📬

Email Newsletters

1 item
Hannah Zhang

A practical guide to escaping the golden handcuffs

The guide addresses the dilemma of balancing personal fulfillment and financial support during a career transition, often referred to as "golden handcuffs." It suggests that many people stay in jobs because the financial security makes leaving feel irrational, despite a lack of fulfillment. The author shares her experience leaving Google after a period of internal conflict over pursuing dreams versus financial stability. The core advice is to focus on deeper questions—finding fulfillment and financial support—before making a move away from a predictable W-2 job. Ultimately, the focus should shift from just calculating finances to trusting oneself in making the decision.

EthicsPolicy
📰

Blog Posts & Articles

17 items
Policy & Industry
VentureBeat - AI

Enterprise AI agents are only as reliable as the messiest documents behind them

Current enterprise AI relies on context engineering, which fails when knowledge is fragmented across independent systems, leading to inconsistent information and difficult change propagation. This fragmentation is a knowledge management problem, not just a context problem, because different teams repeatedly build overlapping pipelines. A shared enterprise knowledge platform is required to manage knowledge as a shared asset across the organization. This platform organizes knowledge through four layers: Raw, Refined, Integrated, and Serving, publishing reusable representations for AI applications. Investing in this foundational data and knowledge platform is the key competitive advantage for reliable enterprise AI.

AgentsResearchPolicy
MarkTechPost

Harvey Introduces Harvey Tenet: A Kimi K3 Base Post-Trained with Fireworks for Long-Horizon Legal Agent Work

Harvey introduced Harvey Tenet, a model post-trained with Fireworks using asynchronous reinforcement learning on long-horizon legal work. This training combined synthetic, public, and human expert data, without using customer data. Tenet significantly outperformed the base Kimi K3 model on legal benchmarks, showing transferred improvements to other agent systems. The research demonstrates that quality and cost improved simultaneously through reward shaping on trajectory length. Harvey Tenet is currently a research preview, not a publicly released artifact, with deployment planned for future integration.

AgentsResearchPolicy
The Guardian - Artificial Intelligence

An AI ‘debt bomb’ crisis? No. This isn’t Enron 2.0 | Gene Marks

Fears of an AI "debt bomb" crisis stemming from datacenter buildouts are exaggerated, as the risks are different from past financial crises. Large tech companies finance datacenter construction by using off-balance-sheet financing structures, which were common in past industries like biotech. While scrutiny exists, current accounting standards and public awareness are much higher than in previous eras. The modern risks involve physical assets and computing infrastructure, which are more recoverable than past failures. Legitimate demand for datacenter capacity, driven by AI, indicates that these investments have a foundation despite potential financial shortfalls.

PolicyEthics
The Guardian - Artificial Intelligence

It’s unwise to end local scrutiny of NHS trusts | Letters

Local scrutiny by informed practitioners is considered an essential check on the powers of a centralizing Department of Health and health minister. Abolishing the role of statutory governors on NHS trusts is deemed ill-advised by some. Jonathan Phillips expressed concern over the abolition of Healthwatch, which provides an independent body for local concerns. These concerns relate to the centralization of hospital oversight and access to health services. The authors hope that public concern can prevent the centralization of hospital oversight.

PolicyEthics
Models & Developer Tools
MarkTechPost

Scientific Data Analysis with LabPlot in Python: Signal Processing, Spectral Peak Fitting, Visualization, and Batch Automation

The tutorial details a LabPlot-inspired workflow in Python for scientific data analysis, incorporating signal processing, spectral peak fitting, and visualization. It builds reusable components for importing data, performing statistical calculations, signal manipulation (smoothing, differentiation, Fourier analysis), and fitting nonlinear models like Gaussian. The process is applied to a spectroscopy example involving interference removal, peak identification, and multi-Gaussian fitting, extended for batch automation. The code implements numerous analytical kernels, including transforms, filtering, and advanced nonlinear fitting routines with statistical diagnostics. Finally, the framework includes visualization elements like XYCurve and Histogram, and supports loading data via ASCII format.

ResearchModels
Towards Data Science

Survival Analysis and the Cox Proportional Hazards Model: A Beginner-Friendly Guide

Survival analysis addresses situations where data is censored, which occurs when the event of interest has not yet happened for some subjects by the end of the observation period. The Cox proportional hazards model estimates covariate effects on the instantaneous rate of an event, known as the hazard function. The model's key feature is the hazard ratio, which scales the baseline hazard, and it is based on the assumption that these ratios are constant over time (proportional hazards). Kaplan-Meier curves estimate survival probability, while the Cox model allows adjustment for covariates. When the proportional hazards assumption is violated, methods like stratification or modeling time-varying effects are used for correction.

Research
Towards Data Science

Parse the Folder, Not Just the PDFs: The Relational Tables RAG Needs on a Case File

A case file is best treated as a bundle of unlike documents about one entity, rather than a single document or corpus. Effective Retrieval-Augmented Generation (RAG) for case files requires parsing the folder into relational tables first to understand the required structure. This structure involves creating an index that lists what a specific case type demands, enabling checks for missing documents and contradictions. Retrieval is insufficient for complex case file queries, necessitating mechanical comparisons of extracted, typed values. The final answer should be a composed object detailing the state of the case, rather than a simple retrieved passage.

ResearchAgents
RL Reddit

[P] DigiCrest-RL: Transforming 8 Anime Crests into an Executable Multi-Agent Reinforcement Learning Prototype

DigiCrest-RL is an executable Multi-Agent Reinforcement Learning (MARL) prototype that maps eight anime crest personality traits (Courage, Friendship, Love, Knowledge, Sincerity, Reliability, Hope, Light) into an RL framework. It investigates the effect of trait-driven reward shaping on individual policy learning and multi-agent coordination in a shared environment. The system analyzes how eight heterogeneous agents manage competition, specialization, and collaboration within a shared state space. The prototype features trait-driven reward shaping, MARL dynamics, and a complete Python implementation for setup and training. The work aims to explore the relationship between abstract personality traits and agent behavior in reinforcement learning.

AgentsModelsResearch
RL Reddit

What makes reinforcement learning so hard to apply in the real world?

Applying reinforcement learning in the real world is challenging due to differences between controlled experiments and real-world situations. Key difficulties include managing exploration, delayed rewards, and unexpected states when environments change. Companies like GeekyAnts emphasize that handling complex real-world challenges is crucial for developing reliable systems. Moving from experimental settings to practical applications presents the biggest hurdle for those working with RL.

ModelsResearch
RL Reddit

I built an open-source roguelike specifically for training game-playing agents

A developer created an open-source roguelike game. The game was specifically designed for the purpose of training game-playing agents. This project was submitted by the user /u/SnyderConsulting. The submission includes a link and comments section for further interaction. The project's focus is on agent training within a roguelike environment.

AgentsResearch
Safety, Ethics & Society
MIT Technology Review - AI & Emerging Tech

Kids outlearn AI—and we still don’t know why

Children can learn human language with significantly less data than large language models, highlighting a "data efficiency gap." This difference suggests that children's learning process may be more effective than the massive data-driven methods used to train current AI. Researchers are investigating how children acquire language to develop more data-efficient AI models. Studies involving children's experiences, such as SAYCam, and new competitions like BabyLM explore using real-world sensory data for machine learning. Ultimately, understanding this gap could lead to better AI and deeper insights into human language acquisition.

ModelsResearchEthics
The Guardian - Artificial Intelligence

Black Box: episode 1 – The connectionists – podcast

The podcast episode explores the world of artificial intelligence, examining its potential dangers and promises for society. It focuses on Geoffrey Hinton, who worked with researchers developing a powerful technology whose inner workings remain misunderstood. The episode addresses the collision between human and artificial intelligences, described as two "black boxes." This interaction is already having significant consequences. The broadcast took place on March 4, 2024.

ResearchEthics
The Guardian - Artificial Intelligence

Ella Baron on AI and the drought – cartoon

Ella Baron created a cartoon addressing the intersection of artificial intelligence and drought. The artwork visually explores the connection between these two major global issues. The specific details of the cartoon's content are not provided in the excerpt. The piece serves as a commentary on the relationship between AI advancements and environmental challenges like drought.

EthicsResearch
Towards Data Science

Bug Detection Blind Spots in AI Coding Harnesses (GStack and Beyond)

Debugging experiments on AI coding agents revealed that they struggle less with algorithmic complexity and more with missing contextual information. While agents successfully fixed hard bugs in Immer and decimal.js by reasoning about the code, they failed when the correct fix depended on understanding external, real-world constraints, such as how users might manipulate input data. For a simple bug in ky, agents consistently found a fix that passed visible tests but introduced a critical flaw by corrupting user data in the payload. This suggests that failure modes arise not from difficulty, but from the agents' inability to reason about the context outside the immediate code they are analyzing. Ultimately, success depends on the AI's ability to infer necessary information from the codebase and bug report, and to execute multi-step reasoning effectively.

AgentsResearchSafety
RL Reddit

Tested whether "shaped" reward actually prevents reward hacking better than naive survival reward — the shaped one exploited harder

A custom gridworld was used to test whether a "shaped" reward better prevents reward hacking than a naive survival reward. The experiment involved five reward configurations against a random policy baseline, measuring a "task\_score" metric. The naive reward led the agent to actively avoid the task, while the shaped reward exploited a specific mechanism. The shaped reward's per-step temperature penalty was found to be so dominant that the optimal policy was to indefinitely occupy a coolant cell. This suggests that any dense per-step term can be exploited to encourage state occupancy rather than task completion.

ModelsResearchEthics
Robotics
RL Reddit

A Robot Dog Trained Entirely on Dog's Video (video to PPO2 RL)

A robot dog was trained exclusively using videos of dogs. This training methodology was applied within a Proximal Policy Optimization (PPO) reinforcement learning framework. The research details the process of using video data to teach robotic behavior. The goal of the study was to demonstrate successful training of a robot dog based solely on visual input. The work falls under the domain of video-to-PPO2 reinforcement learning.

RoboticsResearchModels
RL Reddit

[Project] A cheap webcam pose-tracking teleop rig for legged robots — useful for generating training data at low cost?

A webcam tracks a person's real-time body pose to directly control the joints of two open-source quadruped robots. This setup allows for pose-based teleoperation, providing a low-cost method to generate movement demonstrations. The system is cheap to run as it uses a browser-based pipeline without specialized hardware. This process is proposed as a low-cost way to collect data for imitation learning or seeding reinforcement learning policies. The discussion questions the impact of pose-estimation noise on the quality of downstream AI training.

RoboticsResearchAgents
🔬

Latest Research Papers

29 papers · arXiv
arXiv - cs.AI

SDAD: Spec-Driven Agentic Development for the AI-Native SDLC

Frontier coding agents, powered by large language models, are reshaping the Software Development Life Cycle (SDLC) through rich context handling. Spec-Driven Agentic Development (SDAD) formalizes this process by emphasizing intent capture, machine-readable specifications, and agentic synthesis. SDAD integrates disciplined upfront formalization with high-velocity implementation, involving multi-agent verification under human sign-off. The work compares Human-Agile with Agentic-SDAD, introducing quantitative governance metrics for accountability and security. The paper concludes that agentic speed necessitates relocating engineering discipline upstream into precise specifications and auditable provenance.

AgentsResearchPolicy
arXiv - cs.AI

PrimeAgentOrchestrator: Memory-Primed Agent Spawning for Personal AI Infrastructure

PrimeAgentOrchestrator (PAO) is a system designed to spawn new instances of coding agents pre-loaded with relevant memories from personal databases. PAO achieves this by querying two distinct memory backends—a PostgreSQL database and a Cloudflare Worker index—and fusing the results. It manages the entire agent lifecycle, including trust pre-seeding and adaptive context delivery via filesystem injection. The work reports on four months of deployment and documents the engineering trade-offs of integrating heterogeneous memory systems. This process involves managing context delivery mechanisms and failure modes to bridge different memory sources.

AgentsModelsResearch
arXiv - cs.AI

Truth Lies Deep: Countering Semantic Camouflage via Latent Intent Verification

Safety alignment in LLMs is often superficial, failing to erase harmful knowledge acquired during pretraining. Semantic Camouflage involves adversarial attacks that disguise harmful intent within benign narratives, bypassing standard safety guardrails. Analysis of model activations reveals an "Intent Horizon," a layer depth where harmful intent representation collapses during contextualization. Early-layer representations, however, retain a distinct "harm signature" despite late-layer outputs appearing safe. The proposed Latent Intent Verification (LIV) defense effectively neutralizes these attacks, outperforming standard guardrails by 20-50%.

ModelsSafetyEthics
arXiv - cs.AI

A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications

Advances in large language models have spurred research into agentic frameworks that enable reasoning and action. Large multimodal models enhance these systems by allowing processing of diverse data like images, audio, and video. This survey analyzes the impact of multimodality across the core agentic functions: perception, reasoning, planning, memory, and action. It examines integration techniques and the emergence of multimodal agentic behaviors in domains like robotics and video understanding. The work also discusses performance, efficiency trade-offs, and a roadmap for developing robust intelligent systems.

AgentsModelsResearch
arXiv - cs.AI

Interpretable Multimodal Classification with Linear Discriminant Tree Ensembles

The research develops a framework using tree-based ensembles to achieve interpretable multimodal classification of text, audio, and visual data. This approach aims to balance predictive accuracy with the generation of human-understandable explanations for decision-making. The framework encodes modalities, reduces dimensionality, and utilizes classifiers like Linear Discriminant Tree (LDT) ensembles. Proposed methods show F1-mod gains over multimodal Transformers and extract feature importance with higher human agreement. The resulting feature importance highlights salient inter-modal concepts with improved agreement scores.

ModelsResearchEthics
arXiv - cs.AI

Representation Affects Retrieval: A Case Study of Skill Discovery and Routing in a Multimodal Agent Harness

A multimodal agent harness needs to select the most appropriate skill from a library for a user task. The study examines how different methods of skill representation affect this selection process in a small-scale context. The research used a multimodal video agent harness to represent skills as tool-skills and workflow-skills exposed in the system prompt. Findings indicate that in-prompt skill exposure is not always helpful, as partial exposure can cause lexical competition that suppresses the correct selection. This observation is connected to large-scale retrieval-based skill routing.

AgentsResearchModels
arXiv - cs.AI

Nexus: Depth-Adaptive KV-Cache Splicing and Retrieval-Decoupled Tool Routing for Agentic LLMs on Unified Memory

Nexus decouples tool routing from schema prefill costs using an INT8 semantic lookaside buffer and retrieval. It routes tools based on retrieval from a compressed textual signature rather than the full key/value cache. This approach maintains routing accuracy while achieving a first-argument token generation 1.66x sooner and saving about 80% of main-context tokens. A secondary mechanism transplants compiled schema KV blocks, with error correction for attention corruption beyond a certain depth. The method guarantees output fidelity but focuses on speedups, with performance dependent on depth and specific model tuples.

ModelsAgents
arXiv - cs.AI

Environmental Slow AI: Design Principles for Generative Systems

Generative AI systems reflect embedded cultural values through their design, which can be intentionally reshaped. The paper proposes design principles rooted in environmental sustainability, aligning with the concept of Slow AI. Five principles are articulated: restraint, sufficiency, selectivity over retention, material visibility, and friction as affordance. These principles aim to restore human agency by integrating reflective engagement into system design. Ultimately, the principles seek to shift AI development towards environmental sustainability as a core value.

EthicsResearch
arXiv - cs.AI

When Retrieval Fails Before It Begins: Structurally Indirect Prerequisite Eviction as a Retention Failure in Agentic Memory

Agentic memory involves retention and retrieval, but existing methods assume necessary evidence survives eviction. This paper introduces "structurally indirect prerequisite eviction" as a pre-retrieval failure mode where upstream blocks are discarded under budget pressure. The research provides a benchmark and diagnostics for this failure mode in agentic memory. A proposed method, Dependency-aware Semantic Garbage Collection (DSGC), was evaluated and showed significant retention improvements. DSGC successfully increased full-chain retention from 0.03 to 0.90 using lexical and sentence encoders.

AgentsResearch
arXiv - cs.AI

World models of environment, agent and joint agent-environment systems

World models are crucial for model-based reinforcement learning, typically predicting variables like observations, rewards, or states. The authors propose a distinction based on which channel the model predicts: the environment, the agent, or the joint system. They define canonical predictive models using $\epsilon$-transducers to represent these three channels. The research constructs canonical support-restricted models induced by closed-loop coupling, showing that environment states factor through joint causal states. This framework demonstrates how coupling and support restriction alter the canonical predictive structure and complexity of world models.

ModelsAgentsResearch
arXiv - cs.LG

Bankruptcy Prediction via Hybrid Resampling and Stacking Ensemble Techniques with Explainable Artificial Intelligence (XAI)-Driven Analysis

A framework was developed to predict bankruptcy by integrating feature selection, hybrid resampling, stacking ensembles, and Explainable Artificial Intelligence (XAI). The study used the Taiwanese Bankruptcy Prediction dataset, applying various resampling methods like SVM-SMOTE, SMOTE-Tomek, and SMOTE-ENN to balance the data. Five ensemble models and five deep learning models were compared, with hybrid stacking ensembles combining these classifiers as base learners and deep learning models as meta-learners. The SMOTE-ENN strategy proved effective for minority-class detection, and the GRU model with SMOTE-ENN achieved the best predictive balance. SHAP analysis indicated leverage, profitability, solvency, and operational efficiency as key bankruptcy predictors.

ModelsResearchEthics
arXiv - cs.LG

Machine Learning and ARIMA Model Averaging for Adaptive Public Health Forecasting: Comparative Evaluation and an Ontario COVID-19 Case Study

The study compared ARIMA, Random Forest, and XGBoost models for forecasting Ontario COVID-19 cases using 190 weekly observations from 2020 to 2023. The researchers developed Machine Learning and ARIMA Model Averaging (MLAMA), an ensemble method that weighted forecasts based on forecast horizon and responsiveness. ARIMA adapted quickly but had increasing error at longer horizons, while Random Forest and XGBoost offered more stable error across longer periods. MLAMA consistently achieved the lowest normalized mean absolute percentage error across various forecast horizons. The findings suggest selecting forecasting models based on specific operating conditions rather than a single universal approach.

ModelsResearchHealthcare
arXiv - cs.LG

From Thermal Preference Prediction to Adaptive Thermal Intervention: A Reinforcement Learning Approach Using Physiological and Environmental Sensing

Personalized thermal comfort requires moving beyond static HVAC setpoints by accounting for individual physiological variability. This research proposes a two-stage approach using reinforcement learning to achieve adaptive thermal intervention. The method integrates multimodal physiological and environmental sensing to predict thermal preferences. Reinforcement learning is then used to make adaptive decisions for controlling the thermal environment. This system aims to create more responsive building control strategies based on individual needs.

ResearchModels
arXiv - cs.LG

BF1: A Causal Dyadic Sparse-Attention Retrofit for Efficient Long-Context Transformers

Dense causal attention is expensive for long contexts, prompting the study of BF1, a sparse-attention retrofit. BF1 uses a deterministic dyadic sparse-attention route combining local, global, and historical blocks. This approach achieves $O(n \log n)$ token interactions and $\mathcal{O}(\log n)$ communication depth per layer. Implementation on an NVIDIA GPU shows a $10.91\text{x}$ prefill speedup for $32\text{K}$ tokens. Retrofitting layers reduces warm whole-model time by $7.7\%$ to $15.3\%$ for various context lengths.

ModelsResearch
arXiv - cs.LG

Approximate Homomorphisms and Convergent Representations in Transducers

The study investigates the stability of minimal representations of controlled stochastic processes, specifically transducers, under perturbations. The research introduces concepts like approximate homomorphisms to capture local structural similarity between these representations and metrics for comparing their induced dynamics. For standard transducers, the work shows that approximate homomorphisms exist for linear transducers when the interface is sufficiently close to a simple one. This stability result extends to predictive transducers under mild conditions on belief state indistinguishability. These findings offer theoretical support for the hypothesis that latent representations in AI models exhibit structural convergence when embedded.

ResearchModels
arXiv - cs.LG

Wrong-Physics Backdoors in Neural PDE Operators

Neural PDE operators can be vulnerable to "wrong-physics backdoors" through cross-parameter relinking. This attack leverages failures in tensor-to-parameter provenance in multi-parameter archives to select a valid solution from an incorrect physical parameter. The resulting output remains physically plausible but is incorrect for the intended parameter. Experimental results on various PDEs showed that models like Fourier Neural Operators could achieve a 1.0000 success rate in backdoors while maintaining low clean error. This highlights a validation gap where mere smoothness is insufficient without verifying the provenance of the intended physical parameters.

ModelsResearch
arXiv - cs.LG

Decision Tree and K-Means Analysis of Raman Spectra for Edible Oils: A Physics-Informed AI Approach

A machine learning framework using Raman spectroscopy and Physics-Informed AI was developed to authenticate edible oils. Unsupervised analysis showed that pure oils had stronger class organization, while food-matrix effects caused spectral overlap. Decision Trees achieved 100% accuracy for pure oils using only four representative Raman variables. Physics-Informed AI spectral decomposition improved classification for matrix-containing samples by separating oil signatures. This research demonstrates that compact, physically meaningful spectral representations enable accurate and interpretable oil identification.

ResearchModels
arXiv - cs.LG

Shared Physics Responses Recover Hidden Rankings in Neural Operator Libraries

The method uses a squared Hilbert-space loss to rank a library of neural operators based on the low-dimensional span of candidate differences. A single anchor-based linearized response of the governing equation is used to score all models simultaneously, providing a shared physical diagnostic. This approach accurately recovered over 99.6\% of pairwise preferences and 99.0\% of optimal checkpoints across various operator libraries. The resulting physical proxy often outperformed individual best candidates, enabling reliable deployment without ground-truth data.

ResearchModels
arXiv - cs.LG

Stored in Optimizer State, Valued by Later Training: A Causal Account of Subliminal Trait Transfer

Subliminal trait transfer involves acquiring behavioral dispositions from teacher data without semantic expression. The research proposes that parameters and optimizer moments constitute a single trainer state that carries source perturbations. State surgery reveals that transplanting the first moment causally transfers the source difference, leading to changes in subsequent training. Later training then assigns a value to this transferred information, determining the final behavioral readout. This identifies a two-stage mechanism where optimizer state transports the perturbation, and subsequent training determines its behavioral significance.

ModelsResearchEthics
arXiv - cs.LG

Amortized Bandwidth Learning for Kernel Density Estimation under Logarithmic Score

An amortized learning framework is proposed to learn bandwidth selection for kernel density estimation by optimizing the logarithmic score across a distribution of tasks. This method uses a truncated-and-renormalized bounded-support formulation and affine standardization to ensure stable and transferable learning across heterogeneous density estimation tasks. Experiments demonstrate that this amortized selector significantly outperforms classical selectors like Silverman's rule and least-squares cross-validation. The framework shows especially large gains when dealing with small and heterogeneous samples. This approach allows a single trained selector to be applied effectively to finite samples from unknown densities.

ResearchModels
arXiv - stat.ML

Uncertainty propagation in auto-regressive random neural network models

The research develops analytical and particle-based methods for uncertainty propagation in random neural network models where inputs and parameters are random. It uses a local approximation derived from the Leaky ReLU activation to compute probability density functions and characteristic functions for network outputs. The framework is extended to autonomous dynamical systems where the evolution map is a random neural network, resulting in recursive equations for propagating uncertainty over time. These equations explicitly account for the state-parameter cross-covariance that develops during successive iterations. Numerical experiments on the Lorenz-63 system and Kuramoto-Sivashinsky equation confirm the framework's accuracy in propagating uncertainty through the predictability horizon.

ModelsResearch
arXiv - stat.ML

Minimax Optimality of Score-Entropy Discrete Diffusion

Score-entropy discrete diffusion (SEDD) models are effective for generating data across various formats. This work investigates the statistical limits of concrete score estimation in discrete diffusion models, focusing on uniform and masking diffusions. The authors establish a minimax lower bound for score estimation under the score-entropy loss. They propose a Maximum Likelihood Estimation (MLE)-based thresholding estimator that closely matches this lower bound. This implies that SEDD can achieve nearly optimal minimax sample complexity for generating target distributions.

ModelsResearch
arXiv - stat.ML

The Exceedance Design Effect: Effective Sample Size for Thresholds under Clustering

Machine learning thresholds, such as those used in conformal predictors, rely on calibration sets whose examples are often correlated. Standard methods for discounting correlated data, known from survey statistics, are insufficient for threshold settings. The effective sample size required for a threshold depends on how clustered scores fall relative to that threshold. A dataset does not have a single effective sample size but rather one for each threshold level. This effect can be missed in coverage averaged over many runs, significantly impacting deployed system reliability.

ResearchModels
arXiv - stat.ML

When Clean Data Hurts: Learning with Monotone Corruptions Beyond Binary Classification

Optimal learning under the i.i.d. assumption is disrupted when training data is corrupted with correctly labeled, monotone adversarial examples. This corruption increases error rates for all known optimal binary learners, showing a lower bound of $\Omega (d \log(n / d) / n)$. The research demonstrates that monotone adversaries are significantly more powerful in multiclass classification and partial binary concept classes. Despite these limitations, learnability is maintained when the number of adaptive additions is $o(n)$. Achievable error rates are shown against various restricted adversarial settings.

ModelsResearchSafety
arXiv - stat.ML

EDGE: a closed-form directed test for the calibration of probabilistic binary classifiers

EDGE is a closed-form directed test designed for calibrating probabilistic binary classifiers. It analyzes reliability diagrams, plotting standardized bin residuals onto a basis of smooth calibration-distortion shapes. The test has a closed-form null distribution based on chi-square variables, allowing it to be computed quickly without refitting or resampling. EDGE remains effective across various misspecifications and is computable where refit-based tests are not, offering a theoretical limit for miscalibration.

ModelsResearch
arXiv - stat.ML

Conditional-Independence-Regularized Distributional Autoencoders for Mixed-Type Data

The method introduces Conditional-Independence-Regularized Distributional Autoencoders to learn low-dimensional representations of mixed-type data. It achieves this by combining energy-score objectives for numerical variables and likelihood objectives for categorical variables. A key component is an auxiliary conditional independence regularization term to capture the dependence between numerical and categorical components. Theoretical analysis shows the optimal representation balances numerical variability, categorical entropy, and conditional dependence. Empirically, the approach successfully recovers categorical distributions and preserves mixed-type dependence structures in real-world data.

ModelsResearch
arXiv - stat.ML

Let Time Tell: Identification and Gaussian Process Estimation for Interrupted Time Series

The study addresses causal inference in interrupted time series where contemporaneous controls are unavailable, requiring counterfactual estimation from pre-treatment history. Identification is established within the potential outcomes framework, and the counterfactual is estimated using Gaussian process regression. The method accounts for the fact that the estimator retains functions consistent with pre-treatment data while widening intervals where extrapolation causes divergence. A bias decomposition is derived, isolating the extrapolation inflation component, which justifies the Gaussian process variance as extrapolation-aware uncertainty. The approach is illustrated with simulations and an analysis of handgun purchases following a legal decision.

ResearchModels
arXiv - stat.ML

A Critical Audit of Spatiotemporal Forecasting Benchmark Datasets and Baselines

Researchers critically audited popular benchmark datasets and baselines used in spatiotemporal forecasting, such as Chickenpox and PEMS-BAY. The study analyzed these benchmarks using classical time series methods to reveal biases. The analysis uncovered that spatially-unaware linear models perform better than previously reported against Graph Neural Networks (GNNs). This work suggests that over-reliance on these datasets for method comparison is problematic. The authors advocate for more rigorous statistical evaluation instead.

ResearchModels
arXiv - stat.ML

TRACE-C: Rank-Calibrated Relational Anomaly Detection for Multi-Stream Operational Telemetry

TRACE-C is a rank-calibrated detector designed for identifying anomalies in multi-stream operational telemetry where individual streams may be normal. It uses three window channels derived from rolling median/MAD residuals, Gaussian copula-form dependence contrast, and AR(1) innovation. These channels are fused by rank aggregation against earlier estimates to provide a ranked anomaly score. Evaluation on Great Britain grid streams demonstrated its ability to rank specific events, though channel ablation showed context dependency. The method includes interpretive limits clarifying that resulting p-values are selection quantities, not event probabilities.

ResearchModels