Customer-obsessed science
Research areas
-
August 26, 20265 min readDiscounting the opinions of LLM judges with highly correlated outputs ensures that panels of judges reflect a true diversity of perspectives.
-
August 21, 20269 min read
-
July 30, 20268 min read
-
-
July 9, 202610 min read
Featured news
-
When rubrics fail: Error enumeration as reward in reference-free RL post-training for virtual try-on2026Reinforcement learning with verifiable rewards (RLVR) and Rubrics as Rewards (RaR) have driven strong gains in domains with clear correctness signals and even in subjective domains by synthesizing evaluation criteria from ideal reference answers. But many real-world tasks admit multiple valid outputs and lack the single ideal answer that rubric generation depends on. We identify this reference-free setting
-
QRS 20262026Test automation is moving from fixed script replay to agent driven execution and judgement. An agent may read a goal, inspect product state, call tools, recover from small changes, and collect evidence before reporting a result. Existing test case formats do not give enough structure for this style of execution. Plain prompts mix setup, purpose, rules, and steps. Traditional scripts are repeatable, but
-
ICML 2026 Workshop on Combining Theory and Benchmark2026Generative text classifiers, which assign labels by modeling the joint distribution over inputs and labels, have recently regained attention due to strong low-sample performance and a growing perception that they are less prone to shortcut learning than discriminative classifiers. However, existing evidence for shortcut avoidance is often indirect, frequently conflates classifier formulation with architectural
-
2026The rapid evolution of Large Language Models (LLMs) has driven a growing demand for automated, high-performance system kernels to accelerate machine learning workloads. We introduce TRITON RL, a domain-specialized 8B-scale LLM for Triton programming, trained via a novel reinforcement learning (RL) framework. While Triton synthesis faces unique challenges, including data scarcity and a high susceptibility
-
DARS 20262026We propose a novel algorithm for forming arbitrarily shaped assemblies using decentralized robots. By relying on local interactions, the algorithm ensures there are no unreachable states or gaps in the assembly, which are global properties. The in-assembly robots attract passing-by robots into expanding the assembly via a simple implementation of signaling and alignment. Our approach is minimalistic, requiring
Collaborations
View allWhether you're a faculty member or student, there are number of ways you can engage with Amazon.
View all