Customer-obsessed science
Research areas
-
November 16, 202611 min readNew open-source tool turns existing test suites into sets of formal-verification tasks, which catch buggy solutions that tests alone would miss.
-
November 11, 20265 min read
-
-
-
Featured news
-
NeurIPS 2026 Workshop on Continual Learning in the Era of Foundation Models and Embodied Agents2026We study how a coding agent learns across a sequence of abstract reasoning tasks. The agent runs on a frozen foundation model inside a fixed harness and acts by writing and running Python and shell scripts. The agent retains no state across turns other than its written artifacts, so every thought it forms, carries, corrects or abandons leaves a trace, where a thought is any belief, rule or plan committed
-
2026Deploying large language models for specialized tasks requires lengthy prompts combining schema, demonstrations, and instructions creating a fundamental tension between prompt richness and inference feasibility. We identify and characterize two distinct prompt regimes: pattern-dominant tasks, where demonstrations drive performance through implicit formatting and extraction conventions, and procedure-dominant
-
2026Direct Preference Optimization (DPO) aligns language models using pairwise preference comparisons, offering a simple and effective alternative to Reinforcement Learning (RL) from human feedback. However, in many practical settings, training data consists of multiple rollouts per prompt, inducing rich preference structure that pairwise DPO fails to exploit. Collapsing such data into independent pairs discards
-
COLM 2026 Workshop on Lifelong Agents: Learning, Aligning, and Evolving2026Multi-agent architectures are typically hand-designed, generated in one shot, or evolved through unconstrained code search. None of these treats the number of agents as a searchable parameter, and none can discover that a single agent is optimal. We argue that agent count and coordination topology deserve the same optimization discipline used for neural architectures: bounded edits, held-out validation
-
2026Reinforcement learning is now central to eliciting reasoning in large language models, while in the popular algorithm Group Relative Policy Optimization (GRPO) every token in a rollout receives the same advantage. We ask how to make process supervision efficient: accelerating convergence and improving final quality without the cost of value networks. We propose Bag-of-Tokens Group Relative Policy Optimization
Collaborations
View allWhether you're a faculty member or student, there are number of ways you can engage with Amazon.
View all