Customer-obsessed science
Research areas
-
October 29, 20265 min readTwo optimization techniques, when combined, can significantly improve a model’s speed and cost effectiveness without sacrificing quality.
-
-
October 20, 20263 min read
-
October 12, 202614 min read
-
Featured news
-
COLM 2026 Workshop on Lifelong Agents: Learning, Aligning, and Evolving2026Exact-match retrieval recall is often used as a proxy for whether a retriever supplies useful policy context to a downstream decision model. We test this proxy for pre-action policy classification in τ-bench using Qwen2.5-3B/7B classifiers. Under gold-policy conditioning, a compact structured state improves macro-F1 over raw trajectories by 0.20 after tuning at 3B, with the same ordering at 7B under shared
-
NeurIPS 2026 Workshop on Continual Learning in the Era of Foundation Models and Embodied Agents2026We study how a coding agent learns across a sequence of abstract reasoning tasks. The agent runs on a frozen foundation model inside a fixed harness and acts by writing and running Python and shell scripts. The agent retains no state across turns other than its written artifacts, so every thought it forms, carries, corrects or abandons leaves a trace, where a thought is any belief, rule or plan committed
-
2026Deploying large language models for specialized tasks requires lengthy prompts combining schema, demonstrations, and instructions creating a fundamental tension between prompt richness and inference feasibility. We identify and characterize two distinct prompt regimes: pattern-dominant tasks, where demonstrations drive performance through implicit formatting and extraction conventions, and procedure-dominant
-
NeurIPS 20262026Direct Preference Optimization (DPO) aligns language models using pairwise preference comparisons, offering a simple and effective alternative to Reinforcement Learning (RL) from human feedback. However, in many practical settings, training data consists of multiple rollouts per prompt, inducing rich preference structure that pairwise DPO fails to exploit. Collapsing such data into independent pairs discards
-
COLM 2026 Workshop on Lifelong Agents: Learning, Aligning, and Evolving2026Multi-agent architectures are typically hand-designed, generated in one shot, or evolved through unconstrained code search. None of these treats the number of agents as a searchable parameter, and none can discover that a single agent is optimal. We argue that agent count and coordination topology deserve the same optimization discipline used for neural architectures: bounded edits, held-out validation
Collaborations
View allWhether you're a faculty member or student, there are number of ways you can engage with Amazon.
View all