Customer-obsessed science
Research areas
-
October 29, 20265 min readTwo optimization techniques, when combined, can significantly improve a model’s speed and cost effectiveness without sacrificing quality.
-
-
October 20, 20263 min read
-
October 12, 202614 min read
-
Featured news
-
2026Deploying large language models for specialized tasks requires lengthy prompts combining schema, demonstrations, and instructions creating a fundamental tension between prompt richness and inference feasibility. We identify and characterize two distinct prompt regimes: pattern-dominant tasks, where demonstrations drive performance through implicit formatting and extraction conventions, and procedure-dominant
-
NeurIPS 20262026Direct Preference Optimization (DPO) aligns language models using pairwise preference comparisons, offering a simple and effective alternative to Reinforcement Learning (RL) from human feedback. However, in many practical settings, training data consists of multiple rollouts per prompt, inducing rich preference structure that pairwise DPO fails to exploit. Collapsing such data into independent pairs discards
-
COLM 2026 Workshop on Lifelong Agents: Learning, Aligning, and Evolving2026Multi-agent architectures are typically hand-designed, generated in one shot, or evolved through unconstrained code search. None of these treats the number of agents as a searchable parameter, and none can discover that a single agent is optimal. We argue that agent count and coordination topology deserve the same optimization discipline used for neural architectures: bounded edits, held-out validation
-
2026Reinforcement learning is now central to eliciting reasoning in large language models, while in the popular algorithm Group Relative Policy Optimization (GRPO) every token in a rollout receives the same advantage. We ask how to make process supervision efficient: accelerating convergence and improving final quality without the cost of value networks. We propose Bag-of-Tokens Group Relative Policy Optimization
-
BMVC 20262026Instruction-guided image editing models excel at following instructions but often introduce unintended changes to source regions that should remain unchanged, a critical failure in high-precision applications like product troubleshooting. Existing reward models primarily evaluate instruction adherence and perceptual quality, but do not explicitly assess whether edits preserve the underlying source content
Collaborations
View allWhether you're a faculty member or student, there are number of ways you can engage with Amazon.
View all