Customer-obsessed science
Research areas
-
October 29, 20265 min readTwo optimization techniques, when combined, can significantly improve a model’s speed and cost effectiveness without sacrificing quality.
-
-
October 20, 20263 min read
-
October 12, 202614 min read
-
Featured news
-
SOSP 20262026Foundation model (FM) inference platforms must manage scarce accelerator capacity distributed unevenly across regions. They must also handle requests whose token consumption varies widely and may be revealed progressively during generation, while sharing capacity across workloads with different latency and throughput objectives. This paper describes the architecture of the Workload Management System (WLM
-
2026Fine-tuned small language models (SLMs) are attractive defaults for large-scale structured attribute generation—producing values such as materials, colors, or dimensions from product descriptions—as they are inexpensive to serve. However, a fine-tuned SLM is not reliable everywhere as its correctness varies sharply, so deploying it still requires deciding, per output, whether to keep the SLM's value or
-
ICDM 20262026Optimizing embedding systems for production recommendation pipelines demands systematic exploration that consumes disproportionate engineering effort at scale. We apply Andrej Karpathy's AutoResearch paradigm [1]—a large language model that iteratively edits a training script and retains modifications that improve a held-out scalar metric—to automate this exploration. We report on twelve weeks of running
-
2026A key challenge in reliable LLM deployment is recognizing when uncertainty reflects irreducible variability in the task rather than limitations in the model's knowledge. In language tasks, a central source of such aleatoric uncertainty is input ambiguity or underspecification, where multiple interpretations remain plausible. Existing decomposition methods estimate aleatoric uncertainty by generating multiple
-
EMNLP 2026 Workshop for Research on Agent Language Models (REALM)2026Autonomous GUI agents have achieved near-perfect task completion on touchscreen benchmarks by tapping directly at target coordinates. However, smart televisions, game consoles, and set-top boxes require users to navigate with a directional pad (D-PAD), turning element selection into a planning problem over an unknown focus-transition graph. We study autonomous task completion on streaming TV devices, where
Collaborations
View allWhether you're a faculty member or student, there are number of ways you can engage with Amazon.
View all