Customer-obsessed science
Research areas
-
November 11, 20265 min readStatic analysis of deployed networks helps reduce the risk that sensitive data leaks across partitions, supporting the security and reliability of global-scale networking.
-
-
-
-
October 20, 20263 min read
Featured news
-
2026Language models increasingly act as epistemic proxies, synthesizing evidence from multiple sources to inform decisions. Whether they evaluate the quality of that evidence, or merely aggregate it based on surface presentation, remains poorly understood. We show that models possess the capability to detect fabricated statistics (correct identification rates of 0.90–1.00 for methodology in isolation) but do
-
2026Benchmark quality is critical for meaningful evaluation and sustained progress in time series forecasting, particularly with the rise of time series foundation models (TSFMs). Existing benchmarks often have limited domain coverage or overlook real-world settings such as tasks with covariates. Their aggregation procedures frequently lack statistical rigor, making it unclear whether performance differences
-
2026Enterprise agents act on documents. Before an agent can follow a policy, answer a compliance question or file a ticket, some ingestion layer must turn a Word file or PDF into tokens—and that layer is where an agent deployed in the wild silently loses information. Mature converters recover text, tables and structure faithfully, so the pipeline looks healthy. We show that one layer is lost by all of them—the
-
2026Natural language optimization (NLO) aims to improve an agent by having a model critique and rewrite its natural language policy parameters, e.g., system prompts, tool usage instructions, reasoning directives, few-shot demonstrations. These artifacts are multi-section documents in which some sections encode hard-won contracts (safety clauses, tool schemas, output formats) that must not drift, and others
-
2026Simulating survey responses with LLMs offers a scalable alternative to costly human data collection, yet evaluation methods remain ad hoc and inconsistent. Current metrics, typically borrowed from adjacent domains, focus on accuracy or distributional similarity while overlooking ranking alignment—whether simulations preserve the relative preference orderings observed in human populations. A simulator may
Collaborations
View allWhether you're a faculty member or student, there are number of ways you can engage with Amazon.
View all