63 Amazon Research Award recipients announced

Awardees, who represent 41 universities in 8 countries, have access to Amazon public datasets, along with AWS AI/ML services and tools.

Amazon Research Awards (ARA) provides unrestricted funds and AWS Promotional Credits to academic researchers investigating various research topics in multiple disciplines. This cycle, ARA received many excellent research proposals from across the world and today is publicly announcing 63 award recipients who represent 41 universities in 8 countries.

This announcement includes awards funded under five call for proposals during the spring 2025 cycle: AI for Information Security, Amazon Ads, AWS AI: Agentic AI, Build on Trainium and Think Big. Proposals were reviewed for the quality of their scientific content and their potential to impact both the research community and society. Additionally, Amazon encourages the publication of research results, presentations of research at Amazon offices worldwide, and the release of related code under open-source licenses.

Recipients have access to more than 700 Amazon public datasets and can utilize AWS AI/ML services and tools through their AWS Promotional Credits. Recipients also are assigned an Amazon research contact who offers consultation and advice, along with opportunities to participate in Amazon events and training sessions.

Amazon's competitive-agent architecture creates a continuous improvement cycle that develops security protections at machine speed, reducing what typically takes weeks down to hours.

"Amazon Research Awards are enabling incredibly impactful work to improve human health—from revolutionizing and democratizing structural biology tools, which can accelerate discovery of candidate molecules for new drugs to help patients, to predicting the etiology of a stroke in order to start the appropriate therapies, or interpreting digital phenotyping data to help with mental health services," said Christine Silvers, AWS Principal Healthcare Advisor. "These are just three examples of projects that recipients have received Amazon Research Awards for. The potential for improving healthcare amongst all of the spring 2025 plus past and future awardees is staggering and inspiring.“

"Academic AI researchers face a fundamental challenge: advancing machine learning research and educating the next generation requires access to cutting-edge infrastructure that's both powerful and affordable," said Yida Wang, AWS AI Principal Applied Scientist. "The Build on Trainium program directly addresses this barrier. We are working with leading AI research universities such as, UC Berkeley, Stanford, CMU, MIT, UIUC, UCLA, and many others.  At CMU, researchers achieved significant improvements over state-of-the-art FlashAttention in just one week. At MIT, researchers trained 3D medical imaging models with 50% higher throughput and lower cost, reducing training time from months to weeks. Build on Trainium represents AWS's commitment to democratizing AI research through collaborative partnership with academia—fostering an environment where researchers experiment freely, students learn on production-scale infrastructure, and academic innovations shape the future of machine learning for everyone."

The tables below list, in alphabetical order by last name, the spring 2025 cycle call-for-proposal recipients, sorted by research area.

AI for Information Security

ARA-AIInfoSecurity-1200x750-02.png

Recipient

University

Research title

Christopher Fletcher

University Of California, Berkeley

Design and Verification of High-Assurance Key Management Services for Stateful Confidential Computing

Zhou Li

University Of California, Irvine

Precise and Analyst-friendly Attack Provenance on Audit Logs with LLM

Yu Meng

University of Virginia

Weakly-Supervised RLHF: Modeling Ambiguity and Uncertainty in Human Preferences

Jelena Mirkovic

University of Southern California

Safe and Secure API Discovery for Agentic AI

Aanjhan Ranganathan

Northeastern University

Understanding How LLMs Hack: Interpretable Vulnerability Detection and Remediation

Sanjit Seshia

University Of California, Berkeley

Design and Verification of High-Assurance Key Management Services for Stateful Confidential Computing

Alexey Tregubov

University of Southern California

Safe and Secure API Discovery for Agentic AI

Ziming Zhao

Northeastern University

Understanding How LLMs Hack: Interpretable Vulnerability Detection and Remediation

Amazon Ads

ARA Spring 2025 recipients

Recipient

University

Research title

Xiaojing Liao

University of Illinois at Urbana–Champaign

Adversarial Misuse of Large Language Models in Digital Advertising: Benchmarking and Mitigation

Tianhao Wang

University of Virginia

Adversarial Misuse of Large Language Models in Digital Advertising: Benchmarking and Mitigation

AWS Agentic AI

ARA Spring 2025 recipients

Recipient

University

Research title

Faez Ahmed

Massachusetts Institute of Technology

AutoDA-Sim: A Multi-Agent Framework for Safe, Aesthetic, and Aerodynamic Vehicle Design

Fabio Anza

University of Maryland, Baltimore County

Physics Co-Pilot: An LLM-Orchestrated Scientific Assistant for Physics Research

Andrea Bajcsy

Carnegie Mellon University

Fine Grained Planning Evaluation for VLM Web Agents

Niranjan Balasubramanian

Stony Brook University

Efficient and Effective Long-Horizon Reasoning for Interactive LLM Agents

Andreea Bobu

Massachusetts Institute of Technology

Contextual Harm Mitigation and Automated Backtracking in Computer Use Agents

Joseph Campbell

Purdue University, West Lafayette

Open-World Probabilistic Theory of Mind

Cong Chen

Dartmouth College

Empowering Power Systems and Market Operations with Behavioral Generative Agents

Chunyang Chen

Technical University of Munich

Functional Bug-Aware Software Testing via Intelligent Computer Use Agents

Shay Cohen

University of Edinburgh

Diffusion-inspired chain-of-thought self-revision

Fernando De la Torre

Carnegie Mellon University

Fine Grained Planning Evaluation for VLM Web Agents

Sidong Feng

Monash University

Functional Bug-Aware Software Testing via Intelligent Computer Use Agents

James Fogarty

University of Washington, Seattle

Leveraging Multiple Representations in Multi-Agent Mobile App Interface Understanding and Task Execution

Surbhi Goel

University of Pennsylvania

Efficient and Safe Protocols for Collaborative Agentic AI

Nika Haghtalab

University of California, Berkeley

Multi-Agent AI Alignment

Irwin King

The Chinese University of Hong Kong

WebAGI: VLM-Driven Framework for Robust Web Automation and Planning in Agentic AI

Emma Lejeune

Boston University

Formidable yet Solvable: Scientific Computing Tasks for Agentic AI

Bang Liu

University of Montreal

Foundation Agents and Protocol for Collaborative Agentic AI

Harsha Madhyastha

University of Southern California

Improving the Efficiency of Web Agents

Michael Macy

Cornell University

Artificial Collective Intelligence: The Structure and Dynamics of LLM Communities

Radu Marculescu

University of Texas at Austin

Collaborative Continual Learning in Multimodal Multi-Agent Systems

Lianhui Qin

University of California, San Diego

ReaL-Agent: A Retrieval-and-Reasoning Agent for Deep, Cross-Modality Retrieval

Mahnam Saeednia

Delft University of Technology

Heterogeneous Multi-Agent Collaboration For Built-in Resilience

Maarten Sap

Carnegie Mellon University

OpenAgentSafety: Measuring and Mitigating Safety Harms of LLM-based AI Agent Interactions

Vitaly Shmatikov

Cornell University

Contextual Security for Multi-Agent Systems

Haim Sompolinsky

Harvard University

Lifelong learning in agentic AI through gated memory modules

John Torous

Harvard University

Interpreting Digital Phenotyping Data with LLM-Based Agentic Assistants for Mental Health Services

Jindong Wang

College of William & Mary

Structure Matters: Task-Optimized Topologies for LLM Agents

Xiaolong Wang

University of California, San Diego

Agentic World Representation

Zhi-Li Zhang

University of Minnesota, Twin Cities

NetGenius: Agentic AI for Next-Generation Wireless Network Autonomous Configurations and Intelligent Operations

Jiawei Zhou

Stony Brook University

Efficient and effective long-horizon reasoning for interactive LLM agents

Build on Trainium

ARA Spring 2025 recipients

Recipient

University

Research title

Saikat Dutta

Cornell University

VERA: Automated Testing for Improving the Reliability of Neuron Compiler Toolchain

Kuan Fang

Cornell University

Fast Adaptation of Multi-Modal Foundation Models for Robotic Perception and Control

Shizhong Han

Lieber Institute for Brain Development

Optimizing and scaling pretraining and preference-based fine-tuning of Large Chemical Models

Sitao Huang

University of California, Irvine

Automatic Kernel Synthesis and Tuning for AWS Trainium via Profile-Guided Graph Topology Optimization

Wataru Kameyama

Waseda University

Accelerating Vision-Language Autonomous Driving with AWS Trainium

Dong Li

University of California, Merced

Efficient Sparse Training with Adaptive Expert Parallelism on AWS Trainium

Xiaoxiao Li

University of British Columbia

Efficient MoE LLMs via Pruning and Matryoshka Quantization on AWS Trainium

Jiang Liu

Waseda University

Accelerating Vision-Language Autonomous Driving with AWS Trainium

Xiaoyi Lu

University of California, Merced

Accelerating Large Language and Reasoning Model Workloads with AWS Trainium

Satoshi Masuda

Tokyo City University

LLM for Software Modeling Brain in Multi Language

Andrew McCallum

University of Massachusetts, Amherst

Overcoming Fundamental Reasoning Limitations of LLMs by Always Thinking before Writing

Xupeng Miao

Purdue University, West Lafayette

Towards Communication-Efficient Distributed Training of Large Foundation Models by Dataflow-aware Optimizations

Michael Nagle

Lieber Institute for Brain Development

Optimizing and scaling pretraining and preference-based fine-tuning of Large Chemical Models

Jean-Christophe Nebel

Kingston University London

Efficient Architectures for Genomic Variant Interpretation: Language Models for Non-Coding DNA Variant Analysis

Farzana Rahman

Kingston University London

Efficient Architectures for Genomic Variant Interpretation: Language Models for Non-Coding DNA Variant Analysis

Rohan Sachdeva

University of California, Berkeley

Learning Host–Microbial Genetic Element Interactions with Genomic Language Models

Yanning Shen

University of California, Irvine

Automatic Kernel Synthesis and Tuning for AWS Trainium via Profile-Guided Graph Topology Optimization

Yun Song

University of California, Berkeley

Learning Host–Microbial Genetic Element Interactions with Genomic Language Models

Hoa Vo

Indiana University Bloomington

AI-Powered Travel Pattern Detection in VR for Occupant Behavior Analysis Using AWS Trainium

Minjia Zhang

University of Illinois Urbana-Champaign

Trainium-native MoE: Developing kernel and system optimizations for efficient and scalable MoE training

Think Big

ARA Spring 2025 recipients

Recipient

University

Research title

Tianlong Chen

University of North Carolina at Chapel Hill

Leveraging Molecular Dynamics to Empower Protein AI Models

William H. Lee

Yale School of Medicine

AI-powered prediction of ischemic stroke etiologies using multi-modal data

Piotr Sliz

Harvard Medical School

SBCloud – A Transformative Model for Scalable Structural Biology Research

Related content

US, WA, Bellevue
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their causal inference and/or structural econometrics skillsets to solve real world problems. The intern will work in the area of Economics Intelligence in Amazon Returns and Recommerce Technology and Innovation and develop new, data-driven solutions to support the most critical components of this rapidly scaling team. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. About the team The WWRR Economics Intelligence (RREI) team brings together Economists, Data Scientists, and Business Intelligence Engineers experts to delivers economic solutions focused on forecasting, causality, attribution, customer behavior for returns, recommerce, and sustainability domains.
US, WA, Bellevue
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their causal inference and/or structural econometrics skillsets to solve real world problems. The intern will work in the area of Economics Intelligence in Amazon Returns and Recommerce Technology and Innovation and develop new, data-driven solutions to support the most critical components of this rapidly scaling team. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. About the team The WWRR Economics Intelligence (RREI) team brings together Economists, Data Scientists, and Business Intelligence Engineers experts to delivers economic solutions focused on forecasting, causality, attribution, customer behavior for returns, recommerce, and sustainability domains.
US, WA, Seattle
Amazon has co-founded and signed The Climate Pledge, a commitment to reach net zero carbon by 2040. As a team, we leverage GenAI, sensors, smart home devices, cloud services, material science, and Alexa to build products that have a meaningful impact for customers and the climate. In alignment with this bold corporate goal, the Amazon Devices & Services organization is looking for a passionate, talented, and inventive Senior Applied Scientist to help build revolutionary products with potential for major societal impact. Great candidates for this position will have expertise in the areas of agentic AI applications, deep learning, time series analysis, LLMs, and multimodal systems. This includes experience designing autonomous AI agents that can reason, plan, and execute multi-step tasks, building tool-augmented LLM systems with access to external APIs and data sources, implementing multi-agent orchestration, and developing RAG architectures that combine LLMs with domain-specific knowledge bases. You will strive for simplicity and creativity, demonstrating high judgment backed by statistical proof. Key job responsibilities As a Senior Applied Scientist on the Energy Science team, you'll design and deploy agentic AI systems that autonomously analyze data, plan solutions, and execute recommendations. You'll build multi-agent architectures where specialized AI agents coordinate to solve complex optimization problems, and develop tool-augmented LLM applications that integrate with external data sources and APIs to deliver context-aware insights. Your work involves creating multimodal AI systems that synthesize diverse data streams, while implementing RAG pipelines that ground large language models in domain-specific knowledge bases. You'll apply advanced machine learning and deep learning techniques to time series analysis, forecasting, and pattern recognition. Beyond technical innovation, you'll drive end-to-end product development from research through production deployment, collaborating with cross-functional teams to translate AI capabilities into customer experiences. You'll establish rigorous experimentation frameworks to validate model performance and measure business impact, building AI-driven products with potential for major societal impact.
US, CA, San Francisco
Amazon launched the AGI Lab to develop foundational capabilities for useful AI agents. We built Nova Act - a new AI model trained to perform actions within a web browser. The team builds AI/ML infrastructure that powers our production systems to run performantly at high scale. We’re also enabling practical AI to make our customers more productive, empowered, and fulfilled. In particular, our work combines large language models (LLMs) with reinforcement learning (RL) to solve reasoning, planning, and world modeling in both virtual and physical environments. Our lab is a small, talent-dense team with the resources and scale of Amazon. Each team in the lab has the autonomy to move fast and the long-term commitment to pursue high-risk, high-payoff research. We’re entering an exciting new era where agents can redefine what AI makes possible. We’d love for you to join our lab and build it from the ground up! Key job responsibilities This role will lead a team of SDEs building AI agents infrastructure from launch to scale. The role requires the ability to span across ML/AI system architecture and infrastructure. You will work closely with application developers and scientists to have a impact on the Agentic AI industry. We're looking for a Software Development Manager who is energized by building high performance systems, making an impact and thrives in fast-paced, collaborative environments. About the team Check out the Nova Act tools our team built on on nova.amazon.com/act
US, WA, Seattle
MULTIPLE POSITIONS AVAILABLE Employer: AMAZON WEB SERVICES, INC. Offered Position: Applied Scientist III Job Location: Seattle, Washington Job Number: AMZ9674037 Position Responsibilities: Participate in the design, development, evaluation, deployment and updating of data-driven models and analytical solutions for machine learning (ML) and/or natural language (NL) applications. Develop and/or apply statistical modeling techniques (e.g. Bayesian models and deep neural networks), optimization methods, and other ML techniques to different applications in business and engineering. Routinely build and deploy ML models on available data, and run and analyze experiments in a production environment. Identify new opportunities for research in order to meet business goals. Research and implement novel ML and statistical approaches to add value to the business. Mentor junior engineers and scientists. Position Requirements: Master’s degree or foreign equivalent degree in Computer Science, Machine Learning, Engineering, or a related field and two years of research or work experience in the job offered, or as a Research Scientist, Research Assistant, Software Engineer, or a related occupation. Employer will accept a Bachelor’s degree or foreign equivalent degree in Computer Science, Machine Learning, Engineering, or a related field and five years of progressive post-baccalaureate research or work experience in the job offered or a related occupation as equivalent to the Master’s degree and two years of research or work experience. Must have one year of research or work experience in the following skill(s): (1) programming in Java, C++, Python, or equivalent programming language; and (2) conducting the analysis and development of various supervised and unsupervised machine learning models for moderately complex projects in business, science, or engineering. Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation. 40 hours / week, 8:00am-5:00pm, Salary Range $167,100/year to $226,100/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, visit: https://www.aboutamazon.com/workplace/employee-benefits.#0000
IN, KA, Bengaluru
Interested to build the next generation Financial systems that can handle billions of dollars in transactions? Interested to build highly scalable next generation systems that could utilize Amazon Cloud? Massive data volume + complex business rules in a highly distributed and service oriented architecture, a world class information collection and delivery challenge. Our challenge is to deliver the software systems which accurately capture, process, and report on the huge volume of financial transactions that are generated each day as millions of customers make purchases, as thousands of Vendors and Partners are paid, as inventory moves in and out of warehouses, as commissions are calculated, and as taxes are collected in hundreds of jurisdictions worldwide. Key job responsibilities • Understand the business and discover actionable insights from large volumes of data through application of machine learning, statistics or causal inference. • Analyse and extract relevant information from large amounts of Amazon’s historical transactions data to help automate and optimize key processes • Research, develop and implement novel machine learning and statistical approaches for anomaly, theft, fraud, abusive and wasteful transactions detection. • Use machine learning and analytical techniques to create scalable solutions for business problems. • Identify new areas where machine learning can be applied for solving business problems. • Partner with developers and business teams to put your models in production. • Mentor other scientists and engineers in the use of ML techniques. A day in the life • Understand the business and discover actionable insights from large volumes of data through application of machine learning, statistics or causal inference. • Analyse and extract relevant information from large amounts of Amazon’s historical transactions data to help automate and optimize key processes • Research, develop and implement novel machine learning and statistical approaches for anomaly, theft, fraud, abusive and wasteful transactions detection. • Use machine learning and analytical techniques to create scalable solutions for business problems. • Identify new areas where machine learning can be applied for solving business problems. • Partner with developers and business teams to put your models in production. • Mentor other scientists and engineers in the use of ML techniques. About the team The FinAuto TFAW(theft, fraud, abuse, waste) team is part of FGBS Org and focuses on building applications utilizing machine learning models to identify and prevent theft, fraud, abusive and wasteful(TFAW) financial transactions across Amazon. Our mission is to prevent every single TFAW transaction. As a Machine Learning Scientist in the team, you will be driving the TFAW Sciences roadmap, conduct research to develop state-of-the-art solutions through a combination of data mining, statistical and machine learning techniques, and coordinate with Engineering team to put these models into production. You will need to collaborate effectively with internal stakeholders, cross-functional teams to solve problems, create operational efficiencies, and deliver successfully against high organizational standards.
IN, KA, Bengaluru
Amazon Health Services (One Medical) About Us: At Health AI, we're revolutionizing healthcare delivery through innovative AI-enabled solutions. As part of Amazon Health Services and One Medical, we're on a mission to make quality healthcare more accessible while improving patient outcomes. Our work directly impacts millions of lives by empowering patients and enabling healthcare providers to deliver more meaningful care. Role Overview: We're seeking an Applied Scientist to join our dynamic team in building state of the art AI/ML solutions for healthcare. This role offers a unique opportunity to work at the intersection of artificial intelligence and healthcare, developing solutions that will shape the future of medical services delivery. Key job responsibilities • Lead end-to-end development of AI/ML solutions for Amazon Health organization, including Amazon Pharmacy and One Medical • Research, design, and implement state-of-the-art machine learning models, with a focus on Large Language Models (LLMs) and Visual Language Models (VLMs) • Optimize and fine-tune models for production deployment, including model distillation for improved latency • Drive scientific innovation while maintaining a strong focus on practical business outcomes • Collaborate with cross-functional teams to translate complex technical solutions into tangible customer benefits • Contribute to the broader Amazon Health scientific community and help shape our technical roadmap
US, CA, Santa Clara
Amazon Quick Suite is an enterprise AI platform that transforms how organizations work with their data and knowledge. Combining generative AI-powered search, deep research capabilities, intelligent agents and automations, and comprehensive business intelligence, Quick Suite serves tens of thousands of users. Our platform processes thousands of queries monthly, helping teams make faster, data-driven decisions while maintaining enterprise-grade security and governance. From natural language interactions with complex datasets to automated workflows and custom AI agents, Quick Suite is redefining workplace productivity at unprecedented scale. We are seeking a Data Scientist II to join our Quick Data team, focusing on evaluation and benchmarking data development for Quick Suite features, with particular emphasis on Research and other generative AI capabilities. Our mission is to engineer high-quality datasets that are essential to the success of Amazon Quick Suite. From human evaluations and Responsible AI safeguards to Retrieval-Augmented Generation and beyond, our work ensures that Generative AI is enterprise-ready, safe, and effective for users at scale. As part of our diverse team—including data scientists, engineers, language engineers, linguists, and program managers—you will collaborate closely with science, engineering, and product teams. We are driven by customer obsession and a commitment to excellence. Key job responsibilities In this role, you will leverage data-centric AI principles to assess the impact of data on model performance and the broader machine learning pipeline. You will apply Generative AI techniques to evaluate how well our data represents human language and conduct experiments to measure downstream interactions. Specific responsibilities include: * Design and develop comprehensive evaluation and benchmarking datasets for Quick Suite AI-powered features * Leverage LLMs for synthetic data corpora generation; data evaluation and quality assessment using LLM-as-a-judge settings * Create ground truth datasets with high-quality question-answer pairs across diverse domains and use cases * Lead human annotation initiatives and model evaluation audits to ensure data quality and relevance * Develop and refine annotation guidelines and quality frameworks for evaluation tasks * Conduct statistical analysis to measure model performance, identify failure patterns, and guide improvement strategies * Collaborate with ML scientists and engineers to translate evaluation insights into actionable product improvements * Build scalable data pipelines and tools to support continuous evaluation and benchmarking efforts * Contribute to Responsible AI initiatives by developing safety and fairness evaluation datasets About the team Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Hybrid Work We value innovation and recognize this sometimes requires uninterrupted time to focus on a build. We also value in-person collaboration and time spent face-to-face. Our team affords employees options to work in the office every day or in a flexible, hybrid work model near one of our U.S. Amazon offices.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, WA, Bellevue
The Mission Build AI safety systems that protect millions of Alexa customers every day. As conversational AI evolves, you'll solve challenging problems in Responsible AI by ensuring LLMs provide safe, trustworthy responses, building AI systems that understand nuanced human values across cultures, and maintaining customer trust at scale. What You'll Build You'll pioneer breakthrough solutions in Responsible AI at Amazon's scale. Imagine training models that set new safety standards, designing automated testing systems that hunt for vulnerabilities before they surface, and certifying the systems that power millions of daily conversations. You'll create intelligent evaluation systems that judge responses with human-level insight, build models that truly understand what makes interactions safe and delightful, and craft feedback mechanisms that help Alexa+ grasp the nuances of complex customer conversations. Here's where it gets even more exciting: you'll build AI agents that act as your team's safety net—automatically detecting and fixing production issues in real-time, often before anyone notices there was a problem. Your innovations won't just improve Alexa+; they'll fundamentally shape how it learns, evolves, and earns customer trust. As Alexa+ continues to delight customers, your work ensures it becomes more trustworthy, safer, and deeply aligned with customer needs and expectations. Your work directly protects customer trust at Amazon's scale. Every innovation you create—from novel safety mechanisms to sophisticated evaluation techniques—shapes how millions of people interact with AI confidently. You're not just building products; you're defining industry standards for responsible AI. This is frontier research with immediate real-world impact. You'll tackle problems that require innovative solutions: training models that remain truthful and grounded across diverse contexts, building reward models that capture the nuanced spectrum of human values across cultures and languages, and creating automated systems that continuously discover and address potential issues before customers encounter them. You'll collaborate with world-class scientists, product managers, and engineers to transform state-of-the-art ideas into production systems serving millions. What We're Looking For * Deep expertise in state-of-the-art NLP and Large Language Models * Track record of building scalable ML systems * Passion for impactful research—where frontier science meets real-world responsibility at scale * Excitement about solving problems that will shape the future of AI Ready to work on AI safety challenges that define the industry? Join us. Key job responsibilities This is where you'll make your mark. You'll architect breakthrough Responsible AI solutions that become industry benchmarks, pioneering algorithms that eliminate false information, designing frameworks that hunt down vulnerabilities before bad actors find them, and developing models that understand human values across every culture we serve. Working with world-class engineers and scientists, you'll push the boundaries of model training—transforming bold research into production systems that protect millions of customers daily while withstanding attacks and delivering exceptional experiences. But here's what makes this role truly special: you'll shape the future. You'll lead certification processes, advance optimization techniques, build evaluation systems that reason like humans, and mentor the next generation of AI safety experts. Every innovation you drive will set new standards for trustworthy AI at the world's largest scale. A day in the life As a Responsible AI Scientist, you're at the frontier of AI safety—experimenting with breakthrough techniques that push the boundaries of what's possible. You partner with engineering to transform research into production-ready solutions, tackling complex optimization challenges. You brainstorm with Product teams, translating ambitious visions into concrete objectives that drive real impact. Your expertise shapes critical deployment decisions as you review impactful work and guide go/no-go calls. You mentor the next generation of AI safety leaders, watching ideas spark and capabilities grow. This is where science meets impact—building AI that's not just intelligent, but trustworthy and aligned with human values. About the team Our team pioneers Responsible AI for conversational assistants. We ensure Alexa delivers safe, trustworthy experiences across all devices, modalities, and languages worldwide. We work on frontier AI safety challenges—and we're looking for scientists who want to help shape the future of trustworthy AI.