Social
amazon research awards recipients logo.jpg
Amazon today publicly announced 74 recipients from the Amazon Research Awards Fall 2021 call for proposals. The recipients, who represent 51 universities in 17 countries, have access to more than 300 Amazon public datasets, and can utilize AWS AI/ML services and tools.

75 Amazon Research Awards recipients announced

The awardees represent 52 universities in 17 countries. Recipients have access to more than 300 Amazon public datasets, and can utilize AWS AI/ML services and tools.

By Amazon Research Awards team
July 18, 2022
8 min read
Share

The Amazon Research Awards is a program that provides unrestricted funds and AWS Promotional Credits to academic researchers investigating research topics across a number of disciplines.

Today, we’re publicly announcing 75 award recipients who represent 52 universities in 17 countries. Each award is intended to support the work of one to two graduate students or postdoctoral students for one year, under the supervision of a faculty member.

Top row, left to right: Aws Albarghouthi, Nada Amin, Clark Barrett, Ivan Beschastnikh, William Bowman, Yinzhi Cao, Trevor Carlson, Marsha Chechik; second row, left to right: Cas Cremers, Derek Dreyer, Marcelo Frias, Sicun Gao, Roberto Giacobazzi, Ronghui Gu, Jean-Baptiste Jeannin, Steve Ko; third row, left to right: James Noble, Rohan Padhye, Pavithra Prabhakar, Francesco Ranzato, Talia Ringer, Camilo Rocha, Andrei Sabelfeld, Ilya Sergey; and bottom row, left to right: Michele Sevegnani, Fu Song, Zhendong Su, Daniel Varro, Yakir Vizel, Thomas Wies, Anton Wijs, and Meng Xu.
Top row, left to right: Aws Albarghouthi, Nada Amin, Clark Barrett, Ivan Beschastnikh, William Bowman, Yinzhi Cao, Trevor Carlson, Marsha Chechik; second row, left to right: Cas Cremers, Derek Dreyer, Marcelo Frias, Sicun Gao, Roberto Giacobazzi, Ronghui Gu, Jean-Baptiste Jeannin, Steve Ko; third row, left to right: James Noble, Rohan Padhye, Pavithra Prabhakar, Francesco Ranzato, Talia Ringer, Camilo Rocha, Andrei Sabelfeld, Ilya Sergey; and bottom row, left to right: Michele Sevegnani, Fu Song, Zhendong Su, Daniel Varro, Yakir Vizel, Thomas Wies, Anton Wijs, and Meng Xu are among the recipients from the Amazon Research Awards Fall 2021 call for proposals under the Automated Reasoning CFP.

This announcement includes awards funded under seven call for proposals during the Fall 2021 cycle: AI for Information Security, Amazon Device Security and Privacy, Amazon Payments, AWS Automated Reasoning, Data for Social Sustainability, Prime Video, and Robotics. Proposals were reviewed for the quality of their scientific content, their creativity, and their potential to impact both the research community and society more generally. Theoretical advances, creative new ideas, and practical applications were all considered.

Top row, left to right: Nora Ayanian, Nicola Bezzo, Luca Carlone, Venanzio Cichella, Jia Deng, Nima Fazeli, Maani Ghaffari-Jadidi; second row, left to right: Grace Gu, Leonidas Guibas, Felix Heide, Ralph Hollis, Robert Katzschmann, Sven Koenig, George Konidaris; third row, left to right: Sergey Levine, Jennifer Lewis, Maja Matarić, Jan Peters, Lerrel Pinto, Robert Platt, Nancy Pollard; and bottom row, left to right: Alessandro Rizzo, Oren Salzman, Roland Siegwart, Pratap Tokekar, James Wang, Shenlong Wang, and Yuke Zhu.
Top row, left to right: Nora Ayanian, Nicola Bezzo, Luca Carlone, Venanzio Cichella, Jia Deng, Nima Fazeli, Maani Ghaffari-Jadidi; second row, left to right: Grace Gu, Leonidas Guibas, Felix Heide, Ralph Hollis, Robert Katzschmann, Sven Koenig, George Konidaris; third row, left to right: Sergey Levine, Jennifer Lewis, Maja Matarić, Jan Peters, Lerrel Pinto, Robert Platt, Nancy Pollard; and bottom row, left to right: Alessandro Rizzo, Oren Salzman, Roland Siegwart, Pratap Tokekar, James Wang, Shenlong Wang, and Yuke Zhu are among the recipients from the Amazon Research Awards Fall 2021 call for proposals under the Robotics CFP.

Recipients have access to more than 300 Amazon public datasets and can utilize AWS AI/ML services and tools through their AWS Promotional Credits. Recipients also are assigned an Amazon research contact who offers consultation and advice, along with opportunities to participate in Amazon events and training sessions.

Additionally, Amazon encourages the publication of research results, presentations of research at Amazon offices worldwide, and the release of related code under open-source licenses.

Top row, left to right:NAMES; second row, left to right:NAMES are among the recipients from the Amazon Research Awards Winter 2022 call for proposals under the Alexa: Fairness in AI CFP.
Top row, left to right:NAMES; second row, left to right:NAMES are among the recipients from the Amazon Research Awards Winter 2022 call for proposals under the Alexa: Fairness in AI CFP.

"Research in automated reasoning is deeply intertwined with a broad range of other research areas, touching machine learning, hardware and software engineering, robotics, and life sciences," said Daniel Kroening, an Automated Reasoning Group senior principal scientist. "The 2021 Amazon Research Awards reflect this breadth, and the interdisciplinary nature of research that is necessary to take computing one step closer to that magic spark that drives human reasoning."

ARA funds proposals up to four times a year in a variety of research areas. Applicants are encouraged to visit the ARA call for proposals page for more information or send an email to be notified of future open calls.

The table below lists, in alphabetical order, Fall 2021 cycle call-for-proposal recipients.

Recipient

University

Research title

Aws Albarghouthi

University of Wisconsin-Madison

Teaching SMT Solvers Probability Theory

Nada Amin

Harvard University

Extensible Models and Proofs

Nora Ayanian

Brown University

Large-Scale Labeled Multi-Agent Pathfinding for Warehouses

Clark Barrett

Stanford University

HydraScale: Solving SMT Queries in the Serverless Cloud

Ivan Beschastnikh

University of British Columbia

Compiling Distributed System Models into Implementations

Nicola Bezzo

University of Virginia

Towards Safe and Agile Robot Navigation in Occluding and Dynamic Environments

William Bowman

University of British Columbia

Static reasoning for memory in compilers and intermediate languages

Yinzhi Cao

Johns Hopkins University

Automatic Static Resource Analysis for Serverless Computing

Luca Carlone

Massachusetts Institute of Technology

Real-time Spatial AI for Robotics

Trevor Carlson

National University of Singapore

Accelerating SAT Solving with a Flexible FPGA-Programming Platform

Marsha Chechik

University Of Toronto

Unsatisfiability Proofs for Monotonic Theories

Venanzio Cichella

University Of Iowa

Concurrent allocation and planning for large-scale multi-robot systems

Cas Cremers

CISPA Helmholtz Center for Information Security

KeyLife: Automated Formal Analysis for Key Lifecycles in Security Protocols with Policies, Delegation, and Compromise

Elizabeth Croft

Monash University

Help me!: Humans supporting robots through Augmented Reality

Jia Deng

Princeton University

Optimization-Inspired Neural Networks for Visual SLAM

Derek Dreyer

MPI - SWS

RefinedRust: Automating the Verification of Rust Programs in the Presence of Unsafe Code

Tudor Dumitras

University of Maryland, College Park

Mitigating the impact of behavior variability and label noise on ML-based malware detectors

Nima Fazeli

University of Michigan

Object Manipulation with High-Resolution Tactile Sensors

Earlence Fernandes

University of Wisconsin-Madison

Verifiable Distributed Computation

Marcelo Frias

Buenos Aires Institute of Technology

Modular Bounded Verification with Expressive Contracts

Sicun Gao

University of California, San Diego

Interior Search Methods in SMT

Maani Ghaffari-Jadidi

University of Michigan

Robust low-cost dead reckoning and localization for home robotics using invariant state estimation

Roberto Giacobazzi

University of Verona

Implicit program analysis

Ronghui Gu

Columbia University

Learning Inductive Invariants for Real Distributed Protocols

Grace Gu

University of California, Berkeley

Deep learning-enabled robust grasping for pneumatic actuators

Leonidas Guibas

Stanford University

GeneralPurpose 3D Perception of Object Functionality

Arie Gurfinkel

University of Waterloo

Formal Proofs for Trusted Execution Environments

Hamed Haddadi

Imperial College London

Auditable Model Privacy using TEEs

Felix Heide

Princeton University

Inverse Neural Rendering

Ralph Hollis

Carnegie Mellon University

Low Cost Dynamic Mobile Robots for Research and Teaching

Hongxin Hu

SUNY, Buffalo

Explaining Learning-based Intrusion Detection Systems for Active Intrusion Responses

Jean-Baptiste Jeannin

University of Michigan-Ann Arbor

Automatic Verification of Distributed Systems Implementations

Robert Katzschmann

ETH Zurich

Design and Control Optimization of Soft Gripper Mechanisms for Manipulation

Anirudh Sivaraman Kaushalram

New York University

Observing and controlling microservice deployments

Steve Ko

Simon Fraser University

Practical Symbolic Execution for Rust

Sven Koenig

University of Southern California

Hybrid Search- and Traffic-Based MAPF Systems for Fulfillment Centers

George Konidaris

Brown University

Learning Composable Manipulation Skills

Emmanuel Letouzé

Pompeu Fabra University

Leveraging Digital Data for Monitoring Human Rights and Social Dynamics Along and Around Value Chains

Sergey Levine

University of California, Berkeley

Robotic Learning with Reusable Data

Jennifer Lewis

Harvard University

Computational Co-Design of Dexterous Rigid-Soft Grippers With Intrinsic Tactile-Sensing-Based Control

Maja Matarić

University of Southern California

Learning User Preferences for In-Home Robots Through In Situ Augmented Reality

James Noble

Victoria University Of Wellington

“Programming Made Hard” Made Easier: Improving Dafny’s Human Factors

Rohan Padhye

Carnegie Mellon University

Coverage-Guided Property-Based Testing of Concurrent Programs

Jan Peters

TU Darmstadt

Learning Robot Manipulation from Tactile Feedback

Lerrel Pinto

New York University

Visual Imitation in the Wild through Decoupled Representation Learning

Robert Platt

Northeastern University

On-robot manipulation learning via equivariant models

Nancy Pollard

Carnegie Mellon

Contact Areas for Manipulation Capture, Retargeting, and Hand Design

Pavithra Prabhakar

Kansas State University

Conformance Checking of Evolving ML Software Systems

Francesco Ranzato

University of Verona

Implicit program analysis

Sanjay Rao

Purdue University

Answering counterfactuals from offline data for video streaming

Bruno Ribeiro

Purdue University

Answering counterfactuals from offline data for video streaming

Talia Ringer

University of Illinois Urbana-Champaign

Neurosymbolic Proof Synthesis & Repair

Alessandro Rizzo

Politecnico di Torino

Physics-Informed Machine Learning for Trustworthy Control of Autonomous Robots

Camilo Rocha

Pontificia Universidad Javeriana Cali

Probabilistic and Symbolic Tools for P Program Verification

Andrei Sabelfeld

Chalmers University of Technology

DeepCrawl: Automated Reasoning for Deep Web Crawling

Oren Salzman

Technion - Israel Institute of Technology

Increasing throughput in automated warehouses via environment manipulation

Ilya Sergey

National University of Singapore

Scaling Automated Verification of Distributed Protocols with Specification Transformation and Synthesis

Michele Sevegnani

University of Glasgow

From Whiteboards to Models: Diagrammatic Formal Modelling for Everyone

Roland Siegwart

ETH Zurich

Autonomous Navigation of Aerial Robotic Manipulators in Unstructured Indoor and Outdoor Environments

Ramesh Sitaraman

University of Massachusetts Amherst

Design and Evaluation of ABR Algorithms for High-Performance Video Delivery

Fu Song

ShanghaiTech University

Efficient and Precise Verification for Constant-Time and Time-Balancing of Cryptosystems

Zhendong Su

ETH Zurich

Practical Techniques for Reliable, Robust and Performant SMT Solvers

Jiliang Tang

Michigan State University

Taming Graph Anomaly Detection via Graph Neural Networks

Pratap Tokekar

University of Maryland, College Park

Multi-Robot Coordination through the Lens of Risk

Daniel Varro

McGill University

Graph Solver as a Service

Yakir Vizel

Technion - Israel Institute of Technology

Quantified Invariants

David Wagner

University of California, Berkeley

Machine Learning for Malware Detection: Robustness against Concept Drift

James Wang

Pennsylvania State University

Affective and Social Interaction between Human and Intelligent Machine in Daily Activities

Shenlong Wang

University of Illinois Urbana-Champaign

Safely Test Autonomous Vehicles with Augmented Reality

Thomas Wies

New York University

A Modular Library of Verified Concurrent Search Structure Algorithms

Anton Wijs

Eindhoven University of Technology

Many-Core Acceleration of State Space Construction and Analysis

Xinyu Xing

Northwestern University

Battling Noisy-label Classification

Meng Xu

University Of Waterloo

Finding Specification Blind Spots with Fuzz Testing

Yuke Zhu

University of Texas at Austin

Interactive Learning Framework for Building Structured Object Models from Play

Andrew Zisserman

University of Oxford

Audio-Visual Synchronisation for General Videos
Tags
About the Author
Amazon Research Awards team

Related content

Work with us

See more jobs See more jobs
Applied Scientist / ML scientist, EU Prime and Marketing Analytics & Science (PRIMAS)
ES, B, Barcelona
Are you interested in defining the science strategy that enables Amazon to market to millions of customers based on their lifecycle needs rather than one-size-fits-all campaigns? We are seeking a Applied Scientist to lead the science strategy for our Lifecycle Marketing Experimentation roadmap within the PRIMAS (Prime & Marketing analytics and science) team. The position is open to candidates in Amsterdam and Barcelona. In this role, you will own the end-to-end science approach that enables EU marketing to shift from broad, generic campaigns to targeted, cohort-based marketing that changes customer behavior. This is a high-ambiguity, high-impact role where you will define what problems are worth solving, build the science foundation from scratch, and influence senior business leaders on marketing strategy. You will work directly with Business Directors and channel leaders to solve critical business problems: how do we win back customers lost to competitors, convert Young Adults to Prime, and optimize marketing spend by de-averaging across customer cohorts. Key job responsibilities Science Strategy & Leadership: 1. Own the end-to-end science strategy for lifecycle marketing, defining the roadmap across audience targeting, behavioral modeling, and measurement 2. Navigate high ambiguity in defining customer journey frameworks and behavioral models – our most challenging science problem with no established playbook 3. Lead strategic discussions with business leaders translating business needs into science solutions and building trust across business and tech partners 4. Mentor and guide a team of 2-3 scientists and BIEs on technical execution while contributing hands-on to the hardest problems Advanced Customer Behavior Modeling: 1. Build sophisticated propensity models identifying customer cohorts based on lifecycle stage and complex behavioral patterns (e.g., Bargain hunters, Young adults Prime prospects) 2. Define customer journey frameworks using advanced techniques (Hidden Markov Models, sequential decision-making) to model how customers transition across lifecycle stages 3. Identify which customer behaviors and triggers drive lifecycle progression and what messaging/levers are most effective for each cohort 4. Integrate 1P behavioral data with 2P survey insights to create rich, actionable audience definitions Measurement & Cross-Workstream Integration: 1. Partner with measurement scientist to design experiments (RCTs) that isolate audience targeting effects from creative effects 2. Ensure audience definitions, journey models, and measurement frameworks work coherently across Meta, LiveRamp, and owned channels 3. Establish feedback loops connecting measurement insights back to model improvements About the team The PRIMAS (Prime & Marketing Analytics and Science) is the team that support the science & analytics needs of the EU Prime and Marketing organization, an org that supports the Prime and Marketing programs in European marketplaces and comprises 250-300 employees. The PRIMAS team, is part of a larger tech tech team of 100+ people called WIMSI (WW Integrated Marketing Systems and Intelligence). WIMSI core mission is to accelerate marketing technology capabilities that enable de-averaged customer experiences across the marketing funnel: awareness, consideration, and conversion.
Applied Scientist II, Central Machine Learning
IN, KA, Bengaluru
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation - Mentor other scientists and engineers in the use of ML techniques
Applied Scientist, EU INTech Consumer Selection, Tamale
ES, M, Madrid
At Amazon, we are committed to being the Earth's most customer-centric company. The European International Technology group (EU INTech) owns the enhancement and delivery of Amazon's engineering to all the varied customers and cultures of the world. We do this through a combination of partnerships with other Amazon technical teams and our own innovative new projects. You will be joining the Tamale team to work on Haul. As part of EU INTech and Haul, Tamale strives to create a discovery-driven shopping experience using challenging machine learning and ranking solutions. You will be exposed to large-scale recommendation systems, multi-objective optimization, and state-of-the-art deep learning architectures, and you'll be part of a key effort to improve our customers' browsing experience by building next-generation ranking models for Amazon Haul's endless scroll experience. We are looking for a passionate, talented, and inventive Scientist with a strong machine learning background to help build industry-leading ranking solutions. We strongly value your hard work and obsession to solve complex problems on behalf of Amazon customers. Key job responsibilities We look for applied scientists who possess a wide variety of skills. As the successful applicant for this role, you will work closely with your business partners to identify opportunities for innovation. You will apply machine learning solutions to optimize multi-objective ranking, improve discovery engagement through contextual signals, and scale ranking systems across multiple marketplaces. You will work with business leaders, scientists, and product managers to translate business and functional requirements into concrete deliverables, including the design, development, testing, and deployment of highly scalable distributed ranking services. You will be part of a team of scientists and engineers working on solving ranking and personalization challenges at scale. You will be able to influence the scientific roadmap of the team, setting the standards for scientific excellence. You will be working with state-of-the-art architectures and real-time feature serving systems. Your work will improve the experience of millions of daily customers using Amazon Haul worldwide. You will have the chance to have great customer impact and continue growing in one of the most innovative companies in the world. You will learn a huge amount - and have a lot of fun - in the process!
Applied Scientist, International Machine Learning
IN, HR, Gurugram
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced ML systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real-world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning team for International Emerging Stores (IES). Machine Learning, Big Data and related quantitative sciences have been strategic to Amazon from the early years. Amazon has been a pioneer in areas such as recommendation engines, ecommerce fraud detection and large-scale optimization of fulfillment center operations. As Amazon has rapidly grown and diversified, the opportunity for applying machine learning has exploded. We have a very broad collection of practical problems where machine learning systems can dramatically improve the customer experience, reduce cost, and drive speed and automation. These include product bundle recommendations for millions of products, safeguarding financial transactions across by building the risk models, improving catalog quality via extracting product attribute values from structured/unstructured data for millions of products, enhancing address quality by powering customer suggestions We are developing state-of-the-art machine learning solutions to accelerate the Amazon India growth story. Amazon is an exciting place to be at for a machine learning practitioner. We have the eagerness of a fresh startup to absorb machine learning solutions, and the scale of a mature firm to help support their development at the same time. As part of the International Machine Learning team, you will get to work alongside brilliant minds motivated to solve real-world machine learning problems that make a difference to millions of our customers. We encourage thought leadership and blue ocean thinking in ML. Key job responsibilities Use machine learning and analytical techniques to create scalable solutions for business problems Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes Design, develop, evaluate and deploy, innovative and highly scalable ML models Work closely with software engineering teams to drive real-time model implementations Work closely with business partners to identify problems and propose machine learning solutions Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model maintenance Work proactively with engineering teams and product managers to evangelize new algorithms and drive the implementation of large-scale complex ML models in production Leading projects and mentoring other scientists, engineers in the use of ML techniques About the team International Machine Learning Team is responsible for building novel ML solutions across International Emerging Store (India, MENA, Far-East, LatAm) problems and impact the bottom-line and top-line of India business. Learn more about our team from https://www.amazon.science/working-at-amazon/how-rajeev-rastogis-machine-learning-team-in-india-develops-innovations-for-customers-worldwide
Applied Scientist, Artificial General Intelligence
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
Applied Scientist, Artificial General Intelligence, AGI Data Services
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
Applied Scientist, Artificial General Intelligence, AGI Data Services
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
Applied Scientist, Artificial General Intelligence, AGI Data Services
US, WA, Bellevue
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
Applied Scientist, Artificial General Intelligence, AGI Data Services
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
Applied Scientist, Artificial General Intelligence, AGI Data Services
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
See more jobs
View from space of a connected network around planet Earth representing the Internet of Things.
Get more from Amazon Science
Subscribe to our monthly newsletter

Amazon.com | Conditions of Use | Privacy | © 1996-2026 Amazon.com, Inc. or its affiliates

Social