ARA Program Rules

Last updated: March 26, 2025

By applying to or participating in the Amazon Research Awards Program (the “ARA Program”), you (defined below) agree to the following rules (“Rules”). These Rules are solely between Amazon.com, Inc. and its affiliates (“Amazon”, “we”, “us”, or “our”) and the entity that you represent (“you” or “your”), including the lead researcher/s who applies to the ARA Program (the “Principal Investigator”) and any members of the research team. Capitalized terms not defined herein may be defined in the AWS Agreements (as defined below). You and/or the Principal Investigator are responsible for distributing these Rules to all members of the research team before they participate in any research in connection with a proposal funded by the ARA Program.

I. Eligibility Requirements

To be eligible for an ARA Program award (“Award”), the Principal Investigator must be (1) either a full-time faculty member at an accredited academic institution or a permanent researcher at a non-governmental organization with recognized legal status in its country (equivalent to 501(c)(3) status under the United States Internal Revenue Code) and (2) at or above the age of majority in their jurisdiction of residence at the time of application. Each Principal Investigator is permitted to submit only one proposal to the ARA Program per call for proposal period.

By submitting your proposal to the ARA Program, you represent that your Principal Investigator:

(a) is not a paid employee of a government entity (other than an accredited academic institution);

(b) is not under US export controls or sanctions;

(c) has not been a director, officer, employee, intern or contractor of Amazon within the 12 months preceding submission of your proposal to the ARA Program (“Ineligible Personnel”);

(d) is not a member of the immediate family or household of Ineligible Personnel; and

(e) has not participated in or had decision-making authority over any cloud infrastructure procurements involving Amazon.

The ARA Program is void in Cuba, Iran, Syria, North Korea and the Crimea, Luhansk and Donetsk regions of Ukraine, and where otherwise prohibited by law.

Amazon employees, including employees of Amazon Web Services, Inc. (“AWS”), are not eligible to receive an Award.

Amazon is not responsible for your internal organizational policies and procedures that may restrict your (including the Principal Investigator’s) ability to submit a proposal to the ARA Program.

II. Application Content

No proposal to the ARA Program may contain any confidential information and no part may be marked as ‘confidential.’ Amazon does not accept any legal obligation (whether of confidentiality, compensation, return or otherwise) with respect to any proposals. Amazon reserves the right to implement competitive, similar, or identical ideas in the future, without restriction or obligation. You understand and acknowledge that Amazon has wide access to technology, designs, and other materials, and may work on and/or develop projects and ideas that may be competitive with, similar to, or identical to your proposal in theme, idea, format or other respects, inclusive. You acknowledge and agree that you will not be entitled to any compensation as a result of Amazon’s use of any such similar or identical material that has or may come to Amazon from other sources.

You represent and warrant that your proposal:

(a) is either your original work or an update to your original work;

(b) does not, to your knowledge, infringe any third-party patent rights; and

(c) does not, to your knowledge, infringe, misappropriate or otherwise violate any other third-party intellectual property rights (i.e., other than patent rights), including any copyrights, trade secrets, trademarks, contract or licensing rights, rights of publicity or privacy, or moral rights.

III. Awards

Proposals selected for funding will receive an Award that may include cash, Promotional Credit (as defined in the AWS Promotional Credit Terms & Conditions), or both. Award funding is not extendable or transferable without our written consent, but you may submit new proposals for subsequent ARA Program calls.

All Award amounts will be determined by Amazon in its sole discretion. Any cash component of an Award:

(a) will be structured as a one-time unrestricted gift to your Principal Investigator’s academic institution or organization;

(b) will be provided directly to your academic institution or organization for distribution and management; and

(c) may not be used for indirect expenses which are not allocable, reasonable, adequately documented, and consistent with established policies and practices of your academic institution or organization.

You are responsible for the administration and apportionment of any costs and expenses associated with an Award, including any allowable and allocable overhead or indirect costs. In order to process any cash Award, you will be required to complete administrative requirements, which may include submitting a W-9 form to us, completing a tax questionnaire, and registering in Amazon’s Payee Central System. If you do not fulfill the administrative requirements for processing cash Awards within two years of your receipt of an Award notification, Amazon reserves the right to withhold payment. Any payment from Amazon to you under the Award may be issued by a purchase order. Except where prohibited by law, you are responsible for all taxes (including income tax and value added tax) that may be imposed on you by relevant local tax authorities.

These Rules, the agreements referenced herein, and any other agreement regarding the relationship between you and Amazon will constitute a Master Agreement under the terms of the purchase order.

IV. AWS Customer Agreement and AWS Promotional Credit Terms & Conditions

Amazon may make available to you an amount of AWS promotional computing credits (“AWS Credits”) for use in support of this Agreement. AWS Credits provided to University under this Agreement are subject to the AWS Promotional Credit Terms and Conditions (as may be updated from time to time on the AWS website). You acknowledge and agree that any use of AWS services, including but not limited to use of AWS Credits, is subject to the terms and conditions set forth in the AWS Customer Agreement (https://aws.amazon.com/agreement/), and/or any separate, bespoke agreement that you have entered into with Amazon governing use of AWS services (collectively, the “AWS Agreements”). In the event of any conflict between this Agreement and the AWS Agreements, the terms of the AWS Agreements shall take precedence.

V. Privacy

You acknowledge and agree that we may collect, store, share, and otherwise use personally identifiable information provided during the ARA Program application process, including but not limited to, name, mailing address, phone number, and email address. All personally identifiable information collected is subject to, and will be used in accordance with, the Amazon Privacy Notice, including for administering the ARA Program and verifying applicants’ identities, addresses, and telephone numbers in the event a proposal is selected for funding. By participating in the ARA Program, you consent to the transfer of personal data to the United States for purposes of administering the ARA Program, conducting publicity about the ARA Program, and additional purposes that are consistent with goals relating to the ARA Program. The data controller for information collected by us is Amazon.com, Inc., 410 Terry Ave North, Seattle, Washington 98109, USA.

VI. Publicity

Except where prohibited, you consent to our use of your name and the Principal Investigator’s name and title, proposal title, and proposal abstract text for purposes of identifying Amazon’s support of you, the Principal Investigator, the proposal and/or the ARA Program.

You may acknowledge our support by stating that your research is supported by the ARA Program (e.g., “Research reported in this [publication/press release] was supported by an Amazon Research Award, [Cycle /Year].”). Any use of Amazon or AWS logos is subject to the Amazon Trademark Guidelines and AWS Trademark Guidelines, respectively. Any other use of Amazon or AWS logos requires Amazon’s or such affiliate’s prior written consent. You must receive Amazon’s prior written consent before issuing a press release or making any public disclosure regarding your participation in the ARA Program. You agree not to misrepresent or embellish the relationship between us and you. You will not imply any relationship or affiliation between us and you except as expressly permitted by these Rules.

VII. Limitation of Liability

TO THE EXTENT PERMITTED BY APPLICABLE LAW, YOU ACCEPT THE CONDITIONS STATED IN THESE RULES, AGREE TO BE BOUND BY THE DECISIONS OF AMAZON, AND WARRANT THAT YOU ARE ELIGIBLE TO PARTICIPATE IN THE ARA PROGRAM. TO THE EXTENT PERMITTED BY APPLICABLE LAW, YOU, EACH RESEARCH TEAM MEMBER, THE PRINCIPAL INVESTIGATOR AND THE PRINCIPAL INVESTIGATOR’S INSTITUTION HEREBY RELEASES AMAZON FROM, AND WAIVES ANY AND ALL CLAIMS AGAINST AMAZON FOR, ANY LOSSES, LIABILITY, AND DAMAGES OF ANY KIND, (INCLUDING FOR ANY LOSS OF DATA, LOST PROFITS, COST OF COVER OR OTHER SPECIAL, INCIDENTAL, CONSEQUENTIAL, INDIRECT, PUNITIVE, EXEMPLARY OR RELIANCE DAMAGES) INCURRED OR SUSTAINED IN CONNECTION WITH OR ARISING OUT OF (1) THE ARA PROGRAM OR ANY TRAVEL OR ACTIVITY RELATED THERETO, (2) USE OF ANY PROPOSAL OR RIGHTS THEREIN, OR (3) ANY BREACH OF ANY AGREEMENT OR WARRANTY ASSOCIATED WITH THE ARA PROGRAM, INCLUDING THESE RULES, HOWEVER CAUSED AND REGARDLESS OF THEORY OF LIABILITY.

VIII. Changes

We may amend any of these Rules at our sole discretion by posting the revised terms on the ARA Program website. Your continued participation in the ARA Program after the effective date of the revised Rules constitutes your acceptance of the rules.

IX. Disputes

Any dispute or claim relating in any way to the ARA Program will be resolved in accordance with terms set forth in the AWS Agreements.

X. Representations and Warranties

You represent and warrant that:

(a) your receipt of any Award is neither prohibited by nor inconsistent with any applicable laws, regulations, or binding orders, including applicable ethics rules or internal institutional rules;

(b) you have completed or will complete all legal and ethical requirements necessary to accept the Award;

(c) your receipt of the Award will not knowingly create a conflict of interest for Amazon;

(d) the Principal Investigator has not participated in, nor had, and do not anticipate participating in or having, any decision-making authority over, any procurements or purchasing decisions involving Amazon on behalf of your organization during the previous or upcoming twelve (12) months; and

(e) you will properly book and record the Award in your accounting documents in accordance with applicable laws and regulations.

In the event that your representations and warranties under this section are or become inaccurate, you must notify us immediately (research-awards@amazon.com) and any Award your organization receives will be voidable.

US, NY, New York
Fauna Robotics is building capable, safe, and delightful robots for everyday life, and voice is one of the most natural ways people will interact with them. Cloud speech and language models are good and getting better, but they can only work with the audio they receive, and a robot is a hard place to listen. Its microphones sit beside motors, fans, and moving joints. It speaks through its own loudspeaker while people talk over it. It moves, turns, and shares a room with several people at once. We are hiring a Principal Audio Scientist to be Fauna's technical authority on how our robots hear. You will design, prototype, and ship the hardest algorithms in the robot's audio system. You will set the audio architecture that other engineers build on, shape hardware decisions across robot generations, mentor the engineers and scientists working on audio, and be the person teams come to when the robot can't hear. Key job responsibilities - Set the long-range science roadmap and technical architecture for the robot's audio system, and serve as Fauna's primary technical authority on robot hearing - Design and implement suppression of the robot's own noise from motors, fans, and moving joints - Design and implement echo cancellation for the robot's own voice, so people can interrupt it naturally - Develop multi-microphone processing that holds up as the robot and the people around it move, including locating who is speaking so the robot can turn toward them - Make on-robot listening decisions robust to internal and external noise sources: wake word, voice activity, and whether speech is directed at the robot - Drive microphone and speaker placement, enclosure acoustics, and vibration isolation decisions with mechanical, electrical, and industrial design, backed by your own measurements - Design the robot-specific data collection and evaluation methods to validate the performance of our audio design - Present audio science and its tradeoffs to senior leadership and partner teams - Mentor scientists and engineers, raising the scientific bar for audio across the organization through design reviews, code reviews, and hiring
IN, KA, Bengaluru
Interested to build the next generation Financial systems that can handle billions of dollars in transactions? Interested to build highly scalable next generation systems that could utilize Amazon Cloud? Massive data volume + complex business rules in a highly distributed and service oriented architecture, a world class information collection and delivery challenge. Our challenge is to deliver the software systems which accurately capture, process, and report on the huge volume of financial transactions that are generated each day as millions of customers make purchases, as thousands of Vendors and Partners are paid, as inventory moves in and out of warehouses, as commissions are calculated, and as taxes are collected in hundreds of jurisdictions worldwide. Key job responsibilities • Understand the business and discover actionable insights from large volumes of data through application of machine learning, statistics or causal inference. • Analyse and extract relevant information from large amounts of Amazon’s historical transactions data to help automate and optimize key processes • Research, develop and implement novel machine learning and statistical approaches for anomaly, theft, fraud, abusive and wasteful transactions detection. • Use machine learning and analytical techniques to create scalable solutions for business problems. • Identify new areas where machine learning can be applied for solving business problems. • Partner with developers and business teams to put your models in production. • Mentor other scientists and engineers in the use of ML techniques. A day in the life • Understand the business and discover actionable insights from large volumes of data through application of machine learning, statistics or causal inference. • Analyse and extract relevant information from large amounts of Amazon’s historical transactions data to help automate and optimize key processes • Research, develop and implement novel machine learning and statistical approaches for anomaly, theft, fraud, abusive and wasteful transactions detection. • Use machine learning and analytical techniques to create scalable solutions for business problems. • Identify new areas where machine learning can be applied for solving business problems. • Partner with developers and business teams to put your models in production. • Mentor other scientists and engineers in the use of ML techniques. About the team The FinAuto TFAW(theft, fraud, abuse, waste) team is part of FGBS Org and focuses on building applications utilizing machine learning models to identify and prevent theft, fraud, abusive and wasteful(TFAW) financial transactions across Amazon. Our mission is to prevent every single TFAW transaction. As a Machine Learning Scientist in the team, you will be driving the TFAW Sciences roadmap, conduct research to develop state-of-the-art solutions through a combination of data mining, statistical and machine learning techniques, and coordinate with Engineering team to put these models into production. You will need to collaborate effectively with internal stakeholders, cross-functional teams to solve problems, create operational efficiencies, and deliver successfully against high organizational standards.
US, NY, New York
We are seeking a Robotics/AI Motor Control Scientist to develop cutting-edge machine learning algorithms for motor control systems in robots. In this role, you will focus on creating and optimizing intelligent motor control strategies to enable robots to perform complex, whole-body tasks. Your contributions will be essential in advancing robotics by enabling fluid, reliable, and safe interactions between robots and their environments. Key job responsibilities - Develop controllers that leverage reinforcement learning, imitation learning, or other advanced AI techniques to achieve natural, robust, and adaptive motor behaviors - Collaborate with multi-disciplinary teams to integrate motor control systems with robotic hardware, ensuring alignment with real-world constraints such as actuator dynamics and energy efficiency - Use simulation and real-world testing to refine and validate control algorithms - Stay updated on advancements in robotics, AI, and control systems to apply advanced techniques to robotic motion challenges - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers - Bridge research initiatives with practical engineering implementation About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you. an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
US, CA, Sunnyvale
Amazon's Artificial General Intelligence (AGI) organization is seeking an Applied Scientist III to advance the science of Responsible AI evaluation for large language models and generative AI. In this role, you will lead the design and development of rigorous evaluation methods, benchmarks, and metrics that measure the safety, fairness, robustness, and trustworthiness of frontier models. You will work with large-scale datasets, modern deep learning frameworks, and world-class scientists and engineers to turn research into evaluation systems that shape model launch decisions at Amazon scale. Key job responsibilities - Lead the design and implementation of evaluation frameworks, benchmarks, and metrics for responsible AI, including safety, fairness, robustness, and harmful content. - Build scalable automated evaluation pipelines for large language models, including model-based and human-in-the-loop evaluation. - Partner with pretraining, post-training, and product teams to translate evaluation results into model improvements and launch decisions. - Conduct rigorous experimentation and statistical analysis, and publish research at top venues. - Mentor junior scientists and help raise the scientific bar of the team. - Champion responsible AI practices across the model development lifecycle. About the team The AGI Responsible AI (RAI) team builds the science and systems that make Amazon's large language models safe, fair, and trustworthy. We work on problems spanning safety evaluation, content moderation, watermarking, bias mitigation, and alignment. Our team values scientific rigor, customer obsession, and rapid iteration, and we collaborate closely with pretraining, post-training, and product teams across AGI.
CH, Zurich
RIVR, an Amazon company, is building Physical AI by deploying autonomous robots for real-world doorstep delivery. Operating daily in diverse urban environments, RIVR's robots continuously learn from and navigate the millions of scenarios encountered during deliveries. By owning the full stack from software to hardware, RIVR is purpose-built for safety, reliability, and the customer from day one. Reinforcement learning is transforming our robotic intelligence, enabling autonomous behavior without human guidance. We are seeking a Senior AI Engineer with deep expertise in reinforcement learning and deep learning, including supervised and self-supervised learning with a focus on dexterous manipulation. Your role will involve leveraging both simulated and real-world data to address practical challenges in dynamic grasping, contact-rich manipulation, and object interaction. If you are passionate about advancing AI and developing innovative solutions, join us in shaping the future of intelligent robotics. Key job responsibilities Develop cutting-edge reinforcement learning algorithms to enable robust, contact-rich dexterous manipulation, translating vision, depth, tactile, and proprioceptive sensor input into precise end-effector and joint-level motor commands. Design, test, and refine algorithms to solve complex real-world manipulation challenges, such as handling diverse package form factors, dynamic hand-offs, and operating door handles or latches. Collaborate with the foundation model team to innovate methods that leverage both simulated and real-world data.
US, WA, Seattle
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to help Amazon provide the best customer experience by preventing eCommerce fraud? Are you excited by the prospect of analyzing and modeling terabytes of data and creating state-of-the-art algorithms to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you enjoy collaborating in a diverse team environment? If yes, then you may be a great fit to join the Amazon Selling Partner Trust & Store Integrity Science Team. We are looking for a talented scientist who is passionate to build advanced machine learning systems that help manage the safety of millions of transactions every day and scale up our operation with automation. Key job responsibilities Innovate with the latest GenAI/LLM/VLM technology to build highly automated solutions for efficient fraud detection, risk evaluation and automated operations Design, develop and deploy end-to-end advance machine learning solutions with vision anf GenAi technologies in the Amazon production environment to create impactful business value Learn, explore and experiment with the latest machine learning advancements to create the best customer experience A day in the life You will be working within a dynamic, diverse, and supportive group of scientists who share your passion for innovation and excellence. You'll be working closely with business partners and engineering teams to create end-to-end scalable machine learning solutions that address real-world problems. You will build scalable, efficient, and automated processes for large-scale data analyses, model development, model validation, and model implementation. You will also be providing clear and compelling reports for your solutions and contributing to the ongoing innovation and knowledge-sharing that are central to the team's success.
US, NY, New York
We are seeking an Applied Scientist to contribute to research and development of novel security validation and monitoring techniques for AI systems at scale. You will own and contribute to four critical work-streams: 1. Real-Time Agent Monitoring Design and implement scientific approaches for continuous behavioral analysis of AI agents in production—detecting anomalous actions, prompt injection exploitation, and policy violations in real time. 2. Protection & Automated Remediation Invent and deliver novel protection technologies and automated remediation techniques building on research in security, cryptography, privacy, automated reasoning, and others domains, to enable safe and secure agentic AI models and AI applications. 3. AI Application and Capabilities Validation Invent and deliver scalable methodologies for security testing of AI applications and AI capabilities (e.g. MCP, skills), including adversarial robustness evaluation, safety guardrail bypass detection, tool-use authorization boundaries, and trust boundary verification. 4. AI Asset Discovery & Inventory Research and build scalable techniques to automatically discover, identify, and catalog all AI-enabled applications, services, and capabilities across the company—maintaining a comprehensive, continuously updated database of AI assets. Key job responsibilities Invent • Identify and frame new research challenges in AI security where problems are ill-defined and require novel scientific paradigms at the product level. • Contribute to the team's scientific agenda for agent monitoring, protection, remediation, validation research, and AI asset discovery. • Publish research results at peer-reviewed internal and external venues (e.g., USENIX Security, ACM CCS, IEEE S&P, NeurIPS, ICML security workshops, ICSE, PETS) when appropriate. • Articulate key scientific challenges of current and future AI security threats and deliver novel research to address them. • Design, implementation, and successful delivery of scientifically complex security solutions into production—both brand new systems and evolutions of existing ones. • Write significant portions of critical-path code for detection models, validation engines, protection technologies, and asset discovery / classification systems. • Assess and select appropriate technologies (e.g., data protection, private inference, graph-based anomaly detection, NLP-based service classification, code/traffic analysis for AI fingerprinting) for production systems. • Use best practices in scientific methodology and software engineering across the team; provide insightful peer reviews of code, design, and architecture artifacts. • Deliver solutions that are inventive, maintainable, scalable, and extensible. Influence • Autonomously drive discussions with security engineers, software engineers, product managers, and scientist peers across multiple teams. • Build consensus on larger cross-team security initiatives and factor complex efforts into independent workstreams. • Identify and resolve endemic problems, including areas where current security tooling limits innovation of partner teams. • Contribute to the broader internal and external scientific communities as a subject matter expert in AI security. About the team Diverse Experiences Amazon Security values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why Amazon Security? At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. We offer talented security professionals the chance to accelerate their careers with opportunities to build experience in a wide variety of areas including cloud, devices, retail, entertainment, healthcare, operations, and physical stores. Inclusive Team Culture In Amazon Security, it’s in our nature to learn and be curious. Ongoing DEI events and learning experiences inspire us to continue learning and to embrace our uniqueness. Addressing the toughest security challenges requires that we seek out and celebrate a diversity of ideas, perspectives, and voices. Training & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve.
IN, KA, Bangalore
Amazon’s Last Mile Team is looking for a passionate individual with strong optimization and analytical skills to join its Last Mile Science team in the endeavor of designing and improving the most complex planning of delivery network in the world. Last Mile builds global solutions that enable Amazon to attract an elastic supply of drivers, companies, and assets needed to deliver Amazon's and other shippers' volumes at the lowest cost and with the best customer delivery experience. Last Mile Science team owns the core decision models in the space of jurisdiction planning, delivery channel and modes network design, capacity planning for on the road and at delivery stations, routing inputs estimation and optimization. Our research has direct impact on customer experience, driver and station associate experience, Delivery Service Partner (DSP)’s success and the sustainable growth of Amazon. Optimizing the last mile delivery requires deep understanding of transportation, supply chain management, pricing strategies and forecasting. Only through innovative and strategic thinking, we will make the right capital investments in technology, assets and infrastructures that allows for long-term success. Our team members have an opportunity to be on the forefront of supply chain thought leadership by working on some of the most difficult problems in the industry with some of the best product managers, scientists, and software engineers in the industry. Key job responsibilities Candidates will be responsible for developing solutions to better manage and optimize delivery capacity in the last mile network. The successful candidate should have solid research experience in one or more technical areas of Operations Research or Machine Learning. These positions will focus on identifying and analyzing opportunities to improve existing algorithms and also on optimizing the system policies across the management of external delivery service providers and internal planning strategies. They require superior logical thinkers who are able to quickly approach large ambiguous problems, turn high-level business requirements into mathematical models, identify the right solution approach, and contribute to the software development for production systems. To support their proposals, candidates should be able to independently mine and analyze data, and be able to use any necessary programming and statistical analysis software to do so. Successful candidates must thrive in fast-paced environments, which encourage collaborative and creative problem solving, be able to measure and estimate risks, constructively critique peer research, and align research focuses with the Amazon's strategic needs. As a senior scientist, you will also help coach/mentor junior scientists in the team.
US, NY, New York
We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance. You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection. The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems. Key job responsibilities - Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios - Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies - Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs - Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection - Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection - Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack - Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers
US, NY, New York
We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance. You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection. The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems. Key job responsibilities - Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios - Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies - Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs - Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection - Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection - Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack - Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers