Image shows the abstract page from a paper titled "Optimal Auction Design with Deferred Inspection and Reward" on the left; the authors — Saeed Alaei (top left), Alexandre Belloni (top right), Ali Makhdoumi (bottom left), and Azarakhsh Malekian (bottom right) are shown in a two-by-two grid on the right
In their paper, "Optimal Auction Design with Deferred Inspection and Reward", Saeed Alaei (top left), Alexandre Belloni (top right), Ali Makhdoumi (bottom left), and Azarakhsh Malekian (bottom right) developed a mechanism to incentivize buyers within an auction to bid higher by giving a bonus to bids whose value are closer to the true value of the item.

Monitoring and rewarding honest bids to increase revenue in auctions

Amazon Scholar Alexandre Belloni discusses the implications of auction design on digital goods.

Alexandre Belloni has been intrigued by operations research and optimization problems since his days at as an electrical engineering undergrad at the Pontifical Catholic University of Rio de Janeiro, back in his home country of Brazil. Further schooling just cemented that. His master’s in mathematical economics at the Institute for Pure and Applied Mathematics, also in Rio de Janeiro, “happened to have a strong optimization track,” he said. “Once I got there, the economics influence started to kick in,” he says. “And, given my background, I was always looking for the intersection of operations research and economics.”

For his PhD, Belloni worked on optimization and econometrics at the MIT Operations Research Center. His interest in economics continued to influence his academic path and most of his current research is focused on mechanism design problems, which he describes as “a broad class of ways to allocate resources.” “For example, auctions are a classic way that you can allocate an item and it is especially useful in cases where it’s difficult to price the value of the item.”

Belloni says mechanism design is an incredible field to work on. “Not only there are many interesting perspectives to consider — such as information, computational, approximations, robustness, dynamics — but we also see several industry problems requiring to coordinate decentralized systems.”

Since 2007, Belloni has also taught at the Fuqua Business School at Duke University, where he is currently the John D. Forsyth Professor of Decision Sciences. In 2018, he was recruited to become an Amazon Scholar, joining the company in that capacity in January 2019. “I always thought that the best research is the one that is motivated by empirical, real problems. Amazon gives you a great opportunity to see the real problems,” he says.

Related content
How the Amazon Logistics Research Science team guides important decisions related to last-mile delivery.

Since then, he has been studying problems related to mechanism design and machine learning at Fulfillment by Amazon (FBA), the subdivision of Amazon’s Supply Chain Optimization Technologies (SCOT) organization for third-party sellers who use Amazon’s storage and fulfillment capabilities.

One of the challenges Belloni and his FBA colleagues are currently addressing has to do with capacity management. Third-party sellers own and control their own inventories, and Amazon, with limited information, determines how to both balance the demand for space and ensure fulfillment center capacity is used efficiently and is available for products that customers love. “There has been tons of amazing work and we continue to obsess on finding better ways to manage capacity,” Belloni said.

Coordinating and optimizing allocations is also at the core of a recent work by Belloni and colleagues. In the paper “Optimal Auction Design with Deferred Inspection and Reward”, the authors develop a mechanism to incentivize buyers within an auction to bid higher by rewarding with a bonus the ones whose bids are closer to the true value of the item. This strategy can only be used in certain settings, where it is possible to monitor how the buyer is monetizing that good.

In this interview, Belloni discusses how he and his co-authors — Saeed Alaei, Ali Makhdoumi and Azarakhsh Malekian — came up with this new auction design that is especially suitable for digital goods and how it may impact revenues.

  1. Q. 

    What is the mechanism that you and your colleagues developed to optimize auction design? What are the implications for digital goods?

    A. 

    The key thing about this paper is that, in certain settings, after the winner of an auction is revealed, we can actually learn what is the true value of the good for the agent [buyer]. Indeed, there are many settings where the values are (nearly) observed with some delay. In those cases, if the agent said the truth — that is, the bid is close to the true value — we can give them a bonus back from their initial deposits.

    Related content
    The 2001 paper was awarded for “foundational work initiating a long and fruitful line of work in approximately revenue-optimal auction design in prior free settings”.

    It turns out that we were able to fully characterize the optimal mechanism for a single agent. By using rewards after the inspection to help us screen the agent, we found that the optimal allocation is not a thresholding strategy, and instead is an increasing and continuous function of the reported value. Indeed, it is possible to have different payments (via the rewards) for the same allocation, which contrasts with the case without inspection where no such mechanism would be incentive compatible.

    The results are quite relevant in settings where it is possible to monitor the value (or performance) of the good for the bidder. Digital goods are certainly one application that motivated our setting. For example, consider a platform that would like to sell some preferred advertisement position for a digital good to be displayed. Because consumption of the digital good occurs within the platform, its value is observed, whether it is the winner of the specific auction or not.

    Thus, the paper provides insights on how to monetize on this additional monitoring while still allowing agents to fully control the maximum they would be paying to acquire the preferred advertisement position. This is attractive as agents are always concerned with liability and, in practice, they could be reluctant to accept a contract in which they do not know how much they could end up paying. So, we are taking this concern into consideration. We monitor them, but we cannot charge more than whatever the amount they bid. The agents are in full control of how much they will spend. Ultimately, we are rewarding a digital good that has high value to be able to screen further via monitoring.

  2. Q. 

    How were you able to extrapolate your results from a single buyer to multiple buyers?

    A. 

    A priori, it was unclear how the results would generalize for the multiple-agents case given the generality of the first result. The first step was to consider the so-called reduced-form representation where we model the expected allocation and payments of a bidder condition on his or her own type (by averaging out over the types of the other bidders). But to ensure the reduced form is implementable as an auction, it is well known the additional Border constraints needed to be considered, which can get tricky.

    Using duality theory, we then find a sufficient condition under which the Border constraint in the reduced form of the problem can be dealt with nicely. The sufficient technical condition on the hazard rate of the distribution of the maximum value is not needed in the single-agent case. Indeed, the result for a single agent holds quite generally. Surprisingly, the same structural properties in the single-agent case are still preserved in the multiple-agents case.

    Related content
    Amazon Research Award recipient Éva Tardos studies complex theoretical questions that have far-ranging practical consequences.

    Importantly, we provide an implementation of our optimal auction for multiple agents — Border constraints guarantee an implementation exists but do not tell us how. In particular, we show that the implementation of the optimal auction involves allocating to the agent with the maximum bid and then rewarding this agent if they report truthfully. One aspect of this setup with inspection is that we can further distinguish bidders by having more freedom to manipulate the amount of allocation and payments. In typical auctions, without inspection, there is no value to do that and agents either get the good or not. In our case, we can essentially give you the good with only 50% chance if you bid low, for example.

    Indeed, we increase the chance of allocating the good as the bids increase and when we reach 100% change we can further increase the reward for reporting correctly. So, if you think about a second price auction, for example, the agent pays the second-highest price, and that's it. Here, the monitoring allows us further screen bidders after they bid which allows us to refine the final payments through the bonus. Thus bidders have an additional incentive to pay more (even in a single-agent case) just to make sure that they will have a higher chance of getting the good.

  3. Q. 

    What impact does your optimization have on revenue? And how does that differ from auctions in classic settings?

    A. 

    This auction will, by design, generate higher revenues than the standard option (without monitoring). Intuitively, because of the bonus, if the agent tries to take advantage of you by bidding too low, they are not getting any bonus back. Now, if the agent tells you the truth, then they're going to get a decent bonus. So, this creates this incentive that makes them willing to push towards the true value.

    Related content
    Amazon Scholar David Card and Amazon academic research consultant Guido Imbens talk about the past and future of empirical economics.

    In the paper, we present a nice characterization of why the revenue is going to be bigger. The typical idea in an auction is that you need to pay information rent for the agents. And what happens is that this monitoring reduces the information rent by design. More precisely, the information rent gets reduced by a factor related to the best alternative bid the agent could place. That comes out very clearly in the math.

    We cannot say that we are going to do 20% or 30% more because that's very specific of the company. However, note that this will be particularly impactful with a small number of agents. Thin markets where there is a single bidder, for example, who could typically walk away with a lot of surplus. In specific settings (depending on distributions, number of agents, etc.) we provide examples in the paper where gains are significant. Nonetheless, we can clearly say that we always reduce the information rent.

Related content

IN, HR, Gurugram
Building large-scale forecasting and optimization systems that power Amazon’s global transportation network and directly impact customer experience and cost. Key job responsibilities 1. Guide model and system design across a range of techniques, including tree-based models, deep learning (LSTMs, transformers), LLMs, and reinforcement learning. 2. Ensure models are production-ready, scalable, and robust through close partnership with stakeholders. 3. Partner with Product, Operations, and Engineering leaders to enable proactive decision-making and corrective actions. 4 Own end-to-end business metrics, directly influencing customer experience, cost optimization, and network reliability. 5. Help contribute to the broader ML community through publications, conference submissions, and internal knowledge sharing.
US, NY, New York
Are you excited about applying machine learning and statistical modeling to real-world systems that serve millions of customers? Amazon Connect is a cloud-based contact center service that helps businesses deliver personal, efficient customer experiences. Our team of scientists and engineers builds the AI and ML capabilities that power contact center operations and optimization. We are looking for a Senior Applied Scientist to tackle scientifically complex challenges in areas such as stochastic modeling, queueing theory, anomaly detection, and optimization. In this role, you will design and deploy novel ML models and algorithms that directly improve how businesses interact with their customers. You will work at the intersection of research and production, turning ambiguous problems into scalable solutions that shape the future of cloud-based customer service. Key job responsibilities - Design and deploy novel machine learning models and algorithms to solve complex problems in contact center operations, including forecasting, routing optimization, and anomaly detection. - Lead the scientific agenda for your team by identifying new research opportunities, proposing initiatives, and driving them from concept through production deployment. - Collaborate with engineering teams to architect and implement scalable ML systems, personally contributing significant portions of the critical scientific components. - Mentor fellow scientists and engineers through code reviews, design discussions, and scientific guidance, raising the overall technical bar of the team. - Evaluate and advance the team's ML methodology by benchmarking against current academic and industry research, and by publishing findings internally and externally when appropriate. A day in the life You might start your morning reviewing experiment results from a new forecasting model, then join a design session with engineers to discuss how to integrate it into the production pipeline. After lunch, you could be whiteboarding a novel approach to a queueing optimization problem with a fellow scientist, followed by a code review for a teammate. You will regularly present your research findings to stakeholders across the organization and contribute to the team's publication efforts. About the team Our team within Amazon Connect focuses on building intelligent, ML-driven capabilities that help businesses run their contact centers more effectively. We work closely with product, engineering, and science partners to turn research ideas into features that customers rely on every day. We value curiosity, collaboration, and scientific rigor, and we are investing in new AI capabilities that will continue to transform the customer service industry. If you want to see your research make a tangible impact at scale, this is the place to do it.
US, WA, Seattle
What happens when you give AI the ability to remember? Not cached responses — real structured memory that compounds over time and transfers across contexts. We're building the science behind this, and we need researchers who want to own the problem end-to-end. This is a founding role on a new team. You won't inherit models or maintain someone else's pipeline. You'll define the research direction, run experiments at scale, and ship what works directly to production. Key job responsibilities As an Applied Scientist in our team, you will be responsible for the research, design, and development of new AI technologies for knowledge acquisition and retrieval. You will adopt or invent new machine learning and analytical techniques in the realm of information retrieval, knowledge representation, and large language models. Specific responsibilities include: 1. Design and implement novel approaches to knowledge extraction from heterogeneous, unstructured data sources at organizational scale. 2. Build retrieval systems that match intent to relevant knowledge across domains — solving the "right memory at the right time" problem. 3. Own the quality of memory generation: what to capture, how to structure it, when to surface it, and when to let it decay. 4. Run large-scale experiments using Amazon's compute infrastructure and massive real-world datasets. 5. Develop evaluation frameworks for a system where "quality" means something new — right knowledge, right context, right confidence level. 6. Collaborate with engineers to move from research prototype to production system in weeks, not quarters. 7. Invent new approaches to temporal knowledge management — how memories age, conflict, and compound over time. 8. Publish and patent novel approaches to knowledge acquisition and retrieval at top-tier venues. A day in the life You will solve real-world problems by getting and analyzing large amounts of data, generate insights and opportunities, execute experiments, and develop statistical and ML models. The team is driven by business needs, which requires collaboration with other Scientists, Engineers, and Product Managers across the organization. You get to influence stakeholders with clear communication skills. You innovate on behalf of the customer and strategically build features. You will mentor junior members and help them grow. About the team We're a new team within Personalization, focused on a different kind of recommendation: not "what product should this customer see" but "what knowledge should this AI use right now." Same scale, same rigor, entirely new problem space. The science is at the intersection of information retrieval, knowledge representation, and LLM reasoning — and the right approach hasn't been established yet. The team values innovation and offers a safe place to try, fail, and learn while fostering a culture of continuous improvement. Everyone is a leader and owner for everything we do as a team. We offer creative space with an entrepreneurial work environment focusing on customer obsession.
ES, B, Barcelona
How does Amazon decide which fulfillment center ships your order, which truck carries it, and how to keep promises across hundreds of millions of packages daily? How does it decide how many trucks and how much labor are required to ship orders across the network? SCOT Fulfillment Optimization (FO) owns the optimization and forecasting science behind these decisions. We are seeking Applied Scientists to join the FO Science & Tech team in Barcelona (alternatively: Luxembourg or London) with a strong academic background in optimization, machine learning, and/or time-series forecasting. • You will design and build state-of-the-art machine learning and optimization models that power Amazon's fulfillment decisions at an unprecedented scale across two core scientific pillars: • Large-Scale Optimization and Planning: Designing planning systems for order assignment and resource utilization, while balancing multi-objective cost-speed tradeoffs to enable controllers to steer millions of shipments per hour optimally. • Demand Forecasting & Predictive ML: Developing time-series forecasts for customer demand, incorporating contextual information (weather, sales, order properties), and modeling uncertainty for core planning systems. Basic qualifications • PhD in Operations Research, Applied Mathematics, Computer Science, or related field (or equivalent experience) • Strong programming skills (Python preferred; experience with optimization solvers a plus) • Research experience in one or more: • Large-scale mathematical programming (LP, MIP, decomposition methods) • Combinatorial optimization (assignment, scheduling, network flows) • Multi-objective optimization and control • Large-scale time-series forecasting (GenAI models, probabilistic forecasting, uncertainty quantification) • Causal inference (spatiotemporal causal modeling, offline policy evaluation) Preferred qualifications • Experience building optimization systems that run in production at scale • Being comfortable with ambiguity and fast iteration cycles • Publications in relevant venues Key job responsibilities Design and implement optimization and forecasting models for large-scale fulfillment problems, from order assignment to network flow control. Build research prototypes end-to-end: from problem formulation through scalable implementation to production validation. Analyse complex tradeoffs (cost, speed, capacity, accuracy) and translate findings into actionable recommendations for leadership and operations teams. Collaborate with engineers to bring science solutions into production systems serving millions of customer orders daily. A day in the life You formulate an optimization or forecasting problem on a whiteboard with teammates, then prototype it in Python with real data by the afternoon. You run experiments against production-scale datasets, iterate on the model, and present results to stakeholders who will use them to make network decisions next week. Some days you dive deep into solver performance; other days you're explaining a Pareto frontier to an operations leader. You collaborate with large engineering and product teams to bring your solutions into systems serving millions of customers. Alongside fast-turnaround prototypes, you own long-term research bets, the kind that reshape how Amazon's fulfillment network operates at scale. Your work goes live. About the team SCOT Fulfillment Optimization Science & Tech (FO SnT) is the applied research team behind Amazon's fulfillment decision-making systems. We decide how orders get assigned to warehouses, how capacity is allocated across the network, and how cost and speed tradeoffs are managed in real time, at global scale. Our models influence billions of euros in annual operational spend. They protect sites from overload during peak, reduce transportation costs and CO2 emissions, and ensure customers receive their packages when promised. Leadership relies on our science to make investment decisions worth hundreds of millions. We are practitioners of large-scale optimization: MIP formulations, decomposition methods, approximation algorithms, and parallelisation. We use machine learning where it sharpens our decisions, including forecasting, learned heuristics, and multi-armed bandits. We pick the right tool for the problem, not the fashionable one. You will work alongside Senior and Principal scientists, and collaborate with Amazon Scholars and academic partners who bring frontier research into our applied problems. We code our prototypes to be production-ready and collaborate with large engineering teams to ship systems, not papers. Above all, we have fun solving hard real-world problems at real-world speed, failing, learning, and shipping along the way.
US, CA, Sunnyvale
We are seeking Data Scientist II with strong science application skills to join our Device Economics team. This role will focus primarily on Amazon's innovative devices and services (e.g. Echo Family of Devices), working at the intersection of economic modeling, forecasting science, and business strategy. The ideal candidate will be responsible for pre-launch forecasts, annualized overall forecasts, identifying substitution patterns, and partnering closely with product managers and marketing managers to understand the evolution of the Devices portfolio. Key job responsibilities Forecasting & Modeling 1. Develop and maintain pre-launch forecasts and annualized overall forecasts for Amazon Devices 2. Identify and model substitution patterns across the device portfolio 3. Build economic and financial models to support demand planning and business decisions 4. Formulate relevant analytical frameworks to address key economic issues in device forecasting Science Communication & Collaboration 1. Explain complex science models and methodologies to non-technical stakeholders including product managers and marketing managers 2. Collaborate with economists, data scientists, and applied scientists across Decision Science 3. Present results of analyses to cross-functional teams and leadership 4. Build trust in science models and forecast outputs with product teams Innovation & Strategic Thinking 1. Think creatively about ways that leading-edge analytics and emerging data sources can address Devices' most pressing business challenges 2. Help internal teams leverage analytic tools to better manage innovation 3. Conduct empirical studies and perform quantitative and qualitative research 4. Identify opportunities to improve forecasting accuracy and business impact Cross-Functional Partnership 1. Work closely with product managers and marketing managers to understand portfolio evolution and business strategy 2. Support DSO leadership in quarterly business reviews and strategic planning A day in the life Your days will be split between refining and building models and working with business leaders to interpret them. You own science-based forecasts that can directly impact Amazon's bottom line on the order of multi-million dollar decisions. - You will perform model refreshes or updates to analyses as needed; and, - You will be expected to develop new techniques to process large data sets, address quantitative problems, and contribute to design of automated systems. About the team The Decision Science team within DSO (Device Supply Organization) is responsible for forecasting and demand planning initiatives across Amazon Devices. The DSO team of 300+ engineers, scientists, and PMs applies quantitative methods and data-driven approaches to replace judgment-based decisions with science-driven forecasts. Decision Science focuses on lifetime demand forecasting using econometric and machine learning models for rapid reforecasting, mix adjustments, and portfolio management for new product launches. We also inform to go/no-go investment decision for new product initiatives
US, WA, Seattle
As part of the AWS Applied AI Solutions organization, we have a vision to provide business applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are no-brainers to buy and easy to use. We are looking for an Applied Scientist to join our team that is building enterprise applications leveraging machine learning, generative AI, and agentic AI to help millions of companies worldwide manage their day-to-day supply chain operations. Our mission is to accelerate our customers' businesses through intuitive, differentiated technology solutions that solve enduring supply chain challenges. We blend strategic vision with curiosity and Amazon's real-world operational experience to build opinionated, turnkey solutions that make the 'buy versus build' decision a no-brainer for our customers. As an Applied Scientist, you will design and develop machine learning models and algorithms that power intelligent supply chain applications at global scale. You will work at the intersection of research and real-world product impact, translating scientific advances into production systems that serve millions of customers. We operate like a startup within AWS, offering you the opportunity to tackle complex challenges while working with the latest technologies in deep learning, large language models, and optimization. If you are passionate about pushing the boundaries of applied science, thrive in ambiguous problem spaces, and want to shape the future of supply chain intelligence while having the backing of AWS's extensive resources, we want to hear from you. Key job responsibilities - Design, develop, and deploy machine learning models for demand forecasting, inventory optimization, anomaly detection, and supply chain decision-making. - Develop generative AI and agentic AI solutions that automate complex supply chain workflows and deliver intelligent, adaptive recommendations to customers. - Formulate real-world business problems as machine learning problems; define data requirements, model architectures, evaluation metrics, and experimentation frameworks. - Drive end-to-end applied science projects from ideation through experimentation, offline evaluation, A/B testing, and production deployment at scale. - Collaborate with engineering, product management, and business stakeholders to translate scientific capabilities into customer-facing product features, and mentor other scientists to raise the team's technical bar. A day in the life You will start many mornings reviewing experiment results and model metrics before joining a science sync where you and your teammates discuss progress, debug tricky modeling issues, and brainstorm new approaches. From there, you may spend focused time writing and testing model code in Python or PyTorch, running offline evaluations, or preparing an A/B test for a new forecasting algorithm. Expect regular working sessions with software engineers to integrate your models into production services, and occasional deep-dive reviews where you present your scientific approach and findings to the broader team. About the team The AWS Applied AI Solutions team builds enterprise applications that leverage Amazon's operational expertise to solve real-world supply chain challenges for millions of companies. We operate like a startup within AWS, moving fast and shipping iteratively with modern AI technologies. We invest in your growth through mentorship from experienced scientists, conference publication support, and internal science reading groups. If your career hasn't followed a traditional path, we encourage you to apply — we value varied experiences and perspectives.
US, NY, New York
We are seeking a Lead Applied Scientist to drive the development of next-generation manipulation and autonomy systems for robots operating in complex, real-world environments. This role is designed for an exceptional technical leader with a strong research background and a passion for translating cutting-edge ideas into working robotic systems. You will play a central role in defining the technical direction of our manipulation and autonomy stack, from problem formulation and algorithm design to system integration and real-world deployment. While this role is hands-on and deeply technical, it is also expected to evolve toward technical leadership and team building over time. Key job responsibilities - Lead research and development of manipulation and autonomy systems for robots, including planning, control, learning, and closed-loop execution - Design and implement algorithms, especially focused around autonomy and interaction with dynamic environments - Work closely with perception, motor control, hardware, and systems teams to build tightly integrated autonomy pipelines - Define evaluation methodologies, benchmarks, and simulation-to-real workflows for manipulation and autonomy - Stay deeply engaged with the research community, selectively incorporating state-of-the-art techniques into deployed systems - Mentor and guide other researchers and engineers, help set technical direction, and contribute to team growth and research culture - Lead technical projects from conception through production deployment - Bridge research initiatives with practical engineering implementation About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
US, WA, Seattle
As part of the AWS Applied AI Solutions organization, we have a vision to provide end user applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are easy to adopt and easy to use. The Team Join the next science revolution at AWS Life Sciences Applied AI Solutions, where you'll work alongside world-class scientists to build AI that transforms how therapeutics are discovered, developed, and brought to patients. We're out to revolutionize how medicines are discovered, developed, and brought to patients, powered by a new generation of AI. Our team tackles some of the hardest open problems at the intersection of frontier AI and life sciences. We apply biological foundation models, large language models, and agentic reasoning systems to life sciences problems, then put them into the hands of customers as applications and managed services they can fine-tune, tailor, and deploy on their own data. The science challenges are deep: how do you design agentic systems that reason correctly over complex biological, regulatory, and clinical logic? How do you enable customers to tailor foundation models to their proprietary data and get better outputs with less effort? How do you adapt models to reason faithfully in high-stakes scientific and regulatory domains? Today we're focused on two areas. In clinical trials, we're building AI that automates and optimizes regulatory and clinical development workflows. In drug design, our products (including Amazon Bio Discovery) accelerate discovery by giving bench scientists AI-guided protein engineering and antibody design capabilities. We combine frontier research with production-scale delivery to put breakthrough science into the hands of customers solving humanity's hardest problems. We value scientific rigor, encourage publication, and support conference participation. If you want to do research that ships, this is the team. The Role We are seeking an Applied Scientist to build the models and methods behind our life sciences AI products, with a primary focus on clinical trial operations and agentic reasoning. You will design, train, and evaluate systems that reason over complex clinical and operational logic, and ship them into products customers use directly. You will work closely with senior and principal scientists on well-scoped research problems, own your results end to end, and see your work reach production. This role combines expertise in LLM reasoning and agentic AI with applied impact in life sciences. You will work on how large language models reason, plan, and act in complex scientific domains, while applying domain knowledge to ensure models produce scientifically valid outputs. The problems span multiple fronts: - How do you build LLM-based agentic systems that correctly reason over clinical protocols, regulatory standards, and complex multi-step operational workflows? - How do you evaluate agent reliability and faithfulness rigorously enough to trust in high-stakes clinical settings? - How do you develop model customization methods (fine-tuning, retrieval augmentation, domain adaptation) that let customers get strong results from foundation models on their own data? You will focus on clinical trial operations (agentic automation, structured reasoning, evaluation, domain adaptation), with opportunities to contribute across drug discovery (protein engineering, antibody design) as the portfolio grows. You will own end-to-end scientific solutions from research through production, and your work will directly shape the tools that scientists use daily. Key job responsibilities - Design, train, fine-tune, and evaluate LLM-based agentic systems that reason over clinical protocols, regulatory standards, and operational workflows - Build rigorous evaluation harnesses and benchmarks to measure agent reliability, faithfulness, and failure modes in high-stakes domains - Develop model customization methods (fine-tuning, RLHF, retrieval augmentation, domain adaptation) that help customers get better outputs on their own data with less effort - Contribute to graph-based and causal modeling approaches for clinical trial operations - Partner with Life Sciences domain experts, product, and engineering to translate scientific challenges into shipped capabilities - Own experiments end to end: problem framing, implementation, evaluation, iteration, and hand-off to production - Publish at top-tier venues where the work supports it - Contribute to drug discovery efforts (protein engineering, antibody design) as opportunities arise A day in the life - Design and run an experiment to validate a new agentic reasoning or fine-tuning method, then ship it as a capability customers can use - Diagnose why a model is failing on a new class of inputs and implement a fix to unblock a delivery milestone - Build or extend an evaluation benchmark to measure how faithfully an agent reasons over clinical logic - Meet with domain experts to scope what the next model release needs to do - Review results with a senior scientist, sharpen the approach, and get it over the finish line - Prototype a new idea that could become the next capability in the product About the team AWS Solutions As part of the AWS solutions organization, we have a vision to provide business applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. we blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are no-brainers to buy and easy to use. Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture AWS values curiosity and connection. Our employee-led and company-sponsored affinity groups promote inclusion and empower our people to take pride in what makes us unique. Our inclusion events foster stronger, more collaborative teams. Our continual innovation is fueled by the bold ideas, fresh perspectives, and passionate voices our teams bring to everything we do. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve.
US, CA, Pasadena
As a Senior Quantum Applied Scientist on our Device team, you will be a technical authority and driving force in the design and measurements of novel superconducting qubits. You will lead detailed simulation and measurement efforts to explain experimental results, inform new qubit designs, and optimize device performance, working collaboratively with our design, fabrication, processor, and exploratory research teams. This is a role with significant room for innovation: you will play a key role in finding paths towards more performant devices. We are looking for a seasoned researcher with deep expertise in superconducting circuit physics plus a proven track record of bridging design, simulation, and measurement. Success in this role requires both technical depth and a genuine passion for applied, collaborative work. The ideal candidate will excel at communication across disciplines — translating detailed analyses into actionable guidance for engineering teams — and will bring the experience and judgment to identify innovations that will have the greatest impact. Key job responsibilities • Develop simulations to predict device performance, then design and measure devices that leverage the understood scalings. • Reduce the gap between simulated predictions and measurements by building more accurate models. • Communicate scientific findings across the CQC, and, when appropriate, share results externally via conference presentations and publications in scientific journals • Identify and evaluate emerging research developments that could impact design decisions About the team The Amazon Center for Quantum Computing (CQC) is a multi-disciplinary team of scientists, engineers, and technicians, on a mission to develop a fault-tolerant quantum computer.
US, CA, Pasadena
The Amazon Web Services (AWS) Center for Quantum Computing (CQC) is a multi-disciplinary team of theoretical and experimental physicists, materials scientists, and hardware and software engineers on a mission to develop a fault-tolerant quantum computer. Throughout your internship journey, you'll have access to unparalleled resources, including state-of-the-art computing infrastructure, cutting-edge research papers, and mentorship from industry luminaries. This immersive experience will not only sharpen your technical skills but also cultivate your ability to think critically, communicate effectively, and thrive in a fast-paced, innovative environment where bold ideas are celebrated. Join us at the forefront of applied science, where your contributions will shape the future of Quantum Computing and propel humanity forward. Seize this extraordinary opportunity to learn, grow, and leave an indelible mark on the world of technology. Amazon has positions available for Quantum Research Science and Applied Science Internships in San Francisco, CA; Santa Clara, CA; Pasadena, CA; and Boston, MA. We are particularly interested in candidates with expertise in any of the following areas: superconducting qubits, cavity/circuit QED, quantum optics, open quantum systems, superconductivity, electromagnetic simulations of superconducting circuits, microwave engineering, benchmarking, quantum error correction, fabrication, etc. Key job responsibilities In this role, you will work alongside global experts to develop and implement novel, scalable solutions that advance the state-of-the-art in the areas of quantum computing. You will tackle challenging, groundbreaking research problems, work with leading edge technology, focus on highly targeted customer use-cases, and launch products that solve problems for Amazon customers. The ideal candidate should possess the ability to work collaboratively with diverse groups and cross-functional teams to solve complex problems and to communicate research findings clearly. A successful candidate will be a self-starter, comfortable with ambiguity, with strong attention to detail and the ability to thrive in a fast-paced, ever-changing environment. Leverage AI-powered tools where applicable to accelerate research, experimentation, and prototyping. Critically review and validate outputs from AI tools and automated systems. About the team Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.