Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication.png
Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?” was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.
Glynis Condon

3 questions with Özalp Özer: How to build trust in business relationships

Özer’s paper published in INFORMS’ Management Science 2021 explores the dynamics behind “cheap-talk” communications.

Trust and trustworthiness are important in both our personal and business relationships. How then can we build environments that foster increased trust, trustworthiness and cooperation?

In the first edition of a new series that focuses on research papers published by scientists within the Amazon Supply Chain Optimization Technologies (SCOT) organization, we interview Özalp Özer, coauthor of “Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?”. The paper was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.

Özalp Özer profile image
Özalp Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas.

Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas (UTD). He earned a PhD in operations research from Columbia University, before going on to serve on the faculty at Stanford and Columbia. Özer has published extensively on a diverse range of topics, from supply chain management, capacity and inventory management to pricing and revenue management.

Özer says that a guiding principle behind his research is to focus on solving problems that have a real-world impact at scale. At Stanford and then UTD, Özer found himself drawn to the field of behavioral and experimental economics — particularly the field of game theory and understanding how to model actions and emotions in scenarios involving multiple decision makers in dynamic environments.

Driven by his interest in tackling real-world business problems, Özer remained engaged with industry during his tenure as an academic. While working on a project focused on designing effective procurement contracts, he observed the important role that trust played in establishing and fostering business relationships.

In many cases, the interests of the parties engaging in a negotiation are not aligned. To give one example, suppliers can use product forecast information from a buyer to make capacity, inventory and other manufacturing-related decisions. However, buyers might often provide suppliers with overly optimistic forecasts to ensure an abundant supply. If the demand for the product turns out to be lower than anticipated, the supplier bears the excess investment risk.

Özer says that this scenario represents an example of “cheap talk communications.” He outlines three characteristics that are common to all cheap talk communications: they are costless (they are devoid of monetary penalties), they are non-binding (a buyer can provide a forecast without committing to it), and they are non-verifiable (no forecast can be completely accurate in the light of market uncertainty). To complicate matters, the objective functions that each party is trying to maximize are at odds (or not perfectly aligned) with each other.

Standard game theory suggests that each party in a business transaction will move toward an equilibrium that maximizes their own payoff. In a cheap-talk setting, where the information is costless, non-binding and non-verifiable, the theory suggests that each party will disregard the information supplied by the other.

However, Özer finds that people involved in business (as well as personal) transactions frequently factor into their decision-making information supplied by the other party, even when their incentives are not perfectly aligned and even when the information or recommendation may be perceived as “cheap”. They do this by taking the business context and the related relationship into account. Doing so results in higher returns for both parties involved. For example, third-party sellers are more likely to act on price reduction or replenishment recommendations from Amazon, if they find that these recommendations have previously resulted in an uptick in sales and profits.

Ozer says that “cheap talk” communications have the unfortunate emphasis on being “cheap” and less emphasis on how they are informative and can align incentives. In a series of publications, Ozer shows why, when, and how such communications and recommendations turn out to be informative, and how they help align business objectives, resulting in both parties making better decisions.   

In this interview, Özer talks about findings from the recently published INFORMS paper and discusses the implications of these findings for companies like Amazon.

Q. What are the two models that can be used to explain how cheap talk communications work between decision makers?

As our paper suggests, there are two contrasting economic theories that can be used to analyze cheap-talk communications.

The trust-embedded model — which takes a more optimistic view of humanity — suggests that decision makers are motivated by non-monetary motives to be trusting and trustworthy, besides the monetary incentives such as maximizing cash flow.   

Here, we define trust as instances of decision makers behaving voluntarily in a way that put themselves in vulnerable engagement due to the uncertain behavior of the other party (the trustee), based upon the expectation of a positive outcome from that engagement. Trustworthiness flips the perspective to that of the trustee. We define trustworthiness as an instance of a decision maker behaving voluntarily in a way not to take advantage of the trustor’s vulnerable position – even when faced with a self-serving decision that conflicts with the trustor’s objectives.

Humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk.
Özalp Özer

The trust-embedded model suggests that when engaging with others, decision makers are averse to manipulating information in economic interactions. They incur disutility from lying. As a result, they assess the trustworthiness of the counterparty, and they form a trust factor towards them. This trust factor governs how decision makers interpret and use the information they receive from others.

In other words, humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk. Because they assess — even sometimes incorrectly — that doing so yields positive outcomes, they engage in and cultivate behaviors conducive to enabling these outcomes.

The trust embedded model suggests that individuals are guided by more than self-interest or pecuniary motives as they engage in transactions. For example, senders of information are guided by factors such as fairness and tenets that are central to their company. As a result, they share more information and resources than strictly necessary.

In contrast to the trust-embedded model, the level-k model — the second model discussed in the paper — suggests that decision makers are limited in their ability to think strategically. Receivers of information cannot anticipate the extent to which the sender might have distorted the message. On the flip-side, senders cannot account for just how much receivers might discount their message. Consequently, senders share more than necessary, because they take a dim view of the receiver’s ability to discount their message.

It’s important to note that even the level-k model can sometimes explain why senders and receivers tend to overshare information in a cheap-talk setting, which contrasts with the outcome standard game theory models would predict. It’s just that their motivations are different – with the level-k model, oversharing is driven by a limited ability to think strategically, rather than by the willingness to be trusting and trustworthy.

Overall, our paper that analyzed existing cheap-talk experiment data, found more support for the trust-embedded model, suggesting that individuals are also driven by non-monetary incentives when conducting transactions.

Q. Why do you think that trust-embedded models do a better job of explaining cheap-talk communications? What are the implications for organizations engaging in relationships with businesses and partners?

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust.
Özalp Özer

The answer to your first question is relatively simple — human beings are far more sophisticated than the level-k model gives them credit for. For example, there are many sellers on Amazon’s website who are proficient in using a variety of tools they have developed to make decisions related to pricing and inventory.

As a result, if we want the tools we provide to earn sellers’ trust, we need to think of the system more holistically at both an architecture and policy level to truly understand what builds trust and what is a trust-buster.

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust. Product reviews, the ability to get refunds for a vacation rental because hosts might not have lived up to their promises, or the price for a ride being set in advance — these are some of the mechanisms that let you buy a product or rent a home from people you don’t know.

Q. How are the findings in your paper applicable to your work at Amazon?

We are leveraging the insights from this stream of research as well as others to augment our understanding of seller trust, particularly in relation to how sellers interact with our inventory management tools, and how fidelity of recommendations impact sellers’ trust.

There is no interaction at Amazon that I can think of that doesn’t have an element of trust.
Özalp Özer

We are designing our related processes to reduce barriers for trusting and trustworthy engagements among the participants of our stores; for example, by making specific investments to support seller growth in areas that benefit sellers and customers the most; by reducing perceived vulnerabilities in carrying excess inventory; by looking into ways in which we stabilize our policies; by creating visibility to the reasons for our recommendations; by looking into ways in which we can build interactive communication channels among participants in our stores; and by building reputation and feedback systems that foster trusting and trustworthy engagements and on and on.

Using large-scale data, scientific methods like causal machine learning to optimization, as well as continual engagement with selling partners and customers, we aim to identify at the extent to which sellers trust evolves — so we can identify and invest in processes that foster trust and as a result growth and economic prosperity.  

There is no interaction at Amazon that I can think of that doesn’t have an element of trust. Jeff Bezos has said, “You can’t ask for trust, you just have to do it the hard way, one step at a time.” In my time at the company, I have been struck by the tireless efforts of so many people to gain seller and customer trust. At Amazon, it is just part of everything we do.

Related content

US, WA, Seattle
About Sponsored Products and Brands The Sponsored Products and Brands (SPB) team at Amazon Ads is re-imagining the advertising landscape through generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. About our team The General Shopping Intelligence (GSI) team is a highly motivated, collaborative, and fun-loving group with a strong entrepreneurial spirit and bias for action. We provide advanced real-time machine learning services that connect shoppers with the right ads across all platforms and surfaces worldwide. Through deep understanding of both shoppers and products, we help shoppers discover new products they love, enable advertisers to reach their customers most efficiently, and help Amazon continuously innovate on behalf of all customers. We are seeking a motivated Applied Scientist who loves to innovate at the intersection of customer experience, deep learning, generative AI and high-scale machine learning systems. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. Key job responsibilities As an Applied Scientist, you will: * Leverage Generative AI and Large Language Models (LLMs) to mine complex behavioral data, deriving deep, actionable shopper insights that identify customer experience gaps and unlock new business opportunities. * Design and develop scalable machine learning and GenAI models focused on shopper intent and preference modeling, ensuring a rapid path from prototype to production. * Partner closely with engineering teams to architect and deploy end-to-end GenAI solutions into production, integrating advanced insights directly into real-time, customer-facing systems. * Drive the scalability, efficiency, and automation of large-scale model training and real-time inference systems, pioneering the LLM infrastructure required to support next-generation GenAI workloads at Amazon Ads scale. * Design and run rigorous A/B experiments to quantify the business and customer impact of GenAI-driven shopper insights, performing advanced statistical analysis to guide iterative production rollouts. * Conduct applied research in novel generative AI techniques (e.g., fine-tuning, RAG, agentic workflows) to optimize the shopper experience and drive performance across all aspects of the Sponsored Products and Brands business.
US, WA, Seattle
Interested in modeling and understanding customer behavior through machine learning, artificial intelligence, and data mining over TB scale data with huge business impact on millions of customers? Join our team of Scientists developing models to model customer behavior and optimize the customer experience with Amazon Prime. This includes understanding who our customers are, long-term value of the Prime membership program, and creating the right personalized framework for content and subscription optimization. As an AI/ML expert, you will partner directly with product owners to intake, build, and directly apply your modeling solutions. There are numerous scientific and technical challenges you will get to tackle in this role, such as optimizing/fine-tuning GenAI/LLM solutions for Prime personalization, building GenAI foundation models, global scalability of models, combinatorial optimization, cold start problem, accelerated experimentation, short/long term goals modeling, and multi-step optimization leading to reinforcement learning of the customer journey. We employ techniques from GenAI/LLMs, supervised/semi-supervised learning, deep learning, transformer architectures, using outcomes from causal Econometric modeling, and Reinforcement learning. As the central science team within Prime, our expertise gets routinely called upon to weigh in on a variety of topics. We also emphasize the need and value of scientific research and have developed a strong publication and patent record (internally/externally) which you will be a part of. You will also utilize and be exposed to the latest in ML technologies and infrastructure: AWS technologies (EMR/Spark, Sagemaker, DynamoDB, S3, ClaudeCode), various AI/ML algorithms and techniques (Deep Learning, GenAI/LLMs, transformers, supervised/unsupervised/semi-supervised/reinforcement learning), and statistical modeling techniques. - Stay abreast of current literature in the field and advance/build novel science solutions leveraging SoTA solutions. - Build and develop AI/ML models and supporting infrastructure at TB scale, in coordination with software engineering teams. - Leverage Deep Learning and GenAI solutions for building foundation models and personalized optimization solution. - Develop offline policy estimation tools and integrate with measurement systems/econometric models. - Establish scalable, efficient, automated processes for large scale data analyses, science development, science validation and model implementation. - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes. - Work closely with the business to understand their problem space, identify the opportunities and formulate the problems. - Use AI/machine learning, data mining, statistical techniques and others to create actionable, meaningful, and scalable solutions for the business problems. - Design, develop and evaluate highly innovative models and statistical approaches to understand and predict customer behavior and to solve business problems. Key job responsibilities Key job responsibilities - Stay abreast of current literature in the field and advance/build novel science solutions leveraging SoTA solutions. - Build and develop AI/ML models and supporting infrastructure at TB scale, in coordination with software engineering teams. - Leverage Deep Learning and GenAI solutions for building foundation models and personalized optimization solution. - Develop offline policy estimation tools and integrate with measurement systems/econometric models. - Establish scalable, efficient, automated processes for large scale data analyses, science development, science validation and model implementation. - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes. - Work closely with the business to understand their problem space, identify the opportunities and formulate the problems. - Use AI/machine learning, data mining, statistical techniques and others to create actionable, meaningful, and scalable solutions for the business problems. - Design, develop and evaluate highly innovative models and statistical approaches to understand and predict customer behavior and to solve business problems.
US, WA, Seattle
As part of the AWS Applied AI Solutions organization, we have a vision to provide end user applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are easy to adopt and easy to use. The Team Join the next science revolution at AWS Life Sciences Applied AI Solutions, where you'll work alongside world-class scientists to build AI that transforms how therapeutics are discovered, developed, and brought to patients. We're out to revolutionize how medicines are discovered, developed, and brought to patients, powered by a new generation of AI. Our team tackles some of the hardest open problems at the intersection of frontier AI and life sciences. We apply biological foundation models, large language models, and agentic reasoning systems to life sciences problems, then put them into the hands of pharma, biotech, and diagnostics customers as applications and managed services they can fine-tune, tailor, and deploy on their own data. The science challenges are deep: how do you design agentic systems that reason correctly over complex biological, regulatory, and clinical logic? How do you enable customers to tailor foundation models to their proprietary data and get better outputs with less effort? How do you adapt models to reason faithfully in high-stakes scientific and regulatory domains? Today we're focused on two areas. In drug design, our products (including Amazon Bio Discovery) accelerate discovery by giving bench scientists AI-guided protein engineering and antibody design capabilities. In clinical trials, we're building AI that automates and optimizes regulatory and clinical development workflows. We combine frontier research with production-scale delivery to put breakthrough science into the hands of customers solving humanity's hardest problems. We value scientific rigor, encourage publication, and support conference participation. If you want to do research that ships, this is the team. The Role We are seeking an exceptional Principal Applied Scientist to set the scientific direction for our life sciences AI portfolio. You will be the scientific leader who defines research agendas, architects novel approaches, and delivers models and methods that give our customers capabilities that did not previously exist. This is a rare role that combines deep expertise in LLM reasoning and agentic AI with applied impact in life sciences. You will innovate on how large language models reason, plan, and act in complex scientific domains, while applying domain knowledge in biology to ensure models produce scientifically valid outputs. The problems span multiple fronts: - How do you build LLM-based agentic systems that correctly reason over clinical protocols, regulatory standards, and complex multi-step scientific workflows? - How do you develop model customization and training methods that let customers get state-of-the-art results from foundation models? - How do you adapt and extend protein and antibody models so customers can fine-tune on proprietary sequence data and get therapeutically relevant outputs? You will work across drug discovery (protein engineering, antibody design) and clinical trial operations (agentic automation, structured reasoning, domain adaptation). You will own end-to-end scientific solutions from research through production, and your work will directly shape the tools that thousands of scientists use daily. Key job responsibilities - Set the scientific vision and research agenda for LLM reasoning, agentic AI, and biological model customization across the portfolio - Innovate on LLM reasoning, planning, and agentic approaches for complex scientific and regulatory workflows - Develop model customization methods (fine-tuning, RLHF, retrieval augmentation, domain adaptation) that enable customers to train better models on their own data with less effort - Advance methods to adapt and extend biological foundation models for customer-specific therapeutic applications - Solve open research problems in faithful reasoning, multi-step planning, and tool use in high-stakes scientific domains - Partner with Life Sciences domain experts and customers to understand their hardest scientific challenges and translate those into tractable research problems - Publish at top-tier venues and build the team's external scientific reputation - Mentor applied scientists across the team while maintaining significant personal research contribution - Collaborate with product and engineering to ensure research translates into shipped products that serve customers at scale - Influence multi-year research roadmaps through deep scientific expertise and customer understanding A day in the life - Push a new reasoning approach into production that measurably improves outputs for a pharma customer's workflow - Design and run experiments to validate a novel fine-tuning method, then ship it as a capability customers can use immediately - Unblock a delivery milestone by diagnosing why a model is failing on a new class of inputs and implementing a fix - Meet with a customer's scientific team to scope what the next model release needs to do for them - Review a teammate's experimental results, sharpen the approach, and help get it over the finish line - Publish results from shipped work at a top venue, closing the loop between research and impact - Prototype a new idea that could become the next major capability in the product
IN, KA, Bengaluru
Amazon Health Services (One Medical) About Us: At Health AI, we're revolutionizing healthcare delivery through innovative AI-enabled solutions. As part of Amazon Health Services and One Medical, we're on a mission to make quality healthcare more accessible while improving patient outcomes. Our work directly impacts millions of lives by empowering patients and enabling healthcare providers to deliver more meaningful care. Role Overview: We're seeking an Applied Scientist to join our dynamic team in building state of the art AI/ML solutions for healthcare. This role offers a unique opportunity to work at the intersection of artificial intelligence and healthcare, developing solutions that will shape the future of medical services delivery. Key job responsibilities • Lead end-to-end development of AI/ML solutions for Amazon Health organization, including Amazon Pharmacy and One Medical • Research, design, and implement state-of-the-art machine learning models, with a focus on Large Language Models (LLMs) and Visual Language Models (VLMs) • Optimize and fine-tune models for production deployment, including model distillation for improved latency • Drive scientific innovation while maintaining a strong focus on practical business outcomes • Collaborate with cross-functional teams to translate complex technical solutions into tangible customer benefits • Contribute to the broader Amazon Health scientific community and help shape our technical roadmap
GB, London
In Amazon Advertising, we apply machine learning at massive scale to optimize the prediction, ranking, and bidding behind every ad — deciding, in milliseconds, which ads to show shoppers and how to value them. We're looking for an Applied Scientist to help make sure the ads shoppers see are the right ones for them. You'll work across the science of how we rank, value, and bid on ads for Amazon DSP (Amazon's Demand-Side Platform) — including how we judge whether an ad is a good fit for the page a shopper is on and for the shopper themselves. It's high-scale, low-latency, customer-facing science: your models run live in front of millions of shoppers under tight real-time constraints. The questions are genuinely open — how do you tell whether an ad is relevant to someone, how do you balance what's good for shoppers, advertisers, and Amazon, and how do you keep getting that right as shopping behavior and inventory shift underneath you? Your work will have real impact, and you'll have room to shape where we take it. A few things make this stand out: your models touch a huge share of the ads shoppers see every day, so even small improvements add up fast; you'll run modern ML live under strict latency limits, across regions and very different types of ad inventory; and the problem space is rich — from how we value and bid on ads, to keeping models stable as traffic shifts, to what makes an ad a good fit for a shopper. Key job responsibilities - Design and improve the models that decide how ads are ranked, valued, and priced — including how relevant an ad is to the page and the shopper. - Apply and extend state-of-the-art techniques across e.g. ranking, deep learning, and information retrieval. - Own problems end to end: frame them, prototype, experiment, and ship them to production. - Balance competing objectives — shopper experience, advertiser and publisher value, and Amazon's business — into models that hold up across placements and marketplaces. - Communicate your work clearly to both business and science audiences, tailoring how you share it to each. - Write and ship your own production code backed by strong engineering support — we're all builders here. - Move fast with the best tools available, including modern AI coding assistants and agents. A day in the life You might start by digging into last week's experiment results, then use an AI coding agent to get your next prototype built and ready to test in production. In the afternoon you could be sketching a new way to measure ad relevance, reading a recent paper that bears on it, and talking it through with a senior scientist on the team. You'll move between hands-on science, writing and shipping real production code, and making the calls on your own work. About the team We're a group of scientists and engineers based in Edinburgh and London, working to make Amazon's ads more performant and relevant. We sit within a larger team spread primarily across New York City and the UK, and we have a broad mandate to build and experiment. You'll work alongside senior applied scientists you can learn from, with the data and infrastructure to do the work well and room to grow — with opportunities to attend top conferences (e.g., NeurIPS, KDD, ICML) and take on more scope over time.
US, WA, Seattle
We are seeking a Principal Applied Scientist to own the scientific vision across Agentic WorkSpaces. This is a foundational role spanning the full portfolio — Personal, Applications, and Core, and the agentic surfaces (WS4Builders and WorkSpaces for Agents). You will define how we measure, improve, and guarantee the performance of AI agents and human-AI teams. A core part of the role is defining the science agenda itself — identifying which problems are most worth solving and where the highest-leverage bets lie. Directions worth exploring might include Organizational Intelligence (turning institutional knowledge into agent-consumable skills), AI Agent Experience / AiAX (agent observability and autonomous remediation), and contextual, behavioral security that adapts enforcement in real time for human and agent sessions — but these are illustrative examples, not a fixed roadmap, and many other directions are possible. You will help define which ones we pursue. The problems you will solve do not have established industry patterns. You will set the direction for the science of how AI agents and people perceive, reason about, and act reliably within computing environments at enterprise scale. Key job responsibilities - Set the long-term scientific vision: Define what best-in-class agent performance, evaluation, and learning look like across Agentic WorkSpaces — for computer-using agents and human-AI teams alike. Identify the unsolved scientific problems, chart a multi-year research roadmap, and secure buy-in from VP-level leadership. - Solve highly ambiguous, novel problems: Independently frame and deliver solutions to foundational challenges in agent perception, reasoning, evaluation, reliability, and human-AI collaboration — problems where neither the approach nor the success criteria are pre-defined. - Own the evaluation and measurement foundation: Build the benchmarks, datasets, and metrics that quantify agent and team accuracy, cost, productivity, and safety across the portfolio and diverse enterprise workflows, and that gate what we ship. - Drive cross-organizational scientific alignment: Work across partner teams (AgentCore, Bedrock model teams, Identity, Security, the MCP ecosystem) and across the Applied AI Solutions product portfolio to shape how models and agent frameworks are applied, and ensure scientific decisions compose into a coherent system. - Deliver measurable business impact: Ensure research translates to customer outcomes: higher task accuracy, lower cost-per-action, faster time-to-production, measurable productivity for human-AI teams, and the trust that lets enterprises scale agent workflows. - Raise the scientific bar: Establish rigor in experimentation, evaluation, and reproducibility. Mentor and grow senior scientists and engineers. Set the standard for applied science quality across the organization. - Advance the state of the art: Contribute to the external technical community through publications, patents, and open-source contributions that position AWS as the leader in the science of secure agent-computer interaction and human-AI teamwork. About the team AWS Applied AI Solutions' (AAIS) vision is every business innovating with Amazon AI teammates. Our mission is to build delightful AI solutions that improve human capabilities and business outcomes. The Agentic WorkSpaces organization within AAIS envisions a world where people, teams, and AI collaborate securely from anywhere to create unprecedented value for every organization. We build lovable products that empower every business to unlock the full potential of human-AI teamwork, driving smarter decisions, greater creativity, more value, and faster innovation with confidence. Amazon Agentic WorkSpaces (AAWS) is building the world's most lovable, secure, and trusted always-on workspace where AI agents and humans work as partners behind enterprise-grade security. Our portfolio spans persistent desktops (Personal), application streaming (Applications), and Core, and is evolving into the governed operating environment for the hybrid workforce: humans get AI-native desktops for their role, and agents get governed desktops scoped to their task, with administrators managing both as one. This surface includes WS4Builders (an AI-native environment for builders) and WorkSpaces for Agents (W4A) — enabling AI agents to work the way humans do, with access to real applications, real interfaces, and real computing environments. Enterprises want to use AI agents for critical business workloads that touch legacy desktop applications and mainframes, yet 75% of organizations run legacy applications that lack modern APIs, and 90% of corporate data remains locked in systems never designed for agents. Agentic WorkSpaces solves this: it gives enterprises a secure, governed environment where agents and humans operate both legacy and modern applications directly, just as an employee would, without costly migrations.
US, WA, Seattle
We are seeking a Senior Manager, Applied Science to build and lead the science organization across Agentic WorkSpaces. This is a foundational leadership role spanning the full portfolio — Personal, Applications, and Core, and the agentic surfaces (WS4Builders and WorkSpaces for Agents). You will hire, grow, and lead a team of applied scientists who define how we measure and improve the performance of AI agents and human-AI teams. A core part of the role is defining the science agenda itself — identifying which problems are most worth solving and where the highest-leverage bets lie. Directions worth exploring might include Organizational Intelligence (turning institutional knowledge into agent-consumable skills), AI Agent Experience / AiAX (agent observability and autonomous remediation), and contextual, behavioral security that adapts enforcement in real time for human and agent sessions — but these are illustrative examples, not a fixed roadmap, and many other directions are possible. You and your team will define which ones we pursue. The problems your team will solve do not have established industry patterns. You will set the scientific direction and build the team that determines how AI agents and people perceive, reason about, and act reliably within computing environments at enterprise scale. What You Will Do Build and lead the applied science team. Hire, develop, and retain a high-caliber team of applied scientists spanning the Agentic WorkSpaces portfolio. Set the bar for scientific talent, create the growth paths, and build the culture that makes AAWS a destination for the best agent and human-AI researchers. Own the science strategy across the portfolio. Direct the research agenda for how we measure and improve agents and human-AI teams: the benchmarks, task suites, and metrics (accuracy, cost-per-task, task completion, productivity) that turn subjective "it works" judgments into rigorous, reproducible measurement that gates what we ship. Define and drive high-leverage research directions. Work with your team to identify the problems most worth solving and shape the science agenda. Directions worth exploring might include how agents combine deterministic tool use (MCP) with visual reasoning from computer use; Organizational Intelligence and workflow learning (learning from expert recordings, voice annotations, and SOPs); and AI Agent Experience / AiAX (detecting when agents are stuck or degrading productivity and autonomously remediating) — these are illustrative starting points, and your team will weigh them against many other possibilities. Translate science into shipped product. Partner with engineering, product, and program leaders to move models, evaluation, and learning systems from prototype into a decade-old production service operating at massive scale, without compromising the reliability that customers depend on. Represent science in leadership and to customers. Be the scientific voice in org-level planning and roadmap decisions across AAWS, and engage directly with enterprise customers on how agent performance, safety, and human-AI productivity are measured and earned. Key job responsibilities Build and lead the applied science team. Hire, develop, and retain a high-caliber team of applied scientists spanning the Agentic WorkSpaces portfolio. Set the bar for scientific talent, create the growth paths, and build the culture that makes AAWS a destination for the best agent and human-AI researchers. Own the science strategy across the portfolio. Direct the research agenda for how we measure and improve agents and human-AI teams: the benchmarks, task suites, and metrics (accuracy, cost-per-task, task completion, productivity) that turn subjective "it works" judgments into rigorous, reproducible measurement that gates what we ship. Define and drive high-leverage research directions. Work with your team to identify the problems most worth solving and shape the science agenda. Directions worth exploring might include how agents combine deterministic tool use (MCP) with visual reasoning from computer use; Organizational Intelligence and workflow learning (learning from expert recordings, voice annotations, and SOPs); and AI Agent Experience / AiAX (detecting when agents are stuck or degrading productivity and autonomously remediating) — these are illustrative starting points, and your team will weigh them against many other possibilities. Translate science into shipped product. Partner with engineering, product, and program leaders to move models, evaluation, and learning systems from prototype into a decade-old production service operating at massive scale, without compromising the reliability that customers depend on. Represent science in leadership and to customers. Be the scientific voice in org-level planning and roadmap decisions across AAWS, and engage directly with enterprise customers on how agent performance, safety, and human-AI productivity are measured and earned. Set the long-term scientific vision and team strategy: Define what best-in-class agent performance, evaluation, and learning look like across Agentic WorkSpaces — for computer-using agents and human-AI teams alike. Chart a multi-year research roadmap, and build the team and plan to deliver it. Secure buy-in from VP-level leadership. Hire and grow scientific talent: Own recruiting, calibration, development, and retention for the science team. Mentor scientists toward senior and principal scope, and raise the scientific bar across the organization. Direct research on highly ambiguous, novel problems: Guide the team through foundational challenges in agent perception, reasoning, evaluation, reliability, and human-AI collaboration — problems where neither the approach nor the success criteria are pre-defined. Drive cross-organizational alignment: Work across partner teams (AgentCore, Bedrock model teams, Identity, Security, the MCP ecosystem) and across the Applied AI Solutions product portfolio, with product and engineering leadership, to ensure scientific decisions compose into a coherent product. Deliver measurable business impact: Ensure your team's research translates to customer outcomes: higher task accuracy, lower cost-per-action, faster time-to-production, measurable productivity for human-AI teams, and the trust that lets enterprises scale agent workflows. Establish scientific rigor and operational excellence: Set the standard for experimentation, evaluation, and reproducibility, and the mechanisms that keep the science organization productive and accountable. Advance the state of the art: Enable and champion contributions to the external technical community through publications, patents, and open-source work that position AWS as the leader in the science of secure agent-computer interaction and human-AI teamwork. About the team AWS Applied AI Solutions' (AAIS) vision is every business innovating with Amazon AI teammates. Our mission is to build delightful AI solutions that improve human capabilities and business outcomes. The Agentic WorkSpaces organization within AAIS envisions a world where people, teams, and AI collaborate securely from anywhere to create unprecedented value for every organization. We build lovable products that empower every business to unlock the full potential of human-AI teamwork, driving smarter decisions, greater creativity, more value, and faster innovation with confidence. Amazon Agentic WorkSpaces (AAWS) is building the world's most lovable, secure, and trusted always-on workspace where AI agents and humans work as partners behind enterprise-grade security. Our portfolio spans persistent desktops (Personal), application streaming (Applications), and Core, and is evolving into the governed operating environment for the hybrid workforce: humans get AI-native desktops for their role, and agents get governed desktops scoped to their task, with administrators managing both as one. This surface includes WS4Builders (an AI-native environment for builders) and WorkSpaces for Agents (W4A) — enabling AI agents to work the way humans do, with access to real applications, real interfaces, and real computing environments. Enterprises want to use AI agents for critical business workloads that touch legacy desktop applications and mainframes, yet 75% of organizations run legacy applications that lack modern APIs, and 90% of corporate data remains locked in systems never designed for agents. Agentic WorkSpaces solves this: it gives enterprises a secure, governed environment where agents and humans operate both legacy and modern applications directly, just as an employee would, without costly migrations.
IN, HR, Gurugram
Work on ML teams building large-scale forecasting and optimization systems that power Amazon’s global transportation network and directly impact customer experience and cost. As an Applied Scientist II, you will set scientific direction, mentor applied scientists, and partner with engineering and product leaders to deliver production-grade ML solutions at massive scale. Key job responsibilities 1. Lead and grow a high-performing team of Applied Scientists, providing technical guidance, mentorship, and career development. 2. Define and own the scientific vision and roadmap for ML solutions powering large-scale transportation planning and execution. 3. Guide model and system design across a range of techniques, including tree-based models, deep learning (LSTMs, transformers), LLMs, and reinforcement learning. 4. Ensure models are production-ready, scalable, and robust through close partnership with stakeholders. Partner with Product, Operations, and Engineering leaders to enable proactive decision-making and corrective actions. 5. Own end-to-end business metrics, directly influencing customer experience, cost optimization, and network reliability. 6. Help contribute to the broader ML community through publications, conference submissions, and internal knowledge sharing. A day in the life Your day includes reviewing model performance and business metrics, guiding technical design and experimentation, mentoring scientists, and driving roadmap execution. You’ll balance near-term delivery with long-term innovation while ensuring solutions are robust, interpretable, and scalable. Ultimately, your work helps improve delivery reliability, reduce costs, and enhance the customer experience at massive scale.
US, NY, New York
At Amazon Selection and Catalog Systems (ASCS), our mission is to power the online buying experience for customers worldwide so they can find, discover, and buy any product they want. We innovate on behalf of our customers to infer relationships between products in Amazon Catalog to drive the selection gateway for the search and browse experiences on the website. We're solving a fundamental AI challenge: establishing product identity and relationships at unprecedented scale. Using Generative AI, Visual Language Models (VLMs), and multimodal reasoning, we determine what makes each product unique and how products relate to one another across Amazon's catalog. The scale is staggering: billions of products, petabytes of multimodal data, millions of sellers, dozens of languages, and infinite product diversity—from electronics to groceries to digital content. The research challenges are immense. GenAI and VLMs hold transformative promise for catalog understanding, but we operate where traditional methods fail: ambiguous problem spaces, incomplete and noisy data, inherent uncertainty, reasoning across both images and textual data, and explaining decisions at scale. Establishing product identities and groupings requires sophisticated models that reason across text, images, and structured data—while maintaining accuracy and trust for high-stakes business decisions affecting millions of customers daily. Amazon's Item and Relationship Platform group is looking for an innovative and customer-focused applied scientist to help us make the world's best product catalog even better. In this role, you will partner with technology and business leaders to build new state-of-the-art algorithms, models, and services to infer product-to-product relationships that matter to our customers. You will pioneer advanced GenAI solutions that power next-generation agentic shopping experiences, working in a collaborative environment where you can experiment with massive data from the world's largest product catalog, tackle problems at the frontier of AI research, rapidly implement and deploy your algorithmic ideas at scale, across millions of customers. Key job responsibilities * Formulate novel research problems at the intersection of GenAI, multimodal learning, and large-scale information retrieval—translating ambiguous business challenges into tractable scientific frameworks * Design and implement leading models leveraging VLMs, foundation models, and agentic architectures to solve product identity, relationship inference, and catalog understanding at billion-product scale * Pioneer explainable AI methodologies that balance model performance with scalability requirements for production systems impacting millions of daily customer decisions * Own end-to-end ML pipelines from research ideation to production deployment—processing petabytes of multimodal data with rigorous evaluation frameworks * Define research roadmaps aligned with business priorities, balancing foundational research with incremental product improvements * Mentor peer scientists and engineers on advanced ML techniques, experimental design, and scientific rigor—building organizational capability in GenAI and multimodal AI * Represent the team in the broader science community—publishing findings, delivering tech talks, and staying at the forefront of GenAI, VLM, and agentic system research
IN, KA, Bengaluru
Amazon Ads is a multi-billion dollar global business that delivers advertising experiences across Amazon's owned-and-operated properties (including Prime Video, Twitch, Fire TV, and Amazon.com), third-party publisher networks, and emerging channels like generative AI-powered shopping experiences. As one of the fastest-growing segments of Amazon, we operate at unprecedented scale across desktop, mobile, connected TV, and emerging surfaces. Within Amazon Ads, Traffic Quality is a critical pillar of advertiser trust and marketplace integrity. Our mission is to build advanced capabilities that work at petabyte scale to detect sophisticated invalid traffic (IVT) which includes sophisticated non-human traffic, bot networks, and fraudulent engagement patterns across programmatic advertising. We are on a journey to establish Amazon Ads as an industry leader in traffic quality standards and transparency. Our research agenda focuses on staying ahead of adversarial actors through continuous innovation in detection methodologies, leveraging state-of-the-art techniques in deep learning and generative modeling, user behavior and multi-modal representation learning, anomaly detection, time-series analysis, and sparse labeling methods. We process billions of ad events daily, developing novel algorithms that balance precision and recall while operating under strict latency constraints. Our work directly protects hundreds of millions of dollars in advertiser spend annually while maintaining a seamless user experience. Key job responsibilities As a Data Scientist II in Traffic Quality, you will solve inherently hard problems in advertising fraud detection by applying advanced statistical techniques and machine learning. You'll work on systems that process billions of ad impressions and clicks per day, using Amazon's cloud services including EC2, S3, EMR, Sagemaker, and RedShift. - Define and frame new research problems in fraud detection where neither problem nor solution is well-defined. - Apply new machine learning approaches, models, and algorithms to detect sophisticated invalid traffic. - Apply domain knowledge to perform broad data analysis as a precursor to modeling and build business insights. - Work with unstructured and massive datasets to deliver results. - Produce research reports meeting top-tier external publication standards. - Mentor and develop junior scientists on the team. About the team Here are a few papers published by the team: 1/ [Scaling Generative Pre-training for User Ad Activity Sequences. AdKDD 2023.](https://assets.amazon.science/b7/42/03be071743d5a57cb1656e6caa34/scaling-generative-pre-training-for-user-ad-activity-sequences.pdf) 2/ [SLIDR: Real-time Robot Detection On Online Ads, IAAI 2023, Deployed Highly Innovative Applications of AI Track (AAAI 2023)](https://assets.amazon.science/75/2f/3b7106b143f38f7f4d2806388ace/real-time-detection-of-robotic-traffic-in-online-advertising.pdf) 3/ [Self-supervised Representation Learning Across Sequential and Tabular Features Using Transformers, NeurIPS 2022, First Table Representation Learning Workshop](https://openreview.net/forum?id=wIIJlmr1Dsk)