Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication.png
Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?” was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.
Glynis Condon

3 questions with Özalp Özer: How to build trust in business relationships

Özer’s paper published in INFORMS’ Management Science 2021 explores the dynamics behind “cheap-talk” communications.

Trust and trustworthiness are important in both our personal and business relationships. How then can we build environments that foster increased trust, trustworthiness and cooperation?

In the first edition of a new series that focuses on research papers published by scientists within the Amazon Supply Chain Optimization Technologies (SCOT) organization, we interview Özalp Özer, coauthor of “Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?”. The paper was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.

Özalp Özer profile image
Özalp Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas.

Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas (UTD). He earned a PhD in operations research from Columbia University, before going on to serve on the faculty at Stanford and Columbia. Özer has published extensively on a diverse range of topics, from supply chain management, capacity and inventory management to pricing and revenue management.

Özer says that a guiding principle behind his research is to focus on solving problems that have a real-world impact at scale. At Stanford and then UTD, Özer found himself drawn to the field of behavioral and experimental economics — particularly the field of game theory and understanding how to model actions and emotions in scenarios involving multiple decision makers in dynamic environments.

Driven by his interest in tackling real-world business problems, Özer remained engaged with industry during his tenure as an academic. While working on a project focused on designing effective procurement contracts, he observed the important role that trust played in establishing and fostering business relationships.

In many cases, the interests of the parties engaging in a negotiation are not aligned. To give one example, suppliers can use product forecast information from a buyer to make capacity, inventory and other manufacturing-related decisions. However, buyers might often provide suppliers with overly optimistic forecasts to ensure an abundant supply. If the demand for the product turns out to be lower than anticipated, the supplier bears the excess investment risk.

Özer says that this scenario represents an example of “cheap talk communications.” He outlines three characteristics that are common to all cheap talk communications: they are costless (they are devoid of monetary penalties), they are non-binding (a buyer can provide a forecast without committing to it), and they are non-verifiable (no forecast can be completely accurate in the light of market uncertainty). To complicate matters, the objective functions that each party is trying to maximize are at odds (or not perfectly aligned) with each other.

Standard game theory suggests that each party in a business transaction will move toward an equilibrium that maximizes their own payoff. In a cheap-talk setting, where the information is costless, non-binding and non-verifiable, the theory suggests that each party will disregard the information supplied by the other.

However, Özer finds that people involved in business (as well as personal) transactions frequently factor into their decision-making information supplied by the other party, even when their incentives are not perfectly aligned and even when the information or recommendation may be perceived as “cheap”. They do this by taking the business context and the related relationship into account. Doing so results in higher returns for both parties involved. For example, third-party sellers are more likely to act on price reduction or replenishment recommendations from Amazon, if they find that these recommendations have previously resulted in an uptick in sales and profits.

Ozer says that “cheap talk” communications have the unfortunate emphasis on being “cheap” and less emphasis on how they are informative and can align incentives. In a series of publications, Ozer shows why, when, and how such communications and recommendations turn out to be informative, and how they help align business objectives, resulting in both parties making better decisions.   

In this interview, Özer talks about findings from the recently published INFORMS paper and discusses the implications of these findings for companies like Amazon.

Q. What are the two models that can be used to explain how cheap talk communications work between decision makers?

As our paper suggests, there are two contrasting economic theories that can be used to analyze cheap-talk communications.

The trust-embedded model — which takes a more optimistic view of humanity — suggests that decision makers are motivated by non-monetary motives to be trusting and trustworthy, besides the monetary incentives such as maximizing cash flow.   

Here, we define trust as instances of decision makers behaving voluntarily in a way that put themselves in vulnerable engagement due to the uncertain behavior of the other party (the trustee), based upon the expectation of a positive outcome from that engagement. Trustworthiness flips the perspective to that of the trustee. We define trustworthiness as an instance of a decision maker behaving voluntarily in a way not to take advantage of the trustor’s vulnerable position – even when faced with a self-serving decision that conflicts with the trustor’s objectives.

Humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk.
Özalp Özer

The trust-embedded model suggests that when engaging with others, decision makers are averse to manipulating information in economic interactions. They incur disutility from lying. As a result, they assess the trustworthiness of the counterparty, and they form a trust factor towards them. This trust factor governs how decision makers interpret and use the information they receive from others.

In other words, humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk. Because they assess — even sometimes incorrectly — that doing so yields positive outcomes, they engage in and cultivate behaviors conducive to enabling these outcomes.

The trust embedded model suggests that individuals are guided by more than self-interest or pecuniary motives as they engage in transactions. For example, senders of information are guided by factors such as fairness and tenets that are central to their company. As a result, they share more information and resources than strictly necessary.

In contrast to the trust-embedded model, the level-k model — the second model discussed in the paper — suggests that decision makers are limited in their ability to think strategically. Receivers of information cannot anticipate the extent to which the sender might have distorted the message. On the flip-side, senders cannot account for just how much receivers might discount their message. Consequently, senders share more than necessary, because they take a dim view of the receiver’s ability to discount their message.

It’s important to note that even the level-k model can sometimes explain why senders and receivers tend to overshare information in a cheap-talk setting, which contrasts with the outcome standard game theory models would predict. It’s just that their motivations are different – with the level-k model, oversharing is driven by a limited ability to think strategically, rather than by the willingness to be trusting and trustworthy.

Overall, our paper that analyzed existing cheap-talk experiment data, found more support for the trust-embedded model, suggesting that individuals are also driven by non-monetary incentives when conducting transactions.

Q. Why do you think that trust-embedded models do a better job of explaining cheap-talk communications? What are the implications for organizations engaging in relationships with businesses and partners?

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust.
Özalp Özer

The answer to your first question is relatively simple — human beings are far more sophisticated than the level-k model gives them credit for. For example, there are many sellers on Amazon’s website who are proficient in using a variety of tools they have developed to make decisions related to pricing and inventory.

As a result, if we want the tools we provide to earn sellers’ trust, we need to think of the system more holistically at both an architecture and policy level to truly understand what builds trust and what is a trust-buster.

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust. Product reviews, the ability to get refunds for a vacation rental because hosts might not have lived up to their promises, or the price for a ride being set in advance — these are some of the mechanisms that let you buy a product or rent a home from people you don’t know.

Q. How are the findings in your paper applicable to your work at Amazon?

We are leveraging the insights from this stream of research as well as others to augment our understanding of seller trust, particularly in relation to how sellers interact with our inventory management tools, and how fidelity of recommendations impact sellers’ trust.

There is no interaction at Amazon that I can think of that doesn’t have an element of trust.
Özalp Özer

We are designing our related processes to reduce barriers for trusting and trustworthy engagements among the participants of our stores; for example, by making specific investments to support seller growth in areas that benefit sellers and customers the most; by reducing perceived vulnerabilities in carrying excess inventory; by looking into ways in which we stabilize our policies; by creating visibility to the reasons for our recommendations; by looking into ways in which we can build interactive communication channels among participants in our stores; and by building reputation and feedback systems that foster trusting and trustworthy engagements and on and on.

Using large-scale data, scientific methods like causal machine learning to optimization, as well as continual engagement with selling partners and customers, we aim to identify at the extent to which sellers trust evolves — so we can identify and invest in processes that foster trust and as a result growth and economic prosperity.  

There is no interaction at Amazon that I can think of that doesn’t have an element of trust. Jeff Bezos has said, “You can’t ask for trust, you just have to do it the hard way, one step at a time.” In my time at the company, I have been struck by the tireless efforts of so many people to gain seller and customer trust. At Amazon, it is just part of everything we do.

Related content

US, WA, Seattle
This role sits within Amazon's Automated Reasoning and Formal Verification research horizon. Shape the Future of Cloud Computing. Are you a graduate student passionate about Automated Reasoning and its real-world applications? Join our team of innovators and embark on a journey to revolutionize cloud computing through innovative automated reasoning techniques. Our tools are called billions of times daily, powering the backbone of Amazon's products and services. We are changing the way computer systems are developed and operated, raising the bar for security, durability, availability, and quality. Applied Scientists in Automated Reasoning develop and apply formal methods, automated reasoning techniques, and neurosymbolic approaches to ensure the security, reliability, and correctness of Amazon and AWS services and customer applications. Application areas span cloud infrastructure verification, cryptographic assurance, AI safety, and formal guarantees for generative AI systems. Methods range from interactive theorem proving and constraint solving to neuro-inspired proof search. As an Applied Science Intern, you will have the opportunity to work alongside our scientists and contribute to projects. From distributed proof search and SAT/SMT solvers to program analysis, synthesis, and verification, you will tackle complex challenges at the intersection of theory and practice. Amazon has positions available for Automated Reasoning Applied Science Internships in, but not limited to, Arlington, VA; Boston, MA; New York, NY; Portland, OR; Santa Clara, CA; Seattle, WA. Key job responsibilities We are particularly interested in candidates with expertise in: Theorem Proving, Boolean Satisfiability Solvers, Bounded Model Checking, Deductive Verification, Programming/Scripting Languages, Abstract Interpretation, Automated Reasoning, Static/Program Analysis, Program Synthesis. Contribute to the design and implementation of algorithms and formal methods for automated reasoning, including constraint solving, model checking, static analysis, theorem proving, and program synthesis, within a guided research framework. Explore and apply generative AI and machine learning techniques to enhance automated reasoning, including learning-based heuristics for search, neural approaches to symbolic reasoning, and methods for verifying the correctness of AI-generated code. Contribute to automated reasoning techniques for generative AI and agentic coding systems, including methods that apply formal guarantees to large language model outputs. Contribute to the scientific community through publications at peer-reviewed conferences and journals. Leverage AI-powered tools where applicable to accelerate research, experimentation, and prototyping. Critically review and validate outputs from AI tools and automated systems. The ideal intern must have the ability to communicate research findings clearly to diverse audiences.
US, NY, New York
We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance. You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection. The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems. Key job responsibilities - Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios - Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies - Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs - Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection - Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection - Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack - Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
US, WA, Seattle
We are looking for a talented, organized, and customer-focused applied researcher to join our Pricing Optimization science group, with a charter to measure, refine, and launch customer-obsessed improvements to our algorithmic pricing and promotion models across all products listed on Amazon. This role requires an individual with exceptional machine learning modeling and architecture expertise — particularly in deep learning, neural networks, and transformer-based architectures applied to price prediction and forecasting problems. Equally important is deep expertise in causal machine learning — including causal inference, treatment-effect estimation, and experimentation methods (e.g., uplift modeling, double/debiased machine learning, instrumental variables, and A/B and quasi-experimental design) — to isolate the true impact of pricing and promotion decisions on customer behavior and business outcomes. The ideal candidate brings a strong foundation in applied statistics and probabilistic modeling, excellent cross-functional collaboration skills, business acumen, and an entrepreneurial spirit. We are looking for an experienced innovator who is a self-starter, comfortable with ambiguity, demonstrates strong attention to detail, and has the ability to work in a fast-paced and ever-changing environment. Key job responsibilities See the big picture. Understand and influence the long-term vision for Amazon's science-based competitive, perception-preserving pricing techniques. Develop and advance price prediction models leveraging deep learning frameworks, transformer architectures, and advanced statistical methods to drive pricing accuracy at scale. Build strong collaborations. Partner with product, engineering, and science teams within Pricing & Promotions to deploy machine learning price estimation and error correction solutions at Amazon scale. Design and implement neural network-based architectures — including sequence models and transformers — for large-scale price prediction and optimization. Stay informed. Establish mechanisms to stay up to date on the latest scientific advancements in deep learning, transformer architectures, applied statistics, neural network design, probabilistic forecasting, and multi-objective optimization techniques. Identify opportunities to apply them to relevant Pricing & Promotions business problems. Keep innovating for our customers. Foster an environment that promotes rapid experimentation, continuous learning, and incremental value delivery. Leverage statistical rigor and modern deep learning approaches to validate hypotheses and drive measurable pricing improvements. Successfully execute & deliver. Apply your exceptional technical machine learning expertise — including deep neural networks, attention-based models, and applied statistical analysis — to incrementally move the needle on some of our hardest pricing problems. A day in the life We are hiring a Sr. Applied Scientist to drive our pricing optimization initiatives. We drive cross-domain and cross-system improvements through: * shape and extend our RL optimization platform - a pricing centric tool that automates the optimization of various system parameters and price inputs. * Error detection and price quality guardrails at scale. * Identifying opportunities to optimally price across systems and contexts (marketplaces, request types, event periods) Price is a highly relevant input into Stores architectures; this role creates the opportunity to drive extremely large impact (measured in Bs not Ms), but demands careful thought and clear communication. About the team The Pricing Optimization science group builds and refines Amazon's algorithmic pricing and promotion models at scale. Our team combines expertise in deep learning, transformer architectures, applied statistics, and probabilistic forecasting to develop price prediction systems that directly impact the customer experience. The team also brings hands-on experience with causal modeling and inference — including uplift modeling and treatment effect estimation — to rigorously measure the impact of pricing decisions on customer behavior and business outcomes. We partner closely with product, engineering, and business teams to take solutions from research through production deployment.
IN, KA, Bangalore
Have you ever ordered a product on Amazon and when that box with the smile arrived you wondered how it got to you so fast? Have you wondered where it came from and how much it cost Amazon to deliver it to you? If so, the WW Amazon Logistics, Business Analytics team is for you. We manage the delivery of tens of millions of products every week to Amazon’s customers, achieving on-time delivery in a cost-effective manner. We are looking for an enthusiastic, customer obsessed, Sr. Applied Scientist with good analytical skills to help manage projects and operations, implement scheduling solutions, improve metrics, and develop scalable processes and tools. The primary role of an Operations Research Scientist within Amazon is to address business challenges through building a compelling case, and using data to influence change across the organization. This individual will be given responsibility on their first day to own those business challenges and the autonomy to think strategically and make data driven decisions. Decisions and tools made in this role will have significant impact to the customer experience, as it will have a major impact on how the final phase of delivery is done at Amazon. Ideal candidates will be a high potential, strategic and analytic graduate with a PhD in (Operations Research, Statistics, Engineering, and Supply Chain) ready for challenging opportunities in the core of our world class operations space. Great candidates have a history of operations research, and the ability to use data and research to make changes. This role requires robust program management skills and research science skills in order to act on research outcomes. This individual will need to be able to work with a team, but also be comfortable making decisions independently, in what is often times an ambiguous environment. Responsibilities may include: - Develop input and assumptions based preexisting models to estimate the costs and savings opportunities associated with varying levels of network growth and operations - Creating metrics to measure business performance, identify root causes and trends, and prescribe action plans - Managing multiple projects simultaneously - Working with technology teams and product managers to develop new tools and systems to support the growth of the business - Communicating with and supporting various internal stakeholders and external audiences
US, CA, Palo Alto
About Sponsored Products and Brands The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. Key job responsibilities As a Machine Learning Applied Scientist, you will: * Conduct deep data analysis to derive insights to the business, and identify gaps and new opportunities * Develop scalable and effective machine-learning models and optimization strategies to solve business problems * Run regular A/B experiments, gather data, and perform statistical analysis * Work closely with software engineers to deliver end-to-end solutions into production * Improve the scalability, efficiency and automation of large-scale data analytics, model training, deployment and serving * Conduct research on new machine-learning modeling and Generative AI solutions to optimize all aspects of Sponsored Products and Brands business About the team The Ad Response Prediction team within Sponsored Products and Brands (SPB) drives personalized shopping experiences for SPB Ads across placements, pages, and devices worldwide. We achieve this through ML and GenAI solutions that include customized shopper response prediction and session-level understanding to optimize every stage of the ad-serving process, from sourcing and bidding to widget discovery and auctions. Our responsibilities include advancing response prediction through model and feature innovations and extending prediction beyond the auction stage to areas such as targeting, sourcing, and bidding.
US, NY, New York
We are seeking a Measurement and Attribution Analytics scientist to further the development and application of analytics methods to examine the complex data flows of measurement, attribution and shopper analytics and to translate deep-dives into actionable insights for our product teams. In this role you will develop new tools to analyze our advertising data to help improve the performance of our bidding algorithms, targeting and relevance systems, help advance our supply strategy, and evaluate the adoption and impact of feature releases. Key job responsibilities - Analyze data trends regarding supply, optimization, ad load, and advertising mix effects that affect advertiser performance and contribute to achieving advertiser goals. - Present papers to senior leaders on issues like feature development impact on identity recognition rates, and changes of ad selection systems to improve fill rate highlighting insights that will inform our business development and engineering roadmaps. - Identify, standardize, and operationalize KPIs to effectively measure the performance of all systems involved in ad serving, and use trend insights to inform business priorities. - Partner with engineering teams to define data logging requirements and getting these prioritized in engineering roadmaps. - Validate financial models through analysis - Develop and own ad revenue and supply intelligence analytics decks that provide ongoing deep-dives A day in the life The Measurement and Attribution Scientist will work closely with business leaders and engineers on developing common data architecture that will optimize our data logging at different grains, and will allow data interoperability from bid flow to optimization to campaign delivery. There will be an emphasis on understanding the impact of shopper journeys to and from Amazon properties and their implication on product development. The candidate will then analyze the data and present papers and ongoing reports on actionable insights. About the team The Ads Science Product Team's Mission: Work alongside those who need product data to apply objective perspective and business logic to uncover insights, advise strategic decisions, and adjust to industry changes.
IN, KA, Bangalore
Does the thought of improving one of the world’s most complex logistic systems inspire you? Is your passion to sift through hundreds of systems, processes, and data sources to solve the puzzle and identify the next big opportunity? Are you a creative big thinker who is passionate about using data to direct decision making and solve complex and large-scale challenges? Are you fascinated by the interactions between operations and strategy? Do you feel like your skills uniquely qualify you to bridge communication between teams with competing priorities? If so, then this position is for you! Come help Amazon create state-of-the-art science-driven technologies for delivering packages to the doorstep of our customers! The Last Mile Routing & Planning organization builds the software, algorithms and tools that make the “magic” of home delivery happen: our flow, sort, dispatch and routing intelligence systems are responsible for the billions of daily decisions needed to plan and execute safe, efficient and frustration-free routes for drivers around the world. Our team supports deliveries (and pickups!) for Amazon Logistics, Same Day, Amazon Grocery, Lockers, and other new initiatives across the world. Key job responsibilities In this role, your main focus will be to apply algorithms, synthesize information, identify business opportunities, provide data-driven insights and communicate business and technical requirements within the team and across stakeholder groups. You will partner closely with other scientists and engineers in a collegial environment with a clear path to business impact. We have an exciting portfolio of research areas including vehicle routing, planning for electric and autonomous vehicles, district and stops planning, ultra-fast deliveries, fleet planning, and forecasting solutions for different delivery programs leveraging the latest OR, ML, and Generative AI methods, at a global scale. Successful candidates will have a deep knowledge of Operations Research and/or Machine/Deep Learning methods, experience in applying these methods to large-scale business problems, the ability to map models into production-worthy code in Python or Java, the communication skills necessary to explain complex technical approaches to a variety of stakeholders and customers, and the excitement to take iterative approaches to tackle big research challenges.
US, WA, Bellevue
As an Applied Scientist in Amazon Fullfilment Technology, you will lead the development of agentic systems to assist with operational decision making and orchestration. You will work building full agentic systems leveraging multi-agent orchestration, tool use, memory, and action execution. You will train LLMs using a combination of rejection sampling approaches, SFT, continual post-training, and Reinforcement Learning (RL). These systems are deployed to Amazon buildings, and you will also work on rigorous offline and online evaluations. Your work will leverage the latest LLMs to develop capabilities for agentic reasoning, coding and analytics. You will also lead research projects to tackle unsolved problems, mentor interns, and author academic papers to summarize your findings for external publication. Key job responsibilities - Generating training and preference data for specific use cases (reasoning trajectories, tool traces) - Reward modeling and policy optimization for LLMs: DPO, IPO, RLHF/RLAIF with PPO/GRPO, rejection sampling. - Supervised fine-tuning on step-by-step trajectories and tool-use traces - Verbal Reinforcement Learning and Continual Learning - RL for LLMs, Offline RL and off-policy evaluation - Agentic memory/state management; episodic and semantic memory; vector search; grounding with RAG. - Evaluation: developing decision quality metrics, scaling LLM-based evaluations. About the team Amazon Fulfillment Technologies (AFT) powers Amazon's global fulfillment network. We invent and deliver software, hardware, and data science solutions that orchestrate processes, robots, machines, and people. We harmonize the physical and virtual world so Amazon customers can get what they want, when they want it. Learn more about AFT: https://tinyurl.com/AFTOverview
US, WA, Bellevue
As an Applied Scientist in Amazon Fullfilment Technology, you will lead the development of agentic systems to assist with operational decision making and orchestration. You will work building full agentic systems leveraging multi-agent orchestration, tool use, memory, and action execution. You will train LLMs using a combination of rejection sampling approaches, SFT, continual post-training, and Reinforcement Learning (RL). These systems are deployed to Amazon buildings, and you will also work on rigorous offline and online evaluations. Your work will leverage the latest LLMs to develop capabilities for agentic reasoning, coding and analytics. You will also lead research projects to tackle unsolved problems, mentor interns, and author academic papers to summarize your findings for external publication. Key job responsibilities - Generating training and preference data for specific use cases (reasoning trajectories, tool traces) - Reward modeling and policy optimization for LLMs: DPO, IPO, RLHF/RLAIF with PPO/GRPO, rejection sampling. - Supervised fine-tuning on step-by-step trajectories and tool-use traces - Verbal Reinforcement Learning and Continual Learning - RL for LLMs, Offline RL and off-policy evaluation - Agentic memory/state management; episodic and semantic memory; vector search; grounding with RAG. - Evaluation: developing decision quality metrics, scaling LLM-based evaluations. About the team Amazon Fulfillment Technologies (AFT) powers Amazon's global fulfillment network. We invent and deliver software, hardware, and data science solutions that orchestrate processes, robots, machines, and people. We harmonize the physical and virtual world so Amazon customers can get what they want, when they want it. Learn more about AFT: https://tinyurl.com/AFTOverview
US, VA, Arlington
Are you excited about making business decisions using science and data? Are you interested in supporting consumer device concepts from idea inception to launch? Do you want to work on a Science Product team focused on scaling statistics and econometrics with custom tools? If so, this may be the role for you! Amazon.com strives to be Earth's most customer-centric company. The Amazon Devices and Services team focuses on delighting customer by enabling seamless functionality in supplying, entertaining, and managing the home -- and beyond. We seek and hire the world's brightest minds, offering them a fast-paced, technologically-sophisticated, and friendly work environment, where economic theory meets real-world industry. The Decision Science team in Devices owns demand estimates and pricing recommendations of concept devices before customers know they exist. We support devices and services ranging from Echo Frames to Kindle Paperwhite to Blink Video Camera …all prior to launch. We are a cross-functional Product team working to scale Econometrics through Amazon and beyond by incorporating Science into internal facing tools and making it easier for others to do so as well. In this role, you will have input in decision meetings with Amazon senior leadership, which include go/no-go decisions for brand new devices and services and build volume decisions for manufacture prior to receiving any customer signal. You will have direct input to pricing decisions. You will leverage Science and Tools produced by the Decision Science team such as conjoint demand models to produce these recommendations. You will work with Scientists, Economists, Product Managers, and Software Developers to provide meaningful feedback about stakeholder problems to inform business solutions and increase the velocity, quality, and scope behind our recommendations. You will also have the opportunity to work on special projects to both guide the business and advance your own knowledge and understanding of specific topics. Key job responsibilities Applies expertise to develop econometric/machine learning models to measure the demand of devices and the business; Reviews models and results for other scientists, mentors junior scientists; Generates economic insights for the Devices and Services business and work with stakeholders to run the business for effectively; Describes strategic importance of vision inside and outside of team; and, Identifies business opportunities, defines the problem and how to solve it; Engages with senior scientists, business leadership outside Devices and Services to understand interplay between different business units.