Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication.png
“Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?” was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.
Glynis Condon

3 questions with Özalp Özer: How to build trust in business relationships

Özer’s paper published in INFORMS’ Management Science 2021 explores the dynamics behind “cheap-talk” communications.

Trust and trustworthiness are important in both our personal and business relationships. How then can we build environments that foster increased trust, trustworthiness and cooperation?

In the first edition of a new series that focuses on research papers published by scientists within the Amazon Supply Chain Optimization Technologies (SCOT) organization, we interview Özalp Özer, coauthor of “Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?”. The paper was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.

Özalp Özer profile image
Özalp Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas.

Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas (UTD). He earned a PhD in operations research from Columbia University, before going on to serve on the faculty at Stanford and Columbia. Özer has published extensively on a diverse range of topics, from supply chain management, capacity and inventory management to pricing and revenue management.

Özer says that a guiding principle behind his research is to focus on solving problems that have a real-world impact at scale. At Stanford and then UTD, Özer found himself drawn to the field of behavioral and experimental economics — particularly the field of game theory and understanding how to model actions and emotions in scenarios involving multiple decision makers in dynamic environments.

Driven by his interest in tackling real-world business problems, Özer remained engaged with industry during his tenure as an academic. While working on a project focused on designing effective procurement contracts, he observed the important role that trust played in establishing and fostering business relationships.

In many cases, the interests of the parties engaging in a negotiation are not aligned. To give one example, suppliers can use product forecast information from a buyer to make capacity, inventory and other manufacturing-related decisions. However, buyers might often provide suppliers with overly optimistic forecasts to ensure an abundant supply. If the demand for the product turns out to be lower than anticipated, the supplier bears the excess investment risk.

Özer says that this scenario represents an example of “cheap talk communications.” He outlines three characteristics that are common to all cheap talk communications: they are costless (they are devoid of monetary penalties), they are non-binding (a buyer can provide a forecast without committing to it), and they are non-verifiable (no forecast can be completely accurate in the light of market uncertainty). To complicate matters, the objective functions that each party is trying to maximize are at odds (or not perfectly aligned) with each other.

Standard game theory suggests that each party in a business transaction will move toward an equilibrium that maximizes their own payoff. In a cheap-talk setting, where the information is costless, non-binding and non-verifiable, the theory suggests that each party will disregard the information supplied by the other.

However, Özer finds that people involved in business (as well as personal) transactions frequently factor into their decision-making information supplied by the other party, even when their incentives are not perfectly aligned and even when the information or recommendation may be perceived as “cheap”. They do this by taking the business context and the related relationship into account. Doing so results in higher returns for both parties involved. For example, third-party sellers are more likely to act on price reduction or replenishment recommendations from Amazon, if they find that these recommendations have previously resulted in an uptick in sales and profits.

Ozer says that “cheap talk” communications have the unfortunate emphasis on being “cheap” and less emphasis on how they are informative and can align incentives. In a series of publications, Ozer shows why, when, and how such communications and recommendations turn out to be informative, and how they help align business objectives, resulting in both parties making better decisions.   

In this interview, Özer talks about findings from the recently published INFORMS paper and discusses the implications of these findings for companies like Amazon.

Q. What are the two models that can be used to explain how cheap talk communications work between decision makers?

As our paper suggests, there are two contrasting economic theories that can be used to analyze cheap-talk communications.

The trust-embedded model — which takes a more optimistic view of humanity — suggests that decision makers are motivated by non-monetary motives to be trusting and trustworthy, besides the monetary incentives such as maximizing cash flow.   

Here, we define trust as instances of decision makers behaving voluntarily in a way that put themselves in vulnerable engagement due to the uncertain behavior of the other party (the trustee), based upon the expectation of a positive outcome from that engagement. Trustworthiness flips the perspective to that of the trustee. We define trustworthiness as an instance of a decision maker behaving voluntarily in a way not to take advantage of the trustor’s vulnerable position – even when faced with a self-serving decision that conflicts with the trustor’s objectives.

Humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk.
Özalp Özer

The trust-embedded model suggests that when engaging with others, decision makers are averse to manipulating information in economic interactions. They incur disutility from lying. As a result, they assess the trustworthiness of the counterparty, and they form a trust factor towards them. This trust factor governs how decision makers interpret and use the information they receive from others.

In other words, humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk. Because they assess — even sometimes incorrectly — that doing so yields positive outcomes, they engage in and cultivate behaviors conducive to enabling these outcomes.

The trust embedded model suggests that individuals are guided by more than self-interest or pecuniary motives as they engage in transactions. For example, senders of information are guided by factors such as fairness and tenets that are central to their company. As a result, they share more information and resources than strictly necessary.

In contrast to the trust-embedded model, the level-k model — the second model discussed in the paper — suggests that decision makers are limited in their ability to think strategically. Receivers of information cannot anticipate the extent to which the sender might have distorted the message. On the flip-side, senders cannot account for just how much receivers might discount their message. Consequently, senders share more than necessary, because they take a dim view of the receiver’s ability to discount their message.

It’s important to note that even the level-k model can sometimes explain why senders and receivers tend to overshare information in a cheap-talk setting, which contrasts with the outcome standard game theory models would predict. It’s just that their motivations are different – with the level-k model, oversharing is driven by a limited ability to think strategically, rather than by the willingness to be trusting and trustworthy.

Overall, our paper that analyzed existing cheap-talk experiment data, found more support for the trust-embedded model, suggesting that individuals are also driven by non-monetary incentives when conducting transactions.

Q. Why do you think that trust-embedded models do a better job of explaining cheap-talk communications? What are the implications for organizations engaging in relationships with businesses and partners?

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust.
Özalp Özer

The answer to your first question is relatively simple — human beings are far more sophisticated than the level-k model gives them credit for. For example, there are many sellers on Amazon’s website who are proficient in using a variety of tools they have developed to make decisions related to pricing and inventory.

As a result, if we want the tools we provide to earn sellers’ trust, we need to think of the system more holistically at both an architecture and policy level to truly understand what builds trust and what is a trust-buster.

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust. Product reviews, the ability to get refunds for a vacation rental because hosts might not have lived up to their promises, or the price for a ride being set in advance — these are some of the mechanisms that let you buy a product or rent a home from people you don’t know.

Q. How are the findings in your paper applicable to your work at Amazon?

We are leveraging the insights from this stream of research as well as others to augment our understanding of seller trust, particularly in relation to how sellers interact with our inventory management tools, and how fidelity of recommendations impact sellers’ trust.

There is no interaction at Amazon that I can think of that doesn’t have an element of trust.
Özalp Özer

We are designing our related processes to reduce barriers for trusting and trustworthy engagements among the participants of our stores; for example, by making specific investments to support seller growth in areas that benefit sellers and customers the most; by reducing perceived vulnerabilities in carrying excess inventory; by looking into ways in which we stabilize our policies; by creating visibility to the reasons for our recommendations; by looking into ways in which we can build interactive communication channels among participants in our stores; and by building reputation and feedback systems that foster trusting and trustworthy engagements and on and on.

Using large-scale data, scientific methods like causal machine learning to optimization, as well as continual engagement with selling partners and customers, we aim to identify at the extent to which sellers trust evolves — so we can identify and invest in processes that foster trust and as a result growth and economic prosperity.  

There is no interaction at Amazon that I can think of that doesn’t have an element of trust. Jeff Bezos has said, “You can’t ask for trust, you just have to do it the hard way, one step at a time.” In my time at the company, I have been struck by the tireless efforts of so many people to gain seller and customer trust. At Amazon, it is just part of everything we do.

Related content

US, CA, San Francisco
The Amazon Center for Quantum Computing (CQC) is seeking an Applied Scientist to research and design cryogenic control hardware for large-scale quantum processors, with an emphasis on superconducting digital circuits. Controlling and reading out orders of magnitude more qubits than today's systems demands rethinking where classical control lives and what technology implements it; you will design and model superconducting digital logic (e.g., single-flux-quantum-family circuits) and related cryogenic electronics, evaluate them against the wiring, power, and thermal budgets of a scaled system, and co-design control approaches with the qubit devices they serve. You will carry designs from concept through simulation, layout, design review, and fabrication handoff, and your evaluations will inform which control-electronics directions the organization invests in. Key job responsibilities • Design and simulate superconducting digital circuits and cryogenic control/readout electronics for scalable qubit control • Develop and validate Josephson-junction circuit models, timing and margin analyses, and verification methodology for superconducting digital designs • Quantify system-level trade-offs — wiring count, power dissipation at each cryogenic stage, latency, footprint — across candidate control architectures, and communicate recommendations • Co-design control interfaces with qubit-device colleagues so control electronics and quantum devices are developed as one system • Deliver design artifacts through the organization's design-request and design-review processes, including tapeout-ready layouts and verification reports • Present results internally and, where appropriate, publish in peer-reviewed venues About the team The Enabling Technologies team develops technologies and relationships facilitating scaling, including alternative quantum processor architectures, superconducting qubit device packaging, and cryogenic control device electronics. We work alongside a co-located quantum processor design team focused on current-generation devices; the two teams share design and review processes, and moving ideas between them is an explicit part of our charter.
US, WA, Redmond
Amazon Leo is building a constellation of thousands of low Earth orbit satellites. It will bring fast, reliable internet to customers beyond the reach of existing networks. On the Guidance, Navigation and Control (GNC) team, you will design the algorithms, simulations and onboard autonomy that keep every satellite precisely pointed and stable. Your work lets the payload serve customers on the ground, and it keeps the fleet flying safely. This is satellite GNC at constellation scale. The constellation is launching and growing today, so you will see your work go from concept to orbit, and then fly on many satellites. In this role, you will: - Take your GNC algorithms from concept to orbit, and stay with them through integration, test and on-orbit operations. - Write the production C++ flight code for your own algorithms. The code that flies is the code you write. - Solve hard problems in precise pointing, payload cueing and fleet autonomy. - Work across design, simulation, test and flight operations, not a narrow slice of the lifecycle. **Export Control Requirement:** Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. Key job responsibilities - Design and analyze algorithms for state estimation, attitude determination and control, precise pointing and payload cueing against demanding performance requirements. - Implement these algorithms in production C++ flight software. Our GNC engineers own their algorithms all the way into flight, and partner with our embedded software engineers to integrate and test them. - Write concepts of operations for each phase of a satellite's life, from launch and orbit raising to service and deorbit, including failures and recovery. Balance what the payload needs against momentum, power, thermal and ground-contact limits. - Develop momentum management strategies with reaction wheels and magnetic torquers. Help select, size and place the GNC sensors and actuators for future satellites, and design the algorithms that use them. These include star trackers, magnetometers, sun sensors, IMUs and GNSS receivers. - Develop onboard autonomy, including Fault Detection, Isolation and Recovery (FDIR), so that the fleet operates safely at scale with minimal ground intervention. - Build and validate satellite and constellation models and simulations at several levels of fidelity, including 6-DOF simulation and Monte Carlo analysis. Verify closed-loop performance in hardware-in-the-loop (HITL) tests. - Support component environmental tests, functional and performance checkout, and subsystem and satellite integration in our labs. - Analyze telemetry from the whole fleet. Build the metrics, dashboards and tools that track pointing performance and payload operations time as the constellation grows, and use them to improve the fleet. - Operate the GNC system on orbit and take part in the team's on-call rotation. Review fleet data, support maneuvers, and resolve anomalies when on-orbit behavior differs from the ground model. - Review designs and code with the team, and document your algorithms, analyses and results clearly. A day in the life This role covers a wide range of problems across the spacecraft and the network. You will derive and prototype estimation and control algorithms, and then turn them into production flight code. You will prove them in 6-DOF and Monte Carlo simulation and in hardware-in-the-loop tests in the lab. You will support satellite integration. When a satellite does not behave as the ground model predicted, you will dig into fleet telemetry, find the cause and drive the fix. You will own each problem end to end, with the focus to go deep on it. GNC is at the center of safe flight, so you will work across the whole program. The payload, power, thermal and operations teams all depend on GNC, and you will balance their needs against the pointing and momentum budgets. You will partner closely with avionics, flight software and embedded software engineers to make your algorithms run reliably on the spacecraft. You will help the mechanical teams shape the next generation of satellite hardware, from reaction wheels to star trackers. As satellites move from design through manufacturing into orbit, you will work with systems engineering and Assembly, Integration and Test. The problems are hard: tight pointing requirements, a large constellation to keep flying safely, and the chance to invent capabilities that do not exist yet. Constant work with other teams makes this a place where you keep learning and growing. About the team You will join the Satellite Attitude Determination and Control team. We own GNC for our satellites end to end: algorithm design, flight software, lab integration, and flight operations of our own satellites on orbit. Our engineers bring deep experience from many satellite programs and other flight vehicles, with real strength in both our mission and the core GNC disciplines. We design, prototype, test, iterate and learn together. Because GNC is central to safe flight, we drive the concepts of operations and many of the system-level analyses on the program. We also have a lot of freedom. We trust our engineers to choose their own tools and approaches for the problems they face, and to own the results. If you want the autonomy to solve hard problems your way, with a team of strong engineers, you will feel at home here.
US, WA, Redmond
Amazon Leo is building a constellation of thousands of low Earth orbit satellites. It will bring fast, reliable internet to customers beyond the reach of existing networks. On the Guidance, Navigation and Control (GNC) team, you will design the algorithms, simulations and onboard autonomy that keep every satellite precisely pointed and stable. Your work lets the payload serve customers on the ground, and it keeps the fleet flying safely. This is satellite GNC at constellation scale. The constellation is launching and growing today, so you will see your work go from concept to orbit, and then fly on many satellites. In this role, you will: - Take your GNC algorithms from concept to orbit, and stay with them through integration, test and on-orbit operations. - Write the production C++ flight code for your own algorithms. The code that flies is the code you write. - Solve hard problems in precise pointing, payload cueing and fleet autonomy. - Work across design, simulation, test and flight operations, not a narrow slice of the lifecycle. **Export Control Requirement:** Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. Key job responsibilities - Design and analyze algorithms for state estimation, attitude determination and control, precise pointing and payload cueing against demanding performance requirements. - Implement these algorithms in production C++ flight software. Our GNC engineers own their algorithms all the way into flight, and partner with our embedded software engineers to integrate and test them. - Write concepts of operations for each phase of a satellite's life, from launch and orbit raising to service and deorbit, including failures and recovery. Balance what the payload needs against momentum, power, thermal and ground-contact limits. - Develop momentum management strategies with reaction wheels and magnetic torquers. Help select, size and place the GNC sensors and actuators for future satellites, and design the algorithms that use them. These include star trackers, magnetometers, sun sensors, IMUs and GNSS receivers. - Develop onboard autonomy, including Fault Detection, Isolation and Recovery (FDIR), so that the fleet operates safely at scale with minimal ground intervention. - Build and validate satellite and constellation models and simulations at several levels of fidelity, including 6-DOF simulation and Monte Carlo analysis. Verify closed-loop performance in hardware-in-the-loop (HITL) tests. - Support component environmental tests, functional and performance checkout, and subsystem and satellite integration in our labs. - Analyze telemetry from the whole fleet. Build the metrics, dashboards and tools that track pointing performance and payload operations time as the constellation grows, and use them to improve the fleet. - Operate the GNC system on orbit and take part in the team's on-call rotation. Review fleet data, support maneuvers, and resolve anomalies when on-orbit behavior differs from the ground model. - Review designs and code with the team, and document your algorithms, analyses and results clearly. A day in the life This role covers a wide range of problems across the spacecraft and the network. You will derive and prototype estimation and control algorithms, and then turn them into production flight code. You will prove them in 6-DOF and Monte Carlo simulation and in hardware-in-the-loop tests in the lab. You will support satellite integration. When a satellite does not behave as the ground model predicted, you will dig into fleet telemetry, find the cause and drive the fix. You will own each problem end to end, with the focus to go deep on it. GNC is at the center of safe flight, so you will work across the whole program. The payload, power, thermal and operations teams all depend on GNC, and you will balance their needs against the pointing and momentum budgets. You will partner closely with avionics, flight software and embedded software engineers to make your algorithms run reliably on the spacecraft. You will help the mechanical teams shape the next generation of satellite hardware, from reaction wheels to star trackers. As satellites move from design through manufacturing into orbit, you will work with systems engineering and Assembly, Integration and Test. The problems are hard: tight pointing requirements, a large constellation to keep flying safely, and the chance to invent capabilities that do not exist yet. Constant work with other teams makes this a place where you keep learning and growing. About the team You will join the Satellite Attitude Determination and Control team. We own GNC for our satellites end to end: algorithm design, flight software, lab integration, and flight operations of our own satellites on orbit. Our engineers bring deep experience from many satellite programs and other flight vehicles, with real strength in both our mission and the core GNC disciplines. We design, prototype, test, iterate and learn together. Because GNC is central to safe flight, we drive the concepts of operations and many of the system-level analyses on the program. We also have a lot of freedom. We trust our engineers to choose their own tools and approaches for the problems they face, and to own the results. If you want the autonomy to solve hard problems your way, with a team of strong engineers, you will feel at home here.
US, WA, Seattle
Do you want to make AI provably correct for chip design and verification? We're hiring an Applied Scientist to combine large language models with formal methods such as Lean 4 and turn AI from a helpful assistant into a trusted engineering tool for silicon. Our team builds the formal verification methods behind custom silicon at Amazon scale. As AI agents take on more of chip design and verification, we need people who can make sure their output is checkable, sound and grounded in mathematics. You will research and build systems where LLMs work alongside interactive theorem provers, SMT solvers and model checkers. Engineers write the specifications. AI refines them against RTL, generates proof steps and closes proofs at machine speed. Every result is checked by a formal kernel, not trusted on faith. Work at the frontier of AI reasoning, theorem proving and hardware verification Ship solutions that directly affect real chips running in AWS data centers Publish and help shape how the industry formalizes AI use in hardware engineering Key job responsibilities Design and build LLM-driven systems for formal verification and design tasks, including proof generation, invariant and lemma discovery, spec-to-RTL refinement, and counterexample analysis Develop frameworks in Lean 4 (and related tools such as SMT solvers, model checkers and commercial FV engines) that formally check AI-generated artifacts, so they are correct by construction rather than just plausible Formalize hardware semantics, ISAs and microarchitectural properties in Lean 4 to create machine-checkable foundations for AI agents to reason over Track and evaluate state-of-the-art AI work (LLM agents, autoformalization, neural theorem proving, reinforcement learning from proof feedback) and turn promising research into production tools Build benchmarks and evaluation methods that measure AI soundness, proof success rate and engineering impact on real designs Partner with FV and design engineers to find the highest-leverage problems and deploy solutions into active chip programs Publish research, file patents and represent Amazon in the formal methods and AI communities Mentor engineers and scientists on applying formal AI methods
US, NY, New York
About Sponsored Products and Brands: The Sponsored Products and Brands (SPB) organization at Amazon Ads is re-imagining the advertising landscape through industry leading generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. About Our Team: The Brand Beacon team is responsible for inventing impressions offerings for brands to increase share of voice via premium experiences, helping brands get discovered, acquire new customers and sustainably grow customer lifetime value. We build end-to-end solutions that enable brands to drive discovery, visibility and share of voice. This includes building advertiser controls, shopper experiences, monetization strategies and optimization features. We succeed when (1) shoppers discover, engage and build affinity with brands and (2) brands can grow their business at scale with our advertising products. About This Role: As an Applied Scientist on our team, you will: * Develop AI solutions for advertiser and shopper experiences. Build monetization and optimization systems that leverage generative models to value and improve campaign performance. * Define a long-term science vision and roadmap for our Brand Beacon advertising business, driven from our customers' needs, translating that direction into specific plans for applied scientists and engineering teams. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding. * Design and conduct A/B experiments to evaluate proposed solutions based on in-depth data analyses. * Effectively communicate technical and non-technical ideas with teammates and stakeholders; * Stay up-to-date with advancements and the latest modeling techniques in the field. * Think big about the arc of development of Gen AI over a multi-year horizon and identify new opportunities to apply these technologies to solve real-world problems. #GenAI
US, WA, Seattle
MULTIPLE POSITIONS AVAILABLE Employer: AMAZON.COM SERVICES LLC Offered Position: Applied Scientist III Job Location: Seattle, Washington Job Number: AMZ10037670 Position Responsibilities: Participate in the design, development, evaluation, deployment and updating of data-driven models and analytical solutions for machine learning (ML) and/or natural language (NL) applications. Develop and/or apply statistical modeling techniques (e.g. Bayesian models and deep neural networks), optimization methods, and other ML techniques to different applications in business and engineering. Routinely build and deploy ML models on available data, and run and analyze experiments in a production environment. Identify new opportunities for research in order to meet business goals. Research and implement novel ML and statistical approaches to add value to the business. Mentor junior engineers and scientists. Position Requirements: Master’s degree or foreign equivalent degree in Computer Science, Machine Learning, Engineering, or a related field and two years of research or work experience in the job offered, or as a Research Scientist, Research Assistant, Software Engineer, or a related occupation. Employer will accept a Bachelor’s degree or foreign equivalent degree in Computer Science, Machine Learning, Engineering, or a related field and five years of progressive post-baccalaureate research or work experience in the job offered or a related occupation as equivalent to the Master’s degree and two years of research or work experience. Must have one year of research or work experience in the following skill(s): (1) programming in Java, C++, Python, or equivalent programming language; and (2) conducting the analysis and development of various supervised and unsupervised machine learning models for moderately complex projects in business, science, or engineering. Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation. 40 hours / week, 8:00am-5:00pm, Salary Range $167,100/year to $226,100/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, visit: https://www.aboutamazon.com/workplace/employee-benefits. #0000
US, WA, Seattle
Amazon Web Services (AWS) provides a highly reliable, scalable, low-cost infrastructure platform in the cloud that powers hundreds of thousands of businesses in 190 countries around the world. We are hiring an Applied Scientist in our AWS Sales Science & Economics team. The team uses machine learning, econometrics, and data science to optimize AWS’s service catalogue, driving customer engagement and generating insights to guide AWS sales strategy. We use detailed customer behavioral and usage data to predict and understand what customers want from AWS. Key job responsibilities As an Applied Scientist, you will apply the latest research, state of the art machine learning and GenAI to build highly scalable models in support of predictive research and products used across AWS Sales and leadership. You will be responsible for designing and executing science experiments in short and agile cycles. You will use the latest AWS technologies in Machine Learning, Data Science, and AI. You will work closely with business leaders to identify opportunities to drive business growth by applying machine learning and building out predictive models to support analytics and insights. The ideal candidate will be curious and able to learn new technologies quickly. You will have hands-on experience building data science and machine learning pipelines in production working with large scale data sets. You are passionate about sharing your knowledge to enable others. You empathize with the needs of our customers and align your work accordingly, and provide thought leadership and guidance across the organization. A day in the life You will start your day reviewing experimental results and refining model architectures based on new insights. You might spend the morning prototyping a novel approach to a customer-facing problem, then shift to a design review with engineering partners in the afternoon to align on how your solution integrates into production systems. Along the way, you will mentor junior scientists, contribute to peer reviews, and stay connected to the latest research through reading groups and internal science discussions. Your contributions will move from research notebooks to live systems that customers interact with every day. About the team Our team is focused on applying advanced science and machine learning to build intelligent systems that improve the Amazon experience. We value collaboration, intellectual rigor, and a willingness to explore new ideas. You will work alongside scientists and engineers who are committed to turning ambitious research into practical, high-impact solutions. We are investing in the next generation of machine learning capabilities and are looking for team members who are excited to help define that future.
US, CA, San Francisco
The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, and machine learning to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science and engineering to develop and deliver solutions that measurably achieve this goal. We are looking for an Applied Scientist to build production machine learning solutions that improve employee experiences and inform workforce decisions. You will work on problems spanning predictive modeling, natural language processing, recommendation systems, personalization, generative AI, and causal evaluation. These solutions will predict workforce outcomes, identify individual and organizational needs, recommend targeted actions, and measure the causal impact of programs, products, and policies across diverse employee populations and business contexts. As an Applied Scientist, you will develop models and algorithms from prototype through production. You will collaborate with other scientists and economists to combine machine learning with causal inference and experimentation, allowing teams to understand both what is likely to happen and which actions will improve outcomes. You will also work with product managers, engineers, and business partners to translate business needs into technical solutions and communicate methods and results to technical and nontechnical audiences. Key job responsibilities • Design, develop, and deploy machine learning solutions in production environments. • Develop solutions using techniques that include predictive modeling, deep learning, natural language processing, recommendation systems, personalization, and generative AI. • Build models that predict workforce outcomes, identify employee and organizational needs, and recommend targeted actions. • Partner with economists and other scientists to design causal evaluations and experimental frameworks that measure the impact of programs, products, and policies. • Combine predictive models with causal estimates to help business partners identify effective actions and make evidence-based decisions. • Collaborate with product managers, engineers, and business partners to translate business requirements into modeling approaches and contribute to technical design and roadmap decisions. • Evaluate model accuracy, performance, calibration, and limitations, and identify opportunities for improvement. • Communicate technical concepts, methods, results, and recommendations to technical peers and business partners. A day in the life • Analyze data to investigate model performance or understand an unexpected result from a causal evaluation. • Brainstorm modeling and evaluation approaches with applied scientists and economists on the team. • Develop and test model features, recommendation methods, or generative AI applications. • Design or analyze experiments and observational studies to estimate the causal impact of programs, products, or policies. • Run simulations, offline evaluations, or backtests to assess model performance. • Meet with product, engineering, and business partners to review requirements, data, designs, and implementation decisions. • Review code changes or technical design documents from scientists and engineers. • Write and present documents covering methods, results, limitations, and recommendations. About the team The People eXperience and Technology Central Science Team (PXTCS) uses economics, behavioral science, statistics, and machine learning to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, wellbeing, and the value of work to Amazonians. We are an interdisciplinary team that combines the talents of science and engineering to develop and deliver solutions that measurably achieve this goal.
US, WA, Seattle
Are you excited to play a strategic role in defining the customer experience on Tablets? Come join a dynamic, customer-obsessed, world-class science team to completely reshape the customer experience on our tablets. Key job responsibilities Using Amazon’s large-scale computing resources, you will design and deploy state-of-the-art recommendation models. You will ask research questions about customer behavior, design state-of-the-art models that help customers discover content, and deploy these models to production alongside other engineers. You will participate in the Amazon ML community and mentor other engineers with a strong interest in and knowledge of ML and generative AI. Your work will directly benefit customers! A day in the life We are looking for a passionate, hard-working, and talented Applied Scientist who has experience developing state-of-the-art models and deploying them to production. You will have an opportunity to make an enormous impact on the design, architecture, and implementation of products used everyday by real customers! About the team The Alexa Tablet team is a world-class team that delivers high-quality, innovative products that are loved by our customers. Our team focuses on spinning many of Amazon’s flywheels with bar-raising mobile experiences on our tablets. Over the last 12 years, we have built 4.0+ star rated products, and we continue to look for ways to scale our business. Join us as we continue our ambitious journey which will give you the opportunity to deliver disruptive products with global impact.
IN, KA, Bengaluru
Amazon.com’s Product Detail Page team is looking for talented, motivated and passionate applied scientist to be part of the design and development of a highly scalable multi-tiered shopping application to provide the best possible online shopping experience for Amazon customers world-wide. Our team is comprised of talented applied scientists, developers, testers, program managers, designers and product managers tasked with the singular goal to create THE world's best buying experience. Scientists on this team develop the next-generation technologies and experiences that change how millions interact and shop online. To provide the best possible online shopping at the scale of the web requires ideas from every area of computer science, including distributed computing, large-scale system design, machine learning, natural language processing, data compression and user interface design; the list goes on and is growing every day. We need our scientists to be versatile and always eager to tackle new problems as we continue to push technology forward. Our team leverages sophisticated econometric, machine learning, and big data technologies to help customers to discover the right products at the right prices from millions of trusted sellers billions of times a day. If you are looking for a career-defining opportunity on one of the most customer centric and business impacting teams within Amazon, we’d love to hear from you. We are looking for an Applied Scientist to help build the next generation of Detail Page optimization algorithms. These new set of algorithms will incorporate the continually changing preferences of our customers and continue to scale with numerous new programs that Amazon is introducing for our customers. You will work with multiple Amazon businesses and programs to identify big business opportunities and propose new business features and technical systems to improve customer experience on Amazon Detail Page, Search Page and many other widgets throughout the website. You will be responsible for the quality of algorithm design and will get the opportunity to present your ideas and share results of your deliverables with Amazon executives on a frequent basis. You will get an opportunity to work with senior scientists to define and enforce broad, company-wide technical standards in optimization techniques, statistical modeling and simulation techniques, and/or data analytics.