Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication.png
“Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?” was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.
Glynis Condon

3 questions with Özalp Özer: How to build trust in business relationships

Özer’s paper published in INFORMS’ Management Science 2021 explores the dynamics behind “cheap-talk” communications.

Trust and trustworthiness are important in both our personal and business relationships. How then can we build environments that foster increased trust, trustworthiness and cooperation?

In the first edition of a new series that focuses on research papers published by scientists within the Amazon Supply Chain Optimization Technologies (SCOT) organization, we interview Özalp Özer, coauthor of “Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?”. The paper was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.

Özalp Özer profile image
Özalp Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas.

Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas (UTD). He earned a PhD in operations research from Columbia University, before going on to serve on the faculty at Stanford and Columbia. Özer has published extensively on a diverse range of topics, from supply chain management, capacity and inventory management to pricing and revenue management.

Özer says that a guiding principle behind his research is to focus on solving problems that have a real-world impact at scale. At Stanford and then UTD, Özer found himself drawn to the field of behavioral and experimental economics — particularly the field of game theory and understanding how to model actions and emotions in scenarios involving multiple decision makers in dynamic environments.

Driven by his interest in tackling real-world business problems, Özer remained engaged with industry during his tenure as an academic. While working on a project focused on designing effective procurement contracts, he observed the important role that trust played in establishing and fostering business relationships.

In many cases, the interests of the parties engaging in a negotiation are not aligned. To give one example, suppliers can use product forecast information from a buyer to make capacity, inventory and other manufacturing-related decisions. However, buyers might often provide suppliers with overly optimistic forecasts to ensure an abundant supply. If the demand for the product turns out to be lower than anticipated, the supplier bears the excess investment risk.

Özer says that this scenario represents an example of “cheap talk communications.” He outlines three characteristics that are common to all cheap talk communications: they are costless (they are devoid of monetary penalties), they are non-binding (a buyer can provide a forecast without committing to it), and they are non-verifiable (no forecast can be completely accurate in the light of market uncertainty). To complicate matters, the objective functions that each party is trying to maximize are at odds (or not perfectly aligned) with each other.

Standard game theory suggests that each party in a business transaction will move toward an equilibrium that maximizes their own payoff. In a cheap-talk setting, where the information is costless, non-binding and non-verifiable, the theory suggests that each party will disregard the information supplied by the other.

However, Özer finds that people involved in business (as well as personal) transactions frequently factor into their decision-making information supplied by the other party, even when their incentives are not perfectly aligned and even when the information or recommendation may be perceived as “cheap”. They do this by taking the business context and the related relationship into account. Doing so results in higher returns for both parties involved. For example, third-party sellers are more likely to act on price reduction or replenishment recommendations from Amazon, if they find that these recommendations have previously resulted in an uptick in sales and profits.

Ozer says that “cheap talk” communications have the unfortunate emphasis on being “cheap” and less emphasis on how they are informative and can align incentives. In a series of publications, Ozer shows why, when, and how such communications and recommendations turn out to be informative, and how they help align business objectives, resulting in both parties making better decisions.   

In this interview, Özer talks about findings from the recently published INFORMS paper and discusses the implications of these findings for companies like Amazon.

Q. What are the two models that can be used to explain how cheap talk communications work between decision makers?

As our paper suggests, there are two contrasting economic theories that can be used to analyze cheap-talk communications.

The trust-embedded model — which takes a more optimistic view of humanity — suggests that decision makers are motivated by non-monetary motives to be trusting and trustworthy, besides the monetary incentives such as maximizing cash flow.   

Here, we define trust as instances of decision makers behaving voluntarily in a way that put themselves in vulnerable engagement due to the uncertain behavior of the other party (the trustee), based upon the expectation of a positive outcome from that engagement. Trustworthiness flips the perspective to that of the trustee. We define trustworthiness as an instance of a decision maker behaving voluntarily in a way not to take advantage of the trustor’s vulnerable position – even when faced with a self-serving decision that conflicts with the trustor’s objectives.

Humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk.
Özalp Özer

The trust-embedded model suggests that when engaging with others, decision makers are averse to manipulating information in economic interactions. They incur disutility from lying. As a result, they assess the trustworthiness of the counterparty, and they form a trust factor towards them. This trust factor governs how decision makers interpret and use the information they receive from others.

In other words, humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk. Because they assess — even sometimes incorrectly — that doing so yields positive outcomes, they engage in and cultivate behaviors conducive to enabling these outcomes.

The trust embedded model suggests that individuals are guided by more than self-interest or pecuniary motives as they engage in transactions. For example, senders of information are guided by factors such as fairness and tenets that are central to their company. As a result, they share more information and resources than strictly necessary.

In contrast to the trust-embedded model, the level-k model — the second model discussed in the paper — suggests that decision makers are limited in their ability to think strategically. Receivers of information cannot anticipate the extent to which the sender might have distorted the message. On the flip-side, senders cannot account for just how much receivers might discount their message. Consequently, senders share more than necessary, because they take a dim view of the receiver’s ability to discount their message.

It’s important to note that even the level-k model can sometimes explain why senders and receivers tend to overshare information in a cheap-talk setting, which contrasts with the outcome standard game theory models would predict. It’s just that their motivations are different – with the level-k model, oversharing is driven by a limited ability to think strategically, rather than by the willingness to be trusting and trustworthy.

Overall, our paper that analyzed existing cheap-talk experiment data, found more support for the trust-embedded model, suggesting that individuals are also driven by non-monetary incentives when conducting transactions.

Q. Why do you think that trust-embedded models do a better job of explaining cheap-talk communications? What are the implications for organizations engaging in relationships with businesses and partners?

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust.
Özalp Özer

The answer to your first question is relatively simple — human beings are far more sophisticated than the level-k model gives them credit for. For example, there are many sellers on Amazon’s website who are proficient in using a variety of tools they have developed to make decisions related to pricing and inventory.

As a result, if we want the tools we provide to earn sellers’ trust, we need to think of the system more holistically at both an architecture and policy level to truly understand what builds trust and what is a trust-buster.

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust. Product reviews, the ability to get refunds for a vacation rental because hosts might not have lived up to their promises, or the price for a ride being set in advance — these are some of the mechanisms that let you buy a product or rent a home from people you don’t know.

Q. How are the findings in your paper applicable to your work at Amazon?

We are leveraging the insights from this stream of research as well as others to augment our understanding of seller trust, particularly in relation to how sellers interact with our inventory management tools, and how fidelity of recommendations impact sellers’ trust.

There is no interaction at Amazon that I can think of that doesn’t have an element of trust.
Özalp Özer

We are designing our related processes to reduce barriers for trusting and trustworthy engagements among the participants of our stores; for example, by making specific investments to support seller growth in areas that benefit sellers and customers the most; by reducing perceived vulnerabilities in carrying excess inventory; by looking into ways in which we stabilize our policies; by creating visibility to the reasons for our recommendations; by looking into ways in which we can build interactive communication channels among participants in our stores; and by building reputation and feedback systems that foster trusting and trustworthy engagements and on and on.

Using large-scale data, scientific methods like causal machine learning to optimization, as well as continual engagement with selling partners and customers, we aim to identify at the extent to which sellers trust evolves — so we can identify and invest in processes that foster trust and as a result growth and economic prosperity.  

There is no interaction at Amazon that I can think of that doesn’t have an element of trust. Jeff Bezos has said, “You can’t ask for trust, you just have to do it the hard way, one step at a time.” In my time at the company, I have been struck by the tireless efforts of so many people to gain seller and customer trust. At Amazon, it is just part of everything we do.

Related content

US, WA, Redmond
Amazon Leo is building a low Earth orbit satellite broadband network to deliver fast, affordable connectivity to customers around the world, including those underserved by traditional infrastructure. Operating a live constellation and its ground network at scale means service disruptions are an inevitable reality, and how quickly we detect them, understand them, and prevent them from recurring defines the trust we earn as a connectivity provider. We are seeking a talented Senior Applied Scientist to build the next generation of observability and availability science for the Leo network. Leo already detects outages, notifies affected customers, and restores service. The frontier is prediction and prevention: reasoning over complex network and ground-segment telemetry to autonomously detect anomalies before they reach customers, attribute root cause automatically across a sprawling event surface, and rationalize a large, still-maturing metric set so responders trust what the system tells them. In this role you will work backwards from the needs of customers and operations teams. You will own the scientific direction end to end, partnering closely with network engineers, the Network Operations Center, and the Incident Management team, and the Software and Networking orginization to translate a long-term science vision into concrete research and delivery roadmaps. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. Key job responsibilities * Own the observability and availability science end to end, from long-term vision to research roadmap to production delivery, working backwards from the needs of customers, the NOC, and network engineering. * Develop time-series and graph-based models with dynamic baselining that detect network and ground-segment anomalies before they cross the High Severity threshold, enabling proactive investigation rather than reactive response. * Reason over complex, multi-system telemetry to attribute cause automatically during live HSEs and LSEs, so Call Leaders and engineers spend time mitigating, not hunting. * Provide the science behind the network's bucketed availability decomposition (geometric and satellite coverage, ground and network segments, customer terminals, payload, and planning), attributing every movement to a true cause rather than noise, so leadership steers on signal and engineering effort lands where it actually moves availability and throughput. * Deliver the models, analyses, and metrics that feed the daily system readiness and validation review consumed by senior leadership and product and engineering, turning availability and throughput data into a defensible, evidence-based read on progress against GA entry criteria. * Own the recurring, fleet-wide "hot topic" investigations that span ASIC, firmware, payload, network, and planning, separating correlated symptoms from true root cause across thousands of nodes, quantifying how much availability or throughput each is costing, and answering whether it is a launch-blocking risk and whether it is improving. * Deliver alert correlation and deduplication, false-positive reduction, and metric-quality scoring so responders trust what the system tells them, directly supporting a large, still-maturing KPI set. * Tie your science to the unit the org actually measures: reduce detection and attribution time, raise availability against the network's bar, and increase the share of events prevented before customer impact. * Partner day to day with the Network Operations Center, Network Engineering, and the Incident Management (Call Leader) program; sit on live HSE/LSE bridges as the science partner and turn event learnings into model improvements. * Feed COEs and RCAs back into detection and attribution so recurring signatures are caught earlier, and help design and score gamedays that stress-test both the network and your models against real, closed events. * Build and deploy production pipelines on AWS (e.g., SageMaker, Bedrock, Glue) with model validation, monitoring, drift detection, and explainability, because operations teams must be able to trust and act on model output under pressure. * Set data-science standards, mentor scientists, and drive best practices across the Leo networking organization as the science function scales. * Produce explainable output and written narratives that let responders and leaders three or more levels up act on your models during and between events.
US, CA, Sunnyvale
Amazon is seeking exceptional talent to help develop the next generation of advanced robotics systems that will transform automation at Amazon's scale. We're building robotic systems that combine frontier AI, sophisticated control, and advanced mechanical design to create adaptable automation capable of working safely alongside humans in dynamic environments. This is an opportunity to shape the future of robotics and automation at an unprecedented scale, working with world-class teams pushing the boundaries of what's possible in robotic manipulation, locomotion, and human-robot interaction. We are seeking an Applied Scientist to develop tactile- and force-driven manipulation policies for highly dexterous, multi-fingered robotic hands and grippers. In this role you will research and build policy learning algorithms that enable robotic hands to perform grasping and in-hand manipulation in unstructured, real-world environments, using touch and force feedback as first-class signals rather than afterthoughts. Much of this work is grounded in reinforcement learning. To be successful you need to be highly motivated, dive deep, and deliver to the highest standards. You will demonstrate strong working knowledge of modern policy learning methods, with expertise in taking algorithms from simulation onto real hardware. That means being comfortable working against real physical constraints and treating sim-to-real as a core research problem rather than optimizing for benchmark numbers alone. You will work across tactile signal processing, contact-rich manipulation, sim-to-real transfer, and multi-modal sensor fusion to build robust solutions for autonomous grasping, dexterous re-orientation, and fine motor control. You will bring the desire to learn from new challenges, and the problem-solving and communication skills to work within a highly interactive and experienced team. Key job responsibilities - Design and train manipulation policies that leverage tactile and force feedback for dexterous grasping, in-hand manipulation, and contact-rich tasks, using reinforcement learning, imitation learning, or hybrid approaches. - Drive sim-to-real transfer, closing the gap between simulated and physical performance on real robotic hands. - Shape objectives and control strategies with the hardware in mind, accounting for how motors and actuators actually behave: transmission ratios, torque versus power, backdrivability, and thermal limits. - Build simulation-based and on-robot evaluation frameworks, with benchmarks and metrics that make tactile perception and policy performance systematically comparable across iterations. - Own scientific and technical projects within the tactile sensing and manipulation workstreams, driving from research concept through deployment on physical robotic systems — and, at the senior level, set direction across a workstream. - Collaborate with hardware, mechanical design, firmware, and controls teams — and with partner applied science organizations — to translate research advances into deployable robotic capabilities, and to inform sensor and actuator design decisions with policy-level requirements. - Publish at top-tier venues and build collaborations with the external research community. - Contribute to a strong scientific bar on the team through code and design review, and mentor engineers and interns working on real-world manipulation and sensing problems. A day in the life Your morning might start with a standup alongside hardware and controls engineers reviewing overnight sim-to-real training runs on a multi-finger gripper, debugging why a grasp policy that worked in simulation is slipping on a real sensor array. Mid-morning you join the weekly tactile sensing workstream to align on sensor integration milestones and share early results from a contact-state estimator you have been prototyping. After lunch you spend a focused block iterating on a reinforcement learning reward formulation, testing variations in simulation before queuing runs on the cluster. Later you pair with a mechanical engineer to review sensor placement trade-offs on an upcoming gripper revision, then wrap the day by drafting a short experiment write-up and sketching next steps for a conference submission. No two days look exactly the same: one week you may be collecting teleoperated demonstrations on the physical robot to seed an imitation learning pipeline; the next you could be deep in a codebase refactor to support a new tactile modality. Throughout, you balance hands-on research — writing algorithms, running experiments, analyzing data — with cross-team collaboration and mentoring. The common thread is moving from research insight to working capability on real hardware, with a tight feedback loop between simulation and the physical world. About the team Our is developing next-generation manipulation capabilities for highly dexterous multi-fingered grippers and hands. Our work spans tactile sensor development, manipulation policy learning, and the tight integration of sensing hardware with intelligent control software. We are building systems that can feel, adapt, and manipulate with human-level dexterity. You will join a team working at the frontier of tactile sensing and contact-rich manipulation, helping define how robots perceive and interact with objects through touch. Because we build the hands as well as the policies that drive them, you will have a direct line to the sensor, actuator, and mechanism designs your algorithms depend on — and real influence over how they evolve. This is an opportunity to solve hard problems across perception, learning, and physical interaction alongside a team of scientists and engineers building toward real-world deployment.
US, TX, Austin
The OTS ANCHOR (Analytics, Insights, and Centralized Hub for OTS Reporting) team is part of the WW IT Operations & RME organization, responsible for delivering data solutions that drive operational excellence across Amazon's global IT infrastructure. We build data pipelines, predictive models, develop analytical intelligence frameworks, and create AI-powered solutions that transform how Amazon manages, triages, and resolves IT operational incidents at scale pointing towards the Letting Data Tell the Story north start vision. We are seeking a Data Scientist to help own the end-to-end data science charter for critical operational workstreams — from forecasting IT service demand and capacity planning to designing intelligent severity triaging models and building the analytical backbone for agentic AI solutions. You will work backwards from complex operational problems to create models and solutions that directly impact the efficiency and reliability of Amazon's IT operations worldwide. Key job responsibilities - Design, develop, and deploy machine learning models for IT operations forecasting, including incident volume prediction, capacity planning, and workforce demand modeling - Build and maintain severity classification and intelligent triaging models that process thousands of daily IT service tickets across global regions - Develop anomaly detection systems to identify emerging patterns in operational data, supporting proactive incident prevention - Apply econometric and statistical methods to measure the impact of operational interventions and inform resource allocation decisions - Partner with engineering teams to productionize ML models via automated pipelines using AWS services (SageMaker, Step Functions, Lambda, Redshift) - Design and conduct experiments to empirically validate model performance and operational impact - Contribute to data quality monitoring frameworks and help maintain standards for operational data integrity - Collaborate with cross-functional teams (ServiceNow platform, Decision Intelligence, Field Operations) to translate analytical insights into actionable recommendations - Communicate findings, model performance, and recommendations to stakeholders and senior leaders through written documents and presentations - Contribute to the team's science roadmap, identifying opportunities to apply ML/AI (including Generative AI) to operational challenges A day in the life Amazon Benefits: Amazon offers a full range of benefits that support you and eligible family members, including domestic partners and their children. Benefits can vary by location, the number of regularly scheduled hours you work, length of employment, and job status such as seasonal or temporary employment. The benefits that generally apply to regular, full-time employees include: 1. Medical, Dental, and Vision Coverage 2. Maternity and Parental Leave Options 3. Paid Time Off (PTO) 4. 401(k) Plan
CN, 31, Shanghai
As WWGS is committed to building an AI-native, agentic organization, the heart of SSG's evolution is to reinvent how we engage sellers with an AI-first mindset. Delivering that ambition at scale demands breakthrough innovation in our foundational capabilities, at ever-faster speed. To meet these priorities with the pace and focus they require, we are standing up a dedicated team, organized as a POD model - a lean, cross-functional team led by a single owner who holds end-to-end decisions and the business outcome, so we can move at the speed the business demands. Our priority is to build the capability to reach the right sellers at scale, anchored on two pillars: Seller Tagging and Good Contact. Through Seller Tagging, we will turn today's fragmented, siloed seller signals into a unified seller intelligence capability that deepens and broadens how well we truly understand every seller. Through Good Contact, we will resolve the seller identity gaps across our channels and systems, so that every engagement and every system that depends on it, can consistently reach the right seller contact. The Data Scientist will be part of the POD team and support the team to establish structured data governance and model training framework, and trail predict models with real business use cases. Key job responsibilities Design and deliver seller segmentation and propensity models at scale — incorporating GMS, category, growth trajectory, engagement signals, and lifecycle stage. Build contact quality scoring and lifecycle management systems (coverage optimization, dormancy detection, reactivation modeling). Define success metrics, experimentation frameworks (A/B, causal inference), and measurement methodology for seller engagement interventions. Productionize ML models and data products — partner with engineering to deploy seller scores, contact quality indices, and recommendation signals. Explore LLM/GenAI applications: automated insight generation from seller data, contact intent classification, and intelligent report synthesis. Serve as the science representative in bi-weekly NBS theme reviews; present findings and proposals to theme Bar Raisers and leadership. Collaborate with BIE team members to democratize analytical outputs via dashboards and self-serve tools. Contribute to cross-marketplace seller behavior analysis supporting Global Expansion strategy (IN, KR, VN, LATAM). Evaluate, integrate, and iterate on AI systems — assess new AI/ML tools, frameworks, and third-party models for applicability to seller intelligence use cases.
US, WA, Seattle
Do you want to create the greatest-possible worldwide impact in Robotics? Amazon has the world's most exciting treasure trove of robotics challenges. At Amazon Robotics we build high-performance, real-time robotic systems that can perceive, learn, and act intelligently alongside humans—at Amazon scale. Amazon Robotics invents and scales AI systems for robotics in fulfillment. Our mission is to enable robots to interact safely, efficiently, and fluently high density real-world fulfillment centers. Our AI solutions enable robots to learn from their own experiences, from each other, and from humans to build intelligence that feeds itself. We hire and develop subject matter experts in AI with a focus on 3D perception, computer vision, deep learning, and generative modeling. We target high-impact algorithmic unlocks in areas such as 3D scene understanding and completion, semantic occupancy prediction, multi-view 3D reconstruction, depth estimation, shape completion, and real-time inference - all of which have high-value impact for our current and future fulfillment networks. We are seeking an passionate, hands-on, seasoned Senior Applied Scientist who will be deep in code and algorithms; who is technically strong in building scalable 3D perception systems across semantic scene completion, encoder-decoder and transformer architectures (e.g., VoxFormer, MonoScene), voxelized occupancy prediction, panoptic and instance segmentation, depth estimation, point cloud processing, and multi-view fusion. As a Senior Applied Scientist, you will contribute to the research and development of advanced 3D perception pipelines that enable robots to reason about occluded and partially observed environments; your work along with other top-notch scientists and engineers will deliver the world's most scalable and robust robotic perception systems. You will drive ideas to products using paradigms such as 3D generative models, query-based transformers, masked autoencoder-style completion, and scalable pseudo-ground-truth data generation. As a Senior Applied Scientist, you will also help lead and mentor our team of applied scientists and engineers. You will take on challenging perception problems - such as completing 3D bin scenes from partial observations, integrating multi-camera inputs, and optimizing inference latency for edge deployment - distill requirements, and then deliver solutions that either leverage existing academic and industrial research or utilize your own out-of-the-box but pragmatic thinking. In addition to coming up with novel solutions and prototypes, you will directly contribute to implementation while you lead. A successful candidate has excellent technical depth in 3D computer vision, scientific vision, project management skills, great communication skills, and a drive to achieve results in a collaborative team environment. You should enjoy the process of solving real-world problems that, quite frankly, haven't been solved at scale anywhere before. Along the way, we guarantee you'll get opportunities to be a disruptor, prolific innovator, and a reputed problem solver—someone who truly enables AI and robotics to significantly impact the lives of millions of consumers. Key job responsibilities Architect, design, and implement 3D perception models - including encoder-decoder networks, query-based transformers, and generative architectures- for semantic occupancy prediction and scene completion on robotic platforms. Own the end-to-end model lifecycle: develop scalable training pipelines, optimize inference latency for ARM-based edge processors, and deploy production models that meet real-time performance targets. Design and scale pseudo-ground-truth data generation pipelines - both heuristic-based and learning-based (e.g., SAM3D, shape completion) to produce curated training samples using SageMaker infrastructure. Drive multi-view perception integration by fusing multiple view camera inputs for robust 3D reconstruction in partially observed and occluded bin environments. Influence the team's technical strategy and contribute to the long-term vision and roadmap for 3D perception in fulfillment robotics. Partner with cross-functional stakeholders across engineering, science, and operations teams to define requirements, iterate on system design, and deliver end-to-end solutions from research prototype to production deployment. Maintain high standards by participating in design and code reviews, designing for fault tolerance and operational excellence, and creating mechanisms for continuous improvement. Prototype and validate concepts through simulation, synthetic data evaluation, and live robotic workcell testing using 3D metrics (mIoU, IoU) and affordance-based evaluation frameworks. Mentor applied scientists and engineers, raise the technical bar, and foster a culture of scientific rigor and rapid experimentation. A day in the life Amazon offers a full range of benefits that support you and eligible family members, including domestic partners. Benefits can vary by location, the number of regularly scheduled hours you work, length of employment, and job status such as seasonal or temporary employment. The benefits that generally apply to regular, full-time employees include: 1. Medical, Dental, and Vision Coverage 2. Maternity and Parental Leave Options 3. Paid Time Off (PTO) 4. 401(k) Plan If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply!
US, CA, Palo Alto
Are you passionate about using AI to protect and elevate the shopping experience for hundreds of millions of customers? We're looking for a Sr. Applied Science Manager to lead the Sponsored Products and Brands, Search Relevance team, ensuring that every product recommendation shoppers see on our search results page is relevant, trustworthy, and genuinely useful. In this role, you'll be at the forefront of defining what a great search experience looks like by inventing entirely new ways to help customers understand why a product matches their needs. Safeguard the Customer Experience - Lead the development of predictive models that identify and mitigate irrelevant, misleading, or low-quality product recommendations across search placements - Design and scale AI-powered systems whose outputs are used to continually improve the search results - Expand the definition of search quality beyond query-ASIN relevance to encompass shopper preferences, page-level context, and overall experience coherence Define and Measure Search Quality at Scale - Own the development and ongoing measurement of customer experience metrics as reported to senior leadership - Partner with leaders across Search, Retail, and Advertising organizations to align on metric definitions and establish independent measurement standards where needed - Build scalable measurement frameworks that anticipate evolving search presentation formats and proactively adapt to them Invest in State-of-the-Art AI Infrastructure - Drive investment in AI infrastructure and systems that reduce the cost of measuring and monitoring CX metrics across all placements and marketplaces - Build increasingly precise AI models that minimize human effort for auditing, training data generation, and placement-specific customization - Make strategic build-vs-reuse decisions by staying closely connected to peer teams across the organization Invent New Product Experiences - Create novel product presentation experiences that help shoppers understand the differential value of each result — through intelligent selection of images and titles, contextual explanations, and visual indicators such as badges and tags - Partner with peer teams to share learnings and advocate for the adoption of successful innovations beyond your immediate scope Lead and Influence Across the Organization - Manage and grow a team of applied scientists, engineers, and product managers - Partner with senior leaders (Director-level and above) across multiple organizations to drive alignment on shared goals and cross-functional initiatives - Represent search quality and customer experience in executive-level reviews and reporting cadences
DE, BE, Berlin
At Audible, we believe stories have the power to transform lives. It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global listeners. We are dreamers and inventors who come from a wide range of backgrounds and experiences to empower and inspire each other. Imagine your future with us. ABOUT THIS ROLE As a Senior Applied Scientist, you will solve large complex real-world problems at scale, draw inspiration from the latest science and technology to empower undefined/untapped business use cases, delve into customer requirements, collaborate with tech and product teams on design, and create production-ready models that span various domains, including Machine Learning (ML), Artificial Intelligence (AI) and Generative AI, Natural Language Processing (NLP), Reinforcement Learning (RL), real-time and distributed systems. ABOUT YOU Your work will focus on inventing and extending scientific approaches, models, and algorithms driven by customer needs at the product level, framing new research problems even when the problem is ill-defined and no textbook solution exists. You will lead the design, implementation, and delivery of scientifically complex, end-to-end solutions that are deployed into production, defining system-level requirements and writing a significant portion of the critical-path code. You will develop reusable science components and services that resolve architecture deficiencies and customers’ pain points, while making technical trade-offs for long-term/short-term. You will work independently with limited guidance, and your decision-making will consistently incorporate robust, data-driven business and technical judgment. You will drive your team’s scientific agenda, author internal or external peer-reviewed publications that validate the novelty of your work, mentor and develop other scientists, and build consensus across multiple teams. You will have the opportunity to innovate, invent, and think big, and influence the experiences of millions of customers. We are looking for a results-oriented Senior Applied Scientist with deep expertise in ML, NLP, Deep Learning, GenAI, and/or large-scale distributed computation. As an Applied Scientist, you will... - Understand complex, ambiguous use cases across the business and adopt/extend/design/invent solutions/models that are scalable, efficient, and automated, where neither the problem nor the solution is well defined - Work closely with fellow scientists and software engineers (at Audible and Amazon) to build and productionize models, and deliver novel and highly impactful features - Review models of peers for the purpose of reducing and managing risk to the business, while improving customer experience - Lead the design, development, and production deployment of scientifically complex, end-to-end solutions for Content Understanding, Recommendations, and GenAI-based product features, defining system-level requirements - Drive and lead initiatives that employ the most recent advances in ML/AI/GenAI, drive your team’s scientific agenda, and author peer-reviewed publications - Mentor and grow scientists on the team and across Amazon, and push the boundary of innovation ABOUT AUDIBLE Audible is the leading producer and provider of audio storytelling. We spark listeners’ imaginations, offering immersive, cinematic experiences full of inspiration and insight to enrich our customers daily lives. We are a global company with an entrepreneurial spirit. We are dreamers and inventors who are passionate about the positive impact Audible can make for our customers and our neighbors. This spirit courses throughout Audible, supporting a culture of creativity and inclusion built on our People Principles and our mission to build more equitable communities in the cities we call home.
IT, Turin
We're building systems that turn research into real world impact. We're advancing the intelligence behind how customers converse, connect and interact with Alexa across the globe and we're tackling complex conversational AI challenges with state of the art GenAI systems. We're looking for PhD students across multiple research domains to invent, design, and implement state of the art solutions for never before solved problems. Your work here won't just stay in a notebook, it ships to production and reaches customers worldwide. Check out the details below including the job responsibilities, team details, and basic qualifications before submitting your application. You can find more information about the Amazon Science community as well as interview preparation tips via the links below; - https://www.amazon.science/ - https://amazon.jobs/content/en/career-programs/university/science - https://amazon.jobs/content/en/how-we-hire/university-roles/applied-science Key job responsibilities As an Applied Science Intern, you will own the design and development of end-to-end systems. You'll have the opportunity to write technical white papers, create roadmaps and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists and other science interns to develop solutions and deploy them into production. You will have the opportunity to design new algorithms, models, or other technical solutions whilst experiencing Amazon's customer focused culture. The ideal intern should have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. A day in the life You'll spend your first weeks scoping your project with your mentor, then own the research and implementation end-to-end. Projects may include developing and implementing real-time AI services, conducting comprehensive analysis of GenAI algorithms and methodologies or contributing to the creation of reliable, efficient code for production systems that serve millions of users — depending on the team you're matched with. Many interns publish at top-tier conferences or see their work deployed to production before the internship ends. Interns may also be considered for a return offer at the end of their internship, subject to performance evaluation and headcount availability. Further benefits of an Amazon Science internship include; - All of our internships offer a competitive salary - Interns are paired with an experienced manager and mentor(s) - Interns get invited to different intern program or office events - Interns can build their professional and personal network with other Amazon Scientists - Interns can potentially publish work at top tier conferences About the team You'll submit a single application and we'll match you with science teams best aligned with your research interests. Applications are reviewed on a rolling basis, and your application stays active until we find a team match or confirm there are no matches available. Start dates are available throughout the year for durations of between 3–6 months. Please note, each team has different start date and duration preferences — your recruiter will confirm the preferences of the team you're matched with prior to interviewing. We offer science internships in multiple locations across the EMEA region and you can indicate your interest in all these locations by applying here (Austria, Estonia, France, Germany, Ireland, Israel, Italy, Jordan, Luxembourg, Netherlands, Poland, Romania, South Africa, Spain, Sweden, UAE, and UK). Please note we do not offer remote internships.
US, NY, New York
Do you want to lead the Ads industry and redefine how we measure the effectiveness of Amazon Ads business? Are you passionate about causal inference, Deep Learning & AI, raising the science bar, and connecting leading-edge science research to Amazon-scale implementation? If so, come join Amazon Ads to be a science leader within our Advertising Incrementality Measurement science team! Our work builds the foundations for providing customer-facing advertising measurement tools, furthering internal research & development, and building out Amazon's advertising measurement offerings. Incrementality is a lynchpin for the next generation of Amazon Advertising measurement solutions, and this role will play a key role in the release and expansion of these offerings. We are looking for a thought leader that has an aptitude for delivering customer-focused solutions and who enjoys working on the intersection of Big-Data analytics, Machine/Deep Learning, and Causal Inference. A successful candidate will be a self-starter, comfortable with ambiguity, able to think big and be creative, while still paying careful attention to detail. You should be able to translate how data represents the customer journey, be comfortable dealing with large and complex data sets, and have experience using machine learning and/or econometric modeling to solve business problems. You should have strong analytical and communication skills, be able to work with product managers to define key business questions and work with the engineering team to bring our solutions into production. You will join a highly collaborative and diverse working environment that will empower you to shape the future of Amazon advertising, and also allow you to become part of our large science community. Key job responsibilities • Apply expertise in ML/DL, AI, and causal modeling to develop new models that describe how advertising impacts customers’ actions • Own the end-to-end development of novel scientific models that address the most pressing needs of our business stakeholders and help guide their future actions • Improve upon and simplify our existing solutions and frameworks • Review and audit modeling processes and results for other scientists, both junior and senior • Work with leadership to align our scientific developments with the business strategy • Identify new opportunities that are suggested by the data insights • Bring a department-wide perspective into decision making • Develop and document scientific research to be shared with the greater science community at Amazon About the team AIM is a cross disciplinary team of engineers, product managers, economists, data scientists, and applied scientists with a charter to build scientifically-rigorous causal inference methodologies at scale. Our job is to help customers cut through the noise of the modern advertising landscape and understand what actions, behaviors, and strategies actually have a real, measurable impact on key outcomes. The data we produce becomes the effective ground truth for advertisers and partners making decisions affecting millions in advertising spend.
US, WA, Seattle
Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that takes the company’s Think Big leadership principle to the extreme. We focus on creating entirely new products and services with a goal of positively impacting the lives of our customers. No industries or subject areas are out of bounds. If you’re interested in innovating at scale to address big challenges in the world, this is the team for you. Here at Amazon, we embrace our differences. We are committed to furthering our culture of inclusion. We have thirteen employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We are constantly learning through programs that are local, regional, and global. Amazon’s culture of inclusion is reinforced within our 16 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. Our team highly values work-life balance, mentorship and career growth. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We care about your career growth and strive to assign projects and offer training that will challenge you to become your best.