Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication.png
Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?” was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.
Glynis Condon

3 questions with Özalp Özer: How to build trust in business relationships

Özer’s paper published in INFORMS’ Management Science 2021 explores the dynamics behind “cheap-talk” communications.

Trust and trustworthiness are important in both our personal and business relationships. How then can we build environments that foster increased trust, trustworthiness and cooperation?

In the first edition of a new series that focuses on research papers published by scientists within the Amazon Supply Chain Optimization Technologies (SCOT) organization, we interview Özalp Özer, coauthor of “Are We Strategically Naive or Guided by Trust and Trustworthiness in Cheap-Talk Communication?”. The paper was published in Management Science — the flagship journal of the Institute for Operations Research and the Management Sciences (INFORMS) in April 2021.

Özalp Özer profile image
Özalp Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas.

Özer is a senior principal scientist at Amazon, and George and Fonsa Brody Professor of Management Science at The University of Texas at Dallas (UTD). He earned a PhD in operations research from Columbia University, before going on to serve on the faculty at Stanford and Columbia. Özer has published extensively on a diverse range of topics, from supply chain management, capacity and inventory management to pricing and revenue management.

Özer says that a guiding principle behind his research is to focus on solving problems that have a real-world impact at scale. At Stanford and then UTD, Özer found himself drawn to the field of behavioral and experimental economics — particularly the field of game theory and understanding how to model actions and emotions in scenarios involving multiple decision makers in dynamic environments.

Driven by his interest in tackling real-world business problems, Özer remained engaged with industry during his tenure as an academic. While working on a project focused on designing effective procurement contracts, he observed the important role that trust played in establishing and fostering business relationships.

In many cases, the interests of the parties engaging in a negotiation are not aligned. To give one example, suppliers can use product forecast information from a buyer to make capacity, inventory and other manufacturing-related decisions. However, buyers might often provide suppliers with overly optimistic forecasts to ensure an abundant supply. If the demand for the product turns out to be lower than anticipated, the supplier bears the excess investment risk.

Özer says that this scenario represents an example of “cheap talk communications.” He outlines three characteristics that are common to all cheap talk communications: they are costless (they are devoid of monetary penalties), they are non-binding (a buyer can provide a forecast without committing to it), and they are non-verifiable (no forecast can be completely accurate in the light of market uncertainty). To complicate matters, the objective functions that each party is trying to maximize are at odds (or not perfectly aligned) with each other.

Standard game theory suggests that each party in a business transaction will move toward an equilibrium that maximizes their own payoff. In a cheap-talk setting, where the information is costless, non-binding and non-verifiable, the theory suggests that each party will disregard the information supplied by the other.

However, Özer finds that people involved in business (as well as personal) transactions frequently factor into their decision-making information supplied by the other party, even when their incentives are not perfectly aligned and even when the information or recommendation may be perceived as “cheap”. They do this by taking the business context and the related relationship into account. Doing so results in higher returns for both parties involved. For example, third-party sellers are more likely to act on price reduction or replenishment recommendations from Amazon, if they find that these recommendations have previously resulted in an uptick in sales and profits.

Ozer says that “cheap talk” communications have the unfortunate emphasis on being “cheap” and less emphasis on how they are informative and can align incentives. In a series of publications, Ozer shows why, when, and how such communications and recommendations turn out to be informative, and how they help align business objectives, resulting in both parties making better decisions.   

In this interview, Özer talks about findings from the recently published INFORMS paper and discusses the implications of these findings for companies like Amazon.

Q. What are the two models that can be used to explain how cheap talk communications work between decision makers?

As our paper suggests, there are two contrasting economic theories that can be used to analyze cheap-talk communications.

The trust-embedded model — which takes a more optimistic view of humanity — suggests that decision makers are motivated by non-monetary motives to be trusting and trustworthy, besides the monetary incentives such as maximizing cash flow.   

Here, we define trust as instances of decision makers behaving voluntarily in a way that put themselves in vulnerable engagement due to the uncertain behavior of the other party (the trustee), based upon the expectation of a positive outcome from that engagement. Trustworthiness flips the perspective to that of the trustee. We define trustworthiness as an instance of a decision maker behaving voluntarily in a way not to take advantage of the trustor’s vulnerable position – even when faced with a self-serving decision that conflicts with the trustor’s objectives.

Humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk.
Özalp Özer

The trust-embedded model suggests that when engaging with others, decision makers are averse to manipulating information in economic interactions. They incur disutility from lying. As a result, they assess the trustworthiness of the counterparty, and they form a trust factor towards them. This trust factor governs how decision makers interpret and use the information they receive from others.

In other words, humans use non-Bayesian, trust-based belief systems to update their rules governing interactions with other parties. In short, people involved in a business transaction are willing to be vulnerable and take risk. Because they assess — even sometimes incorrectly — that doing so yields positive outcomes, they engage in and cultivate behaviors conducive to enabling these outcomes.

The trust embedded model suggests that individuals are guided by more than self-interest or pecuniary motives as they engage in transactions. For example, senders of information are guided by factors such as fairness and tenets that are central to their company. As a result, they share more information and resources than strictly necessary.

In contrast to the trust-embedded model, the level-k model — the second model discussed in the paper — suggests that decision makers are limited in their ability to think strategically. Receivers of information cannot anticipate the extent to which the sender might have distorted the message. On the flip-side, senders cannot account for just how much receivers might discount their message. Consequently, senders share more than necessary, because they take a dim view of the receiver’s ability to discount their message.

It’s important to note that even the level-k model can sometimes explain why senders and receivers tend to overshare information in a cheap-talk setting, which contrasts with the outcome standard game theory models would predict. It’s just that their motivations are different – with the level-k model, oversharing is driven by a limited ability to think strategically, rather than by the willingness to be trusting and trustworthy.

Overall, our paper that analyzed existing cheap-talk experiment data, found more support for the trust-embedded model, suggesting that individuals are also driven by non-monetary incentives when conducting transactions.

Q. Why do you think that trust-embedded models do a better job of explaining cheap-talk communications? What are the implications for organizations engaging in relationships with businesses and partners?

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust.
Özalp Özer

The answer to your first question is relatively simple — human beings are far more sophisticated than the level-k model gives them credit for. For example, there are many sellers on Amazon’s website who are proficient in using a variety of tools they have developed to make decisions related to pricing and inventory.

As a result, if we want the tools we provide to earn sellers’ trust, we need to think of the system more holistically at both an architecture and policy level to truly understand what builds trust and what is a trust-buster.

During the internet age, we’ve seen e-commerce, hospitality and ride-sharing companies grow precisely because they’ve been able to create policies and tools that encourage trust. Product reviews, the ability to get refunds for a vacation rental because hosts might not have lived up to their promises, or the price for a ride being set in advance — these are some of the mechanisms that let you buy a product or rent a home from people you don’t know.

Q. How are the findings in your paper applicable to your work at Amazon?

We are leveraging the insights from this stream of research as well as others to augment our understanding of seller trust, particularly in relation to how sellers interact with our inventory management tools, and how fidelity of recommendations impact sellers’ trust.

There is no interaction at Amazon that I can think of that doesn’t have an element of trust.
Özalp Özer

We are designing our related processes to reduce barriers for trusting and trustworthy engagements among the participants of our stores; for example, by making specific investments to support seller growth in areas that benefit sellers and customers the most; by reducing perceived vulnerabilities in carrying excess inventory; by looking into ways in which we stabilize our policies; by creating visibility to the reasons for our recommendations; by looking into ways in which we can build interactive communication channels among participants in our stores; and by building reputation and feedback systems that foster trusting and trustworthy engagements and on and on.

Using large-scale data, scientific methods like causal machine learning to optimization, as well as continual engagement with selling partners and customers, we aim to identify at the extent to which sellers trust evolves — so we can identify and invest in processes that foster trust and as a result growth and economic prosperity.  

There is no interaction at Amazon that I can think of that doesn’t have an element of trust. Jeff Bezos has said, “You can’t ask for trust, you just have to do it the hard way, one step at a time.” In my time at the company, I have been struck by the tireless efforts of so many people to gain seller and customer trust. At Amazon, it is just part of everything we do.

Related content

US, WA, Seattle
Here's the job description with causal ML woven in: We are looking for a talented, organized, and customer-focused applied researcher to join our Pricing Optimization science group, with a charter to measure, refine, and launch customer-obsessed improvements to our algorithmic pricing and promotion models across all products listed on Amazon. This role requires an individual with exceptional machine learning modeling and architecture expertise — particularly in deep learning, neural networks, and transformer-based architectures applied to price prediction and forecasting problems. Equally important is deep expertise in causal machine learning — including causal inference, treatment-effect estimation, and experimentation methods (e.g., uplift modeling, double/debiased machine learning, instrumental variables, and A/B and quasi-experimental design) — to isolate the true impact of pricing and promotion decisions on customer behavior and business outcomes. The ideal candidate brings a strong foundation in applied statistics and probabilistic modeling, excellent cross-functional collaboration skills, business acumen, and an entrepreneurial spirit. We are looking for an experienced innovator who is a self-starter, comfortable with ambiguity, demonstrates strong attention to detail, and has the ability to work in a fast-paced and ever-changing environment. Key job responsibilities See the big picture. Understand and influence the long-term vision for Amazon's science-based competitive, perception-preserving pricing techniques. Develop and advance price prediction models leveraging deep learning frameworks, transformer architectures, and advanced statistical methods to drive pricing accuracy at scale. Build strong collaborations. Partner with product, engineering, and science teams within Pricing & Promotions to deploy machine learning price estimation and error correction solutions at Amazon scale. Design and implement neural network-based architectures — including sequence models and transformers — for large-scale price prediction and optimization. Stay informed. Establish mechanisms to stay up to date on the latest scientific advancements in deep learning, transformer architectures, applied statistics, neural network design, probabilistic forecasting, and multi-objective optimization techniques. Identify opportunities to apply them to relevant Pricing & Promotions business problems. Keep innovating for our customers. Foster an environment that promotes rapid experimentation, continuous learning, and incremental value delivery. Leverage statistical rigor and modern deep learning approaches to validate hypotheses and drive measurable pricing improvements. Successfully execute & deliver. Apply your exceptional technical machine learning expertise — including deep neural networks, attention-based models, and applied statistical analysis — to incrementally move the needle on some of our hardest pricing problems. A day in the life We are hiring a Sr. Applied Scientist to drive our pricing optimization initiatives. We drive cross-domain and cross-system improvements through: * shape and extend our RL optimization platform - a pricing centric tool that automates the optimization of various system parameters and price inputs. * Error detection and price quality guardrails at scale. * Identifying opportunities to optimally price across systems and contexts (marketplaces, request types, event periods) Price is a highly relevant input into Stores architectures; this role creates the opportunity to drive extremely large impact (measured in Bs not Ms), but demands careful thought and clear communication. About the team The Pricing Optimization science group builds and refines Amazon's algorithmic pricing and promotion models at scale. Our team combines expertise in deep learning, transformer architectures, applied statistics, and probabilistic forecasting to develop price prediction systems that directly impact the customer experience. The team also brings hands-on experience with causal modeling and inference — including uplift modeling and treatment effect estimation — to rigorously measure the impact of pricing decisions on customer behavior and business outcomes. We partner closely with product, engineering, and business teams to take solutions from research through production deployment.
US, WA, Seattle
We are seeking a Senior Applied Scientist to join our team in developing pioneering AI research, Generative AI, Agentic AI, Large Language Models (LLMs), Diffusion and Flow Models, and other advanced Machine Learning and Deep Learning solutions for Amazon Selection and Catalog Systems, within the AI Lab Team. This role offers a unique opportunity to work on AI research and AI products that will shape the future of online shopping experiences. Our team operates at the forefront of AI research and development, working on challenges that directly impact millions of customers worldwide. We push the boundaries of AI at both the foundational and application layers. As a Senior Applied Scientist, you will have the chance to experiment with LLMs and deep learning techniques, apply your research to solve real-world problems at an unprecedented scale, and collaborate with experienced scientists to contribute to Amazon's scientific innovation. Join us in redefining the future of shopping. Your work will directly influence how customers interact with the world's largest online store. Key job responsibilities - Design and implement novel AI solutions for Amazon catalog of products - Develop and train state-of-the-art LLMs, Diffusion Models, and other Generative AI models - Build and deploy autonomous AI Agents in Amazon production ecosystem - Scale AI models to handle billions of diverse products across multiple languages and geographies - Conduct research in areas such as Autonomous AI Agents, Generative AI, Language Modeling, Multi-modality Computer Vision, Diffusion Models, Reinforcement Learning - Collaborate with cross-functional teams to integrate AI models into Amazon's production ecosystem - Contribute to the scientific community through publications and conference presentations
US, CA, Sunnyvale
We are seeking an Applied Scientist II to join our team in developing pioneering AI research, Generative AI, Agentic AI, Large Language Models (LLMs), Diffusion and Flow Models, and other advanced Machine Learning and Deep Learning solutions for Amazon Selection and Catalog Systems, within the AI Lab Team. This role offers a unique opportunity to work on AI research and AI products that will shape the future of online shopping experiences. Our team operates at the forefront of AI research and development, working on challenges that directly impact millions of customers worldwide. We push the boundaries of AI at both the foundational and application layers. As a Applied Scientist, you will have the chance to experiment with LLMs and deep learning techniques, apply your research to solve real-world problems at an unprecedented scale, and collaborate with experienced scientists to contribute to Amazon's scientific innovation. Join us in redefining the future of shopping. Your work will directly influence how customers interact with the world's largest online store. Key job responsibilities - Design and implement novel AI solutions for Amazon catalog of products - Develop and train state-of-the-art LLMs, Diffusion Models, and other Generative AI models - Build and deploy autonomous AI Agents in Amazon production ecosystem - Scale AI models to handle billions of diverse products across multiple languages and geographies - Conduct research in areas such as Autonomous AI Agents, Generative AI, Language Modeling, Multi-modality Computer Vision, Diffusion Models, Reinforcement Learning - Collaborate with cross-functional teams to integrate AI models into Amazon's production ecosystem - Contribute to the scientific community through publications and conference presentations
US, WA, Seattle
Do you want to leverage your expertise in translating innovative science into impactful products to improve the lives and work of over a million people worldwide? If so, People eXperience Technology Core Science team would love to discuss how you can make that a reality. Our team is an interdisciplinary team that uses behavioral science, statistics, and machine learning to identify products, mechanisms, and process improvements that enhance Amazonians' well-being and their ability to deliver value for Amazon's customers. We collaborate with HR teams across Amazon to make Amazon PXT the most scientific human resources organization in the world. In this role, you will spearhead science design and technical implementation innovations across our talent solution science work-streams. You'll enhance existing models and create new ones, empowering leaders throughout Amazon to make data-driven business decisions. You'll collaborate with scientists and engineers to deliver solutions while working closely with business stakeholders to address their specific needs. Your work will span various business domains (corporate, operations, safety) and analysis levels (individual, group, organizational), utilizing a range of modeling approaches (linear, tree-based, deep neural networks, and LLM-based). You'll develop end-to-end ML solutions from problem formulation to deployment, maintaining high scientific standards and technical excellence throughout the process. As an Applied Scientist, you'll also contribute to the team's science strategy, keeping pace with emerging AI/ML trends. You'll mentor junior scientists, fostering their growth by identifying high-impact opportunities. Your guidance will span different analysis levels and modeling approaches, enabling stakeholders to make informed, strategic decisions. If you excel at building advanced scientific solutions and are passionate about developing technologies that drive organizational change in the AI era, join us as we work hard, have fun, and make history. Key job responsibilities Key job responsibilities • Model Development & Innovation: Design and implement novel GenAI/LLM solutions using foundation models (e.g., Claude, GPT) and AWS services including Amazon Bedrock, SageMaker, and other AWS AI/ML tools • Research & Experimentation: Conduct applied research to advance the state-of-the-art in LLM applications, including prompt engineering, few-shot learning, fine-tuning, and model evaluation • Production Deployment: Build scalable, production-ready AI systems that serve millions of requests with high reliability, low latency, and cost efficiency • Cross-Functional Collaboration: Partner with product managers, engineers, and business stakeholders to translate business requirements into technical solutions and drive measurable impact • Technical Leadership: Mentor junior scientists, contribute to technical strategy, and establish best practices for GenAI development across the organization • Evaluation & Metrics: Design rigorous evaluation frameworks to measure model performance, bias, safety, and business impact • Documentation & Influence: Publish technical papers, create documentation, and influence both technical and non-technical audiences About the team The People eXperience and Technology (PXT) Core Science Team uses science, engineering, and customer-obsessed problem solving to proactively identify mechanisms, process improvements, and products that simultaneously improve Amazon and Amazonians' lives, wellbeing, and value of work. As an interdisciplinary team combining talents from machine learning, statistics, economics, behavioral science, engineering, and product development, the Core Science team develops and delivers measurable solutions through innovation and rapid prototyping to accelerate informed, accurate, and reliable decision-making backed by science and data. We are building a talent intelligence layer — fusing natural language understanding, network science, and large-scale predictive modeling into a unified platform that continuously learns from how people work, collaborate, and grow across one of the world's largest and most complex workforces.
IN, KA, Bengaluru
Are you excited by the idea of developing personalized experiences for Amazon customers as they shop? Are you looking for new challenges and to solve hard science problems while applying state-of-the-art recommendation system modeling and GenAI techniques? Join us and you'll help millions of customers make informed purchase decisions while also advancing the state of Amazon's science by publishing research! Key job responsibilities - Participate in the design, development, evaluation, deployment and updating of data-driven models for shopping personalization. - Develop and test new signals for improving recommendation models - Use supervised and uplift learning algorithms to improve customer experience - Contribute to production code and science tooling - Design A/B tests and conduct statistical analysis on their results - Work with distributed machine learning and statistical algorithms to harness enormous volumes of data at scale to serve our customers - Work closely with internal stakeholders like the business teams, engineering teams and partner teams and align them with respect to your focus area - Present and publish science research internally and externally, contributing to Amazon's science community - Mentor junior engineers and scientists. About the team Our team's mission is to surface the right payments-related recommendations to customers at the right time, helping create a rewarding and successful shopping experience for Amazon's customers. Our team's culture is highly collaborative, with an emphasis on supporting each other and learning from one another. We dedicate time each week to focus on personal development and expanding our knowledge as a team. We also highly value having a big impact, both for Amazon's business and for our customers.
IN, KA, Bengaluru
Amazon Music is an immersive audio entertainment service that deepens connections between fans, artists, and creators. From personalized music playlists to exclusive podcasts, concert livestreams to artist merch, Amazon Music is innovating at some of the most exciting intersections of music and culture. We offer experiences that serve all listeners with our different tiers of service: Prime members get access to all the music in shuffle mode, and top ad-free podcasts, included with their membership; customers can upgrade to Amazon Music Unlimited for unlimited, on-demand access to 100 million songs, including millions in HD, Ultra HD, and spatial audio; and anyone can listen for free by downloading the Amazon Music app or via Alexa-enabled devices. Join us for the opportunity to influence how Amazon Music engages fans, artists, and creators on a global scale. Learn more at https://www.amazon.com/music. The Music Catalog Quality team at Amazon Music serves a key role in developing solutions to ensure and improve the quality of catalog metadata and content across the music streaming experience. We create solutions that detect, measure, and remediate quality issues in music metadata - including artist information, track attributes, versions, content tags, and provide actionable insights that enable continuous improvement of the catalog. We leverage a host of scientific and engineering technologies to accomplish this mission, including Generative AI, classical ML, Natural Language Processing, Computer Vision, and automated data validation pipelines. Key job responsibilities As an Applied Scientist, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Other responsibilities include: - Collaborate with scientists, engineers, and product managers to define and frame business problems as ML or optimization tasks. - Use machine learning, deep learning, LLMs and Agentic AI techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon's data to help automate and optimize key processes - Design, development and evaluation of AI models for predictive learning - Research and implement novel machine learning and statistical approaches - Implement scalable data pipelines and model-serving systems. - Analyze experimental results, draw insights, and refine models to improve accuracy and robustness. - Communicate findings and recommendations to technical and non-technical audiences.
IN, KA, Bengaluru
Amazon Music is an immersive audio entertainment service that deepens connections between fans, artists, and creators. From personalized music playlists to exclusive podcasts, concert livestreams to artist merch, Amazon Music is innovating at some of the most exciting intersections of music and culture. We offer experiences that serve all listeners with our different tiers of service: Prime members get access to all the music in shuffle mode, and top ad-free podcasts, included with their membership; customers can upgrade to Amazon Music Unlimited for unlimited, on-demand access to 100 million songs, including millions in HD, Ultra HD, and spatial audio; and anyone can listen for free by downloading the Amazon Music app or via Alexa-enabled devices. Join us for the opportunity to influence how Amazon Music engages fans, artists, and creators on a global scale. Learn more at https://www.amazon.com/music. The Music Catalog Quality team at Amazon Music serves a key role in developing solutions to ensure and improve the quality of catalog metadata and content across the music streaming experience. We create solutions that detect, measure, and remediate quality issues in music metadata - including artist information, track attributes, versions, content tags, and provide actionable insights that enable continuous improvement of the catalog. We leverage a host of scientific and engineering technologies to accomplish this mission, including Generative AI, classical ML, Natural Language Processing, Computer Vision, and automated data validation pipelines. Key job responsibilities As an Applied Scientist, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Other responsibilities include: - Collaborate with scientists, engineers, and product managers to define and frame business problems as ML or optimization tasks. - Use machine learning, deep learning, LLMs and Agentic AI techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon's data to help automate and optimize key processes - Design, development and evaluation of AI models for predictive learning - Research and implement novel machine learning and statistical approaches - Implement scalable data pipelines and model-serving systems. - Analyze experimental results, draw insights, and refine models to improve accuracy and robustness. - Communicate findings and recommendations to technical and non-technical audiences.
IN, KA, Bengaluru
Amazon Music is an immersive audio entertainment service that deepens connections between fans, artists, and creators. From personalized music playlists to exclusive podcasts, concert livestreams to artist merch, Amazon Music is innovating at some of the most exciting intersections of music and culture. We offer experiences that serve all listeners with our different tiers of service: Prime members get access to all the music in shuffle mode, and top ad-free podcasts, included with their membership; customers can upgrade to Amazon Music Unlimited for unlimited, on-demand access to 100 million songs, including millions in HD, Ultra HD, and spatial audio; and anyone can listen for free by downloading the Amazon Music app or via Alexa-enabled devices. Join us for the opportunity to influence how Amazon Music engages fans, artists, and creators on a global scale. Learn more at https://www.amazon.com/music. The Music Catalog Quality team at Amazon Music serves a key role in developing solutions to ensure and improve the quality of catalog metadata and content across the music streaming experience. We create solutions that detect, measure, and remediate quality issues in music metadata - including artist information, track attributes, versions, content tags, and provide actionable insights that enable continuous improvement of the catalog. We leverage a host of scientific and engineering technologies to accomplish this mission, including Generative AI, classical ML, Natural Language Processing, Computer Vision, and automated data validation pipelines. Key job responsibilities As an Applied Scientist, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Other responsibilities include: - Collaborate with scientists, engineers, and product managers to define and frame business problems as ML or optimization tasks. - Use machine learning, deep learning, LLMs and Agentic AI techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon's data to help automate and optimize key processes - Design, development and evaluation of AI models for predictive learning - Research and implement novel machine learning and statistical approaches - Implement scalable data pipelines and model-serving systems. - Analyze experimental results, draw insights, and refine models to improve accuracy and robustness. - Communicate findings and recommendations to technical and non-technical audiences.
US, NY, New York
About Sponsored Products and Brands The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through industry leading generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. About our team The Search Ranking and Interleaving (R&I) team within Sponsored Products and Brands is responsible for determining which ads to show and the quality of ads shown on the search page (e.g., relevance, personalized and contextualized ranking to improve shopper experience, where to place them, and how many ads to show on the search page. This helps shoppers discover new products while helping advertisers put their products in front of the right customers, aligning shoppers’, advertisers’, and Amazon’s interests. To do this, we apply a broad range of GenAI and ML techniques to continuously explore, learn, and optimize the ranking and allocation of ads on the search page. We are an interdisciplinary team with a focus on improving the SP experience in search by gaining a deep understanding of shopper pain points and developing new innovative solutions to address them. A day in the life As a Sr. Applied Scientist on this team, you will identify big opportunities for the team to make a direct impact on customers and the search experience. You will work closely with with search and retail partner teams, software engineers and product managers to build scalable real-time GenAI and ML solutions. You will lead projects end-to-end including problem formulation in collaboration with Product Managers and key stakeholders, lead a team of scientists to build models, design, run, and analyze A/B experiments to improve the experience of millions of Amazon shoppers. Key job responsibilities - Architect next-generation systems that improve Amazon's Search page. - Pioneer breakthrough applied science in multi-modal GenAI applications for advertising, combining text, image, and multi-lingual support. - Develop real-time machine learning algorithms to allocate billions of ads per day in advertising auctions. - Research new and innovative machine learning approaches.
US, CA, San Diego
Do you want to join an innovative team of scientists and engineers who use terabytes of data and create state-of-the-art Generative AI algorithms to push the boundaries of AI creativity? We are building foundational behavioral models for Amazon Stores using Generative AI, LLMs and Large Model training techniques that fuses general world knowledge, customer shopping behavior and Amazon e-commerce domain knowledge. We are looking for scientists who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry using intelligent and transformative AI applications. Working closely with cross-functional teams, you will be an essential part of every stage of AI development, from ideation and design to rigorous testing and successful deployment, ensuring our AI projects drive innovation and provide value for our customers. If you’re fired up about being part of a dynamic, driven team, then this is your moment to join us on this exciting journey! Key job responsibilities In this role you will leverage your background and expertise to lead developing foundational behavioral model for Amazon Stores using Generative AI, LLM and Large Model training techniques. On a day-to-day basis, you will: - Research and implement new algorithms and architectures for generative AI applications. - Optimize model performance and scalability for inference and deployment. - Collaborate with other talented applied scientists and engineers to gather and preprocess large datasets and develop an improved training infrastructure that accelerates innovation. - Experiment with SOTA methods to improve generative AI model quality. - Provide technical expertise and guidance to support the integration of generative AI solutions into various products and services.