A paper published at INFORMS in 2020, “Revenue-Utility Tradeoff in Assortment Optimization under the Multinomial Logit Model with Totally Unimodular Constraints”, explores the assortment problem by looking both at revenue and the expected utility to the end customer.
A paper published at INFORMS in 2020, “Revenue-Utility Tradeoff in Assortment Optimization under the Multinomial Logit Model with Totally Unimodular Constraints”, explores the assortment problem by looking both at revenue and the expected utility to the end customer.
Glynis Condon

3 questions with Huseyin Topaloglu: A customer-centric approach to assortment optimization

In a paper published at INFORMS in 2020, the Amazon senior principal scientist and his co-authors factored in both revenue and "the expected utility to the customer from the purchase."

Because fulfillment centers cannot stock every item in the Amazon Store, the question of how to optimally select products for same day (and sometimes sub-same day) delivery is one that scientists in Amazon’s Supply Chain Optimization technologies (SCOT) organization must routinely address. This is known as the assortment problem.

Huseyin Topaloglu, Amazon senior principal scientist
Huseyin Topaloglu, Amazon senior principal scientist

Academic research has traditionally tackled this problem by focusing on revenue. Huseyin Topaloglu, Amazon senior principal scientist and a co-author of a paper published at INFORMS in 2020, “Revenue-Utility Tradeoff in Assortment Optimization under the Multinomial Logit Model with Totally Unimodular Constraints”, explores an alternative approach. In addition to factoring in expected revenue, the paper’s authors also take into account the expected utility to the end customer.

Topaloglu, who joined Amazon in July 2020, is on leave of absence from Cornell University where he has spent 18 years as a professor at the School of Operations Research and Information Engineering. His portfolio of research focuses on revenue management, supply chain management, fleet management, and pricing. Topaloglu, who earned a bachelor’s in industrial engineering from Bogazici University in Turkey, and master’s and PhD degrees in operations research and financial engineering from Princeton, says he is drawn to the tangible nature of problems in operations research.

“The problems play out at a physical, real-world level, and this physicality is also apparent in the solutions,” he says.

For Topaloglu, that real-world focus also extends to determine the ideal assortment of products Amazon should carry within its fulfillment centers. Finding the optimal product selection is vital to enabling the company to fulfill delivery promises.

As part of an ongoing series on scientists within SCOT, Amazon Science spoke to Topaloglu about the assortment problem in revenue management, using a customer-focused approach to arrive at an ideal solution, and how Amazon can obtain optimal product assortments at scale.

Q. What is the assortment problem in revenue management?

Broadly speaking, the assortment problem in revenue management explores methods to offer the optimal assortment — or selection — to customers from a universe of products.  Customers can interact with the assortment either by engaging with the selection and making a purchase or by leaving the system without making a purchase.

The goal in academic assortment optimization problems is to maximize the expected contributions from every customer, and to maximize overall revenue. At their heart, assortment problems are inherently combinatorial in nature: you have to find the maximizer of an objective function from a large universe of possible assortments.

Assortment optimizations are important for a variety of reasons that extend beyond revenue maximization.
Huseyin Topaloglu

Modeling the choice process of customers is an important aspect of assortment optimization. We can accomplish this by measuring the utilities customers assign to different products. For example, one approach is to estimate the utility of every product as a function of its features. In a stylized model of choice, customers might evaluate a computer based on processing power, RAM, hard drive capacity, etc. They place a weight on each of these features. We can put the features and associated weights together, as we would do in a regression problem, and arrive at a concrete measure of utility to the end customer.

As scientists, we have to design probability distributions that accurately model customer choice. To do this, we could develop a probability model that captures the intricacies of choice behavior such as correlations between products — for example, we could assign higher correlation between the utility of a ballpoint pen and a fountain pen than between that of a ballpoint pen and a pencil.

Assortment optimizations are important for a variety of reasons that extend beyond revenue maximization. They can provide a barometer of customer satisfaction, which is important because you want people to keep coming back because they can find what they need.

Assortment optimization also informs inventory placement. At Amazon, we might decide not to ship palettes with a new brand of toothpaste to a fulfillment center that has limited space, because customers shopping for toothpaste are often not amenable to switching brands. However, we might decide to stock both pens and notebooks, because a customer that can’t find a notebook might likely abandon their shopping cart which already contains a pen.

Q. How can you obtain the optimal assortment?

In our paper, we formulate the optimization problem in a way that maximizes the expected revenue of the company, but also considers the expected utility to the customer from the purchase.

Our approach maximizes a linear combination of the expected revenue of the firm, and a constant that’s multiplied by the expected utility of the customer. The constant provides a lever. By increasing or decreasing its value, we can arrive at a range of assortments.  

We can determine the company revenue for different values of the constant. To measure customer utility, we can look at the revenue miss that results from how often customers leave the store without making a purchase. Now that we have put a dollar value on both the revenue and customer satisfaction, we can work our way to the optimal assortment.

The beauty of this approach is in its simplicity: since we are already using utility-based choice models to arrive at our probability distributions, there’s almost no extra work needed to factor customer utility into our model. 

Q. How can Amazon achieve optimal assortment at scale?

In operations research, writing models can be easy. However, as scientists, we also must solve these problems efficiently. The approach described in our paper accomplishes this in several ways.

In operations research, writing models can be easy. However, as scientists, we also must solve these problems efficiently.
Huseyin Topaloglu

The first relates to a discretization approach. When you have a catalog as large as Amazon’s, it is inefficient— in fact, nearly impossible — to calculate every feasible assortment. That’s why we take this combinatorial optimization problem and convert it into a continuous optimization problem. To get around the large number of assortments, we utilize a discretization approach to derive the ideal assortment from a smaller universe of candidate assortments.

The second way we solve the assortment optimization problem efficiently is by imposing unimodular constraints. When we choose an assortment from a larger universe, we can’t offer everything to the customer. As a result, we impose constraints on the model.

These may relate to precedence. For example, you can’t offer notebooks without also offering pens. Or we can impose other constraints. These relate to how customers assign utilities to products based on their features: there’s an inherent ordering in the qualities of the products, and the other constraints must adhere to the same ordering. 

We use unimodular constraints to arrive at the optimal solution. In a continuous optimization problem, the feasible set of assortments is large and might not give you a 0 or 1 decision. Such decisions can, however, always be achieved at the corners of the feasible space. By focusing on the corners and imposing unimodular — 0 or 1— constraints, we are able to place bounds on the number of offered products, and are able to efficiently frame the problem as a continuous optimization problem.

Innovations like these can also allow companies like Amazon to achieve optimal assortments at scale to maximize long-term customer value.
Huseyin Topaloglu

Finally, there’s the model itself. We use a multinomial logit model, which is compatible with the random utility maximization principle. As I stated earlier, this principle ties in to how customers assign random utilities to various alternatives before choosing the alternative with the largest utility. Utilizing the multinomial logit model to express probability distributions makes it simple to express choice probabilities, and arrive at the ideal assortment.

Innovations like these can also allow companies like Amazon to achieve optimal assortments at scale to maximize long-term customer value. It’s important to note that the findings in the paper are only a beginning. Incorporating customer-centric performance measures into assortment opens numerous possibilities for future research, and I’m excited to be at Amazon where a lot of this work is taking place.

Related content

US, WA, Seattle
This role will contribute to developing the Economics and Science products and services in the Fee domain, with specialization in supply chain systems and fees. Through the lens of economics, you will develop causal links for how Amazon, Sellers and Customers interact. You will be a key and senior scientist, advising Amazon leaders how to price our services. You will work on developing frameworks and scalable, repeatable models supporting optimal pricing and policy in the two-sided marketplace that is central to Amazon's business. The pricing for Amazon services is complex. You will partner with science and technology teams across Amazon including Advertising, Supply Chain, Operations, Prime, Consumer Pricing, and Finance. We are looking for an experienced Economist to improve our understanding of seller Economics, enhance our ability to estimate the causal impact of fees, and work with partner teams to design pricing policy changes. In this role, you will provide guidance to scientists to develop econometric models to influence our fee pricing worldwide. You will lead the development of causal models to help isolate the impact of fee and policy changes from other business actions, using experiments when possible, or observational data when not. Key job responsibilities The ideal candidate will have extensive Economics knowledge, demonstrated strength in practical and policy relevant structural econometrics, strong collaboration skills, proven ability to lead highly ambiguous and large projects, and a drive to deliver results. They will work closely with Economists, Data / Applied Scientists, Strategy Analysts, Data Engineers, and Product leads to integrate economic insights into policy and systems production. Familiarity with systems and services that constitute seller supply chains is a plus but not required. About the team The Stores Economics and Sciences team is a central science team that supports Amazon's Retail and Supply Chain leadership. We tackle some of Amazon's most challenging economics and machine learning problems, where our mandate is to impact the business on massive scale.
US, WA, Bellevue
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their causal inference and/or structural econometrics skillsets to solve real world problems. The intern will work in the area of Economics Intelligence in Amazon Returns and Recommerce Technology and Innovation and develop new, data-driven solutions to support the most critical components of this rapidly scaling team. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. About the team The WWRR Economics Intelligence (RREI) team brings together Economists, Data Scientists, and Business Intelligence Engineers experts to delivers economic solutions focused on forecasting, causality, attribution, customer behavior for returns, recommerce, and sustainability domains.
US, WA, Bellevue
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their causal inference and/or structural econometrics skillsets to solve real world problems. The intern will work in the area of Economics Intelligence in Amazon Returns and Recommerce Technology and Innovation and develop new, data-driven solutions to support the most critical components of this rapidly scaling team. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. About the team The WWRR Economics Intelligence (RREI) team brings together Economists, Data Scientists, and Business Intelligence Engineers experts to delivers economic solutions focused on forecasting, causality, attribution, customer behavior for returns, recommerce, and sustainability domains.
US, WA, Seattle
Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that takes the company’s Think Big leadership principle to the next level. We focus on creating entirely new products and services with a goal of positively impacting the lives of our customers. No industries or subject areas are out of bounds. If you’re interested in innovating at scale to address big challenges in the world, this is the team for you. As a Research Scientist, you will work with a unique and gifted team developing exciting products for consumers and collaborate with cross-functional teams. Our team rewards intellectual curiosity while maintaining a laser-focus in bringing products to market. Competitive candidates are responsive, flexible, and able to succeed within an open, collaborative, entrepreneurial, startup-like environment. At the intersection of both academic and applied research in this product area, you have the opportunity to work together with some of the most talented scientists, engineers, and product managers. Here at Amazon, we embrace our differences. We are committed to furthering our culture of inclusion. We have thirteen employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We are constantly learning through programs that are local, regional, and global. Amazon’s culture of inclusion is reinforced within our 16 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. Our team highly values work-life balance, mentorship and career growth. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We care about your career growth and strive to assign projects and offer training that will challenge you to become your best.
US, WA, Seattle
Amazon has co-founded and signed The Climate Pledge, a commitment to reach net zero carbon by 2040. As a team, we leverage GenAI, sensors, smart home devices, cloud services, material science, and Alexa to build products that have a meaningful impact for customers and the climate. In alignment with this bold corporate goal, the Amazon Devices & Services organization is looking for a passionate, talented, and inventive Senior Applied Scientist to help build revolutionary products with potential for major societal impact. Great candidates for this position will have expertise in the areas of agentic AI applications, deep learning, time series analysis, LLMs, and multimodal systems. This includes experience designing autonomous AI agents that can reason, plan, and execute multi-step tasks, building tool-augmented LLM systems with access to external APIs and data sources, implementing multi-agent orchestration, and developing RAG architectures that combine LLMs with domain-specific knowledge bases. You will strive for simplicity and creativity, demonstrating high judgment backed by statistical proof. Key job responsibilities As a Senior Applied Scientist on the Energy Science team, you'll design and deploy agentic AI systems that autonomously analyze data, plan solutions, and execute recommendations. You'll build multi-agent architectures where specialized AI agents coordinate to solve complex optimization problems, and develop tool-augmented LLM applications that integrate with external data sources and APIs to deliver context-aware insights. Your work involves creating multimodal AI systems that synthesize diverse data streams, while implementing RAG pipelines that ground large language models in domain-specific knowledge bases. You'll apply advanced machine learning and deep learning techniques to time series analysis, forecasting, and pattern recognition. Beyond technical innovation, you'll drive end-to-end product development from research through production deployment, collaborating with cross-functional teams to translate AI capabilities into customer experiences. You'll establish rigorous experimentation frameworks to validate model performance and measure business impact, building AI-driven products with potential for major societal impact.
US, CA, San Francisco
Amazon launched the AGI Lab to develop foundational capabilities for useful AI agents. We built Nova Act - a new AI model trained to perform actions within a web browser. The team builds AI/ML infrastructure that powers our production systems to run performantly at high scale. We’re also enabling practical AI to make our customers more productive, empowered, and fulfilled. In particular, our work combines large language models (LLMs) with reinforcement learning (RL) to solve reasoning, planning, and world modeling in both virtual and physical environments. Our lab is a small, talent-dense team with the resources and scale of Amazon. Each team in the lab has the autonomy to move fast and the long-term commitment to pursue high-risk, high-payoff research. We’re entering an exciting new era where agents can redefine what AI makes possible. We’d love for you to join our lab and build it from the ground up! Key job responsibilities This role will lead a team of SDEs building AI agents infrastructure from launch to scale. The role requires the ability to span across ML/AI system architecture and infrastructure. You will work closely with application developers and scientists to have a impact on the Agentic AI industry. We're looking for a Software Development Manager who is energized by building high performance systems, making an impact and thrives in fast-paced, collaborative environments. About the team Check out the Nova Act tools our team built on on nova.amazon.com/act
US, WA, Seattle
MULTIPLE POSITIONS AVAILABLE Employer: AMAZON WEB SERVICES, INC. Offered Position: Applied Scientist III Job Location: Seattle, Washington Job Number: AMZ9674037 Position Responsibilities: Participate in the design, development, evaluation, deployment and updating of data-driven models and analytical solutions for machine learning (ML) and/or natural language (NL) applications. Develop and/or apply statistical modeling techniques (e.g. Bayesian models and deep neural networks), optimization methods, and other ML techniques to different applications in business and engineering. Routinely build and deploy ML models on available data, and run and analyze experiments in a production environment. Identify new opportunities for research in order to meet business goals. Research and implement novel ML and statistical approaches to add value to the business. Mentor junior engineers and scientists. Position Requirements: Master’s degree or foreign equivalent degree in Computer Science, Machine Learning, Engineering, or a related field and two years of research or work experience in the job offered, or as a Research Scientist, Research Assistant, Software Engineer, or a related occupation. Employer will accept a Bachelor’s degree or foreign equivalent degree in Computer Science, Machine Learning, Engineering, or a related field and five years of progressive post-baccalaureate research or work experience in the job offered or a related occupation as equivalent to the Master’s degree and two years of research or work experience. Must have one year of research or work experience in the following skill(s): (1) programming in Java, C++, Python, or equivalent programming language; and (2) conducting the analysis and development of various supervised and unsupervised machine learning models for moderately complex projects in business, science, or engineering. Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation. 40 hours / week, 8:00am-5:00pm, Salary Range $167,100/year to $226,100/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, visit: https://www.aboutamazon.com/workplace/employee-benefits.#0000
IN, KA, Bengaluru
Amazon Health Services (One Medical) About Us: At Health AI, we're revolutionizing healthcare delivery through innovative AI-enabled solutions. As part of Amazon Health Services and One Medical, we're on a mission to make quality healthcare more accessible while improving patient outcomes. Our work directly impacts millions of lives by empowering patients and enabling healthcare providers to deliver more meaningful care. Role Overview: We're seeking an Applied Scientist to join our dynamic team in building state of the art AI/ML solutions for healthcare. This role offers a unique opportunity to work at the intersection of artificial intelligence and healthcare, developing solutions that will shape the future of medical services delivery. Key job responsibilities • Lead end-to-end development of AI/ML solutions for Amazon Health organization, including Amazon Pharmacy and One Medical • Research, design, and implement state-of-the-art machine learning models, with a focus on Large Language Models (LLMs) and Visual Language Models (VLMs) • Optimize and fine-tune models for production deployment, including model distillation for improved latency • Drive scientific innovation while maintaining a strong focus on practical business outcomes • Collaborate with cross-functional teams to translate complex technical solutions into tangible customer benefits • Contribute to the broader Amazon Health scientific community and help shape our technical roadmap
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, CA, Santa Clara
Amazon Quick Suite is an enterprise AI platform that transforms how organizations work with their data and knowledge. Combining generative AI-powered search, deep research capabilities, intelligent agents and automations, and comprehensive business intelligence, Quick Suite serves tens of thousands of users. Our platform processes thousands of queries monthly, helping teams make faster, data-driven decisions while maintaining enterprise-grade security and governance. From natural language interactions with complex datasets to automated workflows and custom AI agents, Quick Suite is redefining workplace productivity at unprecedented scale. We are seeking a Data Scientist II to join our Quick Data team, focusing on evaluation and benchmarking data development for Quick Suite features, with particular emphasis on Research and other generative AI capabilities. Our mission is to engineer high-quality datasets that are essential to the success of Amazon Quick Suite. From human evaluations and Responsible AI safeguards to Retrieval-Augmented Generation and beyond, our work ensures that Generative AI is enterprise-ready, safe, and effective for users at scale. As part of our diverse team—including data scientists, engineers, language engineers, linguists, and program managers—you will collaborate closely with science, engineering, and product teams. We are driven by customer obsession and a commitment to excellence. Key job responsibilities In this role, you will leverage data-centric AI principles to assess the impact of data on model performance and the broader machine learning pipeline. You will apply Generative AI techniques to evaluate how well our data represents human language and conduct experiments to measure downstream interactions. Specific responsibilities include: * Design and develop comprehensive evaluation and benchmarking datasets for Quick Suite AI-powered features * Leverage LLMs for synthetic data corpora generation; data evaluation and quality assessment using LLM-as-a-judge settings * Create ground truth datasets with high-quality question-answer pairs across diverse domains and use cases * Lead human annotation initiatives and model evaluation audits to ensure data quality and relevance * Develop and refine annotation guidelines and quality frameworks for evaluation tasks * Conduct statistical analysis to measure model performance, identify failure patterns, and guide improvement strategies * Collaborate with ML scientists and engineers to translate evaluation insights into actionable product improvements * Build scalable data pipelines and tools to support continuous evaluation and benchmarking efforts * Contribute to Responsible AI initiatives by developing safety and fairness evaluation datasets About the team Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Hybrid Work We value innovation and recognize this sometimes requires uninterrupted time to focus on a build. We also value in-person collaboration and time spent face-to-face. Our team affords employees options to work in the office every day or in a flexible, hybrid work model near one of our U.S. Amazon offices.