Economics.svg
Research Area

Economics

Developing sophisticated approaches and systems to deliver the broadest selection of products and services at the lowest prices.

Recent publications

View All View All
  • Vivian Qin
    Applied Marketing Analytics (AMA)
    2023
    Brands usually invest in a portfolio of digital ad products for brand consideration and conversion, and their performance is commonly evaluated with ad - attributed metrics. However, these metrics limit the measurement of advertising effectiveness within a short time window, typically of two weeks. Therefore, they could underestimate the total effect if some ad products' efficacy lasts beyond the measurement
  • Xin Guo, Lihong Li, Sareh Nabi, Rabih Salhab, Junzi Zhang
    KDD 2023 Workshop on Multi-Armed Bandits and Reinforcement Learning (MARBLE), ICML 2023 Workshop on The Many Facets of Preference-based Learning

    2023
    Motivated by bid recommendation in online ad auctions, this paper considers a general class of multi-level and multi-agent games, with two major characteristics: one is a large number of anonymous agents, and the other is the intricate interplay between competition and cooperation. To model such complex systems, we propose a novel and tractable bi-objective optimization formulation with mean-field approximation
  • KDD 2023 Workshop on Artificial Intelligence for Computational Advertising (AdKDD)
    2023
    This paper proposes a learning model of online ad auctions that allows for the following four key realistic characteristics of contemporary online auctions: (1) ad slots can have different values and click-through rates depending on users’ search queries, (2) the number and identity of competing advertisers are unobserved and change with each auction, (3) advertisers only receive partial, aggregated feedback
  • KDD 2023 ACM SIGKDD Workshop on Causal Discovery, Prediction and Decision (CDPD)
    2023
    Companies offering web services routinely run randomized online experiments to estimate the “causal impact” associated with the adoption of new features and policies on key performance metrics of interest. These experiments are used to estimate a variety of effects: the increase in click rate due to the repositioning of a banner, the impact on subscription rate as a consequence of a discount or special
  • Sushant More, Priya Kotwal, Sujith Chappidi, Dinesh Mandalapu, Chris Khawand
    ECML PKDD 2023
    2023
    Causal Impact (CI) measurement is broadly used across the industry to inform both short- and long-term investment decisions of various types. In this paper, we apply the double machine learning (DML) methodology to estimate average and conditional average treatment effects across 100s of customer action types for e-commerce and digital businesses and 100s of millions of customers that can be used in decisions

Related content

US, NY, New York
Do you want to lead the Ads industry and redefine how we measure the effectiveness of Amazon Ads business? Are you passionate about causal inference, Deep Learning/DNN, raising the science bar, and connecting leading-edge science research to Amazon-scale implementation? If so, come join Amazon Ads to be an Economist leader within our Advertising Incrementality Measurement science team! Our work builds the foundations for providing customer-facing experimentation tools, furthering internal research & development on Econometrics, and building out Amazon's advertising measurement offerings. Incrementality is a lynchpin for the next generation of Amazon Advertising measurement solutions and this role will play a key role in the release and expansion of these offerings. Key job responsibilities As an Economist leader within the Advertising Incrementality Measurement (AIM) science team, you are responsible for defining and executing on key workstreams within our overall causal measurement science vision. In particular, you can lead the development of experimental methodologies to measure ad effectiveness, and also build observational models that lay the foundations for understanding the impact of individual ad touchpoints for billions of daily ad interactions. You will work on a team of Applied Scientists, Economists, and Data Scientists, alongside a dedicated Engineering team, to work backwards from customer needs and translate product ideas into concrete science deliverables. You will be a thought leader for inventing scalable causal measurement solutions that support highly accurate and actionable insights--from defining and executing hundreds of thousands of RCTs, to developing an exciting science R&D agenda. You will be working with massive data and industry-leading partner scientists, while also interfacing with leadership to define our future vision. Your work will help shape the future of Amazon Advertising. About the team AIM is a cross disciplinary team of engineers, product managers, economists, data scientists, and applied scientists with a charter to build scientifically-rigorous causal inference methodologies at scale. Our job is to help customers cut through the noise of the modern advertising landscape and understand what actions, behaviors, and strategies actually have a real, measurable impact on key outcomes. The data we produce becomes the effective ground truth for advertisers and partners making decisions affecting millions in advertising spend.
CA, BC, Vancouver
As the Economist for Customer Promise, you will be responsible for leading the research, econometric modeling, and analysis to understand customer preferences that inform how the business operates. This entails developing analytic tools and economic models - including generative AI agents - that take into account inventory, fulfillment center capabilities, carrier capabilities, customer preferences, and economic impacts to determine customer promise. You will design, build, and rigorously validate GenAI agents against traditional econometric models and production experiments to assess their accuracy, interpretability, and operational impact. The models and agents you develop will drive changes in transportation and fulfillment networks. You will work with a diverse scientific team including computer scientists, machine learning engineers, and statisticians as well as other economists. You will build statistical models and AI-powered agents using world-class data systems to solve business problems in a fast-paced environment, continuously evaluating new methodologies against established econometric approaches to advance the state of the art in promise optimization. Key job responsibilities Conduct economic analysis and develop models that apply mathematical, econometric, and statistical techniques to business problems, including estimates, optimizations, and forecasts using established methodologies in your specialty area Partner with business stakeholders to understand their challenges and translate business questions into technical economic frameworks that deliver workable solutions Build and validate economic models by ensuring data quality, testing results using standard practices, and taking responsibility for correct implementation and the impact your analysis has on business decisions Communicate findings clearly through technical documents, reports, and presentations to leaders and colleagues, conveying your reasoning and limitations of your analysis with transparency Collaborate with other economists and technical teams to embed economic perspectives into projects and contribute to team goals and project-related metrics A day in the life In this role, you'll focus on building economic models and conducting data analysis that support critical business decisions. You might start your day by meeting with a business partner to understand a pricing question or operational challenge, then translate that into a technical framework. You'll spend time working with data analysis software like R, Matlab, or Stata—and potentially Python—to develop models, validate results, and ensure your analysis aligns with project goals. Throughout the day, you'll document your findings in clear technical reports, present your reasoning to colleagues, and collaborate with other economists to embed economic thinking into broader initiatives. You'll also stay current with developments in your economics specialty and participate in team discussions about methodology and best practices. About the team At Amazon, we are the most customer-centric company on earth. If you'd like to help us build the place to find and buy anything online, this is your chance to make history. To get there, we need exceptionally talented, bright, and driven people. We are looking for a dynamic, organized self-starter to join as an Economist for Customer Promise. The Customer Promise team seeks to identify the optimal delivery speed for whatever a customer wants. We believe that finding an optimal promise and living up to it consistently improves our customer experience because we increase customer's confidence and trust in Amazon as the one, best option to get what you want, when you want it.
GB, London
We are looking for a Senior Economist to work on exciting and challenging business problems related to Amazon Retail’s worldwide product assortment. You will build innovative solutions based on econometrics, machine learning, and experimentation. You will be part of a interdisciplinary team of economists, product managers, engineers, and scientists, and your work will influence finance and business decisions affecting Amazon’s vast product assortment globally. If you have an entrepreneurial spirit, you know how to deliver results fast, and you have a deeply quantitative, highly innovative approach to solving problems, and long for the opportunity to build pioneering solutions to challenging problems, we want to talk to you. Key job responsibilities * Work on a challenging problem that has the potential to significantly impact Amazon’s business position * Develop econometric models and experiments to measure the customer and financial impact of Amazon’s product assortment * Collaborate with other scientists at Amazon to deliver measurable progress and change * Influence business leaders based on empirical findings
US, NY, New York
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their macroeconomics and forecasting skillsets to solve real world problems. The intern will work in the area of forecasting, developing models to improve the success of new product launches in Private Brands. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis About the team The Amazon Private Brands Intelligence team applies Machine Learning, Statistics and Econometrics/economics to solve high-impact business problems, develop prototypes for Amazon-scale science solutions, and optimize key business functions of Amazon Private Brands and other Amazon orgs. We are an interdisciplinary team, using science and technology and leveraging the strengths of engineers and scientists to build solutions for some of the toughest business problems at Amazon, covering areas such as pricing, discovery, negotiation, forecasting, supply chain and product selection/development.
US, CA, San Diego
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their macroeconomics and forecasting skillsets to solve real world problems. The intern will work in the area of forecasting, developing models to improve the success of new product launches in Private Brands. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis About the team The Amazon Private Brands Intelligence team applies Machine Learning, Statistics and Econometrics/economics to solve high-impact business problems, develop prototypes for Amazon-scale science solutions, and optimize key business functions of Amazon Private Brands and other Amazon orgs. We are an interdisciplinary team, using science and technology and leveraging the strengths of engineers and scientists to build solutions for some of the toughest business problems at Amazon, covering areas such as pricing, discovery, negotiation, forecasting, supply chain and product selection/development.
US, NY, New York
The AdsEcon Team within Digicon is looking for an experienced PhD economist. You will lead science projects using cutting edge econometrics and ML to advance science especially behind our advertising business. Advertising is used daily to surface new selection and provide customers a wider set of product choices along their shopping journeys. The business is focused on generating value for shoppers as well as advertisers. Our team uses a combination of econometrics, machine learning, and data science to build disruptive products for all our Advertising products. We also generate insights to guide Amazon Advertising strategy, providing direct support to senior leadership. Location could be Seattle, Los Angeles, or New York City. Key job responsibilities Leverage econometrics and ML models to optimize advertising strategies on behalf of our customers. Influence key business and product decisions based on insights from models you develop. Identify and pitch new opportunities to leadership that are suggested by the data. Partner with other science leaders throughout Amazon to develop consistent and repeatable solutions. Design and analyze experiments (A/B testing etc.) to evaluate different strategies. Work with other scientists, software developers, and product partners to implement your solutions.
JP, 13, Tokyo
Elevate Your Economic Research at the Forefront of Global Retail Innovation We're seeking a brilliant economics researcher to join our dynamic team in Tokyo, where your analytical skills will drive transformative insights across Amazon's global retail ecosystem. As an intern, you'll collaborate with world-class economists, data scientists, and business leaders to solve complex challenges that shape the future of e-commerce. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. A day in the life Your day will be filled with intellectual exploration and impactful problem-solving. You'll dive deep into large-scale datasets, develop sophisticated econometric models, and translate complex economic research into actionable business strategies. Expect to engage in collaborative discussions, leverage modern analytical tools, and contribute to projects that have real-world implications for our global customers.
JP, 13, Tokyo
Elevate Your Economic Research at the Forefront of Global Retail Innovation We're seeking a brilliant economics researcher to join our dynamic team in Tokyo, where your analytical skills will drive transformative insights across Amazon's global retail ecosystem. As an intern, you'll collaborate with world-class economists, data scientists, and business leaders to solve complex challenges that shape the future of e-commerce. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. A day in the life Your day will be filled with intellectual exploration and impactful problem-solving. You'll dive deep into large-scale datasets, develop sophisticated econometric models, and translate complex economic research into actionable business strategies. Expect to engage in collaborative discussions, leverage modern analytical tools, and contribute to projects that have real-world implications for our global customers.
US, WA, Seattle
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their causal inference skillsets to solve real world problems. The intern will work in the area of AWS and develop models to understand customer service usage. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis.
US, NY, New York
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their causal inference skillsets to solve real world problems. The intern will work in the area of Amazon Ads measurement and incrementality and develop models to quantify bias between observational and causal conversion path rate metrics. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. Key job responsibilities Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis.