-
2023 Conference on Digital Experimentation @ MIT (CODE@MIT)2023Online A/B tests have become an indispensable tool across all the technology industry: if performed correctly, “online” experiments can inform effective decision making and product development. It should therefore not be surprising that Gupta et al. [2019] estimates that online businesses alone collectively run hundreds of thousands of experiments annually. Modern online experiments are often run in marketplaces
-
2023 Conference on Digital Experimentation @ MIT (CODE@MIT)2023Randomized Control Trials (RCTs) are widely used across Amazon to causally estimate impacts of proposed feature changes, in order to make data-driven launch decisions. A key element of experimental design is the level of randomization, and the choice often relies on the cross-unit interaction structure. For instance, in the context of advertiser experiments, a treatment may affect the outcome of control
-
2023 Conference on Digital Experimentation @ MIT (CODE@MIT)2023There are many experimental settings that may suffer from cross-unit (customers, seller, advertiser, etc.) spillovers, for instance through network effects. Such effects introduce bias and prevent the experimenter from drawing trustworthy insights on the data. One approach to dealing with such spillovers is to group units into clusters and randomize treatment status at the cluster level. Examples of clusters
-
ESREL 20232023Enabling a circular economy aims to reduce the amount of global waste generated from electrical and electronic equipment, mitigate the associated risk to the ecosystem and human health, and address concerns over limited material resources. Durability is a critical concern because keeping products in use for a longer time should reduce resource consumption and waste. Assessing the durability of products
-
WINE 20232023Due to numerous applications in retail and (online) advertising the problem of assortment selection has been widely studied under many combinations of discrete choice models and feasibility constraints. In many situations, however, an assortment of products has to be constructed gradually and without accurate knowledge of all possible alternatives; in such cases, existing offline approaches become inapplicable
Related content
-
July 29, 2025New cost-to-serve-software metric that accounts for the full software development lifecycle helps determine which software development innovations provide quantifiable value. -
May 21, 2025By combining surveys with ads targeted to metro and commuter rail lines, Amazon researchers identify the fraction of residents of different neighborhoods exposed to the ads and measure ad effectiveness.
-
December 16, 2024In a keynote address at the latest Amazon Machine Learning Conference, Amazon academic research consultant, Stanford professor, and recent Nobel laureate Guido Imbens offered insights on the estimation of causal effects in “panel data” settings.
-
October 21, 2024Causal machine learning provides a powerful tool for estimating the effectiveness of Fulfillment by Amazon’s recommendations to selling partners.
-
April 30, 2024Using causal random forests and Bayesian structural time series to extrapolate from sparse data ensures that customers get the most useful information as soon as possible.
-
March 21, 2024The principal economist and his team address unique challenges using techniques at the intersection of microeconomics, statistics, and machine learning.
