Aerial photo of the San Diego waterfront on an overcast day
View of the San Diego skyline from the convention center to Seaport Village.
Jerry Uomala /Getty Images/iStockphoto

Amazon at AEA: The crossroads of economics and AI

Pat Bajari, VP and chief economist for Amazon's Core AI group, on his team's new research and what it says about economists' role at Amazon.

The 2020 meeting of the American Economic Association begins on January 3 in San Diego, and among the Amazon economists attending will be Pat Bajari, VP and chief economist for Amazon’s Core AI group, who is a coauthor on two papers accepted to the conference.

Pat Bajari portrait
Pat Bajari, VP and chief economist, Amazon Core AI
Carl Clark, Amazon Imaging Studio

Economic research at Amazon, Bajari explains, is distinctive in the way it crosses disciplinary boundaries. “These disciplines are like their own worlds,” he says. “It’s easy to get siloed doing engineering, machine learning, natural-language processing, computer vision, stats, operational research, economics, and so on. But when these disciplines interact, you get more interesting and useful results.”

Apples to apples

One of Bajari’s two papers at AEA is a case in point. Titled “New Goods, Productivity and the Measurement of Inflation: Using Machine Learning to Improve Quality Adjustments,” it applies new AI techniques to an old problem in the calculation of inflation rates.

“If you look at a product line, over the course of a year, 80% of the products might vanish,” Bajari explains. “When you calculate the rate of inflation, you’re usually doing an annual measure of price changes. But if 80% of products are gone, that measurement can be inaccurate.”

A famous example, Bajari explains, is personal computers in the late ’90s. At the time, he says, 95% of computers would sell out in the course of a year. The computers on the shelves one January could have very different technical specifications from those on the shelves a year later, making direct price comparison misleading.

Consequently, the standard method of calculating inflation indicated little change in the price of personal computers, even though the price of computational power was plummeting. The classical solution to this problem is so-called hedonic pricing, in which the price of a product is factored into several components, which can be compared independently.

So, for instance, late-’90s computers could be compared according to their price per megahertz of processing speed, per megabyte of random-access memory, per megabyte of storage, and so on. Bajari’s first AEA paper updates hedonic pricing for the age of deep learning. On the paper, he joins Victor Chernozhukov, a professor of economics at MIT and a senior principal economist in Amazon’s Core AI group; Ramon Huerta, a research scientist at the University of California, San Diego, and a principal applied scientist in the Amazon North American Consumer group; George Monokroussos, a former senior economist at Amazon; and three other members of Core AI: Zhihao Cen, a senior applied scientist Junbo Li; a senior software engineer; and Manoj Manukonda, a senior data engineer.

Instead of factorizing product prices themselves, the researchers trained a machine learning model to identify correlations between product features and prices. If the model is trained on data from one year but fed descriptions of products on the shelves a year later, it will spit out the products’ prices according to the earlier valuation. Comparing the predicted and actual prices provides a measure of inflation.

Hedonic-pricing model
To predict a product's price, a new machine learning model factors in numeric data such as number of reviews and average star rating, textual data such as product descriptions and titles, and even visual data such as product shots.
Stacy Reilly

Internally, Amazon can use this type of model to analyze business trends. But if central bankers applied a similar model to products representative of the economy as a whole, they could observe inflation rate variations in real time.

“If central bankers have a view with a one-day latency, it could give them signals about whether monetary policy is too loose or too tight,” Bajari explains.

Feedback loops

Bajari’s other AEA paper examines the design of randomized experiments. It reports work done in collaboration with Guido Imbens, a member of Core AI and the Applied Econometrics Professor and professor of economics at Stanford Business School; Thomas Richardson, a professor of statistics at the University of Washington and an Amazon Scholar; Brian Burdick, the director of Core AI; Ido Rosen, a principal software engineer in Burdick’s group; and James McQueen, a senior applied scientist in Amazon’s Customer Behavior Analytics group.

The most familiar example of a randomized experiment is a drug trial, where some subjects receive an experimental drug, some receive a placebo, and their outcomes are compared. But randomized experiments are also common in industry.

Suppose, for instance, that Amazon researchers develop a new algorithm for calculating how much of a product to restock at a fulfillment center as a function of recent sales rates and supply on hand. In simulations, the algorithm promises more reliable delivery and greater customer satisfaction, but there’s a question about whether those theoretical gains will translate into practice.

Amazon might conduct a randomized experiment in which some fulfillment centers use the new algorithm, some use the old algorithm, and the average results are compared. Such experiments, however, are liable to so-called spillover effects, where the “treatment” — in this case, the deployment of the new algorithm — ends up having consequences for the control group — in this case, the fulfillment centers using the old algorithm.

Suppose that the treatment results in faster delivery of certain products, and consequently, those products grow in popularity. Amazon’s recommendation engine begins recommending those products more frequently, even to customers served by fulfillment centers using the old restock algorithm. Demand for the products spikes, and the control group starts selling through its stocks — a negative outcome, in terms of the experimental design. When the results of the experiment are tallied, the control group’s performance is artificially depreciated because of the treatment.

“This type of spillover does not happen in standard medical-drug trials, because one individual taking the new drug does not affect the outcome for another individual taking the placebo,” Imbens says. “But it is a feature of many experiments at Amazon and similar companies, where we have complex feedback loops.”

Exerting controls

One way to identify such spillover effects would be to ensure that, for every product that receives the treatment, there’s a related product that doesn’t, regardless of where it’s stored. That would make it possible to determine whether demand spikes are affecting product classes as a whole or are limited to treated products. But it complicates the experimental design.

The researchers’ paper presents an ambitious blueprint for performing such complex experiments. It describes how to simultaneously measure average effects and identify spillovers within a single experiment — by, for instance, systematically varying the treatment’s application to pairs of fulfillment centers and products. It also presents statistical techniques for analyzing the results of such experiments.

The researchers’ blueprint could be applied in a host of different contexts — movie recommendations, rideshare services, short-term-property-rental sites, homebuying sites, retail sites, job search sites, and the like. It also generalizes from double randomization — a given product can receive different treatments at different fulfillment centers, and a given fulfillment center can treat some products and not others — to higher-dimensional randomization — varying treatment according to season, delivery destination, vendor, and so on.

“When people do these kinds of experiments, they usually randomize only one variable at a time,” Bajari explains. “We want to go further with this idea, where we use multiple randomizations to learn supply responses, demand responses, equilibria — all with the goal to keep improving the customer experience.”

Helping identify the causal relationships that underlie the data, Bajari says, is one of the ways in which the economic perspective is useful. But another is in deciding what to measure, across what time frame.

“Usually, ML and AI are tools for making decisions,” Bajari says. “If you have a particular product, how much should you stock of it? You want to make that decision in a present-value-maximizing way. You don’t want to sacrifice long-term success for short-term gains. If you only looked at short-term numbers, we would cut safety stock by half. Then customers would be more apt to find products out of stock, which means they might be less likely to shop on Amazon, which in turn could hurt growth.

“If you want to use ML and AI to make decisions in a rational way, you need a way to trade off long-term and short-term results. This is a place where economists help. What should a firm rationally optimize for? That’s just squarely in economics. That’s what we do.”

Amazon's involvement at AEA/ASSA

Paper and presentation schedule

Friday, 1/3 | 2:30 pm - 4:30 pm | Marriott Marquee San Diego | San Diego Ballroom A

"GDPR and the Home Bias of Venture Investment"

Jian Jia (Illinois Institute of Technology) · Ginger Jin (University of Maryland/Amazon Scholar) · Liad Wagman (Illinois Institute of Technology)

"New Goods, Productivity and the Measurement of Inflation: Using Machine Learning to Improve Quality Adjustments"

Pat Bajari (Amazon) · Zhihao Cen (Amazon) · Victor Chernozhukov (MIT/Amazon) · Ramon Huerta (UCSD/Amazon) · Junbo Li (Amazon) · Manoj Manukonda (Amazon) · George Monokroussos (Wayfair)

"Double Randomized Online Experiments"

Pat Bajari (Amazon) · Brian Burdick (Amazon) · Guido Imbens (Stanford Graduate School of Business/Amazon) · James McQueen (Amazon) · Thomas Richardson (University of Washington/Amazon Scholar) · Ido Rosen (Amazon)

Saturday, 1/4 | 2:30 pm - 4:30 pm | Marriott Marquis San Diego | Del Mar

"Sustained Credit Card Borrowing"

Sergei Koulayev (Amazon) · Daniel Grodzicki (Pennsylvania State University/Consumer Financial Protection Bureau)


Econometrica Session: New Developments in Econometrics

Chair: Guido Imbens

About the Author
Larry Hardesty is a science writer at Amazon. Previously, he was managing editor of the Boston Book Review, a senior editor at MIT Technology Review, and the computer science writer at the MIT News Office.

Work with us

See More Jobs
US, WA, Seattle
Prime Video is shaping the future of digital video entertainment. Our mission is to build the widest selection of digital video content and make it easy for customers to stream wherever and whenever they want. The Video Personalization team’s mission is to give customers individual Video recommendations, to surface the titles that they will most enjoy watching.As a Data Scientist in the Video Personalization team, you will play a vital role in understanding how to optimize the customer experience, and how to measure and recognize long term customer value. Your insights will drive what the Personalization product engineering team invests in, and help set and measure annual goals.In this role, you will own measurement strategy, weblab A/B training and office hours, performance tracking, whilst developing new insightful metrics and scaling the existing customer ML models that help define success within online A/B tests. You will work closely with the director, senior managers, product managers, engineers and ML specialists in the Personalization team, as well as people across Video and Amazon in finance, merchandising and economist teams.The successful candidate for this position will understand customers and business problems, and being a skilled modeler will be able to go complex or simple as appropriate. The role will include:- Using R, Python, Sagemaker/Eider, Redshift to analysis and model huge quantities of data- Work with product leaders to understand and reshape their customer problems and deliver innovative solutions- Own a problem space end to end and deliver to agreed timelines- Deep dive experiments to better shape the next set of treatments- Create new metrics that will help guide and evaluation specific customer experience.- Understand how best to cohort customers to track and optimize customer journeys.
US, CA, Sunnyvale
Are you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon. We are a smart team of doers that work passionately to apply cutting edge advances in robotics and software to solve real-world challenges that will transform our customers’ experiences in ways we can’t even imagine yet.As a Manager, Applied Science, you will wear many different hats and work on multiple components of the entire system, in a highly collaborative environment that’s more startup than big company. You will tackle problems that span a variety of domains: computer vision, image recognition, machine learning, real-time and distributed systems.You will also help in defining the creative vision, product requirements, and user experience for this robotics program. Working with a cross-disciplinary team of analysts, designers, hardware engineers, and researchers, you will define and drive the product from concept all the way through to production.You should be a self-starter with a bias towards independent problem solving. Clear communication and prioritization will be important as you plan, design, and deliver the best experience for millions of customers. Your passion for the potential of using technology to improve people’s lives, and your experience leading complex technology projects will help you make strong business judgments.If you’re entrepreneurial and want to build and own transformative technology-driven products, join us in making history.As a part of this role, you will:· Lead the design and implementation of a cutting-edge technology in the Robotics space, focusing on SLAM.· Build and manage a team of Scientists.· Foster career growth and a strong team culture.· Recruit, hire, mentor, and coach technical staff.· Interface with our internal customers to understand requirements, set priorities and communicate direction and progress.· Own all operational metrics and support for your team.· Manage the agile development process and methodology to deliver incremental value to customers.· Help develop long-term roadmaps and business technology strategies.
US, WA, Seattle
Ever wonder how you can keep the world’s largest selection also the world’s safest and legally compliant selection? Then come join a team with the charter to monitor and classify the billions of items in the Amazon catalog to ensure compliance with various legal regulations.Our mission is to enable business users to self-serve build, deploy, maintain and improve prod cut classifiers at Amazon catalog scale. To enable this mission, one needs an ecosystem that proactively interacts and assists its users in delivering a robust ML solution. A self-serve product classification system that proactively engages with its user in a near real-time fashion by providing intuitive “insights and biases” about a model’s learning and seeks user feedback enabling continuous re-learning and correction.In this role, you will have an opportunity to lead state of the art machine learning algorithms on large datasets. You will need to lead & build Amazon scale applications running on Amazon Cloud that both leverage and create new technologies to process large volumes of data that derive patterns and conclusions from the data.We are seeking an Applied Science Manager who has a solid background in applied Machine Learning and AI, deep passion for building data-driven products; ability to communicate data insights and scientific vision, and has a proven track record of leading both applied scientists and software engineers to execute complex projects and deliver business impacts.In this role, you will:· Lead a group applied scientists (predominantly) and software engineers to deliver machine-learning and AI solutions to production.· Advance team's engineering craftsmanship and drive continued scientific innovation as a thought leader and practitioner.· Develop science and engineering roadmap, run Sprint/quarter and annual planning, and foster cross-team collaboration to execute complex projects.· Perform hands-on data analysis, build machine-learning models, run regular A/B tests, and communicate the impact to senior management.· Hire and develop top talents, provide technical and career development guidance to both scientists and engineers in the organization.
US, WA, Seattle
Are you passionate about conducting measurement research and experiments to assess and evaluate talent? Would you like to see your research in products that will drive key talent management behaviors globally to ensure we are raising the bar on our talent? If so, you should consider joining the Global Talent Management (GTM) Science Team!Amazon GTM Science team is an innovative organization that exists to propel Amazon HR toward being the most scientific HR organization on earth. The GTM Science mission is to use Science to assist and measurably improve every talent decision made at Amazon. GTM Science does this by discovering signals in workforce data, infusing intelligence into Amazon’s talent products, and guiding the broader GTM team to pursue high-impact opportunities with tangible returns. This multi-disciplinary approach spans capabilities, including: data engineering, reporting and analytics, research and behavioral sciences, and applied sciences such as economics and machine learning.We are seeking Assessment and Measurement Scientists with expertise developing assessment and validating measures (assessments, performance evaluations, and surveys) to evaluate talent at Amazon. This person will possess knowledge of different assessment approaches to evaluate performance, a strong psychometrics background, scientific survey methodology, computing various content validity analyses, and experience developing legally defensible talent evaluation programs. In this role you will:· Lead the global research strategy developing performance evaluations both quantitative and qualitative· Execute a scalable global content development and research strategy Amazon-wide· Conduct psychometrics analyses to evaluate integrity and practical application of content· Identify research streams to evaluate how to mitigate or remove sources of measurement error· Partner closely and drive effective collaborations across multi-disciplinary research and product teams· Manage full life cycle of large scale research programs (Develop strategy, gather requirements, execute, and evaluate)
US, WA, Seattle
Do you want to join a brand new team building an AI system that would disrupt the industry? Do you enjoy dealing with ambiguity and working on hard problems in a fast-paced environment?Amazon Connect is a highly disruptive cloud-based contact center that enables businesses to deliver engaging, dynamic, and personal customer service experiences. With Amazon Connect, you can create your own cloud-based contact center and be taking calls in minutes. Amazon Connect leverages the power of Artificial Intelligence and the large ecosystem of AWS services such as Lex, Transcribe, Lambda, S3, and Kinesis to provide a truly frustration free and natural customer experience. With this technology, we are transforming an industry and the way customers interact with businesses and how agents service them.As an Applied Scientist on our team, you will analyze data from huge data sets, create ML forecasting and classification models from conception to deployment, and work closely with other senior technical leaders within the team and across AWS. You will demonstrate your deep Applied Science knowledge and experience at prototyping and building accurate and effective ML models using technology such as AWS Sagemaker, PyTorch, and SparkML. Our team is at an early stage, so you will have significant impact on our ML deliverables with no operational load from existing models/systems.We have a rapidly growing customer base and an exciting charter in front of us that includes solving highly complex engineering and algorithmic problems. We are looking for passionate, talented, and experienced people to join us to innovate on this new service that addresses customer needs to build modern contact centers in the cloud. The position represents a rare opportunity to be a part of a fast-growing business soon after launch, and help shape the technology and product as we grow. You will be playing a crucial role in developing the next generation contact center, and get the opportunity to design and deliver scalable, resilient systems while maintaining a constant customer focus.Learn more about Amazon Connect here:
US, WA, Bellevue
Amazon's Customer Delivery Excellence team is looking for a motivated Data Scientist with proven ability to develop, enhance, automate, and manage optimization and cutting edge prediction and learning/Artificial Intelligence models using strong quantitative skills. The successful candidate will have strong data mining, statistical modeling, machine learning skills and is comfortable facilitating ideation and working from concept through to execution.The position will partner with Engineering, Supply Chain teams, Finance and Technology teams to enhance short term and long term volume prediction and optimization models that use a range of data science methodologies to automate data analysis or to solve complex business problems for the NA Transportation network. Responsibilities include building automated tools and support structures needed to analyze data, design metrics for complex systems, dive deep to determine root cause of forecast errors & changes, create statistical definition of the outliers and methodologies to systematically identify and mitigate model variance drivers.A qualified candidate must have demonstrated ability to develop and manage medium to large-scale models and methodologies that are statistically grounded but also functional and practical. Must possess strong written and verbal communication skills, proven ability to engage and collaborate with customers to drive improvements. Possess high intellectual curiosity with ability to quickly learn new concepts/frameworks, algorithms and technology.Additional Responsibilities include:· Research machine learning algorithms and implement by tailoring to particular business needs and test on large datasets.· Manipulating/mining data from databases (Redshift, SQL Server, Oracle DW)· Create automated metrics using complex databases· Providing analytical network support to improve quality and standard work results· Root cause research to identify process breakdowns within departments and providing data through use of various skill sets to find solutions to breakdown· Collaborate with BI/Data Engineer teams and drive the collection of new data and the refinement of existing data sources to continually improve data quality· Foster culture of continuous engineering improvement through mentoring, feedback, and metricsAmazon is an Equal Opportunity-Affirmative Action Employer- Female/Minority/Disability/Vet
UK, Cambridge
We are looking for someone who is excited to apply cutting-edge techniques from deep learning or natural language processing (NLP) to the text-to-speech (TTS) technology behind Alexa and our AWS cloud speech service.As a Machine Learning Scientist you will be responsible for leading the development and launch of core product features. You will have significant influence on our overall strategy by helping define these product features, drive the system architecture, and spearhead the best practices that enable a quality product.We believe that, like a human speaker, a text-to-speech system can produce more natural speech if it has an improved understanding of the meaning and context of the text. If you agree...You will have the opportunity to solve hard problems with voice – we’ve spent years of invention on this. When we started working on this, the technology didn’t even exist – we had to invent it. Join us if you want to apply your deep learning skills in a dynamic field that is revolutionising the way people interact with devices and services.We believe that voice will fundamentally improve the way people interact with technology. It can make the complex simple—it’s the most natural and convenient user interface. Voice is going to be a big part of our future and we are inventing it here.RESPONSIBILITIES· Use your expertise in deep learning to research and implement novel approaches to make improvements to our text-to-speech technology.· Lead and Mentor junior engineers and scientists.· Participate in the design, development, evaluation, deployment and updating of data-driven models and analytical solutions for spoken language applications.
IN, TS, Hyderabad
Amazon’s location and predictive routing inputs play a crucial role in our vehicle routing problems and other critical applications for Amazon , Prime Now, and other Amazon businesses. As part of the Last Mile Science & Technology organization, you’ll partner closely with other scientists and engineers in a collegial environment with a clear path to business impact. We have an exciting problem area to augment the maps and routing inputs used in Last Mile planning and navigation by leveraging the latest computer vision and deep learning techniques, and are actively looking to hire senior scientists to lead this area. Successful candidates will have a deep knowledge of competing machine learning methods for large scale computer vision problems, the ability to map models into production-worthy code, the communication skills necessary to explain complex technical approaches to a variety of stakeholders and customers, and the excitement to take iterative approaches to tackle big, long term problems.
IN, KA, Bangalore
Machine Learning, Big Data and related quantitative sciences have been strategic to Amazon from the early years. Amazon has been a pioneer in areas such as recommendation engines, eCommerce fraud detection and large-scale optimization of fulfillment center operations.As Amazon has rapidly grown and diversified, the opportunity for applying machine learning has exploded. We have a very broad collection of practical problems where machine learning systems can dramatically improve the customer experience, reduce cost, and drive speed and automation. These include automated pricing and demand forecasting for hundreds of millions of products, predicting ad click probabilities, ranking product search results, matching products from multiple sources, classifying products into large taxonomies, information extraction and sentiment analysis for product reviews, voice recognition, natural language understanding, question answering and conversational systems.Your work will focus on retrieving, cleansing and preparing large scale datasets, training and evaluating models and deploying them to production, with continuous monitoring and evaluation. You will work on large engineering efforts that solve significantly complex problems facing global customers. You will be trusted to operate with independence and are often assigned to focus on areas with significant impact on audience satisfaction. You must be equally comfortable with digging in to customer requirements as you are drilling into design with development teams and developing production ready learning models. You consistently bring strong, data-driven business and technical judgment to decisions.You will work with internal and external stakeholders, cross-functional partners, and end-users around the world at all levels. Our team makes a big impact because nothing is more important to us than pleasing our customers, continually earning their trust, and thinking long term. You are empowered to bring new technologies and deep learning approaches to your solutions.
IN, TS, Hyderabad
Do you know Amazon Logistics has grown by 6 times since 2016 in established markets like North America? Do you know that it is handling more than 80% of Amazon shipments in developing countries like India? Curious to develop sustainable solutions that cater to such rapidly scaling business and countries with widely different customer or driver expectations? Interested in modelling and understanding customer behavior through machine learning, artificial intelligence, and data mining over TB scale data with huge business impact on millions of customers?The problems spread across Routing, Maps, Geo-coding, Address Normalization, fraud detection, defect attribution, labor planning spaces, etc. Some examples include determining optimal route for a driver to deliver a set of packages with many customer and on-ground constraints. Creating a mapping infrastructure ground-up right from scratch. Detecting and pre-empting anomalous behavior by delivery agents on the road in real time or predicting what will be the average no. of deliveries made per hour by each driver in upcoming week. If you are looking for an opportunity to build creative technology solutions that positively impact hundreds of millions of international customers, and relish large ownership and diverse technologies join our team today!You will collaborate with Data Scientist, engineers, executives, and designers, You will be instrumental in shaping the product direction and will be actively involved in defining key product features that impact the business. Also, will be responsible to set up and hold a high software quality bar besides providing technical direction to a highly technical team of Software Engineers. The ideal candidate will be a leader, quick learner and be able to work independently. He/she should be able to operate in a very fast paced environment where time to hit market is super critical. The candidate will need to balance technical leadership and savvy with strong business judgment to make the right decisions about technology choices.
IN, KA, Bengaluru
Interested in Amazon Echo? We’re building the speech and language solutions behind Amazon Echo and other Amazon products and services. Come join us!Amazon is looking for passionate, talented and inventive Sr Applied Scientists for our Bangalore center. You will help build industry-leading speech and language solutions that will enhance user interactions with our products and services in order to provide the best-possible experience for our customers. As a Sr Applied Scientist on our team, you will build and optimize cutting-edge natural language understanding systems and conduct core research aimed at advancing the state of the art. This involves:· Researching the latest modeling techniques. Understanding trade-offs between competing approaches, and identifying the ones that are likely to have real impact on our customers.· Implementing and/or improving modeling tools, training recipes and prototypes utilizing programming skills in Python and/or Java.· Conducting experiments to assess the quality of natural language processing modules and to study the effect of different modeling techniques.· Analyzing field data in order to identify areas of possible improvement or enhancement of the system.· Presenting and discussing ideas and results within the team and beyond.· Mentoring team members
IN, KA, Bengaluru
Amazon Alexa Speech and Language Technology team aims to create a delightful experience for Amazon’s customers by making Alexa understand any spoken request quickly and accurately. As Applied Science Manager you will lead a team of talented scientists in the invention, design, development of novel ML algorithms and modeling techniques for advancing speech and language technology, testing, and deployment of technology components, supporting a range of products. This involves: Conducting and coordinating research leading to improved accuracy of automatic speech recognition (ASR) and/or natural language understanding (NLU) systems.Your responsibilities will include· Direct management of scientists· Providing technical and scientific guidance to your team members· Strategic planning and project management for research projects within the team· Advancing state-of-the-art ASR technologyThe successful candidate will;· Leads effectively and prioritizes well· Exhibits excellent judgment· Hires and develops great people· Is able to dive deep and is never out of touch with the details of the technology· Enables and fosters creativity and innovation on her/his team.· Is results-orientated and has a consistent track record of delivery.· Thinks big, out-of-the-box and long-term.· Communicates effectively with senior management as well as with colleagues from science, engineering and business backgrounds
US, CA, Sunnyvale
MULTIPLE POSITIONS AVAILABLE in Sunnyvale, CA for Services, LLC:1. Participate in the design, development, evaluation, deployment and updating of data driven models and analytical solutions for machine learning and/or natural language applications.2. Develop and/or apply statistical modeling techniques (e.g. Bayesian models and deep neural networks), optimization methods, and other ML techniques to different applications in business and engineering.3. Routinely build and deploy ML models on available data.4. Research and implement novel ML and statistical approaches to add value to the Business.5. Mentor junior engineers and scientists.#0000
US, WA, Seattle
Amazon has built a reputation for excellence with recent examples of being named the #1 most trusted company for customers. To deliver on this reputation for trust the Marketplace Abuse team is tasked with identifying and preventing abuse for our customers and brand owners worldwide.Selling Partner Abuse is hiring a Senior Research Scientist who will research and develop innovative statistics based approaches to predict the near-term future. We are working on cutting edge research and we support Patent and publishing papers. The Scientist must understand deeply about Statistical methods and love extracting, nurturing and transforming high volume of data into actionable business information and making it readily accessible to stakeholders.
US, WA, Seattle
This Senior Research Scientist & Strategist role is on a central strategy team supporting Global Corporate Affairs. The individual selected for this position will create and execute numerous high-impact projects related to global strategy development. The work will challenge you to be resourceful, think big while staying connected to the details, translate data-driven insights into strategic recommendations, and embrace a high degree of change and ambiguity. The scope and scale of what we strive to achieve is immense, but it’s also meaningful and energizing.Role responsibilities:· Independently (and in partnership with internal stakeholders) develop, propose, and execute research projects that provide actionable insights to our many global stakeholders· Manage and expand our partnerships with internal research teams and external research agencies with whom we partner· Connect findings across research projects (primary and secondary) to generate overarching insights· Communicate data-driven insights and recommendations through presentations, papers, and other internal communication channels· Provide consultation and create trainings on research fundamentals/best practices, survey design, and developing appropriate KPIs for teams across the organization** Location is open to Virigina, DC, WA, NY, CA, MA**
US, WA, Seattle
The Alexa Shopping team is looking for Applied Scientists to build the next generation of shopping assistants.As an applied scientist in Alexa Shopping, you will be responsible for the research, design and development of new natural language, search, and machine learning technologies for voice shopping. You will be working with top scientists and engineers, as well as with product teams and other research partners, both locally and abroad. Your work will combine data mining, systems and software development, exploration of new technologies, as well as publications and presentations at top scientific conferences.The ideal candidates have deep expertise in one or several of the following fields: Information Retrieval, Web search, Web data mining, Machine Learning, Natural Language Processing, Artificial Intelligence. An ideal candidate shows a bias for action and has a strong understanding of empirical methods. The ability to write clearly and speak convincingly as evidenced through participation in academic conferences and service in the scientific community are a must.Amazon is an Equal Opportunity Employer – Minority / Women / Disability / Veteran / Gender Identity / Sexual Orientation / Age.
US, WA, Seattle
Do you want to influence, design, and build tools that solve Amazon-scale, world-class analytical problems? Are you passionate about Big Data, machine learning, and econometrics? The Economic Trends and Insights (YETI) team is building and scaling an Automated Insights tool to spread data science across the Finance organization and turn Big Data into big business insights.As a Data Scientist on the YETI team, you design and build algorithms and tools to solve the biggest problems across the Consumer Finance organization. From anomaly and trend break detection, to causal inference, to forecasting - you turn complex problems into simple solutions used by technical and non-technical users. You are customer obsessed and enjoy diving deep into data to uncover insights, then partner with software developers and economists to scale your insights across all of Amazon. You treat everything like an experiment, and are able to look around corners to test assumptions and find the non-intuitive answers lurking beneath the surface.As part of the YETI team, you will:· Design, test, and build algorithmic solutions into a production Automated Insight software tool· Collaborate with leading economists and scientists to create scalable solutions to problems including trend break detection, causal inference, and automated root cause analysis· Partner with internal customers to deep dive anomalous trends to generate high impact insights
US, NY, New York
Amazon’s Advertising Audience and Media Insights team (AMI) is looking for a motivated and experienced Applied Science Manager to own and lead a growing science team within our org. Our team owns the product, science, technology and deployment roadmap for advanced analytics and media planning products across our Insights and Performance Team. Analytics and media planning is core to Amazon’s growth, as it helps our suppliers drive awareness, consideration, and purchase of their products by hundreds of millions of consumers around the world, and generates revenue which helps us lower prices and invest in improvements to our customer experience. We are a highly motivated, collaborative and fun-loving team with an entrepreneurial spirit and bias for action. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities.You are the single threaded owner of the Media Insights Science program. You are customer obsessed and have sharp business acumen to build a product vision and roadmap that contributes to the success of our advertisers. You are a technical leader with track record of building and growing applied science and engineering teams. You experiment, develop proof of concept, and ship software. You own the day to day maintenance and evolution of systems that serve the needs of our large and growing base of advertisers. We are looking for a leader who can thrive in a startup environment, thinks big, can move fast, and wants to change the way customers use data to drive business success. If you excel at proposing and developing unique analytical insights and are passionate about creating the future, come join us as we work hard, have fun, and make history.You will:* Own technical vision and direction: You identify and mitigate risks, construct project schedules, and prepare status reports; you embrace performance metrics and measurement techniques because they help you assess how well system-related services are running.* Grow your team: You'll be accountable for growing a team featuring a mix of scientists and engineers that deliver results. This means you'll wear a lot of hats -- from developing scientific models to leading technical discussions, recruiting, establishing processes, and so on. You'll be an example of Amazon's leadership principles and work to grow more leaders within your group. You will manage a fast-growing team that spans multiple locations.* Collaborate on product direction: You’ll build and maintain strong relationships between your team and partner disciplines (Product, User Experience, QA) to ensure that we're focused on delivering the right product for customers.* Lead beyond your team: You will be a key leader within Amazon’s advertising organization. You will contribute to the overall growth of our product development organization. You'll share your best practices and technical acumen in order to drive technology decisions across our organization.You are:* Pragmatic and iterative in developing models and building software: you have an ability to simplify and get things done quickly with a demonstrated track record of building and delivering software and working effectively with external and internal teams.* Highly analytical and data-driven: You solve problems in ways that can be backed up with verifiable data. You focus on driving processes, tools, and statistical methods which support rational decision-making.* Technically fearless: You aren't satisfied by performing 'as expected' and push the limits past conventional boundaries.* Team obsessed: You find and cultivate talent to be capable of achieving outstanding results. You help develop the creative atmosphere to let engineers innovate, while holding them accountable for making smart decisions and delivering results.* Comfortable with ambiguity: You're able to explore new problem spaces with unique constraints and thus non-obvious solutions; you’re quick to identify any gaps in the team and the right person to fill them to best deliver value to customers.* Solutions; you’re quick to identify any gaps in the team and the right person to fill them to best deliver value to customers.
US, NY, New York
Amazon AI is looking for world class scientists and engineers to join its AI Labs working within speech recognition. This group is entrusted with developing core data mining, natural language processing, and machine learning algorithms for AWS services. At Amazon AI you will invent, implement, and deploy state of the art machine learning algorithms and systems. You will build prototypes and explore conceptually new speech recognition solutions. You will interact closely with our customers and with the academic community. You will be at the heart of a growing and exciting focus area for AWS and work with other acclaimed engineers and world famous scientists.
US, NY, New York
Amazon AI is looking for world class scientists and engineers to join its AI Labs working within speech recognition. This group is entrusted with developing core data mining, natural language processing, and machine learning algorithms for AWS services. At Amazon AI you will invent, implement, and deploy state of the art machine learning algorithms and systems. You will build prototypes and explore conceptually new speech recognition solutions. You will interact closely with our customers and with the academic community. You will be at the heart of a growing and exciting focus area for AWS and work with other acclaimed engineers and world famous scientists.