A screen grab of the Amazon Music website
Since 2018, Amazon Music customers in the US have been able to converse with the Alexa voice assistant. Progress in machine learning has recently made the Alexa music recommender experience even more successful and satisfying for customers.

The Amazon Music conversational recommender is hitting the right notes

Learn how the Amazon Music Conversations team is using pioneering machine learning to make Alexa's discernment better than ever.

Recommender systems are everywhere. Our choices in online shopping, television, and music are supported by increasingly sophisticated algorithms that use our previous choices to offer up something else we are likely to enjoy. They are undoubtedly powerful and useful, but television and music recommenders in particular have something of an Achilles heel — key information is often missing. They have no idea what you are in the mood for at this moment, for example, or who else might be in the room with you.

Since 2018, Amazon Music customers in the US who aren’t sure what to choose have been able to converse with the Alexa voice assistant. The idea is that Alexa gathers the crucial missing information to help the customer arrive at the right recommendation for that moment. The technical complexity of this challenge is hard to overstate, but progress in machine learning (ML) at Amazon has recently made the Alexa music recommender experience even more successful and satisfying for customers. And given that Amazon Music has more than 55 million customers globally, the potential customer benefit is enormous.

"Alexa, help me find music"
This audio sample demonstrates a result the conversational recommender might surface based on customer inputs.

But first, how does it work? There are many pathways to the Amazon Music recommender experience, but the most direct is by saying “Alexa, help me find music” or “Alexa, recommend some music” to an Alexa-enabled device. Alexa will then respond with various questions or suggestion-based prompts, designed to elicit what the customer might enjoy. These prompts can be open-ended, such as “Do you have anything in mind?”, or more guided, such as “Something laid back? Or more upbeat?”

With this sort of general information gathered from the customer in conversational turns, Alexa might then suggest a particular artist, or use a prompt that includes a music sample from the millions of tracks available to Amazon Music subscribers. For example: “How about this? <plays snippet of music> Did you like it?” The conversation ends when a customer accepts the suggested playlist or station or instead abandons the interaction.

Related content
In 2017, when the journal IEEE Internet Computing was celebrating its 20th anniversary, its editorial board decided to identify the single paper from its publication history that had best withstood the “test of time”. The honor went to a 2003 paper called “Amazon.com Recommendations: Item-to-Item Collaborative Filtering”, by then Amazon researchers Greg Linden, Brent Smith, and Jeremy York.

Early versions of the conversational recommender were, broadly speaking, based on a rule-based dialogue policy, in which certain types of customer answers triggered specific prompts in response. In the simplest terms, these conversations could be thought of as semi-scripted, albeit a dynamic script with countless possible outcomes.

“That approach worked, but it was very hard to evaluate how we could make the conversation better for the customer,” says Francois Mairesse, an Amazon Music senior machine learning scientist. “Using a rule-based system, you can find out if the conversation you designed is successful or not, thanks to the customer outcome data, but you can’t tell what alternative actions you could take to make the conversation better for customers in the future, because you didn't try them.”

A unique approach

So the Amazon Music Conversations team developed the next-generation of conversation-based music recommender, one that harnesses ML to bring the Alexa music recommender closer to being a genuine, responsive conversation. “This is the first customer-facing ML-based conversational recommender that we know of,” says team member Tao Ye, a senior applied science manager. “The Alexa follow-up prompts are not only responding more effectively for the customer, but also taking into account the customer's listening history.”

Clockwise from the top left are profile photos of, Francois Mairesse, senior machine learning scientist; Tao Ye, senior applied science manager; Ed Bueche, senior principal engineer; and Zhonghao Luo, applied scientist.
Clockwise from the top left, Francois Mairesse, senior machine learning scientist; Tao Ye, senior applied science manager; Ed Bueche, senior principal engineer; and Zhonghao Luo, applied scientist have all contributed to improving the Amazon Music recommender experience.

These two aspects — improved conversational efficiency and the power of incorporating the customer’s history — were explored in two ML successive experiments carried out by the Music Conversations team. The work was outlined in a conference paper presented at the 2021 ACM Conference on Recommender Systems in September.

As a starting point, the team crafted a version of the “Alexa, help me find music” browsing experience in which the questions asked by Alexa were partially randomized. That allowed the team to collect entirely anonymized data from 50,000 conversations, with a meaning representation for each user utterance and Alexa prompt. That data then helped the team estimate whether each Alexa prompt was useful or not — without a human annotator in the loop — by assessing whether the music attribute(s) gathered from a question helped find the music that was ultimately played by the user.

Related content
The scientist's work is driving practical outcomes within an exploding machine learning research field.

From the outset, the team utilized offline reinforcement learning to learn to select the question deemed the most useful at any point in the conversation. In this approach, the ML system aims to optimize scores generated by a customer’s conversation with Alexa, also known as the “reward”. When a given prompt contributed directly to finding the musical content that a customer ultimately selected and listened to, it receives a “prompt usefulness” reward of 1. Prompts that did not contribute to the ultimate success of a conversation receive a reward of 0. The ML system sought ways to maximize these rewards, and created a dialogue policy based on a dataset associating each Alexa prompt with its usefulness.

Continuous improvement

But that was just the first step. Next, the team focused on continuously improving their ML model. That entails working out how to improve the system without exposing large numbers of customers to a potentially sub-optimal experience.

“The whole point of offline policy optimization is that it allows us to take data from anonymized customer conversations and use it to do experiments offline, with no users, in which we are exploring what a new, and hopefully better, dialogue policy might produce,” Mairesse explained.

Conversational recommendations for Alexa presentation at RecSys 2021

That leads to a question: How can you evaluate the effectiveness of a new dialogue policy if you only have data from conversations based on the existing policy? The goal: work out counterfactuals, i.e. what would have happened had Alexa chosen different prompts. To gather the data to make counterfactual analysis possible, the team needed to insert randomization into a small proportion of anonymized customer conversation sessions. This meant the system did not become fixated on always selecting the prompt considered to be most effective, and instead, occasionally probed for opportunities to make new discoveries.

“Let's say there's a prompt that the system expects has only a 5% chance of being the best choice. With randomization activated, that prompt might be asked 5% of the time, instead of never being asked at all. And if it delivers an unexpectedly good result, that’s a fantastic learning opportunity,” explains Mairesse.

Related content
Amazon Research Award recipient Yezhou Yang is studying how to make autonomous systems more robust.

In this way, the system collects sufficient data to fuel the counterfactual analysis. Only when confidence is high that a new dialogue policy will be an improvement on the last will it be presented to some customers and, if it proves as successful as expected, it is rolled out more broadly and becomes the new default.

An early version of the ML-based system focused on improving the question/prompt selection. When its performance was compared with the Amazon Music rule-based conversational recommender, it increased successful customer outcomes by 8% while shortening the number of conversational turns by 20%. The prompt that the ML system learned to select the most was “Something laid back? Or more upbeat?”

Improving outcomes

In a second experiment, the ML system also considered each customer’s listening history when deciding which music samples to offer. Adding this data increased successful customer outcomes by a further 4%, and the number of conversational turns dropped by a further 13%. In this experiment, which was better tailored to the affinities of individual customers, the type of prompt that proved most useful featured genre-related suggestions. For example, “May I suggest some alternative rock? Or perhaps electronic music?”

Related content
The story of a decade-plus long journey toward a unified forecasting model.

“In both of these experiments, we were only trying to maximize the prompt usefulness reward,” emphasizes team member Zhonghao Luo, an Amazon Music applied scientist. “We did not aim to reduce the length of the conversation, but that was an experimental result that we observed. Shorter conversations are associated with better conversations and recommendations from our system.”

The average Alexa music recommender conversation comprises roughly four Alexa prompts and customer responses, but not everyone wants to end the conversation so soon, says Luo. “I've seen conversations in which the customer is exploring music, or playing with Alexa, reach close to 100 turns!”

And this variety of customer goals is built into the system, Ye adds: “It's not black and white, where the system decides it’s asked enough questions and just starts offering music samples. The system can take the lead, or the customer can take the lead. It's very fluid.”

Looking ahead

While the ML-led improvements are already substantial, the team says there is plenty of scope to do more in future. “We are exploring reward functions beyond ‘prompt usefulness’ in a current project, and also which conversational actions are better for helping users reach a successful playback,” says Luo.

The team is also exploring the potential of incorporating sentiment analysis — picking up how a customer is feeling about something based on what they say and how they say it. For example, there’s a difference between a customer responding “Hmm, OK”, “Yes”, “YES!” or “Brilliant, I love it” to an Alexa suggestion.

The conversational experience adapts the response phrasing and tone-of-voice as the conversation progresses to provide a more empathetic conversational experience for the user. “We estimate how close the customer is getting to the goal of finding their music based on a number of factors that include the sentiment of past responses, estimates on how well we understood them, and how confident we are that the sample candidates match their desires,” explained Ed Bueche, senior principal engineer for Amazon Music.

Those factors are rolled into a score that is used to adjust the empathy of the response. “In general, our conversational effort strives to balance cutting edge science and technology with real customer impact,” Bueche said. “We’ve had a number of great partnerships with other research, UX, and engineering teams within Amazon.”

Related content

US, CA, Santa Clara
Job summaryAmazon is looking for a passionate, talented, and inventive Applied Scientist with a strong machine learning background to help build industry-leading language technology.Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Natural Language Processing (NLP), Natural Language Understanding (NLU), Dialog management, conversational AI and Machine Learning (ML).As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop novel algorithms and modeling techniques to advance the state-of-the-art in human language technology. Your work will directly impact millions of our customers in the form of products and services, as well as contributing to the wider research community. You will gain hands on experience with Amazon’s heterogeneous text and structured data sources, and large-scale computing resources to accelerate advances in language understanding.We are hiring primarily in Conversational AI / Dialog System Development areas: NLP, NLU, Dialog Management, NLG.This role can be based in NYC, Seattle or Palo Alto.Inclusive Team CultureHere at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences.Work/Life BalanceOur team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.Mentorship & Career GrowthOur team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.
US, NY, New York
Job summaryAmazon is looking for a passionate, talented, and inventive Applied Scientist with a strong machine learning background to help build industry-leading language technology.Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Natural Language Processing (NLP), Natural Language Understanding (NLU), Dialog management, conversational AI and Machine Learning (ML).As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop novel algorithms and modeling techniques to advance the state-of-the-art in human language technology. Your work will directly impact millions of our customers in the form of products and services, as well as contributing to the wider research community. You will gain hands on experience with Amazon’s heterogeneous text and structured data sources, and large-scale computing resources to accelerate advances in language understanding.We are hiring primarily in Conversational AI / Dialog System Development areas: NLP, NLU, Dialog Management, NLG.This role can be based in NYC, Seattle or Palo Alto.Inclusive Team CultureHere at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences.Work/Life BalanceOur team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.Mentorship & Career GrowthOur team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.
US, CA, Santa Clara
Job summaryAWS AI/ML is looking for world class scientists and engineers to join its AI Research and Education group working on building automated ML solutions for planetary-scale sustainability and geospatial applications. Our team's mission is to develop ready-to-use and automated solutions that solve important sustainability and geospatial problems. We live in a time wherein geospatial data, such as climate, agricultural crop yield, weather, landcover, etc., has become ubiquitous. Cloud computing has made it easy to gather and process the data that describes the earth system and are generated by satellites, mobile devices, and IoT devices. Our vision is to bring the best ML/AI algorithms to solve practical environmental and sustainability-related R&D problems at scale. Building these solutions require a solid foundation in machine learning infrastructure and deep learning technologies. The team specializes in developing popular open source software libraries like AutoGluon, GluonCV, GluonNLP, DGL, Apache/MXNet (incubating). Our strategy is to bring the best of ML based automation to the geospatial and sustainability area.We are seeking an experienced Applied Scientist for the team. This is a role that combines science knowledge (around machine learning, computer vision, earth science), technical strength, and product focus. It will be your job to develop ML system and solutions and work closely with the engineering team to ship them to our customers. You will interact closely with our customers and with the academic and research communities. You will be at the heart of a growing and exciting focus area for AWS and work with other acclaimed engineers and world famous scientists. You are also expected to work closely with other applied scientists and demonstrate Amazon Leadership Principles (https://www.amazon.jobs/en/principles). Strong technical skills and experience with machine learning and computer vision are required. Experience working with earth science, mapping, and geospatial data is a plus. Our customers are extremely technical and the solutions we build for them are strongly coupled to technical feasibility.About the teamInclusive Team CultureAt AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. Work/Life BalanceOur team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.Mentorship & Career GrowthOur team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded scientist and enable them to take on more complex tasks in the future.Interested in this role? Reach out to the recruiting team with questions or apply directly via amazon.jobs.
US, CA, Santa Clara
Job summaryAWS AI/ML is looking for world class scientists and engineers to join its AI Research and Education group working on building automated ML solutions for planetary-scale sustainability and geospatial applications. Our team's mission is to develop ready-to-use and automated solutions that solve important sustainability and geospatial problems. We live in a time wherein geospatial data, such as climate, agricultural crop yield, weather, landcover, etc., has become ubiquitous. Cloud computing has made it easy to gather and process the data that describes the earth system and are generated by satellites, mobile devices, and IoT devices. Our vision is to bring the best ML/AI algorithms to solve practical environmental and sustainability-related R&D problems at scale. Building these solutions require a solid foundation in machine learning infrastructure and deep learning technologies. The team specializes in developing popular open source software libraries like AutoGluon, GluonCV, GluonNLP, DGL, Apache/MXNet (incubating). Our strategy is to bring the best of ML based automation to the geospatial and sustainability area.We are seeking an experienced Applied Scientist for the team. This is a role that combines science knowledge (around machine learning, computer vision, earth science), technical strength, and product focus. It will be your job to develop ML system and solutions and work closely with the engineering team to ship them to our customers. You will interact closely with our customers and with the academic and research communities. You will be at the heart of a growing and exciting focus area for AWS and work with other acclaimed engineers and world famous scientists. You are also expected to work closely with other applied scientists and demonstrate Amazon Leadership Principles (https://www.amazon.jobs/en/principles). Strong technical skills and experience with machine learning and computer vision are required. Experience working with earth science, mapping, and geospatial data is a plus. Our customers are extremely technical and the solutions we build for them are strongly coupled to technical feasibility.About the teamInclusive Team CultureAt AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. Work/Life BalanceOur team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.Mentorship & Career GrowthOur team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded scientist and enable them to take on more complex tasks in the future.Interested in this role? Reach out to the recruiting team with questions or apply directly via amazon.jobs.
US, WA, Seattle
Job summaryHow can we create a rich, data-driven shopping experience on Amazon? How do we build data models that helps us innovate different ways to enhance customer experience? How do we combine the world's greatest online shopping dataset with Amazon's computing power to create models that deeply understand our customers? Recommendations at Amazon is a way to help customers discover products. Our team's stated mission is to "grow each customer’s relationship with Amazon by leveraging our deep understanding of them to provide relevant and timely product, program, and content recommendations". We strive to better understand how customers shop on Amazon (and elsewhere) and build recommendations models to streamline customers' shopping experience by showing the right products at the right time. Understanding the complexities of customers' shopping needs and helping them explore the depth and breadth of Amazon's catalog is a challenge we take on every day. Using Amazon’s large-scale computing resources you will ask research questions about customer behavior, build models to generate recommendations, and run these models directly on the retail website. You will participate in the Amazon ML community and mentor Applied Scientists and software development engineers with a strong interest in and knowledge of ML. Your work will directly benefit customers and the retail business and you will measure the impact using scientific tools. We are looking for passionate, hard-working, and talented Applied scientist who have experience building mission critical, high volume applications that customers love. You will have an enormous opportunity to make a large impact on the design, architecture, and implementation of cutting edge products used every day, by people you know.Key job responsibilitiesScaling state of the art techniques to Amazon-scaleWorking independently and collaborating with SDEs to deploy models to productionDeveloping long-term roadmaps for the team's scientific agendaDesigning experiments to measure business impact of the team's effortsMentoring scientists in the departmentContributing back to the machine learning science community
US, NY, New York
Job summaryAmazon Web Services is looking for world class scientists to join the Security Analytics and AI Research team within AWS Security Services. This group is entrusted with researching and developing core data mining and machine learning algorithms for various AWS security services like GuardDuty (https://aws.amazon.com/guardduty/) and Macie (https://aws.amazon.com/macie/). In this group, you will invent and implement innovative solutions for never-before-solved problems. If you have passion for security and experience with large scale machine learning problems, this will be an exciting opportunity.The AWS Security Services team builds technologies that help customers strengthen their security posture and better meet security requirements in the AWS Cloud. The team interacts with security researchers to codify our own learnings and best practices and make them available for customers. We are building massively scalable and globally distributed security systems to power next generation services.Inclusive Team Culture Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. Work/Life Balance Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives. Mentorship & Career Growth Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. We care about your career growth and strive to assign projects based on what will help each team member develop and enable them to take on more complex tasks in the future.A day in the lifeAbout the hiring groupJob responsibilities* Rapidly design, prototype and test many possible hypotheses in a high-ambiguity environment, making use of both quantitative and business judgment.* Collaborate with software engineering teams to integrate successful experiments into large scale, highly complex production services.* Report results in a scientifically rigorous way.* Interact with security engineers, product managers and related domain experts to dive deep into the types of challenges that we need innovative solutions for.
US, WA, Seattle
Job summaryAmazon Prime Video is changing the way millions of customers enjoy digital content. Prime Video delivers premium content to customers through purchase and rental of movies and TV shows, unlimited on-demand streaming through Amazon Prime subscriptions, add-on channels like Showtime and HBO, and live concerts and sporting events like NFL Thursday Night Football. In total, Prime Video offers nearly 200,000 titles and is available across a wide variety of platforms, including PCs and Macs, Android and iOS mobile devices, Fire Tablets and Fire TV, Smart TVs, game consoles, Blu-ray players, set-top-boxes, and video-enabled Alexa devices. Amazon believes so strongly in the future of video that we've launched our own Amazon Studios to produce original movies and TV shows, many of which have already earned critical acclaim and top awards, including Oscars, Emmys and Golden Globes.The Global Consumer Engagement team within Amazon Prime Video builds product and technology solutions that drive customer activation and engagement across all our supported devices and global footprint. We obsess over finding effective, programmatic and scalable ways to reach customers via a broad portfolio of both in-app and out-of-app experiences. We would love to have you join us to build models that can classify and detect content available on Prime Video. We need you to analyze the video, audio and textual signal streams and improve state-of-art solutions while being scalable to Amazon size data. We need to solve problems across many cultures and languages, working alongside an operations team generating labels across many languages to help us achieve these goals. Our team consistently strives to innovate, and holds several novel patents and inventions in the motion picture and television industry. We are highly motivated to extend the state of the art.As a member of our team, you will apply your deep knowledge of Computer Vision and Machine Learning to concrete problems that have broad cross-organizational, global, and technology impact. Your work will focus on addressing fundamental computer vision models like video understanding and video summarization in addition to building appropriate large scale datasets. You will work on large engineering efforts that solve significantly complex problems facing global customers. You will be trusted to operate with independence and are often assigned to focus on areas with significant impact on audience satisfaction. You must be equally comfortable with digging in to customer requirements as you are drilling into design with development teams and developing production ready learning models. You consistently bring strong, data-driven business and technical judgment to decisions.You will work with internal and external stakeholders, cross-functional partners, and end-users around the world at all levels. Our team makes a big impact because nothing is more important to us than pleasing our customers, continually earning their trust, and thinking long term. You are empowered to bring new technologies and deep learning approaches to your solutions. We embrace the challenges of a fast paced market and evolving technologies, paving the way to universal availability of content. You will be encouraged to see the big picture, be innovative, and positively impact millions of customers. This is a young and evolving business where creativity and drive will have a lasting impact on the way video is enjoyed worldwide.
US, MA, Boston
Job summaryAre you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Robotics. We are a smart team of doers who work passionately to apply cutting edge advances in robotics and software to solve real-world challenges that will transform our customers’ experiences. We invent new improvements every day. We are Amazon Robotics and we will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling, and fun.Amazon.com empowers a smarter, faster, more consistent customer experience through automation. Amazon Robotics automates fulfillment center operations using various methods of robotic technology including autonomous mobile robots, sophisticated control software, language perception, power management, computer vision, depth sensing, machine learning, object recognition, and semantic understanding of commands. Amazon Robotics has a dedicated focus on research and development to continuously explore new opportunities to extend its product lines into new areas.This role is a 6-month Co-Op to join AR full-time (40 hours/week) from January 9, 2023 to June 23, 2023. Amazon Robotics co-op opportunities will be based out of the Greater Boston Area in our two state-of-the-art facilities in Westborough, MA and North Reading, MA. Both campuses provide a unique opportunity to have direct access to robotics testing labs and manufacturing facilities.Key job responsibilitiesWe are seeking data scientist co-ops to help us analyze data, quantify uncertainty, and build machine learning models to make quick prediction.
US, WA, Seattle
Job summary Looking for your next challenge? North America Sort Centers (NASC) are experiencing explosive growth and looking for a skilled, highly motivated Data Scientist to join the Sort Center Product, Science, and Analytics team. The Sort Center network is the critical Middle-Mile solution in the Amazon Transportation Services (ATS) group, linking Fulfillment Centers to the Last Mile. The experience of our customers is dependent on our ability to efficiently execute volume flow through the middle-mile network. Data Scientist will design and implement solutions to address complex business questions using advanced statistical and machine learning techniques, experimentation, and big data. In this role, you will build scalable ML models, apply advanced analysis technique and statistical concepts to draw insights from massive datasets, and create intuitive science models and data visualizations. You can contribute to each layers of a data solution – you work closely with business intelligence engineers and product managers to obtain relevant datasets and prototype predictive analytic models, you team up software development engineers to implement data pipeline to productionize your models, and review key results with business leaders and stakeholders. Your work exhibits a balance between scientific validity and business practicality. To be successful in this role, you must be able to turn ambiguous business questions into clearly defined problems, develop quantifiable metrics and robust machine learning models from imperfect data sources, and deliver results that meet high standards of data quality, security, and privacy. Inclusive Team Culture Here at Amazon, we embrace our differences. We are committed to furthering our culture of inclusion. We have 12 affinity groups (employee resource groups) with more than 87,000 employees across hundreds of chapters around the world. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which reminds team members to seek diverse perspectives, learn and be curious, and earn trust. Flexibility It isn’t about which hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We offer flexibility and encourage you to find your own balance between your work and personal lives. Mentorship & Career Growth We care about your career growth too. Whether your goals are to explore new technologies, take on bigger opportunities, or get to the next level, we'll help you get there. Our business is growing fast and our people will grow with it.
US, CA, Santa Clara
Job summaryAmazon’s Middle Mile Planning Research and Optimization Science group (mmPROS) is looking for a Senior Applied Scientist specializing in design and evaluation of algorithms for predictive modeling and optimization applied to large-scale transportation planning systems. This includes the development and implementation of pricing & yield management (PYM) solutions using stochastic concepts to improve transportation planning solutions. Middle Mile Air and Ground transportation represents one of the fastest growing logistics areas within Amazon. Amazon Fulfillment Services transports millions of packages via air and ground and continues to grow year over year. The scale of this operation challenges Amazon to design, build and operate robust transportation networks that minimize the overall operational cost while meeting all customer deadlines. The Middle Mile Planning Research and Optimization Science group is charged with developing an evolving suite of decision support and optimization tools to facilitate the design of efficient air and ground transport networks, optimize the flow of packages within the network to efficiently align network capacity and shipment demand, set prices, and effectively utilize scarce resources, such as aircraft and trucks. Time horizons for these tools vary from years and months for long-term planning to hours and minutes for near-term operational decision making and disruption recovery. These tools rely heavily on mathematical optimization, stochastic simulation, meta-heuristic and machine learning techniques. In addition, Amazon often finds existing techniques do not effectively match our unique business needs which necessitates the innovation and development of new approaches and algorithms to find an adequate solution.As a Senior Applied Scientist responsible for middle mile transportation, you will be working closely with different teams including business leaders and engineers to design and build scalable products operating across multiple transportation modes. You will create experiments and prototype implementations of new learning algorithms and prediction techniques. You will have exposure to top level leadership to present findings of your research. You will also work closely with other scientists and also engineers to implement your models within our production system. You will implement solutions that are exemplary in terms of algorithm design, clarity, model structure, efficiency, and extensibility, and make decisions that affect the way we build and integrate algorithms across our product portfolio.