Abstract
This paper introduces Meta-Q-Learning (MQL), a new off-policy algorithm for meta-Reinforcement Learning (meta-RL). MQL builds upon three simple ideas. First, we show that Q-learning is competitive with state-of-the-art meta-RL algorithms if given access to a context variable that is a representation of the past trajectory. Second, a multi-task objective to maximize the average reward across the training tasks is an effective method to meta-train RL policies. Third, past data from the meta-training replay buffer can be recycled to adapt the policy on a new task using off-policy updates. MQL draws upon ideas in propensity estimation to do so and thereby amplifies the amount of available data for adaptation. Experiments on standard continuous-control benchmarks suggest that MQL compares favorably with the state of the art in meta-RL.

Github: https://github.com/amazon-research/meta-q-learning
Research areas
Download

View from space of a connected network around planet Earth representing the Internet of Things.
Get more from Amazon Science
Sign up for our monthly newsletter

Work with us

See more jobs
US, WA, Seattle
The Amazon Devices organization designs, produces and markets Kindle e-readers, Fire Tablets, Fire TV Streaming Media Players and Echo Speakers, and is constantly looking to innovate on behalf of customers with new devices in existing or new categories or improving the customer experience on existing platforms. The Devices Customer Behavior team provides customer engagement support to the broader organization for Kindle, Fire, Echo, and emerging products – established and emerging countries, worldwide.We are looking for an innovative, hands-on and customer-obsessed Data Scientist who can be a strategic partner to the product managers and engineers on the team.Our projects span multiple organizations and require coordination of experimentation, economic and causal analysis, forecasting, and predictive machine learning tools. This Data Scientist role is responsible for building quantitative systems and predictive models that are critical inputs to Amazon’s financial and operational planning. A successful candidate will be a problem solver who enjoys diving into data, is excited by difficult modeling challenges, is motivated to build something that will eventually become a production software system, and possesses strong communication skills to effectively interface between technical and business teams.In this role, you will be a technical expert with massive impact. You will take the lead on developing our forecasting technology for key Devices metrics. Your work will directly impact the success of Amazon's growing Devices business. You will work across diverse science/engineering/business teams. You will work on critical data science problems, building high quality, reliable, accurate, and consistent code sets that are aligned with our business needs.Key Performance Areas· Implement statistical or machine learning methods to solve specific business problems.· Improve upon existing methodologies by developing new data sources, testing model enhancements, and fine-tuning model parameters.· Directly contribute to development of modern automated forecasting systems· Build customer-facing reporting tools to provide insights and metrics which track forecast performance and explain variance· Collaborate with researchers, software developers, and business leaders to define product requirements, provide analytical support, and communicate feedback
US, WA, Seattle
Amazon’s Automated Inventory Management (AIM) team is looking for passionate, hard-working, and talented individuals to join our fast paced, stimulating environment to invent the future of business ownership with Technology.The AIM team is part of the Supply Chain Optimization Technology (SCOT) Team within the Operations Organization. The charter of the SCOT team is to maximize Amazon’s return on our inventory investment in terms of Free Cash Flow and customer satisfaction. We accomplish this by determining how much inventory Amazon needs of each SKU and what to do if we have too much. This puts the Inventory Planning group at the nexus of operations, logistics, capacity planning, and our retail business teams.As a Senior Data Scientist on the AIM team, you will research and develop long range forecasting models and solve real world problems using the latest machine learning techniques. You will research new modelling techniques that can discover and interpret causal effects in our supply chain systems at scale. You will work closely with senior business leaders, product managers and engineers to build innovative scientific solutions that impact millions of inventory decisions each day.Key responsibilities:· Implement statistical and machine learning methods to forecast system behavior and solve complex business problems· Research new ways to improve predictive and explanatory models· Directly contribute to the design and development of automated prediction systems and ML infrastructure· Build models that can detect supply chain defects and explain variance to the optimal state· Collaborate with other researchers, software developers, and business leaders to define the scientific roadmap for this teamTo help describe some of our challenges, we created a short video about Supply Chain Optimization at Amazon - http://bit.ly/amazon-scotAmazon is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation / Age
US, NY, New York
Amazon Advertising is one of Amazon's fastest growing and most profitable businesses. The Global Advertising Partner Development team within Advertising helps suppliers, agencies, marketers, authors, content creators, designers, non-endemic advertisers and developers to scale their use of Amazon Advertising and grow their business by surfacing a diverse selection of products to millions of worldwide Amazon customers. We do this via software tools and marketing/engagement programs that enable developers (internal and external) and partners (agencies and tool providers) to better serve advertiser needs.We are looking for a senior applied scientist capable of using statistical and machine learning techniques to create state-of-the-art solutions for non-trivial, and arguably, unsolved problems. If you are results driven, interested in how to apply advanced machine learning and causal analysis techniques, love to work with advertising, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact our customers, we want to talk to you.Key responsibilities include:· Partnering with economists, scientists, developers, and senior team members to drive a new science agenda for causal analysis and ML in advertising.· Driving applied science projects end-to-end: from ideation, analysis, prototyping, development, metrics, and monitoring.· Providing technical leadership, researching new approaches to drive continued scientific innovation.· Presenting results, reports, and data insights to both technical and business leadership.· Build machine learning models and utilize data analysis to deliver scalable solutions to business problems.· Run A/B experiments, gather data, and perform statistical analysis.· Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving.· Work closely with software engineers on detailed requirements, technical designs and implementation of end-to-end solutions in production· Research new machine learning approaches.Why you love this opportunityAmazon is investing heavily in building a world-class advertising business. We are responsible for defining and delivering a collection of self-service performance advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long-term growth. We deliver billions of ad impressions and millions of clicks daily and break fresh ground to create world-class products. We are highly motivated, collaborative, and fun-loving team with an entrepreneurial spirit. With a broad mandate to experiment and innovate.Impact and Career GrowthYou will invent new shopper and advertiser experiences and influence customer-facing shopping experiences to help suppliers grow their retail business and the auction dynamics that leverage native advertising; this is your opportunity to work within the fastest-growing businesses across all of Amazon. Define a long-term science vision for our advertising business, driven fundamentally from our customers' needs, translating that direction into specific plans for research and applied scientists, as well as engineering and product teams. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding.Team video https://youtu.be/zD_6Lzw8raE
US
Excited by using massive amounts of data to develop Machine Learning (ML) and Deep Learning (DL) models? Want to help the largest global enterprises derive business value through the adoption of Artificial Intelligence (AI)? Eager to learn from many different enterprise’s use cases of AWS ML and DL? Thrilled to be key part of Amazon, who has been investing in Machine Learning for decades, pioneering and shaping the world’s AI technology?At Amazon Web Services (AWS), we are helping large enterprises build ML and DL models on the AWS Cloud. We are applying predictive technology to large volumes of data and against a wide spectrum of problems. Our Professional Services organization works together with our AWS customers to address their business needs using AI.AWS Professional Services is a unique consulting team. We pride ourselves on being customer obsessed and highly focused on the AI enablement of our customers. If you have experience with AI, including building ML or DL models, we’d like to have you join our team. You will get to work with an innovative company, with great teammates, and have a lot of fun helping our customers.A successful candidate will be a person who enjoys diving deep into data, doing analysis, discovering root causes, and designing long-term solutions. It will be a person who likes to have fun, loves to learn, and wants to innovate in the world of AI.Responsibilities:· Understand the customer’s business need and guide them to a solution using our AWS AI Services, AWS AI Platforms, AWS AI Frameworks, and AWS AI EC2 Instances .· Assist customers by being able to deliver a ML / DL project from beginning to end, including understanding the business need, aggregating data, exploring data, building & validating predictive models, and deploying completed models to deliver business impact to the organization.· Use Deep Learning frameworks like MXNet, Caffe 2, Tensorflow, Theano, CNTK, and Keras to help our customers build DL models.· Use SparkML and Amazon Machine Learning (AML) to help our customers build ML models.· Work with our Professional Services Big Data consultants to analyze, extract, normalize, and label relevant data.· Work with our Professional Services DevOps consultants to help our customers operationalize models after they are built.· Assist customers with identifying model drift and retraining models.· Research and implement novel ML and DL approaches, including using FPGA.This is a customer facing role. You will be required to travel to client locations and deliver professional services when needed.
US, CA, Palo Alto
The Amazon Search team creates powerful, customer-focused search solutions and technologies. Whenever a customer visits an Amazon site worldwide and types in a query or browses through product categories, Amazon Product Search services go to work. We design, develop, and deploy high performance, fault-tolerant distributed search systems used by millions of Amazon customers every day. Our Search Relevance team works to maximize the quality and effectiveness of the search experience for visitors to Amazon websites worldwide.The Search Relevance team focuses on several technical areas for improving search quality. In this role, you will invent universally applicable signals and algorithms for training machine-learned ranking models. The relevance improvements you make will help millions of customers discover the products they want from a catalog containing millions of products. You will work on problems such as predicting the popularity of new products, developing new ranking features and algorithms that capture unique characteristics, and analyzing the differences in behavior of different categories of customers. The work will span the whole development pipeline, including data analysis, prototyping, A/B testing, and creating production-level components.Joining this team, you’ll experience the benefits of working in a dynamic, entrepreneurial environment, while leveraging the resources of Amazon.com (AMZN), one of the world’s leading Internet companies. We provide a highly customer-centric, team-oriented environment in our offices located in Palo Alto, California.
US, WA, Seattle
At Amazon, we are the most customer-centric company on earth. If you'd like to help us build the place to find and buy anything online, this is your chance to make history. To get there, we need exceptionally talented, bright, and driven people. We are looking for a dynamic, organized self-starter to join as an Applied Scientist II for Promise Optimization.The Promise Optimization team seeks to identify the optimal delivery option for whatever a customer wants. We believe that finding an optimal promise and living up to it consistently improves our customer experience because we increase customer's confidence and trust in Amazon as the one, best option to get what you want, when you want it.As the applied scientist for Promise Optimization, you will be responsible for building and productionizing machine learning models to answer predictive questions and lead efforts to scale, automate, and productionize statistical models on the impact of delivery speed on customer behavior. You will work with a diverse scientific team including software engineers, economists, and data engineers.Within predictive analytics, you will develop and implement a missed promise prediction model in production software. This model will inform supply chain systems on the risk of late shipments throughout the order lifecycle, unlocking the ability for fulfillment execution risk to be known and addressed from promise through fulfillment. Other predictive questions you may address involve predicting shipment consolidations and customer contacts following missed promises. In each case, you will balance analytical rigor with pragmatism, focusing on delivering value for the business question at hand.As our team’s work on estimating the value of delivery speed is incorporated in production software worldwide, you will work with economists to scale and automate statistical models using big data technologies such as Spark and EMR. Your expertise will be used to instruct researchers on using these same technologies, helping to leverage scarce research headcount. You will be a standard bearer on engineering best practices for production models and serve as a technical liaison to the software engineers whose systems depend on our models.Responsibilities include:· Working with economists, BIEs, DEs, and SDEs to design, test, implement, and support predictive and operations research optimization models in production software environments· Ensuring that production models are robust, scalable, and address business and software engineering requirements· Using big data and AWS technologies to scale, automate, and productionize core statistical models and enable rapid deployment of refreshed models, as well as instructing other researchers on the use of these tools· Recognizing and adopting best practices in analysis, data and model integrity, test design, validation, and documentationAmazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation
US, WA, Seattle
At Amazon we strive to be the most innovative and customer centric company on the planet. Come work with us while we are developing our Transportation Technology to deliver the best solutions for our vendors, warehouses and carriers. Help us solve complex problems impacting billions of dollars per year while partnering with world class scientists.Our mission is to build the most efficient and optimal transportation solution on the planet. We aim to leverage cutting edge technologies in big data, machine learning, and optimization techniques, and operate high volume, low latency, and high availability services.You’ll design, model, develop and implement state of the art systems and solutions used by Amazon worldwide and will regularly interact with engineering and business leadership. You will participate in the planning and execution of technology projects and operational excellence initiatives.Tasks/ Responsibilities:· · Partnership with the engineering and operations to drive modeling and design for complex business problems.· · Design and prototype decision support tools (product) to automate standardized processes and optimize trade-offs across the full decision space.· · Contribute to the mid- and long-term strategic planning studies and analysis.· · Lead complex transportation modeling analyses to aid management in making key business decisions and set new policies.· Amazon is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation / Age This critical role requires an aptitude for taking quick initiative, thinking big, and delivering results to drive innovation in transportation modeling and optimization across Amazon’s expanding global network. You will also have the opportunity to work with some of the leading scientists in the areas of meta-heuristics, routing optimization and machine learning.
US, WA, Seattle
We are looking for a strategic, innovative science leader within Amazon Fulfillment Technology organization to lead an interdisciplinary team charged with developing new, data-driven solutions to model, optimize and automate decisions, while applying computer vision, machine learning & robotics to simplify operations in our rapidly growing fulfillment network.Amazon Fulfillment Technologies (AFT) powers the physical engine at the heart of Amazon. AFT builds and operates software, hardware, and the processes that run the global network of fulfillment centers that move billions of units of inventory, employ tens of thousands of people, and ensure that customers get what they want when promised. We do this by building automated solutions to handle things that technology does well, while relying on people to handle things that humans do well.In this role you will lead multiple Research teams across the disciplines of Operations Research, Computer Vision, Machine Learning, Forecasting & Hardware prototyping. You will interface with multiple business leaders and help develop a strategic research roadmap partnering with engineering leaders across different organizations to deliver the research in production.Successful candidates will have an established background in data-driven research and experience in managing technical expertise in the field of science, engineering, and proven track record of managing and delivering mission critical large scale programs in areas such as: Supply Chain Management, Economics, Optimization, Operations Research, Computer Vision, and Machine learning.
US, VA, Arlington
Amazon Region Services team is looking for a Data Scientist to lead the research and thought leadership to drive our data and insights strategy for Amazon Region Services. We develop sophisticated algorithms that involve learning from large amounts of data. You will be responsible for researching, experimenting and analyzing predictive and optimization models.You will provide to engineers, direction on technology strategy in data management, insights and Machine learning that will form the nucleus of providing data and insights as a service to our customers. You will work on ambiguous and complex business and research science problems with large opportunities.You are an individual with outstanding analytical abilities and comfortable working with cross-functional teams and systems. You must be a self-starter and be able to learn on the go. Excellent written and verbal communication skills are required as you will work very closely with diverse teams.Key Responsibilities:· · Interact with business and software teams to understand their business requirements and operational processes· Frame business problems into scalable solutions· Adapt existing and invent new techniques for solutions· Create and track accuracy and performance metrics· Gather data required for analysis and model building· Prototype models by using high-level modeling languages such as R or in software languages such as Python. A software team will be working with you to transform prototypes into production.· Interview, mentor, and develop scientists and engineers across the organization· Create, enhance, and maintain technical documentationHere at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and we host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.We are dedicated to supporting our new team members. Our team has a broad mix of experience levels and Amazon tenures, and we’re building an environment that celebrates knowledge sharing and mentorship.Our team also puts a high value on work-life balance. Striking a healthy balance between your personal and professional life is crucial to your happiness and success here, which is why we aren’t focused on how many hours you spend at work or online. Instead, we’re happy to offer a flexible schedule so you can have a more productive and well-balanced life—both in and outside of work.This position requires that the candidate selected be a US Citizen.
US, MA, Cambridge
Amazon is looking for a passionate, talented, and inventive Machine Learning Scientist with a strong machine learning background to help build industry-leading Alexa Speech and Language technology. Our mission is to push the envelope in Deep Learning, Automatic Speech Recognition (ASR) and Natural Language Processing (NLP), in order to provide the best-possible experience for our customers.Our Machine Learning Scientists, work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art in spoken language. Your work will directly impact our customers in speech and language technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in spoken language understanding. Candidates can work in Cambridge MA, Seattle WA or Sunnyvale CA.
US, CA, Sunnyvale
Amazon is looking for a passionate, talented, and inventive Applied Scientist to help build industry-leading Speech and Language technology. Our mission is to push the envelope in Automatic Speech Recognition (ASR), Natural Language Understanding (NLU), and Audio Signal Processing, in order to provide the best-possible experience for our customers.As a Speech and Language Scientist, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art in spoken language understanding. Your work will directly impact our customers in the form of novel products and services that make use of speech and language technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in spoken language understanding. You will mentor junior scientists, create and drive new initiatives.We are hiring in all areas of spoken language understanding: ASR, NLU, text-to-speech (TTS), and Dialog Management.
US, WA, Seattle
Are you inspired by building new technologies to benefit customers? Do you dream of being at the forefront of and system technology? Would you enjoy working in a fast paced, highly collaborative, start-up like environment? If you answered yes to any of these then you've got to check out the Amazon Scout team.We’ve been hard at work developing a new, fully-electric delivery system – Amazon Scout – designed to get packages to customers using delivery devices. These devices were created by Amazon, are the size of a small cooler, and roll along sidewalks at a walking pace. We developed Amazon Scout at our research and development lab in Seattle, ensuring the devices can safely and efficiently navigate around pets, pedestrians and anything else in their path.The Amazon Scout team shares a passion for innovation using advanced technologies, a love of solving complex challenges, and a desire to impact customers in a meaningful way. We're looking for individuals who like dealing with ambiguity, solving hard, large scale problems, and working in a startup like environment. To learn more about Amazon Scout, check out our Amazon Day One Blog post here: http://amazon.com/scoutCome build the future with us.Duration: 3 monthsKey Job ResponsibilitiesAs a Science Intern, you will work from concept through to execution. This role will give you the opportunity to build tools and support structures needed to analyze, dive deep to resolve root cause of systems errors and changes, and present findings to business partners to drive improvements.Amazon Scout is currently targeting PhD interns who specialize in Computer Vision, Perception, Deep Learning, Simulation, Navigation, and Localization.
US, WA, Seattle
The Amazon Device and Services Design Group (DDG) creates revolutionary products used by millions of customers around the world every day - including Echo, Fire TV, Alexa Communications, and more. Within DDG, the DDG Research team is one of the behind-the-scenes teams that enables Amazon’s Devices’ leaders to make informed decisions based on sound mixed-method research and analytics. We are seeking an exceptional Research Scientist to join our team to help us derive insights that serve our customers. If you are inquisitive, passionate about how research can improve decision making, enjoy weaving data into a telling story, and like your research to have real world impact, we want you on our team.As a successful Research Scientist, you:· Are enthusiastic about collaborating with a cross-functional team of UX designers, researchers (qualitative and quantitative), business partners, design technologists, and developers to provide actionable insights.· Demonstrate excellent statistical skills and are excited about learning new methods.· Are naturally curious about people, especially their motivations, attitudes, and behaviors.· Excel when interacting with business and technical partners whether you are chatting, sending a written message, writing a technical report, or conducting a presentation.· Enjoy working with stakeholders to define their key business needs and deliver on those commitments.· Innovate on behalf of your customers by proactively implementing improvements and taking steps to address challenges that they had not yet identified.· Are drawn to ambiguous, complex problems.· Surface and question both your own and others’ underlying assumptions.· Persuade decision makers at all levels of the organization to take aligned action on research findings – inspire and help them internalize opportunities to delight our customers and differentiate our service.· Define, execute, and invent research methods appropriate to the questions at hand, including but not limited to field research, surveys, lab studies, remote testing, and A-B tests.
US, WA, Seattle
Are you excited about powering Amazon’s physical stores’ expansion through economic models? Do you thrive in a fast-moving, innovative environment that values data-driven decision making and sound scientific practices? We are looking for PhD Economists to build the next level of economic models that will help Amazon physical stores grow and succeed.Our team is responsible for building the core intelligence, insights, and algorithms that support the real estate acquisition strategies for Amazon physical stores. We are tackling cutting-edge, complex problems such as predicting the optimal location for new Amazon stores by bringing together numerous data assets from disparate sources inside and outside of Amazon, and using best-in-class modelling solutions to extract the most information out of them.You will have a proven track-record of delivering measurable benefit to business through strategic analysis, model building, and/or development of new software. You will be comfortable handling complex economic problems and making the right modeling tradeoffs by applying strong economic reasoning. You will be able to break down complex information and insights into clear and concise language and be comfortable presenting your findings to audiences with a broad range of backgrounds.Amazon is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation.
US, MA, North Reading
Robotics Applied Scientist Intern (Westborough, North Reading MA)Are you a MS or PhD student interested in the fields of Computer Vision, Robotics, Machine Learning and Deep Learning and capable of diving deep into hard technical problems and coming up with insightful solutions that enable successful products? Are you unafraid of taking on a mind-bending challenge that really will improve peoples' lives in a meaningful way? Would you love to get access to large datasets with billions of images and video to build large-scale machine learning systems? Are you a finisher who can deliver robust, production-quality code that solves complex, real-world problems in ways that delight customers?If this describes you, come join the Computer Vision teams at Amazon Robotics. Our teams are using computer vision, machine learning, and real-time and distributed systems to create solutions for problems that impact millions of people. A Computer Vision Scientist at Amazon Robotics will translate business and functional requirements into quick prototypes or proofs of concept. Comfort with a high degree of ambiguity and ability to solve problems that haven’t been solved to scale before are essential.Amazon Robotics is seeking talented and motivated interns to develop solutions for controling and optimizing mobile-robotic fulfillment systems used by Amazon.com operations. Our problems span autonomous movement, object identification, grasping, path planning, and action understanding. This position will report to the Amazon Robotics functional manager most closely aligned with the candidate’s skillset and project work. Each intern will have an assigned technical mentor throughout the internship, as well as 1-1 guidance from their manager, and will work closely with other engineers.Amazon Robotics internship opportunities will be based virtually or in the Greater Boston Area, in our two state-of-the-art facilities in Westborough and North Reading, MA. Both campuses provide a unique opportunity for interns to have direct access to robotics testing labs and manufacturing facilities.Amazon internships are full-time (40 hours/week) for 12 or more consecutive weeks with start dates between May and June 2021.
US, NY, New York
Amazon is building a world class advertising business and defining and delivering a collection of self-service performance advertising products that drive discovery and sales of merchandise. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and millions of clicks daily and are breaking fresh ground to create world-class products. We are highly motivated, collaborative and fun-loving with an entrepreneurial spirit and bias for action. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities.Sponsored Products helps merchants, retail vendors, and brand owners succeed via native advertising that grows incremental sales of their products sold through Amazon. The Sponsored Products Ad Marketplace organization optimizes the systems and ad placements to match advertiser demand with publisher supply using a combination of machine learning, big data analytics, ultra-low latency high-volume engineering systems, and quantitative product focus. Our systems and algorithms operate on one of the world's largest product catalogs, matching shoppers with products - with a high relevance bar and strict latency constraints. Our goals are to help buyers discover new products they love, be the most efficient way for advertisers to meet their business objectives, and to build a major, sustainable business that helps Amazon continuously innovate on behalf of all customers.As an Applied Scientist for the Sponsored Products Detail Page Allocation and Pricing team, you develop systems which make the final decision on which ads to show, where to place them on the page and how many ads to place. This also includes selection of various themes that would appear in detail pages. This is a challenging technical and business problem, which requires us to balance the interests of advertisers, shoppers, and Amazon. You'll develop a data-driven product strategy to define the right quantitative measures of shopper impact, using this to evaluate decisions and opportunities. You'll balance a portfolio of pragmatic and long-term investments to drive long term growth of the ads and retail businesses. You'll develop real-time algorithms to allocate billions of ads per day in advertising auctions.Job Responsibilities:· Build machine learning models and utilize data analysis to deliver scalable solutions to business problems.· Run A/B experiments, gather data, and perform statistical analysis.· Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving.· Work closely with software engineers on detailed requirements, technical designs and implementation of end-to-end solutions in production.· Research new machine learning approaches.Impact and Career Growth:In this role you will have significant impact on this team as well as drive cross team projects that consist of Applied Scientists, Data Scientists, Economists, and Software Development Engineers. This is a highly visible role that will help take our products to the next level. You will work alongside many of the best and brightest science and engineering talent and the work you deliver will have a direct impact on customers and revenue!Why you love this opportunity:Amazon is investing heavily in building a world class advertising business and we are responsible for defining and delivering a collection of self-service performance advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and millions of clicks daily and are breaking fresh ground to create world-class products. We are highly motivated, collaborative and fun-loving with an entrepreneurial spirit and bias for action. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities.Team video ~ https://youtu.be/zD_6Lzw8raE
US, NY, New York
Amazon is looking for a passionate, talented, and inventive Applied Scientists with a strong machine learning background to help build industry-leading Speech and Language technology.Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Automatic Speech Recognition (ASR), Machine Translation (MT), Natural Language Understanding (NLU), Machine Learning (ML) and Computer Vision (CV).As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop novel algorithms and modeling techniques to advance the state-of-the-art in human language technology. Your work will directly impact millions of our customers in the form of products and services that make use of speech and language technology. You will gain hands on experience with Amazon’s heterogeneous speech, text, and structured data sources, and large-scale computing resources to accelerate advances in spoken language understanding.We are hiring in all areas of human language technology: ASR, MT, NLU, text-to-speech (TTS), and Dialog Management, in addition to Computer Vision.Inclusive Team CultureHere at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences.Work/Life BalanceOur team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.Mentorship & Career GrowthOur team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.
US, MA, North Reading
Are you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Robotics. We are a smart team of doers that work passionately to apply cutting edge advances in robotics and software to solve real-world challenges that will transform our customers’ experiences in ways we can’t even imagine yet. We invent new improvements every day. We are Amazon Robotics and we will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling and fun.We are looking for world-class scientists and engineers to explore new ideas, invent new approaches, and develop new solutions.If you have expertise in Computer Vision, with extensive industry experience and have:· the ability to think big and conceive of new ideas and novel solutions;· the insight to correctly identify those worth exploring;· the hands-on skills to quickly develop proofs-of-concept;· the rigor to conduct careful experimental evaluations;· the discipline to fast-fail when data refutes theory;· and the fortitude to continue exploring until your solution is foundcome join us to invent the future and change the world.
CA, ON, Toronto
Alexa is the name of the Amazon cloud-based voice service that powers the Echo, Echo Dot, Echo Show and more. Just ask Alexa for information, music, news, weather, and more. And now you can send a message, make a call, play announcements, or drop in on your closest friends & family via Alexa devices or the Alexa app!It’s still Day One for the Alexa Communications team – we have a lot to innovate and build to make communication through Alexa devices a magical experience. We’re working hard, having fun, and making history; come join us! The Alexa communications team is working to become the most natural way for people to communicate, and the challenge ahead is significant. We're a high energy, fast growth business excited to have the opportunity to define the future of voice-controlled communications, make Alexa even more useful, and delight customers around the world.We are seeking talented Audio DSP Engineers to join our Comms Media teams. These teams provide the mechanisms and services that allow our Customers to connect and communicate with each other around the world. In this role you will have an enormous opportunity to make a large impact on the design, architecture, and implementation of cutting edge products used every day, by people you know.The ideal candidate will be passionate about an opportunity to build elegant systems in the most efficient ways, pushing the limits of current technology and challenging the status quo.Key responsibilities include:· Develop and launch core product features· Influence our overall strategy by helping define product features, drive the system architecture, and spearhead the best practices that enable a quality product· Create world class software and Alexa experiences· Interact with cross-functional engineering teams across the company· Dive into and take ownership of mission critical software puzzles· Participate in and drive design reviews· Contribute significantly to key communications quality of Alexa· Innovate, prototype, and create new technology· Design and architect a highly performant, critical application at large scale· Work in an Agile environment to deliver high quality software
US, WA, Seattle
Customer Trust & Partner Support (CTPS) is responsible for creating a trustworthy shopping experience across Amazon stores worldwide by protecting customers, brands, selling partners and Amazon from fraud, counterfeit, and abuse as well as empowering, providing world‐class support, and building loyalty with Amazon’s millions of selling partners. We value individual expression, respect different opinions, and work together to create a culture where each of us is able to contribute fully. Our unique backgrounds and perspectives strengthen our ability to achieve Amazon's mission of being Earth's most customer-centric company.Amazon’s Account Integrity team within the Customer Trust and Partner Support organization is looking for a passionate, results-oriented Senior Data Scientist to leverage data to drive delivery of projects with huge strategic impact. This team designs and builds high performance systems using machine learning that identify and prevent fraudulent activity and maintain high trust levels with our customers. Fraud prevention is a real-money game where our data science and analytics teams strive to outsmart those who attempt to defraud Amazon and our customers.As a Senior Data Scientist in the Account Integrity group, you will work directly with ML Scientists, Software Development Engineers and Product Managers to monitor the flavor/trend of fraud worldwide and create appropriate solutions to detect and mitigate fraud in a collaborative environment.Successful candidates will have broad expertise in a variety of data science disciplines, including both supervised and unsupervised learning methods, strong analytical skills, be detail oriented, and have excellent problem solving abilities. He/she should also have a demonstrated ability to think strategically and analytically about business, product, and technical challenges, with the ability to work cross-functionally.Roles and Responsibilities:1. Use statistical and machine learning techniques to create scalable detection systems.2. Analyze and extract relevant information from large amounts of Amazon's historical business data to help automate and optimize key processes.3. Design, development and evaluation of highly innovative models for predictive learning.4. Work closely with software engineering and ML teams to drive real-time model implementations and new feature creations.5. Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation.6. Play the role of tech lead on the data science team, mentor fellow scientists.