Garrett van Ryzin
Garrett van Ryzin joined Amazon's Supply Chain Optimization Technologies organization in August as a distinguished scientist.
Credit: Jesse Winter/Cornell University

How distinguished scientist Garrett van Ryzin is optimizing his time at Amazon

van Ryzin is focusing on driving innovations in areas ranging from inventory management to last-mile delivery.

Amazon announced in August 2020 that Garrett van Ryzin would be joining the company’s Supply Chain Optimization Technologies (SCOT) organization as a distinguished scientist. SCOT is responsible for designing, building, and operating the Amazon supply chain. SCOT systems manage inventory for the millions of items on Amazon, compute accurate delivery expectations for customer orders, and drive meaningful changes to Amazon’s fulfillment center network so that customers receive their packages in the most efficient way possible.

Prior to Amazon, van Ryzin was a professor of Operations, Technology and Information Management at Cornell Tech, and previously the Paul M. Montrone Professor of Decision, Risk, and Operations at the Columbia University Graduate School of Business.  His university research work has focused on algorithmic pricing, demand modeling, and stochastic optimization.

van Ryzin was also the head of marketplace optimization at ridesharing companies Lyft and Uber, where he led teams that developed models for a variety of functions, such as optimally dispatching drivers to riders, and developing pricing models and driver pay systems that improve market efficiency. Interestingly, van Ryzin’s paper that he wrote while pursuing his PhD at MIT “A Stochastic and Dynamic Vehicle Routing Problem in the Euclidean Plane” imagined a world of on-demand transportation as far back as 1991.

During his career, van Ryzin’s work on complex revenue management problems has enabled businesses across diverse industry sectors to get the most out of their limited capacity. To give just a few examples, van Ryzin’s research has enabled airlines to make a series of large-scale, dynamic and sequential decisions to determine the optimal price of a ticket at a particular moment in time. Retail companies have used similar dynamic optimization to manage inventory levels and prices for different products to maximize revenue.

What I find particularly interesting are problems that move beyond the constraints of optimizing within the system, to actually redesigning the system itself. 
Garrett van Ryzin

However, at Uber and Lyft van Ryzin tackled a new business environment, where revenue maximization wasn’t the primary goal. Instead, van Ryzin’s teams focused on optimizing more immediate metrics that were vital to the very survival of their services: service reliability, driver productivity, and growth.

For example, having a sufficient number of idle drivers at any given time is critical to maintaining throughput in ridesharing services. Surge pricing, a mechanism that van Ryzin’s team at Uber optimized, maintains an efficient level of idle drivers and encourages more drivers to get on the street during peak hours when they are needed the most.

van Ryzin sees technology-enabled service providers — be it at a ridesharing company like Lyft or the Fulfilled by Amazon (FBA) service — as transformational.  Only a few decades ago, businesses like these weren’t viable ways to organize service delivery due to high transaction costs and lack of real-time information. However, technology has radically improved information exchange and reduced transaction costs, which allows independent sellers to sell their products on Amazon much more efficiently than they could on their own.

In this interview, van Ryzin spoke about the different facets of market optimization, the intricacies of making automated decisions at scale, managing system complexity using approximation and decomposition ideas, and why he joined Amazon.

Q. What are the different elements of optimization?

I’d like to think of optimization being made up of human, technical and operational elements.

At a human level, the understanding of behavioral economics is absolutely critical. You have to create the right incentives for both suppliers and buyers to drive efficiencies. This is especially important for companies like Amazon that have many buyers and sellers participating and a high degree of decentralized activity. 

In addition to the human considerations, you also must develop a deep understanding of the technical elements of how these marketplaces work – the capabilities and limitation of the technology – which in turn allows you to gain insights into what structural changes are possible.

Finally, building services like Amazon that provide physical goods and services is a much more complicated endeavor than developing a service for trading virtual entities like stocks or mutual funds. To give just one example, at Amazon we are shipping actual, physical goods. This means the underlying physics of the infrastructure and the different operational elements are critical. So you must also think about your service in terms of factors like product weight and size, labor requirements, storage capacity, inventory levels, and lead times.

From a scientific perspective, there are several open questions in all three elements of market optimization. A fundamental one is determining the best approach to take to develop models to drive efficiency.

One approach is to develop structural models from first principles. For example, you could make an assumption that consumers are utility maximizers, develop a utility function and identify the parameters that constitute this utility function.

Garrett van Ryzin (vertical)
Garrett van Ryzin, Amazon distinguished scientist

You could also take a radically different approach and build models based only on the underlying data – where you draw inferences from what the data alone tells you. Here, you’re not worrying about why something happened. Rather, you can use ideas from machine learning to estimate and refine predictive models without trying to understand the underlying mechanics.

What I find particularly interesting are problems that move beyond the constraints of optimizing within the system, to actually redesigning the system itself.  The ‘Wait and Save’ feature my group developed at Lyft is a good example. This product allows riders to opt into waiting for ten to fifteen minutes for a ride rather than having all rides be on-demand. In exchange for waiting, riders get a lower price. On the technology side, what we are doing here is actually changing the product in order to make the marketplace more efficient. I’ve always found there’s a lot more leverage in changing a system rather than optimizing within a fixed system.  It’s a lot trickier though because big structural changes often mean you have to get users comfortable with entirely new products or a completely new way of using the system.

Q. How do you account for the uncertainty and complexity inherent in large systems?

Approximation is at the heart of optimization because you can never fully represent the full complexity of a real-world trading system. For example, if a consumer places an order on Amazon, you have to make several sequential decisions with complex interactions.  Which fulfillment center should I take that order from? Should I place the items in the same box or should I pack them in different boxes? How will fulfilling this order impact the availability of inventory for the next order that comes in for that product? And how will it affect the available capacity of my local delivery assets?

You can develop approximation models by using a rolling horizon approach. This involves taking a best guess for what the future entails, and then updating your estimate for the future as and when you get new information. Or you could do something that’s far more sophisticated: build simulations of the future, and use sampling techniques to guide your decisions. You can also utilize reinforcement learning where you fit value functions to historical actions to arrive at decisions that are continually refined based on data.

Decomposition is also an important strategy for dealing with the interconnectedness of the different elements of the system. In large systems such as Amazon, everything is related to everything else. Supply affects costs, which affects pricing, which in turn affects demand, which affects dispatch, and so on. Ideally, you’d want to arrive at decisions by taking the whole system into account. However, the size of any real-world system makes this impossible. Any model you arrive at will be too complex, and you’d require a large amount of time to compute anything reasonable.

I’ve always been attracted to the idea of helping drive innovations to get people the basic, physical necessities that are essential to how they live.
Garrett van Ryzin

This is where decomposition comes in. You can break the system down into individual components – such as dispatch models, pricing models, inventory models and so on. The challenge here is to get these different models to collaborate. You don’t want scenarios where they are working at cross purposes with each other. For example, you don’t want one model trying to get rid of an item and have another model actively trying to replace it. In cases like these, you can drive coordination between different models using an internal price or some other mechanism that’s common to all the models.

These are just some of the trickiest issues in optimization, and I’m excited to be at Amazon where a lot of the innovation in these areas is taking place.

Q. Why did you decide to join Amazon?

I’ve always admired Amazon as a company because of its incredible track record of innovation across so many areas. I remember shopping at Amazon when they just sold books. And today, you have Amazon Studios, AWS, Amazon Devices, Alexa and even Project Kuiper where Amazon is putting up over 3,000 satellites in space.

Amazon is a company that excels at understanding economic opportunity and then building products and services that customers value. I’ve only been here for a few months, but I can already see how the company’s unique culture helps it be so successful across so many areas.

I also admire the company’s long-term perspective. Amazon doesn’t make decisions based on driving quarter-over-quarter performance. Amazon is willing to stick with ideas for many years. This appeals to me as a scientist as in my experience, sticking with the right idea over the long term is essential to making fundamental breakthroughs.

At SCOT, I’m excited to have the opportunity to contribute across so many areas, from FBA to last-mile delivery. Over the last few months, Amazon has helped so many people across the world get essential items during the pandemic. I’ve always been attracted to the idea of helping drive innovations to get people the basic, physical necessities that are essential to how they live.


Work with us

See More Jobs
US, WA, Seattle
Amazon is focused on protecting the health and safety of our employees while continuing to serve people who need our services more than ever. Regular testing on a global scale across all industries would both help keep people safe and help get the economy back up and running. But, for this to work, we as a society would need vastly more testing capacity than is currently available. Unfortunately, today we live in a world of scarcity where COVID-19 testing is heavily rationed.To help solve this problem, Amazon has begun building incremental testing capacity and conducting research and development to apply cutting-edge technology advances to solve testing bottlenecks. We are seeking a Bioinformatics Lead to help define new approaches and execute against scaling them. You will work with a unique and gifted team developing these and collaborate with cross-functional teams. Our team rewards intellectual curiosity while maintaining a laser-focus in bringing products to market. Competitive candidates are responsive, flexible, and able to succeed within an open, collaborative, entrepreneurial, startup-like environment. At the cutting edge of both academic and applied research in this product area, you have the opportunity to work together with some of the most talented scientists, engineers, and product managers in the field.
ES, B, Barcelona
Are you a Master’s or Ph.D. student interested in applying machine learning techniques to big-data sets? Are you excited by analyzing and modeling terabytes of text, images, and other types of data to solve real-world problems? We’re looking for smart scientists capable of using machine learning and statistical techniques to invent state-of-the-art solutions to design, evangelize, and implement state-of-the-art solutions for never-before-solved problems.Amazon has multiple positions available for Machine Learning Scientists in Barcelona.
US, CO, Boulder
Amazon Advertising operates at the intersection of eCommerce and advertising, offering a rich array of digital display advertising solutions with the goal of helping our customers find and discover anything they want to buy. We help advertisers reach Amazon customers on Amazon.com, across our other owned and operated sites, on other high quality sites across the web, and on millions of Kindles, tablets, and mobile devices. We start with the customer and work backwards in everything we do, including advertising. If you’re interested in joining a rapidly growing team working to build a unique, truly innovative advertising group with a relentless focus on the customer, you’ve come to the right place.Our team, Machine Learning Optimization, develops machine learning algorithms in high performance, petabyte-scale distributed systems. Our systems process billions of ad impressions daily from across the internet to power all of Amazon’s advertising reporting, as well as algorithms for audience targeting, real time ad ranking and bidding, and automated campaign optimization.We are looking for a talented Business Intelligence Engineer who is passionate about building metrics and pipelines and has the growth goal of getting deep in quantitative algorithm analysis. In this role, you will work with scientists, engineers, and product managers on high impact initiatives in Amazon’s Display Advertising.Job responsibilities:· Innovate new machine learning approaches for advertising targeting and optimization· Research and implement novel experimental design and measurement methodologies· Establish scalable, efficient, automated processes for large scale machine learning· Leverage petabyte scale data in strategic analysis for new monetization strategies, products and business directionsImpact and Career Growth:· Identify problems and opportunities leading to significant business impact.· Leverage petabyte scale data.· Opportunity to grow and broaden your technical skills as you work in an environment that thrives on creativity, experimentation, and product innovation.· Drive real-time algorithms to allocate billions of ads per day in advertising auctions.· Have the ability to experiment effectively with meaningful projects.Amazon is investing heavily in building a world class advertising business. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and millions of clicks daily and are breaking fresh ground to create world-class products. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities. Together, we will change the face of advertising and retail.You can join our Seattle, New York or Boulder offices.
US, VA, Arlington
Ever wonder how you can apply your analytics skills to drive customer experience improvements for a diverse, innovative, and fun company like Amazon? Amazon’s Customer Insights and Research team is looking for a Data Scientist to help do exactly that and much more! If you have experience in surveys, experimental design, statistics and econometrics, and are interested in going deeper into data, this is the right opportunity for you. Our team is responsible for conducting global NPS studies to help business teams drive strategic initiatives that advocate for the best possible customer experience. We have a diverse suite of skill sets on the team, including Business Analysts, Business Intelligence Engineers, Data Scientists, Product Managers, and Software Development Engineers. Data Scientists on our team apply their skills to design studies and surveys, design and apply statistical analyses, and apply NLP-based process. Data Scientists also continuously learn new systems, tools, and industry best practices to analyze big data and enhance our analytics.
US, WA, Seattle
Are you seeking an environment where you can drive innovation? Do you want to apply learning techniques and advanced mathematical modeling to solve real world problems? Do you want to play a key role in determining how to plan and predict inventory flows WW? Come and join us!The Amazon Sales and Operations Planning (S&OP) team seeks a Senior Research Scientist to join our team. Scientists in S&OP develop new algorithms and models to improve the way we plan inventory flows in our complex networks WW. Improvements drive down down supply chain costs and enables better selection and availability for customers.Working collaboratively with Engineers, PMTs, PMs and business partners across groups, you will develop solutions to complex problems, such as designing the next generation of algorithms to drive the Supply Chain. As a Research Scientist, you will continue to contribute to the research community, by working with other scientists across Amazon and our Supply Chain, as well as collaborating with academic researchers and publishing papers. Within S&OP, our Science community values teamwork, supports continued learning, and recognizes the need to take risks and try new ideas that may fail. Furthermore, our builder culture means that Scientists and Software Development Engineers work closely together to invent and construct at a massive scale. Your work can be part of Amazon production system and result in concrete business impact.Responsibilities:· Understand and mine the large amount of data, prototype and implement new learning algorithms and prediction techniques to improve plan accuracy· Collaborate with product managers and engineering teams to design and implement software solutions for Supply Chain problems· Contribute to progress of the Amazon and broader research communities by producing publicationsAmazon is an Equal Opportunity Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation.
US, NY, New York
Amazon Web Services is looking for experienced Applied Science Managers to join the Security Analytics and AI ResearchTeam within AWS Security Services. You would be entrusted with researching and developing state-of-the-art data mining and machine learning algorithms for various AWS security services, such as GuardDuty (https://aws.amazon.com/guardduty/) and Macie (https://aws.amazon.com/macie/). On this team, you will help guide and lead team of scientists who invent and implement innovative solutions for never-before-solved problems. This is not solely a management role, you will be directly contributing to the research and development while you lead. If you have passion for security and experience with managing scientists, this will be an exciting opportunity.The AWS Security Services team builds technologies that help customers strengthen their security posture and better meet security requirements in the AWS Cloud. The team interacts with security researchers to codify our own learnings and best practices and make them available for customers. We are building massively scalable and globally distributed security systems to power next generation services.Key Responsibilities:· Lead scientists and engineers on the team and oversee research and development projects at various stages ranging from initial exploration to deployment into production systems.· Rapidly design, prototype and test many possible hypotheses in a high-ambiguity environment, making use of both quantitative and business judgment.· Collaborate with software engineering teams to integrate successful experiments into large scale, highly complex production services.· Report results in a scientifically rigorous way.· Interact with security engineers, product managers and related domain experts to dive deep into the types of challenges that we need innovative solutions for.
US, WA, Seattle
As a Sr. Research Scientist in Music, you'll discover insights that drive marketing, content and product strategy for our Amazon Music streaming service. You will have the opportunity to work with a huge and rapidly growing data set generated by mobile, desktop and home music streaming application usage interactions and music consumption behaviors.Major responsibilities include:Translate / Interpret· Complex and interrelated datasets describing customer behavior, messaging, content, product design and financial impact.Measure / Quantify / Expand· Retrieve, synthesize, and present critical data in a format that is immediately useful to answering specific questions or improving system performance.· Analyze historical data to identify trends and support decision making.· Improve upon existing methodologies by developing new data sources, testing model enhancements, and fine-tuning model parameters.· Provide requirements to develop analytic capabilities, platforms, and pipelines.· Apply statistical or machine learning knowledge to specific business problems and data.Explore / Enlighten· Formalize assumptions about how users are expected to behave, create statistical definition of the outlier, and develop methods to systematically identify these outliers. Work out why such examples are outliers and define if any actions needed.· Given anecdotes about anomalies or generate automatic scripts to define anomalies, deep dive to explain why they happen, and identify fixes.· Make Decisions and Recommendations· Build decision-making models and propose solution for the business problem you defined· Conduct written and verbal presentation to share insights and recommendations to audiences of varying levels of technical sophistication.· Utilize code (Python/R/SQL) for data analyzing and modeling algorithmsAmazon MusicImagine being a part of an agile team where your ideas have the potential to reach millions. Picture working on cutting-edge consumer-facing products, where every single team member is a critical voice in the decision-making process. Envision being able to leverage the resources of a Fortune-500 company within the atmosphere of a start-up. Welcome to Amazon Music, where ideas are born and come to life as Amazon Music Unlimited, Prime Music, and so much more.Come innovate with the Amazon Music team!
PL, Gdansk
Amazon is searching for passionate, talented, and inventive scientists who are currently enrolled in Master's or Doctoral degrees and looking to launch their careers with an industry leader in Automatic Speech Recognition (ASR) and Natural Language Understanding (NLU). Do you have a strong machine learning background and want to help build new speech and language technology? Our mission is to push the boundaries in ASR, NLU, and Audio Signal Processing, in order to provide the best possible experience for our customers.As a speech and language scientist, your work will directly impact our customers in the form of products and services that make use of speech and language technology. You will work side-by-side with global experts in speech and language to solve challenging groundbreaking research problems on production scale data.We are hiring in all areas of spoken language understanding: ASR, NLP, NLU, text-to-speech (TTS), and Dialog Management. Amazon has multiple positions available for Speech Scientists across Poland. We are currently hiring in Gdansk.
DE, BE, Berlin
Amazon is searching for passionate, talented, and inventive scientists who are currently enrolled in Master's or Doctoral degrees and looking to launch their careers with an industry leader in Automatic Speech Recognition (ASR) and Natural Language Understanding (NLU). Do you have a strong machine learning background and want to help build new speech and language technology? Our mission is to push the boundaries in ASR, NLU, and Audio Signal Processing, in order to provide the best possible experience for our customers.As a speech and language scientist, your work will directly impact our customers in the form of products and services that make use of speech and language technology. You will work side-by-side with global experts in speech and language to solve challenging groundbreaking research problems on production scale data.We are hiring in all areas of spoken language understanding: ASR, NLP, NLU, text-to-speech (TTS), and Dialog Management. Amazon has multiple positions available for Speech Scientists across the Germany. We are currently hiring in Berlin and Aachen.We are currently hiring for multiple teams including:• Alexa Domains• Customer Service• Amazon Search
US, WA, Seattle
Are you passionate about conducting research to drive real behavioral change and inform front line managers and leaders in making more effective decisions? Would you love to see your research in practice, impacting Amazonians globally and improving the employee experience? If so, you should consider joining the Amazon Web Services (AWS) Organizational Effectiveness and Science team.AWS is a dynamic, growing business unit within Amazon.com. Since early 2006, AWS has provided companies of all sizes with an infrastructure platform in the cloud. Today, AWS provides a highly reliable, scalable, low-cost infrastructure platform in the cloud that powers millions of active monthly customers from start-ups to multi-national corporations to governments.In this role, you will lead the research strategy to evaluate, diagnose, understand, and surface drivers and moderators for key, global research streams. These include (but are not limited to) productivity, innovation, decision-making, and Amazon culture. You will dive deep to understand what research should be conducted, develop hypotheses that can be tested, and use both quantitative and qualitative research to deliver actionable insights to AWS leaders. For example, a recent research project has looked at how Amazon’s organizational culture spreads throughout the organization by looking at employee-, team-, department-, and country-level characteristics.The ideal candidate must be self-driven, possess a high degree of ownership, have strong business acumen, excellent communication skills, planning/project management skills, and thrive working in a fast-paced environment. This role requires dealing with a high level of ambiguity and feeling comfortable operating in a space with little direction for solving hard, complex problems. Candidates should be comfortable with nested modeling to assess the impact that variables at the team- and organizational-level has on individual-level outcomes. Experience with applying machine learning to develop classification models as well as forecasting models is a plus, but not essential. There is no opportunity in this role to outsource work to others, so candidates must be comfortable taking on a several activities (i.e., identifying data sources, attaining data via SQL, shaping and analyzing the data, and writing up and communicating the results).The successful candidate will also have a demonstrated track record of:· Knowing Your Customers. Understand their priorities, what they are saying, and more importantly, what they aren’t. Deliver and drive value for them.· Innovation. Appreciate what exists, identify why it works. Then rebuild it or build something totally different that derives even MORE value and a better customer experience.· Judgment. Take different perspectives and business needs, develop a solution that works, move the ball forward. Be able to support your opinions with sound reasoning grounded in the business.· Systems Thinker. Understand all the connections and integrations points through the entire talent management lifecycle.· Thinking big. How do we build it bigger, better, faster? What aren’t we thinking of?· Research driven. We seek to be the most scientific HR organization in the world. We form hypotheses about the best talent management techniques and then set out to prove or disprove them with experiments and careful data collection.· Prioritization. There will be a constant flow of work, both tactical and strategic. Determine what gets done first and why, while managing a plan for what to do with everything else.· Building relationships. Partner with AWS HR COE teams, HR Business Partners, Business Leaders, and corporate COE teams. Share best practices, partner on solutions, and move the organizations forward together.· Consulting. Utilize past experience, deep knowledge of processes and policies, and knowing what’s going on across our organization to create custom solutions and localize as needed.· Communicating. Share your ideas, listen to others, follow-up, and follow-up again. Use the language of the business and avoid “consultant speak”.· Resourcefulness. If you don’t know it, that’s ok. But you should know where to go for the answer or how to find out.· Bias for Action and dealing with ambiguity. Sometimes it is not clear how we are going to get there. Can you help carve a path? How fast can you do it? What are the tradeoffs? Take risks and be willing to try new things, fail fast and iterate.KEY RESPONSIBILITIES:· Manage full life cycle of large-scale research programs (i.e., develop strategy, gather requirements, manage, and execute).· Conduct experiments, analytics, and compute behavioral process models for a deep dive understanding of systemic and individual level drivers; combine quantitative and qualitative data to inform research.· Conduct organizational analysis to uncover talent and org effectiveness insights and build talent and organizational effectiveness solutions (both scrappy or long-term) and mechanisms with the objective to help the business increase talent leverage and improve organizational speed and execution.· Partner closely with our Analytics, Employee Survey (“Connections”), and Diversity and Inclusion teams to identify opportunities for integration points and address specific talent needs leveraging talent data and themes.· Partner with AWS Analytics team to automate organizational health reporting and innovative tools to uncover organizational insights to drive strategic talent and organizational discussions.· Measure and assess the impact of tools and resources introduced to the organization. Continually evaluate solutions for quality, business impact, scalability and sustainability. Conduct post launch evaluations to understand successes and improvement opportunities while establishing methods for sustained adoption.· Evaluate research initiatives to provide bottom line value, ROI, and incremental improvements over timeIf you have an entrepreneurial spirit, know how to deliver, are deeply technical, highly innovative and long for the opportunity to build pioneering solutions to challenging problems, we want to talk to you.
US, WA, Seattle
Are you passionate about solving problems in the marketing domain using various scientific methodologies?Are you the one who is full of ideas and ready to make an impact?The Customer Behavior Analytics (CBA) organization owns Amazon’s insights pipeline, from data collection to deep analytics. We aspire to be the place where Amazon teams come for answers, a trusted source for data and insights that empower our systems and business leaders to make better decisions. Our outputs shape Amazon product and marketing teams’ decisions and thus how Amazon customers see, use, and value their experience. CBA-XO’s mission is to make Amazon’s marketing the most measurably effective in the world. Our long-term objective is to measure the incremental impact of all Amazon’s marketing investments on consumer perceptions, actions, and sales. This requires measuring Amazon’s marketing comparably and consistently across channels, business teams and countries using a comprehensive approach that integrates all Paid, Owned and Earned marketing activity. As the experts on marketing performance we will lead the Amazon worldwide marketing community by providing critical cross-country insights that can power marketing best practices and tenets globally.This role will be part of the new High Value Message (HVM) Analytics team within CBA, which is focused on defining and quantifying how effective our marketing campaigns are changing customer’s perception towards Amazon. You will be a leader to define the ambiguous space. We are looking for a thought leader and you demonstrate this by delivering solutions, not just by having ideas. You will work with Economists and apply theory and quantitative methods to relate how our marketing campaigns affect these measurement metrics. We encourage you to shape the business strategy with data driven recommendations. A successful candidate has an entrepreneurial spirit and wants to make a big impact on Amazon shoppers. You will develop strong working relationships and thrive in a collaborative team environment. Your role requires the ability to influence a virtual team of contributors and interact with marketing executives.The main responsibilities for this position include:· Apply expertise in causal modeling to develop systems that describe how Amazon’s marketing campaigns impact shopper’s perceptions.· Review and audit modeling processes and results for other scientists, both junior and senior.· Work with marketing leadership to align our measurement plan with business strategy.· Formalizing assumptions about how models are expected to behave, creating definitions of outliers, developing methods to systematically identify these outliers, and explaining why they are reasonable or identifying fixes for them· Identify new opportunities that are suggested by the data insights.· Bring a department-wide perspective into decision making.
US, MA, Cambridge
Interested in Amazon Alexa? We’re building the speech and language solutions behind Amazon Alexa and Amazon products and services such as the Amazon Echo and Dot. Come join us!We're looking for an Applied Science Manager who combines exceptional technical, research and analytical capabilities to lead a team that will be integral to the continued improvement of Amazon Alexa. As an Applied Science Manager, you will be responsible for data-driven improvements and evaluation for our spoken language understanding models. You will be responsible for leading a team of research scientists and data experts to build ML models for assessing Alexa’s success at Natural Understanding with accuracy, reliability, scalability to new languages & devices, low latency and limited dependence on manually annotated data. Your work will directly impact our customers in the form of products and services that make use of speech and language technology, particularly in developing predictive analytics models for user in continuously improving the Alexa experience for our customers.This involves:· Conducting and coordinating process development leading to improved and streamlined processes for model development.· Ensuring data quality throughout all stages of acquisition and processing, including such areas as data sourcing/collection, ground truth generation, normalization, transformation, cross-lingual alignment/mapping, etc.· Providing technical and scientific guidance to your team members.· Presenting proposals and results in a clear manner backed by data and coupled with actionable conclusions· Communicating effectively with senior management as well as with colleagues from science, engineering and business backgrounds, in written and verbal forms· Supporting the career development of your team members.The successful candidate will have an established background in defining metrics, building ML models, a strong technical ability, demonstrated experience in people management, excellent project management skills, great communication skills, and the motivation to achieve results in a fast-paced environment.
US, WA, Seattle
Are you passionate about big data and machine learning? Do you enjoy solving complex analytical problems, build predictive analytics models and develop insights and recommendations at web scale? Do you want to make an impact in Amazon’s multi-billion-dollar Messaging business? Amazon’s Outbound Communication Services, OCS, owns foundational systems that power all of Amazon's customer-facing communication on Email, SMS, Push channels, and other emerging messaging applications. In 2019, we sent over 135 billion messages to our global customers on these channels! OCS builds self-governing and message-optimizing engines that leverage integrated Machine Learning, massive data processing and adaptive algorithms to deliver the best messages to Amazon’s customers, over the best channel, and at the right time. Our systems ensure best-in-class engagement experience, which spans transactional and marketing communications. We're building a top-notch team of engineers, applied scientists, data engineers, and engineering leaders. The problems we face are complex and interesting including information engineering, data mining of Big Data sets, and governing real-time messages at scale. We build large scale, distributed systems using multiple AWS services that we designed from the ground up.We are looking for a strong Applied Scientist to work backwards from customers, create models and develop insights, deliver impact, and drive growth of the OCS worldwide. As a Senior Applied Scientist on our team, you will be working with business stakeholders, product/program managers, developers and executives to deeply understand customer problems and priorities. You will form hypotheses, analyze the corpus of Outbound and Amazon data using statistical methods, build predictive models, generate recommendations to address a range of problems to optimize the value of the messages we send to our customers. These span developing insights on customer engagement trends, building models to inform message rates, channel selection, and defining segmentation for marketing, etc. Your expertise will enable us to enable new customer experiences while maintaining best-in-class customer experience. You will be comfortable with big data systems, intimately familiar with advanced machine learning and statistical methods, and experienced in applying these to solve business problems. You will have a strong bias towards customer obsession and delivering results while dealing with ambiguity in fast-paced dynamic environments.Roles and Responsibilities· Work with business teams, product/program managers, engineers and leadership to identify and prioritize customer and business problems· Translate these problems into specific analytical questions and form hypotheses that can be answered with available data using statistical methods or identify additional data needed in the master datasets to fill any gaps· Perform hand-on data analyses and modeling with huge datasets to develop insights and recommendations to inform decisions across the program· Design and run A/B experiments to validate the hypotheses and evaluate the impact of your optimizations and communicate your results to various stakeholders· Collaborate with engineers and product managers to build scalable solutions and new capabilities· Help on projects of high visibility across the organization and deliver business impact
US, WA, Seattle
The Central AWS Econ team is dedicated to bringing the most trustworthy evidence-based analysis to the most strategic decisions for AWS leadership.Our studies impact strategic investments, service business model, resource allocation, product priorities and pricing models, go-to-market motions and more.This economist role partners with AWS business leaders across the organization to define and deliver on economic questions that guide their most strategic decisions. The successful candidate will be a problem solver who enjoys diving into data, is excited by difficult modeling challenges and ambiguous starting points, and possesses strong communication skills to effectively interface and collaborate with product, finance, planning and business teams.Specific questions include developing supporting economics for new business model, evaluating the relationship between short and long term growth, mapping and affecting the customer journey through different AWS products and cloud technologies.The Central AWS Econ team is dedicated to answering these (and many more) questions using quantitative, economic and statistical methods.Key Responsibilities:· Frame and conduct economic studies, from question definition to and communicating practical implications to senior leadership· Develop new repeatable data analysis pipelines to be used by non-economists
US, CA, Virtual Location - California
Are you passionate about leveraging your data science skills to make impact at scale? Do you enjoy developing innovative algorithms, optimization and predictive models to generate insights and recommendations that will be used by millions of Amazon selling partners and FBA operation teams to drive customer impact?Over 2 million Sellers in 10 countries list their products for sale on the Amazon Marketplace. To meet our sellers’ needs, our smart and customer-obsessed employees are constantly innovating and building on new ideas. Fulfillment by Amazon (FBA) is an Amazon service for our sellers. FBA Inbound analytics and data science team partners with FBA inbound product management team to optimize supply chain cost and lead time variability by influencing right trade-offs among cost, speed and FBA supply network capacity.We are looking for a motivated Data Scientist to build, optimize and productionize cutting edge machine learning models. A successful candidate will have strong quantitative, data mining, statistical modeling, machine learning skills and is comfortable facilitating ideation and working from concept through to execution. The position will partner with Product Management, Engineering, Supply Chain optimization and Finance teams to enhance short term and long term business use cases that leverage a range of data science methodologies to solve complex problems for the global FBA Inbound network.A qualified candidate must have demonstrated ability to develop and manage medium to large-scale models and methodologies that are statistically grounded but also functional and practical. Must possess strong written and verbal communication skills, proven ability to engage and collaborate with customers to drive improvements. Possess high intellectual curiosity with ability to quickly learn new concepts/frameworks, algorithms and technology.Key responsibilities of FBA Inbound data scientist include the following:· Research machine learning algorithms and implement by tailoring to FBA business problems· Manipulate/mine data from large databases (Redshift, SQL Server) and create automated pipeline for model training data sets· Improve model usability by analyzing customer behavior and by gathering requirements from business owners and other tech teams.· Create and track accuracy and performance of model predictions/recommendations. Retrain models to maximize business impact· Foster culture of continuous engineering improvement through mentoring, feedback, and analysis.· Lead setting up of machine learning infrastructure and processes for team to collaborate and share codeTo help describe some of our challenges, we created a short video about Supply Chain Optimization at Amazon - http://bit.ly/amazon-scotAmazon is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation / Age
US, WA, Seattle
Amazon’s eCommerce Foundation (eCF) organization provides the core technologies that drive and power the Amazon website and the consumer experience. Millions of customer page views and orders per day are enabled by the systems eCF builds from the ground up. eCF Data enables business analytics and insights, providing data and data curation capabilities to thousands of internal and external customers worldwide.Amazon is looking for a passionate, talented, and inventive Applied Scientist with a strong machine learning background to help build industry-leading machine learning services. As a scientist in the BDT team, you'll partner with technology and business teams to build services that surprise and delight our customers. You will be working with petabytes of structured and unstructured data to help our customers derive critical insights and solve real-world problems. You'll design and implement cutting-edge distributed ML services from the ground up, design and run experiments, research new algorithms, and find new ways of optimizing the risk, profitability, and customer experience for a wide variety of business segments across Amazon. As part of this group, you will have the chance to work with a large team of thought leaders, engineers, and scientists in the distributed computing, machine learning, and business intelligence fields.Applied science at Amazon is a fast growing field. This is a highly technical role that requires substantial cross-disciplinary interaction with software engineers, product managers, solution architects, business intelligence engineers, and other scientists. Besides theoretical analysis and innovation, you will work closely with software engineers to put your research, designs, and algorithms into practice. You will also work on cross-disciplinary efforts with other scientists and engineers at Amazon to establish scalable, efficient, automated processes for large-scale data analysis, ML model development, and model validation.We’re looking for top scientists capable of using ML, computer science, distributed systems, and other techniques to design, implement, and evangelize state-of-the-art solutions for previously-unsolved problems.
US, VA, Arlington
Global Talent Management (GTM) is a central Human Resource (HR) team responsible for creating and evolving Amazon’s human capital and talent products and processes. The GTM Science team is a growing interdisciplinary team within GTM that develops evidence-based products and services that power the growth and development of Amazon’s talent across all of our businesses and locations around the world.GTM Science exists to propel GTM and Amazon HR toward being the most scientific HR organization on earth. Our mission is to use science to assist and measurably improve every talent decision made at Amazon. We do this by discovering signals in workforce data, integrating those signals and behavioral recommendations into Amazon’s talent products, and helping Amazonians make high-judgement decisions that raise the bar on talent. Our multi-disciplinary approach covers an array of capabilities, including: data engineering, business intelligence and analytics, research and behavioral sciences, data science, and applied sciences such as economics and machine learning.We are looking for a dynamic leader to join our leadership team. Reporting directly to the Director of GTM Science, you will lead a team of researchers and analysts primarily responsible for handling high-priority senior-leadership research requests that require scientific rigor and agility. You will be responsible for building mechanisms to scale collaborations across all areas of GTM Science/Product/Tech and to build project-based partnerships with HR Line Analytics and COE teams. Your approach balances scientific rigor and pragmatism, in order to deliver results at the speed of business decision-making. You and your team thrive on quickly framing open-ended business requests into an actionable research plan and reporting your results to the highest levels of leadership, to meaningfully shape Talent processes, policies, and programs in areas such as: Diversity & Inclusion, Flexible Work, Talent Mobility, Talent Evaluation, Talent Retention, Performance Management.
US, CA, Sunnyvale
Want to build the future of music and audio entertainment?Imagine being part of an agile team, where your ideas have the potential to reach millions. Envision working within a startup atmosphere, while being able to leverage the resources of a Fortune-500 company. Picture working on bleeding-edge consumer-facing products, where every team member is a critical voice in the decision-making process. Welcome to Amazon Music’s New Projects team.Our team builds new experiences for Amazon Music listeners. We help our customers discover up-and-coming creators, while also having access to their favorite music and podcasts. We build systems that are distributed around the world, spanning our music apps, web player, and voice-forward experiences on mobile and Amazon Echo devices, powered by Alexa. Amazon Music products support our mission of delivering audio entertainment in new and exciting ways that listeners love.Amazon Music’s New Projects team is looking for founding team members across a variety of functions, including software engineering/development, product, marketing, design, and more. Come make history, as we launch new projects for millions of listeners.
US, MA, Boston
Data Scientist: Elastic Block Store Data Services (AWS)Come and build the future with us as we change the way customers move and transform their EBS data at never before seen scale.EBS customers frequently need to move or transform their underlying data whether its accelerating volume creation from snapshots using Fast Snapshot Restore, increasing their database storage or changing their volume type through Elastic volumes, or encrypting their volumes using AWS managed keys. Our team creates solutions that enable and simplify EBS customer workflows.Building a High-Performing & Inclusive Team CultureYou should be passionate about working with a world-class team that welcomes, celebrates, and leverages a diverse set of backgrounds and skillsets to deliver results. Driving results is your primary responsibility, and doing so in a way that builds on our inclusive culture is key to our long term success.Work/Life BalanceEBS Data Services values work-life balance. On normal days, our entire team is co-located in the Boston office, but we’re also flexible when people occasionally need to work from home. We generally keep core available hours from 10am to 4pm. Some of the team is available earlier and the rest of us work a little later.Energizing and Interesting Technical ProblemsYou will work in partnership with engineers on the team to build and operate large scale systems that move and transform customer volume data and accelerate access to their data. You’ll be working to provide solutions to both internal and external customers and engage deeply with other teams within EBS, S3, EC2, and many other services. It’s humbling and energizing to provide data movement solutions to customers at AWS scale.Mentorship & Career GrowthWe’re committed to the growth and development of every member of EBS Data Services, and that includes our engineers. You will have the opportunity to contribute to the culture and direction of the entire EBS org and deliver initiatives that will improve the life of all of our teams.EBS Data Services is a growth environment - we’re hiring and scaling rapidly to meet the needs of our customers. You’ll have the opportunity to grow your scope of influence naturally as we scale and work on solutions that impact some of Amazon's largest customers.
US, MA, Virtual Location - Massachuset
Are you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Robotics. We are a smart team of doers that work passionately to apply cutting edge advances in robotics and software to solve real-world challenges that will transform our customers’ experiences in ways we can’t even imagine yet. We invent new improvements every day. We are Amazon Robotics and we will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling and fun.The Research and Advanced Development team at Amazon Robotics is seeking interns with a passion for robotic research to work on cutting edge algorithms for robotics. Our team works on challenging and high-impact projects, including allocating resources to complete a million orders a day, coordinating the motion of thousands of robots, autonomous navigation in warehouses, and learning how to grasp all the products Amazon sells. We are seeking internship candidates with backgrounds in computer vision, machine learning, resource allocation, discrete optimization, search, and planning/scheduling. You will be challenged intellectually and have a good time while you are at it!