Several small blue Hercules robots are seen transporting tall yellow pods in a fulfillment center
When an order comes into certain fulfillment centers, Hercules robots — which can lift 1,250 pounds — fetch goods from inventory. If an order involves more than one item, the centralized planner schedules several drives, each carrying one or more products.

Amazon’s tiny robot drives do the heavy lifting

Autonomous robots called drives play a critical role in making billions of shipments every year. Here’s how they work.

Every day, Amazon ships millions of parcels. Single orders often include multiple products, and while Amazon employs hundreds of thousands of people at its fulfillment centers worldwide, those employees sometimes need an assist to handle the volume. They get it from a fleet of mobile robots.

A typical Amazon fulfillment center contains fleets of robotic drives, autonomous mobile robots that transport goods. While each has a heroic name — Hercules, Pegasus, and Xanthus — the fact is that these drives perform the mundane but necessary tasks required to efficiently deliver goods to customers’ doors.

Hercules is the embodiment of Amazon’s goods-to-employee approach to fulfillment.

Hercules, as its name attests, combines strength and speed. It brings goods from inventory to employees for packing. Pegasus, whose name evokes the winged horse of Greek mythology, sorts parcels by zip code or delivery route. Xanthus, named for the immortal horse that drew Achilles’ chariot, also sorts but can do other tasks as well.

Robotic drives complete their tasks while safely navigating a constantly changing world that includes employees, other mobile robots, obstructions, and even congestion. They must not only deliver the right product to the right place, but do it at the right time.

Air traffic control

That is why Amazon has embraced shared autonomy, which allows drives to make some decisions independently while still taking overall direction from centralized planning software.

Related content
Three of Amazon’s leading roboticists — Sidd Srinivasa, Tye Brady, and Philipp Michel — discuss the challenges of building robotic systems that interact with human beings in real-world settings.

Tye Brady, Amazon Robotics’ chief technologist, likens it to an air traffic control system: The flight controller provides the route and departure/arrival times, but the pilot takes off, flies, and lands the jet using their best judgment.

The process begins when an order arrives. Algorithms gauge both product availability and the ability to meet delivery windows. When the right match is found, that information is sent to a specific fulfillment center, where centralized planning software begins to orchestrate the safe, efficient movement of those robot drives to help meet the delivery date.

“Once the centralized planner creates this schedule, it assigns tasks and routes to the drives,” Brady explained. “The drives have enough smarts to move safely around humans, communicate with nearby robots so they do not collide, and report any problems like spills or obstructions back to the controller. If a drive sees that a path is blocked, for example, the planner says, ‘That’s OK. Let me see if I can find you a new route.’”

Fenway Park parking puzzle

After an order comes in, the first in motion is Hercules, which fetches goods from inventory so employees can pack and label them for shipping. If an order involves more than one item, the centralized planner schedules several drives, each carrying one or more products, to arrive one after the other, so the associate can more easily assemble the order.

Related content
Amazon fulfillment centers use thousands of mobile robots. To keep products moving, Amazon Robotics researchers have crafted unique solutions.

Hercules is the embodiment of Amazon’s goods-to-employee approach to fulfillment. Instead of asking employees to search for goods on the shelves, Amazon uses robots to bring products to employees at fixed packaging stations.

There are several reasons Amazon favors a goods-to-associate flow, Brady noted. First, asking employees to rummage through bins to find the right product is repetitive and inefficient. A robot can do this task, allowing employees to focus on more complex tasks.

The benefit of this approach is multiplied when a facility is optimized for robots. For example, Amazon stores goods on four-sided shelves called pods, which contain randomly sized bins of products. Hercules slides under the pod, which weighs up to 1,000 pounds, lifts it off the ground, and delivers the entire pod to the packing station.

Hercules robots can carry pods with several different items.

Because only robots access the pods, Amazon can cluster pods closer to one another, which increases the volume of goods it can store in its warehouses. If a pod’s product is popular, drives will shuttle it closer to the packing stations. If demand cools, they will shift them to the back.

Related content
The Boston region is an important research hub for Amazon, with offices in the city itself as well as in nearby Cambridge and North Reading. Scientists in the Boston area work on technology related to Amazon Web Services, Alexa, robotics, and quantum computing.

However, clustering sometimes creates what Brady, who works in Boston, calls a Fenway Park parking puzzle.

“That’s when your car is boxed in by 10 other cars and you want to get it out efficiently,” he said. “The same thing happens with clustered pods, and our algorithms solve it all the time using a team of robots. Better yet, they will not charge you $80 to park there as well!”

Hercules

Hercules itself is a fourth-generation drive designed to navigate structured fields, floors that contain a grid of encoded markers. By reading the markers with its downward facing camera, it can find its position and the location of any pod.

Hercules mounts a forward-facing 3D camera that identifies people, pods, other robots, and obstructions. The robot uses these images to make safe decisions quickly if an issue arises. The drive is also programmed to respond safely if the electricity goes out or the Wi-Fi crashes.

An Amazon employee is seen wearing a tech vest
Hercules communicates with other robots and with humans wearing Wi-Fi transmitters called Tech Vests, like the one seen here.

Hercules also communicates with other robots and humans with wearable Wi-Fi transmitters called Tech Vests. This enables it to identify the location of humans and robots beyond the range of its sensors, so it can plan a route that steers clear of them.

Hercules drives operate in parallel — even when some need to pause their operations. “If ten or even one hundred drives need to recharge their batteries or stop to run diagnostics, that’s OK,” Brady said. “There’s just so many of them that the rest of the swarm can replan and reroute. There’s no single point of failure.”

In 2018, Amazon unveiled Pegasus, a drive used to take finished parcels from employees and sort them by zip code or delivery route within the fulfillment center.

The robot is built on a Hercules drive and uses a structured field to navigate the sortation center. Like Hercules, the drive is fully sensored and operates safely around people, other robots, and obstructions. The big difference between the two robots is that Pegasus mounts a mini-conveyor belt on top of the puck-like drive.

Related content
Scientists and engineers are developing a new generation of simulation tools accurate enough to develop and test robots virtually.

Sorting, however, is different than moving pods.

It starts when a truck delivers a load of packed and labelled parcels. These go onto a conveyor belt that goes upstairs to the facility’s mezzanine. There, employees (or robotic arms) scan each parcel’s address and then place it onto the Pegasus mini-conveyor. The planner assigns the robot a route based on the address. Pegasus then navigates around an array of holes in the floor. When it gets to the right one, the conveyor drops the package down a chute that takes it to the correct loading dock below.

X-bot

Physically, Xanthus, also called X-bot, looks like a lightweight version of Pegasus, which makes sense, as Amazon doesn’t need a drive designed to lift 1,000-pound pods for delivering twenty-pound parcels.

This makes the drive less expensive to build and deploy in large numbers. Xanthus also has upgraded sensors that enable it to detect people, robots, and obstructions from farther away than any of Amazon’s other mobile robots.

X-bot and Pegasus are designed to carry smaller packages.

What really sets the new drive apart, however, is its flexibility.

“It’s a clever robot, and its sensor package is well-suited to moving in busy environments,” Brady said. “We did that intentionally to make it more of a jack of all trades. We started it on sortation, but in the future, we see a lot more potential applications for it.”

Some of those uses and design features were crowd-sourced from Amazon employees.

“We issued a challenge to our employees about three years ago,” Brady said. “We asked them, ‘What would a very low-cost mobile robot look like?’ About a third of our employees responded, and we grouped some of them into teams to move those ideas forward. We used several of those ideas in the final design.”

It's a clever robot, and its sensor package is well-suited to moving in busy environments. We did that intentionally to make it more of a jack of all trades. We started it on sortation, but in the future, we see a lot more potential applications for it.
Tye Brady

Xanthus’ flexibility could make it a game changer in Amazon’s fulfillment centers. Yet Brady thinks of it as evolutionary, not revolutionary. Xanthus is the next step for Pegasus, just as Hercules is the fourth iteration of Amazon’s original pod drive. In both cases, the new drives are smaller, faster, smarter, and safer than the ones they replaced.

“The job of our engineers is to take these complicated tasks and ideas and simplify, simplify, and simplify until they become reality,” he said. “The best things that we do are really very simple. And because we have gained this world-class capability in autonomous mobility, we can unlock the lessons we’ve already learned inside our fulfillment centers and develop new robots that are extensions of what we already do.

“This work exemplifies one of the company’s newest leadership principles of striving to be the Earth’s best employer,” Brady adds. “That principle suggests that leaders work every day to create a safer, more productive, higher performing, more diverse, and more just work environment. That’s the role of our robots, to augment the work of our employees, making our fulfillment centers safer and more productive.”

At re:MARS, Amazon Robotics unveiled some new robots, including its first fully autonomous mobile robot, Proteus.

Research areas

Related content

CA, ON, Toronto
Are you motivated to explore research in ambiguous spaces? Are you interested in conducting research that will improve associate, employee and manager experiences at Amazon? Do you want to work on an interdisciplinary team of scientists that collaborate rather than compete? Join us at PXT Central Science! The People eXperience and Technology Central Science Team (PXTCS) uses economics, behavioral science, statistics, and machine learning to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, wellbeing, and the value of work to Amazonians. We are an interdisciplinary team that combines the talents of science and engineering to develop and deliver solutions that measurably achieve this goal. Key job responsibilities As an Applied Scientist for People Experience and Technology (PXT) Central Science, you will be working with our science and engineering teams, specifically on re-imagining Generative AI Applications and Generative AI Infrastructure for HR. Applying Generative AI to HR has unique challenges such as privacy, fairness, and seamlessly integrating Enterprise Knowledge and World Knowledge and knowing which to use when. In addition, the team works on some of Amazon’s most strategic technical investments in the people space and support Amazon’s efforts to be Earth’s Best Employer. In this role you will have a significant impact on 1.5 million Amazonians and the communities Amazon serves and ample scope to demonstrate scientific thought leadership and scientific impact in addition to business impact. You will also play a critical role in the organization's business planning, work closely with senior leaders to develop goals and resource requirements, influence our long-term technical and business strategy, and help hire and develop science and engineering talent. You will also provide support to business partners, helping them use the best scientific methods and science-driven tools to solve current and upcoming challenges and deliver efficiency gains in a changing marke About the team The AI/ML team in PXTCS is working on building Generative AI solutions to reimagine Corp employee and Ops associate experience. Examples of state-of-the-art solutions are Coaching for Amazon employees (available on AZA) and reinventing Employee Recruiting and Employee Listening.
IN, KA, Bengaluru
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation - Mentor other scientists and engineers in the use of ML techniques
US, MA, Boston
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Applied Scientist with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Applied Scientist with the AGI team, you will work with talented peers to lead the development of novel algorithms and modeling techniques, to advance the state of the art with LLMs. Your work will directly impact our customers in the form of products and services that make use of speech and language technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in spoken language understanding. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
US, WA, Seattle
The Global Cross-Channel and Cross- Category Marketing (XCM) org are seeking an experienced Economist to join our team. XCM’s mission is to be the most measurably effective and creatively breakthrough marketing organization in the world in order to strengthen the brand, grow the business, and reduce cost for Amazon overall. We achieve this through scaled campaigning in support of brands, categories, and audiences which aim to create the maximum incremental impact for Amazon as a whole by driving the Amazon flywheel. This is a high impact role with the opportunities to lead the development of state-of-the-art, scalable models to measure the efficacy and effectiveness of a new marketing channel. In this critical role, you will leverage your deep expertise in causal inference to design and implement robust measurement frameworks that provide actionable insights to drive strategic business decisions. Key Responsibilities: Develop advanced econometric and statistical models to rigorously evaluate the causal incremental impact of marketing campaigns on customer perception and customer behaviors. Collaborate cross-functionally with marketing, product, data science and engineering teams to define the measurement strategy and ensure alignment on objectives. Leverage large, complex datasets to uncover hidden patterns and trends, extracting meaningful insights that inform marketing optimization and investment decisions. Work with engineers, applied scientists and product managers to automate the model in production environment. Stay up-to-date with the latest research and methodological advancements in causal inference, causal ML and experiment design to continuously enhance the team's capabilities. Effectively communicate analysis findings, recommendations, and their business implications to key stakeholders, including senior leadership. Mentor and guide junior economists, fostering a culture of analytical excellence and innovation.
US, WA, Seattle
The XCM (Cross Channel Cross-Category Marketing) team seeks an Applied Scientist to revolutionize our marketing strategies. XCM's mission is to build the most measurably effective, creatively impactful, and cross-channel campaigning capabilities possible, with the aim of growing "big-bet" programs, strengthening positive brand perceptions, and increasing long-term free cash flow. As a science team, we're tackling complex challenges in marketing incrementality measurement, optimization and audience segmentation. In this role, you'll collaborate with a diverse team of scientists and economists to build and enhance causal measurement, optimization and prediction models for Amazon's global multi-billion dollar fixed marketing budget. You'll also work closely with various teams to develop scientific roadmaps, drive innovation, and influence key resource allocation decisions. Key job responsibilities 1) Innovating scalable marketing methodologies using causal inference and machine learning. 2) Developing interpretable models that provide actionable business insights. 3) Collaborating with engineers to automate and scale scientific solutions. 4) Engaging with stakeholders to ensure effective adoption of scientific products. 5) Presenting findings to the Amazon Science community to promote excellence and knowledge-sharing.
US, WA, Seattle
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to help Amazon provide the best customer experience by preventing eCommerce fraud? Are you excited by the prospect of analyzing and modeling terabytes of data and creating state-of-the-art algorithms to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you enjoy collaborating in a diverse team environment? If yes, then you may be a great fit to join the Amazon Buyer Risk Prevention (BRP) Machine Learning group. We are looking for a talented scientist who is passionate to build advanced algorithmic systems that help manage safety of millions of transactions every day. Key job responsibilities Use machine learning and statistical techniques to create scalable risk management systems Learning and understanding large amounts of Amazon’s historical business data for specific instances of risk or broader risk trends Design, development and evaluation of highly innovative models for risk management Working closely with software engineering teams to drive real-time model implementations and new feature creations Working closely with operations staff to optimize risk management operations, Establishing scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation Tracking general business activity and providing clear, compelling management reporting on a regular basis Research and implement novel machine learning and statistical approaches
US, CA, San Diego
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to help Amazon provide the best customer experience by preventing eCommerce fraud? Are you excited by the prospect of analyzing and modeling terabytes of data and creating state-of-the-art algorithms to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you enjoy collaborating in a diverse team environment? If yes, then you may be a great fit to join the Amazon Buyer Risk Prevention (BRP) Machine Learning group. We are looking for a talented scientist who is passionate to build advanced algorithmic systems that help manage safety of millions of transactions every day. Key job responsibilities Use machine learning and statistical techniques to create scalable risk management systems Learning and understanding large amounts of Amazon’s historical business data for specific instances of risk or broader risk trends Design, development and evaluation of highly innovative models for risk management Working closely with software engineering teams to drive real-time model implementations and new feature creations Working closely with operations staff to optimize risk management operations, Establishing scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation Tracking general business activity and providing clear, compelling management reporting on a regular basis Research and implement novel machine learning and statistical approaches
CA, ON, Toronto
Conversational AI ModEling and Learning (CAMEL) team is part of Amazon Devices organization where our mission is to build a best-in-class Conversational AI that is intuitive, intelligent, and responsive, by developing superior Large Language Models (LLM) solutions and services which increase the capabilities built into the model and which enable utilizing thousands of APIs and external knowledge sources to provide the best experience for each request across millions of customers and endpoints. We are looking for a passionate, talented, and resourceful Applied Scientist in the field of LLM, Artificial Intelligence (AI), Natural Language Processing (NLP), Recommender Systems and/or Information Retrieval, to invent and build scalable solutions for a state-of-the-art context-aware conversational AI. A successful candidate will have strong machine learning background and a desire to push the envelope in one or more of the above areas. The ideal candidate would also have hands-on experiences in building Generative AI solutions with LLMs, enjoy operating in dynamic environments, be self-motivated to take on challenging problems to deliver big customer impact, moving fast to ship solutions and then iterating on user feedback and interactions. Key job responsibilities As an Applied Scientist, you will leverage your technical expertise and experience to collaborate with other talented applied scientists and engineers to research and develop novel algorithms and modeling techniques to reduce friction and enable natural and contextual conversations. You will analyze, understand and improve user experiences by leveraging Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in artificial intelligence. You will work on core LLM technologies, including Prompt Engineering and Optimization, Supervised Fine-Tuning, Learning from Human Feedback, Evaluation, Self-Learning, etc. Your work will directly impact our customers in the form of novel products and services.
CA, ON, Toronto
Conversational AI ModEling and Learning (CAMEL) team is part of Amazon Devices organization where our mission is to build a best-in-class Conversational AI that is intuitive, intelligent, and responsive, by developing superior Large Language Models (LLM) solutions and services which increase the capabilities built into the model and which enable utilizing thousands of APIs and external knowledge sources to provide the best experience for each request across millions of customers and endpoints. We are looking for a passionate, talented, and resourceful Applied Scientist in the field of LLM, Artificial Intelligence (AI), Natural Language Processing (NLP), Recommender Systems and/or Information Retrieval, to invent and build scalable solutions for a state-of-the-art context-aware conversational AI. A successful candidate will have strong machine learning background and a desire to push the envelope in one or more of the above areas. The ideal candidate would also have hands-on experiences in building Generative AI solutions with LLMs, enjoy operating in dynamic environments, be self-motivated to take on challenging problems to deliver big customer impact, moving fast to ship solutions and then iterating on user feedback and interactions. Key job responsibilities As an Applied Scientist, you will leverage your technical expertise and experience to collaborate with other talented applied scientists and engineers to research and develop novel algorithms and modeling techniques to reduce friction and enable natural and contextual conversations. You will analyze, understand and improve user experiences by leveraging Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in artificial intelligence. You will work on core LLM technologies, including Prompt Engineering and Optimization, Supervised Fine-Tuning, Learning from Human Feedback, Evaluation, Self-Learning, etc. Your work will directly impact our customers in the form of novel products and services.
US, WA, Seattle
We are open to hiring candidates to work out of one of the following locations: Seattle, WA, USA Do you love using data to solve complex problems? Are you interested in innovating and developing world-class big data solutions? We have the career for you! EPP Analytics team is seeking an exceptional Data Scientist to recommend, design and deliver new advanced analytics and science innovations end-to-end partnering closely with our security/software engineers, and response investigators. Your work enables faster data-driven decision making for Preventive and Response teams by providing them with data management tools, actionable insights, and an easy-to-use reporting experience. The ideal candidate will be passionate about working with big data sets and have the expertise to utilize these data sets to derive insights, drive science roadmap and foster growth. Key job responsibilities - As a Data Scientist (DS) in EPP Analytics, you will do causal data science, build predictive models, conduct simulations, create visualizations, and influence data science practice across the organization. - Provide insights by analyzing historical data - Create experiments and prototype implementations of new learning algorithms and prediction techniques. - Research and build machine learning algorithms that improve Insider Threat risk A day in the life No two days are the same in Insider Risk teams - the nature of the work we do and constantly shifting threat landscape means sometimes you'll be working with an internal service team to find anomalous use of their data, other days you'll be working with IT teams to build improved controls. Some days you'll be busy writing detections, or mentoring or running design review meetings. The EPP Analytics team is made up of SDEs and Security Engineers who partner with Data Scientists to create big data solutions and continue to raise the bar for the EPP organization. As a member of the team you will have the opportunity to work on challenging data modeling solutions, new and innovative Quicksight based reporting, and data pipeline and process improvement projects. About the team Diverse Experiences Amazon Security values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why Amazon Security? At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. We offer talented security professionals the chance to accelerate their careers with opportunities to build experience in a wide variety of areas including cloud, devices, retail, entertainment, healthcare, operations, and physical stores Inclusive Team Culture In Amazon Security, it’s in our nature to learn and be curious. Ongoing DEI events and learning experiences inspire us to continue learning and to embrace our uniqueness. Addressing the toughest security challenges requires that we seek out and celebrate a diversity of ideas, perspectives, and voices. Training & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve.