Can you teach a computer to smell? Osmo is trying

The company’s work, supported by the Amazon Alexa Fund, has relevant applications for areas from perfumes to disease detection.

At the age of 12, Alex Wiltschko bought his first perfume, Azzaro pour Homme. He’d read about it in his favorite book — Perfumes: The Guide, by Luca Turin — and was thrilled to find it at a knock-down price at his local TJ Maxx. It would be the first in a large collection.

For as long as he can remember, Wiltschko has been obsessed by scent. “It’s how I’m wired,” he says. His other obsession? Computers. “An interest in perfumes and computers was not the recipe for social success as an adolescent,” he adds.

It was, however, the recipe for a life trajectory that took Wiltschko deep into the neuroscience of olfaction and cutting-edge machine learning. This combination has placed Wiltschko at the forefront of the nascent science of digital olfaction — a.k.a. giving computers a sense of smell.

Wiltschko is now the CEO of Osmo, a Google Research spinout based in Cambridge, Massachusetts. In September 2022, the company hit the ground running with $60 million in initial funding, including an investment from the Amazon Alexa Fund.

In the short term, Osmo aims to unlock a new era of commercial fragrance innovation. Longer term, the company envisions its technologies having the potential to save lives through the development of better insect repellents and even digital diagnostic tools for detecting serious illnesses on a person's breath.

The Principal Odor Map

The keystone to all this is the team’s breakthrough advance: the creation of what it calls the Principal Odor Map (POM).

Before vision could be digitized, a map called RGB was required: It shows how every color is made up of varying proportions of red, green, and blue. Before Osmo was spun out, Wiltschko’s team did something similar — and remarkable — with odor. They used machine learning to map the structure of a molecule directly to how humans perceive the smell of that molecule. In other words, they built a model that can tell you what a molecule smells like just by looking at it. This is the POM.

That was an ‘a-ha!’ moment for us, akin to passing a Turing test for odor. We'd built something with real commercial value that was sufficiently validated to bring into the world.
Jon Hennek

Here’s how they created POM and, crucially, how they proved it worked. They first trained a graph neural network (GNN) on about 5,000 molecules from several flavor and fragrance databases. The smells of all these molecules were well-documented with multiple human-judged odor labels such as beefy, floral, or minty. From this, the model was able to learn connections between molecular structure and odor, without needing any knowledge of what actually happens in the nose or brain of a person sniffing an odor.

That’s great, as far as it goes. The crucial question then was, could POM generalize to predict the smell of molecules it had never seen before, based solely on their molecular structure? And could it do that as well as trained human raters, which is the gold standard for odor characterization? To find out, the team took a diverse set of more than 400 odor molecules previously unseen by POM and had the model blindly predict their characteristics. Then a panel of trained human raters sniffed and labeled those same odors.

When the Osmo team compared the results, they were delighted. Not only had the model successfully predicted the odor of these unseen molecules as well as trained humans, but its predicted odor profiles were closer to the average results of the panel than any of the individual panelists themselves.

“That was an ‘a-ha!’ moment for us, akin to passing a Turing test for odor,” says Jon Hennek, chief product officer at Osmo. “We'd built something with real commercial value that was sufficiently validated to bring into the world.”

Islands of odor

POM is not a map in the typical sense, but it can nevertheless be compared to the RGB map. Pick two points at random on a two-dimensional color map. The closer those two points are to each other, the more similar the color. The same is true for odors in POM, though this map exists in a mind-bending 256 dimensions. All of the tulip-smelling molecules are close to each other, for example. Ditto for the brandy-smelling molecules.

“Zooming out a little, all the flowers are next to each other. There's a whole floral Pangaea in this odor map! We didn't tell it to do that,” says Wiltschko. This sort of grouping is also true for woods, bakery-type smells, alcoholic smells, you name it. Our brain seems to organize smells in nested hierarchies, says Wiltschko, so the rose odor is inside the rose category, inside the flowers category, inside the plants category, inside the pleasant category.

“The fact that we were able to observe this in the POM without telling it is astounding,” he says.

On the left is a color map (the CIE 1931 color space chromaticity diagram), similar colors lie near each other. On the right is Osmo’s Principal Odor Map, individual molecules (grey points) are found nearer to each other if they are predicted to smell similar.
In this color map (the CIE 1931 color space chromaticity diagram), similar colors lie near each other. Likewise, in Osmo’s Principal Odor Map, individual molecules (grey points) are found nearer to each other if they are predicted to smell similar.
Courtesy of Osmo

While Wiltschko has bold ideas for the future of Osmo’s technology, the first order of business is putting the company on a solid commercial footing. For now, Osmo is concentrating on developing new ingredients for the global fragrance category.

The Osmo team is using POM to explore the world of odor molecules — several billion of them — and homing in on molecules that POM predicts to have an interesting and strong olfactory character.

“We're much better at that, I believe, than anybody else in the world,” says Hennek. “Because rather than start with rules of thumb and chemical intuition, we are starting with an odor prediction for every molecule we could possibly synthesize. It lets us find molecules that a chemist might never have considered.”

The team is working with advisors, including Christophe Laudamiel, a French master perfumer, and potential customers include fragrance houses and packaged goods companies.

More from Alexa Fund
Alexa Fund company’s assisted reality tech could unlock speech for hundreds of millions of people who struggle to communicate.

“We've had repeated feedback that our ingredients have the potential to be very successful, commercially,” says Wiltschko. “That smells like product/market fit.” The principal idea is to license those molecules to fragrance houses.

It’s a timely endeavor. The global fragrance category is valued at more than $10 billion and growing steadily. But some traditional ingredients, such as sandalwood oils, can result in over-harvesting or other ecological harm, while the characteristics of other ingredients increasingly fall short as the demand grows for safer, more biodegradable products.

With POM, Osmo is paving the way for palettes of safe, synthetic fragrances that recreate natural odors using environmentally friendly and easily synthesized molecules. To that end Osmo is looking at combinations of just a handful of atoms: carbon, hydrogen, oxygen, nitrogen, phosphorus, and sulfur.

“Then we bring them into our lab for a process akin to a drug discovery pipeline,” says Hennek. “We are working towards regulatory approval of those molecules.”

Rise of the graph neural networks

All of this has only become possible in the last six years or so. The core insight that started this scientific project, says Wiltschko, was that machine learning was “getting really good at molecules,” thanks to the recent rise of GNNs.

Related content
Dual embeddings of each node, as both source and target, and a novel loss function enable 30% to 160% improvements over predecessors.

Previously, machine learning approaches primarily converted inputs — images or data arrays, say — into rectangles or data grids to process them. Molecules didn’t fit this mold: a molecule might be two atoms, or it might be 20 atoms, with wildly different structure and connectivity. They are simply not reducible to rectangles or grids.

Instead, the atoms in a molecule can be considered as nodes, and the chemical bonds between them as edges, forming a graph structure. This representation allows GNNs to model and process molecular data.

“Some of this technology was developed by friends of mine at Google. So, it was a fantastic, fertile ground to start exploring this idea,” says Wiltschko.

This ongoing exploration is creating some exciting possibilities. Wiltschko reasoned that, just as the sun has shone on Earth since before life began, resulting in many creatures evolving similar visual apparatuses, the composition of the Earth’s atmosphere has been broadly stable over evolutionary time. So could POM also be used to understand the olfactory responses of other species, even those separated from humans by millions of years of evolution?

Life-saving potential

Take mosquitos. Could POM be used to work out what odors repel these disease-carrying insects?

To find out, they augmented POM with additional data sources. The first was a long-forgotten U.S. government report, published in the 1940s, that featured the results of testing 19,000 compounds for their mosquito repellency. The second was information provided by TropIQ, a Dutch company that develops malaria-control technology. The augmented model was soon able to predict entirely new molecules with repellency at least as powerful as DEET, the active ingredient in the most effective mosquito repellents.

osmo image 2.png
Osmo digitized mosquito-repellency data for 19,000 compounds reported on by the United States Department of Agriculture and used that to refine its model (left). The team then predicted candidate molecules that would be most repellent to mosquitos, produced the most viable options, tested them on real mosquitos, and fed those results back into the model to further refine it.
Courtesy of Osmo

The development of cheaper, more effective, and safer insect repellents could have a huge impact on global health. Wiltschko has nothing to announce yet, but says this research is ongoing in collaboration with the Bill & Melinda Gates Foundation.

Applying POM to mosquitos is also a proof of concept, says Hennek. “We can picture applying our product not just to what mosquitoes don’t like, but to what roaches don’t like. Or any number of agricultural pests.”

Capturing smell forever

Looking further down the road, Wiltschko’s vision is to digitize our sense of smell. The idea is not as far-fetched as it sounds. Consider several hundred years ago. The idea that a visual moment — the fleeting expression on your child’s face or an orchard of apple trees in blossom — could be instantly captured and made available forever more in perfect color would have been nothing short of magical thinking.

By the 1820s came the first photography, and with it, the first steps towards human mastery of the world of light. Today, it feels like a fundamental right to freeze those visual memories and hold on to them forever. And the same goes for the auditory world.

“We know what’s required to digitize a human sense,” says Wiltschko. “And we don't have to wait for any of the inventions that vision did — particularly integrated circuits.”

Indeed, with modern computing power and the harnessing of machine learning, Wiltschko reckons computers will have a “sense of smell” within a decade or two. Three stages are required: “reading” smell, understanding it, and “writing” it. Osmo wants to understand, and ultimately curate a wide palette of safe, synthetic molecules that can recreate the entire human smellscape. The reading (sensing) of odorous molecules currently requires bulky and expensive lab equipment, such as a gas chromatography mass spectrometer, while the writing (producing) of smells on demand remains science fiction at the consumer level, says Wiltschko, for now.

A window to the inside

Sensing and understanding odor at a high level may be sufficient to herald powerful health applications, says Wiltschko. For example, it is well established that serious illnesses, including some cancers, can be detected through their effect on your breath. Being able to take a snapshot of that odor profile — an “Osmograph”, in Wiltschko’s words – could reveal a great deal about what’s going on inside our bodies.

“We don't know if that technology will ultimately have a transformative effect on healthcare, but I am betting that it will,” he says.

Related content
ARA recipient Marinka Zitnik is focused on how machine learning can enable accurate diagnoses and the development of new treatments and therapies.

It’s very important to Wiltschko that, down the line, Osmo grows to develop clinical diagnostics applications. “That's the North Star for me, and it's very important that we get there. But the sheer cost and the talent that's required is rare and expensive,” he says. “So, it can’t be the first beach that we storm.”

As Osmo grows, it will be looking for similarly passionate people to push the mission forward. “We've been finding that there are people out there who are secret scent lovers, who secretly aspire to work in the field of machine olfaction,” says Wiltschko. “Just to put it out there: there's one place to do this, and it's Osmo.”

Talking to Wiltschko and those inspired to work alongside him, it is clear to see that Osmo is the culmination of his lifelong passions. For him, it’s emotional. “Once you smell a thing, you cannot stop the feelings that you get from it. There's a very fundamental feeling and emotional component,” he says, “and I think that’s beautiful.”

Research areas

Related content

US, CA, San Francisco
Amazon’s Frontier AI & Robotics (FAR) team is seeking a Member of Technical Staff to drive foundational research and build intelligent robotic systems from the ground up. In this role, you will operate at the intersection of innovative AI research and real-world robotics - conducting original research, publishing, and deploying your innovations into production systems at Amazon scale. We’re looking for researchers who think from first principles, push the boundaries of what’s possible, and take full ownership of turning breakthrough ideas into working systems. You will join the next revolution in robotics, where you'll work alongside world-renowned AI pioneers to push the boundaries of what's possible in robotic intelligence. As a Member of Technical Staff, you'll develop breakthrough foundation models that enable robots to perceive, understand, and interact with the physical world in unprecedented ways—with a strong emphasis on the hardware systems that bring these models to life. You'll drive independent research initiatives in areas such as locomotion, manipulation, motor control, actuator design, sim2real transfer, and multi-modal robot learning, designing novel frameworks that bridge state-of-the-art research with real-world hardware deployment at Amazon scale. In this role, you'll balance innovative technical exploration with hands-on hardware implementation, collaborating with mechanical, electrical, and controls engineering teams to ensure your models and algorithms perform robustly on physical robotic platforms in dynamic real-world environments. You'll have access to Amazon's computational resources and advanced robotics infrastructure—including high degree-of-freedom prototype platforms, custom actuators, and precision sensing systems—enabling you to tackle ambitious problems in areas like multi-modal robotic foundation models, motor-level control optimization, and efficient model architectures that scale across diverse robotic hardware. Key job responsibilities · Drive independent research initiatives across the full robotics stack, including robot co-design, manipulation mechanisms, innovative actuation and motor control strategies, state estimation, low-level control, system identification, reinforcement learning, and sim-to-real transfer, as well as foundation models for perception and manipulation · Lead full-stack robotics projects from conceptualization through hardware deployment, taking a system-level approach that integrates actuator dynamics, sensor feedback (force/torque, IMUs, encoders), and electromechanical constraints with algorithmic development · Develop and optimize control algorithms and sensing pipelines for physical robotic hardware, including motor characterization, actuator performance tuning, and robust sensor integration in production environments · Collaborate with hardware, mechanical, and electrical engineering teams to ensure seamless integration of learned models across the robotics stack—from embedded compute and communication buses to actuator-level control · Contribute to the team's technical strategy and help shape our approach to next-generation hardware-aware robotics challenges, including hardware-in-the-loop validation and prototype-to-deployment transitions A day in the life · Design and implement innovative systems and algorithms, leveraging our extensive computational and robotics hardware infrastructure to prototype and evaluate at scale · Collaborate with hardware and software engineers to solve complex technical challenges spanning motors, actuators, sensors, and learned control · Lead technical initiatives from conception to hardware deployment, working closely with robotics engineers and lab teams to integrate your solutions into physical robotic platforms · Participate in technical discussions and design reviews with team leaders, hardware engineers, and fellow scientists · Leverage our compute cluster and advanced robotics lab—including high-DoF prototype platforms and custom actuation systems—to rapidly prototype and validate new ideas · Transform theoretical insights into practical solutions that perform reliably on real-world robotic hardware About the team At Frontier AI & Robotics, we're not just advancing robotics – we're reimagining it from the ground up. Our team is building the future of intelligent robotics through ground breaking foundation models and end-to-end learned systems. We tackle some of the most challenging problems in AI and robotics, from developing sophisticated perception systems to creating adaptive manipulation strategies that work in complex, real-world scenarios. What sets us apart is our unique combination of ambitious research vision and practical impact. We leverage Amazon's massive computational infrastructure and rich real-world datasets to train and deploy state-of-the-art foundation models. Our work spans the full spectrum of robotics intelligence – from multimodal perception using images, videos, and sensor data, to sophisticated manipulation strategies that can handle diverse real-world scenarios. We're building systems that don't just work in the lab, but scale to meet the demands of Amazon's global operations. Join us if you're excited about pushing the boundaries of what's possible in robotics, working with world-class researchers, and seeing your innovations deployed at unprecedented scale.
GB, Virtual Location - Uk
Amazon Integrated Security is seeking a Principal Applied Scientist to lead research at the intersection of cognitive psychology, measurement science, and AI security. This role will pioneer new approaches to understanding and leveraging behavioral characteristics of autonomous AI systems in security contexts, turning threat actor use of AI into a structural advantage for defenders. Key job responsibilities Establish and lead a novel research program exploring cognitive patterns and biases in agentic AI systems used for offensive security purposes. Design and conduct experiments to understand black-box AI system behavior, develop measurement frameworks for previously unmeasurable security concepts, and translate research findings into actionable defensive strategies and tooling. Create feedback loops between offensive and defensive security teams, collaborate with threat intelligence experts and red team operations, and publish findings that advance both academic understanding and practical security outcomes. Apply measurement science expertise to quantify complex security concepts including risk, business impact, and trust. A day in the life Work closely with a Principal Technologist with AI and security expertise, senior security engineers with threat intelligence backgrounds, offensive AI security teams, and detection/response operations. Mentor junior scientists and engineers while maintaining strong connections with academic research communities.
US, NY, New York
We are seeking a Sr. Applied Scientist to develop cutting-edge machine learning algorithms for motor control systems in robots. In this role, you will focus on creating and optimizing intelligent motor control strategies to enable robots to perform complex, whole-body tasks. Your contributions will be essential in advancing robotics by enabling fluid, reliable, and safe interactions between robots and their environments. Key job responsibilities - Develop controllers that leverage reinforcement learning, imitation learning, or other advanced AI techniques to achieve natural, robust, and adaptive motor behaviors - Collaborate with multi-disciplinary teams to integrate motor control systems with robotic hardware, ensuring alignment with real-world constraints such as actuator dynamics and energy efficiency - Use simulation and real-world testing to refine and validate control algorithms - Stay updated on advancements in robotics, AI, and control systems to apply advanced techniques to robotic motion challenges - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers - Bridge research initiatives with practical engineering implementation About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you. an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
US, NY, New York
We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance. You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection. The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems. Key job responsibilities - Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios - Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies - Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs - Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection - Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection - Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack - Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
US, NY, New York
We are seeking a Robotics/AI Motor Control Scientist to develop cutting-edge machine learning algorithms for motor control systems in robots. In this role, you will focus on creating and optimizing intelligent motor control strategies to enable robots to perform complex, whole-body tasks. Your contributions will be essential in advancing robotics by enabling fluid, reliable, and safe interactions between robots and their environments. Key job responsibilities - Develop controllers that leverage reinforcement learning, imitation learning, or other advanced AI techniques to achieve natural, robust, and adaptive motor behaviors - Collaborate with multi-disciplinary teams to integrate motor control systems with robotic hardware, ensuring alignment with real-world constraints such as actuator dynamics and energy efficiency - Use simulation and real-world testing to refine and validate control algorithms - Stay updated on advancements in robotics, AI, and control systems to apply advanced techniques to robotic motion challenges - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers - Bridge research initiatives with practical engineering implementation About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you. an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
AU, VIC, Melbourne
Are you excited about leveraging state-of-the-art Computer Vision algorithms and large datasets to solve real-world problems? Join Amazon as an Applied Scientist Intern and be at the forefront of AI innovation! As an Applied Scientist Intern, you'll work in a fast-paced, cross-disciplinary team of pioneering researchers. You'll tackle complex problems, developing solutions that either build on existing academic and industrial research or stem from your own innovative thinking. Your work may even find its way into customer-facing products, making a real-world impact. Key job responsibilities - Develop novel solutions and build prototypes - Work on complex problems in Computer Vision and Machine Learning - Contribute to research that could significantly impact Amazon's operations - Collaborate with a diverse team of experts in a fast-paced environment - Collaborate with scientists on writing and submitting papers to Tier-1 conferences (e.g., CVPR, ICCV, NeurIPS, ICML) - Present your research findings to both technical and non-technical audiences Key Opportunities: - Collaborate with leading machine learning researchers - Access innovative tools and hardware (large GPU clusters) - Address challenges at an unparalleled scale - Become a disruptor, innovator, and problem solver in the field of computer vision - Potentially deliver solutions to production in customer-facing applications - Opportunities to become an FTE after the internship Join us in shaping the future of AI at Amazon. Apply now and turn your research into real-world solutions!
US, WA, Seattle
The Alexa for Shopping team is seeking a customer-obsessed senior economist to own and drive analytics strategy for GenAI-powered Shopping experiences. This role will partner closely with senior leaders to deliver high-quality insights that inform executive decision-making for the AI shopping assistant, Rufus. The successful candidate will demonstrate strong attention to detail, excellent written and verbal communication, and the ability to influence across organizations. In this role, you will mentor and set the bar for data science, economics, and engineering partners by establishing best practices for understanding customer behavior in AI-driven shopping experiences. You will invent and scale metrics that measure customer adoption and habituation, and build agentic, automated analytical workflows that enable fast, repeatable deep dives. This position will play a critical role in shaping product roadmap and investment decisions in a rapidly evolving GenAI space. The ideal candidate will operate effectively in ambiguous environments, exercise strong business judgment on high-impact, one-way door decisions, and continuously raise the bar for analytical rigor and operational excellence. You will work cross-functionally with product, engineering, and economics partners to deliver results for customers Key job responsibilities - Own the development of customer and shopping-mission cohorts to understand behavior with and without Rufus engagement across the end-to-end shopping journey. - Identify which Rufus query types and interaction patterns drive the most customer value for specific customer cohorts and shopping missions. - Build predictive models to estimate customer re-engagement and long-term adoption of Rufus based on interaction quality and downstream shopping outcomes. - Invent, operationalize, and publish scalable metrics and dashboards that surface actionable insights, enabling data-driven product growth and executive decision-making. - Partner closely with Product, Engineering, and Economics teams to translate analytical insights into roadmap priorities and customer-focused improvements. About the team The Alexa for Shopping economics team focuses on understanding how GenAI-powered shopping tools are transforming customer behavior across the shopping lifecycle - from inspiration and problem-solving, to product research, selection, purchase, and post-purchase support. We build the foundational measurement frameworks that enable teams to evaluate performance, identify what Rufus experiences resonate most with customers, and uncover opportunities for improvement. Our work directly influences customer-centric product roadmap decisions and helps scale impactful, high-quality AI shopping experiences
US, CA, San Francisco
Amazon’s Frontier AI & Robotics (FAR) team is seeking a Member of Technical Staff to drive foundational research and build intelligent robotic systems from the ground up. In this role, you will operate at the intersection of cutting-edge AI research and real-world robotics - conducting original research, publishing, and deploying your innovations into production systems at Amazon scale. We’re looking for researchers who think from first principles, push the boundaries of what’s possible, and take full ownership of turning breakthrough ideas into working systems.  You will join the next revolution in robotics, where you'll work alongside world-renowned AI pioneers to push the boundaries of what's possible in robotic intelligence. As a Member of Technical Staff, you'll be at the forefront of developing breakthrough foundation models and full-stack robotics systems that enable robots to perceive, understand, and interact with the world in unprecedented ways. You'll drive technical excellence and independent research initiatives in areas such as locomotion, manipulation, perception, sim2real transfer, multi-modal, multi-task robot learning, designing novel frameworks that bridge the gap between state-of-the-art research and real-world deployment at Amazon scale. In this role, you'll balance innovative technical exploration with practical implementation, collaborating with platform teams to ensure your models and algorithms perform robustly in dynamic real-world environments. You’ll have the freedom to pursue ambitious research directions while leveraging Amazon’s vast computational resources to tackle ambiguous problems in areas like very large multi-modal robotic foundation models and efficient, promptable model architectures that can scale across diverse robotic applications. Key job responsibilities - Drive independent research initiatives across the robotics stack, driving breakthrough approaches through hands-on research and development in areas including robot co-design, dexterous manipulation mechanisms, innovative actuation strategies, state estimation, low-level control, system identification, reinforcement learning, sim-to-real transfer, as well as foundation models focusing on breakthrough approaches in perception, and manipulation. - Lead and Guide technical direction for full-stack robotics projects from conceptualization through deployment, taking a system-level approach that integrates hardware considerations with algorithmic development - Develop and optimize control algorithms and sensing pipelines that enable robust performance in production environments - Collaborate with platform and hardware teams to ensure seamless integration across the entire robotics stack, optimizing and scaling models for real-world applications - Contribute to team's technical decisions and influence implementation strategies to help shape our approach to next-generation robotics challenges - Mentor fellow researchers while maintaining solid individual technical contributions A day in the life - Design and implement novel foundation model architectures and innovative systems and algorithms, leveraging our extensive infrastructure to prototype and evaluate at scale - Collaborate with our world-class research team to solve complex technical challenges across the full robotics stack - Lead focused technical initiatives from conception through deployment, ensuring successful integration with production systems - Drive technical discussions and brainstorming sessions with team leaders, fellow researchers and key stakeholders - Conduct experiments and prototype new ideas using our massive compute cluster and extensive robotics infrastructure - Transform theoretical insights into practical solutions that can handle the complexities of real-world robotics applications About the team At Frontier AI & Robotics, we're not just advancing robotics – we're reimagining it from the ground up. Our team is building the future of intelligent robotics through innovative foundation models and end-to-end learned systems. We tackle some of the most challenging problems in AI and robotics, from developing sophisticated perception systems to creating adaptive manipulation strategies that work in complex, real-world scenarios. What sets us apart is our unique combination of ambitious research vision and practical impact. We leverage Amazon's massive computational infrastructure and rich real-world datasets to train and deploy state-of-the-art foundation models. Our work spans the full spectrum of robotics intelligence – from multimodal perception using images, videos, and sensor data, to sophisticated manipulation strategies that can handle diverse real-world scenarios. We're building systems that don't just work in the lab, but scale to meet the demands of Amazon's global operations. Join us if you're excited about pushing the boundaries of what's possible in robotics, working with world-class researchers, and seeing your innovations deployed at unprecedented scale.
US, CA, San Francisco
Amazon’s Frontier AI & Robotics (FAR) team is seeking a Member of Technical Staff to drive foundational research and build intelligent robotic systems from the ground up. In this role, you will operate at the intersection of cutting-edge AI research and real-world robotics - conducting original research, publishing, and deploying your innovations into production systems at Amazon scale. We’re looking for researchers who think from first principles, push the boundaries of what’s possible, and take full ownership of turning breakthrough ideas into working systems.  You will join the next revolution in robotics, where you'll work alongside world-renowned AI pioneers to push the boundaries of what's possible in robotic intelligence. As a Member of Technical Staff, you'll be at the forefront of developing breakthrough foundation models and full-stack robotics systems that enable robots to perceive, understand, and interact with the world in unprecedented ways. You'll drive technical excellence and independent research initiatives in areas such as locomotion, manipulation, perception, sim2real transfer, multi-modal, multi-task robot learning, designing novel frameworks that bridge the gap between state-of-the-art research and real-world deployment at Amazon scale. In this role, you'll balance innovative technical exploration with practical implementation, collaborating with platform teams to ensure your models and algorithms perform robustly in dynamic real-world environments. You’ll have the freedom to pursue ambitious research directions while leveraging Amazon’s vast computational resources to tackle ambiguous problems in areas like very large multi-modal robotic foundation models and efficient, promptable model architectures that can scale across diverse robotic applications. Key job responsibilities - Drive independent research initiatives across the robotics stack, including robot co-design, dexterous manipulation mechanisms, innovative actuation strategies, state estimation, low-level control, system identification, reinforcement learning, sim-to-real transfer, as well as foundation models focusing on breakthrough approaches in perception, and manipulation, for example open-vocabulary panoptic scene understanding, scaling up multi-modal LLMs, sim2real/real2sim techniques, end-to-end vision-language-action models, efficient model inference, video tokenization - Design and implement novel deep learning architectures that push the boundaries of what robots can understand and accomplish - Guide technical direction for full-stack robotics projects from conceptualization through deployment, taking a system-level approach that integrates hardware considerations with algorithmic development, ensuring robust performance in production environments - Collaborate with platform and hardware teams to ensure seamless integration across the entire robotics stack, optimizing and scaling models for real-world applications - Contribute to team's technical decisions and influence implementation strategies to help shape our approach to next-generation robotics challenges - Mentor fellow researchers while maintaining solid individual technical contributions A day in the life - Design and implement novel foundation model architectures and innovative systems and algorithms, leveraging our extensive infrastructure to prototype and evaluate at scale - Collaborate with our world-class research team to solve complex technical challenges across the full robotics stack - Lead focused technical initiatives from conception through deployment, ensuring successful integration with production systems - Drive technical discussions and brainstorming sessions with team leaders, fellow researchers and key stakeholders - Conduct experiments and prototype new ideas using our massive compute cluster and extensive robotics infrastructure - Transform theoretical insights into practical solutions that can handle the complexities of real-world robotics applications About the team At Frontier AI & Robotics, we're not just advancing robotics – we're reimagining it from the ground up. Our team is building the future of intelligent robotics through innovative foundation models and end-to-end learned systems. We tackle some of the most challenging problems in AI and robotics, from developing sophisticated perception systems to creating adaptive manipulation strategies that work in complex, real-world scenarios. What sets us apart is our unique combination of ambitious research vision and practical impact. We leverage Amazon's massive computational infrastructure and rich real-world datasets to train and deploy state-of-the-art foundation models. Our work spans the full spectrum of robotics intelligence – from multimodal perception using images, videos, and sensor data, to sophisticated manipulation strategies that can handle diverse real-world scenarios. We're building systems that don't just work in the lab, but scale to meet the demands of Amazon's global operations. Join us if you're excited about pushing the boundaries of what's possible in robotics, working with world-class researchers, and seeing your innovations deployed at unprecedented scale.
IN, KA, Bengaluru
Amazon is looking for a passionate, talented, and inventive Applied Scientists with machine learning background to help build industry-leading Speech and Language technology. Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Automatic Speech Recognition (ASR), Natural Language Understanding (NLU), Machine Learning (ML) and Computer Vision (CV). Key job responsibilities Amazon is looking for a passionate, talented, and inventive Applied Scientists with machine learning background to help build industry-leading Speech and Language technology. Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Automatic Speech Recognition (ASR), Natural Language Understanding (NLU), Machine Learning (ML) and Computer Vision (CV). As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop novel algorithms and modeling techniques to advance the state-of-the-art in human language technology. Your work will directly impact millions of our customers in the form of products and services that make use of speech and language technology. You will gain hands on experience with Amazon’s heterogeneous speech, text, and structured data sources, and large-scale computing resources to accelerate advances in spoken language understanding. We are hiring in all areas of human language technology: ASR, MT, NLU, text-to-speech (TTS), and Dialog Management, in addition to Computer Vision. We are also looking for talents with experiences/expertise in building large-scale, high-performing systems. A day in the life 0