Can you teach a computer to smell? Osmo is trying

The company’s work, supported by the Amazon Alexa Fund, has relevant applications for areas from perfumes to disease detection.

At the age of 12, Alex Wiltschko bought his first perfume, Azzaro pour Homme. He’d read about it in his favorite book — Perfumes: The Guide, by Luca Turin — and was thrilled to find it at a knock-down price at his local TJ Maxx. It would be the first in a large collection.

For as long as he can remember, Wiltschko has been obsessed by scent. “It’s how I’m wired,” he says. His other obsession? Computers. “An interest in perfumes and computers was not the recipe for social success as an adolescent,” he adds.

It was, however, the recipe for a life trajectory that took Wiltschko deep into the neuroscience of olfaction and cutting-edge machine learning. This combination has placed Wiltschko at the forefront of the nascent science of digital olfaction — a.k.a. giving computers a sense of smell.

Wiltschko is now the CEO of Osmo, a Google Research spinout based in Cambridge, Massachusetts. In September 2022, the company hit the ground running with $60 million in initial funding, including an investment from the Amazon Alexa Fund.

In the short term, Osmo aims to unlock a new era of commercial fragrance innovation. Longer term, the company envisions its technologies having the potential to save lives through the development of better insect repellents and even digital diagnostic tools for detecting serious illnesses on a person's breath.

The Principal Odor Map

The keystone to all this is the team’s breakthrough advance: the creation of what it calls the Principal Odor Map (POM).

Before vision could be digitized, a map called RGB was required: It shows how every color is made up of varying proportions of red, green, and blue. Before Osmo was spun out, Wiltschko’s team did something similar — and remarkable — with odor. They used machine learning to map the structure of a molecule directly to how humans perceive the smell of that molecule. In other words, they built a model that can tell you what a molecule smells like just by looking at it. This is the POM.

That was an ‘a-ha!’ moment for us, akin to passing a Turing test for odor. We'd built something with real commercial value that was sufficiently validated to bring into the world.
Jon Hennek

Here’s how they created POM and, crucially, how they proved it worked. They first trained a graph neural network (GNN) on about 5,000 molecules from several flavor and fragrance databases. The smells of all these molecules were well-documented with multiple human-judged odor labels such as beefy, floral, or minty. From this, the model was able to learn connections between molecular structure and odor, without needing any knowledge of what actually happens in the nose or brain of a person sniffing an odor.

That’s great, as far as it goes. The crucial question then was, could POM generalize to predict the smell of molecules it had never seen before, based solely on their molecular structure? And could it do that as well as trained human raters, which is the gold standard for odor characterization? To find out, the team took a diverse set of more than 400 odor molecules previously unseen by POM and had the model blindly predict their characteristics. Then a panel of trained human raters sniffed and labeled those same odors.

When the Osmo team compared the results, they were delighted. Not only had the model successfully predicted the odor of these unseen molecules as well as trained humans, but its predicted odor profiles were closer to the average results of the panel than any of the individual panelists themselves.

“That was an ‘a-ha!’ moment for us, akin to passing a Turing test for odor,” says Jon Hennek, chief product officer at Osmo. “We'd built something with real commercial value that was sufficiently validated to bring into the world.”

Islands of odor

POM is not a map in the typical sense, but it can nevertheless be compared to the RGB map. Pick two points at random on a two-dimensional color map. The closer those two points are to each other, the more similar the color. The same is true for odors in POM, though this map exists in a mind-bending 256 dimensions. All of the tulip-smelling molecules are close to each other, for example. Ditto for the brandy-smelling molecules.

“Zooming out a little, all the flowers are next to each other. There's a whole floral Pangaea in this odor map! We didn't tell it to do that,” says Wiltschko. This sort of grouping is also true for woods, bakery-type smells, alcoholic smells, you name it. Our brain seems to organize smells in nested hierarchies, says Wiltschko, so the rose odor is inside the rose category, inside the flowers category, inside the plants category, inside the pleasant category.

“The fact that we were able to observe this in the POM without telling it is astounding,” he says.

On the left is a color map (the CIE 1931 color space chromaticity diagram), similar colors lie near each other. On the right is Osmo’s Principal Odor Map, individual molecules (grey points) are found nearer to each other if they are predicted to smell similar.
In this color map (the CIE 1931 color space chromaticity diagram), similar colors lie near each other. Likewise, in Osmo’s Principal Odor Map, individual molecules (grey points) are found nearer to each other if they are predicted to smell similar.
Courtesy of Osmo

While Wiltschko has bold ideas for the future of Osmo’s technology, the first order of business is putting the company on a solid commercial footing. For now, Osmo is concentrating on developing new ingredients for the global fragrance category.

The Osmo team is using POM to explore the world of odor molecules — several billion of them — and homing in on molecules that POM predicts to have an interesting and strong olfactory character.

“We're much better at that, I believe, than anybody else in the world,” says Hennek. “Because rather than start with rules of thumb and chemical intuition, we are starting with an odor prediction for every molecule we could possibly synthesize. It lets us find molecules that a chemist might never have considered.”

The team is working with advisors, including Christophe Laudamiel, a French master perfumer, and potential customers include fragrance houses and packaged goods companies.

More from Alexa Fund
Alexa Fund company’s assisted reality tech could unlock speech for hundreds of millions of people who struggle to communicate.

“We've had repeated feedback that our ingredients have the potential to be very successful, commercially,” says Wiltschko. “That smells like product/market fit.” The principal idea is to license those molecules to fragrance houses.

It’s a timely endeavor. The global fragrance category is valued at more than $10 billion and growing steadily. But some traditional ingredients, such as sandalwood oils, can result in over-harvesting or other ecological harm, while the characteristics of other ingredients increasingly fall short as the demand grows for safer, more biodegradable products.

With POM, Osmo is paving the way for palettes of safe, synthetic fragrances that recreate natural odors using environmentally friendly and easily synthesized molecules. To that end Osmo is looking at combinations of just a handful of atoms: carbon, hydrogen, oxygen, nitrogen, phosphorus, and sulfur.

“Then we bring them into our lab for a process akin to a drug discovery pipeline,” says Hennek. “We are working towards regulatory approval of those molecules.”

Rise of the graph neural networks

All of this has only become possible in the last six years or so. The core insight that started this scientific project, says Wiltschko, was that machine learning was “getting really good at molecules,” thanks to the recent rise of GNNs.

Related content
Dual embeddings of each node, as both source and target, and a novel loss function enable 30% to 160% improvements over predecessors.

Previously, machine learning approaches primarily converted inputs — images or data arrays, say — into rectangles or data grids to process them. Molecules didn’t fit this mold: a molecule might be two atoms, or it might be 20 atoms, with wildly different structure and connectivity. They are simply not reducible to rectangles or grids.

Instead, the atoms in a molecule can be considered as nodes, and the chemical bonds between them as edges, forming a graph structure. This representation allows GNNs to model and process molecular data.

“Some of this technology was developed by friends of mine at Google. So, it was a fantastic, fertile ground to start exploring this idea,” says Wiltschko.

This ongoing exploration is creating some exciting possibilities. Wiltschko reasoned that, just as the sun has shone on Earth since before life began, resulting in many creatures evolving similar visual apparatuses, the composition of the Earth’s atmosphere has been broadly stable over evolutionary time. So could POM also be used to understand the olfactory responses of other species, even those separated from humans by millions of years of evolution?

Life-saving potential

Take mosquitos. Could POM be used to work out what odors repel these disease-carrying insects?

To find out, they augmented POM with additional data sources. The first was a long-forgotten U.S. government report, published in the 1940s, that featured the results of testing 19,000 compounds for their mosquito repellency. The second was information provided by TropIQ, a Dutch company that develops malaria-control technology. The augmented model was soon able to predict entirely new molecules with repellency at least as powerful as DEET, the active ingredient in the most effective mosquito repellents.

osmo image 2.png
Osmo digitized mosquito-repellency data for 19,000 compounds reported on by the United States Department of Agriculture and used that to refine its model (left). The team then predicted candidate molecules that would be most repellent to mosquitos, produced the most viable options, tested them on real mosquitos, and fed those results back into the model to further refine it.
Courtesy of Osmo

The development of cheaper, more effective, and safer insect repellents could have a huge impact on global health. Wiltschko has nothing to announce yet, but says this research is ongoing in collaboration with the Bill & Melinda Gates Foundation.

Applying POM to mosquitos is also a proof of concept, says Hennek. “We can picture applying our product not just to what mosquitoes don’t like, but to what roaches don’t like. Or any number of agricultural pests.”

Capturing smell forever

Looking further down the road, Wiltschko’s vision is to digitize our sense of smell. The idea is not as far-fetched as it sounds. Consider several hundred years ago. The idea that a visual moment — the fleeting expression on your child’s face or an orchard of apple trees in blossom — could be instantly captured and made available forever more in perfect color would have been nothing short of magical thinking.

By the 1820s came the first photography, and with it, the first steps towards human mastery of the world of light. Today, it feels like a fundamental right to freeze those visual memories and hold on to them forever. And the same goes for the auditory world.

“We know what’s required to digitize a human sense,” says Wiltschko. “And we don't have to wait for any of the inventions that vision did — particularly integrated circuits.”

Indeed, with modern computing power and the harnessing of machine learning, Wiltschko reckons computers will have a “sense of smell” within a decade or two. Three stages are required: “reading” smell, understanding it, and “writing” it. Osmo wants to understand, and ultimately curate a wide palette of safe, synthetic molecules that can recreate the entire human smellscape. The reading (sensing) of odorous molecules currently requires bulky and expensive lab equipment, such as a gas chromatography mass spectrometer, while the writing (producing) of smells on demand remains science fiction at the consumer level, says Wiltschko, for now.

A window to the inside

Sensing and understanding odor at a high level may be sufficient to herald powerful health applications, says Wiltschko. For example, it is well established that serious illnesses, including some cancers, can be detected through their effect on your breath. Being able to take a snapshot of that odor profile — an “Osmograph”, in Wiltschko’s words – could reveal a great deal about what’s going on inside our bodies.

“We don't know if that technology will ultimately have a transformative effect on healthcare, but I am betting that it will,” he says.

Related content
ARA recipient Marinka Zitnik is focused on how machine learning can enable accurate diagnoses and the development of new treatments and therapies.

It’s very important to Wiltschko that, down the line, Osmo grows to develop clinical diagnostics applications. “That's the North Star for me, and it's very important that we get there. But the sheer cost and the talent that's required is rare and expensive,” he says. “So, it can’t be the first beach that we storm.”

As Osmo grows, it will be looking for similarly passionate people to push the mission forward. “We've been finding that there are people out there who are secret scent lovers, who secretly aspire to work in the field of machine olfaction,” says Wiltschko. “Just to put it out there: there's one place to do this, and it's Osmo.”

Talking to Wiltschko and those inspired to work alongside him, it is clear to see that Osmo is the culmination of his lifelong passions. For him, it’s emotional. “Once you smell a thing, you cannot stop the feelings that you get from it. There's a very fundamental feeling and emotional component,” he says, “and I think that’s beautiful.”

Research areas

Related content

IN, KA, Bengaluru
Are you passionate about solving complex business problems at scale through Generative AI? Do you want to help build intelligent systems that reason, act, and learn from minimal supervision? If so, we have an exciting opportunity for you on Amazon's Trustworthy Shopping Experience (TSE) team. At TSE, our vision is to guarantee customers a worry-free shopping experience by earning their trust that the products they buy are safe, authentic, and compliant with regulations and policy. We do this in close partnership with our selling partners, empowering them with best-in-class tools and expertise to offer a high-quality, compliant selection that customers trust. As an Applied Scientist I, you will bring subject matter expertise in at least one relevant discipline (e.g., NLP, computer vision, representation learning, agentic architecture) to contribute to next-generation agentic AI solutions that automate complex manual investigation processes at Amazon scale. Working alongside senior scientists, you will map business goals—such as reducing cost-of-serving while maintaining trust and safety standards—to well-defined scientific problems and metrics. You will invent, refine, and experiment with solutions spanning agentic reasoning, self-supervised representation learning, few-shot adaptation, multimodal understanding, and model compression. With guidance from senior scientists, you will stay current on research trends and benchmark your results against the state of the art. You will help design and execute experiments to identify optimal solutions, initiating the development and implementation of small components with team guidance. You will write secure, stable, testable, and well-documented production code at the level of an SDE I, rigorously evaluating models and quantifying performance. You will handle data in accordance with Amazon policies, troubleshoot issues to root cause, and ensure your work does not put the company at risk. Your scope of influence will typically be at the self-level, with the possibility of mentoring interns. You will participate in team design and prioritization discussions, learn the business context behind TSE's products, and escalate problems with proposed solutions. You will publish internal technical reports and may contribute to peer-reviewed publications and external review activities when aligned with business needs. This role offers a unique opportunity to contribute to end-to-end AI development—from research through production—with your contributions serving hundreds of millions of customers within months, not years. Key job responsibilities • Contribute to the design and development of agentic AI systems with multi-step reasoning, autonomous task execution, and multimodal intelligence, including feedback and memory mechanisms, leveraging reinforcement learning techniques for agent decision-making and policy optimization, with input and guidance from senior scientists • Help productionize models built on top of SFT (Supervised Fine-tuning) and RFT (Reinforced Fine-tuning) approaches, as well as few-shot approaches based on multimodal datasets spanning text, images, and structured data, applying mathematical optimization techniques to improve efficiency, resource allocation, and decision-making in complex workflows, working alongside senior scientists to identify optimal solutions • Contribute to building production-ready deep learning and conventional ML solutions, including multimodal fusion and cross-modal alignment techniques that seamlessly connect visual, textual, and relational understanding, to support automation requirements within your team's scope • Help identify customer and business problems; use reasonable assumptions, data, and customer requirements to solve well-defined scientific problems involving multimodal inputs such as unstructured text, documents, product images, and relational data, developing representations that capture complementary signals across modalities and mapping business goals to scientific metrics • May co-author research papers for peer-reviewed internal and/or external venues, including contributions in areas such as multimodal representation learning and vision-language modeling, and contribute to the wider scientific community by reviewing research submissions, when aligned with business needs • Prototype rapidly, iterate based on feedback, and deliver small components at SDE I level—including multimodal data pipelines and inference modules—that integrate into production-scale systems • Write secure, stable, testable, maintainable, and well-documented code, balancing model capability, deployment cost, and resource usage across multimodal architectures while understanding state-of-the-art data structures, algorithms, and performance tradeoffs • Rigorously test code and evaluate models across individual and combined modalities, quantifying their performance; troubleshoot issues, research root causes, and thoroughly resolve defects, leaving systems more maintainable • Participate in team design, scoping, and prioritization discussions through clear verbal and written communication; seek to learn the business context, science, and engineering behind your team's products, including how multimodal signals contribute to trust and safety decisions • Participate in engineering best practices with peer reviews; clearly document approaches and communicate design decisions; publish internal technical reports to institutionalize scientific learning • Help train and mentor scientist interns; identify and escalate problems with proposed solutions, taking ownership or ensuring clear hand-off to the right owner About the team Trustworthy Shopping Experience Product team in TSE is responsible for the human-in-the-loop products and technology used in the risk investigations at Amazon. The team is also responsible for reducing the cost of performing the investigations, by automating wherever possible and optimizing the experience where manual interventions are needed. The team leverages state-of-the art technology and GenAI to deliver the products and associated goals.
US, NY, New York
Do you want to lead the Ads industry and redefine how we measure the effectiveness of Amazon Ads business? Are you passionate about causal inference, Deep Learning & AI, raising the science bar, and connecting leading-edge science research to Amazon-scale implementation? If so, come join Amazon Ads to be a science leader within our Advertising Incrementality Measurement science team! Our work builds the foundations for providing customer-facing advertising measurement tools, furthering internal research & development, and building out Amazon's advertising measurement offerings. Incrementality is a lynchpin for the next generation of Amazon Advertising measurement solutions, and this role will play a key role in the release and expansion of these offerings. We are looking for a thought leader that has an aptitude for delivering customer-focused solutions and who enjoys working on the intersection of Big-Data analytics, Machine/Deep Learning, and Causal Inference. A successful candidate will be a self-starter, comfortable with ambiguity, able to think big and be creative, while still paying careful attention to detail. You should be able to translate how data represents the customer journey, be comfortable dealing with large and complex data sets, and have experience using machine learning and/or econometric modeling to solve business problems. You should have strong analytical and communication skills, be able to work with product managers to define key business questions and work with the engineering team to bring our solutions into production. You will join a highly collaborative and diverse working environment that will empower you to shape the future of Amazon advertising, and also allow you to become part of our large science community. Key job responsibilities • Apply expertise in ML/DL, AI, and causal modeling to develop new models that describe how advertising impacts customers’ actions • Own the end-to-end development of novel scientific models that address the most pressing needs of our business stakeholders and help guide their future actions • Improve upon and simplify our existing solutions and frameworks • Review and audit modeling processes and results for other scientists, both junior and senior • Work with leadership to align our scientific developments with the business strategy • Identify new opportunities that are suggested by the data insights • Bring a department-wide perspective into decision making • Develop and document scientific research to be shared with the greater science community at Amazon About the team AIM is a cross disciplinary team of engineers, product managers, economists, data scientists, and applied scientists with a charter to build scientifically-rigorous causal inference methodologies at scale. Our job is to help customers cut through the noise of the modern advertising landscape and understand what actions, behaviors, and strategies actually have a real, measurable impact on key outcomes. The data we produce becomes the effective ground truth for advertisers and partners making decisions affecting millions in advertising spend.
US, NY, New York
The Ads Measurement Science team in the Measurement, Ad Tech, and Data Science (MADS) team of Amazon Ads serves a centralized role developing solutions for a multitude of performance measurement products. We create solutions which measure the comprehensive impact of advertiser's ad spend, including sales impacts both online and offline and across timescales, and provide actionable insights that enable our advertisers to optimize their media portfolios. We also own the science solutions for AI tools that unlock new insights and automate high-effort customer workflows, such as custom query and report generation based on natural language user requests. We leverage a host of scientific technologies to accomplish this mission, including Generative AI, classical ML, Causal Inference, Natural Language Processing, and Computer Vision. As an Applied Scientist on the team, you will lead measurement solutions end-to-end from inception to production. You will propose, design, analyze, and productionize models to provide novel measurement insights to our customers. Key job responsibilities - Leverage deep expertise in one or more scientific disciplines to invent solutions to ambiguous ads measurement problems - Disambiguate problems to propose clear evaluation frameworks and success criteria - Work autonomously and write high quality technical documents - Implement a significant portion of critical-path code, and partner with engineers to directly carry solutions into production - Partner closely with other scientists to deliver large, multi-faceted technical projects - Share and publish works with the broader scientific community through meetings and conferences - Communicate clearly to both technical and non-technical audiences - Contribute new ideas that shape the direction of the team's work - Mentor more junior scientists and participate in the hiring process About the team We are a team of scientists across Applied, Research, Data Science and Economist disciplines. You will work with colleagues with deep expertise in ML, NLP, CV, Gen AI, and Causal Inference with a diverse range of backgrounds. We partner closely with top-notch engineers, product managers, sales leaders, and other scientists with expertise in the ads industry and on building scalable modeling and software solutions.
US, NY, New York
The Ads Measurement Science team in the Measurement, Ad Tech, and Data Science (MADS) team of Amazon Ads serves a centralized role developing solutions for a multitude of performance measurement products. We create solutions which measure the comprehensive impact of advertiser's ad spend, including sales impacts both online and offline and across timescales, and provide actionable insights that enable our advertisers to optimize their media portfolios. We also own the science solutions for AI tools that unlock new insights and automate high-effort customer workflows, such as custom query and report generation based on natural language user requests. We leverage a host of scientific technologies to accomplish this mission, including Generative AI, classical ML, Causal Inference, Natural Language Processing, and Computer Vision. As an Applied Scientist on the team, you will lead measurement solutions end-to-end from inception to production. You will propose, design, analyze, and productionize models to provide novel measurement insights to our customers. Key job responsibilities - Leverage deep expertise in one or more scientific disciplines to invent solutions to ambiguous ads measurement problems - Disambiguate problems to propose clear evaluation frameworks and success criteria - Work autonomously and write high quality technical documents - Implement a significant portion of critical-path code, and partner with engineers to directly carry solutions into production - Partner closely with other scientists to deliver large, multi-faceted technical projects - Share and publish works with the broader scientific community through meetings and conferences - Communicate clearly to both technical and non-technical audiences - Contribute new ideas that shape the direction of the team's work - Mentor more junior scientists and participate in the hiring process About the team We are a team of scientists across Applied, Research, Data Science and Economist disciplines. You will work with colleagues with deep expertise in ML, NLP, CV, Gen AI, and Causal Inference with a diverse range of backgrounds. We partner closely with top-notch engineers, product managers, sales leaders, and other scientists with expertise in the ads industry and on building scalable modeling and software solutions.
ES, B, Barcelona
Are you interested in changing how Amazon does marketing — moving beyond platform-optimized broad reach to campaigns that find the right customer, at the right moment, using Amazon's unmatched 1P data? We are seeking an Applied Scientist to join PRIMAS (Prime & Marketing Analytics and Science). In this role, you will design and run the experiments that answer the foundational question for EU marketing: does adding 1P audience signal on top of Value-Based Optimization (VBO) improve marketing efficiency — and if so, for which customer cohorts, on which surfaces, and at what scale? Amazon's current marketing model is largely platform-led: we set objectives and let platforms optimize toward conversion. This approach works well for broad acquisition but systematically underserves lifecycle goals — it cannot distinguish between a Bargain Hunter who will never pay full price and a high-potential customer one nudge away from becoming a Prime member. This role sits at the center of changing that. You will build the 1P audiences, design the experiments that test them, and generate the evidence that guides how Amazon allocates hundreds of millions in marketing spend. Year 1 is an experimentation year. You will deploy 1P audiences across multiple surfaces and channels — Meta, Google, Amazon Display Ads — and measure incrementally against VBO baselines. The goal is not to replace platform optimization but to understand when and where the combination of 1P signal + VBO outperforms VBO alone, and to build the experimental infrastructure that makes this learning scalable. Key job responsibilities 1P Audience Development & Experimentation: - Build and validate 1P audience segments from Amazon behavioral, transactional, and lifecycle data - Design experiments that isolate the incremental effect of 1P audience signal over platform VBO baselines - Deploy audiences across activation surfaces and establish measurement standards that make cross-surface comparison valid Causal Measurement & Incrementality: - Apply causal inference methods to measure the true incremental lift of audience-based targeting vs. VBO - Develop power analysis frameworks and guardrails that enable rapid experimentation without underpowered or conflated tests - Deliver optimization recommendations grounded in experimental evidence: which cohorts respond, which surfaces deliver, which creative strategies drive behavior change Scaling the Learning: - Build reusable audience and measurement frameworks that can be deployed across campaigns and channels — year 1 experiments should produce infrastructure, not one-off analyses - Document experimental learnings in a way that informs both the 2026 roadmap and the business case for investing further in 1P audience capabilities in 2027+ - Partner with engineering and PMT to translate validated audience prototypes into production-ready solutions that scale beyond the experimentation phase About the team The PRIMAS team, is part of a larger tech tech team of 100+ people called WIMSI (WW Integrated Marketing Systems and Intelligence). WIMSI core mission is to accelerate marketing technology capabilities that enable de-averaged customer experiences across the marketing funnel: awareness, consideration, and conversion.
US, MA, Boston
We're a new research lab based in San Francisco and Boston focused on developing foundational capabilities for useful AI agents. We're pursuing several key research bets that will enable AI agents to perform real-world actions, learn from human feedback, self-course-correct, and infer human goals. We're particularly excited about combining large language models (LLMs) with reinforcement learning (RL) to solve reasoning and planning, learned world models, and generalizing agents to physical environments. We're a small, talent-dense team with the resources and scale of Amazon. Each team has the autonomy to move fast and the long-term commitment to pursue high-risk, high-payoff research. AI agents are the next frontier—the right research bets can reinvent what's possible. Join us and help build this lab from the ground up. Key job responsibilities * Define the product vision and roadmap for our agentic developer platform, translating research into products developers love * Partner deeply with research and engineering to identify which capabilities are ready for productization and shape how they're exposed to customers * Own the developer experience end-to-end from API design and SDK ergonomics to documentation, sample apps, and onboarding flows * Understand our customers deeply by engaging directly with developers and end-users, synthesizing feedback, and using data to drive prioritization * Shape how the world builds AI agents by defining new primitives, patterns, and best practices for agentic applications About the team Our team brings the AGI Lab's agent capabilities to customers. We build accessible, usable products: interfaces, frameworks, and solutions, that turn our platform and model capabilities into AI agents developers can use. We own the Nova Act agent playground, Nova Act IDE extension, Nova Act SDK, Nova Act AWS Console, reference architectures, sample applications, and more.
US, CA, San Francisco
Amazon is on a mission to redefine the future of automation — and we're looking for exceptional talent to help lead the way. We are building the next generation of advanced robotic systems that seamlessly blend cutting-edge AI, sophisticated control systems, and novel mechanical design to create adaptable, intelligent automation solutions capable of operating safely alongside humans in dynamic, real-world environments. At Amazon, we leverage the power of machine learning, artificial intelligence, and advanced robotics to solve some of the most complex operational challenges at a scale unlike anywhere else in the world. Our fleet of robots spans hundreds of facilities globally, working in sophisticated coordination to deliver on our promise of customer excellence — and we're just getting started. As a Sr. Scientist in Robot Navigation, you will be at the forefront of this transformation — architecting and delivering navigation systems that are intelligent, safe, and scalable. You will bring deep expertise in learning-based planning and control, a strong understanding of foundation models and their application to embodied agents, and as well as have in-depth understanding of control-theoretic approaches such as model predictive control (MPC)-based trajectory planning. You will develop navigation solutions that seamlessly blend data-driven intelligence with principled control-theoretic guarantees. Our vision is bold: to build navigation systems that allow robots to move fluidly and safely through dynamic environments — understanding context, anticipating change, and adapting in real time. You will lead research that bridges the gap between cutting-edge academic advances and production grade deployment, collaborating with world-class teams pushing the boundaries of robotic autonomy, manipulation, and human-robot interaction. Join us in building the next generation of intelligent navigation systems that will define the future of autonomous robotics at scale. Key job responsibilities - Design, develop, and deploy perception algorithms for robotics systems, including object detection, segmentation, tracking, depth estimation, and scene understanding - Lead research initiatives in computer vision, sensor fusion and 3D perception - Collaborate with cross-functional teams including robotics engineers, software engineers, and product managers to define and deliver perception capabilities - Drive end-to-end ownership of ML models — from data collection and labeling strategy to training, evaluation, and deployment - Mentor junior scientists and engineers; contribute to a culture of technical excellence - Define and track key metrics to measure perception system performance in real-world environments - Publish research findings in top-tier venues (CVPR, ICCV, ECCV, ICRA, NeurIPS, etc.) and contribute to patents A day in the life - Train ML models for deployment in simulation and real-world robots, identify and document their limitations post-deployment - Drive technical discussions within your team and with key stakeholders to develop innovative solutions to address identified limitations - Actively contribute to brainstorming sessions on adjacent topics, bringing fresh perspectives that help peers grow and succeed — and in doing so, build lasting trust across the team - Mentor team members while maintaining significant hands-on contribution to technical solutions About the team Our team is a group is a diverse group of scientists and engineers passionate about building intelligent machines. We value curiosity, rigor, and a bias for action. We believe in learning from failure and iterating quickly toward solutions that matter.
US, NY, New York
The Ads Measurement Science team in the Measurement, Ad Tech, and Data Science (MADS) team of Amazon Ads serves a centralized role developing solutions for a multitude of performance measurement products. We create solutions which measure the comprehensive impact of advertiser's ad spend, including sales impacts both online and offline and across timescales, and provide actionable insights that enable our advertisers to optimize their media portfolios. We also own the science solutions for AI tools that unlock new insights and automate high-effort customer workflows, such as custom query and report generation based on natural language user requests. We leverage a host of scientific technologies to accomplish this mission, including Generative AI, classical ML, Causal Inference, Natural Language Processing, and Computer Vision. As a Senior Applied Scientist on the team, you will be at the forefront of innovation, developing measurement solutions end-to-end from inception to production. You will set the technical vision and innovate on behalf of our customers. You will propose, design, analyze, and productionize models to provide novel measurement insights to our customers. You will partner with engineering to deploy these solutions into production. You will work with key stakeholders from various business teams to enable advertisers to act upon those metrics. Key job responsibilities * Lead the development of ad measurement models and solutions that address the full spectrum of an advertiser's investment, focusing on scalable and efficient methodologies. * Collaborate closely with cross-functional teams including engineering, product management, and business teams to define and implement measurement solutions. * Use state-of-the-art scientific technologies including Generative AI, Classical Machine Learning, Causal Inference, Natural Language Processing, and Computer Vision to develop state of the art models that measure the impact of ad spend across multiple platforms and timescales. * Drive experimentation and the continuous improvement of ML models through iterative development, testing, and optimization. * Translate complex scientific challenges into clear and impactful solutions for business stakeholders. * Mentor and guide junior scientists, fostering a collaborative and high-performing team culture. * Foster collaborations between scientists to move faster, with broader impact. * Regularly engage with the broader scientific community with presentations, publications, and patents. A day in the life You will solve real-world problems by getting and analyzing large amounts of data, generate business insights and opportunities, design simulations and experiments, and develop statistical and ML models. The team is driven by business needs, which requires collaboration with other Scientists, Engineers, and Product Managers across the advertising organization. You will prepare written and verbal presentations to share insights to audiences of varying levels of technical sophistication. Team video https://advertising.amazon.com/help/G4LNN5YWHP6SM9TJ About the team We are a team of scientists across Applied, Research, Data Science and Economist disciplines. You will work with colleagues with deep expertise in ML, NLP, CV, Gen AI, and Causal Inference with a diverse range of backgrounds. We partner closely with top-notch engineers, product managers, sales leaders, and other scientists with expertise in the ads industry and on building scalable modeling and software solutions.
US, WA, Seattle
At Amazon Selection and Catalog Systems (ASCS), our mission is to power the online buying experience for customers worldwide so they can find, discover, and buy any product they want. We innovate on behalf of our customers to ensure uniqueness and consistency of product identity and to infer relationships between products in Amazon Catalog to drive the selection gateway for the search and browse experiences on the website. We're solving a fundamental AI challenge: establishing product identity and relationships at unprecedented scale. Using Generative AI, Visual Language Models (VLMs), and multimodal reasoning, we determine what makes each product unique and how products relate to one another across Amazon's catalog. The scale is staggering: billions of products, petabytes of multimodal data, millions of sellers, dozens of languages, and infinite product diversity—from electronics to groceries to digital content. The research challenges are immense. GenAI and VLMs hold transformative promise for catalog understanding, but we operate where traditional methods fail: ambiguous problem spaces, incomplete and noisy data, inherent uncertainty, reasoning across both images and textual data, and explaining decisions at scale. Establishing product identities and groupings requires sophisticated models that reason across text, images, and structured data—while maintaining accuracy and trust for high-stakes business decisions affecting millions of customers daily. Amazon's Item and Relationship Platform group is looking for an innovative and customer-focused applied scientist to help us make the world's best product catalog even better. In this role, you will partner with technology and business leaders to build new state-of-the-art algorithms, models, and services to infer product-to-product relationships that matter to our customers. You will pioneer advanced GenAI solutions that power next-generation agentic shopping experiences, working in a collaborative environment where you can experiment with massive data from the world's largest product catalog, tackle problems at the frontier of AI research, rapidly implement and deploy your algorithmic ideas at scale, across millions of customers. Key job responsibilities Key job responsibilities include: * Formulate novel research problems at the intersection of GenAI, multimodal learning, and large-scale information retrieval—translating ambiguous business challenges into tractable scientific frameworks * Design and implement leading models leveraging VLMs, foundation models, and agentic architectures to solve product identity, relationship inference, and catalog understanding at billion-product scale * Pioneer explainable AI methodologies that balance model performance with scalability requirements for production systems impacting millions of daily customer decisions * Own end-to-end ML pipelines from research ideation to production deployment—processing petabytes of multimodal data with rigorous evaluation frameworks * Define research roadmaps aligned with business priorities, balancing foundational research with incremental product improvements * Mentor peer scientists and engineers on advanced ML techniques, experimental design, and scientific rigor—building organizational capability in GenAI and multimodal AI * Represent the team in the broader science community—publishing findings, delivering tech talks, and staying at the forefront of GenAI, VLM, and agentic system research
US, CA, San Francisco
In this role, you will act as the primary specialist for physics engine internals and dynamics, developing high-fidelity, vectorized simulation environments for robotics locomotion, navigation, and interaction/manipulation. You will collaborate with hardware engineers to validate robot models and partner with research scientists to ensure numerical stability and physical accuracy for Sim2Real transfer. Your work focuses on tuning solvers, optimizing collision dynamics, and performing system identification to enable the training of robust robot control policies for complex, physical interactions. Key job responsibilities * Develop and maintain the shared simulation software framework, specifically owning the physics integration, robot state management, and control layers * Develop and optimize parallelized (vectorized) physics environments for high-throughput reinforcement learning (e.g., Isaac Lab, MuJoCo) * Tune physics engine parameters (solvers, friction, restitution) to support complex contact-rich scenarios required for dexterous manipulation and agile locomotion. * Implement and validate complex robot models (URDF/MJCF) involving precise actuator and sensor modeling * Collaborate with robot engineers and scientists to perform System Identification (SysID) to minimize the Sim2Real gap About the team At Frontier AI & Robotics (FAR), we're not just advancing robotics – we're reimagining it from the ground up. Our team is building the future of intelligent robotics through frontier foundation models and end-to-end learned systems. We tackle some of the most challenging problems in AI and robotics, from developing sophisticated perception systems to creating adaptive manipulation strategies that work in complex, real-world scenarios. What sets us apart is our unique combination of ambitious research vision and practical impact. We leverage Amazon's massive computational infrastructure and rich real-world datasets to train and deploy state-of-the-art foundation models. Our work spans the full spectrum of robotics intelligence – from multimodal perception using images, videos, and sensor data, to sophisticated manipulation strategies that can handle diverse real-world scenarios. We're building systems that don't just work in the lab, but scale to meet the demands of Amazon's global operations. Join us if you're excited about pushing the boundaries of what's possible in robotics, working with world-class researchers, and seeing your innovations deployed at unprecedented scale.