Can you teach a computer to smell? Osmo is trying

The company’s work, supported by the Amazon Alexa Fund, has relevant applications for areas from perfumes to disease detection.

At the age of 12, Alex Wiltschko bought his first perfume, Azzaro pour Homme. He’d read about it in his favorite book — Perfumes: The Guide, by Luca Turin — and was thrilled to find it at a knock-down price at his local TJ Maxx. It would be the first in a large collection.

For as long as he can remember, Wiltschko has been obsessed by scent. “It’s how I’m wired,” he says. His other obsession? Computers. “An interest in perfumes and computers was not the recipe for social success as an adolescent,” he adds.

It was, however, the recipe for a life trajectory that took Wiltschko deep into the neuroscience of olfaction and cutting-edge machine learning. This combination has placed Wiltschko at the forefront of the nascent science of digital olfaction — a.k.a. giving computers a sense of smell.

Wiltschko is now the CEO of Osmo, a Google Research spinout based in Cambridge, Massachusetts. In September 2022, the company hit the ground running with $60 million in initial funding, including an investment from the Amazon Alexa Fund.

In the short term, Osmo aims to unlock a new era of commercial fragrance innovation. Longer term, the company envisions its technologies having the potential to save lives through the development of better insect repellents and even digital diagnostic tools for detecting serious illnesses on a person's breath.

The Principal Odor Map

The keystone to all this is the team’s breakthrough advance: the creation of what it calls the Principal Odor Map (POM).

Before vision could be digitized, a map called RGB was required: It shows how every color is made up of varying proportions of red, green, and blue. Before Osmo was spun out, Wiltschko’s team did something similar — and remarkable — with odor. They used machine learning to map the structure of a molecule directly to how humans perceive the smell of that molecule. In other words, they built a model that can tell you what a molecule smells like just by looking at it. This is the POM.

That was an ‘a-ha!’ moment for us, akin to passing a Turing test for odor. We'd built something with real commercial value that was sufficiently validated to bring into the world.
Jon Hennek

Here’s how they created POM and, crucially, how they proved it worked. They first trained a graph neural network (GNN) on about 5,000 molecules from several flavor and fragrance databases. The smells of all these molecules were well-documented with multiple human-judged odor labels such as beefy, floral, or minty. From this, the model was able to learn connections between molecular structure and odor, without needing any knowledge of what actually happens in the nose or brain of a person sniffing an odor.

That’s great, as far as it goes. The crucial question then was, could POM generalize to predict the smell of molecules it had never seen before, based solely on their molecular structure? And could it do that as well as trained human raters, which is the gold standard for odor characterization? To find out, the team took a diverse set of more than 400 odor molecules previously unseen by POM and had the model blindly predict their characteristics. Then a panel of trained human raters sniffed and labeled those same odors.

When the Osmo team compared the results, they were delighted. Not only had the model successfully predicted the odor of these unseen molecules as well as trained humans, but its predicted odor profiles were closer to the average results of the panel than any of the individual panelists themselves.

“That was an ‘a-ha!’ moment for us, akin to passing a Turing test for odor,” says Jon Hennek, chief product officer at Osmo. “We'd built something with real commercial value that was sufficiently validated to bring into the world.”

Islands of odor

POM is not a map in the typical sense, but it can nevertheless be compared to the RGB map. Pick two points at random on a two-dimensional color map. The closer those two points are to each other, the more similar the color. The same is true for odors in POM, though this map exists in a mind-bending 256 dimensions. All of the tulip-smelling molecules are close to each other, for example. Ditto for the brandy-smelling molecules.

“Zooming out a little, all the flowers are next to each other. There's a whole floral Pangaea in this odor map! We didn't tell it to do that,” says Wiltschko. This sort of grouping is also true for woods, bakery-type smells, alcoholic smells, you name it. Our brain seems to organize smells in nested hierarchies, says Wiltschko, so the rose odor is inside the rose category, inside the flowers category, inside the plants category, inside the pleasant category.

“The fact that we were able to observe this in the POM without telling it is astounding,” he says.

On the left is a color map (the CIE 1931 color space chromaticity diagram), similar colors lie near each other. On the right is Osmo’s Principal Odor Map, individual molecules (grey points) are found nearer to each other if they are predicted to smell similar.
In this color map (the CIE 1931 color space chromaticity diagram), similar colors lie near each other. Likewise, in Osmo’s Principal Odor Map, individual molecules (grey points) are found nearer to each other if they are predicted to smell similar.
Courtesy of Osmo

While Wiltschko has bold ideas for the future of Osmo’s technology, the first order of business is putting the company on a solid commercial footing. For now, Osmo is concentrating on developing new ingredients for the global fragrance category.

The Osmo team is using POM to explore the world of odor molecules — several billion of them — and homing in on molecules that POM predicts to have an interesting and strong olfactory character.

“We're much better at that, I believe, than anybody else in the world,” says Hennek. “Because rather than start with rules of thumb and chemical intuition, we are starting with an odor prediction for every molecule we could possibly synthesize. It lets us find molecules that a chemist might never have considered.”

The team is working with advisors, including Christophe Laudamiel, a French master perfumer, and potential customers include fragrance houses and packaged goods companies.

More from Alexa Fund
Alexa Fund company’s assisted reality tech could unlock speech for hundreds of millions of people who struggle to communicate.

“We've had repeated feedback that our ingredients have the potential to be very successful, commercially,” says Wiltschko. “That smells like product/market fit.” The principal idea is to license those molecules to fragrance houses.

It’s a timely endeavor. The global fragrance category is valued at more than $10 billion and growing steadily. But some traditional ingredients, such as sandalwood oils, can result in over-harvesting or other ecological harm, while the characteristics of other ingredients increasingly fall short as the demand grows for safer, more biodegradable products.

With POM, Osmo is paving the way for palettes of safe, synthetic fragrances that recreate natural odors using environmentally friendly and easily synthesized molecules. To that end Osmo is looking at combinations of just a handful of atoms: carbon, hydrogen, oxygen, nitrogen, phosphorus, and sulfur.

“Then we bring them into our lab for a process akin to a drug discovery pipeline,” says Hennek. “We are working towards regulatory approval of those molecules.”

Rise of the graph neural networks

All of this has only become possible in the last six years or so. The core insight that started this scientific project, says Wiltschko, was that machine learning was “getting really good at molecules,” thanks to the recent rise of GNNs.

Related content
Dual embeddings of each node, as both source and target, and a novel loss function enable 30% to 160% improvements over predecessors.

Previously, machine learning approaches primarily converted inputs — images or data arrays, say — into rectangles or data grids to process them. Molecules didn’t fit this mold: a molecule might be two atoms, or it might be 20 atoms, with wildly different structure and connectivity. They are simply not reducible to rectangles or grids.

Instead, the atoms in a molecule can be considered as nodes, and the chemical bonds between them as edges, forming a graph structure. This representation allows GNNs to model and process molecular data.

“Some of this technology was developed by friends of mine at Google. So, it was a fantastic, fertile ground to start exploring this idea,” says Wiltschko.

This ongoing exploration is creating some exciting possibilities. Wiltschko reasoned that, just as the sun has shone on Earth since before life began, resulting in many creatures evolving similar visual apparatuses, the composition of the Earth’s atmosphere has been broadly stable over evolutionary time. So could POM also be used to understand the olfactory responses of other species, even those separated from humans by millions of years of evolution?

Life-saving potential

Take mosquitos. Could POM be used to work out what odors repel these disease-carrying insects?

To find out, they augmented POM with additional data sources. The first was a long-forgotten U.S. government report, published in the 1940s, that featured the results of testing 19,000 compounds for their mosquito repellency. The second was information provided by TropIQ, a Dutch company that develops malaria-control technology. The augmented model was soon able to predict entirely new molecules with repellency at least as powerful as DEET, the active ingredient in the most effective mosquito repellents.

osmo image 2.png
Osmo digitized mosquito-repellency data for 19,000 compounds reported on by the United States Department of Agriculture and used that to refine its model (left). The team then predicted candidate molecules that would be most repellent to mosquitos, produced the most viable options, tested them on real mosquitos, and fed those results back into the model to further refine it.
Courtesy of Osmo

The development of cheaper, more effective, and safer insect repellents could have a huge impact on global health. Wiltschko has nothing to announce yet, but says this research is ongoing in collaboration with the Bill & Melinda Gates Foundation.

Applying POM to mosquitos is also a proof of concept, says Hennek. “We can picture applying our product not just to what mosquitoes don’t like, but to what roaches don’t like. Or any number of agricultural pests.”

Capturing smell forever

Looking further down the road, Wiltschko’s vision is to digitize our sense of smell. The idea is not as far-fetched as it sounds. Consider several hundred years ago. The idea that a visual moment — the fleeting expression on your child’s face or an orchard of apple trees in blossom — could be instantly captured and made available forever more in perfect color would have been nothing short of magical thinking.

By the 1820s came the first photography, and with it, the first steps towards human mastery of the world of light. Today, it feels like a fundamental right to freeze those visual memories and hold on to them forever. And the same goes for the auditory world.

“We know what’s required to digitize a human sense,” says Wiltschko. “And we don't have to wait for any of the inventions that vision did — particularly integrated circuits.”

Indeed, with modern computing power and the harnessing of machine learning, Wiltschko reckons computers will have a “sense of smell” within a decade or two. Three stages are required: “reading” smell, understanding it, and “writing” it. Osmo wants to understand, and ultimately curate a wide palette of safe, synthetic molecules that can recreate the entire human smellscape. The reading (sensing) of odorous molecules currently requires bulky and expensive lab equipment, such as a gas chromatography mass spectrometer, while the writing (producing) of smells on demand remains science fiction at the consumer level, says Wiltschko, for now.

A window to the inside

Sensing and understanding odor at a high level may be sufficient to herald powerful health applications, says Wiltschko. For example, it is well established that serious illnesses, including some cancers, can be detected through their effect on your breath. Being able to take a snapshot of that odor profile — an “Osmograph”, in Wiltschko’s words – could reveal a great deal about what’s going on inside our bodies.

“We don't know if that technology will ultimately have a transformative effect on healthcare, but I am betting that it will,” he says.

Related content
ARA recipient Marinka Zitnik is focused on how machine learning can enable accurate diagnoses and the development of new treatments and therapies.

It’s very important to Wiltschko that, down the line, Osmo grows to develop clinical diagnostics applications. “That's the North Star for me, and it's very important that we get there. But the sheer cost and the talent that's required is rare and expensive,” he says. “So, it can’t be the first beach that we storm.”

As Osmo grows, it will be looking for similarly passionate people to push the mission forward. “We've been finding that there are people out there who are secret scent lovers, who secretly aspire to work in the field of machine olfaction,” says Wiltschko. “Just to put it out there: there's one place to do this, and it's Osmo.”

Talking to Wiltschko and those inspired to work alongside him, it is clear to see that Osmo is the culmination of his lifelong passions. For him, it’s emotional. “Once you smell a thing, you cannot stop the feelings that you get from it. There's a very fundamental feeling and emotional component,” he says, “and I think that’s beautiful.”

Research areas

Related content

ES, B, Barcelona
Are you interested in defining the science strategy that enables Amazon to market to millions of customers based on their lifecycle needs rather than one-size-fits-all campaigns? We are seeking a Applied Scientist to lead the science strategy for our Lifecycle Marketing Experimentation roadmap within the PRIMAS (Prime & Marketing analytics and science) team. The position is open to candidates in Amsterdam and Barcelona. In this role, you will own the end-to-end science approach that enables EU marketing to shift from broad, generic campaigns to targeted, cohort-based marketing that changes customer behavior. This is a high-ambiguity, high-impact role where you will define what problems are worth solving, build the science foundation from scratch, and influence senior business leaders on marketing strategy. You will work directly with Business Directors and channel leaders to solve critical business problems: how do we win back customers lost to competitors, convert Young Adults to Prime, and optimize marketing spend by de-averaging across customer cohorts. Key job responsibilities Science Strategy & Leadership: 1. Own the end-to-end science strategy for lifecycle marketing, defining the roadmap across audience targeting, behavioral modeling, and measurement 2. Navigate high ambiguity in defining customer journey frameworks and behavioral models – our most challenging science problem with no established playbook 3. Lead strategic discussions with business leaders translating business needs into science solutions and building trust across business and tech partners 4. Mentor and guide a team of 2-3 scientists and BIEs on technical execution while contributing hands-on to the hardest problems Advanced Customer Behavior Modeling: 1. Build sophisticated propensity models identifying customer cohorts based on lifecycle stage and complex behavioral patterns (e.g., Bargain hunters, Young adults Prime prospects) 2. Define customer journey frameworks using advanced techniques (Hidden Markov Models, sequential decision-making) to model how customers transition across lifecycle stages 3. Identify which customer behaviors and triggers drive lifecycle progression and what messaging/levers are most effective for each cohort 4. Integrate 1P behavioral data with 2P survey insights to create rich, actionable audience definitions Measurement & Cross-Workstream Integration: 1. Partner with measurement scientist to design experiments (RCTs) that isolate audience targeting effects from creative effects 2. Ensure audience definitions, journey models, and measurement frameworks work coherently across Meta, LiveRamp, and owned channels 3. Establish feedback loops connecting measurement insights back to model improvements About the team The PRIMAS (Prime & Marketing Analytics and Science) is the team that support the science & analytics needs of the EU Prime and Marketing organization, an org that supports the Prime and Marketing programs in European marketplaces and comprises 250-300 employees. The PRIMAS team, is part of a larger tech tech team of 100+ people called WIMSI (WW Integrated Marketing Systems and Intelligence). WIMSI core mission is to accelerate marketing technology capabilities that enable de-averaged customer experiences across the marketing funnel: awareness, consideration, and conversion.
IN, KA, Bengaluru
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation - Mentor other scientists and engineers in the use of ML techniques
ES, M, Madrid
At Amazon, we are committed to being the Earth's most customer-centric company. The European International Technology group (EU INTech) owns the enhancement and delivery of Amazon's engineering to all the varied customers and cultures of the world. We do this through a combination of partnerships with other Amazon technical teams and our own innovative new projects. You will be joining the Tamale team to work on Haul. As part of EU INTech and Haul, Tamale strives to create a discovery-driven shopping experience using challenging machine learning and ranking solutions. You will be exposed to large-scale recommendation systems, multi-objective optimization, and state-of-the-art deep learning architectures, and you'll be part of a key effort to improve our customers' browsing experience by building next-generation ranking models for Amazon Haul's endless scroll experience. We are looking for a passionate, talented, and inventive Scientist with a strong machine learning background to help build industry-leading ranking solutions. We strongly value your hard work and obsession to solve complex problems on behalf of Amazon customers. Key job responsibilities We look for applied scientists who possess a wide variety of skills. As the successful applicant for this role, you will work closely with your business partners to identify opportunities for innovation. You will apply machine learning solutions to optimize multi-objective ranking, improve discovery engagement through contextual signals, and scale ranking systems across multiple marketplaces. You will work with business leaders, scientists, and product managers to translate business and functional requirements into concrete deliverables, including the design, development, testing, and deployment of highly scalable distributed ranking services. You will be part of a team of scientists and engineers working on solving ranking and personalization challenges at scale. You will be able to influence the scientific roadmap of the team, setting the standards for scientific excellence. You will be working with state-of-the-art architectures and real-time feature serving systems. Your work will improve the experience of millions of daily customers using Amazon Haul worldwide. You will have the chance to have great customer impact and continue growing in one of the most innovative companies in the world. You will learn a huge amount - and have a lot of fun - in the process!
IN, HR, Gurugram
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced ML systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real-world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning team for International Emerging Stores (IES). Machine Learning, Big Data and related quantitative sciences have been strategic to Amazon from the early years. Amazon has been a pioneer in areas such as recommendation engines, ecommerce fraud detection and large-scale optimization of fulfillment center operations. As Amazon has rapidly grown and diversified, the opportunity for applying machine learning has exploded. We have a very broad collection of practical problems where machine learning systems can dramatically improve the customer experience, reduce cost, and drive speed and automation. These include product bundle recommendations for millions of products, safeguarding financial transactions across by building the risk models, improving catalog quality via extracting product attribute values from structured/unstructured data for millions of products, enhancing address quality by powering customer suggestions We are developing state-of-the-art machine learning solutions to accelerate the Amazon India growth story. Amazon is an exciting place to be at for a machine learning practitioner. We have the eagerness of a fresh startup to absorb machine learning solutions, and the scale of a mature firm to help support their development at the same time. As part of the International Machine Learning team, you will get to work alongside brilliant minds motivated to solve real-world machine learning problems that make a difference to millions of our customers. We encourage thought leadership and blue ocean thinking in ML. Key job responsibilities Use machine learning and analytical techniques to create scalable solutions for business problems Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes Design, develop, evaluate and deploy, innovative and highly scalable ML models Work closely with software engineering teams to drive real-time model implementations Work closely with business partners to identify problems and propose machine learning solutions Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model maintenance Work proactively with engineering teams and product managers to evangelize new algorithms and drive the implementation of large-scale complex ML models in production Leading projects and mentoring other scientists, engineers in the use of ML techniques About the team International Machine Learning Team is responsible for building novel ML solutions across International Emerging Store (India, MENA, Far-East, LatAm) problems and impact the bottom-line and top-line of India business. Learn more about our team from https://www.amazon.science/working-at-amazon/how-rajeev-rastogis-machine-learning-team-in-india-develops-innovations-for-customers-worldwide
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, WA, Bellevue
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.