Diagram that describes the features of Amazon HealthLake

AWS director of machine learning explains the significance of new Amazon HealthLake service

Taha Kass-Hout says the service’s secret sauce is its ability to create a comprehensive data set within a secure data lake that can be organized by different attributes, and then queried and analyzed with advanced analytics and machine learning.

During yesterday's re:Invent 2020 Machine Learning keynote, Matt Wood, AWS vice president of AI, announced Amazon HealthLake, a HIPAA-eligible service that enables healthcare providers, health insurance companies, and pharmaceutical companies to store, transform, query, and analyze health data in the cloud at petabyte scale.

Taha Kass-Hout, AWS director of machine learning
Taha Kass-Hout, AWS director of machine learning.

The new service provides these customers with the ability to use machine learning to spot trends and anomalies in health data so they can provide more precise care for individual patients and across entire populations.

One of the scientists behind the new service is Taha Kass-Hout, MD, MS, AWS director of machine learning. A physician and bioinformatician, Kass-Hout has developed a successful track record in the past two decades innovating on behalf of customers, and pioneering in healthcare and life sciences, precision medicine, and artificial intelligence. Prior to joining Amazon in 2017, he was the first chief health informatics officer for the US Food and Drug Administration (FDA), where he created openFDA and precisionFDA, part of President Obama’s 2015 Precision Medicine Initiative.  Previously, he served as director of health informatics solutions and operations for the US Centers for Disease Control and Prevention (CDC).

Prior to the announcement, Kass-Hout took some time to answer questions about the new service for Amazon Science.

Q. There’s a desire for our health care system to shift from reactive to proactive, to provide more preventative care. What role can Amazon HealthLake play in accelerating that trend?

First, Amazon HealthLake is a HIPAA-eligible service that allows our healthcare and life sciences customers to bring together their disparate health information previously stored in many different formats, and within various data silos, into a secure data lake they own and control. Emerging open standards, such as the Fast Healthcare Interoperability Resources (FHIR), aim to address this challenge by providing a consistent format to describe and exchange structured data across these systems.

However, much of this data is unstructured information, like clinical notes, PDF laboratory reports, insurance claims, X-ray and MRI images, recorded conversations, heart ECG or brain EEG traces, and more, which means the data needs to be extracted and transformed before it can be searched and analyzed. Amazon HealthLake ingests data in FHIR V4 format and then normalizes this information and tags the dates and any key descriptions of events, such as medications, procedures, diagnoses, across every encounter a patient might have throughout their health history. It then indexes all the information so it can be searched later. Now, you have a complete view of an individual patient’s history that is to a level of granularity where now you can apply advanced analytics or predict a bunch of interesting things with new machine learning models to all that data, not just a subset of it.

For example, today the most widely used clinical models to predict someone’s risk of disease oftentimes might have as few as 20 or 30 data points, like someone’s risk of a heart attack or failure. However, if you look at an individual's medical record, there may be at least 250,000 to 300,000 data points, including their medical notes. None of this is used today to manage patients or predict their outcomes. So, we believe the ability to read someone’s entire medical history will lead to better clinical decisions where health care providers can now discover trends and insights on their entire populations from this previously untapped information.

Q. What is the secret sauce of Amazon HealthLake?

At a high level, it’s the ability to create a comprehensive data set in a secure data lake that can be organized by different attributes, and then queried and analyzed with advanced analytics and machine learning. This ability to search and apply advanced analytics, or predict potential disease outcomes with machine learning models, including healthcare utilization metrics, or cost, is very powerful.

The benefit is that now you can make predictions much earlier than you could previously, or intervene quickly to improve care and reduce cost.  The other benefit is now you have access to all this information through a standards-based API, allowing you — with the patient’s consent — to share that data between health systems and with popular third-party applications, analytic platforms, etc. Providers can collaborate more effectively and patients can have unfettered access to their medical information. Using Amazon HealthLake, you now have a patient’s entire medical information structured and organized with a timeline, allowing you to run numerous models to assess risk of chronic disease, manage total medical expense, or predict a patient being readmitted to a hospital after being discharged—at an individual level as well as the population level.

Q. If you were still a practicing physician today, what would most excite you about this solution?

What excites me most is that at the point of care physicians can now look at the individual in front of them and determine what's relevant at that time for each individual patient. They can also zoom out to look at the entire population, compare and manage the broader population with data-driven decisions. This will enable a higher quality of patient care, as physicians can use data to figure out what is working and what is not.

Imagine you have a diabetic patient whose condition you’re managing, and two months later their A1C or glucose level is still not responding to the treatment that you have prescribed. Imagine that you can have comparative analysis on that patient and figure out what other individuals might be similarly unique, and see what worked, or didn’t work for them. Now that you have this comprehensive information available to you about the patient, as well as the entire population, you can make point-of-care decisions that are driven by evidence from the overall data. That’s something really profound. It’s something that’s desperately needed to close gaps in care and ensure you’re providing the highest-quality care every patient deserves, and find out what is working and what isn’t for the larger population.

Q. If Amazon HealthLake had been available a decade ago when you were at the CDC and FDA, how might that have changed your approach to those roles?

No doubt we would have been able to find aberrations from the norm in the larger population much earlier. We could have done far more predictive analytics and figured out sooner whether interventions were working or not, for example, during the H1N1 pandemic I worked on. Having that ability to look across all information and then glean insights from the data, whether it was about an emerging outbreak, or evaluating certain conditions propagating within a community, and then identifying gaps in care, or what might have contributed to disparities in disease susceptibility, would have been immensely helpful.

At the FDA, the amount of information you're trying to manage is enormous. For example, take post-marketing surveillance. This is when a new drug is being approved and you're trying to track across the population to determine if there are any adverse reactions, or trying to understand why a certain part of the population is responding positively, while another isn’t. Oftentimes in these situations we struggled dealing with a lot of unstructured data that comes through in all forms, whether it’s a patient reporting information, or a physician, a pharmacist, or data that a pharma company is mandated to submit.

One of the greatest things about Amazon Web Services is not only are we removing the heavy lifting for all these components, but demystifying machine learning and artificial intelligence.
Taha Kass-Hout

Data is often unstructured like a handwritten note, containing typos, abbreviations, and spelling errors. There are a lot of lost signals in that large volume of text that a solution like Amazon HealthLake absolutely would help identify. That’s because Amazon HealthLake takes the meaning and context into account to extract and establish relationships between entities, such as a medication and its dosage for a medical condition and the associated adverse reaction. It would provide that opportunity to find a needle in a haystack, and provide earlier detection of any adverse events from the wide variety of unstructured medical data that's been collected.

If all of those tools were available 10 years ago, I could have imagined getting ahead of outbreaks or disease propagation in any community, and understanding the complexities associated with each occurrence. We then could have applied a combination of modeling and pattern recognition so we could deliver better outcomes for the public.

Q. Is the development of a service like Amazon HealthLake one of the reasons you decided to join Amazon four years ago?

Absolutely. I have been on a mission focused on making more informed health decisions, whether that’s at the point of care, or as a public health official trying to determine the right public health intervention at the population level. It is humbling to be part of the team building tools and machinery to help healthcare providers, public health officials and others carry out their missions securely, and at scale with the most advanced and accurate scientific tools. The democratization of these technologies so a clinician like myself can use these tools regardless of technical depth is of immense value.

One of the greatest things about Amazon Web Services is not only are we removing the heavy lifting for all these components, but demystifying machine learning and artificial intelligence. We are simplifying access to these tools so they can be plugged in and tailored to individual needs, whether you are at the bottom of the stack — someone with deep expertise —or a novice practitioner. The power of Amazon HealthLake is that you can bring all your data together in a secure environment that only you can access, and then derive trends, insights, and findings from all your data to make clinical decisions, recommendations, and perhaps new policies. That is the promise of a learning health system.

Related content

US, VA, Arlington
The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through SOTA generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. The Marketplace Intelligence (MI) team is looking for an Applied Science Manager to lead a team of scientists and engineers in building production ML and bandit solutions to customize the search experience. We determine which ads to show in Amazon search, where to place them, how many ads to place, and to which customers. This helps shoppers discover new products while helping advertisers put their products in front of the right customers, aligning shoppers’, advertisers’, and Amazon’s interests. To do this, we apply a broad range of machine learning, causal inference, and optimization techniques to continuously explore, learn, and optimize the allocation and ranking of ads on the search page. We are an interdisciplinary team with a focus on customer obsession and inventing and simplifying. Our primary focus is on improving the SP experience in search by gaining a deep understanding of shopper pain points and developing new innovative solutions to address them. You’ll lead the MI Interleaving team. The Interleaving team’s mission is to personalize and contextualize SP ad allocation on the search page. We do this by modeling shopper responses to the number, placement, and quality of ads. We use online experimentation, simulation, causal modeling, and online feedback to estimate the cost of displacing organic and sponsored content. Then, we incorporate those estimates into ad allocation to deliver an efficient and customized shopping experience for shoppers and improved discoverability and sales for advertisers. You’ll own the experimentation systems, models, and online model serving infrastructure to support these solutions. This is a unique opportunity for someone who wants to have broad business impact, a direct impact on customers and the search experience, build scaled real-time LLM and ML solutions, and lead a cross-functional team. If you are interested in machine learning, bandit learning, building production systems, and leading a team to build these solutions, this role is for you. We’re looking for a leader who can help lay out the vision for the team and grow with it. Key job responsibilities * Lead a team of scientists and engineers in building scalable machine learning solutions. * Develop a vision for contextualizing and personalizing SP ads in Amazon search. * Create, develop, and drive a data-driven product strategy to define the right quantitative measures of shopper impact, using this to evaluate decisions and opportunities. * Tackle and solve challenging science and business problems that balance the interests of advertisers, shoppers, and Amazon. * Own a portfolio of pragmatic long-term investments that drive long-term growth of the ads and retail businesses. * Develop real-time LLM and ML algorithms to allocate billions of ads per day in advertising auctions. * Develop efficient algorithms for multi-objective optimization and AI control methods to find operating points for the ad marketplace then evolve them * Develop scientists and ML engineers around machine learning, economics, and optimization for Advertising.
US, CA, Culver City
MULTIPLE POSITIONS AVAILABLE Employer: AMAZON.COM SERVICES LLC Offered Position: Data Scientist II Job Location: Culver City, California Job Number: AMZ10564056 Position Responsibilities: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. 40 hours / week, 8:00am-5:00pm, Salary Range: $158,681/year to $184,000/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, visit: https://www.aboutamazon.com/workplace/employee-benefits. Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation.#0000
CH, Zurich
RIVR, an Amazon company, is building Physical AI by deploying autonomous robots for real-world doorstep delivery. Operating daily in diverse urban environments, RIVR's robots continuously learn from and navigate the millions of scenarios encountered during deliveries. By owning the full stack from software. Our fleet of delivery robots operates globally today, generating vast amounts of robotic real-world data. By utilizing state-of-the-art Vision-Language-Action (VLA) models, large-scale generalist models (like Transformers), generative AI, and similar methods, we can leverage this pool of data to significantly enhance its autonomy, navigation, and manipulation skills. In this role, you will develop multi-modal models that enable robots to autonomously generate actions from demonstrations, real-time sensor data, and natural language commands. We are seeking an expert in VLA models, imitation learning, and generative AI techniques with a deep knowledge of supervised, and self-supervised learning algorithms. If you are passionate about pushing the boundaries of AI we invite you to join us in shaping the future of intelligent robotics. Key job responsibilities Develop and implement Vision-Language-Action (VLA) models, generalist robot transformers, and imitation learning algorithms (e.g., diffusion policies) to enable robots to autonomously execute complex tasks. Design, test, and refine your algorithms to meet the demands of complex real-world autonomy and navigation tasks, with a focus on spatial reasoning and generalization. Streamline the data collection and training workflow to efficiently expand model capabilities with new tasks and data sources. Collaborate with the reinforcement learning team to innovate methods that leverage both simulated and real-world data. Optimize and distill networks for real-time deployment on the edge (e.g. Nvidia Jetson Thor). Build, lead and mentor an exceptional team of software engineers. Provide expert guidance to product managers and executives for strategic decision-making. Create and maintain documentation, guidelines, and best practices to streamline knowledge sharing.
ES, M, Madrid
At Amazon, we are committed to being the Earth’s most customer-centric company. The European International Technology group (EU INTech) owns the enhancement and delivery of Amazon’s engineering to all the varied customers and cultures of the world. We do this through a combination of partnerships with other Amazon technical teams and our own innovative new projects. You will be joining the Tools and Machine Learning (Tamale) team. As part of EU INTech, we tackle complex, high-impact problems at the intersection of e-commerce, AI, and customer experience; going well beyond traditional ML pipelines. Our work spans multiple frontiers: we build GenAI-powered data solutions, enabling scalable and cost-efficient training data generation at Amazon scale. We design and deploy agentic systems for detecting and fixing quality issues across Amazon's retail surfaces. And we develop ranking and recommendation models for Haul shopping experiences. We are looking for a passionate, talented, and inventive Scientist with a strong machine learning background to help build industry-leading machine learning solutions. We strongly value your hard work and obsession to solve complex problems on behalf of Amazon customers. Key job responsibilities We look for applied scientists who possess a wide variety of skills. As the successful applicant for this role, you will with work closely with your business partners to identify opportunities for innovation. You will apply machine learning solutions to automate manual processes, to scale existing systems and to improve catalog data quality, to name just a few. You will work with business leaders, scientists, and product managers to translate business and functional requirements into concrete deliverables, including the design, development, testing, and deployment of highly scalable distributed services. You will be part of team of scientists and engineers working on solving data quality issues at scale. You will be able to influence the scientific roadmap of the team, setting the standards for scientific excellence. You will be working with state-of-the-art models, including image to text, Multimodal LLMs and GenAI. Your work will improve the experience of millions of daily customers using Amazon in Europe and in other regions. You will have the chance to have great customer impact and continue growing in one of the most innovative companies in the world. You will learn a huge amount - and have a lot of fun - in the process!
CL, Virtual
The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, and machine learning to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science and engineering to develop and deliver solutions that measurably achieve this goal. We are looking for a Economist II who is able to provide structure around complex business problems, hone those complex problems into specific, scientific questions, and test those questions to generate insights. The ideal candidate will work with various science, engineering, operations, and analytics teams to estimate models and algorithms on large scale data, design pilots and measure their impact, and transform successful prototypes into improved policies and programs at scale. They will lead teams of researchers to produce robust, objective research results and insights which can be communicated to a broad audience inside and outside of Amazon. The ideal candidate has a PhD in Economics and deep expertise in causal inference and applied econometrics. Experience with large-scale data, proficiency in statistical programming (Python), and familiarity with machine learning methods are a plus. To be successful in this role, you should be comfortable operating with ambiguity, able to independently scope and prioritize research agendas, skilled at influencing decisions through rigorous analysis, and comfortable with using AI tools.
US, MA, Boston
Our team is involved with pre-silicon design verification for custom IP. A critical requirement of the verification flow is the requirement of legal and realistic stimulus of a custom Machine Learning Accelerator Chip. Content creation is built using formal methods that model legal behavior of the design and then solving the problem to create the specific assembly tests. The entire frame work for creating these custom tests is developed using a SMT solver and custom software code to guide the solution space into templated scenarios. This highly visible and innovative role requires the design of this solving framework and collaborating with design verification engineers, hardware architects and designers to ensure that interesting content can be created for the projects needs. Key job responsibilities Develop an understanding for a custom machine learning instruction set architecture. Model correctness of instruction streams using first order logic. Create custom API's to allow control over scheduling and randomness. Deploy algorithms to ensure concurrent code is safely constructed. Create coverage metrics to ensure solution space coverage. Use novel methods like machine learning to automate content creation. About the team Utility Computing (UC) AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services. Annapurna Labs (our organization within AWS UC) designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world.
IN, KA, Bengaluru
Have you ever wondered how that Amazon box with the smile arrives so quickly, where it came from, and how much it cost Amazon to deliver? The WW Amazon Logistics, Business Analytics team manages the delivery of tens of millions of products every week to Amazon's customers, achieving on-time delivery in a cost-effective manner. We are seeking an enthusiastic, customer-obsessed Research Science Manager(RSM) with strong analytical skills to join our team. This role is crucial in optimizing Amazon's vast delivery network and will have significant impact on the customer experience, particularly in the final phase of delivery. As a Research Science Manager, you will: 1. Address business challenges through building compelling cases and using data to influence change across the organization 2. Develop input and assumptions based on preexisting models to estimate costs and savings opportunities associated with varying levels of network growth and operations 3. Create metrics to measure business performance, identify root causes and trends, and prescribe action plans 4. Manage multiple high-impact projects simultaneously 5. Work with technology teams and product managers to develop new tools and systems supporting business growth 6. Communicate with and support various internal stakeholders and external audiences 7. Implement scheduling solutions, improve metrics, and develop scalable processes and tools Looking for minds with: Extensive experience in operations research and data-driven decision making Strong analytical and problem-solving skills Robust program management and research science skills Ability to work with a team and make independent decisions in ambiguous environments Customer-obsessed mindset with a focus on improving the Amazon delivery experience This role offers the autonomy to think strategically and make data-driven decisions from day one. Join us in shaping the future of e-commerce delivery and addressing the core challenges in our world-class operations space! Key job responsibilities Key job responsibilities 1. Advanced Modeling and Algorithm Development: Design and implement sophisticated machine learning models for logistics optimization Develop complex time series forecasting algorithms for demand prediction and resource allocation 2. AI and Machine Learning Integration: Architect and deploy AI-powered systems to enhance decision-making in logistics operations Implement deep learning techniques for image recognition in package sorting and handling Develop reinforcement learning algorithms for adaptive scheduling and resource management 3. Big Data Analytics and Processing: Design and implement distributed computing solutions for processing massive logistics datasets Utilize cloud computing platforms (e.g., AWS) for scalable data processing and analysis 4. AI-Driven Workflow Optimization: Design and implement AI agents for autonomous decision-making in logistics processes Create machine learning models for customer behavior analysis and personalized delivery options 5. Software Development and System Architecture: Write efficient, scalable code in languages such as Python, Java, or C++ Develop and maintain complex software systems for logistics optimization Stay at the forefront of AI and ML research Publish research findings in top-tier conferences and journals About the team We are Amazon's Last Mile Science and Analytics team, dedicated to improving e-commerce delivery. We work to optimize our vast network, forecast demand using machine learning, and enhance route efficiency. Our efforts focus on developing innovative delivery methods, applying AI to solve complex problems, and conducting geospatial analysis. We create simulations to refine processes and plan capacity effectively. Operating globally, we strive to develop adaptable solutions for diverse markets. We aim to advance logistics science, continually improving speed, efficiency, and customer satisfaction, in support of Amazon's mission to be Earth's most customer-centric company.
IN, KA, Bengaluru
Amazon Devices is an inventive research and development company that designs and engineer high-profile devices like the Kindle family of products, Fire Tablets, Fire TV, Health Wellness, Amazon Echo & Astro products. This is an exciting opportunity to join Amazon in developing state-of-the-art techniques that bring Gen AI on edge for our consumer products. We are looking for exceptional scientists to join our Applied Science team and help develop the next generation of edge models, and optimize them while doing co-designed with custom ML HW based on a revolutionary architecture. Work hard. Have Fun. Make History. Key job responsibilities - Quantize, prune, distill, finetune Gen AI models to optimize for edge platforms - Fundamentally understand Amazon’s underlying Neural Edge Engine to invent optimization techniques - Analyze deep learning workloads and provide guidance to map them to Amazon’s Neural Edge Engine - Use first principles of Information Theory, Scientific Computing, Deep Learning Theory, Non Equilibrium Thermodynamics - Train custom Gen AI models that beat SOTA and paves path for developing production models - Collaborate closely with compiler engineers, fellow Applied Scientists, Hardware Architects and product teams to build the best ML-centric solutions for our devices - Publish in open source and present on Amazon's behalf at key ML conferences - NeurIPS, ICLR, MLSys.
US, CA, Culver City
MULTIPLE POSITIONS AVAILABLE Employer: AMAZON.COM SERVICES LLC Offered Position: Applied Scientist III Job Location: Culver City, California Job Number: AMZ10564141 Position Responsibilities: Participate in the design, development, evaluation, deployment and updating of data-driven models and analytical solutions for machine learning (ML) and/or natural language (NL) applications. Develop and/or apply statistical modeling techniques (e.g. Bayesian models and deep neural networks), optimization methods, and other ML techniques to different applications in business and engineering. Routinely build and deploy ML models on available data, and run and analyze experiments in a production environment. Identify new opportunities for research in order to meet business goals. Research and implement novel ML and statistical approaches to add value to the business. Mentor junior engineers and scientists. 40 hours / week, 8:00am-5:00pm, Salary Range: $167,100/year to $226,100/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, visit: https://www.aboutamazon.com/workplace/employee-benefits. Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation.#0000
IN, KA, Bengaluru
We are looking for a talented Applied Scientist to join our team. In this role, you will design, develop, and deploy machine learning and computer vision models that solve real-world problems at scale in the Amazon grocery domain. You will work closely with engineering, product, and business teams to turn complex technical challenges into production-ready solutions, and own the model development lifecycle from experimentation through deployment. You will bring scientific rigor to every stage — from data analysis and model design to evaluation and iteration. This is a high-impact role where your models will directly improve the shopping experience for millions of customers in Amazon grocery stores. Key job responsibilities Design, train, and evaluate computer vision and machine learning models for complex grocery-domain problems including product identification, shelf perception, and in-store scene understanding — iterating rapidly from prototype to production-quality solutions Conduct rigorous exploratory data analysis to characterize domain-specific challenges (image variability, catalog gaps, label noise) and translate findings into actionable modeling decisions Own the model development lifecycle from experimentation through deployment — collaborating with software and ML engineers to ensure models meet latency, throughput, and reliability requirements at production scale Design and execute offline and online evaluation frameworks — defining metrics that capture both model performance and downstream business impact, and diagnosing failure modes to prioritize improvements Build and improve data pipelines and annotation workflows that feed model training, including active learning strategies to maximize label efficiency Communicate technical results, trade-offs, and recommendations clearly to engineering, product, and business stakeholders — connecting model behavior to customer experience outcomes Stay current with state-of-the-art research in computer vision, multimodal learning, and representation learning — evaluating and adapting promising techniques to team-specific problems Contribute to a culture of scientific rigor through reproducible experimentation, thorough documentation, peer code and design reviews, and raising the quality bar for the team A day in the life As an Applied Scientist on the GRAISE team, you'll spend your days analyzing model performance from overnight experiments, collaborating with engineers to deploy computer vision models to production, and prototyping new approaches using multimodal learning with store video and sensor data. You'll present findings to product and business stakeholders, translating technical results into actionable recommendations. Throughout the day, you'll balance rigorous scientific thinking with practical engineering constraints, knowing your work directly improves the shopping experience for millions of customers in Amazon grocery stores. About the team The GRAISE team (Grocery, Retail & In-Store Experience) within World Wide Grocery Store Tech (WWGST) builds foundational AI and machine learning systems that power Amazon's in-store grocery technologies. We develop domain-specific models that solve uniquely complex challenges in grocery — from smart shopping carts and inventory intelligence to personalization and store operations. Our mission is to create technology which makes grocery shopping more convenient, economical, personalized, and enjoyable for customers while empowering retailers with operational efficiency