Social
Conversational AI

A quick guide to Amazon's papers at Interspeech 2023

Speech recognition predominates, but Amazon's research takes in data representation, dialogue management, question answering, and more.

By Staff writer
August 18, 2023
5 min read
Share

Amazon's papers at Interspeech 2023, sorted by research topic.

Automatic speech recognition

A metric-driven approach to conformer layer pruning for efficient ASR inference
Dhanush Bekal, Karthik Gopalakrishnan, Karel Mundnich, Srikanth Ronanki, Sravan Bodapati, Katrin Kirchhoff

Conmer: Streaming Conformer without self-attention for interactive voice assistants
Martin Radfar, Paulina Lyskawa, Brandon Trujillo, Yi Xie, Kai Zhen, Jahn Heymann, Denis Filimonov, Grant Strimel, Nathan Susanj, Athanasios Mouchtaris

DCTX-Conformer: Dynamic context carry-over for low latency unified streaming and non-streaming Conformer
Goeric Huybrechts, Srikanth Ronanki, Xilai Li, Hadis Nosrati, Sravan Bodapati, Katrin Kirchhoff

Distillation strategies for discriminative speech recognition rescoring
Prashanth Gurunath Shivakumar, Jari Kolehmainen, Yi Gu, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Effective training of attention-based contextual biasing adapters with synthetic audio for personalised ASR
Burin Naowarat, Philip Harding, Pasquale D'Alterio, Sibo Tong, Bashar Awwad Shiekh Hasan

Human transcription quality improvement
Jian Gao, Hanbo Sun, Cheng Cao, Zheng Du

Human transcription quality.png
In “Human transcription quality improvement”, Amazon researchers use machine learning models to align and score multiple transcription hypotheses from crowd workers.

Learning when to trust which teacher for weakly supervised ASR
Aakriti Agrawal, Milind Rao, Anit Kumar Sahu, Gopinath (Nath) Chennupati, Andreas Stolcke

Model-internal slot-triggered biasing for domain expansion in neural transducer ASR models
Edie Lu, Philip Harding, Kanthashree Mysore Sathyendra, Sibo Tong, Xuandi Fu, Jing Liu, Feng-Ju (Claire) Chang, Simon Wiesler, Grant Strimel

Multi-view frequency-attention alternative to CNN frontends for automatic speech recognition
Belen Alastruey Lasheras, Lukas Drude, Jahn Heymann, Simon Wiesler

Multilingual contextual adapters to improve custom word recognition in low-resource languages
Devang Kulshreshtha, Saket Dingliwal, Brady Houston, Sravan Bodapati

Multilingual contextual adapters.png
“Multilingual contextual adapters to improve custom word recognition in low-resource languages” proposes a three-stage process for training multilingual contextual adapters. Stage I trains a multilingual encoder; stage II learns multilingual contextual adapters by freezing the encoder; and stage III jointly optimizes both components on the target language.

PATCorrect: Non-autoregressive phoneme-augmented transformer for ASR error correction
Ziji Zhang, Zhehui Wang, Raj Kamma, Sharanya Eswaran, Narayanan Sadagopan

Personalization for BERT-based discriminative speech recognition rescoring
Jari Kolehmainen, Yi Gu, Aditya Gourav, Prashanth Gurunath Shivakumar, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Personalized predictive ASR for latency reduction in voice assistants
Andreas Schwarz, Di He, Maarten Van Segbroeck, Mohammed Hethnawi, Ariya Rastrow

Record deduplication for entity distribution modeling in ASR transcripts
Tianyu Huang, Chung Hoon Hong, Carl Wivagg, Kanna Shimizu

Scaling laws for discriminative speech recognition rescoring models
Yi Gu, Prashanth Gurunath Shivakumar, Jari Kolehmainen, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Selective biasing with trie-based contextual adapters for personalised speech recognition using neural transducers
Philip Harding, Sibo Tong, Simon Wiesler

Streaming speech-to-confusion network speech recognition
Denis Filimonov, Prabhat Pandey, Ariya Rastrow, Ankur Gandhe, Andreas Stolcke

Data representation

Don’t stop self-supervision: Accent adaptation of speech representations via residual adapters
Anshu Bhatia, Sanchit Sinha, Saket Dingliwal, Karthik Gopalakrishnan, Sravan Bodapati, Katrin Kirchhoff

Dialogue management

Parameter-efficient low-resource dialogue state tracking by prompt tuning
Mingyu Derek Ma, Jiun-Yu Kao, Shuyang Gao, Arpit Gupta, Di Jin, Tagyoung Chung, Violet Peng

Parameter efficient low resource dialogue state tracking.png
“Parameter-efficient low-resource dialogue state tracking by prompt tuning” proposes a method for using language-model prompts to do dialogue state tracking, with a separate, fixed-length embedding for each input segment.

Grapheme-to-phoneme conversion

Improving grapheme-to-phoneme conversion by learning pronunciations from speech recordings
Sam Ribeiro, Giulia Comini, Jaime Lorenzo Trueba

Keyword spotting

On-device constrained self-supervised speech representation learning for keyword spotting via knowledge distillation
Gene-Ping Yang, Yue Gu, Qingming Tang, Dongsu Du, Yuzong Liu

Natural-language understanding

Quantization-aware and tensor-compressed training of transformers for natural language understanding
Zi Yang, Samridhi Choudhary, Siegfried Kunzmann, Zheng Zhang

Sampling bias in NLU models: Impact and mitigation
Zefei Li, Anil Ramakrishna, Anna Rumshisky, Andy Rosenbaum, Saleh Soltan, Rahul Gupta

Understanding disrupted sentences using underspecified abstract meaning representation
Angus Addlesee, Marco Damonte

Paralinguistics

Towards paralinguistic-only speech representations for end-to-end speech emotion recognition
George Ioannides, Michael Owen, Andrew Fletcher, Viktor Rozgic, Chao Wang

Utility-preserving privacy-enabled Speech embeddings for emotion detection
Chandrashekhar Lavania, Sanjiv Das, Xin Huang, Kyu Han

Question answering

Question content alignment.png
In “Question-context alignment and answer-context dependencies for effective answer sentence selection,” Amazon researchers propose a method that uses the sentences surrounding answer candidates as additional context. Given probability distributions over sequences of words, the method aligns questions with answer candidates and context by using optimal transport to move probability from one distribution to another.

Question-context alignment and answer-context dependencies for effective answer sentence selection
Minh Van Nguyen, Kishan K C, Toan Nguyen, Thien Nguyen, Ankit Chadha, Thuy Vu

Speaker diarization

Lexical speaker error correction: Leveraging language models for speaker diarization error correction
Rohit Paturi, Sundararajan Srinivasan, Xiang Li

Speech translation

Knowledge distillation on joint task end-to-end speech translation

Khandokar Md. Nayem, Ran Xue, Ching-Yun (Frannie) Chang, Akshaya Vishnu Kudlu Shanbhogue

Text-to-speech

Comparing normalizing flows and diffusion models for prosody and acoustic modelling in text-to-speech
Guangyang Zhang, Tom Merritt, Sam Ribeiro, Biel Tura Vecino, Kayoko Yanagisawa, Kamil Pokora, Abdelhamid Ezzerg, Sebastian Cygert, Ammar Abbas, Piotr Bilinski, Roberto Barra-Chicote, Daniel Korzekwa, Jaime Lorenzo Trueba

Cross-lingual prosody transfer for expressive machine dubbing
Jakub Swiatkowski, Duo Wang, Mikolaj Babianski, Patrick Tobing, Ravi chander Vipperla, Vincent Pollet

Diffusion-based accent modelling in speech synthesis
Kamil Deja, Georgi Tinchev, Marta Czarnowska, Marius Cotescu, Jasha Droppo

eCat: An end-to-end model for multi-speaker TTS & many-to-many fine-grained prosody transfer
Ammar Abbas, Sri Karlapati, Bastian Schnell, Penny Karanasou, Marcel Granero Moya, Amith Nagaraj, Ayman Boustati, Nicole Peinelt, Alexis Moinet, Thomas Drugman

Expressive machine dubbing through phrase-level cross-lingual prosody transfer
Jakub Swiatkowski, Duo Wang, Mikolaj Babianski, Giuseppe Coccia, Patrick Tobing, Ravi chander Vipperla, Viacheslav Klimkov, Vincent Pollet

Expressive machine dubbing.png
The architecture proposed in “Expressive machine dubbing through phrase-level cross-lingual prosody transfer” relies on a reference encoder that explicitly models noise.

Multilingual context-based pronunciation learning for text-to-speech
Giulia Comini, Sam Ribeiro, Fan Yang, Heereen Shim, Jaime Lorenzo Trueba

Research areas
Tags
About the Author
Staff writer

Related content

Work with us

See more jobs See more jobs
Research Scientist, Selling Partner Satisfaction
US, WA, Seattle
We’re looking for a Research Scientist to join a team that measures and explains how over 2.4 million sellers and vendors experience selling on Amazon. You’ll apply survey science, psychometrics, and applied statistics to help drive meaningful change at Amazon on behalf of Sellers. In this role, you’ll work across a variety of research methodologies to optimize our data collection, create scalable analytical approaches, and deep dive the Seller experience to create rigorous, quantitative insights that senior leaders use to set strategy. Key job responsibilities Key Job Responsibilities - Apply psychometric and survey methodology techniques (e.g., IRT, factor analysis, scale development, single-item indicators) to measure seller experience constructs with scientific rigor - Design and implement frameworks that link seller attitudinal data to behavioral outcomes and identify high-impact opportunity areas - Design and execute statistical analyses including regression modeling, significance testing, and driver analysis to identify what matters most to sellers - Apply observational causal evaluation methods to estimate the effects of policy changes, product launches, and platform interventions on seller experience - Design, build and maintain analytical pipelines that transform raw survey data into production-ready metrics, reports, and dashboards - Design and build systems to analyze open-ended survey responses using text classification, thematic coding, and natural language processing techniques - Design and monitor processes improve survey response rates, sampling methodology, and data quality - Productionalize research code: take analyses from prototype to automated, reproducible pipelines that run reliably in production environments - Communicate findings clearly to technical and non-technical audiences through written reports, data visualizations, and presentations - Collaborate and influence with cross-functional partners to translate business questions into well-defined research problems and scientific metrics - Document research methods, assumptions, and limitations transparently to ensure reproducibility A day in the life Your day typically starts with the data. You might spend the morning reviewing satisfaction trends, investigating a shift in a key metric, and pulling together an analysis that explains what's driving it. You'll regularly meet with external teams to help them understand how a proposed product will affect seller sentiment and what the data says they should prioritize. You'll also spend time in R or Python building, training, or testing models to improve how we measure and act on sentiment data. About the team Our team owns the research and measurement infrastructure that tracks satisfaction across all 2.1 million selling partners on Amazon, spanning Seller Central, Next Gen Selling, and Mobile. We sit at the intersection of data and strategy, partnering with teams across product, design, and engineering to advocate for seller experience improvements. This is a high-visibility team where the work is consequential, the stakeholders are senior, and the problems are genuinely hard.
Data Scientist , Worldwide Global Selling -AIT
CN, 31, Shanghai
Worldwide Global Selling has been helping individuals and businesses increase sales and reach new customers around the globe. Today, more than 50% of Amazon's total unit sales come from third-party selection. The Global Selling team in China is responsible for recruiting local businesses to sell on Amazon's 19+ overseas marketplaces and supporting local Sellers' success and growth on Amazon. Our vision is to be the first choice for all types of Chinese business to go globally. The Worldwide Global Selling Analytics, Intelligence, and Technology (WWGS-AIT) team serves as the research, automation, and insight arm of the International Seller Service data hub, enabling rapid delivery of growth insights through strategic investments in regional data foundations, self-service business intelligence solutions, and artificial intelligence tools. The WWGS-AIT team is positioned to establish AI-ready foundational capabilities across the WWGS organization while maintaining excellence in business insight generation, and self-service BI/AI application development. WWGS-AIT is looking for a Data Scientist to design and build seller-facing AI agents that turn our AI-ready data foundation into intelligent, conversational experiences for Amazon's global sellers. You will own the intelligence layer of these agents end-to-end, from modeling and retrieval to evaluation and launch, working alongside applied scientists, data engineers, and the Seller Assistant platform team to put trustworthy AI directly into sellers' hands. Key job responsibilities - Design, build, and iterate seller-facing AI agents (LLM-powered) that help Chinese sellers grow globally, reasoning over WWGS-AIT's AI-ready data foundation and knowledge base. - Develop the intelligence layer of agents: retrieval-augmented generation (RAG) over our knowledge management system, tool-use / function-calling orchestration, prompt engineering, and model fine-tuning or adaptation where needed. - Ground agent responses in standardized metrics and unified seller profiles to guarantee consistency and accuracy across agents; design and enforce guardrails that prevent hallucination and protect sensitive, compliance-restricted data. - Build rigorous evaluation frameworks (golden datasets, offline evaluation, and online experimentation) to measure and continuously improve agent quality, safety, and seller impact. - Develop seller-intelligence models (segmentation, entity resolution / One-ID, ranking and recommendation) that power personalized agent experiences. - Partner with WWGS Tech and the Seller Assistant platform team to productionize agents and tools (e.g., via MCP), defining the model and intelligence contract while engineering operates the runtime. - Collaborate with business, product, and cross-functional partners to translate seller pain points into agent capabilities and measurable business outcomes. - Stay current with advances in GenAI and agentic systems, and bring applied research into production.
Data Scientist, Automated Vehicle Testing
US, WA, Redmond
Amazon Leo is Amazon’s low Earth orbit satellite broadband network. Its mission is to deliver fast, reliable internet to customers and communities around the world, and we’ve designed the system with the capacity, flexibility, and performance to serve a wide range of customers, from individual households to schools, hospitals, businesses, government agencies, and other organizations operating in locations without reliable connectivity. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. We are looking for an experienced Data Scientist to help architect state-of-the-art test infrastructure and lead the development of data models and analysis tools to represent the ground truth about satellite test results in order to facilitate important business decisions. Our team is responsible for core infrastructure and tools that will serve as the backbone of automated satellite testing operations to enable rapid scaling of manufacturing processes. Key job responsibilities * Work with engineering, software and manufacturing teams to understand drivers, impacts, and key influences on satellite performance * Lead the design, build and implementation of production models and make decisions in real time for satellite test results * Drive actions at scale to optimize test methodology and drive increases to satellite reliability * Analysis and modeling of satellite telemetry from test results in lab and on-orbit * Develop models and data pipelines for satellite telemetry * Create and manage datasets for continued pre-training and supervised fine-tuning of LLMs * Develop scalable visualizations for analysis of satellite performance A day in the life As Amazon Leo Data Scientist you will own the architecture definition and development of data analysis tools to to aid engineering and production teams in deciding flight-worthiness of each Amazon Leo satellite and historical traceability tools to enable simplified discovery and interpretation of past test data. You will work with multiple engineering, software and manufacturing teams across ground and space systems, to specify requirements, define data collection, interpretation strategies, data pipelines and implement data analysis and reporting tools for Integrated Vehicle tests. Your focus will be in optimizing the analysis of test results to enable Amazon Leo production plans. About the team The Automated Vehicle Testing Team is a mix of scientists and software engineers responsible for data infrastructure, tools, and research that serve as the backbone of automated satellite testing operations to enable rapid scaling of manufacturing processes.
Senior Economist, PXT Central Science
US, CA, San Francisco
The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, and machine learning to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science and engineering to develop and deliver solutions that measurably achieve this goal. We are looking for a Senior Economist who is able to provide structure around complex business problems, hone those complex problems into specific, scientific questions, and test those questions to generate insights. The ideal candidate will work with various science, engineering, operations, and analytics teams to estimate models and algorithms on large scale data, design pilots and measure their impact, and transform successful prototypes into improved policies and programs at scale. They will lead teams of researchers to produce robust, objective research results and insights which can be communicated to a broad audience inside and outside of Amazon. The ideal candidate has a PhD in Economics and deep expertise in causal inference and applied econometrics. Experience with large-scale data, proficiency in statistical programming (Python), and familiarity with machine learning methods are a plus. To be successful in this role, you should be comfortable operating with ambiguity, able to independently scope and prioritize research agendas, skilled at influencing decisions through rigorous analysis, and comfortable with using AI tools.
Data Scientist , Leo Customer Terminal
US, WA, Redmond
At Amazon, we’re inventing on behalf of customers, and with Amazon Leo, we’re redefining what global connectivity looks like. Our mission is to deliver fast, affordable broadband to unserved and underserved communities around the world through a constellation of low Earth orbit (LEO) satellites. Every system we build helps connect people to education, healthcare, opportunity, and each other. As a Data Scientist, you will be responsible for developing advanced analytics and machine learning solutions for user terminals. You will develop predictive models to proactively identify possible user terminal failures in the field. You will work in a collaborative environment with a multi-disciplinary team, including constellation, RF, antenna, silicon, algorithm, and software engineers. Key job responsibilities As a Data Scientist, you will develop analytic tools for a team developing current and future user terminals. Your responsibilities include: • Develop statistical and analytical tool to enable the regression decision from on-orbit and lab measurement of user terminals • Publish documents and create compelling visualizations and presentations to communicate insights to stakeholders • Create and manage datasets for continued pre-training and supervised fine-tuning of LLMs • Develop scalable visualizations for analysis of user terminal performance • Work closely with constellation, RF, antenna, silicon, algorithm, and software engineers to root-cause the failures using data as the primary tool • Drive consensus on metrics and analysis approaches to support product development strategy Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. A day in the life As a Data Scientist in the LEO Customer Terminal Team, you will work daily with satellite constellation, algorithm, RF, antenna, silicon, hardware, and software teams in a collaborative environment. Your focus will be using data as an intelligence source to enable design decisions for the team. About the team The LEO Customer Terminal team is responsible for developing both outdoor and indoor devices that enable customers to access internet service via the LEO satellite network. We own the entire process from early prototypes through mass production, including requirements documentation, architecture definition, hardware development, algorithm development, and all integration and verification testing.
Sr. Manager, Applied Science, AWS Agentic AI
US, WA, Seattle
Amazon Web Services (AWS) is looking for a sr. Manager, Applied to join the Quick Science team. Quick is AWS’s enterprise generative AI assistant that helps users answer questions, summarize documents, generate content, take actions, and automate workflows using information across enterprise systems. As a key member of this team, you will lead research and development efforts in generative AI and Agentic AI to enable intelligent agents that perform complex reasoning, automate multi-step workflows, and make enterprise users significantly more productive. Key job responsibilities You’ll work on building and optimizing multi-modal foundation models, training and fine-tuning state-of-the-art LLMs, and architecting systems that scale efficiently across domains. This role blends science leadership, development of applied scientists, innovation, and deep collaboration with engineering teams to bring research into production.
Research Scientist II - AMZ9898222
US, NY, New York
MULTIPLE POSITIONS AVAILABLE Employer: AMAZON.COM SERVICES LLC Offered Position: Research Scientist II Job Location: New York, New York Job Number: AMZ9898222 Position Responsibilities: Interact with various software and business groups to develop an understanding of their business requirements and operational processes. Utilize acquired knowledge and business judgment to build scalable machine learning systems, optimization models and operational tools to improve the bottom line. Build quantitative mathematical models to represent a wide range of supply chain, transportation and logistics systems. Implement these models and tools using modeling languages and engineering code in software languages such as Python, C++, or JAVA. Gather required data for analysis and mathematical model building by writing ad-hoc scripts and database queries. Perform quantitative, economic, and numerical performance analyses of these systems under uncertainty using statistical and optimization tools. Create computer simulations to support operational decision-making. Identify areas with potential for improvement and work with internal teams to generate requirements to realize improvements. Design optimal or near optimal solution methodologies to be used by in-house decision support tools and software. Create software prototypes to verify and validate the devised solutions methodologies. Integrate prototypes into production systems using standard software development tools and methodologies. Position Requirements: Master's degree or foreign equivalent degree in Operations Research, Computer Science, Engineering, Mathematics, or a related field and one year of research or work experience in the job offered, or as a Research Scientist, Research Assistant, Software Engineer, or a related occupation. Employer will accept a Bachelor's degree or foreign equivalent degree in Operations Research, Computer Science, Engineering, Mathematics, or a related field and five years of progressive post-baccalaureate research or work experience in the job offered or a related occupation as equivalent to the Master's degree and one year of experience. Must have one year of research or work experience in the following skill(s): (1) programming with a major programming language including Java, C++, C#, C, or Python; and (2) formulating and solving both discrete and continuous optimization problems. Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation. 40 hours / week, 8:00am-5:00pm, Salary Range $158,440/year to $212,800/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, visit: https://www.aboutamazon.com/workplace/employee-benefits.#0000
Applied Scientist I, CMT
IN, TN, Chennai
As a member of the CMT team, you'll play a key role in the evolution of our Competitive Monitoring systems to solve significantly complex and interesting technical challenges in machine learning, large language models in production, and recommender systems to name a few. The team's work directly impacts customer experience at a worldwide scale. Key job responsibilities Key job responsibilities 1. Research the problem domain and come up with various approaches to solve the problem. 2. Be willing to experiment quickly and fail fast. 3. Collaborate with engineers to come up with the right end to end solution to the business problems. 4. Ideate on future roadmap for science in CMT 5. Be willing to roll up your sleeves and learn core topics outside applied science, for example ML engineering A day in the life A typical day might involve (a) working on ideas for improving models around product similarity or price recommendations, (b) working closely with other scientists and our ML engineers to ensure that the best models are in production, (c) writing good maintainable code that can be reused and reproduced, (d) sharing your work across CMT and beyond via technical writings and presentations
Applied Scientist III, Sponsored Products and Brands - Advertiser Growth and Strategies
US, WA, Seattle
The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through cutting-edge generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. We are looking for an Applied Scientist III to set the scientific direction for the next generation of agentic AI applications that guide Amazon advertisers. In this role you will define, lead and build the science behind agentic systems that reason, plan, and act autonomously to manage and optimize ad campaigns based on a deep understanding of the advertiser and the marketplace. You will own the agentic architecture end to end, partnering closely with product and engineering leaders to translate a long-term science vision into concrete research and engineering roadmaps. Working backwards from the needs of millions of advertisers, you will take the lead on medium-to-large, ambiguous problems where neither the problem nor the solution is well defined, and deliver customer-facing products that help advertisers create, optimize, and grow their campaigns. You will invent new methods at the product level, and drive their adoption across multiple teams. This role combines science leadership, technical depth, product focus, and business understanding: you will raise the science bar, build consensus on approach across partners, and mentor scientists and engineers while remaining deeply hands-on with the hardest technical problems. Key job responsibilities As an Applied Scientist III on this team you will: - Define the science vision for the agentic campaign management system and, with product and engineering leaders, turn it into delivery roadmaps. - Build agentic systems that autonomously manage and optimize ad campaigns — encoding auction and marketplace dynamics (bidding, budget pacing, keyword and targeting decisions) while balancing advertiser ROI, shopper experience, and marketplace health. - Define and curate the datasets and signals needed to train and evaluate these agents — advertiser and campaign data, auction and bid/budget signals, impressions, clicks, conversions, and search-term/keyword performance. - Stay deeply hands-on: write production-quality, critical-path code and build core components that take agentic systems from prototype to launch. - Own the agentic architecture — planning, tool use and integration (e.g., MCP), long-horizon reasoning (e.g., ReAct, CoT/ToT), and multi-agent orchestration — and stay deeply hands-on, writing production-quality, critical-path code from prototype to launch. - Define the evaluation and safety methodology for agent workflows and drive its adoption as the bar for reliability and trust. - Drive the team's scientific agenda, mentor scientists and engineers, and represent the team in the internal and external scientific community. About the team The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through the latest generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. This team within Sponsored Products and Brands is focused on guiding and supporting millions of advertisers to meet their advertising needs of creating and managing ad campaigns. At this scale, the complexity of diverse advertiser goals, campaign types, and market dynamics creates both a massive technical challenge and a transformative opportunity: even small improvements in guidance systems can have outsized impact on advertiser success and Amazon’s retail ecosystem. Our vision is to build a highly personalized, context-aware agentic advertiser guidance system that leverages LLMs together with tools such as auction simulations, ML models, and optimization algorithms. This agentic framework, will operate across both chat and non-chat experiences in the ad console, scaling to natural language queries as well as autonomously manage campaigns based on deep understanding of the advertiser. To execute this vision, we collaborate closely with stakeholders across Ad Console, Sales, and Marketing to identify opportunities—from high-level product guidance down to granular keyword recommendations—and deliver them through a tailored, personalized experience. Our work is grounded in state-of-the-art agent architectures, tool integration, reasoning frameworks, and model customization approaches (including tuning, MCP, and preference optimization), ensuring our systems are both scalable and adaptive.
Applied Scientist (Speech / Voice AI), Prime Video
US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video subscriptions such as Apple TV+, HBO Max, Peacock, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video team member, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! Key job responsibilities As a highly experienced science leader in speech and audio processing, you will apply state-of-the-art research in automatic speech recognition, voice synthesis, speech translation, and prosody modeling to make content sound great in every language, powering features like Dialogue Boost, AI-Assisted Dubbing, and Automated Audio Descriptions. You will lead the research direction for a team of deeply talented applied scientists working at the intersection of speech AI and accessibility, defining roadmaps that advance our capabilities in dialogue enhancement, hybrid AI-human dubbing pipelines, and dialect adaptation at scale. You will communicate these roadmaps effectively to senior leadership, connecting technical breakthroughs to customer impact. About the team The Prime Video - Content Reasoning, Enrichment & Localization Team's mission is to deeply understand all content and empower all customers with relevant language options, innovative accessibility assists, and rich title-information across all their content-experiences on Prime Video. We create and publish content on-time that's meaningful, accurate, and accessible to every customer globally. We delight our customers by pushing the boundaries of content understanding and enrichment. Through inclusion and innovation, we do the most fulfilling work of our career.
See more jobs
View from space of a connected network around planet Earth representing the Internet of Things.
Get more from Amazon Science
Subscribe to our newsletter

Amazon.com | Conditions of Use | Privacy | © 1996-2026 Amazon.com, Inc. or its affiliates

Social