A quick guide to Amazon’s 50-plus ICASSP papers 2022

Topics range from the predictable, such as speech recognition and signal processing, to time series forecasting and personalization.

Amazon researchers have more than 50 papers at this year’s International Conference on Acoustics, Speech, and Signal Processing (ICASSP). A plurality of them are on automatic speech recognition and related topics, such as keyword spotting and speaker identification. But others range farther afield, to topics such as computer vision and federated learning.

ICASSP-2022-Header.png
This year's ICASSP includes a virtual component, from May 7 to 13, and an in-person component in Singapore, May 22 to 27.

Acoustic-event detection

Federated self-supervised learning for acoustic event classification
Meng Feng, Chieh-Chi Kao, Qingming Tang, Ming Sun, Viktor Rozgic, Spyros Matsoukas, Chao Wang

Improved representation learning for acoustic event classification using tree-structured ontology
Arman Zharmagambetov, Qingming Tang, Chieh-Chi Kao, Qin Zhang, Ming Sun, Viktor Rozgic, Jasha Droppo, Chao Wang

WikiTAG: Wikipedia-based knowledge embeddings towards improved acoustic event classification
Qin Zhang, Qingming Tang, Chieh-Chi Kao, Ming Sun, Yang Liu, Chao Wang

Automatic speech recognition

A likelihood ratio-based domain adaptation method for end-to-end models
Chhavi Choudhury, Ankur Gandhe, Xiaohan Ding, Ivan Bulyko

Being greedy does not hurt: Sampling strategies for end-to-end speech recognition
Jahn Heymann, Egor Lakomkin, Leif RādellJahn Heymann, Egor Lakomkin, Leif RādelJahn Heymann, Egor Lakomkin, Leif RādelJahn Heymann, Egor Lakomkin, Leif Rādel

Caching networks: Capitalizing on common speech for ASR
Anastasios Alexandridis, Grant P. Strimel, Ariya Rastrow, Pavel Kveton, Jon Webb, Maurizio Omologo, Siegfried Kunzmann, Athanasios Mouchtaris

Lattice attention.png
In "LATTENTION: Lattice attention in ASR rescoring", Amazon researchers show that applying an attention mechanism (colored grid) to a lattice encoding multiple automatic-speech-recognition (ASR) hypotheses improves ASR performance.

Contextual adapters for personalized speech recognition in neural transducers
Kanthashree Mysore Sathyendra, Thejaswi Muniyappa, Feng-Ju Chang, Jing Liu, Jinru Su, Grant P. Strimel, Athanasios Mouchtaris, Siegfried Kunzmann

LATTENTION: Lattice attention in ASR rescoring
Prabhat Pandey, Sergio Duarte Torres, Ali Orkan Bayer, Ankur Gandhe, Volker Leutnant

Listen, know and spell: Knowledge-infused subword modeling for improving ASR performance of out-of-vocabulary (OOV) named entities
Nilaksh Das, Monica Sunkara, Dhanush Bekal, Duen Horng Chau, Sravan Bodapati, Katrin Kirchhoff

KG ASR rescoring.png
In "Listen, know and spell: Knowledge-infused subword modeling for improving ASR performance of OOV named entities", Amazon researchers show how to improve automatic speech recognition by incorporating information from knowledge graphs into the processing pipeline.

Mitigating closed-model adversarial examples with Bayesian neural modeling for enhanced end-to-end speech recognition
Chao-Han Huck Yang, Zeeshan Ahmed, Yile Gu, Joseph Szurley, Roger Ren, Linda Liu, Andreas Stolcke, Ivan Bulyko

Multi-modal pre-training for automated speech recognition
David M. Chan, Shalini Ghosh, Debmalya Chakrabarty, Björn Hoffmeister

Multiturn encoder.png
The model used in "Multi-turn RNN-T for streaming recognition of multi-party speech" to disentangle overlapping speech in multi-party automatic speech recognition.

Multi-turn RNN-T for streaming recognition of multi-party speech
Ilya Sklyar, Anna Piunova, Xianrui Zheng, Yulan Liu

RescoreBERT: Discriminative speech recognition rescoring with BERT
Liyan Xu, Yile Gu, Jari Kolehmainen, Haidar Khan, Ankur Gandhe, Ariya Rastrow, Andreas Stolcke, Ivan Bulyko

USTED: Improving ASR with a unified speech and text encoder-decoder
Bolaji Yusuf, Ankur Gandhe, Alex Sokolov

VADOI: Voice-activity-detection overlapping inference for end-to-end long-form speech recognition
Jinhan Wang, Xiaosu Tong, Jinxi Guo, Di He, Roland Maas

Computer vision

ASD-transformer: Efficient active speaker detection using self and multimodal transformers
Gourav Datta, Tyler Etchart, Vivek Yadav, Varsha Hedau, Pradeep Natarajan, Shih-Fu Chang

Dynamically pruning SegFormer for efficient semantic segmentation
Haoli Bai, Hongda Mao, Dinesh Nair

Enhancing contrastive learning with temporal cognizance for audio-visual representation generation
Chandrashekhar Lavania, Shiva Sundaram, Sundararajan Srinivasan, Katrin Kirchhoff

Few-shot gaze estimation with model offset predictors
Jiawei Ma, Xu Zhang, Yue Wu, Varsha Hedau, Shih-Fu Chang

Visual representation learning with self-supervised attention for low-label high-data regime
Prarthana Bhattacharyya, Chenge Li, Xiaonan Zhao, István Fehérvári, Jason Sun

Federated learning

Federated learning challenges and opportunities: An outlook
Jie Ding, Eric Tramel, Anit Kumar Sahu, Shuang Wu, Salman Avestimehr, Tao Zhang

FL framework.png
The federated-learning scenario considered in "Federated learning challenges and opportunities: An outlook".

Learnings from federated learning in the real world
Christophe Dupuy, Tanya G. Roosta, Leo Long, Clement Chung, Rahul Gupta, Salman Avestimehr

Information retrieval

Contrastive knowledge graph attention network for request-based recipe recommendation
Xiyao Ma, Zheng Gao, Qian Hu, Mohamed Abdelhady

Keyword spotting

Unified speculation, detection, and verification keyword spotting
Geng-shen Fu, Thibaud Senechal, Aaron Challenner, Tao Zhang

Machine translation

Isometric MT: Neural machine translation for automatic dubbing
Surafel Melaku Lakew, Yogesh Virkar, Prashant Mathur, Marcello Federico

Natural-language understanding

ADVIN: Automatically discovering novel domains and intents from user text utterances
Nikhita Vedula, Rahul Gupta, Aman Alok, Mukund Sridhar, Shankar Ananthakrishnan

An efficient DP-SGD mechanism for large scale NLU models
Christophe Dupuy, Radhika Arava, Rahul Gupta, Anna Rumshisky

Paralinguistics

Confidence estimation for speech emotion recognition based on the relationship between emotion categories and primitives
Yang Li, Constantinos Papayiannis, Viktor Rozgic, Elizabeth Shriberg, Chao Wang

Multi-lingual multi-task speech emotion recognition using wav2vec 2.0
Mayank Sharma

Representation learning through cross-modal conditional teacher-student training for speech emotion recognition
Sundararajan Srinivasan, Zhaocheng Huang, Katrin Kirchhoff

Sentiment-aware automatic speech recognition pre-training for enhanced speech emotion recognition
Ayoub Ghriss, Bo Yang, Viktor Rozgic, Elizabeth Shriberg, Chao Wang

Personalization

Incremental user embedding modeling for personalized text classification
Ruixue Lian, Che-Wei Huang, Yuqing Tang, Qilong Gu, Chengyuan Ma, Chenlei (Edward) Guo

Signal processing

Deep adaptive AEC: Hybrid of deep learning and adaptive acoustic echo cancellation
Hao Zhang, Srivatsan Kandadai, Harsha Rao, Minje Kim, Tarun Pruthi, Trausti Kristjansson

Improved singing voice separation with chromagram-based pitch-aware remixing
Siyuan Yuan, Zhepei Wang, Umut Isik, Ritwik Giri, Jean-Marc Valin, Michael M. Goodwin, Arvindh Krishnaswamy

Sparse recovery of acoustic waves
Mohamed Mansour

Upmixing via style transfer: A variational autoencoder for disentangling spatial images and musical content
Haici Yang, Sanna Wager, Spencer Russell, Mike Luo, Minje Kim, Wontak Kim

Sound source localization

End-to-end Alexa device arbitration
Jarred Barber, Yifeng Fan, Tao Zhang

Speaker diarization/identification/verification

ASR-aware end-to-end neural diarization
Aparna Khare, Eunjung Han, Yuguang Yang, Andreas Stolcke

Improving fairness in speaker verification via group-adapted fusion network
Hua Shen, Yuguang Yang, Guoli Sun, Ryan Langman, Eunjung Han, Jasha Droppo, Andreas Stolcke

OpenFEAT: Improving speaker identification by open-set few-shot embedding adaptation with Transformer
Kishan K C, Zhenning Tan, Long Chen, Minho Jin, Eunjung Han, Andreas Stolcke, Chul Lee

Self-supervised speaker recognition training using human-machine dialogues
Metehan Cekic, Ruirui Li, Zeya Chen, Yuguang Yang, Andreas Stolcke, Upamanyu Madhow

Self-supervised speaker verification with simple Siamese network and self-supervised regularization
Mufan Sang, Haoqi Li, Fang Liu, Andrew O. Arnold, Li Wan

Spoken-language understanding

A neural prosody encoder for end-to-end dialogue act classification
Kai Wei, Dillon Knox, Martin Radfar, Thanh Tran, Markus Mueller, Grant P. Strimel, Nathan Susanj, Athanasios Mouchtaris, Maurizio Omologo

Multi-task RNN-T with semantic decoder for streamable spoken language understanding
Xuandi Fu, Feng-Ju Chang, Martin Radfar, Kai Wei, Jing Liu, Grant P. Strimel, Kanthashree Mysore Sathyendra

Tie your embeddings down: Cross-modal latent spaces for end-to-end spoken language understanding
Bhuvan Agrawal, Markus Mueller, Samridhi Choudhary, Martin Radfar, Athanasios Mouchtaris, Ross McGowan, Nathan Susanj, Siegfried Kunzmann

TINYS2I: A small-footprint utterance classification model with contextual support for on-device SLU
Anastasios Alexandridis, Kanthashree Mysore Sathyendra, Grant P. Strimel, Pavel Kveton, Jon Webb, Athanasios Mouchtaris

Text-to-speech

Cross-speaker style transfer for text-to-speech using data augmentation
Manuel Sam Ribeiro, Julian Roth, Giulia Comini, Goeric Huybrechts, Adam Gabrys, Jaime Lorenzo-Trueba

Distribution augmentation for low-resource expressive text-to-speech
Mateusz Lajszczak, Animesh Prasad, Arent van Korlaar, Bajibabu Bollepalli, Antonio Bonafonte, Arnaud Joly, Marco Nicolis, Alexis Moinet, Thomas Drugman, Trevor Wood, Elena Sokolova

Duration modeling of neural TTS for automatic dubbing
Johanes Effendi, Yogesh Virkar, Roberto Barra-Chicote, Marcello Federico

Neural speech synthesis on a shoestring: Improving the efficiency of LPCNET
Jean-Marc Valin, Umut Isik, Paris Smaragdis, Arvindh Krishnaswamy

Text-free non-parallel many-to-many voice conversion using normalising flows
Thomas Merritt, Abdelhamid Ezzerg, Piotr Biliński, Magdalena Proszewska, Kamil Pokora, Roberto Barra-Chicote, Daniel Korzekwa

VoiceFilter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing module
Adam Gabrys, Goeric Huybrechts, Manuel Sam Ribeiro, Chung-Ming Chien, Julian Roth, Giulia Comini, Roberto Barra-Chicote, Bartek Perz, Jaime Lorenzo-Trueba

Time series forecasting

Robust nonparametric distribution forecast with backtest-based bootstrap and adaptive residual selection
Longshaokan Marshall Wang, Lingda Wang, Mina Georgieva, Paulo Machado, Abinaya Ulagappa, Safwan Ahmed, Yan Lu, Arjun Bakshi, Farhad Ghassemi

Research areas

Related content

US, NY, New York
We are seeking an Applied Scientist to develop and optimize Visual Inertial Odometry (VIO) and sensor fusion systems for our intelligent robots. In this role, you will design, implement, and deploy state estimation and tracking algorithms that enable robots to understand their position and motion in real time, even in challenging and dynamic environments. You will own the full pipeline from algorithm development through embedded deployment, ensuring that perception systems run efficiently on resource-constrained robotic hardware. You will also leverage modern machine learning approaches to push the boundaries of classical perception methods, combining learned representations with geometric techniques to achieve robust, real-time performance. This is a deeply hands-on role. You will work directly with sensors, hardware, and real-world data, while prototyping, testing, and iterating in physical environments. The ideal candidate has strong foundations in VIO and sensor fusion, practical experience optimizing algorithms for embedded platforms, and familiarity with how modern deep learning is transforming perception. Key job responsibilities - Design and implement Visual Inertial Odometry algorithms for robust real-time state estimation on robotic platforms like Sprout - Develop multi-sensor fusion pipelines integrating cameras, IMUs, and other sensing modalities for accurate pose tracking - Optimize perception and tracking algorithms for deployment on embedded hardware (e.g., ARM, GPU-accelerated edge devices) under strict latency and power constraints - Apply modern ML-based perception techniques (learned features, depth estimation, neural odometry) to complement and improve classical geometric approaches - Build and maintain calibration, evaluation, and benchmarking infrastructure for perception systems - Collaborate with hardware, controls, and navigation teams to integrate perception outputs into the robot’s autonomy stack - Lead technical projects from research prototyping through production deployment
US, WA, Bellevue
Amazon Leo is a constellation of Low Earth Orbit satellites that will provide low-latency, high-speed broadband network connectivity to unserved and underserved communities around the world. We are looking for an Applied Scientist to be a founding scientist on the Engineering and R\&D team within Leo Infrastructure and IP Security. The team defends the manufacturing lines, launch sites, and global ground infrastructure behind the constellation from the most sophisticated threat actors on the planet. These requirements create open scientific problems at the intersection of agentic AI, real-time stream processing, graph-based reasoning, and behavioral analytics. You will build the science behind a neurosymbolic reasoning platform and the models that detect the behavior of sophisticated threat actors. This is an R\&D role with a production mandate, where you define the problem rather than solve a pre-scoped one, and every model, detection, and agent workflow you build becomes the system Leo's security teams use to protect the constellation. #### Export Control Requirement Due to applicable export control laws and regulations, candidates must be a U.S. citizen. Key job responsibilities - Design and implement scalable, production-grade neurosymbolic systems that integrate symbolic reasoning over graph-based knowledge representations with LLM agents to deliver reliable, verifiable security outcomes. - Design and run reinforcement learning and fine-tuning pipelines (GRPO, PPO, DPO) to optimize language models for security reasoning, triage, and detection-authoring tasks. - Build behavioral and statistical models that detect threat actor behavior, and design the evaluation frameworks that measure model performance against that behavior before trusting a model in production. - Design and build multi-agent systems that autonomously triage, enrich, and contain security events, including the constrained reasoning, safety guardrails, and validation mechanisms that make automated decisions trustworthy at scale. - Own the end-to-end science lifecycle, from research and experimentation through production deployment, defining the metrics that measure system performance and real-world security impact. - Advance the state of the art through publications at top-tier venues, patents, or open-source contributions, and shape the scientific agenda and research culture from day one. A day in the life You will move between research and production in the same week: framing an ambiguous security problem as a scientific question, prototyping an approach, and partnering with software engineers to ship it as a capability the platform runs continuously. Security engineers on your team translate threat intelligence into the adversary behaviors that matter; you build the models that detect those behaviors and evaluate model performance against them. You will obsess over the two latencies that define the platforms, the time from event to detection and the time from detection to containment action, and design agents and detections that drive both down. You will backtest candidate detections against retained telemetry, review evaluation results before a model or agent capability graduates to automated execution, and deliver scientific artifacts that ship. About the team Leo Infrastructure and IP Security protects the people, facilities, hardware, and supply chain behind a global satellite constellation. The Engineering and R&D team within this organization builds the platforms and tooling the security pillar teams operate on, moving security operations from manual triage to correlation-based detection, automated response, and agentic AI. The team is composed of applied scientists, software engineers, and security engineers working across physical and digital security domains. #### Inclusive Team Culture In Amazon Security, it's in our nature to learn and be curious. Ongoing DEI events and learning experiences inspire us to continue learning and to embrace our uniqueness. Addressing the toughest security challenges requires that we seek out and celebrate a diversity of ideas, perspectives, and voices. #### Training & Career Growth We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional. #### Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there's nothing we can't achieve.
US, CA, Sunnyvale
Robots are about to step out of the movies and into our homes. If you're excited about this robotics revolution, come join Amazon's Fauna Robotics. As an Applied Scientist in this org, you'll push the state-of-the-art techniques in Robotics. You'll drive technical excellence in areas such as perception, manipulation, sim2real transfer, reinforcement learning and multi-task learning, designing novel algorithms that bridge the gap between research and real-world deployment. In this role, you will integrate hands-on technical expertise with scientific leadership, ensuring your team delivers robust solutions for dynamic real-world environments. While staying updated with the latest advancements in robotics research, you will leverage your experience and expertise to guide the team towards the most promising direction. Collaborating with a talented group of software engineers and scientists, you will bring your ideas to fruition. Deploying robots in home environments requires you to anticipate challenges not encountered in structured settings like warehouses. Additionally, consumer-grade sensors and actuators necessitate working around their limitations, requiring out-of-the-box innovative ideas. As such, you are someone who truly enjoys thinking about problems using first principles at a holistic and systems level to address the aforementioned challenges. Key job responsibilities - Lead technical initiatives in areas such as robotics foundation models, reinforcement learning and manipulation - - Design experiments to identify the limitations of current state-of-the-art models and developing new models or techniques that can surpass these models - Design and implement novel deep learning architectures that push the boundaries of what robots can understand and accomplish - Mentor fellow scientists while maintaining strong individual technical contributions - Collaborate with engineering teams to optimize and scale models for real-world applications - Influence technical decisions and implementation strategies within your area of focus - Experienced in communicating complex technical work to a non-technical audience - The ability to work with minimal guidance, be proactive and to handle ambiguity and the challenge of quickly evolving goals About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
US, WA, Seattle
Economists at Amazon partner closely with senior management, business stakeholders, scientist and engineers, and economist leadership to solve key business problems ranging from Amazon Web Services, Prime, inventory planning, international retail, third party merchants, search, pricing, labor and employment planning, effective benefits (health, retirement, etc.) and beyond. Amazon Economists build econometric models using our world class data systems and apply approaches from a variety of skillsets – applied macro/time series, applied micro, econometric theory, empirical IO, empirical health, labor, public economics and related fields are all highly valued skillsets at Amazon. You will work in a fast moving environment to solve business problems as a member of either a cross-functional team embedded within a business unit or a central science and economics organization. You will be expected to develop techniques that apply econometrics to large data sets, address quantitative problems, and contribute to the design of automated systems around the company.
US, WA, Seattle
We are seeking an exceptional Applied Scientist, Seller Abuse Prevention, to lead the development and implementation of advanced AI solutions that will transform how we prevent bad actors from operating in our store and enable Selling Partners to start and grow their business without fear of disruption, so that customers and Selling Partners across the globe trust us and have confidence in the integrity of Amazon's store. This role will focus on building risk detection models leveraging state-of-the-art AI, including small language models, to detect and prevent abuse of Amazon's catalog worldwide. You will design, develop, and deploy scalable AI solutions to proactively detect and prevent marketplace abuse throughout the seller lifecycle. You will work with massive-scale, multi-modal datasets spanning behavioral patterns, transactional histories, and behavioral data to build detection systems that are ahead of evolving adversarial tactics. Key job responsibilities - Design and build predictive risk detection models using advanced AI techniques, including Natural Language Processing including LLMs and agents to proactively identify bad actors and prevent marketplace abuse at scale - Own the end-to-end scientific solution from risk quantification through decision optimization, determining the appropriate actions to take across varying risk levels - Develop interpretability and reasoning pipelines that provide transparent, actionable explanations for model decisions to support enforcement and seller experience - Work with risk programs across the seller lifecycle to define detection strategies, translate operational investigation patterns into automated systems, and prioritize high-impact risk areas - Partner with engineering teams to deploy models into production, define evaluation frameworks, and collaborate with operations and verification teams to measure and improve detection effectiveness A day in the life Day-to-day you can expect to: - Explore datasets to understand predictors and patterns of abuse - Work with product, program, and engineering stakeholders to build solutions into production that will last - Identify new and emerging abuse vectors as abusers get more sophisticated - Use search, graph, computer vision, NLP, and anomaly detection methodologies to automatically detect abusive actions. About the team Our team is driven by the belief that scientific innovation unlocks transformative customer experiences. We tackle hard, ambiguous problems by combining rigorous research methods with practical engineering, and we value collaboration across disciplines. We are building an inclusive environment where scientists at every stage of their career can grow, publish impactful work, and see their research come to life at Amazon scale. If you want to do science that matters, this is the place.
US, NY, New York
The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through industry leading generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. As an Applied Scientist within the Brand Intelligence team, you will be responsible for improving the quality of underlying agentic solutions and their impact within the ads delivery stack. We are looking for a passionate candidate with technical expertise in agentic systems, continual learning, evaluation, information retrieval, Natural Language Processing (NLP), and Large Language Models (LLM). In addition to having hands-on experience in building ML-based solutions, an ideal candidate should be able to create and articulate a customer-centric science vision, show willingness to continuously learn about new scientific approaches, and enjoy operating in startup-like environment.
US, NY, New York
Fauna Robotics is building capable, safe, and delightful robots for everyday life, and understanding where it is, and what's around it, is fundamental to everything a robot does. A robot that lives alongside people must build and maintain a map of its environment, plan paths through cluttered and changing spaces, and do so reliably whether it's navigating a hallway for the hundredth time or entering a room it has never seen. We are hiring a Principal Applied Scientist to serve as a technical authority on how our robots understand and move through the world. You will design, prototype, and ship the core algorithms that give the robot spatial intelligence - from real-time SLAM and scene understanding to motion planning and autonomous navigation. You will set the mapping and navigation architecture that other engineers build on, shape sensor and compute decisions across robot generations, mentor the engineers and scientists working on spatial perception, and be the person teams come to when the robot is lost. Key job responsibilities - Set the long-range science roadmap and technical architecture for the robot's mapping, localization, and navigation stack, and serve as Fauna's primary technical authority on spatial intelligence - Design and implement real-time visual-inertial and/or lidar-based SLAM systems that build, update, and maintain persistent maps of home and indoor environments - Develop robust localization algorithms that allow the robot to determine its precise pose in previously mapped spaces, handling environmental changes such as moved furniture, lighting variation, and dynamic occupants - Build navigation and motion planning systems that produce safe, efficient, and natural-looking trajectories through cluttered, dynamic human spaces - Architect semantic mapping capabilities that go beyond geometry — enabling the robot to understand rooms, objects, surfaces, and traversable space at a level that supports higher-level task planning - Drive sensor selection and placement decisions for depth cameras, lidar, IMUs, and encoders in collaboration with mechanical, electrical, and industrial design teams, backed by your own benchmarking and analysis - Design the robot-specific data collection, benchmarking, and evaluation methods to validate mapping accuracy, localization robustness, and navigation safety across diverse real-world environments - Develop strategies for graceful degradation and recovery — ensuring the robot behaves safely when localization is uncertain, maps are incomplete, or sensors are occluded - Present mapping and navigation science and its tradeoffs to senior leadership and partner teams - Mentor scientists and engineers, raising the scientific bar for spatial perception across the organization through design reviews, code reviews, and hiring About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won't arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We're changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We're building robots that feel responsive, expressive, and genuinely useful. At Fauna, you'll work at the frontier of this space, helping define how robots move, navigate, and interact with people in natural environments. It's an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we're interested in hearing from you.
CH, Zurich
Are you passionate about pushing the boundaries of what robots can do? Amazon is looking for a creative and driven Applied Scientist to help build intelligent robotic manipulation systems powered by reinforcement learning. In this role, you will research, design, and deploy machine learning solutions that enable robots to interact with the physical world in increasingly capable ways. You will tackle complex, ambiguous problems where textbook answers don't exist, working backwards from real-world needs to invent new approaches. Your work will directly influence how automation systems learn, adapt, and perform at Amazon's scale — and you will see your research come to life on real hardware. Key job responsibilities - Research and develop reinforcement learning methods for robotic manipulation, advancing the state of the art in sim-to-real transfer, contact-rich control, and adaptive grasping strategies. - Design, implement, and evaluate machine learning models and algorithms, leveraging deep learning frameworks such as PyTorch or TensorFlow to train policies that generalize across varied manipulation tasks. - Build and maintain production-quality code that integrates scientific prototypes into larger robotics systems, making thoughtful tradeoffs between complexity, performance, and maintainability. - Collaborate with cross-functional engineering and science teams to define simulation requirements, validate model performance, and iterate on solutions informed by real-world hardware feedback. - Contribute to the team's scientific roadmap by identifying new research directions, mentoring fellow scientists, and publishing results at peer-reviewed venues when appropriate. A day in the life You might start your morning reviewing overnight training runs, analyzing reward curves and failure modes from your latest reinforcement learning experiments. After a quick sync with robotics engineers, you shift to refining a simulation environment to close a gap you spotted between sim and real performance. In the afternoon, you pair with a teammate to design a new evaluation framework, then wrap up by drafting a short write-up of your findings to share with the broader team. About the team Our team sits at the intersection of machine learning research and real-world robotics, focused on teaching robots to manipulate objects with precision and adaptability. We combine reinforcement learning, physics-based simulation, and hands-on hardware validation to deliver solutions that work beyond the lab. We value intellectual curiosity, collaborative problem-solving, and a shared commitment to turning ambitious research ideas into tangible impact. If you are excited about building intelligent systems that learn from experience and operate at scale, this is the team for you.
US, CA, Sunnyvale
Amazon is looking for an Applied Scientist with a strong deep learning background to help build the training environments that teach large language models to reason, use tools, and complete complex, multi-step tasks. Key job responsibilities You will design, build, and evaluate reinforcement learning environments (RL gyms) for LLM training: realistic, verifiable task environments where models learn through interaction and feedback. This includes defining tasks and reward signals, building the infrastructure to run environments at scale, measuring how well environments transfer into model capability, and developing rigorous methods to verify environment quality and correctness. You will work closely with model training teams to understand where environments are most valuable and iterate based on what the models learn. Your work will directly shape products and services that use generative AI. About the team The Foundational AI (FAI) team has a mission to push the envelope in GenAI with LLMs, in order to provide the best-possible experience for our customers.
US, WA, Seattle
The charter of the Entertainment Economics team includes working on high-impact projects that require economics expertise and a cross-business perspective. Our team supports Amazon’s diverse entertainment businesses – especially Prime Video, Amazon Music, Amazon MGM Studios, and Gaming (Luna) – through complex causal measurements (observational and experimental) and structural modeling. Some of our team’s areas of science expertise include marketing science, long-term value measurement, and experimentation. As a central economics team not embedded in any particular business, we strive to provide objective analyses that take a customer-obsessed, pan-Amazon perspective. This role partners with the Prime Science team to evaluate and improve the way Amazon allocates Prime subscription revenue across its benefit teams, including entertainment businesses. Prime is Amazon's premiere membership program, with over 200mm members world-wide, bringing in billions in Prime subscription revenue annually. Prime is at the center of many major company decisions that impact Amazon's customers. These decisions span a variety of industries, each reflecting the diversity of Prime benefits: fast and free shipping, entertainment & digital content, reading, healthcare, and grocery. Each of these Prime benefits is supported by a different organization, and each relies on Prime subscription revenue to make critical investment decisions. Our team partners with Prime Science to ensure that these allocations are credible, actionable, and incentive compatible for every benefit. To support this work, this role will create science models, validate them, and productionize them. In addition to stellar economics expertise, this role requires systems thinking (anticipating how complex interconnected models will respond to changes in data or modeling), strategic thinking (supporting decisions that affect 200 million+ customers and set Amazon’s direction for years to come), and scientifically novel thinking (using AI and the latest science advancements to achieve move). The ideal candidate is expert in causal inference with experience working in large, complex structural modeling environments. They are a creative problem-solver, able to identify new approaches that solve multiple problems at once while minimizing churn. They think big, not limiting themselves to what’s been done before, while tactfully accounting for the costs of major changes. They can add structure to incredibly ambiguous business contexts, making defensible assumptions and delivering measurements that drive impactful business decisions. They have effective communication and the skill to translate data-driven findings into actionable insights for senior leaders. Finally, they are empathetic and constructive. Our healthy team culture is supportive and fast-paced, and we prioritize learning, growth, and helping each other to continuously raise the bar. Impact and Career Growth In today’s entertainment landscape, critical decisions are made with data and economic models. You’ll help leaders ask the right questions, and then deliver data-driven answers, helping to create the future of Amazon. You’ll help define a long-term science vision in this space and translate it into an actionable roadmap. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding – a perfect recipe for career growth as an economist in tech. Key job responsibilities • Design and build econometric models, especially causal models, to measure the value of the business and its many features • Develop science products from concept to prototype to production, incorporating feedback from scientists and business partners • Independently identify and pursue new opportunities to leverage economic insights across entertainment and Prime • Write business and technical documents communicating business context, methods, and results to business leadership and other scientists • Serve as a technical reviewer for our team and related teams, including document and code reviews