The science behind Echo Frames

How the team behind Echo Frames delivered longer battery life and improved sound quality inside the slim form factor of a pair of eyeglasses.

When the team behind Amazon’s Echo Frames set out to improve the next generation of their product, they needed to strike a delicate balance. Customer feedback on earlier versions of the smart audio eyeglasses centered on three elements: longer battery life, more style options, and improved sound quality.

A man with a beard is seen wearing a pair of Echo Frames glasses. He is standing outside and is pictured in three-quarters view.
Echo Frames feature custom-built speech processing technology that drastically improves word recognition — key for interacting with Alexa in windy or noisy environments.

Achieving all three of those goals would be a challenge in itself; doing that inside the slim form factor of a pair of Alexa-enabled eyeglasses upped the ante.

“All three of those goals are in tension with one another,” says Adam Slaboski, senior manager of product management and product lead for Echo Frames. The easiest way to improve battery and audio would be to increase the size of the device, but that would conflict with feedback around the importance of design. Amping up bass to improve the audio experience would consume more battery, and so on.

Finding that sweet spot was a huge effort in engineering and customer understanding.
Adam Slaboski

“Finding that sweet spot was a huge effort in engineering and customer understanding," Slaboski says.

With Echo Frames (3rd Gen) and Carrera Smart Glasses with Alexa (designed in collaboration with Safilo, one of the world’s leading eyewear companies), the Smart Eyewear team met the challenge.

The smart glasses feature enhanced audio playback, with custom-built speech-processing technology that dramatically improves word recognition — key for interacting with Alexa in windy or noisy environments. The new range of frame styles come in a variety of sizes, and all come with a significant boost in battery life.

From the outside, Echo Frames still look like a pair of regular eyeglasses. “But we changed everything on the inside,” says Jean Wang, general manager and director of Smart Eyewear. “And we learned new lessons along the way.”

Here’s how Amazon engineers and product designers tackled all three customer demands.

Turning up the volume with open-ear audio

Like previous generations of Echo Frames, the current model uses open-ear audio. In addition to fitting the form factor of a pair of glasses, this allows users to maintain awareness of their surroundings while interacting with Alexa or enjoying audio entertainment.

Related content
Combining psychoacoustics, signal processing, and speaker beamforming enhances stereo audio and delivers an immersive sound experience for customers.

The open-ear audio design has been popular with users who are blind or have low vision, notes Jenai Akina, senior product manager for Echo Frames. “It’s really beneficial that it doesn’t obstruct a critical sense like hearing,” she explains. “That form factor is really helpful for daily interactions — especially when we want to be open to engage with our environment and the people around us. Open ear allows customers to maintain awareness, while providing access to a voice assistant.”

Open-ear audio brings a host of unique challenges to the engineering process. Typical headphones and earbuds block off the ear from the outside world, preventing air from escaping. That funnels more of the sound waves from the speakers into the user’s ears. With an open-ear design, sound has to travel farther, and there is less control over direction. That could lower the audio volume and reduce clarity — and importantly, audio could leak out to people standing nearby. The key is to drive the sound pressure as much as possible toward the user’s ears while minimizing the audio leakage.

By bringing people into the lab, we can simulate real environmental noise conditions like wind, background noise in a crowded restaurant, and the sound of cars on the road.
Scott Choi

In working to improve audio quality, the team continued to hone the directionality of the sound while also working to improve volume and bass. A technique called dipole speaker configuration helps to do both. In addition to a sound porthole located near the ear canal, the frames feature a second porthole that cancels unnecessary sound while amping up bass.

With input from in-house audio experts and instruments to analyze measurements like harmonic distortion, the team came up with a set of potential tuning solutions that met objective targets for audio quality. They then tested those “flavors” of tuning in the lab with several user groups.

“By bringing people into the lab, we can simulate real environmental-noise conditions like wind, background noise in a crowded restaurant, and the sound of cars on the road,” explains senior manager of audio Scott Choi. That allowed his team to understand environmental variables in a controlled setting.

With the feedback from those focus groups, the team then selected a few of the most popular tunings to push out to beta testing, where users could provide feedback on a weekly basis.

“We see how the feedback trends change with each tuning change, which gradually allows it to mature and converge into a certain tuning,” Choi says. The result is audio calibrated to maximize intelligibility and volume without leaking private conversations (or guilty-pleasure playlists).

The Echo Frame team used a rotating arch of microphones to lest leakage. This animation shows the array moving in circles around a mannequin wearing the Gen 3 prototype, creating a 3D sphere plot of audio leakage. Via this testing, the team was able to minimize leakage to the side and back.
The Echo Frame team used a rotating arch of microphones to lest leakage. The array moved in circles around a mannequin wearing the Gen 3 prototype, creating a 3D sphere plot of audio leakage. Via this testing, the team was able to minimize leakage to the side and back.

To test leakage, the audio team rigged up a rotating arch of microphones. The array moved in circles around a mannequin wearing the Gen 3 prototype, creating a 3-D sphere plot of audio leakage. Choi explains that they focused on minimizing leakage to the side and back, and ultimately, the speakers were moved much closer to the ear to help minimize leakage and improve loudness.

Leakage isn’t the only privacy consideration. The Echo Frame team also continues to innovate on protecting users from bad actors who may get hold of their smart glasses.

Related content
Amazon senior principal engineer Luu Tran is helping the Alexa team innovate by collaborating closely with scientist colleagues.

Gen 2 protected users by requiring them to authenticate their sessions using a trusted phone. Without authentication, a user can’t invoke sensitive commands like “navigate me home,” unlocking a smart lock, or making a purchase. But customers didn’t like the added friction.

Now customers who enroll in Alexa Voice ID will be able to use their vocal fingerprints for authentication to receive responses to smart-home utterances.

“We’re the first on-the-go Alexa device to use Voice ID for privacy authentication,” Slaboski says.

Boosting battery life without cramping style

Gen 3 improves continuous music playback time to six hours, versus the four hours offered by the previous generation of Echo Frames. It also bumps battery life to up to 14 hours of moderate usage spread across playback, talk time, notifications, and Alexa interactions.

Delivering the desired loudness, bass, and audio quality while optimizing for battery life was a careful balance.
Ravi Sanapala

The team couldn’t simply slap on a bigger battery without making the Echo Frames look less like normal glasses. And with sound quality high on the priority list as well, the devices were going to need as much juice as ever. The team focused on trimming power use in standby mode, ensuring that the overall battery consumption would go down without weakening the speakers when users needed them.

“Delivering the desired loudness, bass, and audio quality while optimizing for battery life was a careful balance,” says senior product manager Ravi Sanapala. “We need the battery to last throughout as much of the day as possible and for Alexa to be available whenever users need it.”

The architectural changes in speaker placement helped keep power needs low while improving audio. The team also tweaked the placement of the battery itself, distributing its capacity differently than in Gen 2. Sanapala adds that algorithmic changes were key in balancing idle-battery conservation and on-demand device usage.

“We had to collaborate with all of our cross-functional teams to optimize everything,” Sanapala says.

Gen 3 also features an all-new charging stand, which is designed for compatibility with all frame shapes and keeps lenses upright, protecting them from scratches while wirelessly charging.

Making smart eyewear look like eyewear

Making glasses that are suitable for everyday wear has always been a priority. “One of our goals has always been to develop technology that appears when you need it and disappears when you don’t,” says Wang.

Previous models of Echo Frames have come in a single, one-size-fits-all style.

A person is seen wearing Echo Frames sunglasses outside. The person carries a notebook and is looking down at it, and there are some buildings and blue sky in the background.
The Echo Frames team consulted with both internal and external eyewear designers to review common and popular styles of frames, and to survey potential customers about their preferences.

“That was a very intentional move,” Wang explains. “We wanted to start simply and learn from customer feedback.”

Gen 2’s flexible spring hinge and adjustable temple tips ensured that the single size fit many different faces. In fact, Wang says, while the goal was to fit around half of all potential users, they’ve found that 85 percent of the adult population can comfortably wear the Gen 2 design.

But with Gen 3, Wang says, the team needed to go beyond designing glasses that looked typical. Customers wanted glasses that looked stylish, too.

The team consulted with both internal and external eyewear designers to review common and popular styles of frames, as well as “edgier” designs, and to survey potential customers about their preferences. After testing options with beta customers, they settled on a variety of styles in various colors that cover a range of aesthetics. They also switched to an acetate material to match the feel of high-end eyewear.

Related content
How a team of designers, scientists, developers, and engineers worked together to create a truly unique device in Echo Show 10.

While each style will still come in a single size, the range of designs will accommodate even more faces than Gen 2, as the collection spans narrow, medium, and wide fits. Each style features adjustable temple tips constructed out of silicone around a lightweight titanium core for better fit. And despite the boost in battery life, the temples of Gen 3 frames have actually been slimmed down. Wang notes that competitive products often place large batteries behind a user’s ears. But presenting Echo Frames users with something that bulky and uncomfortable was never on the table.

“We were working with really heavy constraints,” Wang says. “So we have been very deliberate in making design choices in the service of our customer. That’s challenged us to be innovative and really push the limits of what’s possible in the architecture of our designs.”

Related content

US, MA, Boston
Our team is involved with pre-silicon design verification for custom IP. A critical requirement of the verification flow is the requirement of legal and realistic stimulus of a custom Machine Learning Accelerator Chip. Content creation is built using formal methods that model legal behavior of the design and then solving the problem to create the specific assembly tests. The entire frame work for creating these custom tests is developed using a SMT solver and custom software code to guide the solution space into templated scenarios. This highly visible and innovative role requires the design of this solving framework and collaborating with design verification engineers, hardware architects and designers to ensure that interesting content can be created for the projects needs. Key job responsibilities Develop an understanding for a custom machine learning instruction set architecture. Model correctness of instruction streams using first order logic. Create custom API's to allow control over scheduling and randomness. Deploy algorithms to ensure concurrent code is safely constructed. Create coverage metrics to ensure solution space coverage. Use novel methods like machine learning to automate content creation. About the team Utility Computing (UC) AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services. Annapurna Labs (our organization within AWS UC) designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world.
IN, KA, Bengaluru
Amazon Devices is an inventive research and development company that designs and engineer high-profile devices like the Kindle family of products, Fire Tablets, Fire TV, Health Wellness, Amazon Echo & Astro products. This is an exciting opportunity to join Amazon in developing state-of-the-art techniques that bring Gen AI on edge for our consumer products. We are looking for exceptional scientists to join our Applied Science team and help develop the next generation of edge models, and optimize them while doing co-designed with custom ML HW based on a revolutionary architecture. Work hard. Have Fun. Make History. Key job responsibilities - Quantize, prune, distill, finetune Gen AI models to optimize for edge platforms - Fundamentally understand Amazon’s underlying Neural Edge Engine to invent optimization techniques - Analyze deep learning workloads and provide guidance to map them to Amazon’s Neural Edge Engine - Use first principles of Information Theory, Scientific Computing, Deep Learning Theory, Non Equilibrium Thermodynamics - Train custom Gen AI models that beat SOTA and paves path for developing production models - Collaborate closely with compiler engineers, fellow Applied Scientists, Hardware Architects and product teams to build the best ML-centric solutions for our devices - Publish in open source and present on Amazon's behalf at key ML conferences - NeurIPS, ICLR, MLSys.
US, CA, Culver City
MULTIPLE POSITIONS AVAILABLE Employer: AMAZON.COM SERVICES LLC Offered Position: Applied Scientist III Job Location: Culver City, California Job Number: AMZ10564141 Position Responsibilities: Participate in the design, development, evaluation, deployment and updating of data-driven models and analytical solutions for machine learning (ML) and/or natural language (NL) applications. Develop and/or apply statistical modeling techniques (e.g. Bayesian models and deep neural networks), optimization methods, and other ML techniques to different applications in business and engineering. Routinely build and deploy ML models on available data, and run and analyze experiments in a production environment. Identify new opportunities for research in order to meet business goals. Research and implement novel ML and statistical approaches to add value to the business. Mentor junior engineers and scientists. 40 hours / week, 8:00am-5:00pm, Salary Range: $167,100/year to $226,100/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, visit: https://www.aboutamazon.com/workplace/employee-benefits. Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation.#0000
IN, KA, Bengaluru
Amazon Prime Video is looking for passionate, talented, and inventive Applied Scientists with a strong machine learning background to help build industry-leading Audio, Video and Language technology using GenAI. As part of the AI team in Amazon Prime Video, you will work on developing and fine-tuning LLMs and developing new large multimodal models to advance state-of-the-art in the translation, transcription and generation of multingual cinematic content. You will use the latest GenAI techniques to create and assess cinematic content like videos, audio, and captions, and more. You will design novel approaches to integrate speech, vision, and text for holistic understanding and generation of content, and Collaborate cross-functionally with product managers, engineers, and domain experts to define and deliver high-impact solutions. Your work will directly impact millions of our customers in the form of products and services that make use of speech and language technology on Prime Video content. Key job responsibilities We are looking to hire a top notch scientist with strong machine learning background, sharp research acumen and a hunger for solving ambiguous and challenging science problems. This person will work on developing and fine-tuning LLMs and developing new large multimodal models to advance state-of-the-art in the translation, transcription and generation of multingual cinematic content. They will be required to use the latest GenAI advancements to create and assess cinematic content like videos, audio, and captions, and more. Flavor of problems we are trying to solve: a) generating high quality subtitles in many languages meeting high customer satisfaction bar, b) developing foundation model capable of enabling many down stream tasks in localization and accessibility space, c) generating captions with plot pertinency, character identification etc. d) developing solution for assessing quality of subtitles, captions and metadata unified across different content types, linguistic vs non-linguistic aspects, different languages, and which mimics end user satisfaction while at the same time is explainable. About the team By 2027, Prime Video (PV) aspires to be the primary destination for customers to watch and the primary channel for partners to distribute premium cinematic content. The Content Reasoning, Enrichment & Localization (CoREL) science team’s mission is to develop AI to deeply understand the diverse facets of Prime Video's content across multiple languages, and to create content that power immersive, cinematic experiences. To drive this mission and delight our customers, the CoREL Science Bangalore team addresses the localization and accessibility aspects by a) understanding fine-grained information contained in content to enable generation of localized assets in different languages, b) generating subtitles and accessibility assets like captions across different content types and languages, c) assessing quality of generated (1P) and partner submitted (3P) assets and metadata to ensure defect free customer experience on PV.
US, CA, San Francisco
If you are interested in this position, please apply on Twitch's Career site https://www.twitch.tv/jobs/en/ About Us: Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day. We’re about community, inside and out. You’ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We’re on a quest to empower live communities, so if this sounds good to you, see what we’re up to on LinkedIn and X, and discover the projects we’re solving on our Blog. Be sure to explore our Interviewing Guide to learn how to ace our interview process. About the Role We are looking for an Applied Scientist to solve challenging and open-ended problems in the domain of Creators and content contextual signals. As an Applied Scientist on Twitch's GTM Science team, you will use applied machine learning to tackle ambiguous business problems across problem areas such as Ads, Brand Safety, Creator Sponsorship and Content Understanding. You will lead high profile projects where you will use a wide toolbox of ML tools to handle multiple types of data, including user behavior, metadata, and user generated content such as text and video. You will collaborate with a team of passionate scientists, engineers, and product stakeholders to develop these models, prototype and put them into production, where they can help Twitch's creators and viewers succeed and build communities. You will report to our Senior Data Science Manager for GTM. This position is located in San Francisco, CA. You Will - Build machine learning products to enrich Twitch’s content understanding and help creators and viewers build and discover their communities. - Propose, design, and oversee execution for high-impact projects that work backwards from customer problems to develop the right solution for the job. Know when to use a classical ML model versus a state-of-the-art one. - Collaborate with cross-functional engineering and product teams to prototype and deploy your models into flexible data pipelines and ML-based services. - Bring innovation and help drive science culture on the team by staying up to date and experimenting with new techniques in LLM, computer vision, inference and model evaluation. Perks * Medical, Dental, Vision & Disability Insurance * 401(k) * Maternity & Parental Leave * Flexible PTO * Amazon Employee Discount
IN, KA, Bengaluru
Interested to build the next generation Financial systems that can handle billions of dollars in transactions? Interested to build highly scalable next generation systems that could utilize Amazon Cloud? Massive data volume + complex business rules in a highly distributed and service oriented architecture, a world class information collection and delivery challenge. Our challenge is to deliver the software systems which accurately capture, process, and report on the huge volume of financial transactions that are generated each day as millions of customers make purchases, as thousands of Vendors and Partners are paid, as inventory moves in and out of warehouses, as commissions are calculated, and as taxes are collected in hundreds of jurisdictions worldwide. Key job responsibilities • Understand the business and discover actionable insights from large volumes of data through application of machine learning, statistics or causal inference. • Analyse and extract relevant information from large amounts of Amazon’s historical transactions data to help automate and optimize key processes • Research, develop and implement novel machine learning and statistical approaches for anomaly, theft, fraud, abusive and wasteful transactions detection. • Use machine learning and analytical techniques to create scalable solutions for business problems. • Identify new areas where machine learning can be applied for solving business problems. • Partner with developers and business teams to put your models in production. • Mentor other scientists and engineers in the use of ML techniques. A day in the life • Understand the business and discover actionable insights from large volumes of data through application of machine learning, statistics or causal inference. • Analyse and extract relevant information from large amounts of Amazon’s historical transactions data to help automate and optimize key processes • Research, develop and implement novel machine learning and statistical approaches for anomaly, theft, fraud, abusive and wasteful transactions detection. • Use machine learning and analytical techniques to create scalable solutions for business problems. • Identify new areas where machine learning can be applied for solving business problems. • Partner with developers and business teams to put your models in production. • Mentor other scientists and engineers in the use of ML techniques. About the team The FinAuto TFAW(theft, fraud, abuse, waste) team is part of FGBS Org and focuses on building applications utilizing machine learning models to identify and prevent theft, fraud, abusive and wasteful(TFAW) financial transactions across Amazon. Our mission is to prevent every single TFAW transaction. As a Machine Learning Scientist in the team, you will be driving the TFAW Sciences roadmap, conduct research to develop state-of-the-art solutions through a combination of data mining, statistical and machine learning techniques, and coordinate with Engineering team to put these models into production. You will need to collaborate effectively with internal stakeholders, cross-functional teams to solve problems, create operational efficiencies, and deliver successfully against high organizational standards.
US, NY, New York
Fauna Robotics is building capable, safe, and delightful robots for everyday life, and voice is one of the most natural ways people will interact with them. Cloud speech and language models are good and getting better, but they can only work with the audio they receive, and a robot is a hard place to listen. Its microphones sit beside motors, fans, and moving joints. It speaks through its own loudspeaker while people talk over it. It moves, turns, and shares a room with several people at once. We are hiring a Principal Audio Scientist to be Fauna's technical authority on how our robots hear. You will design, prototype, and ship the hardest algorithms in the robot's audio system. You will set the audio architecture that other engineers build on, shape hardware decisions across robot generations, mentor the engineers and scientists working on audio, and be the person teams come to when the robot can't hear. Key job responsibilities - Set the long-range science roadmap and technical architecture for the robot's audio system, and serve as Fauna's primary technical authority on robot hearing - Design and implement suppression of the robot's own noise from motors, fans, and moving joints - Design and implement echo cancellation for the robot's own voice, so people can interrupt it naturally - Develop multi-microphone processing that holds up as the robot and the people around it move, including locating who is speaking so the robot can turn toward them - Make on-robot listening decisions robust to internal and external noise sources: wake word, voice activity, and whether speech is directed at the robot - Drive microphone and speaker placement, enclosure acoustics, and vibration isolation decisions with mechanical, electrical, and industrial design, backed by your own measurements - Design the robot-specific data collection and evaluation methods to validate the performance of our audio design - Present audio science and its tradeoffs to senior leadership and partner teams - Mentor scientists and engineers, raising the scientific bar for audio across the organization through design reviews, code reviews, and hiring
US, NY, New York
We are seeking a Robotics/AI Motor Control Scientist to develop cutting-edge machine learning algorithms for motor control systems in robots. In this role, you will focus on creating and optimizing intelligent motor control strategies to enable robots to perform complex, whole-body tasks. Your contributions will be essential in advancing robotics by enabling fluid, reliable, and safe interactions between robots and their environments. Key job responsibilities - Develop controllers that leverage reinforcement learning, imitation learning, or other advanced AI techniques to achieve natural, robust, and adaptive motor behaviors - Collaborate with multi-disciplinary teams to integrate motor control systems with robotic hardware, ensuring alignment with real-world constraints such as actuator dynamics and energy efficiency - Use simulation and real-world testing to refine and validate control algorithms - Stay updated on advancements in robotics, AI, and control systems to apply advanced techniques to robotic motion challenges - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers - Bridge research initiatives with practical engineering implementation About the team Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces. We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products. Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful. At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you. an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build. If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.
US, CA, Sunnyvale
Amazon's Artificial General Intelligence (AGI) organization is seeking an Applied Scientist III to advance the science of Responsible AI evaluation for large language models and generative AI. In this role, you will lead the design and development of rigorous evaluation methods, benchmarks, and metrics that measure the safety, fairness, robustness, and trustworthiness of frontier models. You will work with large-scale datasets, modern deep learning frameworks, and world-class scientists and engineers to turn research into evaluation systems that shape model launch decisions at Amazon scale. Key job responsibilities - Lead the design and implementation of evaluation frameworks, benchmarks, and metrics for responsible AI, including safety, fairness, robustness, and harmful content. - Build scalable automated evaluation pipelines for large language models, including model-based and human-in-the-loop evaluation. - Partner with pretraining, post-training, and product teams to translate evaluation results into model improvements and launch decisions. - Conduct rigorous experimentation and statistical analysis, and publish research at top venues. - Mentor junior scientists and help raise the scientific bar of the team. - Champion responsible AI practices across the model development lifecycle. About the team The AGI Responsible AI (RAI) team builds the science and systems that make Amazon's large language models safe, fair, and trustworthy. We work on problems spanning safety evaluation, content moderation, watermarking, bias mitigation, and alignment. Our team values scientific rigor, customer obsession, and rapid iteration, and we collaborate closely with pretraining, post-training, and product teams across AGI.
CH, Zurich
RIVR, an Amazon company, is building Physical AI by deploying autonomous robots for real-world doorstep delivery. Operating daily in diverse urban environments, RIVR's robots continuously learn from and navigate the millions of scenarios encountered during deliveries. By owning the full stack from software to hardware, RIVR is purpose-built for safety, reliability, and the customer from day one. Reinforcement learning is transforming our robotic intelligence, enabling autonomous behavior without human guidance. We are seeking a Senior AI Engineer with deep expertise in reinforcement learning and deep learning, including supervised and self-supervised learning with a focus on dexterous manipulation. Your role will involve leveraging both simulated and real-world data to address practical challenges in dynamic grasping, contact-rich manipulation, and object interaction. If you are passionate about advancing AI and developing innovative solutions, join us in shaping the future of intelligent robotics. Key job responsibilities Develop cutting-edge reinforcement learning algorithms to enable robust, contact-rich dexterous manipulation, translating vision, depth, tactile, and proprioceptive sensor input into precise end-effector and joint-level motor commands. Design, test, and refine algorithms to solve complex real-world manipulation challenges, such as handling diverse package form factors, dynamic hand-offs, and operating door handles or latches. Collaborate with the foundation model team to innovate methods that leverage both simulated and real-world data.