The science behind Echo Frames

How the team behind Echo Frames delivered longer battery life and improved sound quality inside the slim form factor of a pair of eyeglasses.

When the team behind Amazon’s Echo Frames set out to improve the next generation of their product, they needed to strike a delicate balance. Customer feedback on earlier versions of the smart audio eyeglasses centered on three elements: longer battery life, more style options, and improved sound quality.

A man with a beard is seen wearing a pair of Echo Frames glasses. He is standing outside and is pictured in three-quarters view.
Echo Frames feature custom-built speech processing technology that drastically improves word recognition — key for interacting with Alexa in windy or noisy environments.

Achieving all three of those goals would be a challenge in itself; doing that inside the slim form factor of a pair of Alexa-enabled eyeglasses upped the ante.

“All three of those goals are in tension with one another,” says Adam Slaboski, senior manager of product management and product lead for Echo Frames. The easiest way to improve battery and audio would be to increase the size of the device, but that would conflict with feedback around the importance of design. Amping up bass to improve the audio experience would consume more battery, and so on.

Finding that sweet spot was a huge effort in engineering and customer understanding.
Adam Slaboski

“Finding that sweet spot was a huge effort in engineering and customer understanding," Slaboski says.

With Echo Frames (3rd Gen) and Carrera Smart Glasses with Alexa (designed in collaboration with Safilo, one of the world’s leading eyewear companies), the Smart Eyewear team met the challenge.

The smart glasses feature enhanced audio playback, with custom-built speech-processing technology that dramatically improves word recognition — key for interacting with Alexa in windy or noisy environments. The new range of frame styles come in a variety of sizes, and all come with a significant boost in battery life.

From the outside, Echo Frames still look like a pair of regular eyeglasses. “But we changed everything on the inside,” says Jean Wang, general manager and director of Smart Eyewear. “And we learned new lessons along the way.”

Here’s how Amazon engineers and product designers tackled all three customer demands.

Turning up the volume with open-ear audio

Like previous generations of Echo Frames, the current model uses open-ear audio. In addition to fitting the form factor of a pair of glasses, this allows users to maintain awareness of their surroundings while interacting with Alexa or enjoying audio entertainment.

Related content
Combining psychoacoustics, signal processing, and speaker beamforming enhances stereo audio and delivers an immersive sound experience for customers.

The open-ear audio design has been popular with users who are blind or have low vision, notes Jenai Akina, senior product manager for Echo Frames. “It’s really beneficial that it doesn’t obstruct a critical sense like hearing,” she explains. “That form factor is really helpful for daily interactions — especially when we want to be open to engage with our environment and the people around us. Open ear allows customers to maintain awareness, while providing access to a voice assistant.”

Open-ear audio brings a host of unique challenges to the engineering process. Typical headphones and earbuds block off the ear from the outside world, preventing air from escaping. That funnels more of the sound waves from the speakers into the user’s ears. With an open-ear design, sound has to travel farther, and there is less control over direction. That could lower the audio volume and reduce clarity — and importantly, audio could leak out to people standing nearby. The key is to drive the sound pressure as much as possible toward the user’s ears while minimizing the audio leakage.

By bringing people into the lab, we can simulate real environmental noise conditions like wind, background noise in a crowded restaurant, and the sound of cars on the road.
Scott Choi

In working to improve audio quality, the team continued to hone the directionality of the sound while also working to improve volume and bass. A technique called dipole speaker configuration helps to do both. In addition to a sound porthole located near the ear canal, the frames feature a second porthole that cancels unnecessary sound while amping up bass.

With input from in-house audio experts and instruments to analyze measurements like harmonic distortion, the team came up with a set of potential tuning solutions that met objective targets for audio quality. They then tested those “flavors” of tuning in the lab with several user groups.

“By bringing people into the lab, we can simulate real environmental-noise conditions like wind, background noise in a crowded restaurant, and the sound of cars on the road,” explains senior manager of audio Scott Choi. That allowed his team to understand environmental variables in a controlled setting.

With the feedback from those focus groups, the team then selected a few of the most popular tunings to push out to beta testing, where users could provide feedback on a weekly basis.

“We see how the feedback trends change with each tuning change, which gradually allows it to mature and converge into a certain tuning,” Choi says. The result is audio calibrated to maximize intelligibility and volume without leaking private conversations (or guilty-pleasure playlists).

The Echo Frame team used a rotating arch of microphones to lest leakage. This animation shows the array moving in circles around a mannequin wearing the Gen 3 prototype, creating a 3D sphere plot of audio leakage. Via this testing, the team was able to minimize leakage to the side and back.
The Echo Frame team used a rotating arch of microphones to lest leakage. The array moved in circles around a mannequin wearing the Gen 3 prototype, creating a 3D sphere plot of audio leakage. Via this testing, the team was able to minimize leakage to the side and back.

To test leakage, the audio team rigged up a rotating arch of microphones. The array moved in circles around a mannequin wearing the Gen 3 prototype, creating a 3-D sphere plot of audio leakage. Choi explains that they focused on minimizing leakage to the side and back, and ultimately, the speakers were moved much closer to the ear to help minimize leakage and improve loudness.

Leakage isn’t the only privacy consideration. The Echo Frame team also continues to innovate on protecting users from bad actors who may get hold of their smart glasses.

Related content
Amazon senior principal engineer Luu Tran is helping the Alexa team innovate by collaborating closely with scientist colleagues.

Gen 2 protected users by requiring them to authenticate their sessions using a trusted phone. Without authentication, a user can’t invoke sensitive commands like “navigate me home,” unlocking a smart lock, or making a purchase. But customers didn’t like the added friction.

Now customers who enroll in Alexa Voice ID will be able to use their vocal fingerprints for authentication to receive responses to smart-home utterances.

“We’re the first on-the-go Alexa device to use Voice ID for privacy authentication,” Slaboski says.

Boosting battery life without cramping style

Gen 3 improves continuous music playback time to six hours, versus the four hours offered by the previous generation of Echo Frames. It also bumps battery life to up to 14 hours of moderate usage spread across playback, talk time, notifications, and Alexa interactions.

Delivering the desired loudness, bass, and audio quality while optimizing for battery life was a careful balance.
Ravi Sanapala

The team couldn’t simply slap on a bigger battery without making the Echo Frames look less like normal glasses. And with sound quality high on the priority list as well, the devices were going to need as much juice as ever. The team focused on trimming power use in standby mode, ensuring that the overall battery consumption would go down without weakening the speakers when users needed them.

“Delivering the desired loudness, bass, and audio quality while optimizing for battery life was a careful balance,” says senior product manager Ravi Sanapala. “We need the battery to last throughout as much of the day as possible and for Alexa to be available whenever users need it.”

The architectural changes in speaker placement helped keep power needs low while improving audio. The team also tweaked the placement of the battery itself, distributing its capacity differently than in Gen 2. Sanapala adds that algorithmic changes were key in balancing idle-battery conservation and on-demand device usage.

“We had to collaborate with all of our cross-functional teams to optimize everything,” Sanapala says.

Gen 3 also features an all-new charging stand, which is designed for compatibility with all frame shapes and keeps lenses upright, protecting them from scratches while wirelessly charging.

Making smart eyewear look like eyewear

Making glasses that are suitable for everyday wear has always been a priority. “One of our goals has always been to develop technology that appears when you need it and disappears when you don’t,” says Wang.

Previous models of Echo Frames have come in a single, one-size-fits-all style.

A person is seen wearing Echo Frames sunglasses outside. The person carries a notebook and is looking down at it, and there are some buildings and blue sky in the background.
The Echo Frames team consulted with both internal and external eyewear designers to review common and popular styles of frames, and to survey potential customers about their preferences.

“That was a very intentional move,” Wang explains. “We wanted to start simply and learn from customer feedback.”

Gen 2’s flexible spring hinge and adjustable temple tips ensured that the single size fit many different faces. In fact, Wang says, while the goal was to fit around half of all potential users, they’ve found that 85 percent of the adult population can comfortably wear the Gen 2 design.

But with Gen 3, Wang says, the team needed to go beyond designing glasses that looked typical. Customers wanted glasses that looked stylish, too.

The team consulted with both internal and external eyewear designers to review common and popular styles of frames, as well as “edgier” designs, and to survey potential customers about their preferences. After testing options with beta customers, they settled on a variety of styles in various colors that cover a range of aesthetics. They also switched to an acetate material to match the feel of high-end eyewear.

Related content
How a team of designers, scientists, developers, and engineers worked together to create a truly unique device in Echo Show 10.

While each style will still come in a single size, the range of designs will accommodate even more faces than Gen 2, as the collection spans narrow, medium, and wide fits. Each style features adjustable temple tips constructed out of silicone around a lightweight titanium core for better fit. And despite the boost in battery life, the temples of Gen 3 frames have actually been slimmed down. Wang notes that competitive products often place large batteries behind a user’s ears. But presenting Echo Frames users with something that bulky and uncomfortable was never on the table.

“We were working with really heavy constraints,” Wang says. “So we have been very deliberate in making design choices in the service of our customer. That’s challenged us to be innovative and really push the limits of what’s possible in the architecture of our designs.”

Related content

US, CA, Santa Clara
We are seeking an Applied Scientist II to join Amazon Customer Service's Science team, where you will build AI-based automated customer service solutions using state-of-the-art techniques in retrieval-augmented generation (RAG), agentic AI, and post-training of large language models. You will work at the intersection of research and production, developing intelligent systems that directly impact millions of customers while collaborating with scientists, engineers, and product managers in a fast-paced, innovative environment. Key job responsibilities - Design, develop, and deploy information retrieval systems and RAG pipelines using embedding models, reranking algorithms, and generative models to improve customer service automation - Conduct post-training of large language models using techniques such as Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Group Relative Policy Optimization (GRPO) to optimize model performance for customer service tasks - Build and curate high-quality datasets for model training and evaluation, ensuring data quality and relevance for customer service applications - Design and implement comprehensive evaluation frameworks, including data curation, metrics development, and methods such as LLM-as-a-judge to assess model performance - Develop AI agents for automated customer service, understanding their advantages and common pitfalls, and implementing solutions that balance automation with customer satisfaction - Independently perform research and development with minimal guidance, staying current with the latest advances in machine learning and AI - Collaborate with cross-functional teams including engineering, product management, and operations to translate research into production systems - Publish findings and contribute to the broader scientific community through papers, patents, and open-source contributions - Monitor and improve deployed models based on real-world performance metrics and customer feedback A day in the life As an Applied Scientist II, you will start your day reviewing metrics from deployed models and identifying opportunities for improvement. You might spend your morning experimenting with new post-training techniques to improve model accuracy, then collaborate with engineers to integrate your latest model into production systems. You will participate in design reviews, share your findings with the team, and mentor junior scientists. You will balance research exploration with practical implementation, always keeping the customer experience at the forefront of your work. You will have the autonomy to drive your own research agenda while contributing to team goals and deliverables. About the team The Amazon Customer Service Science team is dedicated to revolutionizing customer support through advanced AI and machine learning. We are a diverse group of scientists and engineers working on some of the most challenging problems in natural language understanding and AI automation. Our team values innovation, collaboration, and a customer-obsessed mindset. We encourage experimentation, celebrate learning from failures, and are committed to maintaining Amazon's high bar for scientific rigor and operational excellence. You will have access to world-class computing resources, massive datasets, and the opportunity to work alongside some of the brightest minds in AI and machine learning.
US, WA, Redmond
Amazon Leo is an initiative to launch a constellation of Low Earth Orbit satellites that will provide low-latency, high-speed broadband connectivity to unserved and underserved communities around the world. As a Communications Engineer in Modeling and Simulation, this role is primarily responsible for the developing and analyzing high level system resource allocation techniques for links to ensure optimal system and network performance from the capacity, coverage, power consumption, and availability point of view. Be part of the team defining the overall communication system and architecture of Amazon Leo’s broadband wireless network. This is a unique opportunity to innovate and define novel wireless technology with few legacy constraints. The team develops and designs the communication system of Leo and analyzes its overall system level performance, such as overall throughput, latency, system availability, packet loss, etc., as well as compatibility for both connectivity and interference mitigation with other space and terrestrial systems. This role in particular will be responsible for 1) evaluating complex multi-disciplinary trades involving RF bandwidth and network resource allocation to customers, 2) understanding and designing around hardware/software capabilities and constraints to support a dynamic network topology, 3) developing heuristic or solver-based algorithms to continuously improve and efficiently use available resources, 4) demonstrating their viability through detailed modeling and simulation, 5) working with operational teams to ensure they are implemented. This role will be part of a team developing the necessary simulation tools, with particular emphasis on coverage, capacity, latency and availability, considering the yearly growth of the satellite constellation and terrestrial network. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. Key job responsibilities • Work within a project team and take the responsibility for the Leo's overall communication system design and architecture • Extend existing code/tools and create simulation models representative of the target system, primarily in MATLAB • Design interconnection strategies between fronthaul and backhaul nodes. Analyze link availability, investigate link outages, and optimize algorithms to study and maximize network performance • Use RF and optical link budgets with orbital constellation dynamics to model time-varying system capacity • Conduct trade-off analysis to benefit customer experience and optimization of resources (costs, power, spectrum), including optimization of satellite constellation design and link selection • Work closely with implementation teams to simulate expected system level performance and provide quick feedback on potential improvements • Analyze and minimize potential self-interference or interference with other communication systems • Provide visualizations, document results, and communicate them across multi-disciplinary project teams to make key architectural decisions
US, WA, Seattle
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their causal inference / structural econometrics skillsets to solve real world problems. The intern will work in the area of Store Economics and Science (SEAS) and develop models to SEAS. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. About the team The Stores Economics and Science Team (SEAS) is a Stores-wide interdisciplinary team at Amazon with a "peak jumping" mission focused on disruptive innovation. The team applies science, economics, and engineering expertise to tackle the business's most critical problems, working to move from local to global optima across Amazon Stores operations. SEAS builds partnerships with organizations throughout Amazon Stores to pursue this mission, exploring frontier science while learning from the experience and perspective of others. Their approach involves testing solutions first at a small scale, then aligning more broadly to build scalable solutions that can be implemented across the organization. The team works backwards from customers using their unique scientific expertise to add value, takes on long-run and high-risk projects that business teams typically wouldn't pursue, helps teams with kickstart problems by building practical prototypes, raises the scientific bar at Amazon, and builds and shares software that makes Amazon more productive.
US, WA, Seattle
Amazon is seeking exceptional talent to help develop the next generation of advanced robotics systems that will transform automation at Amazon's scale. We're building revolutionary robotic systems that combine cutting-edge AI, sophisticated control systems, and advanced electromechanical design to create adaptable automation solutions capable of working safely alongside humans in dynamic environments. This is a unique opportunity to shape the future of robotics and automation at an unprecedented scale, working with world-class teams pushing the boundaries of what's possible in robotic manipulation, locomotion, and human-robot interaction. Amazon is seeking a talented and motivated Principal Applied Scientist to develop tactile sensors and guide the sensing strategy for our gripper design. The ideal candidate will have extensive experience in sensor development, analysis, testing and integration. This candidate must have the ability to work well both independently and in a multidisciplinary team setting. Key job responsibilities - Author functional requirements, design verification plans and test procedures - Develop design concepts which meet the requirements - Work with engineering team members to implement the concepts in a product design - Support product releases to manufacturing and customer deployments - Work efficiently to support aggressive schedules
US, TX, Austin
Amazon Security is seeking an Applied Scientist to work on GenAI acceleration within the Secure Third Party Tools (S3T) organization. The S3T team has bold ambitions to re-imagine security products that serve Amazon's pace of innovation at our global scale. This role will focus on leveraging large language models and agentic AI to transform third-party security risk management, automate complex vendor assessments, streamline controllership processes, and dramatically reduce assessment cycle times. You will drive builder efficiency and deliver bar-raising security engagements across Amazon. Key job responsibilities Own and drive end-to-end technical delivery for scoped science initiatives focused on third-party security risk management, independently defining research agendas, success metrics, and multi-quarter roadmaps with minimal oversight. Understanding approaches to automate third-party security review processes using state-of-the-art large language models, development intelligent systems for vendor assessment document analysis, security questionnaire automation, risk signal extraction, and compliance decision support. Build advanced GenAI and agentic frameworks including multi-agent orchestration, RAG pipelines, and autonomous workflows purpose-built for third-party risk evaluation, security documentation processing, and scalable vendor assessment at enterprise scale. Build ML-powered risk intelligence capabilities that enhance third-party threat detection, vulnerability classification, and continuous monitoring throughout the vendor lifecycle. Coordinate with Software Engineering and Data Engineering to deploy production-grade ML solutions that integrate seamlessly with existing third-party risk management workflows and scale across the organization. About the team Security is central to maintaining customer trust and delivering delightful customer experiences. At Amazon, our Security organization is designed to drive bar-raising security engagements. Our vision is that Builders raise the Amazon security bar when they use our recommended tools and processes, with no overhead to their business. Diverse Experiences Amazon Security values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why Amazon Security? At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. We offer talented security professionals the chance to accelerate their careers with opportunities to build experience in a wide variety of areas including cloud, devices, retail, entertainment, healthcare, operations, and physical stores. Inclusive Team Culture In Amazon Security, it’s in our nature to learn and be curious. Ongoing DEI events and learning experiences inspire us to continue learning and to embrace our uniqueness. Addressing the toughest security challenges requires that we seek out and celebrate a diversity of ideas, perspectives, and voices. Training & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve.
US, CA, Mountain View
At AWS Healthcare AI, we're revolutionizing healthcare delivery through AI solutions that serve millions globally. As a pioneer in healthcare technology, we're building next-generation services that combine Amazon's world-class AI infrastructure with deep healthcare expertise. Our mission is to accelerate our healthcare businesses by delivering intuitive and differentiated technology solutions that solve enduring business challenges. The AWS Healthcare AI organization includes services such as HealthScribe, Comprehend Medical, HealthLake, and more. We're seeking a Senior Applied Scientist to join our team working on our AI driven clinical solutions that are transforming how clinicians interact with patients and document care. Key job responsibilities To be successful in this mission, we are seeking an Applied Scientist to contribute to the research and development of new, highly influencial AI applications that re-imagine experiences for end-customers (e.g., consumers, patients), frontline workers (e.g., customer service agents, clinicians), and back-office staff (e.g., claims processing, medical coding). As a leading subject matter expert in NLU, deep learning, knowledge representation, foundation models, and reinforcement learning, you will collaborate with a team of scientists to invent novel, generative AI-powered experiences. This role involves defining research directions, developing new ML techniques, conducting rigorous experiments, and ensuring research translates to impactful products. You will be a hands-on technical innovator who is passionate about building scalable scientific solutions. You will set the standard for excellence, invent scalable, scientifically sound solutions across teams, define evaluation methods, and lead complex reviews. This role wields significant influence across AWS, Amazon, and the global research community.
US, TX, Austin
Amazon Leo is an initiative to launch a constellation of Low Earth Orbit satellites that will provide low-latency, high-speed broadband connectivity to unserved and underserved communities around the world. As a Systems Engineer, this role is primarily responsible for the design, development and integration of communication payload and customer terminal systems. The Role: Be part of the team defining the overall communication system and architecture of Amazon Leo’s broadband wireless network. This is a unique opportunity to innovate and define groundbreaking wireless technology at global scale. The team develops and designs the communication system for Leo and analyzes its overall system level performance such as for overall throughput, latency, system availability, packet loss etc. This role in particular will be responsible for leading the effort in designing and developing advanced technology and solutions for communication system. This role will also be responsible developing advanced physical layer + protocol stacks systems as proof of concept and reference implementation to improve the performance and reliability of the LEO network. In particular this role will be responsible for using concepts from digital signal processing, information theory, wireless communications to develop novel solutions for achieving ultra-high performance LEO network. This role will also be part of a team and develop simulation tools with particular emphasis on modeling the physical layer aspects such as advanced receiver modeling and abstraction, interference cancellation techniques, FEC abstraction models etc. This role will also play a critical role in the integration and verification of various HW and SW sub-systems as a part of system integration and link bring-up and verification. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum.
US, WA, Seattle
Come be a part of a rapidly expanding $35 billion-dollar global business. At Amazon Business, a fast-growing startup passionate about building solutions, we set out every day to innovate and disrupt the status quo. We stand at the intersection of tech & retail in the B2B space developing innovative purchasing and procurement solutions to help businesses and organizations thrive. At Amazon Business, we strive to be the most recognized and preferred strategic partner for smart business buying. Bring your insight, imagination and a healthy disregard for the impossible. Join us in building and celebrating the value of Amazon Business to buyers and sellers of all sizes and industries. Unlock your career potential. Amazon Business Data Insights and Analytics team is looking for a Data Scientist to lead the research and thought leadership to drive our data and insights strategy for Amazon Business. This role is central in shaping the definition and execution of the long-term strategy for Amazon Business. You will be responsible for researching, experimenting and analyzing predictive and optimization models, designing and implementing advanced detection systems that analyze customer behavior at registration and throughout their journey. You will work on ambiguous and complex business and research science problems with large opportunities. You'll leverage diverse data signals including customer profiles, purchase patterns, and network associations to identify potential abuse and fraudulent activities. You are an analytical individual who is comfortable working with cross-functional teams and systems, working with state-of-the-art machine learning techniques and AWS services to build robust models that can effectively distinguish between legitimate business activities and suspicious behavior patterns You must be a self-starter and be able to learn on the go. Excellent written and verbal communication skills are required as you will work very closely with diverse teams. Key job responsibilities - Interact with business and software teams to understand their business requirements and operational processes - Frame business problems into scalable solutions - Adapt existing and invent new techniques for solutions - Gather data required for analysis and model building - Create and track accuracy and performance metrics - Prototype models by using high-level modeling languages such as R or in software languages such as Python. - Familiarity with transforming prototypes to production is preferred. - Create, enhance, and maintain technical documentation
US, MA, N.reading
Amazon Industrial Robotics Group is seeking exceptional talent to help develop the next generation of advanced robotics systems that will transform automation at Amazon's scale. We're building revolutionary robotic systems that combine cutting-edge AI, sophisticated control systems, and advanced mechanical design to create adaptable automation solutions capable of working safely alongside humans in dynamic environments. This is a unique opportunity to shape the future of robotics and automation at an unprecedented scale, working with world-class teams pushing the boundaries of what's possible in robotic dexterous manipulation, locomotion, and human-robot interaction. This role presents an opportunity to shape the future of robotics through innovative applications of deep learning and large language models. At Amazon Industrial Robotics Group, we leverage advanced robotics, machine learning, and artificial intelligence to solve complex operational challenges at an unprecedented scale. Our fleet of robots operates across hundreds of facilities worldwide, working in sophisticated coordination to fulfill our mission of customer excellence. We are pioneering the development of dexterous manipulation system that: - Enables unprecedented generalization across diverse tasks - Enables contact-rich manipulation in different environments - Seamlessly integrates low-level skills and high-level behaviors - Leverage mechanical intelligence, multi-modal sensor feedback and advanced control techniques. The ideal candidate will contribute to research that bridges the gap between theoretical advancement and practical implementation in robotics. You will be part of a team that's revolutionizing how robots learn, adapt, and interact with their environment. Join us in building the next generation of intelligent robotics systems that will transform the future of automation and human-robot collaboration. A day in the life - Work on design and implementation of methods for Visual SLAM, navigation and spatial reasoning - Leverage simulation and real-world data collection to create large datasets for model development - Develop a hierarchical system that combines low-level control with high-level planning - Collaborate effectively with multi-disciplinary teams to co-design hardware and algorithms for dexterous manipulation
US, NY, New York
We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance. You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection. The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems. Key job responsibilities - Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios - Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies - Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs - Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection - Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection - Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack - Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches - Lead technical projects from conception through production deployment - Mentor junior scientists and engineers