Top row, left to right: Xu Chen, McMinn Endowed Research Professor of Mechanical Engineering; Karen Leung, assistant professor, aeronautics and astronautics; Jeffrey Lipton, assistant professor of mechanical engineering; bottom row, left to right: Adriana Schulz, assistant professor of computer science and engineering; Rajesh P. N. Rao, CJ and Elizabeth Hwang Professor of Computer Science; and Chiwei Yan, assistant professor, industrial and systems engineering.
The UW + Amazon Science Hub inaugural research-award recipients are (top row, left to right): Xu Chen, McMinn Endowed Research Professor of Mechanical Engineering; Karen Leung, assistant professor, aeronautics and astronautics; Jeffrey Lipton, assistant professor of mechanical engineering; (bottom row, left to right): Adriana Schulz, assistant professor of computer science and engineering; Rajesh P. N. Rao, CJ and Elizabeth Hwang Professor of Computer Science; and Chiwei Yan, assistant professor, industrial and systems engineering.

Amazon and University of Washington announce inaugural Science Hub faculty research awards

Six UW professors will advance artificial intelligence and robotics research with new grants.

The UW + Amazon Science Hub, founded in February 2022 and housed in the University of Washington College of Engineering, has announced the recipients of its inaugural set of faculty research awards to advance artificial intelligence (AI) and robotics.

Related content
The collaboration will focus on advancing innovation in core robotics and AI technologies and their applications.

The projects were selected through a joint review process between the UW Advisory Group and Amazon. Each recipient will each receive up to $100,000 in research funding from Amazon, and each year-long project will address a real-world, cutting-edge challenge in AI or robotics.

Below is background on this year’s recipients, and their research projects.

Xu Chen, McMinn Endowed Research Professor of Mechanical Engineering: “Adaptive Grasping and Object Manipulation using Visual and Tactile Feedback”

“The project aims to enable industrial collaborative robots with the manipulation intelligence that humans employ to grasp and manipulate objects with heterogeneous feedback. Humans use a combination of visual and tactile sensing to grasp and manipulate objects. Previously, numerous studies have proposed purely visual or purely tactile feedback algorithms to grasp objects. With recent advances of perception, computation, and sensor fusion, this project will integrate visual and tactile feedback to grasp and manipulate objects. The geometry, material and loading of the objects will not be known a priori. The study will use a UR5e robot fitted with a 2D stereo camera and a parallel gripper with pressure sensors for experimental validation of grasping and manipulation algorithms.”

Karen Leung, assistant professor, aeronautics and astronautics: “Shifting From Reactive to Proactive Safety: Legible Contingency Planning for Prosocial Interactions

“The goal of this project is to innovate towards a proactive safety framework for robot planning and control in multi-agent interactive warehouse navigation settings, a stark departure from typical reactive safety paradigms. The key insight is to develop legible robot motion to induce prosocial human-robot behaviors (i.e., taking actions to benefit the group), resulting in (i) safe and seamless human-robot interactions, and (ii) a reduction in the frequent use of reactive safety controllers which degrade performance and may damage the robot or cargo.”

Jeffrey Lipton, assistant professor of mechanical engineering: “Dynamic Stiffness for Rapid Gripping Using Metamaterials”

“Vacuum adhesion using suction cups is a vitally important method for grasping objects in an Amazon warehouse. These systems use extending rods to move the cups away from an industrial robotic arm’s wrist down to the target object. This causes two problems: firstly, the rigid connection between the object and arm makes the suction cups susceptible to pealing and secondly it requires the large arms to gimbal to pick up items. This gimbaling motion takes up space and slows down the picking and stowing process. We will solve these problems by generating a new type of end effector based on mechanical metamaterials known as handed shearing auxetics (H.S.A.). H.S.As are patterns on hollow tubes that can convert rotation directly into extending or bending movements and can dynamically change stiffness. We will develop a rapidly articulable wrist and validate it on grasping tasks to compare the pick time and space used with those of a traditional robot arm. Next, we will learn to use the dynamic stiffness of the H.S.A to perform picking operations with higher reliability. Finally, we will develop an extendable flex shaft for driving multistage H.S.A. systems. Longer term this will lay the foundation for low-cost and safe arms made entirely from metamaterials for picking and stowing tasks.”

Adriana Schulz, assistant professor of computer science and engineering: “Design-Aware 3D Scene Interpretation”

“Though image-based recognition and reconstruction is a well-studied problem, recovering an accurate 3D model from images remains challenging, particularly for scenarios with clutter and occlusions. Typical methods rely on retrieval from a database and are intractable when 3D models of the items are not available. In this proposal, we uniquely observe that manufacturability defines and constrains the design space for man-made objects and can be leveraged to develop novel reconstruction methods. Using design for manufacturing as an underlying representation, we can reduce the search space to models that can be represented in Computer-Aided-Design (CAD) systems, making the inverse reconstruction problem easier to manage. We demonstrate how this approach can improve local precision in 3D reconstruction to enable robust robotic manipulation.”

Rajesh P. N. Rao, CJ and Elizabeth Hwang Professor of Computer Science: “Self-Supervised Learning of Part-Whole Hierarchies for Semantic Scene Understanding, with Applications to Representing Densely Packed Bins and Mobile Robotics

“A key problem in automating the semantic understanding of objects, scenes and environments is learning compositional, part-whole representations from images and videos. We propose a new deep learning framework called Active Predictive Coding Networks (APCNs) for solving this important problem. Inspired by emerging ideas in neuroscience and cognitive science, APCNs utilize hierarchical reference frames and action-conditional predictions to learn versatile spatiotemporal representations of a scene that are compositional, generative, and probabilistic. By combining reinforcement learning and active inference for inferring actions with self-supervised learning of interpretable world models, APCNs lend themselves naturally to applications such as representing and manipulating densely packed bins and modeling the dynamically changing environments of mobile robots.”

Chiwei Yan, assistant professor, industrial and systems engineering: “Fleet Planning of Autonomous Cart Systems in Modern Fulfillment Centers

“Modern fulfillment centers are replacing traditional conveyor belt systems, forklifts or automated guided vehicles with multi-purpose autonomous carts. These autonomous carts are designed to work alongside human and automatically transport stock keeping units (SKUs) from an origin location to a destination location, without following a fixed path, which allows them to be flexibly deployed in existing facilities without significant infrastructure changes. This proposal concerns the fleet planning problem of deploying such autonomous cart systems in practice — how many carts are needed to achieve certain throughput rate given the layout and service capacity of the facility, and what are the resulting key performance measures such as cart utilization rate and waiting times. This decision is complex because of a multitude of conflicting factors such as the dichotomy of cart density on service availability and congestion, which requires dedicated analytics capabilities. We propose an array of novel, simple and practical models that can guide practitioners to a reliable initial estimate of fleet sizing, before running expensive field experiments or building customized simulation software.”

The UW + Amazon Science Hub also supports doctoral fellowships and sponsors longer-term research and development aligned with Amazon interests. For more information on events and activities, visit the official site.

Research areas

Related content

US, TX, Austin
The Automated Reasoning Group in AWS Utility Computing is looking for a Senior Applied Scientist with experience in building scalable automated reasoning solutions that delight customers. You will be part of a world-class team building the next generation of automated reasoning tools and services. You will apply your knowledge to propose solutions, create software prototypes, and develop prototypes into production systems using software development tools. In addition, you will support and scale your solutions to meet the ever-growing demand of customer use. You have demonstrated leadership in automated reasoning positions in industry or academia, strong verbal and written communication skills, are self-driven and deliver high quality results in a fast-paced environment. Each day, hundreds of thousands of developers make billions of transactions worldwide on AWS. They harness the power of the cloud to enable innovative applications, websites, and businesses. Using automated reasoning technology and mathematical proofs, AWS allows customers to answer questions about security, availability, durability, and functional correctness. We call this provable security, absolute assurance in security of the cloud and in the cloud. https://aws.amazon.com/security/provable-security/ Key job responsibilities As a Senior Applied Scientist, you will help shape the definition and vision for applied science across teams within AWS. We have a diverse portfolio of projects that target protocol, code, and hardware verification, and leadership opportunities exist for: - Advance automated code-level reasoning and invariant synthesis and proof repair for cloud-scale web services. - Build new engines and extending foundational proof engines that apply to distributed systems. - Researching the application of automated reasoning to novel software applications. - Building automated reasoning solutions for critical AWS DSLs for architectural configuration, migration, code generation, and other areas. - Improving integration and user experience of tools to support large-scale adoption and use of automated reasoning techniques. You will work in an agile, startup-like development environment, where you are always working on the most important things, and you will design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security. About the team About AWS Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. This team is part of AWS Utility Computing: Utility Computing (UC) AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for their cloud services.
US, WA, Seattle
We’re working to improve shopping on Amazon using the conversational capabilities of large language models, and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry. You'll be working with talented scientists and engineers to innovate on behalf of our customers. If you're fired up about being part of a dynamic, driven team, then this is your moment to join us on this exciting journey! Key job responsibilities We seek strong Applied Scientists with domain expertise in machine learning and deep learning, transformers, generative models, large language models, computer vision and multimodal models. You will devise innovative solutions at scale, pushing the technological and science boundaries. You will guide the design, modeling, and architectural choices of state-of-the-art large language models and multimodal models. You will devise and implement new algorithms and new learning strategies and paradigms. You will be technically hands-on and drive the execution from ideation to productionization. You will work in collaborative environment with other technical and business leaders, to innovate on behalf of the customer.
US, WA, Seattle
The Worldwide Defect Elimination (WWDE) Science team in Amazon Customer Service builds state-of-the-art Artificial Intelligence (AI) models to enable defect-free shopping experiences for Amazon customers. We develop technology and mechanisms to discover, root cause, measure, and escalate defects for resolution before they impact a broader range of customers. We are looking for a creative problem solver and technically-skilled Research Scientist able and interested in building AI solutions to address customer issues at scale. The ideal candidate will lead the development of innovative solutions that identify, root cause, attribute, and summarize problems embedded in large volumes of customer feedback in different modalities. They will also utilize the latest advances in GenAI technology to explore billions of customer contacts and automate defect resolution workflows. As a part of this role, this candidate will collaborate with a large team of experts in the field and move the state of defect elimination research forward. This candidate should have a knack for leveraging AI to translate complex data insights into actionable strategies and can communicate these effectively to both technical and non-technical audiences. Key job responsibilities * Apply science models to extract actionable information from large volumes and varying modalities of customer feedback * Leverage GenAI/Large Language Model (LLM) technology for scaling and automating defect elimination workflows * Design and implement metrics to evaluate the effectiveness of AI models * Present deep dives and analysis to both technical and non-technical stakeholders, ensuring clarity and understanding and influencing business partners * Perform statistical analysis and statistical tests including hypothesis testing and A/B testing * Recognize and adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation A day in the life If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply! Amazon offers a full range of benefits that support you and eligible family members, including domestic partners and their children. Benefits can vary by location, the number of regularly scheduled hours you work, length of employment, and job status such as seasonal or temporary employment. The benefits that generally apply to regular, full-time employees include: 1. Medical, Dental, and Vision Coverage 2. Maternity and Parental Leave Options 3. Paid Time Off (PTO) 4. 401(k) Plan About the team The Worldwide Defect Elimination (WWDE) team's mission is to understand and resolve all issues impacting customers at scale. The WWDE Science team is a force multiplier within this group, helping to to apply science solutions to eliminate defects and enhance customer experience.
IL, Tel Aviv
Are you a MS or PhD student interested in a 2024 Research Science Internship, where you would be using your experience to initiate the design, development, execution and implementation of scientific research projects? If so, we want to hear from you! Is your research in machine learning, deep learning, automated reasoning, speech, robotics, computer vision, optimization, or quantum computing? If so, we want to hear from you! We are looking for motivated students with research interests in a variety of science domains to build state-of-the-art solutions for never before solved problems You can find more information about the Amazon Science community as well as our interview process via the links below; https://www.amazon.science/ https://amazon.jobs/content/en/career-programs/university/science Key job responsibilities As a Research Science Intern, you will have following key job responsibilities; • Work closely with scientists and engineering teams (position-dependent) • Work on an interdisciplinary team on customer-obsessed research • Design new algorithms, models, or other technical solutions • Experience Amazon's customer-focused culture A day in the life At Amazon, you will grow into the high impact, visionary person you know you’re ready to be. Every day will be filled with developing new skills and achieving personal growth. How often can you say that your work changes the world? At Amazon, you’ll say it often. Join us and define tomorrow. Some more benefits of an Amazon Science internship include; • All of our internships offer a competitive stipend/salary • Interns are paired with an experienced manager and mentor(s) • Interns receive invitations to different events such as intern program initiatives or site events • Interns can build their professional and personal network with other Amazon Scientists • Interns can potentially publish work at top tier conferences each year About the team Applicants will be reviewed on a rolling basis and are assigned to teams aligned with their research interests and experience prior to interviews. Start dates are available throughout the year and durations can vary in length from 3-6 months for full time internships and up to 12 months for part time internships. This role may available across multiple locations in the EMEA region (Austria, Estonia, France, Germany, Ireland, Israel, Italy, Luxembourg, Netherlands, Poland, Romania, Spain, UAE, and UK). Please note these are not remote internships.
US, MA, Westborough
Are you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Robotics. We are a smart team of doers that work passionately to apply cutting edge advances in robotics and software to solve real-world challenges that will transform our customers’ experiences in ways we can’t even imagine yet. We invent new improvements every day. We are Amazon Robotics and we will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling and fun. Amazon Robotics is seeking Applied Science Interns and Co-ops with a passion for robotic research to work on cutting edge algorithms for robotics. Our team works on challenging and high-impact projects within robotics. Examples of projects include allocating resources to complete a million orders a day, coordinating the motion of thousands of robots, autonomous navigation in warehouses, identifying objects and damage, and learning how to grasp all the products Amazon sells. As an Applied Science Intern/Co-op at Amazon Robotics, you will be working on one or more of our robotic technologies such as autonomous mobile robots, robot manipulators, and computer vision identification technologies. The intern/co-op project(s) and the internship/co-op location are determined by the team the student will be working on. Please note that by applying to this role you would be considered for Applied Scientist summer intern, spring co-op, and fall co-op roles on various Amazon Robotics teams. These teams work on robotics research within areas such as computer vision, machine learning, robotic manipulation, navigation, path planning, perception, optimization and more. Learn more about Amazon Robotics: https://amazon.jobs/en/teams/amazon-robotics
US, WA, Bellevue
The AGI Data Service team is seeking a dedicated, skilled, and innovative Scientist with a robust background in deep learning, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI-DS team, a Research Scientist will collaborate closely with talented colleagues to lead the development of advanced approaches and modeling techniques, driving forward the frontier of LLM technology. This includes innovating model-in-the-loop and human-in-the-loop approaches to ensure the collection of high-quality data, safeguarding data privacy and security for LLM training, and more. A scientist will also have a direct impact on enhancing customer experiences through state-of-the-art products and services that harness the power of speech and language technology. A day in the life The Scientist with the AGI team will support the science solution design, run experiments, research new algorithms, and find new ways of optimizing the customer experience; while setting examples for the team on good science practice and standards. Besides theoretical analysis and innovation, the scientist will also work closely with talented engineers and scientists to put algorithms and models into practice. The ideal candidate should be passionate about delivering experiences that delight customers and creating robust solutions. They will also create reliable, scalable and high-performance products that require exceptional technical expertise, and a sound understanding of Machine Learning.
LU, Luxembourg
At Global Mile Expansion team, our vision is to become the carrier of choice for all of our Selling Partners cross-border shipping needs, offering complete set of end to end cross border solutions from key manufacturing hubs to footprint countries supporting business who use Amazon to grow their business globally. As we expand, the need for comprehensive business insight and robust demand forecasting to aid decision making on asset utilization especially where we know demand will be variable becomes vital, as well as operational excellence. We are building business models involving large amounts of data and Macro economic inputs to produce the robust forecast to help the operational excellence and continue improving the customer experience. We are looking for an experienced economist who can apply innovative modelling techniques to real-world problems, and convert it to highly business-impacting solutions. Key job responsibilities - Experienced in using mathematical and statistical approach to create new, scalable solutions for business problems - Analyze and extract relevant information from business data to help automate and optimize key processes - Design, develop and evaluate highly innovative models for predictive learning - Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation - Research and implement statistical approaches to understand the business long-term and short-term trend and support the strategies
ES, Madrid
Are you a MS or PhD student interested in a 2025 Internship in the field of machine learning, deep learning, speech, robotics, computer vision, optimization, quantum computing, automated reasoning, or formal methods? If so, we want to hear from you! We are looking for students interested in using a variety of domain expertise to invent, design and implement state-of-the-art solutions for never-before-solved problems. You can find more information about the Amazon Science community as well as our interview process via the links below; https://www.amazon.science/ https://amazon.jobs/content/en/career-programs/university/science https://amazon.jobs/content/en/how-we-hire/university-roles/applied-science Key job responsibilities As an Applied Science Intern, you will own the design and development of end-to-end systems. You’ll have the opportunity to write technical white papers, create roadmaps and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. You will have the opportunity to design new algorithms, models, or other technical solutions whilst experiencing Amazon’s customer focused culture. The ideal intern must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. A day in the life At Amazon, you will grow into the high impact, visionary person you know you’re ready to be. Every day will be filled with developing new skills and achieving personal growth. How often can you say that your work changes the world? At Amazon, you’ll say it often. Join us and define tomorrow. Some more benefits of an Amazon Science internship include; • All of our internships offer a competitive stipend/salary • Interns are paired with an experienced manager and mentor(s) • Interns receive invitations to different events such as intern program initiatives or site events • Interns can build their professional and personal network with other Amazon Scientists • Interns can potentially publish work at top tier conferences each year About the team Applicants will be reviewed on a rolling basis and are assigned to teams aligned with their research interests and experience prior to interviews. Start dates are available throughout the year and durations can vary in length from 3-6 months for full time internships. This role may available across multiple locations in the EMEA region (Austria, Estonia, France, Germany, Ireland, Israel, Italy, Luxembourg, Netherlands, Poland, Romania, Spain, UAE, and UK). Please note these are not remote internships.
LU, Luxembourg
Are you a MS or PhD student interested in a 2025 Internship in the field of machine learning, deep learning, speech, robotics, computer vision, optimization, quantum computing, automated reasoning, or formal methods? If so, we want to hear from you! We are looking for students interested in using a variety of domain expertise to invent, design and implement state-of-the-art solutions for never-before-solved problems. You can find more information about the Amazon Science community as well as our interview process via the links below; https://www.amazon.science/ https://amazon.jobs/content/en/career-programs/university/science https://amazon.jobs/content/en/how-we-hire/university-roles/applied-science Key job responsibilities As an Applied Science Intern, you will own the design and development of end-to-end systems. You’ll have the opportunity to write technical white papers, create roadmaps and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. You will have the opportunity to design new algorithms, models, or other technical solutions whilst experiencing Amazon’s customer focused culture. The ideal intern must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. A day in the life At Amazon, you will grow into the high impact, visionary person you know you’re ready to be. Every day will be filled with developing new skills and achieving personal growth. How often can you say that your work changes the world? At Amazon, you’ll say it often. Join us and define tomorrow. Some more benefits of an Amazon Science internship include; • All of our internships offer a competitive stipend/salary • Interns are paired with an experienced manager and mentor(s) • Interns receive invitations to different events such as intern program initiatives or site events • Interns can build their professional and personal network with other Amazon Scientists • Interns can potentially publish work at top tier conferences each year About the team Applicants will be reviewed on a rolling basis and are assigned to teams aligned with their research interests and experience prior to interviews. Start dates are available throughout the year and durations can vary in length from 3-6 months for full time internships. This role may available across multiple locations in the EMEA region (Austria, Estonia, France, Germany, Ireland, Israel, Italy, Luxembourg, Netherlands, Poland, Romania, Spain, UAE, and UK). Please note these are not remote internships.
US, CA, Santa Clara
About Amazon Health Amazon Health’s mission is to make it dramatically easier for customers to access the healthcare products and services they need to get and stay healthy. Towards this mission, we (Health Storefront and Shared Tech) are building the technology, products and services, that help customers find, buy, and engage with the healthcare solutions they need. Job summary We are seeking an exceptional Senior Applied Scientist to join a team of experts in the field of machine learning, and work together to break new ground in the world of healthcare to make personalized and empathetic care accessible, convenient, and cost-effective. We leverage and train state-of-the-art large-language-models (LLMs) and develop entirely new experiences to help customers find the right products and services to address their health needs. We work on machine learning problems for intent detection, dialogue systems, and information retrieval. You will work in a highly collaborative environment where you can pursue both near-term productization opportunities to make immediate, meaningful customer impacts while pursuing ambitious, long-term research. You will work on hard science problems that have not been solved before, conduct rapid prototyping to validate your hypothesis, and deploy your algorithmic ideas at scale. You will get the opportunity to pursue work that makes people's lives better and pushes the envelop of science. #everydaybetter Key job responsibilities - Translate product and CX requirements into science metrics and rigorous testing methodologies. - Invent and develop scalable methodologies to evaluate LLM outputs against metrics and guardrails. - Design and implement the best-in-class semantic retrieval system by creating high-quality knowledge base and optimizing embedding models and similarity measures. - Conduct tuning, training, and optimization of LLMs to achieve a compelling CX while reducing operational cost to be scalable. A day in the life In a fast-paced innovation environment, you work closely with product, UX, and business teams to understand customer's challenges. You translate product and business requirements into science problems. You dive deep into challenging science problems, enabling entirely new ML and LLM-driven customer experiences. You identify hypothesis and conduct rapid prototyping to learn quickly. You develop and deploy models at scale to pursue productizations. You mentor junior science team members and help influence our org in scientific best practices. About the team We are the Health AI team at HST (Health Store and Technology). The team consists of exceptional ML Scientists with diverse background in healthcare, robotics, customer analytics, and communication. We are committed to building and deploying the most advanced scientific capabilities and solutions for the products and services at Amazon Health.