International Women's Day 2020.png
Credit: Glynis Condon

Seven Amazon scientists shaping the future of AI

To commemorate International Women’s Day, we spoke to women scientists across a variety of research areas at Amazon.

To commemorate International Women’s Day (IWD), during Women's History Month, we asked scientists across a variety of Amazon research areas about their backgrounds, and the most exciting innovations in their fields. Here’s what they had to say.

Xin Luna Dong, principal scientist

Xin Luna Dong
Xin Luna Dong, principal scientist

Dong is a principal scientist, leading the efforts to develop the Amazon Product Knowledge Graph. Dong received her PhD in computer science, with a focus on data integration, from the University of Washington. The personal information management system in Dong’s dissertation (which won the Best Demo award in Sigmod’ 2005), is a personal knowledge graph developed at least five years before the phrase “knowledge graph” was coined. After graduation, Dong led the development of the Knowledge-based Trust project at Google. Dong has co-authored the book Big Data Integration. She is an ACM Distinguished Member, and has received the VLDB Early Career Research Contribution Award for "advancing the state of the art of knowledge fusion”. Dong was program committee co-chair for Sigmoid 2018, and is program committee co-chair for VLDB 2020. She also serves on the VLDB endowment and PVLDB advisory committees.

Innovations I find exciting

A recent innovation that I’m most excited about is graph neural network (GNN). Unlike recurrent neural networks (RNNs) and convolutional neural networks (CNNs), which focus much more on regular data such as word sequences, 2-D images, and 3-D videos, GNNs allow us to leverage graphs to capture much more complex relationships. These include elements in the graph, represented by nodes in the graph, and their relationships, represented by edges between the nodes. Examples of graphs influenced by GNNs include social networks, world wide web (WWW) topology, knowledge graphs, and molecular graphs. As we build knowledge graphs for products, it is amazing how many different ways we can benefit from GNNs.

Naturally, we can apply GNNs on the knowledge graphs we have built, to discern interesting patterns to find popular artists in the music domain. We also model webpage layouts as graphs, and model customer behaviors as graphs, so GNNs help us extract relevant knowledge and enrich our knowledge graphs. This new technique enables us to be so much more creative in the practice of constructing knowledge graphs, and applying the findings to real-world applications.

Claire Law, senior technical program manager

ClaireLaw.jfif
Claire Law, senior technical program manager

Law is senior technical program manager on Amazon’s physical retail team, the team behind the Just Walk Out technology used in Amazon Go and Amazon Go Grocery stores. She studied nanotechnology engineering at the University of Waterloo. Early on, she realized that she didn’t enjoy the type of lab work expected from a researcher in material science. She leveraged a university program, and interned as a software developer, marketer, hardware test engineer, project control officer in consulting, and software program manager. These experiences, coupled with work experiences at Microsoft and Research in Motion, led Law to pursue a career in software.

After a stint in Amazon’s international organization, Law joined the physical retail team to work on machine vision initiatives. On this team, Law is able to leverage her experience in cloud computing and knowledge of optics and photography to build new experiences for physical retail.

Innovations I find exciting

We are only now reaching a level where computer vision can solve real-world problems in a meaningful way. While we still need to be creative in where we look for simplifiers, algorithms are able to solve more and more problems every day. Challenges that looked insurmountable just a couple years ago are now part of production systems across the industry. Checkout-free stores seemed like science fiction before Amazon Go was launched, and now customers are loving this effortless shopping experience in the 25 Amazon Go stores, and the new Amazon Go Grocery store we have open today.

Yoelle Maarek, vice president

Yoelle Maarek, vice president of research and science for Alexa Shopping
Yoelle Maarek, vice president of research and science for Alexa Shopping

Maarek is vice president of research and science, Alexa Shopping. Prior to Amazon, Maarek served in engineering and research leadership roles at Yahoo, Google and IBM. Maarek has been regularly serving as program committee (PC) chair and senior PC committee member at leading academic research conferences related to Web search and data mining, such as SIGIR, The Web Conference, and Web Search and Data Mining (WSDM). She is currently serving on the steering committees of WSDM and the Web Conference series.

She is a member of the Technion Board of Governors and was inducted as an ACM Fellow in 2013. Maarek obtained a PhD in computer science from the Technion, Israel in 1989. She holds an engineering degree from the Ecole des Ponts et Chaussées, and a DEA (graduate degree) in computer science from Paris VI university. Maarek completed her PhD at the Technion in Israel and was a visiting student at Columbia University. She played a pioneering role within industry in researching the field of information retrieval, the computer science discipline behind search, in the pre-Web era, and led the launch of Google Suggest, the query auto-completion capability. As such, she jokingly refers to herself as a “search dinosaur”.

Innovations I find exciting

We are on the verge of making ambient computing happen, and Alexa is pioneering this long-awaited revolution. It forces us to revisit all our assumptions across multiple domains. I see this prevalent especially in search and question answering. These are topics close to my heart. I have been following progress in these areas since I got my PhD thirty years ago. The focus on ambient computing is also a unique opportunity for us at Amazon to demonstrate what we mean by customer-obsessed science. As humans are learning to interact with machines, their behavior is evolving and we need to follow suit. It not only challenges scientists to keep inventing on behalf of customers but also forces all of us to remain humble. We are not here to teach customers how to speak to a machine, but rather to do everything in our power to understand, satisfy and predict their needs so as to constantly wow and delight them.

Angeliki Metallinou, applied science manager

angeliki.jpeg
Angeliki Metallinou, applied science manager

Metallinou is an applied science manager within the Amazon Alexa AI Natural Understanding group. She received both her PhD, and master’s degree in electrical engineering from the University of Southern California. Her interests and experience lie in the areas of spoken and natural language understanding, dialogue systems, machine learning, deep learning, affective computing and applications for education and healthcare.

She has published papers in the areas of speech, language, dialogue, artificial intelligence and multimodal human computer interaction at leading science conferences such as Interspeech, the AAAI Conference on Artificial Intelligence, and the Association for Computational Linguistics (ACL), has served as an area chair for Interspeech 2016, and as a reviewer of papers for several science conferences.

Innovations I find exciting

It is exciting to see how new techniques in deep learning continuously push the boundaries of the state of the art in the fields of dialogue and spoken language processing. I’m very interested in advances around unsupervised, semi-supervised and transfer learning, which allow deep learning models to leverage the power of large corpora without relying on costly and time-consuming manual annotations. Pre-trained language models like BERT and GPT-2 and their use in downstream applications are just a few examples. These innovations are particularly relevant for industry applications where scalability is key.

I am also excited about recent literature in deep learning that is allowing us to develop models to perform complex tasks like higher-level reasoning, for example, over the contents of a document or an image or both, as opposed to simpler classification tasks. I’m also excited to see how these methods can have a positive impact on people through their deployment in products, especially in applications of healthcare, accessibility and education.

Priya Ponnapalli, principal deep learning scientist

Priya Ponnapalli
Priya Ponnapalli, principal deep learning scientist

Ponnapalli is a senior manager and principal deep learning scientist within the Amazon ML Solutions Lab, where she leads a global team of data scientists that help AWS customers accelerate their adoption of ML and cloud technologies across industries, from healthcare and finance to sports. As the leader of Amazon ML Solutions Lab’s sports business, Ponnapalli works with customers including National Football League (NFL), Six Nations Rugby, and Formula 1 (F1), just to name a few, to enhance the fan experience and transform sports using ML.

Ponnapalli is also a senior research affiliate at the Genomic Signal Processing Lab at the University of Utah, and a faculty member at Rutgers Business School, where she teaches ML to business leaders, and works to inspire the next generation of leaders. Prior to joining AWS, she co-founded Eigengene, a data-driven personalized medicine startup and has helped companies like Genentech and Roche establish and build data science teams. For her PhD in electrical and computer engineering at the University of Texas at Austin, Ponnapalli defined and demonstrated the higher-order generalized singular value decomposition (HO GSVD), the only framework that can create a single coherent model from multiple two-dimensional datasets by extending the GSVD from two to more than two matrices.

Innovations I find exciting

As an Amazon ML Solutions Lab scientist, I’m most excited about real-world applications of ML across industries. I’m interested in innovations to overcome challenges with small, limited datasets that companies often have to contend with. I’m also intrigued by model interpretability and explainability which are key to earning trust and spurring broad adoption. I’m passionate about making ML accessible to all, so it can be used to solve some of the most important problems we are facing, from fighting climate change to treating cancer.

Ana Pinheiro Privette, senior program manager

ana.jpg
Ana Pinheiro Privette, senior program manager

Ana Pinheiro Privette is a senior program manager with Amazon's Sustainability group. She joined the Sustainability Science and Innovation team in September 2017 as the program lead for the Amazon Sustainability Data Initiative (ASDI), a program that seeks to leverage Amazon’s scale, technology, and infrastructure to help create more global innovation for sustainability. ASDI is a Tech-for-Good project and is a joint effort between Amazon Sustainability and the AWS Open Data team focusing on democratizing access to key data and analytical capabilities to anyone working in the sustainability space.

Privette was trained as an environmental engineer and as an earth sciences researcher at the New University of Lisbon (Portugal) and at MIT. She did her doctoral research work at NASA in the Washington D.C. area and as part of her project, she spent a couple of years running scientific field work sites in Africa to support a NASA international field campaign. After spending most of her career at NASA and NOAA as a scientist, Privette led projects for the White House climate portfolio, including the Obama Climate Data Initiative and the Partnership for Resilience and Preparedness (PREP), both focused on delivering better access and use of US Federal climate data to support decision makers.

Innovations I find exciting

As part of ASDI, I work very closely with AWS customers developing applications in the space of sustainability to understand what challenges they may be experiencing and how we may accelerate sustainability research and innovation by minimizing the cost and time required to acquire and analyze large sustainability datasets. The ASDI currently works with scientific organizations like NOAA, NASA, the UK Met Office and Government of Queensland to identify, host, and deploy key datasets on the AWS Cloud, including weather observations, weather forecasts, climate projection data, satellite imagery, hydrological data, air quality data, and ocean forecast data. These datasets are publicly available to anyone.

In addition, ASDI provides cloud grants to those interested in exploring the use of AWS’ technology and scalable infrastructure to solve big, long-term sustainability challenges with this data. The dual-pronged approach allows sustainability researchers to analyze massive amounts of data in mere minutes, regardless of where they are in the world or how much local storage space or computing capacity they can access.

Nashlie Sephus, manager, applied science

sephus.jpg
Nashlie Sephus, applied scientist, Amazon Web Services machine learning team.
Credit: Terrence Wells@PoetWilliamsPhotography

Sephus is an applied scientist on AWS’s artificial intelligence team, focusing on computer vision. In this role, Sephus focuses on the fairness and accuracy of the team’s algorithms. Sephus formerly led the Amazon Visual Search team in Atlanta, which launched visual search for replacement parts on the Amazon Shopping app in June 2018. This technology was a result of former startup Partpic (Atlanta) being acquired by Amazon, for which she was the chief technology officer (CTO). Prior to working at Partpic, she received her PhD in 2014 from the School of Electrical and Computer Engineering at the Georgia Institute of Technology. She received her bachelor’s degree in computer engineering in 2007 from Mississippi State University.

Innovations I find exciting

Since the onset of machine learning and artificial intelligence, neural networks (such as convolutional neural networks (CNNs), and generative adversarial networks (GANs), etc.) and learning algorithms have always excited me. It’s being able to quickly and automatically draw patterns from data, whether it be images, video, or audio at scale, that fascinates me. Since music was my first love (along with karaoke!), music information retrieval has always been a passion of mine. These innovations, when used responsibly and fairly, are able to benefit people in their everyday activities.

Research areas

Related content

US, VA, Arlington
We are seeking an exceptional Data Scientist to join our team in PXT Central Science. The ideal candidate will thrive in a dynamic, multifaceted role where you'll translate complex business challenges into rigorous quantitative frameworks, extract actionable insights from structured and unstructured datasets, and architect science-backed, scalable solutions that elevate the experience of our 1 million+ employees worldwide. If you're energized by the opportunity to apply data science to our mission of making Amazon Earth's Best Employer, we want to hear from you. Key job responsibilities • Own the design, development, and maintenance of scalable models and prototypes leveraging statistical, machine learning, or GenAI methodologies to enhance employee experience. • Partner with scientists, engineers, and product leaders to solve for employee experience defects using scientific approaches, building new services and tools that deliverable measurable impact. • Author and maintain detailed technical documentation related to the projects you drive. • Communicate results to diverse audiences of varying technical background with effective writing, visualizations, and presentations • Stay current with emerging methods and technologies, and implement them strategically to amplify the team’s impact. About the team The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, machine learning, and Generative AI to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science, engineering, and UX to develop and deliver solutions that measurably achieve this goal.
US, WA, Bellevue
The Amazon Fulfillment Technologies (AFT) Science team is looking for an exceptional Applied Scientist, with strong optimization and analytical skills, to develop production solutions for one of the most complex systems in the world: Amazon’s Fulfillment Network. At AFT Science, we design, build and deploy optimization, simulation, and machine learning solutions to power the production systems running at world wide Amazon Fulfillment Centers. We solve a wide range of problems that are encountered in the network, including labor planning and staffing, demand prioritization, pick assignment and scheduling, and flow process optimization. We are tasked to develop innovative, scalable, and reliable science-driven solutions that are beyond the published state of art in order to run frequently (ranging from every few minutes to every few hours per use case) and continuously in our large scale network. Key job responsibilities As an Applied Scientist, you will work with other scientists, software engineers, product managers, and operations leaders to develop scientific solutions and analytics using a variety of tools and observe direct impact to process efficiency and associate experience in the fulfillment network. Key responsibilities include: * Develop an understanding and domain knowledge of operational processes, system architecture and functions, and business requirements * Deep dive into data and code to identify opportunities for continuous improvement and/or disruptive new approach * Develop scalable mathematical models for production systems to derive optimal or near-optimal solutions for existing and new challenges * Create prototypes and simulations for agile experimentation of devised solutions * Advocate technical solutions to business stakeholders, engineering teams, and senior leadership * Partner with engineers to integrate prototypes into production systems * Design experiment to test new or incremental solutions launched in production and build metrics to track performance About the team Amazon Fulfillment Technology (AFT) designs, develops and operates the end-to-end fulfillment technology solutions for all Amazon Fulfillment Centers (FC). We harmonize the physical and virtual world so Amazon customers can get what they want, when they want it. The AFT Science team has expertise in operations research, optimization, scheduling, planning, simulation, and machine learning. We also have domain expertise in the operational processes within the FCs and their defects. We prioritize advancements that support AFT tech teams and focus areas rather than specific fields of research or individual business partners. We influence each stage of innovation from inception to deployment which includes both developing novel solutions or improving existing approaches. Resulting production systems rely on a diverse set of technologies, our teams therefore invest in multiple specialties as the needs of each focus area evolves.
US, WA, Seattle
We are seeking an exceptional Data Scientist to join our team in PXT Central Science. The ideal candidate will thrive in a dynamic, multifaceted role where you'll translate complex business challenges into rigorous quantitative frameworks, extract actionable insights from structured and unstructured datasets, and architect science-backed, scalable solutions that elevate the experience of our 1 million+ employees worldwide. If you're energized by the opportunity to apply data science to our mission of making Amazon Earth's Best Employer, we want to hear from you. Key job responsibilities • Own the design, development, and maintenance of scalable models and prototypes leveraging statistical, machine learning, or GenAI methodologies to enhance employee experience. • Partner with scientists, engineers, and product leaders to solve for employee experience defects using scientific approaches, building new services and tools that deliverable measurable impact. • Author and maintain detailed technical documentation related to the projects you drive. • Communicate results to diverse audiences of varying technical background with effective writing, visualizations, and presentations • Stay current with emerging methods and technologies, and implement them strategically to amplify the team’s impact. About the team The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, machine learning, and Generative AI to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science, engineering, and UX to develop and deliver solutions that measurably achieve this goal.
US, WA, Bellevue
Alexa International is looking for a passionate, talented, and inventive Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. You will contribute to developing novel solutions and deliver high-quality results that impact Alexa's international products and services. Key job responsibilities As an Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs. Your work will directly impact our international customers in the form of products and services that make use of digital assistant technology. You will leverage Amazon's heterogeneous data sources, unique and diverse international customer nuances and large-scale computing resources to accelerate advances in text, voice, and vision domains in a multimodal setup. The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environments to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and collaborate effectively with cross-functional teams. A day in the life * Analyze, understand, and model customer behavior and the customer experience based on large-scale data. * Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants. * Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF. * Set up experimentation frameworks for agile model analysis and A/B testing. * Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies. * Contribute to end-to-end delivery of solutions from research to production, including reusable science components. * Communicate solutions clearly to partners and stakeholders. * Contribute to the scientific community through publications and community engagement.
US, WA, Bellevue
Amazon’s Last Mile Team is looking for a passionate individual with strong optimization and analytical skills to join its Last Mile Science team in the endeavor of designing and improving the most complex planning of delivery network in the world. Last Mile builds global solutions that enable Amazon to attract an elastic supply of drivers, companies, and assets needed to deliver Amazon's and other shippers' volumes at the lowest cost and with the best customer delivery experience. Last Mile Science team owns the core decision models in the space of jurisdiction planning, delivery channel and modes network design, capacity planning for on the road and at delivery stations, routing inputs estimation and optimization. Our research has direct impact on customer experience, driver and station associate experience, Delivery Service Partner (DSP)’s success and the sustainable growth of Amazon. Optimizing the last mile delivery requires deep understanding of transportation, supply chain management, pricing strategies and forecasting. Only through innovative and strategic thinking, we will make the right capital investments in technology, assets and infrastructures that allows for long-term success. Our team members have an opportunity to be on the forefront of supply chain thought leadership by working on some of the most difficult problems in the industry with some of the best product managers, scientists, and software engineers in the industry. Key job responsibilities Candidates will be responsible for developing solutions to better manage and optimize delivery capacity in the last mile network. The successful candidate should have solid research experience in one or more technical areas of Operations Research or Machine Learning. These positions will focus on identifying and analyzing opportunities to improve existing algorithms and also on optimizing the system policies across the management of external delivery service providers and internal planning strategies. They require superior logical thinkers who are able to quickly approach large ambiguous problems, turn high-level business requirements into mathematical models, identify the right solution approach, and contribute to the software development for production systems. To support their proposals, candidates should be able to independently mine and analyze data, and be able to use any necessary programming and statistical analysis software to do so. Successful candidates must thrive in fast-paced environments, which encourage collaborative and creative problem solving, be able to measure and estimate risks, constructively critique peer research, and align research focuses with the Amazon's strategic needs.
US, WA, Bellevue
Alexa International is looking for a passionate, talented, and inventive Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. You will contribute to developing novel solutions and deliver high-quality results that impact Alexa's international products and services. Key job responsibilities As an Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs. Your work will directly impact our international customers in the form of products and services that make use of digital assistant technology. You will leverage Amazon's heterogeneous data sources, unique and diverse international customer nuances and large-scale computing resources to accelerate advances in text, voice, and vision domains in a multimodal setup. The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environments to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and collaborate effectively with cross-functional teams. A day in the life * Analyze, understand, and model customer behavior and the customer experience based on large-scale data. * Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants. * Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF. * Set up experimentation frameworks for agile model analysis and A/B testing. * Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies. * Contribute to end-to-end delivery of solutions from research to production, including reusable science components. * Communicate solutions clearly to partners and stakeholders. * Contribute to the scientific community through publications and community engagement.
US, CA, Pasadena
The Amazon Web Services (AWS) Center for Quantum Computing (CQC) is a multi-disciplinary team of theoretical and experimental physicists, materials scientists, and hardware and software engineers on a mission to develop a fault-tolerant quantum computer. Throughout your internship journey, you'll have access to unparalleled resources, including state-of-the-art computing infrastructure, cutting-edge research papers, and mentorship from industry luminaries. This immersive experience will not only sharpen your technical skills but also cultivate your ability to think critically, communicate effectively, and thrive in a fast-paced, innovative environment where bold ideas are celebrated. Join us at the forefront of applied science, where your contributions will shape the future of Quantum Computing and propel humanity forward. Seize this extraordinary opportunity to learn, grow, and leave an indelible mark on the world of technology. Amazon has positions available for Quantum Research Science and Applied Science Internships in Santa Clara, CA and Pasadena, CA. We are particularly interested in candidates with expertise in any of the following areas: superconducting qubits, cavity/circuit QED, quantum optics, open quantum systems, superconductivity, electromagnetic simulations of superconducting circuits, microwave engineering, benchmarking, quantum error correction, fabrication, etc. Key job responsibilities In this role, you will work alongside global experts to develop and implement novel, scalable solutions that advance the state-of-the-art in the areas of quantum computing. You will tackle challenging, groundbreaking research problems, work with leading edge technology, focus on highly targeted customer use-cases, and launch products that solve problems for Amazon customers. The ideal candidate should possess the ability to work collaboratively with diverse groups and cross-functional teams to solve complex business problems. A successful candidate will be a self-starter, comfortable with ambiguity, with strong attention to detail and the ability to thrive in a fast-paced, ever-changing environment. About the team Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Hybrid Work We value innovation and recognize this sometimes requires uninterrupted time to focus on a build. We also value in-person collaboration and time spent face-to-face. Our team affords employees options to work in the office every day or in a flexible, hybrid work model near one of our U.S. Amazon offices.
US, WA, Bellevue
Alexa International Science team is looking for a passionate, talented, and inventive Senior Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. At this level, you will drive cross-team scientific strategy, influence partner teams, and deliver solutions that have broad impact across Alexa's international products and services. Key job responsibilities As a Senior Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs, particularly delivering industry-leading scientific research and applied AI for multi-lingual applications — a challenging area for the industry globally. Your work will directly impact our global customers in the form of products and services that support Alexa+. You will leverage Amazon's heterogeneous data sources and large-scale computing resources to accelerate advances in text, speech, and vision domains. The ideal candidate possesses a solid understanding of machine learning, speech and/or natural language processing, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environment, like to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and are able to influence and align multiple teams around a shared scientific vision.
US, WA, Bellevue
Amazon is seeking a Language Data Scientist to join the Alexa International science team as domain expert. This role focuses on expanding analysis and evaluation of conversational interaction data deliverables. The Language Data Scientist is an expert in conversation assessment processes, working closely with a team of skilled machine learning scientists and engineers, and is a key member in developing new conventions for relevant annotation workflows. The Language Data Scientist will be own unique data analysis and research requests that support the training and evaluation of LLMs and machine learning models, and the overall processing of a data collection. Key job responsibilities To be successful in this role, you must have a passion for data, efficiency, and accuracy. Specifically, you will: - Own data analyses for customer-facing features, including launch go/no-go metrics for new features and accuracy metrics for existing features - Handle unique data analysis requests from a range of stakeholders, including quantitative and qualitative analyses to elevate customer experience with speech interfaces - Lead and evaluate changing dialog evaluation conventions, test tooling developments, and pilot processes to support expansion to new data areas - Continuously evaluate workflow tools and processes and offer solutions to ensure they are efficient, high quality, and scalable - Provide expert support for a large and growing team of data analysts - Provide support for ongoing and new data collection efforts as a subject matter expert on conventions and use of the data - Conduct research studies to understand speech and customer-Alexa interactions - Collaborate with scientists and product managers, and other stakeholders in defining and validating customer experience metrics
US, WA, Bellevue
Alexa International is looking for a passionate, talented, and inventive Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. You will contribute to developing novel solutions and deliver high-quality results that impact Alexa's international products and services. Key job responsibilities As an Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs. Your work will directly impact our international customers in the form of products and services that make use of digital assistant technology. You will leverage Amazon's heterogeneous data sources, unique and diverse international customer nuances and large-scale computing resources to accelerate advances in text, voice, and vision domains in a multimodal setup. The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environments to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and collaborate effectively with cross-functional teams. A day in the life * Analyze, understand, and model customer behavior and the customer experience based on large-scale data. * Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants. * Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF. * Set up experimentation frameworks for agile model analysis and A/B testing. * Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies. * Contribute to end-to-end delivery of solutions from research to production, including reusable science components. * Communicate solutions clearly to partners and stakeholders. * Contribute to the scientific community through publications and community engagement.