Alexa Prize Proceedings

The Alexa Prize Proceedings publishes the research in conversational AI from the competition. Amazon works closely with university teams to provide a testbed for research to address the challenges with dialog management, natural language understanding, contextual modeling, commonsense reasoning and response generation, and these proceedings seek to capture the advances in those areas that result from these efforts. Authors are free to make additional hardcopy publishing arrangements, but Amazon will not produce hardcopies of these volumes.
93 results found
  • University of California, Davis
    Alexa Prize SocialBot Grand Challenge 3 Proceedings
    2019
    Gunrock 2.0 is built on top of Gunrock with an emphasis on user adaptation. Gunrock 2.0 combines various neural natural language understanding modules, including named entity detection, linking, and dialog act prediction, to improve user understanding. Its dialog management is a hierarchical model that handles various topics, such as movies, music, and sports. The system-level dialog manager can handle
  • University of California, Santa Cruz
    Alexa Prize SocialBot Grand Challenge 3 Proceedings
    2019
    This report describes Athena, a dialogue system for spoken conversation on popular topics and current events. We develop a flexible topic-agnostic approach to dialogue management that dynamically configures dialogue based on general principles of entity and topic coherence. Athena’s dialogue manager uses a contract-based method where discourse constraints are dispatched to clusters of response generators
  • Carnegie Mellon University
    Alexa Prize SocialBot Grand Challenge 3 Proceedings
    2019
    Tartan is a social bot that engages users in sharing daily personal experiences in multiple domains. Our work contributes to Conversational AI in two aspects: 1) We extract common-sense knowledge expressed in large-scale user utterances in conversations, and find that more than 20% of the shared information is related to personal life, such as social relationships and individual activities. 2) Based on
  • Alexa Prize SocialBot Grand Challenge 3 Proceedings
    2019
    Building a dialogue system able to talk fluently and meaningfully in an open domain conversation is one of the foundational challenges in the field of AI. Recent progress in NLP driven by the application of the deep neural networks and large language models opened new possibilities to solve many hard problems of the conversational AI. Alexa Prize Socialbot Grand Challenge gives a unique opportunity to test
  • University of California, Irvine
    Alexa Prize SocialBot Grand Challenge 3 Proceedings
    2019
    We describe the ZOTBOT system for open-ended conversations, designed for the Alexa Prize competition. We focus on two main shortcomings in existing conversational agents: lack of awareness in commonsense reasoning when responding to user utterances (resulting in nonsensical or uninteresting responses) and inability to understand semantics and converse naturally about fact-based articles in a compelling
  • University of California, San Diego
    Alexa Prize SocialBot Grand Challenge 3 Proceedings
    2019
    We propose Bernard: a framework for an engaging open-domain socialbot. While the task of open-domain dialog generation remains a difficult one, we explore various strategies to generate coherent dialog given an arbitrary dialog history. We incorporate a stateful autonomous dialog manager using non-deterministic finite automata to control multi-turn conversations. We show that powerful pretrained language
  • Alexa Prize SocialBot Grand Challenge 3 Proceedings
    2019
    Conversational Intelligence requires that a person engage on informational, personal and relational levels. Advances in Natural Language Understanding have helped recent chatbots succeed at dialog on the informational level. However, current techniques still lag for conversing with humans on a personal level and fully relating to them. The University of Michigan’s submission to the Alexa Prize Grand Challenge
  • Chandra Khatri, Behnam Hedayatnia, Chandra Khatri, Anushree Venkatesh, Jeff Nunn, Yi Pan, Qing Liu, Han Song, Anna Gottardi, Sanjeev Kwatra, Sanju Pancholi, Ming Cheng, Qinglang Chen, Lauren Stubel, Karthik Gopalakrishnan
    Alexa Prize SocialBot Grand Challenge 2 Proceedings
    2018
    Building open domain conversational systems that allow users to have engaging conversations on topics of their choice is a challenging task. Alexa Prize was launched in 2016 to tackle the problem of achieving natural, sustained, coherent and engaging open-domain dialogs. In the second iteration of the competition in 2018, university teams advanced the state of the art by using context in dialog models,
  • Alexa Prize SocialBot Grand Challenge 2 Proceedings
    2018
    Building conversational systems that enable natural language interactions with machines has been attractive to mankind since the early days of computing, as exemplified by earlier text-based systems such as ELIZA [Weizenbaum, 1966]. Previous work on conversational systems generally falls into two categories, task-oriented and socialbots. Task-oriented systems aim to help users accomplish a specific task
  • Mari Ostendorf
    Alexa Prize SocialBot Grand Challenge 2 Proceedings
    2018
    In September 2016, Amazon introduced a new problem in conversational Al, the Alexa Prize, which challenged student teams to build a socialbot that could converse with Alexa on a wide range of topics. The socialbot differs from task-oriented dialog systems that address explicit user goals associated with a constrained domain, and also differs from chatbot systems that only handle social chitchat. The socialbot

Latest news

The latest updates, stories, and more about Alexa Prize.
US, NY, New York
We are seeking a Human-Robot Interaction (HRI) Research Scientist to develop cutting-edge interactions that make robots feel alive, personal, and fun. In this role, you will focus on verbal and non-verbal conversational systems, social dynamics, memory, and long-term relationship formation between robots, their environments, and the people they interact with. Your contributions will be essential in advancing robotics by enabling expressive, socially intelligent, and trustworthy interactions between robots and humans.
US, WA, Seattle
Are you a PhD interested in machine learning, natural language processing, computer vision, automated reasoning, robotics, or quantum technologies? We are looking for skilled scientists capable of putting theory into practice through experimentation and invention, leveraging science techniques and implementing systems to work on massive datasets in an effort to tackle never-before-solved problems. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. As an Applied Scientist, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Key job responsibilities Amazon Science gives insight into the company’s approach to customer-obsessed scientific innovation. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. It’s the company’s ability to have an impact at scale that allows us to attract some of the brightest minds in artificial intelligence and related fields. Our scientists use our working backwards method to enrich the way we live and work. For more information on the Amazon Science community please visit https://www.amazon.science.
US, MA, North Reading
Amazon Robotics is transforming warehouse automation through edge AI and machine learning applied to real-world robotics challenges. We're seeking a Research Scientist to advance our mobile manipulation capabilities by developing novel learning-based approaches that enable robots to navigate and manipulate objects in dynamic fulfillment environments. This role offers the opportunity to conduct original research and translate state-of-the-art findings into production systems operating at Amazon's unprecedented scale. Key job responsibilities Research and Algorithm Development: Formulate novel research problems in robot learning and manipulation, design new model architectures, validate hypotheses through rigorous experimentation, and advance the state of the art in learning-based robotics. Data Strategy and Pipeline Design: Define data requirements for research initiatives, design scalable collection and curation strategies, establish governance and provenance standards, and build reusable pipelines ensuring data quality and reproducibility. Experimentation and Scientific Validation: Design and execute experiments in simulation and real-world embodiments, develop evaluation methodologies and benchmarks, perform ablation studies and statistical analyses, and iterate systematically to advance model performance. Prototyping and Research Infrastructure: Develop clean, well-documented research codebases, build experimentation frameworks and evaluation tooling, contribute to shared training infrastructure, and implement interfaces for broader robotics integration. Scientific Leadership and Publication: Drive an independent research agenda aligned with team objectives, publish at top-tier venues (e.g., RSS, CoRL, ICRA, NeurIPS), identify research gaps through literature reviews, and present findings via technical reports and talks. Cross-Functional Collaboration: Partner with scientists, engineers, and leaders across teams to translate research into deployable solutions, mentor junior researchers, contribute to the team's scientific culture, and support integration with robotics hardware teams. A day in the life If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply! About the team Are you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Robotics. We are a smart, collaborative team of enthusiastic doers that work passionately to apply innovative advances in robotics and software to solve real-world challenges that will transform our customers’ experiences in ways we can’t even image yet. We invent new improvements every day. We are Amazon Robotics and we will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling and fun!
US, WA, Seattle
What happens when you give AI the ability to remember? Not cached responses — real structured memory that compounds over time and transfers across contexts. We're building the science behind this, and we need researchers who want to own the problem end-to-end. This is a founding role on a new team. You won't inherit models or maintain someone else's pipeline. You'll define the research direction, run experiments at scale, and ship what works directly to production. Key job responsibilities As an Applied Scientist in our team, you will be responsible for the research, design, and development of new AI technologies for knowledge acquisition and retrieval. You will adopt or invent new machine learning and analytical techniques in the realm of information retrieval, knowledge representation, and large language models. Specific responsibilities include: 1. Design and implement novel approaches to knowledge extraction from heterogeneous, unstructured data sources at organizational scale. 2. Build retrieval systems that match intent to relevant knowledge across domains — solving the "right memory at the right time" problem. 3. Own the quality of memory generation: what to capture, how to structure it, when to surface it, and when to let it decay. 4. Run large-scale experiments using Amazon's compute infrastructure and massive real-world datasets. 5. Develop evaluation frameworks for a system where "quality" means something new — right knowledge, right context, right confidence level. 6. Collaborate with engineers to move from research prototype to production system in weeks, not quarters. 7. Invent new approaches to temporal knowledge management — how memories age, conflict, and compound over time. 8. Publish and patent novel approaches to knowledge acquisition and retrieval at top-tier venues. A day in the life You will solve real-world problems by getting and analyzing large amounts of data, generate insights and opportunities, execute experiments, and develop statistical and ML models. The team is driven by business needs, which requires collaboration with other Scientists, Engineers, and Product Managers across the organization. You get to influence stakeholders with clear communication skills. You innovate on behalf of the customer and strategically build features. You will mentor junior members and help them grow. About the team We're a new team within Personalization, focused on a different kind of recommendation: not "what product should this customer see" but "what knowledge should this AI use right now." Same scale, same rigor, entirely new problem space. The science is at the intersection of information retrieval, knowledge representation, and LLM reasoning — and the right approach hasn't been established yet. The team values innovation and offers a safe place to try, fail, and learn while fostering a culture of continuous improvement. Everyone is a leader and owner for everything we do as a team. We offer creative space with an entrepreneurial work environment focusing on customer obsession.
ES, B, Barcelona
How does Amazon decide which fulfillment center ships your order, which truck carries it, and how to keep promises across hundreds of millions of packages daily? How does it decide how many trucks and how much labor are required to ship orders across the network? SCOT Fulfillment Optimization (FO) owns the optimization and forecasting science behind these decisions. We are seeking Applied Scientists to join the FO Science & Tech team in Barcelona (alternatively: Luxembourg or London) with a strong academic background in optimization, machine learning, and/or time-series forecasting. • You will design and build state-of-the-art machine learning and optimization models that power Amazon's fulfillment decisions at an unprecedented scale across two core scientific pillars: • Large-Scale Optimization and Planning: Designing planning systems for order assignment and resource utilization, while balancing multi-objective cost-speed tradeoffs to enable controllers to steer millions of shipments per hour optimally. • Demand Forecasting & Predictive ML: Developing time-series forecasts for customer demand, incorporating contextual information (weather, sales, order properties), and modeling uncertainty for core planning systems. Basic qualifications • PhD in Operations Research, Applied Mathematics, Computer Science, or related field (or equivalent experience) • Strong programming skills (Python preferred; experience with optimization solvers a plus) • Research experience in one or more: • Large-scale mathematical programming (LP, MIP, decomposition methods) • Combinatorial optimization (assignment, scheduling, network flows) • Multi-objective optimization and control • Large-scale time-series forecasting (GenAI models, probabilistic forecasting, uncertainty quantification) • Causal inference (spatiotemporal causal modeling, offline policy evaluation) Preferred qualifications • Experience building optimization systems that run in production at scale • Being comfortable with ambiguity and fast iteration cycles • Publications in relevant venues Key job responsibilities Design and implement optimization and forecasting models for large-scale fulfillment problems, from order assignment to network flow control. Build research prototypes end-to-end: from problem formulation through scalable implementation to production validation. Analyse complex tradeoffs (cost, speed, capacity, accuracy) and translate findings into actionable recommendations for leadership and operations teams. Collaborate with engineers to bring science solutions into production systems serving millions of customer orders daily. A day in the life You formulate an optimization or forecasting problem on a whiteboard with teammates, then prototype it in Python with real data by the afternoon. You run experiments against production-scale datasets, iterate on the model, and present results to stakeholders who will use them to make network decisions next week. Some days you dive deep into solver performance; other days you're explaining a Pareto frontier to an operations leader. You collaborate with large engineering and product teams to bring your solutions into systems serving millions of customers. Alongside fast-turnaround prototypes, you own long-term research bets, the kind that reshape how Amazon's fulfillment network operates at scale. Your work goes live. About the team SCOT Fulfillment Optimization Science & Tech (FO SnT) is the applied research team behind Amazon's fulfillment decision-making systems. We decide how orders get assigned to warehouses, how capacity is allocated across the network, and how cost and speed tradeoffs are managed in real time, at global scale. Our models influence billions of euros in annual operational spend. They protect sites from overload during peak, reduce transportation costs and CO2 emissions, and ensure customers receive their packages when promised. Leadership relies on our science to make investment decisions worth hundreds of millions. We are practitioners of large-scale optimization: MIP formulations, decomposition methods, approximation algorithms, and parallelisation. We use machine learning where it sharpens our decisions, including forecasting, learned heuristics, and multi-armed bandits. We pick the right tool for the problem, not the fashionable one. You will work alongside Senior and Principal scientists, and collaborate with Amazon Scholars and academic partners who bring frontier research into our applied problems. We code our prototypes to be production-ready and collaborate with large engineering teams to ship systems, not papers. Above all, we have fun solving hard real-world problems at real-world speed, failing, learning, and shipping along the way.
US, NY, New York
Want to work on building a Amazon Ads billion dollar business, innovate on a new product, and have a positive impact on millions of views while working with industry-leading technologies? We're growing a team to support the Sponsored Ads business that powers the advertising experience for millions of viewers and advertisers daily. Amazon is investing heavily in building a world-class advertising business and developing a collection of self-service performance advertising products that drive discovery and sales. We deliver billions of ad impressions and millions of clicks daily and are constantly challenging ourselves to create world-class products and an unparalleled shopping experience for our hundreds of millions of customers worldwide. Key job responsibilities We are building the next-gen smart ads campaign. At its core is an Intelligence Flywheel — an architecture where every component's output is designed to train models that improve every other component. The Model Layer that is meant to power every capability currently has no dedicated science ownership. As the Senior Applied Scientist on this team, you own the science that makes the flywheel turn. You will turn static, threshold-based logic into self-improving, closed-loop intelligence, and define the decision policies that let the system act autonomously with advertiser trust. Concretely, you will: * Build predictive issue-detection models that identify under-delivery, over-delivery, and performance degradation from campaign signals before they materially impact advertisers. * Design the intervention-selection policy — which autonomous action to take — framed as a contextual bandit: choose, observe, update. Engineers implement action execution; you define the policy that selects actions. * Establish causal attribution for autonomous optimization, separating the effect of our interventions from organic performance change, so improvements can be attributed and advertiser trust in autonomy can be earned. * Integrate and adapt cross-model signals. Combine creative-quality, product-relevance, and budget signals into a unified advertiser-intelligence picture, and adapt general-purpose partner models to our product reality via fine-tuning, re-ranking, or thin adaptation layers. * Close recommendation and grading feedback loops — define reward schemas for accept/reject and performance-vs-baseline signals, correlate creative-quality scores with real campaign outcomes, and feed empirical findings back to both our product and partner science teams. You will work backwards from ambiguous business problems, set the science roadmap for the Model Layer, and partner closely with the team's software engineers — who own the services, pipelines, and execution infrastructure — so that model artifacts you produce are deployed and served in production. This is a high-leverage, high-autonomy role: your outputs are consumed by multiple engineering workstreams at once, and you set the abstractions the team builds on. About the team We are focused on goal-oriented, AI powered workflows that help advertisers achieve their marketing objectives. We collect campaign goals, surface relevant data at key decision points, and provide reporting that validates decision-making. Our product suite guides advertisers in building campaigns with optimal targeting, creative formats, inventory, and bid models that are highly likely to hit their goals — reducing the need for manual intervention.
US, WA, Seattle
At Amazon Selection and Catalog Systems (ASCS), our mission is to power the online buying experience for customers worldwide so they can find, discover, and buy any product they want. We innovate on behalf of our customers to ensure uniqueness and consistency of product identity and to infer relationships between products in Amazon Catalog to drive the selection gateway for the search and browse experiences on the website. We're solving a fundamental AI challenge: establishing product relevant information at unprecedented scale with Frontier Models and Agents. The scale is staggering: billions of products, petabytes of multimodal data, millions of sellers, dozens of languages, and infinite product diversity ranging from electronics to groceries to digital content. The research challenges are immense. GenAI and VLMs hold transformative promise for catalog understanding, but we operate where traditional methods fail: ambiguous problem spaces, incomplete and noisy data, inherent uncertainty, reasoning across both images and textual data, and explaining decisions at scale. Enriching product information requires sophisticated models that reason across text, images, and structured data, all while maintaining accuracy and trust for high-stakes business decisions affecting millions of customers daily. Amazon's Catalog System Services Science team is looking for an innovative and customer-focused applied scientist to help us make the world's best product catalog even better. In this role, you will partner with technology and business leaders to build new state-of-the-art algorithms, models, and services. You will pioneer advanced GenAI solutions that power next-generation agentic shopping experiences, working in a collaborative environment where you can experiment with massive data from the world's largest product catalog, tackle problems at the frontier of AI research, rapidly implement and deploy your algorithmic ideas at scale, across millions of customers. Key job responsibilities - Formulate novel research problems at the intersection of GenAI, multimodal learning, and large-scale information retrieval. In essence, translating ambiguous business challenges into tractable scientific frameworks - Design and implement leading models leveraging frontier models, and agentic architectures to enrich catalog information at billion-product scale - Pioneer explainable AI methodologies that balance model performance with scalability requirements for production systems impacting millions of daily customer decisions - Own end-to-end ML pipelines from research ideation to production deployment, processing petabytes of multimodal data with rigorous evaluation frameworks - Represent the team in the broader science community - publishing findings, delivering tech talks, and staying at the forefront of GenAI, VLM, and agentic system research
US, NY, New York
Are you excited about applying machine learning and statistical modeling to real-world systems that serve millions of customers? Amazon Connect is a cloud-based contact center service that helps businesses deliver personal, efficient customer experiences. Our team of scientists and engineers builds the AI and ML capabilities that power contact center operations and optimization. We are looking for a Senior Applied Scientist to tackle scientifically complex challenges in areas such as stochastic modeling, queueing theory, anomaly detection, and optimization. In this role, you will design and deploy novel ML models and algorithms that directly improve how businesses interact with their customers. You will work at the intersection of research and production, turning ambiguous problems into scalable solutions that shape the future of cloud-based customer service. Key job responsibilities - Design and deploy novel machine learning models and algorithms to solve complex problems in contact center operations, including forecasting, routing optimization, and anomaly detection. - Lead the scientific agenda for your team by identifying new research opportunities, proposing initiatives, and driving them from concept through production deployment. - Collaborate with engineering teams to architect and implement scalable ML systems, personally contributing significant portions of the critical scientific components. - Mentor fellow scientists and engineers through code reviews, design discussions, and scientific guidance, raising the overall technical bar of the team. - Evaluate and advance the team's ML methodology by benchmarking against current academic and industry research, and by publishing findings internally and externally when appropriate. A day in the life You might start your morning reviewing experiment results from a new forecasting model, then join a design session with engineers to discuss how to integrate it into the production pipeline. After lunch, you could be whiteboarding a novel approach to a queueing optimization problem with a fellow scientist, followed by a code review for a teammate. You will regularly present your research findings to stakeholders across the organization and contribute to the team's publication efforts. About the team Our team within Amazon Connect focuses on building intelligent, ML-driven capabilities that help businesses run their contact centers more effectively. We work closely with product, engineering, and science partners to turn research ideas into features that customers rely on every day. We value curiosity, collaboration, and scientific rigor, and we are investing in new AI capabilities that will continue to transform the customer service industry. If you want to see your research make a tangible impact at scale, this is the place to do it.
IN, HR, Gurugram
Building large-scale forecasting and optimization systems that power Amazon’s global transportation network and directly impact customer experience and cost. Key job responsibilities 1. Guide model and system design across a range of techniques, including tree-based models, deep learning (LSTMs, transformers), LLMs, and reinforcement learning. 2. Ensure models are production-ready, scalable, and robust through close partnership with stakeholders. 3. Partner with Product, Operations, and Engineering leaders to enable proactive decision-making and corrective actions. 4 Own end-to-end business metrics, directly influencing customer experience, cost optimization, and network reliability. 5. Help contribute to the broader ML community through publications, conference submissions, and internal knowledge sharing.
US, CA, Sunnyvale
We are looking for a Senior Applied Scientist to help drive the research and development of real-time multimodal conversational AI. You will contribute across two focus areas: advancing foundation models for speech and audio, and building the post-training systems (reward modeling, reinforcement learning) that shape natural, human-like conversational behavior. You will own a significant research area and contribute across the full model lifecycle — from pre-training and architecture design through post-training alignment and real-time deployment. You will work at the frontier of what’s possible in conversational AI, with the compute, data, and runway to pursue problems that few teams in the world have the resources to tackle. As a Senior Scientist, you will drive the technical execution of your research area, contribute to the team’s roadmap, and work closely with inference engineers to ensure your models are designed for real-time production deployment. Key job responsibilities What You’ll Do Foundation Model Scaling - Help build and train large-scale multimodal foundation models for real-time speech and audio generation, from architecture design through production-scale training - Advance the scaling and efficiency of conversational models, including the relationship between data, model size, and real-time performance - Design model architectures informed by hardware constraints and inference requirements, working with inference engineers to ensure models are servable from inception - Develop training methodologies for multimodal models that jointly process and generate speech, language, and audio in real-time streaming contexts - Contribute to the state of the art on efficient architectures and training methods for conversational AI at scale Post-Training & Reinforcement Learning - Design and build reward models and reward functions for speech systems — capturing naturalness, fluency, conversational quality, and real-time responsiveness - Develop and apply reinforcement learning methods to shape conversational behavior — teaching models natural timing, responsiveness, and fluid interaction - Build parts of the post-training pipeline from SFT through RL alignment, optimized for real-time multimodal outputs rather than text-only generation - Design evaluation frameworks that capture the quality dimensions unique to real-time conversation (latency sensitivity, audio quality, prosody, interaction naturalness) Real-Time Perception & Generation - Advance the team’s capabilities in real-time perception — the ability of the model to process incoming audio/speech while simultaneously generating responses - Develop techniques for natural interactive systems where the model handles concurrent input and output with human-like timing - Work at the intersection of model architecture and production constraints to ensure multimodal capabilities function within hard real-time latency budgets