Ten university teams selected for Alexa Prize TaskBot Challenge 2

Second iteration features five new teams.

Amazon today announced that ten teams from around the globe have been selected to participate in the Alexa Prize TaskBot Challenge year 2, a university challenge focused on developing multimodal (voice and vision) conversational agents that assist customers in completing tasks requiring multiple steps and decisions.

Alexa Prize is a flagship industry-academic collaboration dedicated to accelerating the science of conversational artificial intelligence (AI) and multimodal human-AI interactions.

“Prize competitions provide an agile science experimentation framework for researchers and students encouraging them to explore transformational ideas at the boundaries of what is achievable,” said Reza Ghanadan, senior principal scientist with Alexa AI and head of Alexa Prize. “We have developed the CoBot platform and tools to lower the barriers to AI innovation for both the academic research community and students interested in conversational AI assistants. These tools allow students to quickly deploy their solutions at scale in the real world with Alexa, then observe, evaluate, and enhance their research results using feedback from Alexa customers.”

Photo of Participants in the Alexa Prize TaskBot Challenge Bootcamp
The Alexa Prize TaskBot Bootcamp was held in Seattle, Washington, with representatives from all ten university teams.

The teams selected for the challenge, which began in January, feature five returning entrants — including the top three finishers in the most recent challenge — and five new universities.

Team

University

Faculty advisor

Returning

TWIZNOVA School of Science and TechnologyJoão Magalhães
EvoquerBOTPenn State UniversityRui Zhang
Taco 2.0The Ohio State UniversityHuan Sun
GRILLUniversity of GlasgowJeff Dalton
MarunaUniversity of Massachusetts AmherstHamed Zamani

New

BoilerBotPurdue UniversityJulia Rayz
DiWBotRutgers UniversityMatthew Stone
SageUniversity of California, Santa CruzXin (Eric) Wang
ISABELUniversity of PittsburghMalihe Alikhani
PLAN-BotVirginia TechIsmini Lourentzou

The prizes for overall performance in the competition will be $500,000 for the first-place team, $100,000 for second, and $50,000 for third. Those prizes will be paid out to the students on the teams with the best overall performance.

“I am delighted to see that new teams are joining the second year of the competition together with returning teams, who, by competing again, are signaling to us that they found value in the TaskBot challenge, said Yoelle Maarek, vice president research and science for Amazon Shopping.  

“We expect these talented graduate students to continue surprising us, as well as Amazon customers, this year. Connecting academia, Amazonians, and actual customers experimenting with taskbots, is a winning combination to keep pushing the boundaries of science in conversational AI for Alexa to delight and ease the lives of millions of customers.”

The Alexa Prize is a competition for university students dedicated to advancing the field of conversational AI. Launched in 2016, the program was created to recognize students from around the globe who are changing the way we interact with technology.

TaskBot Challenge 2 teams are working to address one of the hardest problems in conversational AI — creating next-generation conversational AI experiences that delight customers by addressing their changing needs as they complete complex tasks. This challenge builds upon the Alexa Prize’s foundation of providing universities a unique opportunity to test cutting-edge machine learning models with actual customers at scale.

The Alexa Prize TaskBot challenge provides a realistic scenario with real-user multimodal interactions, making this the perfect setting to observe and measure human-bot conversations and AI algorithms in a groundbreaking setting.
rafael_ferreira_twiz.jpg
Rafael Ferreira, NOVA School of Science and Technology, Team TWIZ
Our vision of EvoquerBOT combines improving task completion rates and elevating user satisfaction. To this end, we deliver innovative solutions to fundamental NLP challenges.
haoran_zhang.jpeg
Haoran Zhang, Penn State University, Team EvoquerBOT
We are especially interested in developing innovative ways to achieve successful coordination of multiple modalities, such as visual and verbal elements, and create a more engaging and intuitive user experience.
Lingbo_Mo.JPG
Lingbo Mo, The Ohio State University, Team Taco 2.0
The GRILL team is excited to continue bringing cutting-edge AI research to improve people’s lives. Our research team works on new capabilities of foundation models that understand text, images, and the surrounding world.
Sophie_portrait.jpg
Sophie Fischer, University of Glasgow, Team GRILL
The competition lets us create interfaces for the general public in a production environment – it’s a unique opportunity to connect our research with our career goals.
Baber (Rutgers).jpeg
Baber Khalid, Rutgers University, Team DiWBot
We are very excited to be part of the community and look forward to working with the Alexa team and other teams.
Anthony_Sicilia.jpg
Anthony Sicilia, University of Pittsburgh, Team ISABEL
The Alexa Prize TaskBot Challenge combines a vast range of tasks over multiple domains with multimodal outputs. This is the ultimate test for any moonshot concept, and we can't wait to see what the real world has in store for us.
purdue 2.jpg
Rey (Alex) Gonzalez, Purdue University, Team BoilerBot
Participating in this competition is an incredible opportunity that will allow us to do applied research and ship it to real users.
ChrisSamarinas_DSC02670.jpg
Chris Samarinas, University of Massachusetts Amherst, Team Maruna
Although artificial intelligence has experienced explosive development in the past decade, there is still a gap between research and real-world application. The TaskBot Challenge provides us with a unique opportunity to explore multimodal AI in practical situations.
UCSC Kaishi TB2.png
Kaizhi Zheng Univerisity of California, Santa Cruz-Amherst, Team Sage
Our bot will make adaptable conversation a reality by allowing customers to follow personalized decisions through the completion of multiple, sequential sub-tasks and adapt to the tools, materials, or ingredients available to the user by proposing appropriate substitutes and alternatives.
Afrina Tabassum
Afrina Tabassum

TaskBot is the first conversational AI challenge to incorporate multimodal customer experiences, so in addition to receiving verbal instructions, customers with Echo Show or Fire TV devices, can also be presented with step-by-step instructions, images, or diagrams that enhance task guidance.

This year’s challenge has been expanded to include more hobbies and at-home activities. Participating teams were asked to propose interesting ways to incorporate visual aids into every conversation turn when a screen is available. Innovative ideas on improving the presentation of visual aids, as well as the coordination of visual and verbal modalities, were part of the team selection criteria.

Each university selected for the challenge receives a $250,000 research grant, Alexa-enabled devices, free Amazon Web Services (AWS) cloud computing services to support their research and development efforts, access to Amazon scientists, the CoBot (conversational bot) toolkit and other tools such as automated speech recognition through Alexa, neural detection and generation models, conversational data sets, and design guidance and development support from the Alexa Prize team.

"Alexa, let's work together"

The university teams’ taskbots will be available for Alexa customers to engage with in May 2023 with a finals event being held in September, and winners announced later that month.

As with the previous challenge, Alexa customers can engage in conversation with teams’ taskbots when they become available in May by saying, “Alexa, let’s work together.” Until then, “Alexa, let’s work together” will direct you to conversations with the previous challenge winners of 2022 and the Alexa Prize TaskBot.

After initiating the interaction, Alexa customers then receive a brief message informing them that they are interacting with an Alexa Prize university taskbot before being randomly connected to one of the participating taskbots.

After exiting the conversation with the taskbot, which customers can do at any time, the customer is prompted for a verbal rating, followed by an option to provide additional feedback. The interactions, ratings, and feedback are shared with the teams to help them improve their taskbots. Customer ratings are also used to determine which university teams will move on to the semifinals and finals.

Our goal is to contribute to the multimodal conversational AI field and move it closer to the way humans perceive, reason, and communicate through multimodal information.
joao_magalhaes_twiz.jpg
João Magalhães, associate professor, NOVA School of Science and Technology, Team TWIZ
We look forward to the Challenge because it is the perfect platform to create multimodal, tasked-oriented dialogue systems that elevate user experience and engagement.
rui_zhang.jpeg
Rui Zhang, assistant professor, Penn State University, Team EvoquerBOT
Through this TaskBot Challenge, we hope our work can expand the horizon of conversational AI along dimensions like dialogue depth, multi-modal coordination, commonsense reasoning, and learning from use.
Huan_Sun.png
Huan Sun, associate professor, The Ohio State University, Team Taco 2.0
The GRILL team is creating the next generation of open assistants that understand and use knowledge about the world and can communicate effectively to inform and educate.
jeff.jpeg
Jeff Dalton, associate professor, University of Glasgow, Team GRILL
Our TaskBot will help people get things done through personalized, adaptive, and context-aware conversational interaction by combining our research results with the state-of-the-art capabilities of Alexa devices.
Matthew Stone (Rutgers).jpg
Matthew Stone, professor, Rutgers University, Team DiWBot
We work towards making conversational AI technology more inclusive and collaborative. Inclusive Alexa can collaborate with users from diverse cultures and with different communication capabilities and preferences.
Malihe_Alikhani.jpg
Malihe Alikhani, assistant professor, University of Pittsburgh, Team ISABEL
We hope to develop a task-oriented system that can interact with users based on their level of knowledge, experience, and communication preference.
purdue 1.jpg
Julia Rayz, professor, Purdue University, Team BoilerBot

Success in the previous TaskBot Challenge required teams to address many difficult AI obstacles. The challenge required the fusion of multiple AI techniques including knowledge representation and inference, commonsense and causal reasoning, and language understanding and generation.

The “GRILLBot” team from University of Glasgow won the TaskBot 1 Challenge, earning a $500,000 prize for its performance. Teams from NOVA School of Science and Technology (Portgual) and The Ohio State University earned second- and third-place prizes, respectively.

Research papers from Amazon’s Alexa Prize team, and each of the competing teams, can be viewed and downloaded here.

Alexa Prize Taskbot Challenge Finals | Amazon Science

Research areas

Latest news

The latest updates, stories, and more about Alexa Prize.
US, WA, Seattle
Amazon's Global Fixed Marketing Campaign Measurement & Optimization (CMO) team is looking for a senior economic expert in causal inference and applied ML to advance the economic measurement, accuracy validation and optimization methodologies of Amazon's global multi-billion dollar fixed marketing spend. This is a thought leadership position to help set the long-term vision, drive methods innovation, and influence cross-org methods alignment. This role is also an expert in modeling and measuring marketing and customer value with proven capacity to innovate, scale measurement, and mentor talent. This candidate will also work closely with senior Fixed Marketing tech, product, finance and business leadership to devise science roadmaps for innovation and simplification, and adoption of insights to influence important resource allocation, fixed marketing spend and prioritization decisions. Excellent communication skills (verbal and written) are required to ensure success of this collaboration. The candidate must be passionate about advancing science for business and customer impact. Key job responsibilities - Advance measurement, accuracy validation, and optimization methodology within Fixed Marketing. - Motivate and drive data generation to size. - Develop novel, innovative and scalable marketing measurement techniques and methodologies. - Enable product and tech development to scale science solutions and approaches. A day in the life - Propose and refine economic and scientific measurement, accuracy validation, and optimization methodology to improve Fixed Marketing models, outputs and business results - Brief global fixed marketing and retails executives about FM measurement and optimization approaches, providing options to address strategic priorities. - Collaborate with and influence the broader scientific methodology community. About the team CMO's vision is to maximizing long-term free cash flow by providing reliable, accurate and useful global fixed marketing measurement and decision support. The team measures and helps optimize the incremental impact of Amazon (Stores, AWS, Devices) fixed marketing investment across TV, Digital, Social, Radio, and many other channels globally. This is a fully self supported team composed of scientists, economists, engineers, and product/program leaders with S-Team visibility. We are open to hiring candidates to work out of one of the following locations: Irvine, CA, USA | San Francisco, CA, USA | Seattle, WA, USA | Sunnyvale, CA, USA
GB, Cambridge
Our team builds generative AI solutions that will produce some of the future’s most influential voices in media and art. We develop cutting-edge technologies with Amazon Studios, the provider of original content for Prime Video, with Amazon Game Studios and Alexa, the ground-breaking service that powers the audio for Echo. Do you want to be part of the team developing the future technology that impacts the customer experience of ground-breaking products? Then come join us and make history. We are looking for a passionate, talented, and inventive Applied Scientist with a background in Machine Learning to help build industry-leading Speech, Language, Audio and Video technology. As an Applied Scientist at Amazon you will work with talented peers to develop novel algorithms and generative AI models to drive the state of the art in audio (and vocal arts) generation. Position Responsibilities: * Participate in the design, development, evaluation, deployment and updating of data-driven models for digital vocal arts applications. * Participate in research activities including the application and evaluation and digital vocal and video arts techniques for novel applications. * Research and implement novel ML and statistical approaches to add value to the business. * Mentor junior engineers and scientists. We are open to hiring candidates to work out of one of the following locations: Cambridge, GBR
US, TX, Austin
The Workforce Solutions Analytics and Tech team is looking for a senior Applied Scientist who is interested in solving challenging optimization problems in the labor scheduling and operations efficiency space. We are actively looking to hire senior scientists to lead one or more of these problem spaces. Successful candidates will have a deep knowledge of Operations Research and Machine Learning methods, experience in applying these methods to large-scale business problems, the ability to map models into production-worthy code in Python or Java, the communication skills necessary to explain complex technical approaches to a variety of stakeholders and customers, and the excitement to take iterative approaches to tackle big research challenges. As a member of our team, you'll work on cutting-edge projects that directly impact over a million Amazon associates. This is a high-impact role with opportunities to designing and improving complex labor planning and cost optimization models. The successful candidate will be a self-starter comfortable with ambiguity, with strong attention to detail and outstanding ability in balancing technical leadership with strong business judgment to make the right decisions about model and method choices. Successful candidates must thrive in fast-paced environments, which encourage collaborative and creative problem solving, be able to measure and estimate risks, constructively critique peer research, and align research focuses with the Amazon's strategic needs. Key job responsibilities • Candidates will be responsible for developing solutions to better manage and optimize flexible labor capacity. The successful candidate should have solid research experience in one or more technical areas of Operations Research or Machine Learning. As a senior scientist, you will also help coach/mentor junior scientists on the team. • In this role, you will be a technical leader in applied science research with significant scope, impact, and high visibility. You will lead science initiatives for strategic optimization and capacity planning. They require superior logical thinkers who are able to quickly approach large ambiguous problems, turn high-level business requirements into mathematical models, identify the right solution approach, and contribute to the software development for production systems. • Invent and design new solutions for scientifically-complex problem areas and identify opportunities for invention in existing or new business initiatives. • Successfully deliver large or critical solutions to complex problems in the support of medium-to-large business goals. • Apply mathematical optimization techniques and algorithms to design optimal or near optimal solution methodologies to be used for labor planning. • Research, prototype, simulate, and experiment with these models and participate in the production level deployment in Python or Java. We are open to hiring candidates to work out of one of the following locations: Arlington, VA, USA | Austin, TX, USA | Bellevue, WA, USA | Nashville, TN, USA | Seattle, WA, USA | Tempe, AZ, USA
US, NY, New York
Where will Amazon's growth come from in the next year? What about over the next five? Which product lines are poised to quintuple in size? Are we investing enough in our infrastructure, or too much? How do our customers react to changes in prices, product selection, or delivery times? These are among the most important questions at Amazon today. The Topline Forecasting team in the Supply Chain Optimization Technologies (SCOT) group is looking for innovative, passionate and results-oriented Economists to answer these questions. You will have an opportunity to own the long-run outlook for Amazon’s global consumer business and shape strategic decisions at the highest level. The successful candidate will be able to formalize problem definitions from ambiguous requirements, build econometrics models using Amazon’s world-class data systems, and develop cutting-edge solutions for non-standard problems. Key job responsibilities · Develop new econometric models or improve existing approaches using scalable techniques. · Extract data for analysis and model development from large, complex datasets. · Closely work with engineering teams to build scalable, efficient systems that implement prototypes in production. · Apply economic theory to solve business problems in a fast moving environment. · Distill problem definitions from informal business requirements and communicate technical solutions to senior business leaders. · Drive innovation and best practices in applied research across the Amazon research science community. We are open to hiring candidates to work out of one of the following locations: New York, NY, USA
US, MD, Virtual Location - Maryland
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to work with large and complicated data sets. Some knowledge of econometrics, as well as basic familiarity with Python is necessary, and experience with SQL and UNIX would be a plus. This is a part time position, 29 hours per week, with compensation being awarded on an hourly basis. You will learn how to build data sets and perform applied econometric analysis at Internet speed collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. Roughly 85% of previous cohorts have converted to full time economics employment at Amazon. If you are interested, please send your CV to our mailing list at econ-internship@amazon.com. We are open to hiring candidates to work out of one of the following locations: Virtual Location - MD
US, WA, Bellevue
We are seeking a passionate, talented, and inventive individual to join the Applied AI team and help build industry-leading technologies that customers will love. This team offers a unique opportunity to make a significant impact on the customer experience and contribute to the design, architecture, and implementation of a cutting-edge product. Key job responsibilities On our team you will push the boundaries of ML and Generative AI techniques to scale the inputs for hundreds of billions of dollars of annual revenue for our eCommerce business. If you have a passion for AI technologies, a drive to innovate and a desire to make a meaningful impact, we invite you to become a valued member of our team. We are seeking an experienced Scientist who combines superb technical, research, analytical and leadership capabilities with a demonstrated ability to get the right things done quickly and effectively. This person must be comfortable working with a team of top-notch developers and collaborating with our research teams. We’re looking for someone who innovates, and loves solving hard problems. You will be expected to have an established background in building highly scalable systems and system design, great communication skills, and a motivation to achieve results in a fast-paced environment. You should be somebody who enjoys working on complex problems, is customer-centric, and feels strongly about building good software as well as making that software achieve its operational goals. A day in the life You will be responsible for developing and maintaining the systems and tools that enable us to accelerate knowledge operations and work in the intersection of Science and Engineering. You will push the boundaries of ML and Generative AI techniques to scale the inputs for hundreds of billions of dollars of annual revenue for our eCommerce business. If you have a passion for AI technologies, a drive to innovate and a desire to make a meaningful impact, we invite you to become a valued member of our team. About the team The mission of the Applied AI team is to enable organizations within Worldwide Amazon.com Stores to accelerate the adoption of AI technologies across various parts of our business. We are looking for an Applied Scientist to join our Applied AI team to work on LLM-based solutions. We are open to hiring candidates to work out of one of the following locations: Bellevue, WA, USA
US, WA, Bellevue
We are seeking a passionate, talented, and inventive individual to join the Applied AI team and help build industry-leading technologies that customers will love. This team offers a unique opportunity to make a significant impact on the customer experience and contribute to the design, architecture, and implementation of a cutting-edge product. The mission of the Applied AI team is to enable organizations within Worldwide Amazon.com Stores to accelerate the adoption of AI technologies across various parts of our business. We are looking for a Senior Applied Scientist to join our Applied AI team to work on LLM-based solutions. We are seeking an experienced Scientist who combines superb technical, research, analytical and leadership capabilities with a demonstrated ability to get the right things done quickly and effectively. This person must be comfortable working with a team of top-notch developers and collaborating with our research teams. We’re looking for someone who innovates, and loves solving hard problems. You will be expected to have an established background in building highly scalable systems and system design, excellent project management skills, great communication skills, and a motivation to achieve results in a fast-paced environment. You should be somebody who enjoys working on complex problems, is customer-centric, and feels strongly about building good software as well as making that software achieve its operational goals. Key job responsibilities You will be responsible for developing and maintaining the systems and tools that enable us to accelerate knowledge operations and work in the intersection of Science and Engineering. A day in the life On our team you will push the boundaries of ML and Generative AI techniques to scale the inputs for hundreds of billions of dollars of annual revenue for our eCommerce business. If you have a passion for AI technologies, a drive to innovate and a desire to make a meaningful impact, we invite you to become a valued member of our team. We are open to hiring candidates to work out of one of the following locations: Bellevue, WA, USA
IN, KA, Bengaluru
Amazon strives to be Earth's most customer-centric company where people can find and discover virtually anything they want to buy online. By giving customers more of what they want - low prices, vast selection, and convenience - Amazon continues to grow and evolve as a world-class e-commerce platform. The AOP team is an integral part of this and strives to provide Analytical Capabilities to fulfil all customer processes in the IN-ECCF regions. We’re seeking a Data Scientist with expertise in a breadth of ML techniques. Your responsibilities will include developing, prototyping and productionizing innovative models using a range of techniques (Supervised/Unsupervised/Reinforcement). We are also looking for innovators capable of using generative AI to design, evangelize, and implement state-of-the-art solutions for never-before-solved problems. Key job responsibilities - Demonstrate thorough technical knowledge on feature engineering of massive datasets, effective exploratory data analysis, and model building using industry standard AI/ML models and working with Large Language Models - Proficiency in both Supervised(Linear/Logistic Regression) and UnSupervised algorithms(k means clustering) - Understand the business reality behind large sets of data and develop meaningful solutions comprising of analytics as well as marketing management. - Work closely with internal stakeholders like the business teams, engineering teams and partner teams and align them with respect to your focus area - Innovate by adapting new modeling techniques and procedures - Passionate about working with huge data sets ( training/fine tuning) and be someone who loves to bring datasets together to answer business questions. You should have deep expertise in creation and management of datasets - Exposure at implementing and operating stable, scalable data flow solutions from production systems into end-user facing applications/reports. These solutions will be fault tolerant, self-healing and adaptive. - Work with distributed machine learning and statistical algorithms to harness enormous volumes of data at scale to serve our customers We are open to hiring candidates to work out of one of the following locations: Bengaluru, KA, IND | Hyderabad, TS, IND
DE, Aachen
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Senior Applied Scientist with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Senior Applied Scientist with the AGI team, you will work with talented peers to lead the development of novel algorithms and modeling techniques, to advance the state of the art with LLMs. Your work will directly impact our customers in the form of products and services that make use of speech and language technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in spoken language understanding. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers. We are open to hiring candidates to work out of one of the following locations: Aachen, DEU
US, WA, Bellevue
We are seeking a passionate, talented, and inventive individual to join the Applied AI team and help build industry-leading technologies that customers will love. This team offers a unique opportunity to make a significant impact on the customer experience and contribute to the design, architecture, and implementation of a cutting-edge product. The mission of the Applied AI team is to enable organizations within Worldwide Amazon.com Stores to accelerate the adoption of AI technologies across various parts of our business. We are looking for a Senior Applied Scientist to join our Applied AI team to work on LLM-based solutions. We are seeking an experienced Scientist who combines superb technical, research, analytical and leadership capabilities with a demonstrated ability to get the right things done quickly and effectively. This person must be comfortable working with a team of top-notch developers and collaborating with our research teams. We’re looking for someone who innovates, and loves solving hard problems. You will be expected to have an established background in building highly scalable systems and system design, excellent project management skills, great communication skills, and a motivation to achieve results in a fast-paced environment. You should be somebody who enjoys working on complex problems, is customer-centric, and feels strongly about building good software as well as making that software achieve its operational goals. Key job responsibilities You will be responsible for developing and maintaining the systems and tools that enable us to accelerate knowledge operations and work in the intersection of Science and Engineering. You will push the boundaries of ML and Generative AI techniques to scale the inputs for hundreds of billions of dollars of annual revenue for our eCommerce business. If you have a passion for AI technologies, a drive to innovate and a desire to make a meaningful impact, we invite you to become a valued member of our team. We are open to hiring candidates to work out of one of the following locations: Bellevue, WA, USA