Ten university teams selected for Alexa Prize TaskBot Challenge 2

Second iteration features five new teams.

Amazon today announced that ten teams from around the globe have been selected to participate in the Alexa Prize TaskBot Challenge year 2, a university challenge focused on developing multimodal (voice and vision) conversational agents that assist customers in completing tasks requiring multiple steps and decisions.

Alexa Prize is a flagship industry-academic collaboration dedicated to accelerating the science of conversational artificial intelligence (AI) and multimodal human-AI interactions.

“Prize competitions provide an agile science experimentation framework for researchers and students encouraging them to explore transformational ideas at the boundaries of what is achievable,” said Reza Ghanadan, senior principal scientist with Alexa AI and head of Alexa Prize. “We have developed the CoBot platform and tools to lower the barriers to AI innovation for both the academic research community and students interested in conversational AI assistants. These tools allow students to quickly deploy their solutions at scale in the real world with Alexa, then observe, evaluate, and enhance their research results using feedback from Alexa customers.”

Photo of Participants in the Alexa Prize TaskBot Challenge Bootcamp
The Alexa Prize TaskBot Bootcamp was held in Seattle, Washington, with representatives from all ten university teams.

The teams selected for the challenge, which began in January, feature five returning entrants — including the top three finishers in the most recent challenge — and five new universities.

Team

University

Faculty advisor

Returning

TWIZNOVA School of Science and TechnologyJoão Magalhães
EvoquerBOTPenn State UniversityRui Zhang
Taco 2.0The Ohio State UniversityHuan Sun
GRILLUniversity of GlasgowJeff Dalton
MarunaUniversity of Massachusetts AmherstHamed Zamani

New

BoilerBotPurdue UniversityJulia Rayz
DiWBotRutgers UniversityMatthew Stone
SageUniversity of California, Santa CruzXin (Eric) Wang
ISABELUniversity of PittsburghMalihe Alikhani
PLAN-BotVirginia TechIsmini Lourentzou

The prizes for overall performance in the competition will be $500,000 for the first-place team, $100,000 for second, and $50,000 for third. Those prizes will be paid out to the students on the teams with the best overall performance.

“I am delighted to see that new teams are joining the second year of the competition together with returning teams, who, by competing again, are signaling to us that they found value in the TaskBot challenge, said Yoelle Maarek, vice president research and science for Amazon Shopping.  

“We expect these talented graduate students to continue surprising us, as well as Amazon customers, this year. Connecting academia, Amazonians, and actual customers experimenting with taskbots, is a winning combination to keep pushing the boundaries of science in conversational AI for Alexa to delight and ease the lives of millions of customers.”

The Alexa Prize is a competition for university students dedicated to advancing the field of conversational AI. Launched in 2016, the program was created to recognize students from around the globe who are changing the way we interact with technology.

TaskBot Challenge 2 teams are working to address one of the hardest problems in conversational AI — creating next-generation conversational AI experiences that delight customers by addressing their changing needs as they complete complex tasks. This challenge builds upon the Alexa Prize’s foundation of providing universities a unique opportunity to test cutting-edge machine learning models with actual customers at scale.

The Alexa Prize TaskBot challenge provides a realistic scenario with real-user multimodal interactions, making this the perfect setting to observe and measure human-bot conversations and AI algorithms in a groundbreaking setting.
rafael_ferreira_twiz.jpg
Rafael Ferreira, NOVA School of Science and Technology, Team TWIZ
Our vision of EvoquerBOT combines improving task completion rates and elevating user satisfaction. To this end, we deliver innovative solutions to fundamental NLP challenges.
haoran_zhang.jpeg
Haoran Zhang, Penn State University, Team EvoquerBOT
We are especially interested in developing innovative ways to achieve successful coordination of multiple modalities, such as visual and verbal elements, and create a more engaging and intuitive user experience.
Lingbo_Mo.JPG
Lingbo Mo, The Ohio State University, Team Taco 2.0
The GRILL team is excited to continue bringing cutting-edge AI research to improve people’s lives. Our research team works on new capabilities of foundation models that understand text, images, and the surrounding world.
Sophie_portrait.jpg
Sophie Fischer, University of Glasgow, Team GRILL
The competition lets us create interfaces for the general public in a production environment – it’s a unique opportunity to connect our research with our career goals.
Baber (Rutgers).jpeg
Baber Khalid, Rutgers University, Team DiWBot
We are very excited to be part of the community and look forward to working with the Alexa team and other teams.
Anthony_Sicilia.jpg
Anthony Sicilia, University of Pittsburgh, Team ISABEL
The Alexa Prize TaskBot Challenge combines a vast range of tasks over multiple domains with multimodal outputs. This is the ultimate test for any moonshot concept, and we can't wait to see what the real world has in store for us.
purdue 2.jpg
Rey (Alex) Gonzalez, Purdue University, Team BoilerBot
Participating in this competition is an incredible opportunity that will allow us to do applied research and ship it to real users.
ChrisSamarinas_DSC02670.jpg
Chris Samarinas, University of Massachusetts Amherst, Team Maruna
Although artificial intelligence has experienced explosive development in the past decade, there is still a gap between research and real-world application. The TaskBot Challenge provides us with a unique opportunity to explore multimodal AI in practical situations.
UCSC Kaishi TB2.png
Kaizhi Zheng Univerisity of California, Santa Cruz-Amherst, Team Sage
Our bot will make adaptable conversation a reality by allowing customers to follow personalized decisions through the completion of multiple, sequential sub-tasks and adapt to the tools, materials, or ingredients available to the user by proposing appropriate substitutes and alternatives.
Afrina Tabassum
Afrina Tabassum

TaskBot is the first conversational AI challenge to incorporate multimodal customer experiences, so in addition to receiving verbal instructions, customers with Echo Show or Fire TV devices, can also be presented with step-by-step instructions, images, or diagrams that enhance task guidance.

This year’s challenge has been expanded to include more hobbies and at-home activities. Participating teams were asked to propose interesting ways to incorporate visual aids into every conversation turn when a screen is available. Innovative ideas on improving the presentation of visual aids, as well as the coordination of visual and verbal modalities, were part of the team selection criteria.

Each university selected for the challenge receives a $250,000 research grant, Alexa-enabled devices, free Amazon Web Services (AWS) cloud computing services to support their research and development efforts, access to Amazon scientists, the CoBot (conversational bot) toolkit and other tools such as automated speech recognition through Alexa, neural detection and generation models, conversational data sets, and design guidance and development support from the Alexa Prize team.

"Alexa, let's work together"

The university teams’ taskbots will be available for Alexa customers to engage with in May 2023 with a finals event being held in September, and winners announced later that month.

As with the previous challenge, Alexa customers can engage in conversation with teams’ taskbots when they become available in May by saying, “Alexa, let’s work together.” Until then, “Alexa, let’s work together” will direct you to conversations with the previous challenge winners of 2022 and the Alexa Prize TaskBot.

After initiating the interaction, Alexa customers then receive a brief message informing them that they are interacting with an Alexa Prize university taskbot before being randomly connected to one of the participating taskbots.

After exiting the conversation with the taskbot, which customers can do at any time, the customer is prompted for a verbal rating, followed by an option to provide additional feedback. The interactions, ratings, and feedback are shared with the teams to help them improve their taskbots. Customer ratings are also used to determine which university teams will move on to the semifinals and finals.

Our goal is to contribute to the multimodal conversational AI field and move it closer to the way humans perceive, reason, and communicate through multimodal information.
joao_magalhaes_twiz.jpg
João Magalhães, associate professor, NOVA School of Science and Technology, Team TWIZ
We look forward to the Challenge because it is the perfect platform to create multimodal, tasked-oriented dialogue systems that elevate user experience and engagement.
rui_zhang.jpeg
Rui Zhang, assistant professor, Penn State University, Team EvoquerBOT
Through this TaskBot Challenge, we hope our work can expand the horizon of conversational AI along dimensions like dialogue depth, multi-modal coordination, commonsense reasoning, and learning from use.
Huan_Sun.png
Huan Sun, associate professor, The Ohio State University, Team Taco 2.0
The GRILL team is creating the next generation of open assistants that understand and use knowledge about the world and can communicate effectively to inform and educate.
jeff.jpeg
Jeff Dalton, associate professor, University of Glasgow, Team GRILL
Our TaskBot will help people get things done through personalized, adaptive, and context-aware conversational interaction by combining our research results with the state-of-the-art capabilities of Alexa devices.
Matthew Stone (Rutgers).jpg
Matthew Stone, professor, Rutgers University, Team DiWBot
We work towards making conversational AI technology more inclusive and collaborative. Inclusive Alexa can collaborate with users from diverse cultures and with different communication capabilities and preferences.
Malihe_Alikhani.jpg
Malihe Alikhani, assistant professor, University of Pittsburgh, Team ISABEL
We hope to develop a task-oriented system that can interact with users based on their level of knowledge, experience, and communication preference.
purdue 1.jpg
Julia Rayz, professor, Purdue University, Team BoilerBot

Success in the previous TaskBot Challenge required teams to address many difficult AI obstacles. The challenge required the fusion of multiple AI techniques including knowledge representation and inference, commonsense and causal reasoning, and language understanding and generation.

The “GRILLBot” team from University of Glasgow won the TaskBot 1 Challenge, earning a $500,000 prize for its performance. Teams from NOVA School of Science and Technology (Portgual) and The Ohio State University earned second- and third-place prizes, respectively.

Research papers from Amazon’s Alexa Prize team, and each of the competing teams, can be viewed and downloaded here.

Alexa Prize Taskbot Challenge Finals | Amazon Science

Research areas

Latest news

The latest updates, stories, and more about Alexa Prize.
US, CA, San Diego
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to help Amazon provide the best customer experience by preventing eCommerce fraud? Are you excited by the prospect of analyzing and modeling terabytes of data and creating state-of-the-art algorithms to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you enjoy collaborating in a diverse team environment? If yes, then you may be a great fit to join the Amazon Buyer Risk Prevention (BRP) Machine Learning group. We are looking for a talented scientist who is passionate to build advanced algorithmic systems that help manage safety of millions of transactions every day. Key job responsibilities Use machine learning and statistical techniques to create scalable risk management systems Learning and understanding large amounts of Amazon’s historical business data for specific instances of risk or broader risk trends Design, development and evaluation of highly innovative models for risk management Working closely with software engineering teams to drive real-time model implementations and new feature creations Working closely with operations staff to optimize risk management operations, Establishing scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation Tracking general business activity and providing clear, compelling management reporting on a regular basis Research and implement novel machine learning and statistical approaches
GB, Cambridge
The Artificial General Intelligence team (AGI) has an exciting position for an Applied Scientist with a strong background NLP and Large Language Models to help us develop state-of-the-art conversational systems. As part of this team, you will collaborate with talented scientists and software engineers to enable conversational assistants capabilities to support the use of external tools and sources of information, and develop novel reasoning capabilities to revolutionise the user experience for millions of Alexa customers. Key job responsibilities As an Applied Scientist, you will develop innovative solutions to complex problems to extend the functionalities of conversational assistants . You will use your technical expertise to research and implement novel algorithms and modelling solutions in collaboration with other scientists and engineers. You will analyse customer behaviours and define metrics to enable the identification of actionable insights and measure improvements in customer experience. You will communicate results and insights to both technical and non-technical audiences through written reports, presentations and external publications.
US, CA, Sunnyvale
The Artificial General Intelligence (AGI) team is looking for a highly skilled and experienced Senior Applied Scientist, to lead the development and implementation of cutting-edge algorithms and models for supervised fine-tuning and reinforcement learning through human feedback; with a focus across text, image, and video modalities. As a Senior Applied Scientist, you will play a critical role in driving the development of Generative AI (GenAI) technologies that can handle Amazon-scale use cases and have a significant impact on our customers' experiences. Key job responsibilities - Collaborate with cross-functional teams of engineers, product managers, and scientists to identify and solve complex problems in GenAI - Design and execute experiments to evaluate the performance of different algorithms and models, and iterate quickly to improve results - Think big about the arc of development of GenAI over a multi-year horizon, and identify new opportunities to apply these technologies to solve real-world problems - Communicate results and insights to both technical and non-technical audiences, including through presentations and written reports - Mentor and guide junior scientists and engineers, and contribute to the overall growth and development of the team
US, WA, Bellevue
Amazon’s Last Mile Team is looking for a passionate individual with strong optimization and analytical skills to join its Last Mile Science team in the endeavor of designing and improving the most complex planning of delivery network in the world. Last Mile builds global solutions that enable Amazon to attract an elastic supply of drivers, companies, and assets needed to deliver Amazon's and other shippers' volumes at the lowest cost and with the best customer delivery experience. Last Mile Science team owns the core decision models in the space of jurisdiction planning, delivery channel and modes network design, capacity planning for on the road and at delivery stations, routing inputs estimation and optimization. Our research has direct impact on customer experience, driver and station associate experience, Delivery Service Partner (DSP)’s success and the sustainable growth of Amazon. Optimizing the last mile delivery requires deep understanding of transportation, supply chain management, pricing strategies and forecasting. Only through innovative and strategic thinking, we will make the right capital investments in technology, assets and infrastructures that allows for long-term success. Our team members have an opportunity to be on the forefront of supply chain thought leadership by working on some of the most difficult problems in the industry with some of the best product managers, scientists, and software engineers in the industry. Key job responsibilities Candidates will be responsible for developing solutions to better manage and optimize delivery capacity in the last mile network. The successful candidate should have solid research experience in one or more technical areas of Operations Research or Machine Learning. These positions will focus on identifying and analyzing opportunities to improve existing algorithms and also on optimizing the system policies across the management of external delivery service providers and internal planning strategies. They require superior logical thinkers who are able to quickly approach large ambiguous problems, turn high-level business requirements into mathematical models, identify the right solution approach, and contribute to the software development for production systems. To support their proposals, candidates should be able to independently mine and analyze data, and be able to use any necessary programming and statistical analysis software to do so. Successful candidates must thrive in fast-paced environments, which encourage collaborative and creative problem solving, be able to measure and estimate risks, constructively critique peer research, and align research focuses with the Amazon's strategic needs.
IN, KA, Bangalore
Alexa is the voice activated digital assistant powering devices like Amazon Echo, Echo Dot, Echo Show, and Fire TV, which are at the forefront of this latest technology wave. To preserve our customers’ experience and trust, the Alexa Sensitive Content Intelligence (ASCI) team creates policies and builds services and tools through Machine Learning techniques to detect and mitigate sensitive content across Alexa. We are looking for an experienced Applied Science Manager to lead a team to build industry-leading technologies in attribute extraction and sensitive content detection across all languages and countries. A Manager, Applied Science will be a tech leader for a team of exceptional scientists to develop novel algorithms and modeling techniques to advance the state of the art in NLP or CV related tasks. You will work in a hybrid, fast-paced organization where scientists, engineers, and product managers work together to build customer facing experiences. You will collaborate with and mentor other scientists to raise the bar of scientific research in Amazon. Your work will directly impact our customers in the form of products and services that make use of speech, language, and computer vision technologies. We are looking for a leader with strong technical experiences a passion for building scientific driven solutions in a fast-paced environment. You should have good understanding of NLP models (e.g. LSTM, transformer based models) or CV models (e.g. CNN, AlexNet, ResNet) and where to apply them in different business cases. You leverage your exceptional technical expertise, a sound understanding of the fundamentals of Computer Science, and practical experience of building large-scale distributed systems to creating reliable, scalable, and high-performance products. In addition to technical depth, you must possess exceptional communication skills and understand how to influence key stakeholders. You will be joining a select group of people making history producing one of the most highly rated products in Amazon's history, so if you are looking for a challenging and innovative role where you can solve important problems while growing as a leader, this may be the place for you. Key job responsibilities You'll lead and manage the science driven solution development including design, run experiments, research new algorithms, and find new ways of optimizing customer experience. You set examples for the team on good science practice and standards. Besides theoretical analysis and innovation, you will work closely with talented engineers and ML scientists to put your algorithms and models into practice. Your work will directly impact the trust customers place in Alexa, globally. You contribute directly to our growth by hiring smart and motivated Scientists to establish teams that can deliver swiftly and predictably, adjusting in an agile fashion to deliver what our customers need. A day in the life You will be working with a group of talented scientists as well as stakeholder from different functional areas (e.g. product, engineering) on researching algorithm and running experiments to test scientific proposal/solutions to improve our sensitive contents detection and mitigation. This will involve collaboration with partner teams including engineering, PMs, data annotators, and other scientists to discuss data quality, policy, and model development. You will mentor other scientists, review and guide their work, help develop roadmaps for the team. You work closely with partner teams across Alexa to deliver platform features that require cross-team leadership. About the team The mission of the Alexa Sensitive Content Intelligence (ASCI) team is to (1) minimize negative surprises to customers caused by sensitive content, (2) detect and prevent potential brand-damaging interactions, and (3) build customer trust through appropriate interactions on sensitive topics. The term “sensitive content” includes within its scope a wide range of categories of content such as offensive content (e.g., hate speech, racist speech), profanity, content that is suitable only for certain age groups, politically polarizing content, and religiously polarizing content. The term “content” refers to any material that is exposed to customers by Alexa (including both 1P and 3P experiences) and includes text, speech, audio, and video.
US, WA, Seattle
Are you passionate about leveraging data to deliver actionable insights that impact daily marketing activities at Amazon? The Customer Targeting team in Amazon is seeking an Applied Scientist to join our team to develop models for optimizing the performance of Amazon’s marketing initiatives across channels and advertising formats. You have experience applying modern machine learning methods to answer key business questions, make strategic and tactical recommendations for change, and work with business leaders to drive these to production. You are entrepreneurial and able to work in a highly collaborative environment. This role requires an individual with strong quantitative modeling skills and experience using statistical methods. The successful candidate will be a self-starter comfortable with ambiguity, with strong attention to detail, an ability to work in a fast-paced and ever-changing environment. You will be expected to: - Leverage knowledge of statistics and optimization to frame decision-making problems for determining marketing spends across channels. - Predict future customer behavior and business conditions through machine learning and predictive modeling. - Use analytical and predictive techniques to build models for optimizing targeting. - Present proposals and results in a clear manner backed by data and coupled with actionable conclusions.
US, CA, Pasadena
The Amazon Web Services (AWS) Center for Quantum Computing (CQC) is a multi-disciplinary team of scientists, engineers, and technicians, on a mission to develop a fault-tolerant quantum computer. We are looking to hire a Research Scientist with fabrication and data analysis experience working on all elements of a superconducting circuit. The position is on-site at our lab, located on the in Pasadena, CA. The ideal candidate will have had prior experience building software tools for data analysis and visualization to enable deep diving into fabrication details, electrical test data. We are looking for candidates with strong engineering principles, resourcefulness and data science experience. Organization and communication skills are essential. Key job responsibilities * Develop and automate data pipeline pertinent to superconducting device fabrication. * Develop analytical tools to uncover new information about established and new processes. * Develop new or contribute to modifying existing data visualization tools. * Utilize machine learning to enable better deeper dives into fabrication and related data. * Interface with various software, design, fabrication and electrical test teams to enable new functionalities. A day in the life The role will be vital to the fabrication team and quantum computing device integration mechanism. The candidate will develop software based analytical tools to enable data driven decisions across projects related to fabrication and supporting infrastructure. Each fabrication run delivers additional data. The candidate will stay close to the details of fabrication providing data analysis and quick feedback to key stakeholders. At the end of fabrication runs custom and standardized reports will be generated by the candidate to provide insights into data generated from the run. This position may require occasional weekend work. About the team AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Hybrid Work We value innovation and recognize this sometimes requires uninterrupted time to focus on a build. We also value in-person collaboration and time spent face-to-face. Our team affords employees options to work in the office every day or in a flexible, hybrid work model near one of our U.S. Amazon offices.
US, WA, Bellevue
Conversational AI ModEling and Learning (CAMEL) team is part of Amazon Devices organization where our mission is to build a best-in-class Conversational AI that is intuitive, intelligent, and responsive, by developing superior Large Language Models (LLM) solutions and services which increase the capabilities built into the model and which enable utilizing thousands of APIs and external knowledge sources to provide the best experience for each request across millions of customers and endpoints. We are looking for a passionate, talented, and resourceful Senior Applied Scientist in the field of LLM, Artificial Intelligence (AI), Natural Language Processing (NLP), Recommender Systems and/or Information Retrieval, to invent and build scalable solutions for a state-of-the-art context-aware conversational AI. A successful candidate will have strong machine learning background and a desire to push the envelope in one or more of the above areas. The ideal candidate would also have hands-on experiences in building Generative AI solutions with LLMs, enjoy operating in dynamic environments, be self-motivated to take on challenging problems to deliver big customer impact, moving fast to ship solutions and then iterating on user feedback and interactions. Key job responsibilities As a Senior Applied Scientist, you will leverage your technical expertise and experience to demonstrate leadership in tackling large complex problems, setting the direction and collaborating with other talented applied scientists and engineers to research and develop LLM modeling and engineering techniques to reduce friction and enable natural and contextual conversations. You will analyze, understand and improve user experiences by leveraging Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in artificial intelligence. You will work on core LLM technologies, including Prompt Engineering, Model Fine-Tuning, Reinforcement Learning from Human Feedback (RLHF), Evaluation, etc. Your work will directly impact our customers in the form of novel products and services .
US, WA, Seattle
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to help Amazon provide the best customer experience by preventing eCommerce fraud? Are you excited by the prospect of analyzing and modeling terabytes of data and creating state-of-the-art algorithms to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you enjoy collaborating in a diverse team environment? If yes, then you may be a great fit to join the Amazon Buyer Risk Prevention (BRP) Machine Learning group. We are looking for a talented scientist who is passionate to build advanced algorithmic systems that help manage safety of millions of transactions every day. Key job responsibilities Use machine learning and statistical techniques to create scalable risk management systems Learning and understanding large amounts of Amazon’s historical business data for specific instances of risk or broader risk trends Design, development and evaluation of highly innovative models for risk management Working closely with software engineering teams to drive real-time model implementations and new feature creations Working closely with operations staff to optimize risk management operations, Establishing scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation Tracking general business activity and providing clear, compelling management reporting on a regular basis Research and implement novel machine learning and statistical approaches
US, CA, Palo Alto
We are reimagining Amazon Search by introducing an interactive conversational experience that makes finding the perfect product easier than ever. With our state-of-the-art Large Language Model (LLM) innovations, you can now ask product-related questions, compare products, receive personalized suggestions, and more—all through a fast and reliable natural language conversation. This is just the beginning of a new era in online shopping, and the future is yours to shape. We're searching for pioneers who are passionate about technology, innovation, and customer experience, and who are ready to make a lasting impact on the industry. You'll be working with talented scientists, and engineers to innovate on behalf of our customers. If you're fired up about being part of a dynamic, driven team, then this is your moment to join us on this exciting journey and change the world of eCommerce forever!