GRILL

This taskbot will continue to grow on a new generation of task agents able to accomplish assistance on complex real-world tasks.

Task agents will be able to generalize to new domains with limited effort with scaleable and automatic knowledge acquisition leveraging large-scale language models. GRILLBot will be able to react to specific users’ skill levels and preferences by performing complex task.

Team GRILL (2022)
Team GRILL (2022)

Sophie Fischer - Team leader

Fischer is a 1st year PhD student specializing in multimodal representation learning and common sense reasoning. She was part of the 2021/22 GRILL lab team that finished 1st place in the Alexa Taskbot Challenge, where she was the team’s conversational UI developer and gamifier in chief. She was developing methods for multimodal task augmentation last year and designed the front-end interface.

Carlos Gemmell

Gemmell is a 3rd-year NLP Ph.D. student at the University of Glasgow supervised by Jeff Dalton. He is broadly interested in decoupling memorization from reasoning in language models. At present, he explores how language models can generate programs as tools to break down tasks, access external knowledge and make their reasoning explicit. During his Ph.D., Carlos led the winning Amazon Alexa Prize TaskBot team as one of ten global teams successfully putting ideas of code + language models into practice for question answering and dialogue management.

Niklas Tecklenburg

Tecklenburg is a 4th year Informatics undergraduate student at the University of Glasgow and has been working on Software Engineering and Computer Vision projects in the past. He has taken courses related to machine learning and natural language processing. His research revolves around improving the quality of Question Answering systems.

Philip Zubel

Zubel is a fourth-year undergraduate Computing Science student. He have developed full-stack financial applications and has taken courses related to machine learning and natural language processing. His research revolves around improving the quality of taskgraph representations and analyzing them in search.

Ekaterina Terzieva

Terzieva is a 5th year MSci Computing Science student. She has taken courses in Machine Learning and has experience building full stack applications and mobile games. Her research focus will be on dialogue policy and decision making. She is also responsible for coordinating the team and the day-to-day management of the project.

Eva Kupcova

Kupcovaa is a 4th-year undergraduate student completing her degree in Computing Science. She has developed full-stack applications, which
included accessibility testing and improvement. She took courses related to natural language processing and human-computer interaction. She will assist with UX development, perform user lab studies, enhance user engagement and improve the individual user experience based on their knowledge.

Federico Rossetto

Rossetto is a third-year PhD student specializing in multi-modal representations of music and text for conversational systems. He is an expert in applied ML, including reinforcement learning, and competed and won in the Fujitsu AI-NLP challenge 2018. He develops novel methods for multi-modal representations. He will focus on the multi-modal representation learning of video and text for the offline models. He will also assist with the core development and deployment of conversational models. Hr was a member of the 2021/22 GRILL Lab team that finished 1st place in the Alexa Taskbot Challenge.

Iain Mackie

Mackie is a third-year PhD student specializing in multi-task retrieval and information extraction graph neural models. He develops new methods for retrieval for complex tasks using knowledge bases and text-based graph neural networks. His recent publications (SIGIR 2021, SIGIR 2022, SIGDIAL 2022, IMuR 2022) focus on neural ranking models, conversational systems, entity-centric search, and multimodal interactions. He previously co-founded an e-commerce data science startup and has industry experience across various tech and finance roles. He was a member of the 2021/22 GRILL Lab team that finished 1st place in the Alexa Taskbot Challenge.

Dr. Jeff Dalton - Faculty advisor

Dalton is a Senior Lecturer in AI and IR in the School of Computing Science at the University of Glasgow where he leads the Glasgow Representation and Information Learning Lab (GRILL) (https://grilllab.ai). His research focuses on text understanding and conversational information seeking. He completed his Ph.D. at the University of Massachusetts Amherst in the Center for Intelligent Information Retrieval. Later at Google Research, he worked on web information extraction as part of the Knowledge Discovery Team (Knowledge Vault) and on language understanding in the Assistant Response Ranking team. He was the lead organizer for the TREC Conversational Assistance Track (CAsT) (http://treccast.ai) and also helped organize the Complex Answer Retrieval track. He is the recipient of a UKRI Turing AI Acceleration Fellowship on Neural Conversational Assistants and received research awards from Google, Amazon, and Bloomberg. He is the faculty advisor for the 2021/2022 Alexa Prize Taskbot challenge team, GRILLBot, that won first prize. He holds multiple patents in retrieval, information extraction, and question answering.

Latest news

The latest updates, stories, and more about Alexa Prize.
GB, London
We are looking for a Senior Economist to work on exciting and challenging business problems related to Amazon Retail’s worldwide product assortment. You will build innovative solutions based on econometrics, machine learning, and experimentation. You will be part of a interdisciplinary team of economists, product managers, engineers, and scientists, and your work will influence finance and business decisions affecting Amazon’s vast product assortment globally. If you have an entrepreneurial spirit, you know how to deliver results fast, and you have a deeply quantitative, highly innovative approach to solving problems, and long for the opportunity to build pioneering solutions to challenging problems, we want to talk to you. Key job responsibilities * Work on a challenging problem that has the potential to significantly impact Amazon’s business position * Develop econometric models and experiments to measure the customer and financial impact of Amazon’s product assortment * Collaborate with other scientists at Amazon to deliver measurable progress and change * Influence business leaders based on empirical findings
IN, KA, Bengaluru
Alexa+ is Amazon’s next-generation, AI-powered virtual assistant. Building on the original Alexa, it uses generative AI to deliver a more conversational, personalised, and effective experience. Alexa Sensitive Content Intelligence (ASCI) team is developing responsible AI (RAI) solutions for Alexa+, empowering it to provide useful information responsibly. The Mission Build AI safety systems that protect millions of Alexa customers every day. As conversational AI evolves, you'll solve challenging problems in Responsible AI by ensuring LLMs provide safe, trustworthy responses, building AI systems that understand nuanced human values across cultures, and maintaining customer trust at scale. We are looking for a passionate, talented, and inventive Data Scientist-II to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring good learning and generative models knowledge. You will be working with a team of exceptional Data Scientists working in a hybrid, fast-paced organization where scientists, engineers, and product managers work together to build customer facing experiences. You will collaborate with other data scientists while understanding the role data plays in developing data sets and exemplars that meet customer needs. You will analyze and automate processes for collecting and annotating LLM inputs and outputs to assess data quality and measurement. You will apply state-of-the-art Generative AI techniques to analyze how well our data represents human language and run experiments to gauge downstream interactions. You will work collaboratively with other data scientists and applied scientists to design and implement principled strategies for data optimization. Key job responsibilities A Data Scientist-II should have a reasonably good understanding of NLP models (e.g. LSTM, LLMs, other transformer based models) or CV models (e.g. CNN, AlexNet, ResNet, GANs, ViT) and know of ways to improve their performance using data. You leverage your technical expertise in improving and extending existing models. Your work will directly impact our customers in the form of products and services that make use of speech, language, and computer vision technologies. You will be joining a select group of people making history producing one of the most highly rated products in Amazon's history, so if you are looking for a challenging and innovative role where you can solve important problems while growing in your career, this may be the place for you. A day in the life You will be working with a group of talented scientists on running experiments to test scientific proposal/solutions to improve our sensitive contents detection and mitigation for worldwide coverage. This will involve collaboration with partner teams including engineering, PMs, data annotators, and other scientists to discuss data quality, policy, model development, and solution implementation. You will work with other scientists, collaborating and contributing to extending and improving solutions for the team. About the team Our team pioneers Responsible AI for conversational assistants. We ensure Alexa delivers safe, trustworthy experiences across all devices, modalities, and languages worldwide. We work on frontier AI safety challenges—and we're looking for scientists who want to help shape the future of trustworthy AI.
IN, KA, Bengaluru
Alexa+ is Amazon’s next-generation, AI-powered virtual assistant. Building on the original Alexa, it uses generative AI to deliver a more conversational, personalised, and effective experience. Alexa Sensitive Content Intelligence (ASCI) team is developing responsible AI (RAI) solutions for Alexa+, empowering it to provide useful information responsibly. The Mission Build AI safety systems that protect millions of Alexa customers every day. As conversational AI evolves, you'll solve challenging problems in Responsible AI by ensuring LLMs provide safe, trustworthy responses, building AI systems that understand nuanced human values across cultures, and maintaining customer trust at scale. We are looking for a passionate, talented, and inventive Data Scientist-II to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring good learning and generative models knowledge. You will be working with a team of exceptional Data Scientists working in a hybrid, fast-paced organization where scientists, engineers, and product managers work together to build customer facing experiences. You will collaborate with other data scientists while understanding the role data plays in developing data sets and exemplars that meet customer needs. You will analyze and automate processes for collecting and annotating LLM inputs and outputs to assess data quality and measurement. You will apply state-of-the-art Generative AI techniques to analyze how well our data represents human language and run experiments to gauge downstream interactions. You will work collaboratively with other data scientists and applied scientists to design and implement principled strategies for data optimization. Key job responsibilities A Data Scientist-II should have a reasonably good understanding of NLP models (e.g. LSTM, LLMs, other transformer based models) or CV models (e.g. CNN, AlexNet, ResNet, GANs, ViT) and know of ways to improve their performance using data. You leverage your technical expertise in improving and extending existing models. Your work will directly impact our customers in the form of products and services that make use of speech, language, and computer vision technologies. You will be joining a select group of people making history producing one of the most highly rated products in Amazon's history, so if you are looking for a challenging and innovative role where you can solve important problems while growing in your career, this may be the place for you. A day in the life You will be working with a group of talented scientists on running experiments to test scientific proposal/solutions to improve our sensitive contents detection and mitigation for worldwide coverage. This will involve collaboration with partner teams including engineering, PMs, data annotators, and other scientists to discuss data quality, policy, model development, and solution implementation. You will work with other scientists, collaborating and contributing to extending and improving solutions for the team. About the team Our team pioneers Responsible AI for conversational assistants. We ensure Alexa delivers safe, trustworthy experiences across all devices, modalities, and languages worldwide. We work on frontier AI safety challenges—and we're looking for scientists who want to help shape the future of trustworthy AI.
EG, Cairo
Are you a MS or PhD student interested in a 2026 internship in the field of machine learning, deep learning, generative AI, large language models and speech technology, robotics, computer vision, optimization, operations research, quantum computing, automated reasoning, or formal methods? If so, we want to hear from you! We are looking for students interested in using a variety of domain expertise to invent, design and implement state-of-the-art solutions for never-before-solved problems. You can find more information about the Amazon Science community as well as our interview process via the links below; https://www.amazon.science/ https://amazon.jobs/content/en/career-programs/university/science https://amazon.jobs/content/en/how-we-hire/university-roles/applied-science Key job responsibilities As an Applied Science Intern, you will own the design and development of end-to-end systems. You’ll have the opportunity to write technical white papers, create roadmaps and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists and other science interns to develop solutions and deploy them into production. You will have the opportunity to design new algorithms, models, or other technical solutions whilst experiencing Amazon’s customer focused culture. The ideal intern must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. A day in the life At Amazon, you will grow into the high impact person you know you’re ready to be. Every day will be filled with developing new skills and achieving personal growth. How often can you say that your work changes the world? At Amazon, you’ll say it often. Join us and define tomorrow. Some more benefits of an Amazon Science internship include; • All of our internships offer a competitive stipend/salary • Interns are paired with an experienced manager and mentor(s) • Interns receive invitations to different events such as intern program initiatives or site events • Interns can build their professional and personal network with other Amazon Scientists • Interns can potentially publish work at top tier conferences each year About the team Applicants will be reviewed on a rolling basis and are assigned to teams aligned with their research interests and experience prior to interviews. Start dates are available throughout the year and durations can vary in length from 3-6 months for full time internships. This role may available across multiple locations in the EMEA region (Austria, Estonia, France, Germany, Ireland, Israel, Italy, Jordan, Luxembourg, Netherlands, Poland, Romania, Spain, South Africa, UAE, and UK). Please note these are not remote internships.
US, CA, San Diego
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their macroeconomics and forecasting skillsets to solve real world problems. The intern will work in the area of forecasting, developing models to improve the success of new product launches in Private Brands. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis About the team The Amazon Private Brands Intelligence team applies Machine Learning, Statistics and Econometrics/economics to solve high-impact business problems, develop prototypes for Amazon-scale science solutions, and optimize key business functions of Amazon Private Brands and other Amazon orgs. We are an interdisciplinary team, using science and technology and leveraging the strengths of engineers and scientists to build solutions for some of the toughest business problems at Amazon, covering areas such as pricing, discovery, negotiation, forecasting, supply chain and product selection/development.
US, CA, Pasadena
The Amazon Center for Quantum Computing in Pasadena, CA, is looking to hire an Applied Science intern who will specialize in hardware signal train design for quantum computing. Working alongside other scientists and engineers, you will design and validate hardware performing the control and readout functions for Amazon quantum processors, from room to cryogenic temperatures. Candidates must have a solid background in analog or mixed-signal design at the PCB level. Working effectively within a cross-functional team environment is critical. Key job responsibilities Our scientists and engineers collaborate across diverse teams and projects to offer state of the art, cost effective solutions for the control of Amazon quantum processor systems. You’ll bring a passion for innovation and collaboration to: Design cryogenic and room temperature printed circuit board based hardware, used for signal conditioning and control functions. Develop tests to validate hardware with both benchtop and cryogenic test setups with quantum devices. Explore enabling control technologies necessary for Amazon to produce commercially viable quantum computers. About the team Diverse Experiences Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Inclusive Team Culture Here at Amazon, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship and Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
US, WA, Seattle
Come be a part of a rapidly expanding $35 billion-dollar global business. At Amazon Business, a fast-growing startup passionate about building solutions, we set out every day to innovate and disrupt the status quo. We stand at the intersection of tech & retail in the B2B space developing innovative purchasing and procurement solutions to help businesses and organizations thrive. At Amazon Business, we strive to be the most recognized and preferred strategic partner for smart business buying. Bring your insight, imagination and a healthy disregard for the impossible. Join us in building and celebrating the value of Amazon Business to buyers and sellers of all sizes and industries. Unlock your career potential. Amazon Business Data Insights and Analytics team is looking for a Data Scientist to lead the research and thought leadership to drive our data and insights strategy for Amazon Business. This role is central in shaping the definition and execution of the long-term strategy for Amazon Business. You will be responsible for researching, experimenting and analyzing predictive and optimization models, designing and implementing advanced detection systems that analyze customer behavior at registration and throughout their journey. You will work on ambiguous and complex business and research science problems with large opportunities. You'll leverage diverse data signals including customer profiles, purchase patterns, and network associations to identify potential abuse and fraudulent activities. You are an analytical individual who is comfortable working with cross-functional teams and systems, working with state-of-the-art machine learning techniques and AWS services to build robust models that can effectively distinguish between legitimate business activities and suspicious behavior patterns You must be a self-starter and be able to learn on the go. Excellent written and verbal communication skills are required as you will work very closely with diverse teams. Key job responsibilities - Interact with business and software teams to understand their business requirements and operational processes - Frame business problems into scalable solutions - Adapt existing and invent new techniques for solutions - Gather data required for analysis and model building - Create and track accuracy and performance metrics - Prototype models by using high-level modeling languages such as R or in software languages such as Python. - Familiarity with transforming prototypes to production is preferred. - Create, enhance, and maintain technical documentation
US, VA, Arlington
About Sponsored Products and Brands The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. About our team The SPB Offsite team builds solutions to extend campaigns to reach customers off the store and extend shopping experiences on third party sites where shoppers search and discover products. We use industry leading machine learning, high scale low latency systems, and AI technologies to create better sponsored customer experiences off the store. This role will have deep interest in building the next innovations in ad tech and shopping wherever shoppers go. You will work with external and internal partners to connect ad tech systems, understand customers, and drive results at scale. You are a deeply technical leader who operates with a GenAI first approach to product, engineering, and science based solutions. As an Applied Scientist on this team, you will: - Drive end-to-end Machine Learning projects that have a high degree of ambiguity, scale, complexity. - Perform hands-on analysis and modeling of enormous data sets to develop insights that increase traffic monetization and merchandise sales, without compromising the shopper experience. - Build machine learning models, perform proof-of-concept, experiment, optimize, and deploy your models into production; work closely with software engineers to assist in productionizing your ML models. - Run A/B experiments, gather data, and perform statistical analysis. - Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving. - Research new and innovative machine learning approaches. Why you will love this opportunity: Amazon is investing heavily in building a world-class advertising business. This team defines and delivers a collection of advertising products that drive discovery and sales. Our solutions generate billions in revenue and drive long-term growth for Amazon’s Retail and Marketplace businesses. We deliver billions of ad impressions, millions of clicks daily, and break fresh ground to create world-class products. We are a highly motivated, collaborative, and fun-loving team with an entrepreneurial spirit - with a broad mandate to experiment and innovate. Impact and Career Growth: You will invent new experiences and influence customer-facing shopping experiences to help suppliers grow their retail business and the auction dynamics that leverage native advertising; this is your opportunity to work within the fastest-growing businesses across all of Amazon! Define a long-term science vision for our advertising business, driven from our customers' needs, translating that direction into specific plans for research and applied scientists, as well as engineering and product teams. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding.
US, WA, Seattle
Are you passionate about leveraging data and economics to enhance customer experience across Amazon's diverse businesses? The Customer Experience and Business Trends (CXBT) organization is seeking an Economist to join our Benchmarking Economics Analytics and Measurement (BEAM) team. Our mission is to drive customer experience improvements through innovative economic modeling, advanced analytics, and scalable scientific solutions. As an Economist on our team, you will collaborate with senior management, business stakeholders, scientists, engineers, and economics leadership to solve complex business challenges across Amazon's business lines. You'll develop sophisticated econometric models using our world-class data systems, applying diverse methodologies spanning causal inference, machine learning, and generative AI. In this fast-paced environment, you'll tackle challenging problems that directly influence strategic decision-making and drive measurable business impact. Key job responsibilities - Develop economic theory and deliver causal machine learning models at scale - Collaborate with cross-functional teams to translate research into scalable solutions - Write effective business narratives and scientific papers to communicate to both business and technical audiences - Drive data-driven decision making to improve customer experience About the team Customer Experience and Business Trends (CXBT) is an organization made up of a diverse suite of functions dedicated to deeply understanding and improving customer experience, globally. We are a team of builders that develop products, services, ideas, and various ways of leveraging data to influence product and service offerings – for almost every business at Amazon – for every customer (e.g., consumers, developers, sellers/brands, employees, investors, streamers, gamers). Our approach is based on determining the customer need, along with problem solving, and we work backwards from there. We use technical and non-technical approaches and stay aware of industry and business trends. We are a global team, made up of a diverse set of profiles, skills, and backgrounds – including: Product Managers, Software Developers, Computer Vision experts, Solutions Architects, Data Scientists, Business Intelligence Engineers, Business Analysts, Risk Managers, and more.
US, WA, Seattle
Are you passionate about leveraging data and economics to enhance customer experience across Amazon's diverse businesses? The Customer Experience and Business Trends (CXBT) organization is seeking an Economist to join our Benchmarking Economics Analytics and Measurement (BEAM) team. Our mission is to drive customer experience improvements through innovative economic modeling, advanced analytics, and scalable scientific solutions. As an Economist on our team, you will collaborate with senior management, business stakeholders, scientists, engineers, and economics leadership to solve complex business challenges across Amazon's business lines. You'll develop sophisticated econometric models using our world-class data systems, applying diverse methodologies spanning causal inference, machine learning, and generative AI. In this fast-paced environment, you'll tackle challenging problems that directly influence strategic decision-making and drive measurable business impact. Key job responsibilities - Develop economic theory and deliver causal machine learning models at scale - Collaborate with cross-functional teams to translate research into scalable solutions - Write effective business narratives and scientific papers to communicate to both business and technical audiences - Drive data-driven decision making to improve customer experience About the team Customer Experience and Business Trends (CXBT) is an organization made up of a diverse suite of functions dedicated to deeply understanding and improving customer experience, globally. We are a team of builders that develop products, services, ideas, and various ways of leveraging data to influence product and service offerings – for almost every business at Amazon – for every customer (e.g., consumers, developers, sellers/brands, employees, investors, streamers, gamers). Our approach is based on determining the customer need, along with problem solving, and we work backwards from there. We use technical and non-technical approaches and stay aware of industry and business trends. We are a global team, made up of a diverse set of profiles, skills, and backgrounds – including: Product Managers, Software Developers, Computer Vision experts, Solutions Architects, Data Scientists, Business Intelligence Engineers, Business Analysts, Risk Managers, and more.