Search results

In this paper we investigate a time delay neural network (TDNN) for a keyword spotting task that requires low CPU, memory and latency. The TDNN is trained with transfer learning and multi-task learning. Temporal subsampling enabled by the time delay architecture reduces computational complexity. We propose to apply singular value decomposition (SVD) to further reduce TDNN complexity. This allows us to first

We present a zero-shot learning approach for text classification, predicting which natural language understanding domain can handle a given utterance. Our approach can predict domains at runtime that did not exist at training time. We achieve this extensibility by learning to project utterances and domains into the same embedding space while generating each domain-specific embedding from a set of attributes

Conversational agents are exploding in popularity. However, much work remains in the area of non goal-oriented conversations, despite significant growth in research interest over recent years. To advance the state of the art in conversational AI, Amazon launched the Alexa Prize, a 2.5-million dollar university competition where sixteen selected university teams built conversational agents to deliver the

Automatic speech recognition is now playing an important role in volume control and adjustment of modern smart speakers. According to the recognition results by using the advanced deep neural network technology, this paper proposes an efficient processing system for automatic volume control (AVC) and limiter. The theoretical analyses, subjective and objective testing results show that the proposed processing

In this work, we develop a technique for training features directly from the single-channel speech waveform in order to improve wake word (WW) detection performance. Conventional speech recognition systems typically extract a compact feature representation based on prior knowledge such as log-mel filter bank energy (LFBE). Such a feature is then used for training a deep neural network (DNN) acoustic model

The task of automatically detecting the end of a device-directed user request is particularly challenging in case of switching short command and long free-form utterances. While low latency end-pointing configurations typically lead to good user experiences in the case of short requests, such as “play music”, it can be too aggressive in domains with longer free-form queries, where users tend to pause noticeably

We propose a new smart local search for the p-center problem, based on the critical vertex concept, and embed it in a GRASP framework. Experimental results attest the robustness of the proposed search procedure and confirm that for benchmark instances it converges to optimal or near/optimal solutions faster than the best known state-of-the-art local search.

Recent years have seen a surge in consumer usage of spoken dialog systems, due to the popularity of voice assistants. While these systems are capable of answering factual questions or executing basic tasks, they do not yet have the capability to hold multi-turn conversations. The Alexa Prize challenge provides us a great opportunity to explore various approaches and dialog strategies for building a multi-turn

RubyStar is a dialog system designed to create “human-like” conversation by combining different response generation strategies. RubyStar conducts a non- task-oriented conversation on general topics by using an ensemble of rule-based, retrieval-based and generative methods. Topic detection, engagement monitoring, and context tracking are used for managing interaction. Predictable elements of conversation

In this work, we designed a conversational system by combining a finite state method, a retrieval model and a machine-initiative dialogue strategy. By using the machine-initiative strategy, most of the user queries are handled by the finite state machine which models predefined dialogues. If the user’s utterance is out of the range of modeled dialogues, the retrieval model processes the input. On comparative

In this paper we introduce a novel, open domain socialbot for the Amazon Alexa Prize competition, aimed at carrying on friendly conversations with users on a variety of topics. We present our modular system, highlighting our different data sources and how we use the human mind as a model for data management. Additionally we build and employ natural language understanding and information retrieval tools

We present a novel, large-scale ensemble-based system for the Amazon Alexa Prize competition. Our system leverages state-of-the-art methods from deep learning and reinforcement learning. We carry out A/B testing experiments with real-world users and demonstrate that our approach yields substantial improvements over several baseline systems. During the competition semi-finals, our best performing system

Edina is a conversational agent whose responses utilize data harvested from Amazon Mechanical Turk (AMT) through an innovative new technique we call self-dialogues. These are conversations in which a single AMT Worker plays both participants in a dialogue. Such dialogues are surprisingly natural, efficient to collect and reflective of relevant and/or trending topics. These self-dialogues provide training

This paper introduces the University of Washington’s Alexa Prize socialbot, Sound- ing Board, which is designed to engage users with a wide variety of content. The system models the user utterance using a multi-dimensional representation. A hierarchical dialogue manager is employed where a master manages the overall conversation and a collection of miniskills manage different conversation segments. The

Open–domain dialogue systems should be able to cover a very large set of domains and at the same time keep the user engaged in the interaction. Current approaches to dialogue modeling are divided between domain–independent, non–modular approaches using sequence–to–sequence models and the domain–specific modular systems developed for task–based dialogue. Furthermore, user engagement in dialogue, addressed

We describe an information-oriented conversational AI system, EmersonBot, developed for the Alexa Prize 2017 competition. The main goal of the system was informing users about current events, and answering their questions, while maintaining a fluent conversation. The main innovations of Emersonbot include the development of a federated multi-source information retrieval system that is aware of the conversation

We describe our Alexa prize system (called ‘Alana’) which consists of an ensemble of bots, combining rule-based and machine learning systems, and using a contextual ranking mechanism to choose system responses. This paper reports on the version of the system developed and evaluated in the semi-finals of the competition (i.e. up to 15 August 2017), but not on subsequent enhancements. The ranker for this

We present Pixie, a socialbot submitted to the 2017 Alexa Prize, developed with the objective of holding engaging casual conversations on open-ended topics. We discuss the modular, heterogeneous architecture of the Pixie system, and highlight the successes and shortcomings of our primarily template-based approach. We reflect on our findings about alternative paradigms used in the prototyping phase; in particular

In recent years, chat-bots that assist people’s daily life gained tremendous popular- ity, such as Siri, Cortana, Alexia and Google assistant. Typically, conversations with chat-bots are task orientated and brief. In this work, we explore creating social bot that can complete task and entertain user. We proposed a two-layered dialogue framework which allows for flexible reuse and reorganization of individual

In this document we outline the data collection methods, system, and experiments we ran during the course of this project. We aim to shed light on what drove the development of our bot and the techniques we used to power our bot in the course of the conversation.