subscribe_icon.png Newsletter
Social
ConversationalAI.svg
Research Area

Conversational AI

Building software and systems that help people communicate with computers naturally, as if communicating with family and friends.
Explore more

Publications

View all View all
  • Augmented natural language for generative sequence labeling
    Ben Athiwaratkun, Cicero Nogueira dos Santos, Jason Krone, Bing Xiang
    EMNLP 2020
    2020
    We propose a generative framework for joint sequence labeling and sentence-level classification. Our model performs multiple sequence labeling tasks at once using a single, shared natural language output space. Unlike prior discriminative methods, our model naturally incorporates label semantics and shares knowledge across tasks. Our framework is general purpose, performing well on few-shot, low-resource
    Conversational AI
  • Improve transformer models with better relative position embeddings
    Zhiheng Huang, Davis Liang, Peng Xu, Bing Xiang
    Findings of EMNLP 2020
    2020
    Transformer architectures rely on explicit position encodings in order to preserve a notion of word order. In this paper, we argue that existing work does not fully utilize position information. For example, the initial proposal of a sinusoid embedding is fixed and not learnable. In this paper, we first review absolute position embeddings and existing methods for relative position embeddings. We then propose
    Conversational AI
  • Beyond [CLS] through ranking by generation
    Cicero Nogueira dos Santos, Xiaofei Ma, Ramesh Nallapati, Zhiheng Huang, Bing Xiang
    EMNLP 2020
    2020
    Generative models for Information Retrieval, where ranking of documents is viewed as the task of generating a query from a document’s language model, were very successful in various IR tasks in the past. However, with the advent of modern deep neural networks, attention has shifted to discriminative ranking functions that model the semantic similarity of documents and queries instead. Recently, deep generative
    Conversational AI
  • Converting the point of view of messages spoken to virtual assistants
    Isabelle G. Lee, Vera Zu, Sai Srujana Buddi, Dennis Liang, Purva Kulkarni, Jack G. M. FitzGerald
    EMNLP 2020
    2020
    Virtual Assistants can be quite literal at times. If a user says tell Bob I love him, most virtual assistants will extract the message I love him and send it to the user’s contact named Bob, rather than properly converting the message to I love you. We designed a system that takes a voice message from one user, converts the point of view of the message, and then delivers the result to its target user. We
    Conversational AI
  • An empirical investigation towards efficient multi-domain language model pre-training
    Kristjan Arumae, Qing Sun, Parminder Bhatia
    EMNLP 2020
    2020
    Pre-training large language models has become a standard in the natural language processing community. Such models are pretrained on generic data (e.g. BookCorpus and English Wikipedia) and often fine-tuned on tasks in the same domain. However, in order to achieve state-of-the-art performance on out of domain tasks such as clinical named entity recognition and relation extraction, additional in domain pre-training
    Conversational AI
Load more

Related content

Load more

Work with us

See more jobs See more jobs
Applied Scientist, Artificial General Intelligence
US, MA, Boston
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Applied Scientist with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As an Applied Scientist with the AGI team, you will work with talented peers to lead the development of algorithms and modeling techniques, to advance the state of the art with LLMs. Your work will directly impact our customers in the form of products and services that make use of GenAI technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in LLMs. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
Applied scientist, Agentic AI, AWS Agentic AI
IL, Tel Aviv
Come join the AWS Agentic AI science team in building the next generation models for intelligent automation. AWS, the world-leading provider of cloud services, has fostered the creation and growth of countless new businesses, and is a positive force for good. Our customers bring problems that will give Applied Scientists like you endless opportunities to see your research have a positive and immediate impact in the world. You will have the opportunity to partner with technology and business teams to solve real-world problems, have access to virtually endless data and computational resources, and to world-class engineers and developers that can help bring your ideas into the world. As part of the team, we expect that you will develop innovative solutions to hard problems, and publish your findings at peer reviewed conferences and workshops. We are looking for world class researchers with experience in one or more of the following areas - autonomous agents, API orchestration, Planning, large multimodal models (especially vision-language models), reinforcement learning (RL) and sequential decision making.
Senior Data Scientist
US, CA, San Francisco
If you are interested in this position, please apply on Twitch's Career site https://www.twitch.tv/jobs/en/ About the Role Platforms & Services is responsible for the central services and systems that empower both Twitch users directly as well as the product engineers across Twitch who build experiences for them. You will be part of a team of data scientists who focus on providing deep product and user insights that drive engineering roadmaps, priorities, and investments. You will partner closely with product managers, engineering leaders, and engineers to build deep product expertise and will become a critical voice in the development and delivery of some of Twitch’s most critical central services. You can work in San Francisco, CA; Irvine, CA; New York, NY; or Seattle, WA. About Us: Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day. We’re about community, inside and out. You’ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We’re on a quest to empower live communities, so if this sounds good to you, see what we’re up to on LinkedIn and X, and discover the projects we’re solving on our Blog. Be sure to explore our Interviewing Guide to learn how to ace our interview process. You Will - Collaborate with product, engineering, and operations teams to design durable systems that support all of Twitch - Tackle ambiguous, high-impact problems by defining analytical approaches grounded in statistics, computer science, and deep domain expertise—driving clarity, innovation, and durable solutions at scale - Become a key thought partner in shaping builder experiences, providing data-backed insights to support higher-quality and more efficient experiences for builders across Twitch - Foster a culture of analytical rigor, clear communication, and shared accountability for impact across cross-functional teams. - Maintain a customer-centric focus while being a domain and product expert through data, develop trust amongst peers and stakeholders, and ensure that the teams and programs are empowered and enabled to take data-driven actions - Prioritize and execute in the face of ambiguity, work with stakeholders and mentors to distill the problem, adapt tools to answer complicated questions, and identify the trade-offs between speed and quality of different approaches - Create analytical frameworks to measure team success by partnering with cross-functional teams to define success metrics, create approaches to track the data and troubleshoot errors, quantify and evaluate the data to develop a common language for all colleagues to understand these metrics and KPIs - Operationalize data processes in order to provide stakeholders with ad-hoc analysis, automated dashboards, and self-service reporting tools so that everyone gets a good sense of the state of the business Perks - Medical, Dental, Vision & Disability Insurance - 401(k) - Maternity & Parental Leave - Flexible PTO - Amazon Employee Discount
Applied Scientist, India Machine Learning
IN, KA, Bengaluru
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and team for India Consumer Businesses. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation - Mentor other scientists and engineers in the use of ML techniques About the team The India Machine Learning team works closely with the business and engineering teams in building ML solutions that create an impact for Amazon's IN businesses. This is a great opportunity to leverage your machine learning and data mining skills to create a direct impact on consumers and end users.
Sr. Applied Scientist, Amazon AI at Work
US, WA, Seattle
We are looking for a Senior Applied Scientist who will lead the technical vision and innovation in revolutionizing how product managers, program managers, and business analysts work with artificial intelligence. You will be part of the Amazon AI at Work (AIW) team building the next generation of AI agents that transform how business professionals operate and reshape the future of hybrid (AI + human) work. As a Senior Applied Scientist, you are a recognized technical leader who drives the scientific strategy, mentors team members, and partners with cross-functional teams to deliver complex end-to-end AI solutions. Your work focuses on identifying and framing new research challenges in ambiguous problem areas where both the business problem and solution approach need to be defined. The problems you tackle require significant scientific innovation at the product level. Key job responsibilities • Design and architect complex AI agent systems for business and product management workflows at scale • Define and lead research initiatives in human-AI collaboration frameworks across multiple teams • Drive end-to-end delivery of novel AI solutions from inception to production, ensuring system-level technical requirements are met • Lead technical discovery and innovation through rapid experimentation while maintaining high standards • Mentor junior scientists and influence adoption of scientific best practices across teams • Author technical documentation and research papers that advance the field of AI agents The ideal candidate combines deep technical expertise with strong business acumen and thrives in ambiguous, fast-paced environments. You should be passionate about creating AI solutions that enhance human capabilities and comfortable working in a startup-like atmosphere while maintaining high standards for responsible AI development. A day in the life You take ownership of the long-term scientific vision, product roadmaps, and technologies, defining how they should evolve. You build consensus through thoughtful discussions with stakeholders, engineers, and scientist peers across multiple teams. You bring deep expertise to provide context for current and future technology choices and make strategic recommendations on modeling approaches and system architecture to achieve transformative business outcomes and user experiences. About the team As part of the AWS Applied AI Solutions organization, we have a vision to provide business applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are no-brainers to buy and easy to use. Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Applied Scientist II, Amazon AI at Work
US, WA, Seattle
We are looking for an Applied Scientist who is passionate about revolutionizing how product managers, program managers, and business analysts work with artificial intelligence. You will be part of the Amazon AI at Work (AIW) team building the next generation of AI agents that transform how business professionals operate and reshape the future of hybrid (AI + human) work. As an Applied Scientist, you are recognized for your expertise, advise team members on a range of machine learning topics, and work closely with software engineers to drive the delivery of end-to-end agentic AI solutions. Your work focuses on ambiguous problem areas where the business problem or opportunity may not yet be defined. The problems that you take on require scientific breakthroughs. You take a long-term view of the business objectives, product roadmaps, technologies, and how they should evolve. You drive mindful discussions with stakeholders, engineers, and scientist peers. You bring perspective and provide context for current technology choices and make recommendations on the right modeling and component design approach to achieve the desired business outcome and user experience. Key job responsibilities • Design and develop AI agents specifically tailored for business and product management workflows. • Create novel frameworks for automating and enhancing workplace tasks. • Lead cross-team projects to bring solutions from research to production. • Drive innovation in business process automation and decision support systems. • Communicate and document your research via publishing papers in external scientific venues. About the team As part of the AWS Applied AI Solutions organization, we have a vision to provide business applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are no-brainers to buy and easy to use. Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Applied Scientist, AGI Foundational Modeling - Speech
US, CA, Sunnyvale
Our mission is to create a best-in-class Conversational AI that is intuitive, intelligent, and responsive, by developing superior Large Language Models (LLM) solutions and services which increase the capabilities built into the model and which enable utilizing thousands of APIs and external knowledge sources to provide the best experience for each request across millions of customers and endpoints. We are looking for a passionate, talented, and resourceful Applied Scientist in the field of LLM, Artificial Intelligence (AI), Natural Language Processing (NLP), Recommender Systems and/or Information Retrieval, to invent and build scalable solutions for a state-of-the-art context-aware conversational AI. A successful candidate will have strong machine learning background and a desire to push the envelope in one or more of the above areas. The ideal candidate would also have hands-on experiences in building Generative AI solutions with LLMs, enjoy operating in dynamic environments, be self-motivated to take on challenging problems to deliver big customer impact, moving fast to ship solutions and then iterating on user feedback and interactions. Key job responsibilities As an Senior Applied Scientist, you will leverage your technical expertise and experience to collaborate with other talented applied scientists and engineers to research and develop novel algorithms and modeling techniques to reduce friction and enable natural and contextual conversations. You will analyze, understand and improve user experiences by leveraging Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in artificial intelligence. You will work on core LLM technologies, including Supervised Fine-Tuning (SFT), In-Context Learning (ICL), Learning from Human Feedback (LHF), etc. Your work will directly impact our customers in the form of novel products and services .
Survey Research Scientist, Strategy and Insights, Reputation Marketing and Insights
US, VA, Arlington
As a Survey Research Scientist within the Reputation Marketing & Insights team, your primary responsibility will be to help manage our employee communications research program, including a global tracking survey. The work will challenge you to be resourceful, think big while staying connected to the details, translate survey, focus group results, and advanced analytics into strategic direction, and embrace a high degree of change and ambiguity at speed. The scope and scale of what we strive to achieve is immense, but it is also meaningful and energizing. This is an individual contributor role. The right candidate possesses endless curiosity and passion for understanding employee perceptions and what drives them. You have end-to-end experience conducting qualitative research, robust large-scale surveys, campaign measurement, as well as advanced modeling skills to uncover perception drivers. You have proficiency in diving deep into large amounts of data and translating research into actionable insights/recommendations for internal communicators. You are an excellent writer who can effectively communicate data-driven insights and recommendations through written documents, presentations, and other internal communication channels. You are a creative problem-solver who seeks to deeply understand the business/communications so you can tailor research that informs stakeholder decision making and strategic messaging tactics. Key job responsibilities - Design and manage the execution of a global tracking survey focused on employee communications - Develop research to identify and test messages to drive employee perceptions - Use advanced statistical methodologies to better understand the relationship between key internal communications metrics and other related measures of perception (e.g., regression, structural equation modeling, latent growth curve modeling, Shapley analysis, etc.) - Develop causal and semi-causal measurement techniques to evaluate the perception impact of internal communications campaigns - Identify opportunities to simplify existing research processes and operate more nimbly - Engage in strategic discussions with internal partner teams to ensure our research generates actionable and on-point findings About the team This team sits within the CCR organization. Our focus is on conducting research that identifies messaging opportunities and informs communication strategies for Amazon as a brand.
Research Scientist, Wireless Connectivity
US, CA, Sunnyvale
Are you passionate about solving complex wireless challenges that impact millions of customers? Join Amazon's Device Connectivity team who are revolutionizing how wireless technology shapes the future of consumer electronics. As a Wireless Research Scientist, you'll be at the forefront of developing solutions that enhance the connectivity and reliability of millions of customer devices. Your expertise will drive the creation of next-generation wireless technologies, from concept to implementation, directly shaping the future of Amazon's product ecosystem. In this role, you'll tackle complex electromagnetic challenges head-on, leveraging your analytical prowess and deep understanding of wireless principles. You'll collaborate with world-class scientists and engineers, applying machine learning and statistical analysis to optimize system performance and create scalable, cost-effective solutions for mass production. Your impact will extend beyond the lab, as you transform research concepts into practical features that delight our customers. You'll influence product roadmaps, drive critical technical decisions, and play a key role in accelerating our product development lifecycle. Key job responsibilities As a Wireless research scientist, you will use your experience to initiate wireless design, development, execution and implementation of scientific research projects. Working closely with fellow hardware dev, scientists and product managers, you will use your experience in modeling, statistics, and simulation to design new hardware, customer modeling and evaluate their benefits and impacts to cost, connectivity use cases, reliability, and speed of productization Ability to work and connect concepts across various engineering fields like EMC design, desense, antenna, wireless communication and computational electromagnetics to solve complex and novel problems Experience in combinatorial optimization, algorithms, data structures, statistics, and/or machine learning that can be leveraged to develop novel wireless designs that can be integrated and mass produced on products. This position requires superior analytical thinking, and ability to apply their technical and statistical knowledge to identify opportunities for wireless/EM applications. You should be able to mine and analyze large data, and be able to use necessary programming and statistical analysis software/tools to do so. Ability to leverage ML techniques for design optimization and performance modeling that influence technology integration and productization of novel consumer products. A day in the life Invent • You invent and design new solutions for scientifically-complex problem areas and identify opportunities for invention in existing or new business initiatives. • You expertly frame the scientific approach to solve ambiguous business problems, distinguishing between those that require new solutions and those that can be addressed with existing approaches. • You focus on business and customer problems that require scientific advances at the product level. Your research solutions set a strong example for others. You work efficiently and routinely delivered the right things. • You show good judgment when making trade-offs between short- and long-term customer, business, and technology needs. • You drive your team’s scientific agenda by proposing new initiatives and securing management buy-in. • You lead the writing of internal documents or external publications when appropriate for your team and not precluded by business considerations. • Your work consistently delivers significant benefit to the business. What you deliver could be functional, such as a software system or conceptual, such as a paper that advances scientific knowledge in a specific field or convinces the business to focus on a particular strategy. Implement • You are self-directed in your daily work and require only limited guidance for confidence checks. • You define and prioritize science or engineering specifications for new approaches. • You independently assess alternative technologies or approaches to choose the right one to be used by your system or solution with little guidance. You may own the delivery of solutions for an entire business application. • You ensure accuracy in your process abstractions, models, and simulation results. • Your solutions are inventive, maintainable, scalable, extensible, accurate, and cost-effective (e.g., you know where to extend or adapt methods). • Your solutions are creative and of such a high quality that they can be handed off with minimal rework. Influence • You are a key influencer in team strategy that impacts the business. You make insightful contributions to team roadmaps, goals, priorities, and approach. • You build consensus on larger projects and factor complex efforts into independent tasks that can be performed by you and others. • You actively recruit and help others by coaching and mentoring in your organization (or at your location). • You are involved and visible in the broader scientific communities (internal or external) as a subject matter expert. For example, you may give guest lectures, review scientific work of others, serve as a Program Committee member in conferences, or serve as a reviewer for journal publications. • You contribute to the broader internal and external scientific communities. About the team Amazon Lab126 is an inventive research and development company that designs and engineers high-profile consumer electronics. Lab126 began in 2004 as a subsidiary of Amazon.com, Inc., originally creating the best-selling Kindle family of products. Since then, we have produced innovative devices like Fire tablets, Fire TV and Amazon Echo. What will you help us create?
Sr. Mgr, AS Health AI, Amazon Health Science & Analytics
US, CA, Santa Clara
Want to work on frontier, world class, AI-powered experiences for health customers and health providers? The Health Science & Analytics group in Amazon's Health Store & Technology organization is looking for a Senior Manager of Applied Science to lead a group of applied scientists and engineers to work hand in hand with physicians to build the future of AI-powered healthcare experiences. We have an ambitious roadmap which includes scaling recently launched products which are already delighting products and the opportunity to build disruptive, new experiences. This role will be responsible for leading the science and technology teams driving these key innovations on behalf of our customers. Key job responsibilities - Independently manage a team of scientists and engineers to sustainably deliver science driven products. - Define the vision and long-term technical roadmap to achieve multi-year business objectives. - Maintain and raise the science bar of the team’s deliverables and keep the broader Amazon Health Services organization apprised of the latest relevant technical developments in the field. - Work across business, clinical, and technical leaders to disambiguate product requirements and socialize progress towards key goals and deliverables. - Proactively identify risks and shape the technical roadmap in anticipation of industry trends in emerging AI subfields.
See more jobs
View from space of a connected network around planet Earth representing the Internet of Things.
Get more from Amazon Science
Subscribe to our monthly newsletter

Amazon.com | Conditions of Use | Privacy | © 1996-2025 Amazon.com, Inc. or its affiliates

Social