The ScottyBot team hails from Carnegie Mellon University (CMU), and is a joint venture between the Language Technologies and Robotics Institutes.
The CMU School of Computer Science (SCS) is considered to be one of the leading centers of artificial intelligence research in the world, with numerous federal grants, affiliated research institutes, degree programs, and awards in the areas of robotics, language technologies, and human-machine interaction.
Jonathan F. — Team leader
Jonathan is a PhD Candidate in the Language Technologies Institute at CMU and a Research Scientist at Bosch Research. His research focuses on harnessing domain knowledge for multimodal representation learning, in robotics and autonomous driving. As a former researcher in a major U.S. defense contractor and research committee member for various U.S. Department of Energy programs in distributed sensing and control, he brings over a decade's worth of experience in institutional research and advanced development from public, private, and academic sectors. Jonathan holds Bachelor's and Master's degrees in Electrical & Computer Engineering from Carnegie Mellon.
Ye Won (Emily) B.
Emily is a first year PhD student at CMU’s Robotics Institute advised by Professor Jean Oh. Emily's current research interests are in areas of multimodal machine learning and vision-language planning. Previously, Emily pursued research in unsupervised learning and physical scene understanding during my undergrad at Brown, where I double majored in Computer Science and Physics.
So Yeon (Tiffany) M.
Tiffany is a second year PhD student in CMU's Machine Learning Department, advised by Yonatan Bisk and Ruslan Salakhutdinov. Tiffany's research builds towards neuro-symbolic AI for embodied control. Tiffany's research interests include : (1) combinatorial reasoning with multimodal and dynamic inputs (e.g. reasoning with common sense), (2) symbolic reasoning (e.g. following certain rules at deployment without training), (3) visual/ spatial uncertainty quantification (e.g. novelty detection), and (4) building world models with language.
Benjamin is a Ph.D. student in the Computer Science Department at Carnegie Mellon University. His research currently focuses on social robot navigation for autonomous aircraft, as well as lifelong learning and task similarity algorithms. Prior to starting his Ph.D., Benjamin received his master’s in computer science from the University of Michigan, and worked as a staff researcher at a U.S. Department of Defense affiliated center. Benjamin has also previously worked on operating systems research, in symbolic execution and automated bug finding, and leverages this to better build and test complex systems.
Jimin is a Master’s student in Language Technologies at Carnegie Mellon University, advised by Professor Jean Oh. Jimin's research interests are in natural language processing, especially language grounding and language pragmatics. Jimin is interested in modeling contextual information for tasks such as machine translation or visual-language navigation. Prior to joining CMU, Jimin was a research intern at Kakao Enterprise, South Korea, where Jimin worked on adapting machine translation systems to specific domains such as chat and medical domains. Previously, Jimin received a Bachelor’s degree in Psychology and Master’s degree in Industrial Engineering from Seoul National University.
Hao is a third-year doctoral student at Language Technologies Institute, Carnegie Mellon University. Hao is fortunately advised by Graham Neubig and Yonatan Bisk. Before joining CMU, IHao enjoyed four fantastic undergrad years at Tsinghua University. Hao's ultimate goal is to understand human intelligence. Believing in Feynman's famous quote, "What I cannot create, I do not understand", Hao is working on teaching Machine Learning models to gain human intelligence. More specifically, Hao is currently interested in teaching machines to speak human language, as well as to do human-level logical reasoning. I also have broad interests in other cognitive science fields.
Yonatan Bisk — Faculty advisor
Yonatan Bisk is an assistant professor in the Languages Technology Institute at CMU. His work broadly falls into uncovering the latent structures of natural language; modeling the semantics of the physical world; and connecting language to perception and control.