Our vision for TaskBot is to adapt multiple new features and functionalities to make users feel more immersed and informed
The bots would provide consistent and faithful visual aid generation to guide users with demonstrations that would make the instructional steps clear. Including proactive personalization would keep user preferences and favorites in the knowledge graph that the bot will learn from all the time.
Kaizhi Zheng - Team leader
Zheng is a second-year CSE Ph.D. student at the University of California, Santa Cruz, working with Prof. Xin (Eric) Wang. He completed his M.S’ from the University of Michigan, Ann Arbor working with Prof. Chad Jenkins. His research interests focus on multi-modality understanding for robot learning. My research goal is to establish intelligent agents who can understand and interact with the environment.
Heo is a second year Ph.D. Student in Computer Science and Engineering at University of California, Santa Cruz. Her research interests are sequential data modeling, multi-modality understanding, and HCI.
Sonawane is a first year MS NLP student interested in working on conversational AI, multimodal systems, Knowledge Graph problems. He has four years of IT industry experience including in roles like Systems Engineer and Machine Learning Engineer. He has contributed to the project's architectural design, data acquisition, pre-processing, model development, unit testing (an offline testing mechanism), project deployment, and A/B testing (an online testing mechanism) aspects. In his free time he solves algorithmic questions on Leetcode.
He is a passionate NLP researcher currently pursuing graduate studies at University Of California, Santa Cruz. Previously he worked at Goldman Sachs Research & Development team on a variety of problems in the space of information retrieval and extraction from rich and densely packed financial and legal documents. He researched in this space and build intelligent systems to help distill information by incorporating deeper structured search through representation learning from knowledge graphs.
Garg is a Masters student at the University of California Santa Cruz. His interest lies in Multimodal Systems and Natural language Generation.
Xin Wang - Faculty advisor
Wang is an Assistant Professor of Computer Science and Engineering at
UC Santa Cruz. His research interests include Natural Language Processing, Computer Vision, and Machine Learning, with an emphasis on Multimodality and Embodied Agents. Xin has served as Area Chair for ACL, NAACL, EMNLP, ICLR, and Senior Program Committee (SPC) for AAAI and IJCAI. He organized multiple workshops and tutorials at CVPR, ICCV, ACL, NAACL, etc. He has received a CVPR Best Student Paper Award, a Google Faculty Research Award,and two Amazon Alexa Prize Awards, etc.