Machine social intelligence in Virtualhome

Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, September, 2020 === Cataloged from student-submitted PDF version of thesis. === Includes bibliographical references (pages 49-53). === This thesis introduces a Watch-And-Help (WAH) challen...

Full description

Bibliographic Details
Main Author: Li, Shuang,S.M.Massachusetts Institute of Technology.
Other Authors: Antonio Torralba.
Format: Others
Language:English
Published: Massachusetts Institute of Technology 2021
Subjects:
Online Access:https://hdl.handle.net/1721.1/129367
Description
Summary:Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, September, 2020 === Cataloged from student-submitted PDF version of thesis. === Includes bibliographical references (pages 49-53). === This thesis introduces a Watch-And-Help (WAH) challenge and a multi-agent environment for testing social intelligence in multiple agents. In the challenge, an AI agent needs to help a human-like agent perform a complex household task efficiently. To succeed, the AI agent needs to i) understand the underlying goal of the task by watching a single demonstration of the human-like agent performing the same task (social perception), and ii) coordinate with the human-like agent to solve the task in an unseen environment as fast as possible (human-AI collaboration). For this challenge, we build VirtualHome-Social, a multi-agent household environment, and provide a benchmark including both planning and learning based baselines. Experimental results demonstrate that in order to achieve success in the challenge, an AI agent has to accurately understand and predict the human-like agent's behaviors, and adapt its collaborative plan accordingly in novel environments. === by Shuang Li. === S.M. === S.M. Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science