CraftAssist Instruction Parsing: Semantic Parsing for a Voxel-World Assistant
Kavya Srinet, Yacine Jernite, Jonathan Gray, Arthur Szlam
Dialogue and Interactive Systems Long Paper
Session 9A: Jul 7
(17:00-18:00 GMT)
Session 10A: Jul 7
(20:00-21:00 GMT)
Abstract:
We propose a semantic parsing dataset focused on instruction-driven communication with an agent in the game Minecraft. The dataset consists of 7K human utterances and their corresponding parses. Given proper world state, the parses can be interpreted and executed in game. We report the performance of baseline models, and analyze their successes and failures.
You can open the
pre-recorded video
in a separate window.
NOTE: The SlidesLive video may display a random order of the authors.
The correct author list is shown at the top of this webpage.
Similar Papers
Learning to execute instructions in a Minecraft dialogue
Prashant Jayannavar, Anjali Narayan-Chen, Julia Hockenmaier,
Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedback
Ahmed Elgohary, Saghar Hosseini, Ahmed Hassan Awadallah,
Image-Chat: Engaging Grounded Conversations
Kurt Shuster, Samuel Humeau, Antoine Bordes, Jason Weston,
Refer360°: A Referring Expression Recognition Dataset in 360° Images
Volkan Cirik, Taylor Berg-Kirkpatrick, Louis-Philippe Morency,
