On the Spontaneous Emergence of Discrete and Compositional Signals
Nur Geffen Lan, Emmanuel Chemla, Shane Steinert-Threlkeld
Interpretability and Analysis of Models for NLP Short Paper
Session 9A: Jul 7
(17:00-18:00 GMT)
Session 10B: Jul 7
(21:00-22:00 GMT)
Abstract:
We propose a general framework to study language emergence through signaling games with neural agents. Using a continuous latent space, we are able to (i) train using backpropagation, (ii) show that discrete messages nonetheless naturally emerge. We explore whether categorical perception effects follow and show that the messages are not compositional.
You can open the
pre-recorded video
in a separate window.
NOTE: The SlidesLive video may display a random order of the authors.
The correct author list is shown at the top of this webpage.
Similar Papers
Benefits of Intermediate Annotations in Reading Comprehension
Dheeru Dua, Sameer Singh, Matt Gardner,
Inducing Grammar from Long Short-Term Memory Networks by Shapley Decomposition
Yuhui Zhang, Allen Nie,
Learning to Deceive with Attention-Based Explanations
Danish Pruthi, Mansi Gupta, Bhuwan Dhingra, Graham Neubig, Zachary C. Lipton,
Obtaining Faithful Interpretations from Compositional Neural Networks
Sanjay Subramanian, Ben Bogin, Nitish Gupta, Tomer Wolfson, Sameer Singh, Jonathan Berant, Matt Gardner,
