T3: Reviewing Natural Language Processing Research

Kevin Cohen, Karen Fort, Margot Mieskes and Aurelie Neveol

Live Session: Jul 5 (17:30-21:00 GMT)
Abstract: This tutorial will cover the theory and practice of reviewing research in natural language processing. Heavy reviewing burdens on natural language processing researchers have made it clear that our community needs to increase the size of our pool of potential reviewers. Simultaneously, notable false negatives--rejection by our conferences of work that was later shown to be tremendously important after acceptance by other conferences--have raised awareness of the fact that our reviewing practices leave something to be desired. We do not often talk about false positives with respect to conference papers, but leaders in the field have noted that we seem to have a publication bias towards papers that report high performance, with perhaps not much else of interest in them. It need not be this way. Reviewing is a learnable skill, and you will learn it here via lectures and a considerable amount of hands-on practice.

Information about the virtual format of this tutorial: This tutorial has a prerecorded talk on this page (see below) that you can watch anytime during the conference. It also has a live session that will be conducted on Zoom and will be livestreamed on this page. Additionally, it has a chat window that you can use to have discussions with the tutorial teachers and other attendees anytime during the conference.

Live Session