Automated Topical Component Extraction Using Neural Network Attention Scores from Source-based Essay Scoring

Haoran Zhang, Diane Litman

Abstract Paper Share

NLP Applications Short Paper

Session 14B: Jul 8 (18:00-19:00 GMT)
Session 15B: Jul 8 (21:00-22:00 GMT)
Abstract: While automated essay scoring (AES) can reliably grade essays at scale, automated writing evaluation (AWE) additionally provides formative feedback to guide essay revision. However, a neural AES typically does not provide useful feature representations for supporting AWE. This paper presents a method for linking AWE and neural AES, by extracting Topical Components (TCs) representing evidence from a source text using the intermediate output of attention layers. We evaluate performance using a feature-based AES requiring TCs. Results show that performance is comparable whether using automatically or manually constructed TCs for 1) representing essays as rubric-based features, 2) grading essays.
You can open the pre-recorded video in a separate window.
NOTE: The SlidesLive video may display a random order of the authors. The correct author list is shown at the top of this webpage.

Similar Papers

LinggleWrite: a Coaching System for Essay Writing
Chung-Ting Tsai, Jhih-Jie Chen, Ching-Yu Yang, Jason S. Chang,
A representative figure from paper demo.139