Crawling and Preprocessing Mailing Lists At Scale for Dialog Analysis
Janek Bevendorff, Khalid Al Khatib, Martin Potthast, Benno Stein
Resources and Evaluation Short Paper
Session 2A: Jul 6
(08:00-09:00 GMT)
Session 3A: Jul 6
(12:00-13:00 GMT)
Abstract:
This paper introduces the Webis Gmane Email Corpus 2019, the largest publicly available and fully preprocessed email corpus to date. We crawled more than 153 million emails from 14,699 mailing lists and segmented them into semantically consistent components using a new neural segmentation model. With 96% accuracy on 15 classes of email segments, our model achieves state-of-the-art performance while being more efficient to train than previous ones. All data, code, and trained models are made freely available alongside the paper.
You can open the
pre-recorded video
in a separate window.
NOTE: The SlidesLive video may display a random order of the authors.
The correct author list is shown at the top of this webpage.