Crawling and Preprocessing Mailing Lists At Scale for Dialog Analysis

Janek Bevendorff, Khalid Al Khatib, Martin Potthast, Benno Stein

Abstract Paper Share

Resources and Evaluation Short Paper

Session 2A: Jul 6 (08:00-09:00 GMT)
Session 3A: Jul 6 (12:00-13:00 GMT)
Abstract: This paper introduces the Webis Gmane Email Corpus 2019, the largest publicly available and fully preprocessed email corpus to date. We crawled more than 153 million emails from 14,699 mailing lists and segmented them into semantically consistent components using a new neural segmentation model. With 96% accuracy on 15 classes of email segments, our model achieves state-of-the-art performance while being more efficient to train than previous ones. All data, code, and trained models are made freely available alongside the paper.
You can open the pre-recorded video in a separate window.
NOTE: The SlidesLive video may display a random order of the authors. The correct author list is shown at the top of this webpage.

Similar Papers

Smart To-Do: Automatic Generation of To-Do Items from Emails
Sudipto Mukherjee, Subhabrata Mukherjee, Marcello Hasegawa, Ahmed Hassan Awadallah, Ryen White,
A representative figure from paper main.767
A Transformer-based Approach for Source Code Summarization
Wasi Ahmad, Saikat Chakraborty, Baishakhi Ray, Kai-Wei Chang,
A representative figure from paper main.449
Embarrassingly Simple Unsupervised Aspect Extraction
Stéphan Tulkens, Andreas van Cranenburgh,
A representative figure from paper main.290
S2ORC: The Semantic Scholar Open Research Corpus
Kyle Lo, Lucy Wang, Mark Neumann, Rodney Kinney, Daniel Weld,
A representative figure from paper main.447