A Real-World Data Resource of Complex Sensitive Sentences Based on Documents from the Monsanto Trial

Jan Neerbek, Morten Eskildsen, Peter Dolog, Ira Assent

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

3 Citations (Scopus)
38 Downloads (Pure)


In this work we present a corpus for the evaluation of sensitive information detection approaches that addresses the need for real world sensitive information for empirical studies. Our sentence corpus contains different notions of complex sensitive information that correspond to different aspects of concern in a current trial of the Monsanto company. This paper describes the annotations process, where we both employ human annotators and furthermore create automatically inferred labels regarding technical, legal and informal communication within and with employees of Monsanto, drawing on a classification of documents by lawyers involved in the Monsanto court case. We release corpus of high quality sentences and parse trees with these two types of labels on sentence level. We characterize the sensitive information via several representative sensitive information detection models, in particular both keyword-based (n-gram) approaches and recent deep learning models, namely, recurrent neural networks (LSTM) and recursive neural networks (RecNN). Data and code are made publicly available.
Original languageEnglish
Title of host publicationProceedings of The 12th Language Resources and Evaluation Conference, LREC 2020, Marseille, France, May 11-16, 2020
EditorsNicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asunción Moreno, Jan Odijk, Stelios Piperidis
Number of pages10
Place of PublicationMarseille, France
PublisherEuropean Language Resources Association
Publication date2020
Publication statusPublished - 2020
Event12th Language Resources and Evaluation Conference - Marseille, France
Duration: 1 May 202031 May 2020
Conference number: 12th


Conference12th Language Resources and Evaluation Conference


Dive into the research topics of 'A Real-World Data Resource of Complex Sensitive Sentences Based on Documents from the Monsanto Trial'. Together they form a unique fingerprint.

Cite this