Skip to main navigation Skip to search Skip to main content

Building the Dresden Web Table Corpus: A Classification Approach

  • Julian Eberius
  • , Katrin Braunschweig
  • , Markus Hentsch
  • , Maik Thiele
  • , Ahmad Ahmadov
  • , Wolfgang Lehner

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

Abstract

In recent years, researchers have recognized relational tables on the Web as an important source of information. To assist this research we developed the Dresden Web Tables Corpus (DWTC), a collection of about 125 million data tables extracted from the Common Crawl (CC) which contains 3.6 billion web pages and is 266TB in size. As the vast majority of HTML tables are used for layout purposes and only a small share contains genuine tables with different surface forms, accurate table detection is essential for building a large-scale Web table corpus. Furthermore, correctly recognizing the table structure (e.g. horizontal listings, matrices) is important in order to understand the role of each table cell, distinguishing between label and data cells. In this paper, we present an extensive table layout classification that enables us to identify the main layout categories of Web tables with very high precision. We therefore identify and develop a plethora of table features, different feature selection techniques and several classification algorithms. We evaluate the effectiveness of the selected features and compare the performance of various state-of-the-art classification algorithms. Finally, the winning approach is employed to classify millions of tables resulting in the Dresden Web Table Corpus (DWTC).

Original languageEnglish
Title of host publicationProceedings - 2015 2nd IEEE/ACM International Symposium on Big Data Computing, BDC 2015
EditorsRajkumar Buyya, Ioan Raicu, Omer Rana
Number of pages10
PublisherIEEE Signal Processing Society
Publication date11 Feb 2016
Pages41-50
Article number7406328
ISBN (Electronic)9780769556963
DOIs
Publication statusPublished - 11 Feb 2016
Externally publishedYes
Event2nd IEEE/ACM International Symposium on Big Data Computing, BDC 2015 - Limassol, Cyprus
Duration: 7 Dec 2015 → 10 Dec 2015

Conference

Conference2nd IEEE/ACM International Symposium on Big Data Computing, BDC 2015
Country/TerritoryCyprus
CityLimassol
Period07/12/2015 → 10/12/2015
SponsorAssociation for Computing Machinery (ACM), IEEE Computer Society
SeriesProceedings - 2015 2nd IEEE/ACM International Symposium on Big Data Computing, BDC 2015

Bibliographical note

Publisher Copyright:
© 2015 ACM.

Keywords

  • Data preprocessing
  • Machine learning
  • Web mining

Fingerprint

Dive into the research topics of 'Building the Dresden Web Table Corpus: A Classification Approach'. Together they form a unique fingerprint.

Cite this