Resumé
version management of facts and implements four different methods for handling deleted facts. The framework enables, e.g., data scientists, to program complete and complex ETL solutions very efficiently with only few lines of code, which is demonstrated with a real-world example.
| Originalsprog | Engelsk |
|---|---|
| Titel | Proceedings of the 20th International Workshop on Design, Optimization, Languages and Analytical Processing of Big Data co-located with 10th EDBT/ICDT Joint Conference |
| Antal sider | 6 |
| Vol/bind | 2062 |
| Forlag | CEUR Workshop Proceedings |
| Publikationsdato | 1 jan. 2018 |
| Status | Udgivet - 1 jan. 2018 |
| Begivenhed | 20th International Workshop on Design, Optimization, Languages and Analytical Processing of Big Data co-located with 10th EDBT/ICDT Joint Conference - TU Wien's Faculty of Electrical Engineering, Wien, Østrig Varighed: 26 mar. 2018 → 29 mar. 2018 Konferencens nummer: 20 http://www.cs.put.poznan.pl/events/DOLAP2018.html |
Konference
| Konference | 20th International Workshop on Design, Optimization, Languages and Analytical Processing of Big Data co-located with 10th EDBT/ICDT Joint Conference |
|---|---|
| Nummer | 20 |
| Lokation | TU Wien's Faculty of Electrical Engineering |
| Land | Østrig |
| By | Wien |
| Periode | 26/03/2018 → 29/03/2018 |
| Internetadresse |
| Navn | CEUR Workshop Proceedings |
|---|---|
| Vol/bind | 2062 |
| ISSN | 1613-0073 |
Citer dette
}
SimpleETL : ETL Processing by Simple Specifications. / Andersen, Ove; Thomsen, Christian; Torp, Kristian.
Proceedings of the 20th International Workshop on Design, Optimization, Languages and Analytical Processing of Big Data co-located with 10th EDBT/ICDT Joint Conference. Bind 2062 CEUR Workshop Proceedings, 2018. (CEUR Workshop Proceedings, Bind 2062).Publikation: Bidrag til bog/antologi/rapport/konference proceeding › Konferenceartikel i proceeding › Forskning › peer review
TY - GEN
T1 - SimpleETL
T2 - ETL Processing by Simple Specifications
AU - Andersen, Ove
AU - Thomsen, Christian
AU - Torp, Kristian
PY - 2018/1/1
Y1 - 2018/1/1
N2 - Massive quantities of data are today collected from many sources. However, it is often labor-intensive to handle and integrate these data sources into a data warehouse. Further, the complexity is increased when specific requirements exist. One such new requirement, is the right to be forgotten where an organization upon request must delete all data about an individual. Another requirement is when facts are updated retrospectively. In this paper, we present the general framework SimpleETL which is currently used for Extract-Transform-Load (ETL) processing in a company with such requirements. SimpleETL automatically handles all database interactions such as creating fact tables, dimensions, and foreign keys. The framework also has features for handlingversion management of facts and implements four different methods for handling deleted facts. The framework enables, e.g., data scientists, to program complete and complex ETL solutions very efficiently with only few lines of code, which is demonstrated with a real-world example.
AB - Massive quantities of data are today collected from many sources. However, it is often labor-intensive to handle and integrate these data sources into a data warehouse. Further, the complexity is increased when specific requirements exist. One such new requirement, is the right to be forgotten where an organization upon request must delete all data about an individual. Another requirement is when facts are updated retrospectively. In this paper, we present the general framework SimpleETL which is currently used for Extract-Transform-Load (ETL) processing in a company with such requirements. SimpleETL automatically handles all database interactions such as creating fact tables, dimensions, and foreign keys. The framework also has features for handlingversion management of facts and implements four different methods for handling deleted facts. The framework enables, e.g., data scientists, to program complete and complex ETL solutions very efficiently with only few lines of code, which is demonstrated with a real-world example.
UR - http://www.scopus.com/inward/record.url?scp=85044296032&partnerID=8YFLogxK
M3 - Article in proceeding
VL - 2062
T3 - CEUR Workshop Proceedings
BT - Proceedings of the 20th International Workshop on Design, Optimization, Languages and Analytical Processing of Big Data co-located with 10th EDBT/ICDT Joint Conference
PB - CEUR Workshop Proceedings
ER -