Research output per year
Research output per year
Abstract
Extract-Transform-Load (ETL) processes are used for extracting data, transforming it and loading it into data
warehouses (DWs). Many tools for creating ETL processes exist. The dominating tools all use graphical user
interfaces (GUIs) where the developer visually defines the data flow and operations. In this paper, we challenge
this approach and propose to do ETL programming by writing code. To make the programming easy, we present
the (Python-based) framework pygrametl which offers commonly used functionality for ETL development.
By using the framework, the developer can efficiently create effective ETL solutions from which the full power
of programming can be exploited. Our experiments show that when pygrametl is used, both the development
time and running time are short when compared to an existing GUI-based tool
warehouses (DWs). Many tools for creating ETL processes exist. The dominating tools all use graphical user
interfaces (GUIs) where the developer visually defines the data flow and operations. In this paper, we challenge
this approach and propose to do ETL programming by writing code. To make the programming easy, we present
the (Python-based) framework pygrametl which offers commonly used functionality for ETL development.
By using the framework, the developer can efficiently create effective ETL solutions from which the full power
of programming can be exploited. Our experiments show that when pygrametl is used, both the development
time and running time are short when compared to an existing GUI-based tool
| Original language | English |
|---|
| Place of Publication | Aalborg |
|---|---|
| Publisher | Department of Computer Science, Aalborg University |
| Volume | 25 |
| Number of pages | 18 |
| Publication status | Published - 2009 |
| Series | 1DB Technical Report |
|---|---|
| Number | 25 |
Fingerprint
Dive into the research topics of 'pygrametl: A Powerful Programming Framework for Extract–Transform–Load Programmers'. Together they form a unique fingerprint.Research output
- 34 Citations
- 1 Book chapter
-
pygrametl: A Powerful Programming Framework for Easy Creation and Testing of ETL Flows
Jensen, S. K., Thomsen, C., Pedersen, T. B. & Andersen, O., 18 May 2021, Transactions on Large-Scale Data- and Knowledge-Centered Systems XLVIII: Special Issue In Memory of Univ. Prof. Dr. Roland Wagner. Springer, Vol. XLVIII. p. 45-84 40 p. (Lecture Notes in Computer Science, Vol. 12670).Research output: Contribution to book/anthology/report/conference proceeding › Book chapter › Research › peer-review
Open AccessFile3 Citations (Scopus)401 Downloads (Pure)