pygrametl: A Powerful Programming Framework for Extract–Transform–Load Programmers

Publikation: Bog/antologi/afhandling/rapportRapport

28 Citationer (Scopus)
5389 Downloads (Pure)

Abstrakt

    Extract-Transform-Load (ETL) processes are used for extracting data, transforming it and loading it into data
warehouses (DWs). Many tools for creating ETL processes exist. The dominating tools all use graphical user
interfaces (GUIs) where the developer visually defines the data flow and operations. In this paper, we challenge
this approach and propose to do ETL programming by writing code. To make the programming easy, we present
the (Python-based) framework pygrametl which offers commonly used functionality for ETL development.
By using the framework, the developer can efficiently create effective ETL solutions from which the full power
of programming can be exploited. Our experiments show that when pygrametl is used, both the development
time and running time are short when compared to an existing GUI-based tool
OriginalsprogEngelsk
Udgivelses stedAalborg
ForlagDepartment of Computer Science, Aalborg University
Vol/bind25
Antal sider18
StatusUdgivet - 2009
Navn1DB Technical Report
Nummer25

Fingeraftryk Dyk ned i forskningsemnerne om 'pygrametl: A Powerful Programming Framework for Extract–Transform–Load Programmers'. Sammen danner de et unikt fingeraftryk.

  • Citationsformater

    Thomsen, C., & Pedersen, T. B. (2009). pygrametl: A Powerful Programming Framework for Extract–Transform–Load Programmers. Department of Computer Science, Aalborg University. 1DB Technical Report, Nr. 25