Scalable Model-Based Management of Correlated Dimensional Time Series in ModelarDB+

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

5 Citations (Scopus)


To monitor critical infrastructure, high quality sensors sampled at a high frequency are increasingly used. However, as they produce huge amounts of data, only simple aggregates are stored. This removes outliers and fluctuations that could indicate problems. As a remedy, we present a model-based approach for managing time series with dimensions that exploits correlation in and among time series. Specifically, we propose compressing groups of correlated time series using an extensible set of model types within a user-defined error bound (possibly zero). We name this new category of model-based compression methods for time series Multi-Model Group Compression (MMGC). We present the first MMGC method GOLEMM and extend model types to compress time series groups. We propose primitives for users to effectively define groups for differently sized data sets, and based on these, an automated grouping method using only the time series dimensions. We propose algorithms for executing simple and multi-dimensional aggregate queries on models. Last, we implement our methods in the Time Series Management System (TSMS) ModelarDB (ModelarDB+). Our evaluation shows that compared to widely used formats, ModelarDB+ provides up to 13.7x faster ingestion due to high compression, 113x better compression due to the adaptivity of GOLEMM, 573x faster aggregates by using models, and close to linear scalability. It is also extensible and supports online query processing.
Original languageEnglish
Title of host publicationProceedings of the 37th IEEE International Conference on Data Engineering
Number of pages12
Publication date22 Apr 2021
Article number9458830
ISBN (Print)978-1-7281-9185-0
ISBN (Electronic)978-1-7281-9184-3
Publication statusPublished - 22 Apr 2021
Event37th International Conference on Data Engineering -
Duration: 19 Apr 202122 Apr 2021
Conference number: 2021


Conference37th International Conference on Data Engineering
Internet address
SeriesProceedings of the International Conference on Data Engineering


Dive into the research topics of 'Scalable Model-Based Management of Correlated Dimensional Time Series in ModelarDB+'. Together they form a unique fingerprint.

Cite this