Efficient Search for Multi-Scale Time Delay Correlations in Big Time Series

Nguyen Thi Thao Ho*, Torben Bach Pedersen, Long Van Ho, Mai Vu

*Corresponding author

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

41 Downloads (Pure)

Abstract

Very large time series are increasingly available from an ever wider range of IoT-enabled sensors deployed in different environments. Significant insights and values can be obtained from these time series through performing cross-domain analyses, one of which is analyzing time delay temporal correlations across different datasets. Most existing works in this area are either limited in the type of detected relations, e.g., linear relations alone, only working with a fixed temporal scale, or not considering time delay between time series. This paper presents our Time delaY COrrelation Search (TYCOS) approach which provides a powerful and robust solution with the following features: (1) TYCOS is based on the concept of mutual information (MI) from information theory, giving it a strong theoretical foundation to detect all types of relations including non-linear ones, (2) TYCOS is able to discover time delay correlations at multiple temporal scales, (3) TYCOS works in an efficient, bottom-up fashion, pruning non-interesting time intervals from the search by employing a novel MI-based theory, and (4) TYCOS is designed to efficiently minimize computational redundancy. A comprehensive experimental evaluation using synthetic and real-world datasets from the energy and smart city domains shows that TYCOS is able to find significant time delay correlations across different time intervals among big time series. The performance evaluation shows that TYCOS can scale to large datasets, and achieve an average speedup of 2 to 3 orders of magnitude compared to the baselines by using the proposed optimizations.
Original languageEnglish
Title of host publicationProceedings - The 23rd International Conference on Extending Database Technology (EDBT), March 30-April 2, 2020
PublisherAssociation for Computing Machinery
ISBN (Electronic)978-3-89318-083-7
Publication statusAccepted/In press - 2020

    Fingerprint

Keywords

  • time delay
  • temporal correlation
  • mutual information
  • hill climbing

Cite this

Ho, N. T. T., Pedersen, T. B., Ho, L. V., & Vu, M. (Accepted/In press). Efficient Search for Multi-Scale Time Delay Correlations in Big Time Series. In Proceedings - The 23rd International Conference on Extending Database Technology (EDBT), March 30-April 2, 2020 Association for Computing Machinery.