TY - GEN
T1 - Efficient Bottom-Up Discovery of Multi-Scale Time Series Correlations Using Mutual Information
AU - Ho, Thi Thao Nguyen
AU - Pedersen, Torben Bach
AU - Vu, Mai
AU - Van, Ho Long
AU - Biscio, Christophe Ange Napoléon
PY - 2019/4/8
Y1 - 2019/4/8
N2 - Recent developments in computing and IoT technology have enabled the daily generation of enormous amounts of time series data. These time series have to be analyzed to create value. A fundamental type of analysis is to find temporal correlations between given sets of time series. To provide a robust method for solving this problem, several properties are desirable. First, the method should have a strong theoretical foundation. Second, since temporal correlations can occur at different temporal scales, e.g., sub-second versus weekly, it is important that the method is capable of discovering multitemporal scale correlations. Finally, the method should be efficient and scalable. This paper presents an approach to search for synchronous correlations in big time series that displays all three properties: the proposed method (i) utilizes the metric of mutual information from information theory, providing a strong theoretical foundation, (ii) is able to discover correlations at multiple temporal scales, and (iii) works in an efficient, bottom-up fashion, making it scalable to large datasets. Our experiments verify that the proposed approach can identify various types of correlation relations across multiple temporal scales, while achieving a performance of an order of magnitude faster than the state-of-the-art techniques.
AB - Recent developments in computing and IoT technology have enabled the daily generation of enormous amounts of time series data. These time series have to be analyzed to create value. A fundamental type of analysis is to find temporal correlations between given sets of time series. To provide a robust method for solving this problem, several properties are desirable. First, the method should have a strong theoretical foundation. Second, since temporal correlations can occur at different temporal scales, e.g., sub-second versus weekly, it is important that the method is capable of discovering multitemporal scale correlations. Finally, the method should be efficient and scalable. This paper presents an approach to search for synchronous correlations in big time series that displays all three properties: the proposed method (i) utilizes the metric of mutual information from information theory, providing a strong theoretical foundation, (ii) is able to discover correlations at multiple temporal scales, and (iii) works in an efficient, bottom-up fashion, making it scalable to large datasets. Our experiments verify that the proposed approach can identify various types of correlation relations across multiple temporal scales, while achieving a performance of an order of magnitude faster than the state-of-the-art techniques.
KW - Hill climbing
KW - Mutual information
KW - Sliding window
KW - Temporal correlation
UR - http://www.scopus.com/inward/record.url?scp=85068016582&partnerID=8YFLogxK
U2 - 10.1109/ICDE.2019.00185
DO - 10.1109/ICDE.2019.00185
M3 - Article in proceeding
T3 - Proceedings of the International Conference on Data Engineering
SP - 1734
EP - 1737
BT - Proceedings - 2019 IEEE 35th International Conference on Data Engineering, ICDE 2019
PB - IEEE (Institute of Electrical and Electronics Engineers)
T2 - The 35th IEEE International Conference on Data Engineering (ICDE)
Y2 - 8 April 2019 through 12 April 2019
ER -