Dynamic Allocation and Efficient Distribution of Data Among Multiple Clouds Using Network Coding

Marton A. Sipos, Frank Fitzek, Daniel Enrique Lucani Roetter, Morten Videbæk Pedersen

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

3 Citations (Scopus)

Abstract

Distributed storage has attracted large interest lately from both industry and researchers as a flexible, cost-efficient, high performance, and potentially secure solution for geographically distributed data centers, edge caching or sharing storage among users. This paper studies the benefits of random linear network coding to exploit multiple commercially available cloud storage providers simultaneously with the possibility to constantly adapt to changing cloud performance in order to optimize data retrieval times. The main contribution of this paper is a new data distribution mechanisms that cleverly stores and moves data among different clouds in order to optimize performance. Furthermore, we investigate the trade-offs among storage space, reliability and data retrieval speed for our proposed scheme. By means of real-world implementation and measurements using well-known and publicly accessible cloud service providers, we can show close to 9x less network use for the adaptation compared to more conventional dense recoding approaches, while maintaining similar download time performance and the same reliability.
Original languageEnglish
Title of host publicationCloud Networking (CloudNet), 2014 IEEE 3rd International Conference on
PublisherIEEE
Publication date2014
Pages90 - 95
ISBN (Print)978-1-4799-2730-2
DOIs
Publication statusPublished - 2014
EventThird IEEE International Conference on Cloud Networking - , Luxembourg
Duration: 8 Oct 2014 → …

Conference

ConferenceThird IEEE International Conference on Cloud Networking
CountryLuxembourg
Period08/10/2014 → …
SeriesIEEE International Conference on Cloud Networking

Fingerprint

Network coding
Linear networks
Costs
Industry

Cite this

Sipos, M. A., Fitzek, F., Roetter, D. E. L., & Pedersen, M. V. (2014). Dynamic Allocation and Efficient Distribution of Data Among Multiple Clouds Using Network Coding. In Cloud Networking (CloudNet), 2014 IEEE 3rd International Conference on (pp. 90 - 95). IEEE. IEEE International Conference on Cloud Networking https://doi.org/10.1109/CloudNet.2014.6968974
Sipos, Marton A. ; Fitzek, Frank ; Roetter, Daniel Enrique Lucani ; Pedersen, Morten Videbæk. / Dynamic Allocation and Efficient Distribution of Data Among Multiple Clouds Using Network Coding. Cloud Networking (CloudNet), 2014 IEEE 3rd International Conference on. IEEE, 2014. pp. 90 - 95 (IEEE International Conference on Cloud Networking).
@inproceedings{e75a8f1c6acd4a3da8a8fb5b5361112f,
title = "Dynamic Allocation and Efficient Distribution of Data Among Multiple Clouds Using Network Coding",
abstract = "Distributed storage has attracted large interest lately from both industry and researchers as a flexible, cost-efficient, high performance, and potentially secure solution for geographically distributed data centers, edge caching or sharing storage among users. This paper studies the benefits of random linear network coding to exploit multiple commercially available cloud storage providers simultaneously with the possibility to constantly adapt to changing cloud performance in order to optimize data retrieval times. The main contribution of this paper is a new data distribution mechanisms that cleverly stores and moves data among different clouds in order to optimize performance. Furthermore, we investigate the trade-offs among storage space, reliability and data retrieval speed for our proposed scheme. By means of real-world implementation and measurements using well-known and publicly accessible cloud service providers, we can show close to 9x less network use for the adaptation compared to more conventional dense recoding approaches, while maintaining similar download time performance and the same reliability.",
author = "Sipos, {Marton A.} and Frank Fitzek and Roetter, {Daniel Enrique Lucani} and Pedersen, {Morten Videb{\ae}k}",
year = "2014",
doi = "10.1109/CloudNet.2014.6968974",
language = "English",
isbn = "978-1-4799-2730-2",
pages = "90 -- 95",
booktitle = "Cloud Networking (CloudNet), 2014 IEEE 3rd International Conference on",
publisher = "IEEE",
address = "United States",

}

Sipos, MA, Fitzek, F, Roetter, DEL & Pedersen, MV 2014, Dynamic Allocation and Efficient Distribution of Data Among Multiple Clouds Using Network Coding. in Cloud Networking (CloudNet), 2014 IEEE 3rd International Conference on. IEEE, IEEE International Conference on Cloud Networking, pp. 90 - 95, Third IEEE International Conference on Cloud Networking, Luxembourg, 08/10/2014. https://doi.org/10.1109/CloudNet.2014.6968974

Dynamic Allocation and Efficient Distribution of Data Among Multiple Clouds Using Network Coding. / Sipos, Marton A.; Fitzek, Frank; Roetter, Daniel Enrique Lucani; Pedersen, Morten Videbæk.

Cloud Networking (CloudNet), 2014 IEEE 3rd International Conference on. IEEE, 2014. p. 90 - 95.

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

TY - GEN

T1 - Dynamic Allocation and Efficient Distribution of Data Among Multiple Clouds Using Network Coding

AU - Sipos, Marton A.

AU - Fitzek, Frank

AU - Roetter, Daniel Enrique Lucani

AU - Pedersen, Morten Videbæk

PY - 2014

Y1 - 2014

N2 - Distributed storage has attracted large interest lately from both industry and researchers as a flexible, cost-efficient, high performance, and potentially secure solution for geographically distributed data centers, edge caching or sharing storage among users. This paper studies the benefits of random linear network coding to exploit multiple commercially available cloud storage providers simultaneously with the possibility to constantly adapt to changing cloud performance in order to optimize data retrieval times. The main contribution of this paper is a new data distribution mechanisms that cleverly stores and moves data among different clouds in order to optimize performance. Furthermore, we investigate the trade-offs among storage space, reliability and data retrieval speed for our proposed scheme. By means of real-world implementation and measurements using well-known and publicly accessible cloud service providers, we can show close to 9x less network use for the adaptation compared to more conventional dense recoding approaches, while maintaining similar download time performance and the same reliability.

AB - Distributed storage has attracted large interest lately from both industry and researchers as a flexible, cost-efficient, high performance, and potentially secure solution for geographically distributed data centers, edge caching or sharing storage among users. This paper studies the benefits of random linear network coding to exploit multiple commercially available cloud storage providers simultaneously with the possibility to constantly adapt to changing cloud performance in order to optimize data retrieval times. The main contribution of this paper is a new data distribution mechanisms that cleverly stores and moves data among different clouds in order to optimize performance. Furthermore, we investigate the trade-offs among storage space, reliability and data retrieval speed for our proposed scheme. By means of real-world implementation and measurements using well-known and publicly accessible cloud service providers, we can show close to 9x less network use for the adaptation compared to more conventional dense recoding approaches, while maintaining similar download time performance and the same reliability.

U2 - 10.1109/CloudNet.2014.6968974

DO - 10.1109/CloudNet.2014.6968974

M3 - Article in proceeding

SN - 978-1-4799-2730-2

SP - 90

EP - 95

BT - Cloud Networking (CloudNet), 2014 IEEE 3rd International Conference on

PB - IEEE

ER -

Sipos MA, Fitzek F, Roetter DEL, Pedersen MV. Dynamic Allocation and Efficient Distribution of Data Among Multiple Clouds Using Network Coding. In Cloud Networking (CloudNet), 2014 IEEE 3rd International Conference on. IEEE. 2014. p. 90 - 95. (IEEE International Conference on Cloud Networking). https://doi.org/10.1109/CloudNet.2014.6968974