CloudSense: Continuous Fine-Grain Cloud Monitoring with Compressive Sensing

DSpace/Manakin Repository

CloudSense: Continuous Fine-Grain Cloud Monitoring with Compressive Sensing

Citable link to this page

. . . . . .

Title: CloudSense: Continuous Fine-Grain Cloud Monitoring with Compressive Sensing
Author: Kung, H.T. T.; Lin, Chit-Kwan; Vlah, Dario

Note: Order does not necessarily reflect citation order of authors.

Citation: Kung, H.T., Chit-Kwan Lin, and Dario Vlah. 2011. CloudSense: Continuous fine-grain cloud monitoring with compressive sensing. In proceedings of 3rd USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 2011), Portland, OR, June 14-15.
Full Text & Related Files:
Abstract: Continuous fine-grain status monitoring of a cloud data center enables rapid response to anomalies, but handling the resulting torrent of data poses a significant challenge. As a solution, we propose CloudSense, a new switch design that performs in-network compression of status streams via compressive sensing. Using MapReduce straggler detection as an example of cloud monitoring, we give evidence that CloudSense allows earlier detection of stragglers, since finer-grain status can be reported for a given bandwidth budget. Furthermore, CloudSense showcases the advantage of an intrinsic property of compressive sensing decoding that enables detection of the slowest stragglers first. Finally, CloudSense achieves in-network compression via a low-complexity encoding scheme, which is easy and convenient to implement in a switch. We envision that CloudSense switches could form the foundation of a "compressed status information plane" that is useful for monitoring not only the cloud data center itself, but also the user applications that it hosts.
Published Version: http://static.usenix.org/event/hotcloud11/tech/final_files/Kung.pdf
Other Sources: http://www.eecs.harvard.edu/~htk/publication/2011-hotcloud-kung-lin-vlah.pdf
Terms of Use: This article is made available under the terms and conditions applicable to Open Access Policy Articles, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#OAP
Citable link to this page: http://nrs.harvard.edu/urn-3:HUL.InstRepos:9972706

Show full Dublin Core record

This item appears in the following Collection(s)

  • FAS Scholarly Articles [7105]
    Peer reviewed scholarly articles from the Faculty of Arts and Sciences of Harvard University
 
 

Search DASH


Advanced Search
 
 

Submitters