Evaluating DHT-Based Service Placement for Stream Based Overlays

DSpace/Manakin Repository

Evaluating DHT-Based Service Placement for Stream Based Overlays

Citable link to this page


Title: Evaluating DHT-Based Service Placement for Stream Based Overlays
Author: Roussopoulos, Mema; Seltzer, Margo; Welsh, Matt; Ledlie, Jonathan; Shneidman, Jeffrey; Pietzuch, Peter

Note: Order does not necessarily reflect citation order of authors.

Citation: Pietzuch, Peter, Jeffrey Shneidman, Jonathan Ledlie, Matt Welsh, Margo Seltzer, and Mema Roussopoulos. 2005. Evaluating DHT-based service placement for stream based overlays. Proceedings of the 4th International Workshop on Peer to Peer Systems (IPTPS’05), Ithaca, NY, February 24-25, 2005. Berlin: Springer Verlang. Published in Lecture Notes in Computer Science 3640: 275-286.
Full Text & Related Files:
Abstract: Stream-based overlay networks (SBONs) are one approach to implementing large-scale stream processing systems. A fundamental consideration in an SBON is that of service placement, which determines the physical location of in-network processing services or operators, in such a way that network resources are used efficiently. Service placement consists of two components: node discovery, which selects a candidate
set of nodes on which services might be placed, and node selection, which chooses the particular node to host a service. By viewing the placement problem as the composition of these two processes we can trade-off quality and efficiency between them. A bad discovery scheme can yield a good placement, but at the cost of an expensive selection mechanism.
Recent work on operator placement [3, 9] proposes to leverage routing paths in a distributed hash table (DHT) to obtain a set of candidate nodes for service placement. We evaluate the appropriateness of using DHT routing paths for service placement in an SBON, when aiming to minimize network usage. For this, we consider two DHT-based algorithms for node discovery, which use either the union or intersection of DHT routing paths in the SBON, and compare their performance to other techniques. We show that current DHT-based schemes are actually rather poor node discovery algorithms, when minimizing network utilization. An efficient DHT may not traverse enough hops to obtain a sufficiently large candidate set for placement. The union of DHT routes may result in a low-quality set of discovered nodes that requires an expensive node selection algorithm. Finally, the intersection of DHT routes relies on route convergence, which prevents the placement of services with a large fan-in.
Published Version: http://dx.doi.org/10.1007/11558989_25
Other Sources: http://www.eecs.harvard.edu/~margo/papers/
Terms of Use: This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAA
Citable link to this page: http://nrs.harvard.edu/urn-3:HUL.InstRepos:2962665
Downloads of this work:

Show full Dublin Core record

This item appears in the following Collection(s)


Search DASH

Advanced Search