Abstract
Thanks to the recent introduction of peer-to-peer communication between browsers with WebRTC, real time processing of streams can now be deployed on browsers in addition to traditional server-side execution environments. In this paper we present the Web Liquid Streams framework for building and executing stream processing topologies capable of gathering data from Web-enabled sensors and process it through JavaScript operators scattered across a peer-to-peer Cloud of computing peers. i) support for arbitrary topologies and data streams, ii) deployment on heterogeneous Web-enabled devices, iii) transparent stream delivery across the WebRTC, WebSockets and ZeroMQ protocols, iv) stateful and stateless operators. WLS takes care of the deployment of the topology on the available resources, while users are only required to implement the operators and describe the topology graph using JSON. The structure of the topology can be dynamically adapted without stopping the stream flowing through it. We present the platform and its programming interface, showing a first evaluation of the system.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Storm: distributed and fault-tolerant realtime computation (2011). http://storm-project.net/
Akidau, T., et al.: Millwheel: Fault-tolerant stream processing at internet scale. Proc. VLDB Endow. 6(11), 1033–1044 (2013)
Arasu, A., et al: Linear road: a stream data management benchmark. In: Proc. of the Thirteenth International Conference on Very Large Data Bases, VLDB 2004, vol. 30, pp. 480–491. VLDB Endowment (2004)
Babaoglu, O., et al: Design and implementation of a p2p cloud system. In: Proc. of SAC 2012
Babaoglu, O., Jelasity, M., Kermarrec, A.-M., Montresor, A., van Steen, M.: Managing clouds: A case for a fresh look at large unreliable dynamic networks. SIGOPS Oper. Syst. Rev. 40(3), 9–13 (2006)
Babazadeh, M., Gallidabino, A., Pautasso, C.: Liquid stream processing across web browsers and web servers. In: Cimiano, P., Frasincar, F., Houben, G.-J., Schwabe, D. (eds.) ICWE 2015. LNCS, vol. 9114, pp. 24–33. Springer, Heidelberg (2015)
Babazadeh, M., Pautasso, C.: A RESTful API for controlling dynamic streaming topologies. In: 5th International Workshop on Web APIs and RESTful Design (WS-REST 2014), Seoul, Korea, April 2014
Cugola, G., Margara, A.: Processing flows of information: From data stream to complex event processing. ACM Comput. Surv. 44(3), 15:1–15:62 (2012)
Guinard, D.: A Web of Things Application Architecture - Integrating the Real-World into the Web. PhD thesis, ETH Zurich, Zurich, Switzerland, August 2011
Jelasity, M., Montresor, A., Babaoglu, O.: Gossip-based aggregation in large dynamic networks. ACM Trans. Comput. Syst. 23(3), 219–252 (2005)
Kakkad, V., Attar, S., Santosa, A.E., Fekete, A., Scholz, B.: Curracurrong: a stream programming environment for wireless sensor networks. Softw. Pract. Exper. 44(2), 175–199 (2014)
Kakkad, V., et al: Curracurrong cloud: Stream processing in the cloud. In: Proc. of ICDEW, pp. 207–214, March 2014
Kovatsch, M.: CoAP for the web of things: from tiny resource-constrained devices to the web browser. In: Adj. Proc. of UbiComp, pp. 1495–1504 (2013)
Rodríguez, P., et al: Advanced videoconferencing services based on WebRTC. In: Proc. of ICWBC, pp. 180–184, July 2012
Vogt, C., et al: Content-centric user networks: WebRTC as a path to name-based publishing. In: Proc. of ICNP, October 2013
Vogt, C., Werner, M.J., Schmidt, T.C.: Leveraging webRTC for P2P content distribution in web browsers. In: Proc. of ICNP, October 2013
Zaharia, M., et al: Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters. In: Proc. of USENIX HotCloud 2012
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 IFIP International Federation for Information Processing
About this paper
Cite this paper
Babazadeh, M., Gallidabino, A., Pautasso, C. (2015). Decentralized Stream Processing Over Web-Enabled Devices. In: Dustdar, S., Leymann, F., Villari, M. (eds) Service Oriented and Cloud Computing. ESOCC 2015. Lecture Notes in Computer Science(), vol 9306. Springer, Cham. https://doi.org/10.1007/978-3-319-24072-5_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-24072-5_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24071-8
Online ISBN: 978-3-319-24072-5
eBook Packages: Computer ScienceComputer Science (R0)