Abstract
This paper describes the operational characteristics of “CompTorrent”, a general purpose distributed computing platform that provides a low entry cost to creating new distributed computing projects. An algorithm is embedded into a metadata file along with data set details which are then published on the Internet. Potential nodes discover and download metadata files for projects they wish to participate in, extract the algorithm and data set descriptors, and join other participants in maintaining a swarm. This swarm then cooperatively shares the raw data set in pieces between nodes and applies the algorithm to produce a computed data set. This computed data set is also shared and distributed amongst participating nodes. CompTorrent allows a simple, “home-brewed” solution for small or individual distributed computing projects. Testing and experimentation have shown CompTorrent to be an effective system that provides similar benefits for distributed computing to those BitTorrent provides for large file distribution.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Larson, S.M., Snow, D.C., Shirts, M., Pande, V.S.: Folding@Home and Genome@Home: Using distributed computing to tackle previously intractable problems in computational biology. In: Grant, R. (ed.) Horizon Press Modern Methods in Computational Biology (2003)
Hayes, B.: Collective Wisdom. American Scientist 86(2), 118–122 (1998)
Anderson, D., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: SETI@home: An Experiment in Public-Resource Computing. Communications of the ACM 45(11), 56–61 (2002)
Cohen, B.: Incentives Build Robustness in BitTorrent. In: Workshop on Economics of Peer-to-peer Systems, Berkeley, CA, USA (June 2003)
Atkinson, A., Malhotra, V.: Coalescing idle Workstations as a Multiprocessor System using JavaSpace and Java WebStart. In: Proceedings of the 8th IASTED International Conference on Internet and Multimedia Systems and Applications, Kauai, Hawaii, USA, pp. 233–238 (2004)
Andreson, D.P.: BOINC: A System for Public-Resource Computing and Storage. In: 5th IEEE/ACM International Workshop on Grid Computing, Pittsburgh, USA (2004)
GPU: a Global Processing Unit Web page, http://gpu.sourceforge.net/ (accessed January 25, 2007)
Bharambe, A., Herley, C., Padmanabhan, V.N.: Analyzing and Improving BitTorrent Performance. Tech. Rep. MSR-TR-2005-03, Microsoft Research (February 2005)
Ritter, J.: Why Gnutella Can’t Scale. No Really, http://www.darkridge.com/~jpr5/doc/gnutella.html (accessed April 11, 2006)
Transcode Processing, http://www.transcoding.org/ (accessed January 25, 2007)
Piatek, M., Isdal, T., Anderson, T., Krishnamurthy, A., Venkataramani, A.: Do incentives build robustness in BitTorrent? To appear in the 4th USENIX Symposium on Networked Systems Design and Implementation (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Goldsmith, B. (2010). Enabling Grassroots Distributed Computing with CompTorrent. In: Joseph, S.R.H., Despotovic, Z., Moro, G., Bergamaschi, S. (eds) Agents and Peer-to-Peer Computing. AP2PC 2007. Lecture Notes in Computer Science(), vol 5319. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11368-0_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-11368-0_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-11367-3
Online ISBN: 978-3-642-11368-0
eBook Packages: Computer ScienceComputer Science (R0)