Abstract
We present the results of a feasibility study using shared, existing, network-accessible infrastructure for repository replication. We utilize the SMTP and NNTP protocols to replicate both the metadata and the content of a digital library, using OAI-PMH to facilitate management of the archival process. We investigate how dissemination of repository contents can be piggybacked on top of existing email and Usenet traffic. Long-term persistence of the replicated repository may be achieved thanks to current policies and procedures which ensure that email messages and news posts are retrievable for evidentiary and other legal purposes for many years after the creation date. While the preservation issues of migration and emulation are not addressed with this approach, it does provide a simple method of refreshing content with unknown partners for smaller digital repositories that do not have the administrative resources for more sophisticated solutions.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Kantor, B., Lapsley, P.: Network news transfer protocol, Internet RFC-977 (February 1986)
Postel, J.B.: Simple mail transfer protocol, Internet RFC-821 (August 1982)
20 year archive on google groups, http://www.google.com/googlegroups/archive_announce_20.html
Goldberg, A.V., Yianilos, P.N.: Towards an archival intermemory. In: Proceedings of IEEE Advances in Digital Libraries, ADL 1998, April 1998, pp. 147–156 (1998)
Clarke, I., Sandberg, O., Wiley, B., Hong, T.W.: Freenet: A distributed anonymous information storage and retrieval system. In: Federrath, H. (ed.) Designing Privacy Enhancing Technologies. LNCS, vol. 2009, p. 46. Springer, Heidelberg (2001)
Dingledine, R., Freedman, M.J., Molnar, D.: The free haven project: Distributed anonymous storage service. In: Federrath, H. (ed.) Designing Privacy Enhancing Technologies. LNCS, vol. 2009, pp. 67–95. Springer, Heidelberg (2001)
Maniatis, P., Roussopoulos, M., Giuli, T.J., Rosenthal, D.S.H., Baker, M.: The LOCKSS peer-to-peer digital preservation system. ACM Transactions on computer systems 23, 2–50 (2005)
Tridgell, A., Mackerras, P.: The rsync algorithm. Technical report, The Australian National University (1996), http://cs.anu.edu.au/techreports/1996/TR-CS-96-05.pdf
Cooper, B.F., Garcia-Molina, H.: Peer-to-peer data trading to preserve information. ACM Transactions on Information Systems 20(2), 133–170 (2002)
Back, A.: The eternity service. Phrack Magazine 7(51) (1997)
Anderson, R.J.: The eternity service. In: 1st International Conference on the Theory and Applications of Cryptology (Pragocrypt 1996), pp. 242–252 (1996)
Nelson, M.L., Van de Sompel, H., Liu, X., Harrison, T.L.: mod oai: An apache module for metadata harvesting. Technical report, Old Dominion University (2005) arXiv cs.DL/0503069
Lagoze, C., Van de Sompel, H., Nelson, M.L., Warner, S.: The Open Archives Initiative Protocol for Metadata Harvesting, http://www.openarchives.org/OAI/openarchivesprotocol.html
Bekaert, J., Hochstenbach, P., Van de Sompel, H.: Using MPEG-21 DIDL to represent complex digital objects in the Los Alamos National Laboratory digital library. D-Lib Magazine 9(11) (November 2003), doi:10.1045/november2003-bekaert
Smith, J.A., Klein, M., Nelson, M.L.: Repository replication using NNTP and SMTP. Technical report, Old Dominion University (2006) arXiv cs.DL/0606008
Bekaert, J., Liu, X., Van de Sompel, H.: Representing digital assets for long-term preservation using MPEG-21 DID. In: Ensuring Long-term Preservation and Adding Value to Scientific and Technical data, PV 2005 (2005) arXiv cs.DL/0509084
Van de Sompel, H., Nelson, M.L., Lagoze, C., Warner, S.: Resource harvesting within the OAI-PMH framework. D-Lib Magazine 10(12) (December 2004), doi:10.1045/december2004-vandesompel
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Smith, J.A., Klein, M., Nelson, M.L. (2006). Repository Replication Using NNTP and SMTP. In: Gonzalo, J., Thanos, C., Verdejo, M.F., Carrasco, R.C. (eds) Research and Advanced Technology for Digital Libraries. ECDL 2006. Lecture Notes in Computer Science, vol 4172. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11863878_5
Download citation
DOI: https://doi.org/10.1007/11863878_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44636-1
Online ISBN: 978-3-540-44638-5
eBook Packages: Computer ScienceComputer Science (R0)