Abstract
Most of the semantic content available has been generated automatically by using annotation services for existing content. Automatic annotation is not of sufficient quality to enable focused search and retrieval: either too many or too few terms are semantically annotated. User-defined semantic enrichment allows for a more targeted approach. We developed a tool for semantic annotation of digital documents and conducted an end-user study to evaluate its acceptance by and usability for non-expert users. This paper presents the results of this user study and discusses the lessons learned about both the semantic enrichment process and our methodology of exposing non-experts to semantic enrichment.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Luczak-Rösch, M., Heese, R.: Linked data authoring for non-experts. In: Linked Data on the Web Workshop, World Wide Web Conference (April 2009)
Thomson Reuters Inc.: Open Calais website, http://www.opencalais.com/
Zemanta Ltd.: Zemanta (2012), http://www.zemanta.com/
Yesilada, Y., Bechhofer, S., Horan, B.: Cohse: Dynamic linking of web resources. Technical Report TR-2007-167, Sun Microsystems (August 2007)
Kalyanpur, A., Hendler, J., Parsia, B., Golbeck, J.: SMORE - semantic markup, ontology, and RDF editor. Technical Report ADA447989, Maryland University (2006)
McDowell, L., Etzioni, O., Gribble, S.D., Halevy, A., Levy, H., Pentney, W., Verma, D., Vlasseva, S.: Mangrove: Enticing Ordinary People onto the Semantic Web via Instant Gratification. In: Fensel, D., Sycara, K., Mylopoulos, J. (eds.) ISWC 2003. LNCS, vol. 2870, pp. 754–770. Springer, Heidelberg (2003)
Handschuh, S., Staab, S.: Cream: Creating metadata for the semantic web. Computer Networks 42(5), 579–598 (2003)
Booktate: Booktate website (2012), http://booktate.com/
Textensor Limited: A.nnotate (2012), http://a.nnotate.com
Olive Tree Bible Software, Inc.: Bible+ (2012), available online at http://itunes.apple.com/
Khalili, A., Auer, S.: The RDFa content editor - from WYSIWYG to WYSIWYM (2011), http://svn.aksw.org/papers/2011/ISWC_RDFaEditor/public.pdf
Morbidoni, C.: SWickyNotes Starting Guide. Net7 and Universita Politecnica delle Marche (April 2012), http://www.swickynotes.org/docs/SWickyNotesStartingGuide.pdf
Dello, K., Simperl, E.P.B., Tolksdorf, R.: Creating and using semantic web information with makna. In: First Workshop on Semantic Wikis - From Wiki to Semantics (2006)
Auer, S., Dietzold, S., Riechert, T.: OntoWiki – A Tool for Social, Semantic Collaboration. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L.M. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 736–749. Springer, Heidelberg (2006)
Schaffert, S.: Ikewiki: A semantic wiki for collaborative knowledge management. In: Workshop on Semantic Technologies in Collaborative Applications, Manchester, UK (June 2006)
Hinze, A., Voisard, A., Buchanan, G.: Tip: Personalizing information delivery in a tourist information system. J. of IT & Tourism 11(3), 247–264 (2009)
Kruk, S.R., Woroniecki, T., Gzella, A., Dabrowski, M.: JeromeDL - a semantic digital library. In: Semantic Web Challenge (2007)
faviki: faviki - tags that make sense, http://www.faviki.com
Passant, A.: MOAT-project, http://moat-project.org
Teufel, S.: Argumentative Zoning: Information Extraction from Scientific Text. PhD thesis, University of Edinburgh (1999)
Handschuh, S.: Creating Ontology-based Metadata by Annotation for the Semantic Web. Ph.D. thesis (dr. rer. pol.), University of Karlsruhe, TH (2005)
Bayerl, P.S., Lüngen, H., Gut, U., Paul, K.I.: Methodology for reliable schema development and evaluation of manual annotations. In: Workshop on Knowledge Markup and Semantic Annotation, pp. 17–23 (2003)
Erdmann, M., Maedche, A., Schnurr, H., Staab, S.: From manual to semi-automatic semantic annotation: About ontology-based text annotation tools. Group 6(i), 79–91 (2000)
Maynard, D., Dasiopoulou, S., et al.: D1.2.2.1.3 Benchmarking of annotation tools. Technical report, Knowledge Web Project (2007)
Castro, R.: Benchmarking Semantic Web technology. Studies on the Semantic Web. IOS Press (2010)
Degler, D., Henninger, S., Battle, L.: Semantic Web HCI: discussing research implications. In: Extended Abstracts on Human Factors in Computing Systems, pp. 1909–1912. ACM (2007)
Schraefel, M., Karger, D.: The pathetic fallacy of rdf. In: International Workshop on the Semantic Web and User Interaction (SWUI 2006) (2006)
Uren, V., Cimiano, P., et al.: Semantic annotation for knowledge management: Requirements and a survey of the state of the art. Web Semant. 4(1), 14–28 (2006)
Karger, D.: Unference: Ui (not ai) as key to the semantic web. Panel on Interaction Design Grand Challenges and the Semantic Web at Semantic Web User Interaction Workshop (2006), http://swui.semanticweb.org/swui06/panel/Karger.ppt
Jameson, A.: Usability and the Semantic Web. In: Sure, Y., Domingue, J. (eds.) ESWC 2006. LNCS, vol. 4011, pp. 3–3. Springer, Heidelberg (2006)
Duineveld, A.J., Stoter, R., et al.: Wondertools? a comparative study of ontological engineering tools. Journal of Human-Computer Studies 52(6), 1111–1133 (2000)
Flouris, G., Manakanatas, D., Kondylakis, H., Plexousakis, D., Antoniou, G.: Ontology change: Classification and survey. Knowl. Eng. Rev. 23(2), 117–152 (2008)
Maedche, A., Staab, S.: Ontology learning for the semantic web. IEEE Intelligent Systems 16(2), 72–79 (2001)
Jones, W., Karger, D., Bergman, O., Franklin, M., Pratt, W., Bates, M.: Towards a Unification & Integration of PIM support. Technical report, University of Washington (2005)
Furst, F., Kuntz, P., Trichet, F.: Conceptual and Lexical Prototypicality Gradients Dedicated to Ontology Personalisation. In: Meersman, R., Tari, Z. (eds.) OTM 2008, Part II. LNCS, vol. 5332, pp. 1423–1439. Springer, Heidelberg (2008)
Hogben, G., Wilikens, M., Vakalis, I.: On the Ontology of Digital Identification. In: Meersman, R. (ed.) OTM Workshops 2003. LNCS, vol. 2889, pp. 579–593. Springer, Heidelberg (2003)
Handschuh, S., Staab, S.: Authoring and annotation of web pages in cream. In: WWW, pp. 462–473 (2002)
Heese, R., Luczak-Rösch, M., Paschke, A., Oldakowski, R., Streibel, O.: One click annotation. In: Workshop on Scripting and Development for the Semantic Web (May 2010)
Degler, D.: Design 10:5:2 for semantic applications. In: Semantic Technology Conference (2011), http://www.designforsemanticweb.com/
Snyder, C.: Paper prototyping: The fast and easy way to design and refine user interfaces. Morgan Kaufmann Pub. (2003)
IBM: User expectations (2012), http://www-01.ibm.com/software/ucd/initial/expectations.html
Schlegel, A., Heese, R., Hinze, A.: Visualisation of semantic enrichment. In: Interaction and Visualisation in the Data Web, Workshop at Informatik 2012 (2012)
Hinze, A., Heese, R., Schlegel, A., Luczak-Rösch, M.: User-Defined Semantic Enrichment of Full-Text Documents: Experiences and Lessons Learned. In: Zaphiris, P., Buchanan, G., Rasmussen, E., Loizides, F. (eds.) TPDL 2012. LNCS, vol. 7489, pp. 209–214. Springer, Heidelberg (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hinze, A., Heese, R., Luczak-Rösch, M., Paschke, A. (2012). Semantic Enrichment by Non-experts: Usability of Manual Annotation Tools. In: Cudré-Mauroux, P., et al. The Semantic Web – ISWC 2012. ISWC 2012. Lecture Notes in Computer Science, vol 7649. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35176-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-35176-1_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35175-4
Online ISBN: 978-3-642-35176-1
eBook Packages: Computer ScienceComputer Science (R0)