Skip to main content
SpringerLink
Log in

Linked Data and multimedia: the state of affairs

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Linked Data is a way of exposing and sharing data as resources on the Web and interlinking them with semantically related resources. In the last three years significant amounts of data have been generated, increasingly forming a globally connected, distributed data space. For multimedia content, metadata are a key factor for efficient management, organization, and retrieval. However, the relationship between multimedia and Linked Data has been rarely studied, leading to a lack of mutual awareness and, as a consequence thereof, technological deficiencies. This article introduces the basic concepts of Linked Data in the context of multimedia metadata, and discusses techniques to generate, expose, discover, and consume Linked Data. It shows that a large amount of data sources exist, which are ready to be exploited by multimedia applications. The benefit of Linked Data in two multimedia-related applications is discussed and open research issues are outlined with the goal of bringing the research fields of multimedia and Linked Data closer together in order to facilitate mutual benefit.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. Wikipedia: http://www.wikipedia.org

  2. WordNet: http://wordnet.princeton.edu

  3. Internet Movie Data Base: http://www.imdb.com

  4. The RDF standard also contains the concept of blank nodes, i.e., resources that are not assigned a URI. However, since these resources cannot be dereferenced using HTTP they are less relevant in the context of Linked Data.

  5. Notation3 (http://www.w3.org/DesignIssues/Notation3.html) is not a “real” serialization format because it encodes only a superset of the RDF data model.

  6. N-Triples: http://www.w3.org/2001/sw/RDFCore/ntriples/

  7. Pubby: http://www4.wiwiss.fu-berlin.de/pubby/

  8. Paget: http://code.google.com/p/paget/

  9. Talis Platform: http://www.talis.com/platform/

  10. In this case it is not required to materialize the complete source dataset into RDF because parts of it can be transformed upon request.

  11. Lists are maintained at http://esw.w3.org/topic/ConverterToRdf and http://simile.mit.edu/wiki/RDFizers.

  12. Aperture: http://aperture.sourceforge.net/

  13. Listed at http://www.w3.org/2005/Incubator/mmsem/wiki/Tools_and_Resources.

  14. Cf. http://esw.w3.org/topic/TaskForces/CommunityProjects/LinkingOpenData/DataSets/Statistics

  15. Video Vocabulary: http://digitalbazaar.com/media/video

  16. W3C Exif Vocabulary: http://www.w3.org/2003/12/exif/

  17. We use Turtle syntax [9] for representing RDF examples.

  18. DBpedia Lookup: http://lookup.dbpedia.org/

  19. Faceted Wikipedia Search: http://dbpedia.neofonie.de/browse/

  20. Henry: http://dbtune.org/henry/

  21. W3C WGS84 vocabulary: http://www.w3.org/2003/01/geo/

  22. FOAF: http://www.foaf-project.org

  23. Open Link LOD Cloud Cache: http://lod.openlinksw.com/sparql

  24. RKBExplorer: http://void.rkbexplorer.com/sparql/

  25. OpenLink Data Explorer: http://ode.openlinksw.com/

  26. ZitGist DataViewer: http://dataviewer.zitgist.com/

  27. Marbles: http://www5.wiwiss.fu-berlin.de/marbles/

  28. RDFLib: http://www.rdflib.net

  29. SemWeb: http://razor.occams.info/code/semweb/

  30. List of SPARQL implementations: http://esw.w3.org/SparqlImplementations

  31. Annozilla: http://annozilla.mozdev.org

  32. W3C Media Fragments Group: http://www.w3.org/2008/WebVideo/Fragments/

  33. W3C Media Annotations Group: http://www.w3.org/2008/WebVideo/Annotations/

  34. NEPOMUK Project: http://nepomuk.semanticdesktop.org

  35. Nepomuk-KDE: http://nepomuk.kde.org

  36. OSCAF Ontologies: http://sourceforge.net/apps/trac/oscaf/wiki/Ontologies

  37. Gwenview: http://gwenview.sourceforge.net

  38. Bangarang: http://bangarangkde.wordpress.com

  39. An initial draft of the OAC model is available at http://www.openannotation.org/documents/OAC-Model_UseCases-alpha.pdf.

References

  1. Adida B, Birbeck M, McCarron S, Pemberton S (2008) RDFa in XHTML: syntax and processing. World Wide Web Consortium. Available at http://www.w3.org/TR/rdfa-syntax/

  2. Agosti M, Ferro N, Frommholz I, Thiel U (2004) Annotations in digital libraries and collaboratories—facets, models and usage. In: Heery R, Lyon L (eds) ECDL. Lecture notes in computer science, vol 3232. Springer, pp 244–255

  3. Alexander K, Cyganiak R, Hausenblas M, Zhao J (2009) Describing linked datasets—on the design and usage of void, the ‘vocabulary of interlinked datasets’. In: Proceedings of the 2nd international workshop on Linked Data on the Web (LDOW). Madrid, Spain

  4. Anderson O, Berjon R, Dahlström E, Emmons A, Ferraiolo J, Grasso A, Hardy V, Hayman S, Jackson D, Lilley C, McCormack C, Neumann A, Northway C, Quint A, Ramani N, Schepers D, Shellshear A (2008) Scalable Vector Graphics (SVG) tiny 1.2 specification (W3C recommendation 22 December 2008). World Wide Web Consortium. Available at http://www.w3.org/TR/SVGTiny12/

  5. Arndt R, Troncy R, Staab S, Hardman L, Vacura M (2008) COMM: designing a well-founded multimedia ontology for the Web. In: Aberer K, Choi KS, Noy N, Allemang D, Lee KI, Nixon L, Golbeck J, Mika P, Maynard D, Mizoguchi R, Schreiber G, Cudré-Mauroux P (eds) The Semantic Web: ISWC 2007 + ASWC 2007. Lecture notes in computer science, vol 4825. Springer, Berlin, pp 30–43. doi:10.1007/978-3-540-76298-0_3

    Google Scholar 

  6. Auer S, Dietzold S, Lehmann J, Hellmann S, Aumueller D (2009) Triplify—light-weight Linked Data publication from relational databases. In: Proc. of 18th international World Wide Web conference

  7. Auer S, Lehmann J, Hellmann S (2009) LinkedGeoData—adding a spatial dimension to the Web of Data. In: Proc. of 7th international Semantic Web conference (ISWC)

  8. Becker C, Bizer C (2008) DBpedia Mobile: a location-enabled Linked Data browser. In: Linked Data on the Web workshop 2008, CEUR-WS, vol 369. Beijing, China

  9. Beckett D, Berners-Lee T (2008) Turtle—terse RDF triple language (W3C team submission 14 January 2008). World Wide Web Consortium, http://www.w3.org/TeamSubmission/turtle/, retrieved 8 August 2008

  10. Berners-Lee T (2006) Linked Data. World Wide Web Consortium. Available at http://www.w3.org/DesignIssues/LinkedData.html, retrieved 8 August 2008

  11. Berners-Lee T, Chen Y, Chilton L, Connolly D, Dhanaraj R, Hollenbach J, Lerer A, Sheets D (2006) Tabulator: exploring and analyzing Linked Data on the Semantic Web. In: Proceedings of the 3rd international Semantic Web user interaction workshop (SWUI’06). Athens, GA, USA

  12. Berruta D, Phipps J (2008) Best practice recipes for publishing RDF vocabularies. W3C Semantic Web deployment working group. Available at: http://www.w3.org/TR/swbp-vocab-pub/

  13. Bizer C, Cyganiak R (2006) D2R server—publishing relational databases on the Semantic Web. In: 5th international Semantic Web conference

  14. Bizer C, Cyganiak R, Heath T (2007) How to publish Linked Data on the Web. URL: http://www4.wiwiss.fu-berlin.de/bizer/pub/LinkedDataTutorial

  15. Bizer C, Heath T, Berners-Lee T (2009) Linked Data—the story so far. Int J Semantic Web Inf Syst 5(3):1–22. doi:10.4018/jswis.2009081901

    Google Scholar 

  16. Bizer C, Lehmann J, Kobilarov G, Auer S, Becker C, Cyganiak R, Hellmann S (2009) DBpedia—a crystallization point for the Web of Data. J Web Sem 7(3):154–165

    Article  Google Scholar 

  17. Boardman R, Spence R, Sasse MA (2003) Too many hierarchies? The daily struggle for control of the workspace. In: Proceedings of HCI international 2003, vol 1, pp 616–620

  18. Bürger T, Hausenblas M (2008) Interlinking multimedia—principles and requirements. In: First international workshop on interacting with multimedia content on the social Semantic Web, co-located with SAMT 2008, 3–5 December 2008

  19. Bürger T, Hausenblas M (2010) Metadata standards and ontologies for multimedia content. In: Handbook of metadata, semantics and ontologies (to be published). World Scientific, Singapore

    Google Scholar 

  20. Bush V (1945) As we may think. Atl Mon 176(1):101–108. URL http://www.ps.uni-sb.de/~duchier/pub/vbush/

    Google Scholar 

  21. Carroll J, Dickinson I, Dollin C, Reynolds D, Seaborne A, Wilkinson K (2004) Jena: implementing the Semantic Web recommendations. In: Proceedings of the 13th international World Wide Web conference on alternate track papers and posters (WWW’04). New York, NY, USA

  22. Cheng G, Ge W, Qu Y (2008) Falcons: searching and browsing entities on the Semantic Web. In: Proceedings of the 17th international conference on World Wide Web (WWW’09). Beijing, China

  23. Corlosquet S, Delbru R, Clark T, Polleres A, Decker S (2009) Produce and consume Linked Data with Drupal! In: Proceedings of the 8th international Semantic Web conference (ISWC 2009)

  24. Cyganiak R, Jentzsch A (2009) The linking open data dataset cloud. URL http://richard.cyganiak.de/2007/10/lod/

  25. d’Aquin M, Baldassarre C, Gridinoc L, Angeletou S, Sabou M, Motta E (2007) Characterizing knowledge on the Semantic Web with Watson. In: Proceedings of 5th international EON workshop (EON2007) at the 6th international Semantic Web conference. Busan, Korea

  26. Erling O, Mikhailov I (2007) RDF support in the virtuoso DBMS. In: CSSW, pp 59–68

  27. Fielding RT (2000) Architectural styles and the design of network-based software architectures. PhD thesis, University of California, Irvine. URL http://www.ics.uci.edu/~fielding/pubs/dissertation/top.htm

  28. Frisse ME (1987) Searching for information in a hypertext medical handbook. In: Hypertext’87 proceedings, 13–15 November 1987. Chapel Hill, North Carolina, USA. ACM, pp 57–66

    Google Scholar 

  29. Gruber T (1993) A translation approach to portable ontology specifications. Knowl Acquis 5(2):199–220

    Article  Google Scholar 

  30. Han L, Finin T, Parr C, Sachs J, Joshi A (2008) RDF123: from spreadsheets to RDF. In: 7th international Semantic Web conference (ISWC2008)

  31. Harth A, Hogan A, Delbru R, Umbrich J, Decker S (2007) SWSE: answers before links. In: Semantic Web challenge at 6th international Semantic Web conference. Busan, Korea

  32. Hartig O, Bizer C, Freytag JC (2009) Executing SPARQL queries over the Web of Linked Data. In: Proceedings of the 8th international Semantic Web conference (ISWC’09). Washington, DC, USA

  33. Haslhofer B, Schandl B (2008) The OAI2LOD server: exposing OAI-PMH metadata as Linked Data. In: International workshop on Linked Data on the Web (LDOW2008). Beijing, China

  34. Haslhofer B, Jochum W, King R, Sadilek C, Schellner K (2009) The LEMO annotation framework: weaving multimedia annotations with the Web. Int J Digit Libr 10(1):15–32

    Article  Google Scholar 

  35. Haslhofer B, Momeni Roochi E, Gay M, Simon R (2010) Augmenting Europeana content with Linked Data resources. In: Linked Data triplification challenge, co-located with I-Semantics 2010. Graz, Austria

  36. Hassanzadeh O, Consens M (2009) Linked movie data base. In: Proceedings of the 2nd international workshop on Linked Data on the Web (LDOW). Madrid, Spain

  37. Hausenblas M, Bailer W, Bürger T, Troncy R (2007) ramm.x: deploying multimedia metadata on the Semantic Web. In: Proceedings of SAMT 2007, December 4–7. Genova, Italy

  38. Hausenblas M, Troncy R, Raimond Y, Bürger T (2009) Interlinking multimedia: how to apply Linked Data principles to multimedia fragments. In: Proceedings of the 2nd international workshop on Linked Data on the Web (LDOW). Madrid, Spain

  39. Hunter J (2009) Collaborative semantic tagging and annotation systems. In: Cronin B (ed) Annual review of information science and technology, vol 43, chap 2. American Society for Information Science & Technology

  40. ISO/IEC (2006) Multimedia framework (MPEG-21)—part 17: fragment identification of MPEG resources. International Organization for Standardization, Geneva, Switzerland

  41. Jacobs I, Walsh N (2004) Architecture of the World Wide Web, vol 1. URL http://www.w3.org/TR/webarch/

  42. Kahan J, Koivunen MR (2001) Annotea: an open RDF infrastructure for shared Web annotations. In: WWW ’01: proceedings of the 10th international conference on World Wide Web. ACM Press, New York, pp 623–632

    Chapter  Google Scholar 

  43. Kobilarov G, Scott T, Raimond Y, Oliver S, Sizemore C, Smethurst M, Bizer C, Lee R (2009) Media meets Semantic Web—how the BBC uses DBpedia and Linked Data to make connections. In: Proceedings of the 6th European Semantic Web conference. Springer, Berlin, pp 723–737

    Google Scholar 

  44. Langegger A, Wöß W (2009) XLWrap—querying and integrating arbitrary spreadsheets with SPARQL. In: Proceedings of the 8th international Semantic Web conference (ISWC 2009). Springer

  45. Langegger A, WößW, Blöchl M (2008) A Semantic Web middleware for virtual data integration on the Web. In: Proceedings of the European Semantic Web conference 2008. Tenerife

  46. Lee W, Bürger T, Sasaki F, Malaise V, Stegmaier F, Söderberg J (2009) Ontology for media resource 1.0. W3C working draft, 18 June 2009

  47. LODr—a linking open data tagging system. In: Workshop on social data on the Web (SDoW2008), vol 405. CEUR-WS.org

  48. Marshall CC (2000) The future of annotation in a digital (paper) world. In: Harum S, Twidale M (eds) Successes and failures of digital libraries. University of Illinois, Urbana-Champaign, pp 97–117

    Google Scholar 

  49. Marshall CC, Brush BAJ (2004) Exploring the relationship between personal and public annotations. In: JCDL ’04: proceedings of the 4th ACM/IEEE-CS joint conference on digital libraries. ACM Press, New York, pp 349–357

    Google Scholar 

  50. Network Working Group (NWG) (2005) RFC3986—uniform resource identifier (URI): generic syntax. URL http://www.gbiv.com/protocols/uri/rfc/rfc3986.html

  51. Ovsiannikov IA, Arbib MA, McNeill TH (1999) Annotation technology. Int J Hum-Comput Stud 50(4):329–362

    Article  Google Scholar 

  52. Raimond Y, Sandler MB (2008) A Web of musical information. In: Bello JP, Chew E, Turnbull D (eds) ISMIR, pp 263–268

  53. Richardson L, Ruby S (2007) RESTful Web services. O’Reilly Media Inc

  54. Rodríguez JB, Corcho O, Gómez-Pérez A (2004) R2O, an extensible and semantically based database-to-ontology mapping language. In: Proceedings of the 2nd workshop on Semantic Web and databases (SWDB2004)

  55. Saathoff C, Scherp A (2009) M3O: the multimedia metadata ontology. In: Proceedings of the workshop on semantic multimedia database technologies (SeMuDaTe 2009)

  56. Sack H, Baumann B, Groß A, Meinel C (2009) Linking tele-TASK video protal to the Semantic Web. In: Proceeding of the 9th international conference on innovative community systems (IICS), June 15–17. Jena, Germany

  57. Sauermann L, Cyganiak R (2008) Cool URIs for the Semantic Web. W3C Semantic Web activity. Available at: http://www.w3.org/TR/cooluris/

  58. Sauermann L, Bernardi A, Dengel A (2005) Overview and outlook on the semantic desktop. In: Proceedings of the 1st semantic desktop workshop, CEUR workshop proceedings, Galway, Ireland, vol 175

  59. Schandl B, Popitsch N (2010) Lifting file systems into the Linked Data cloud with TripFS. In: Proceedings of the 3rd international workshop on Linked Data on the Web (LDOW2010). Raleigh, North Carolina, USA

    Google Scholar 

  60. Scharffe F, Euzenat J (2009) Alignments for data interlinking: analysed systems. http://melinda.inrialpes.fr/systems.html

  61. Schroeter R, Hunter J (2007) Annotating relationships between multiple mixed-media digital objects by extending annotea. In: Proceedings of the 4th European Semantic Web conference, ESWC 2007

  62. Sheth A, Klas W (1998) Multimedia data management: using metadata to integrate and apply digital media. Mcgraw-Hill Education, New York

    Google Scholar 

  63. Simon R, Sadilek C, Korb J, Baldauf M, Haslhofer B (2010) Tag clouds and old maps: annotations as linked spatiotemporal data in the cultural heritage domain. In: Workshop on linked spatiotemporal data 2010, held in conjunction with the 6th international conference on geographic information systems (GIScience 2010). Zurich, Switzerland

    Google Scholar 

  64. Stegmaier F, Bailer W, Bürger T, Döller M, Höffernig M, Lee W, Malaise V, Poppe C, Troncy R, Kosch H, de Walle RV (2009) How to align media metadata schemas? Design and implementation of the media ontology. In: Proceedings of the workshop on semantic multimedia database technologies (SeMuDaTe 2009)

  65. Tummarello G, Delbru R, Oren E (2007) Sindice.com: weaving the open Linked Data. In: Proceedings of the 6th international the Semantic Web and 2nd Asian conference on Asian Semantic Web conference. Busan, Korea

  66. Volz J, Bizer C, Gaedke M, Kobilarov G (2009) Silk—A link discovery framework for the Web of Data. In: Proceedings of the 2nd international workshop on Linked Data on the Web (LDOW). Madrid, Spain

  67. W3C (2003) XPointer framework. Available at: http://www.w3.org/TR/xptr-framework/

  68. W3C (2004) RDF vocabulary description language 1.0: RDF schema. W3C Semantic Web activity—RDF core working group. Available at: http://www.w3.org/TR/rdf-schema/

  69. W3C (2004) RDF/XML syntax specification (revised). W3C Semantic Web activity—RDF core working group. Available at: http://www.w3.org/TR/2004/REC-rdf-syntax-grammar-20040210/

  70. W3C (2004) Resource Description Framework (RDF). W3C Semantic Web activity—RDF core working group, URL http://www.w3.org/RDF/

  71. W3C (2008) SPARQL query language for RDF. W3C Semantic Web activity—RDF Data Access working group, URL http://www.w3.org/TR/rdf-sparql-query/

  72. W3C (2009) OWL 2Web ontology language. W3C Semantic Web activity—OWL working group, URL http://www.w3.org/TR/owl2-overview/

  73. W3C Media Fragments Working Group (2009) Media fragments URI 1.0. W3C working draft. Available at: http://www.w3.org/TR/media-frags/

  74. W3C Semantic Web Deployment Group (2009) SKOS simple knowledge organization system reference. URL http://www.w3.org/TR/2009/REC-skos-reference-20090818/

Download references

Acknowledgements

Parts of this work have been funded by FIT-IT grant 815133 from the Austrian Federal Ministry of Transport, Innovation, and Technology, and the EU eContentPlus project EuropeanaConnect.

Author information

Authors and Affiliations

  1. Department of Distributed and Multimedia Systems, University of Vienna, Liebiggasse 4/3-4, 1010, Wien, Austria

    Bernhard Schandl & Bernhard Haslhofer

  2. Salzburg Research Forschungsgesellschaft mbH, Jakob Haringer-Straße 5/3, 5020, Salzburg, Austria

    Tobias Bürger

  3. Institute for Application-Oriented Knowledge Processing, Johann Kepler University Linz, Altenberger Straße 69, 4040, Linz, Austria

    Andreas Langegger

  4. DIGITAL—Institute for Information and Communication Technologies, JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, 8010, Graz, Austria

    Wolfgang Halb

Authors
  1. Bernhard Schandl
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bernhard Haslhofer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tobias Bürger
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andreas Langegger
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wolfgang Halb
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bernhard Schandl.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Schandl, B., Haslhofer, B., Bürger, T. et al. Linked Data and multimedia: the state of affairs. Multimed Tools Appl 59, 523–556 (2012). https://doi.org/10.1007/s11042-011-0762-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0762-9

Keywords

Search

Navigation