Skip to main content
Top

2016 | OriginalPaper | Chapter

10. Data Fusion Across Traditional and Social Media

Authors : Werner Bailer, Gert Kienast, Georg Thallinger, Gerhard Backfried

Published in: Fusion Methodologies in Crisis Management

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Crises and disasters are covered continuously and without interruption by today’s media, especially social media. There is not a single significant occurrence within the flow of events which they do not document. Consequently, the information contained in media—especially social media like Facebook and Twitter—provides an often neglected potential which should not be overlooked. Through fusion of sources, diverse, mixed, and complementary types of information can be tapped into and combined. The difficulty of this process is to view, channel, prepare, and exploit this inhomogeneous and enormous amount of information. Automatic monitoring of traditional as well as social media sources allows to deriving risk factors and risk indicators for crises and disaster events quickly. Intelligence derived from this process allows for earlier and swifter reaction to potential situations of crisis and interrelationships. Current publicly described technical and electronic infrastructure for national and international crisis and disaster management is not able to perform comprehensive analyses of all media channels automatically. The continuous developments in the areas of multimedia and social media demand the creation of adequate methods of processing. Relevant manifestations of events are to be identified automatically from documents from traditional (TV, radio, web) as well as social media and document clusters of the examined multimedia documents are to be presented to situational awareness experts. The focus of the Quelloffene IntegrierteMultimedia Analyse (QuOIMA) project is on the research on and development of algorithms and methods to achieve this goal. Automatic analysis of content in the multimedia and social media domain forms a fundamental innovation. From a technical, social studies, and scientific point of view, the targeted insights and findings of this project, form a fundamental contribution to security research, reaching far beyond the quality of existing systems. The integration of findings regarding situational awareness will provide more realistic risk assessment increasing their possibilities to (re)act. End users extend their expertise and as a consequence the ability of the overall organizations to act.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Bailer W, Weiss W, Kienast G, Thallinger G, Haas W (2010) A video browsing tool for content management in post-production. Int J Digit Multimed Broadcast 2010, 856761. doi: 10.1155/2010/856761 Bailer W, Weiss W, Kienast G, Thallinger G, Haas W (2010) A video browsing tool for content management in post-production. Int J Digit Multimed Broadcast 2010, 856761. doi: 10.​1155/​2010/​856761
go back to reference Bailer W, Lokaj M, Stiegler H (2014) Context in video search: is close-by good enough when using linking? In: Proceedings of ACM International Conference on Multimedia Retrieval, Glasgow, UK, pp 209–217 Bailer W, Lokaj M, Stiegler H (2014) Context in video search: is close-by good enough when using linking? In: Proceedings of ACM International Conference on Multimedia Retrieval, Glasgow, UK, pp 209–217
go back to reference Bikel D, Miller S, Schwartz R, Weischedel R (1997) Nymble: a high-performance learning name-finder, ANLC’97 Proceedings of the fifth conference on applied natural language processing, Stroudsburg, PA Bikel D, Miller S, Schwartz R, Weischedel R (1997) Nymble: a high-performance learning name-finder, ANLC’97 Proceedings of the fifth conference on applied natural language processing, Stroudsburg, PA
go back to reference Boser BE, Guyon I, Vapnik V (1992) A training algorithm for optimal margin classifiers. In: Proceedings of the 5th Annual Workshop on Computational learning theory. ACM Press, New York, NY, pp 144–152 Boser BE, Guyon I, Vapnik V (1992) A training algorithm for optimal margin classifiers. In: Proceedings of the 5th Annual Workshop on Computational learning theory. ACM Press, New York, NY, pp 144–152
go back to reference Brugghemans B, Van de Walle B, Milis K (2013) Impact of the distribution and enrichment of information on the coordination of a human-made fast-burning crisis. In: Proceedings of the 10th International Conference on Information Systems for Crisis Responses and Management (ISCRAM 2013), Baden-Baden, Germany, pp 89–93 Brugghemans B, Van de Walle B, Milis K (2013) Impact of the distribution and enrichment of information on the coordination of a human-made fast-burning crisis. In: Proceedings of the 10th International Conference on Information Systems for Crisis Responses and Management (ISCRAM 2013), Baden-Baden, Germany, pp 89–93
go back to reference Bruno E, Marchand-Maillet S (2009) Multiview clustering: a late fusion approach using latent models. In: Proceedings of the 32nd international ACM SIGIR conference on research and development in information retrieval (SIGIR’09), Boston, MA Bruno E, Marchand-Maillet S (2009) Multiview clustering: a late fusion approach using latent models. In: Proceedings of the 32nd international ACM SIGIR conference on research and development in information retrieval (SIGIR’09), Boston, MA
go back to reference Bruns A, Burgess J, Crawford K, Shaw F (2012) #qldfloods and @QPSMedia: crisis communication on Twitter in the 2011 South East Queensland Floods. ARC Centre of Excellence for Creative Industries and Innovation, Brisbane, QLD Bruns A, Burgess J, Crawford K, Shaw F (2012) #qldfloods and @QPSMedia: crisis communication on Twitter in the 2011 South East Queensland Floods. ARC Centre of Excellence for Creative Industries and Innovation, Brisbane, QLD
go back to reference Costantini L, Nicolussi R (2011) Image clustering fusion technique based on BFS. In: Proceedings of the 20th ACM international conference on Information and knowledge management (CIKM’11), Glasgow, UK Costantini L, Nicolussi R (2011) Image clustering fusion technique based on BFS. In: Proceedings of the 20th ACM international conference on Information and knowledge management (CIKM’11), Glasgow, UK
go back to reference Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the IEEE Computer Society Conference on Computer vision and pattern recognition (CVPR’05), vol 1, San Diego, CA, pp 886–893 Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the IEEE Computer Society Conference on Computer vision and pattern recognition (CVPR’05), vol 1, San Diego, CA, pp 886–893
go back to reference Duan L-Y, Gao F, Chen J, Lin J, Huang T (2013) Compact descriptors for mobile visual search and MPEG CDVS standardization. In: IEEE International Symposium on Circuits and Systems (ISCAS), Beijing, China, 19–23 May 2013, pp 885–888 Duan L-Y, Gao F, Chen J, Lin J, Huang T (2013) Compact descriptors for mobile visual search and MPEG CDVS standardization. In: IEEE International Symposium on Circuits and Systems (ISCAS), Beijing, China, 19–23 May 2013, pp 885–888
go back to reference Duda RO, Hart PE, Stork DG (2000) Pattern classification. Wiley-Interscience, New York, NY Duda RO, Hart PE, Stork DG (2000) Pattern classification. Wiley-Interscience, New York, NY
go back to reference Fei-Fei L, Perona P (2005) A Bayesian hierarchical model for learning natural scene categories. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol 2, San Diego, CA, pp 524 Fei-Fei L, Perona P (2005) A Bayesian hierarchical model for learning natural scene categories. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol 2, San Diego, CA, pp 524
go back to reference Fred ALN, Jain AK (2005) Combining multiple clusterings using evidence accumulation. IEEE Trans Pattern Anal Mach Intell 27(6):835–850CrossRef Fred ALN, Jain AK (2005) Combining multiple clusterings using evidence accumulation. IEEE Trans Pattern Anal Mach Intell 27(6):835–850CrossRef
go back to reference Frossyniotis DS, Pertselakis M, Stafylopatis A (2002) A multi-clustering fusion algorithm. In: Proceedings of the Second Hellenic Conference on AI: methods and applications of artificial intelligence (SETN’02), Thessaloniki, Greece, April 11–12, 2002 Frossyniotis DS, Pertselakis M, Stafylopatis A (2002) A multi-clustering fusion algorithm. In: Proceedings of the Second Hellenic Conference on AI: methods and applications of artificial intelligence (SETN’02), Thessaloniki, Greece, April 11–12, 2002
go back to reference Gao B, Liu T-Y, Qin T, Zheng X, Cheng Q-S, Ma W-Y (2005) Web image clustering by consistent utilization of visual features and surrounding texts. In: Proceedings of ACM Multimedia, Singapore, November 6–11, 2005, pp 112–121 Gao B, Liu T-Y, Qin T, Zheng X, Cheng Q-S, Ma W-Y (2005) Web image clustering by consistent utilization of visual features and surrounding texts. In: Proceedings of ACM Multimedia, Singapore, November 6–11, 2005, pp 112–121
go back to reference Hecht R, Riedler J, Backfried G, German broadcast news transcription. In: Proceedings of the International Conference on Spoken language processing, ICSLP 2002, Denver, CO, USA, September 2002 Hecht R, Riedler J, Backfried G, German broadcast news transcription. In: Proceedings of the International Conference on Spoken language processing, ICSLP 2002, Denver, CO, USA, September 2002
go back to reference Hsu WH, Chang S-F (2006) Topic tracking across broadcast news videos with visual duplicates and semantic concepts. In: IEEE International Conference on Image Processing, October 8–11, 2006, pp 141–144 Hsu WH, Chang S-F (2006) Topic tracking across broadcast news videos with visual duplicates and semantic concepts. In: IEEE International Conference on Image Processing, October 8–11, 2006, pp 141–144
go back to reference Johansson F, Brynielsson J, Narganes Quijano M (2012) Estimating citizen alertness in crises using social media monitoring and analysis, EISIC 2012, Odense, Denmark Johansson F, Brynielsson J, Narganes Quijano M (2012) Estimating citizen alertness in crises using social media monitoring and analysis, EISIC 2012, Odense, Denmark
go back to reference Kohlschütter C, Frankhauser P, Nejdl W (2010) Boilerplate detection using shallow text features. In: Proceedings of the third ACM international conference on Web search and data mining (WSDM 2010), New York, NY Kohlschütter C, Frankhauser P, Nejdl W (2010) Boilerplate detection using shallow text features. In: Proceedings of the third ACM international conference on Web search and data mining (WSDM 2010), New York, NY
go back to reference Kubala F, Jin H, Nguyen L, Schwartz R, Matsoukas S (1997) Broadcast News Transcription. In: Proc of the ICASSP’97, vol 1, pp 203–206 Kubala F, Jin H, Nguyen L, Schwartz R, Matsoukas S (1997) Broadcast News Transcription. In: Proc of the ICASSP’97, vol 1, pp 203–206
go back to reference Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef
go back to reference Mendoza M, Poblete B, Castillo C (2010) Twitter under crisis: can we trust what we RT? In: SOMA 2010, Washington, DC Mendoza M, Poblete B, Castillo C (2010) Twitter under crisis: can we trust what we RT? In: SOMA 2010, Washington, DC
go back to reference Mimaroglu S, Erdil E (2011) Combining multiple clusterings using similarity graph. Pattern Recogn 44(3):694–703CrossRefMATH Mimaroglu S, Erdil E (2011) Combining multiple clusterings using similarity graph. Pattern Recogn 44(3):694–703CrossRefMATH
go back to reference Mimaroglu S, Erdil E (2013) An efficient and scalable family of algorithms for combining clusterings. Eng Appl Artif Intel 26(10):2525–2539CrossRef Mimaroglu S, Erdil E (2013) An efficient and scalable family of algorithms for combining clusterings. Eng Appl Artif Intel 26(10):2525–2539CrossRef
go back to reference Muhren WJ, Van de Walle B (2010) Sense-making and information management in emergency response. Bull Am Soc Inf Sci Technol 36(5):30–33CrossRef Muhren WJ, Van de Walle B (2010) Sense-making and information management in emergency response. Bull Am Soc Inf Sci Technol 36(5):30–33CrossRef
go back to reference Nilsson J et al. (2012) Making use of new Media for Pan-European crisis communication, ISCRAM 2012, Vancouver, Canada Nilsson J et al. (2012) Making use of new Media for Pan-European crisis communication, ISCRAM 2012, Vancouver, Canada
go back to reference Perronnin F, Dance C (2007) Fisher kernels on visual vocabularies for image categorization. In: Proc IEEE Conference on Computer vision and pattern recognition, Minneapolis, MN, pp 1–8 Perronnin F, Dance C (2007) Fisher kernels on visual vocabularies for image categorization. In: Proc IEEE Conference on Computer vision and pattern recognition, Minneapolis, MN, pp 1–8
go back to reference Picard D, Gosselin P-H (2011) Improving image similarity with vectors of locally aggregated tensors. In: IEEE International Conference on Image Processing, Brussels, Belgium, pp669–672 Picard D, Gosselin P-H (2011) Improving image similarity with vectors of locally aggregated tensors. In: IEEE International Conference on Image Processing, Brussels, Belgium, pp669–672
go back to reference Rege M, Dong M, Hua J (2008) Graph theoretical framework for simultaneously integrating visual and textual features for efficient web image clustering. In: Proceedings of the 17th international conference on World Wide Web, Beijing, China, pp 317–326 Rege M, Dong M, Hua J (2008) Graph theoretical framework for simultaneously integrating visual and textual features for efficient web image clustering. In: Proceedings of the 17th international conference on World Wide Web, Beijing, China, pp 317–326
go back to reference Shalunts G., Backfried G, Prinz K, Sentiment Analysis of German Social Media for Natural Disasters, , 11th International Conference of Information Systems for Crisis Response and Management, ISCRAM, 2014, University Park, P Shalunts G., Backfried G, Prinz K, Sentiment Analysis of German Social Media for Natural Disasters, , 11th International Conference of Information Systems for Crisis Response and Management, ISCRAM, 2014, University Park, P
go back to reference Snoek CGM, Worring M, Smeulders AWM (2005) Early versus late fusion in semantic video analysis. In: Proceedings of the 13th annual ACM international conference on Multimedia (MULTIMEDIA’05), Singapore, November 06–12, 2005 Snoek CGM, Worring M, Smeulders AWM (2005) Early versus late fusion in semantic video analysis. In: Proceedings of the 13th annual ACM international conference on Multimedia (MULTIMEDIA’05), Singapore, November 06–12, 2005
go back to reference Thelwall M, Buckley K, Paltoglou G, Cai D, Kappas A (2010) Sentiment strength detection in short informal text. J Am Soc Inf Sci Technol 61(12):2544–2558CrossRef Thelwall M, Buckley K, Paltoglou G, Cai D, Kappas A (2010) Sentiment strength detection in short informal text. J Am Soc Inf Sci Technol 61(12):2544–2558CrossRef
go back to reference Vega-Pons S, Ruiz-Shulcloper J (2011) A Survey of Clustering Ensemble Algorithms. Int J Pattern Recogn Artif Intell 25(3):337–372CrossRefMathSciNet Vega-Pons S, Ruiz-Shulcloper J (2011) A Survey of Clustering Ensemble Algorithms. Int J Pattern Recogn Artif Intell 25(3):337–372CrossRefMathSciNet
go back to reference Voorhees EM, Gupta NK, Johnson-Laird B (1995) Learning collection fusion strategies. In: Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR’95), Seattle, WA Voorhees EM, Gupta NK, Johnson-Laird B (1995) Learning collection fusion strategies. In: Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR’95), Seattle, WA
Metadata
Title
Data Fusion Across Traditional and Social Media
Authors
Werner Bailer
Gert Kienast
Georg Thallinger
Gerhard Backfried
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-22527-2_10