Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Knowledge and Information Systems
Published in: Knowledge and Information Systems 1/2019

17-12-2018 | Regular Paper

F2ConText: how to extract holistic contexts of persons of interest for enhancing exploratory analysis

Authors: Md Abdul Kader, Arnold Priguna Boedihardjo, Mahmud Shahriar Hossain

Published in: Knowledge and Information Systems | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A wide variety of publicly available heterogeneous data has provided us with an opportunity to meander through contextual snippets relevant to a particular event or persons of interest. One example of a heterogeneous source is online news articles where both images and text descriptions may co-exist in documents. Many of the images in a news article may contain faces of people. Names of many of the faces may not appear in the text. An expert on the topic may be able to identify people in images or at least recognize the context of the faces who are not widely known. However, it is difficult as well as expensive to employ topic experts of news topics to label every face of a massive news archive. In this paper, we describe an approach named F2ConText that helps analysts build contextual information, e.g., named entity context and geographical context of facial images found within news articles. Our approach extracts facial features of the faces detected in the images of publicly available news articles and learns probabilistic mappings between the features and the contents of the articles in an unsupervised manner. Afterward, it translates the mappings to geographical distributions and generates a contextual template for every face detected in the collection. This paper demonstrates three empirical studies—related to construction of context-based genealogy of events, tracking of a contextual phenomenon over time, and creation of contextual clusters of faces—to evaluate the effectiveness of the generated contexts.
previous article Effective and efficient location influence mining in location-based social networks
next article Short-term trend prediction in financial time series data

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now
Footnotes
1
Codes and data are provided here: http://​dal.​cs.​utep.​edu/​projects/​storyboarding/​KAIS/​. Password: 16context.
 
Literature
1.
Ahonen T, Matas J, He C, Pietikäinen M (2009) Rotation invariant image description with local binary pattern histogram Fourier features. In: SCIA
2.
3.
Bier EA, Ishak EW, Chi E (2006) Entity workspace: an evidence file that aids memory, inference, and reading. In: ISI, pp 466–472
4.
5.
Bruni E, Tran GB, Baroni M (2011) Distributional semantics from text and images. In: Proceedings of the GEMS 2011 workshop on geometrical models of natural language semantics. Association for Computational Linguistics, pp 22–32
6.
7.
Cai D, Yu S, Wen J-R, Ma W-Y (2003) VIPS: a vision-based page segmentation algorithm. Technical report, MSR-TR-2003-79
8.
Chakrabarti S, Sarawagi S, Dom B (1998) Mining surprising patterns using temporal description length. In: VLDB ’98, vol 98, pp 606–617
9.
Chen L, Hu B, Zhang L, Li M, Zhang H (2003) Face annotation for family photo album management. IJIG 3(01):81–94
10.
Choi JY, De Neve W, Ro YM, Plataniotis KN (2010) Automatic face annotation in personal photo collections using context-based unsupervised clustering and face information fusion. IEEE Trans Circuits Syst Video Technol 20(10):1292–1309CrossRef
11.
Choi JY, Yang S, Ro YM, Plataniotis KN (2008) Face annotation for personal photos using context-assisted face recognition. In: Proceedings of the 1st ACM international conference on multimedia information retrieval. ACM, New York, pp 44–51
12.
Christopher D, Manning PR, Schtze H (2008) Introduction to information retrieval, chapter 13. Text classification and Naive Bayes. Cambridge University Press, Cambridge
13.
Das-Neves F, Fox EA, Yu X (2005) Connecting topics in document collections with stepping stones and pathways. In: CIKM ’05, pp 91–98
14.
Ester M, peter Kriegel HSJ, Xu X (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD
15.
Faloutsos C, McCurley KS, Tomkins A (2004) Fast discovery of connection subgraphs. In: KDD 04’, pp 118–127
16.
Fang L, Sarma AD, Yu C, Bohannon P (2011) Rex: explaining relationships between entity pairs. Proc VLDB Endow 5(3):241–252CrossRef
17.
18.
Feng S, Manmatha R, Lavrenko V (2004) Multiple bernoulli relevance models for image and video annotation. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004, vol 2. IEEE, pp II–II
19.
Feng Y, Lapata M (2008) Automatic image annotation using auxiliary text information. In: ACL, vol 8, pp 272–280
20.
21.
Fisichella M, Stewart A, Denecke K, Nejdl W (2010) Unsupervised public health event detection for epidemic intelligence. In: CIKM ’10, pp 1881–1884
22.
23.
24.
25.
26.
Hassner T, Harel S, Paz E, Enbar R (2015) Effective face frontalization in unconstrained images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4295–4304
27.
Heath K, Gelfand N, Ovsjanikov M, Aanjaneya M, Guibas LJ (2010) Image webs: computing and exploiting connectivity in image collections. In: CVPR ’10, pp 3432–3439
28.
Heuer R (1999) Psychology of intelligence analysis. In: CIA ’99
29.
Hossain MS, Andrews C, Ramakrishnan N, North C (2011) Helping intelligence analysts make connections. In: AAAI ’11 workshop on scalable integration of analytics and visualization
30.
31.
Hossain MS, Gresock J, Edmonds Y, Helm R, Potts M, Ramakrishnan N (2012) Connecting the dots between pubmed abstracts. PLoS ONE 7(1):e29509CrossRef
32.
Huang C, Ai H, Li Y, Lao S (2007) High-performance rotation invariant multiview face detection. TPAMI 29(4):671–686CrossRef
33.
Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical report 07–49, University of Massachusetts, Amherst
34.
35.
36.
37.
Kader MA, Naim SM, Boedihardjo AP, Hossain MS (2016) Connecting the dots using contextual information hidden in text and images. In: AAAI
38.
Kalva P, Enembreck F, Koerich A (2007) Web image classification based on the fusion of image and text classifiers. In: ICDAR, vol 1, pp 561–568
39.
Kang H, Plaisant C, Lee B, Bederson BB (2007) NetLens: iterative exploration of content-actor network data. Inf Vis 6(1):18–31CrossRef
40.
Karpathy A, Fei-Fei L (2015) Deep visual-semantic alignments for generating image descriptions. In: CVPR, pp 3128–3137
41.
Karpathy A, Joulin A, Li FFF (2014) Deep fragment embeddings for bidirectional image sentence mapping. In: Advances in neural information processing systems, pp 1889–1897
42.
Kinsella S, Murdock V, O’Hare N (2011) “I’m eating a sandwich in glasgow”: modeling locations with tweets. In: SMUC, pp 61–68
43.
Koch GG, Koldehofe B, Rothermel K (2010) Cordies: expressive event correlation in distributed systems. In: DEBS ’10, pp 26–37
44.
Kumar D, Ramakrishnan N, Helm RF, Potts M (2006) Algorithms for storytelling. In: KDD ’06
45.
Lai JH, Yuen PC, Feng GC (2001) Face recognition using holistic fourier invariant features. Pattern Recognit 34(1):95–109CrossRefMATH
46.
Laxman S, Sastry P, Unnikrishnan K (2005) Discovering frequent episodes and learning hidden Markov models: a formal connection. KDE 17(11):1505–1517
47.
Le D-D, Satoh S (2008) Unsupervised face annotation by mining the web. In: Eighth IEEE international conference on data mining, 2008. ICDM’08. IEEE, pp 383–392
48.
Lee H-J, Lee W-S, Chung J-H (2001) Face recognition using fisherface algorithm and elastic graph matching. In: ICIP, pp 998–1001
49.
Li H, Lin Z, Shen X, Brandt J, Hua G (2015) A convolutional neural network cascade for face detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5325–5334
50.
51.
Little S, Jargalsaikhan I, Clawson K, Nieto M, Li H, Direkoglu C, O’Connor NE, Smeaton AF, Scotney B, Wang H, Liu J (2013) An information retrieval approach to identifying infrequent events in surveillance video. In: ICMR ’13, pp 223–230. https://​doi.​org/​10.​1145/​2461466.​2461503
52.
Mishra A, Mishra N, Agrawal A (2010) Context-aware restricted geographical domain question answering system. In: CICN ’10, pp 548–553
53.
National Research Council (2002) Making the nation safer: the role of science and technology in countering terrorism. National Academies Press, Washington
54.
55.
56.
57.
Parkhi OM, Vedaldi A, Zisserman A (2015) Deep face recognition. BMVC 1(3):6
58.
Petz G, Karpowicz M, Fürschuß H, Auinger A, Stříteskỳ V, Holzinger A (2014) Computational approaches for mining users opinions on the web 2.0. Inf Process Manag 50(6):899–908CrossRef
59.
Rahman S, Naim SM, Al Farooq A, Islam MM (2010) Performance of mpeg-7 edge histogram descriptor in face recognition using principal component analysis. In: ICCIT, pp 476–481
60.
Rahman S, Naim SM, Al Farooq A, Islam MM (2012) Combination of gabor and curvelet texture features for face recognition using principal component analysis. IACSIT 4(3):264
61.
Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 815–823
62.
Shahaf D, Guestrin C (2010) Connecting the dots between news articles. In: KDD ’10, pp 623–632
63.
Silva MJ, Martins B, Chaves M, Afonso AP, Cardoso N (2006) Adding geographic scopes to web resources. CEUS 30(4):378–399
64.
Socher R, Fei-Fei L (2010) Connecting modalities: semi-supervised segmentation and annotation of images using unaligned text corpora. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 966–973
65.
66.
Stasko J, Görg C, Liu Z (2008) Jigsaw: supporting investigative analysis through interactive visualization. Inf Vis 7(2):118–132CrossRef
67.
Stone Z, Zickler T, Darrell T (2008) Autotagging facebook: social network context improves photo annotation. In: CVPRW’08. IEEE computer society conference on Computer vision and pattern recognition workshops, 2008. IEEE, pp 1–8
68.
Sun Y, Chen Y, Wang X, Tang X (2014) Deep learning face representation by joint identification–verification. In: Advances in neural information processing systems, pp 1988–1996
69.
Sun Y, Wang X, Tang X (2013) Deep convolutional network cascade for facial point detection. In: CVPR ’13, pp 3476–3483
70.
Szegedy C, Toshev A, Erhan D (2013) Deep neural networks for object detection. In: NIPS
71.
Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: CVPR, pp 1701–1708
72.
Tecuci G, Boicu M, Schum D, Marcu D (2010) Coping with the complexity of intelligence analysis: cognitive assistants for evidence-based reasoning. Technical report, LAC GMU
73.
Tian Y, Liu W, Xiao R, Wen F, Tang X (2007) A face annotation framework with partial clustering and interactive labeling. In: CVPR’07. IEEE, pp 1–8
74.
75.
United States Government (2009) A tradecraft primer: structured analytic techniques for improving intelligence analysis. In: CIA CSI
76.
Valstar M, Martinez B, Binefa X, Pantic M (2010) Facial point detection using boosted regression and graph models. In: CVPR ’10, pp 2729–2736
77.
Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: CVPR
78.
Wang D, Hoi SC, He Y, Zhu J, Mei T, Luo J (2014) Retrieval-based face annotation by weak label regularized local coordinate coding. IEEE Trans Pattern Anal Mach Intell 36(3):550–563CrossRef
79.
Wu B, Ai H, Huang C, Lao S (2004) Fast rotation invariant multi-view face detection based on real adaboost. In: FG, pp 79–84
80.
Xu J, Lu T-C (2015) Seeing the big picture from microblogs: harnessing social signals for visual event summarization. In: IUI ’15, pp 62–66
81.
Yao BZ, Yang X, Lin L, Lee MW, Zhu S-C (2010) I2T: image parsing to text description. Proc IEEE 98(8):1485–1508CrossRef
82.
83.
Zhang K, Zhang Z, Li Z, Qiao Y (2016) Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process Lett 23(10):1499–1503CrossRef
Metadata
Title
F2ConText: how to extract holistic contexts of persons of interest for enhancing exploratory analysis
Authors
Md Abdul Kader
Arnold Priguna Boedihardjo
Mahmud Shahriar Hossain
Publication date
17-12-2018
Publisher
Springer London
Published in
Knowledge and Information Systems / Issue 1/2019
Print ISSN: 0219-1377
Electronic ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-018-1304-9

Other articles of this Issue 1/2019

Knowledge and Information Systems 1/2019 Go to the issue

Regular Paper

Short-term trend prediction in financial time series data

Regular Paper

Conditional adjacency anonymity in social graphs under active attacks

Regular Paper

AutoRepair: an automatic repairing approach over multi-source data

Regular Paper

Two-hop privacy-preserving nearest friend searches

Regular Paper

HIME: discovering variable-length motifs in large-scale time series

Regular Paper

Scalable approximations to k-cycle transversal problems on dynamic networks

Premium Partner

    Image Credits