Skip to main content

2016 | OriginalPaper | Buchkapitel

PicHunt: Social Media Image Retrieval for Improved Law Enforcement

verfasst von : Sonal Goel, Niharika Sachdeva, Ponnurangam Kumaraguru, A. V. Subramanyam, Divam Gupta

Erschienen in: Social Informatics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

First responders are increasingly using social media to identify and reduce crime for well-being and safety of the society. Images shared on social media hurting religious, political, communal and other sentiments of people, often instigate violence and create law & order situations in society. This results in the need for first responders to inspect the spread of such images and users propagating them on social media. In this paper, we present a comparison between different hand-crafted features and a Convolutional Neural Network (CNN) model to retrieve similar images, which outperforms state-of-art hand-crafted features. We propose an Open-Source-Intelligent (OSINT) real-time image search system, robust to retrieve modified images that allows first responders to analyze the current spread of images, sentiments floating and details of users propagating such content. The system also aids officials to save time of manually analyzing the content by reducing the search space on an average by 67 %.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Crump, J.: What are the police doing on Twitter? Social media, the police and the public. Policy Internet 3(4), 1–27 (2011)CrossRef Crump, J.: What are the police doing on Twitter? Social media, the police and the public. Policy Internet 3(4), 1–27 (2011)CrossRef
2.
Zurück zum Zitat Cui, P., Liu, S.-W., Zhu, W.-W., Luan, H.-B., Chua, T.-S., Yang, S.-Q.: Social-sensed image search. ACM Trans. Inf. Syst. (TOIS) 32(2), 8 (2014)CrossRef Cui, P., Liu, S.-W., Zhu, W.-W., Luan, H.-B., Chua, T.-S., Yang, S.-Q.: Social-sensed image search. ACM Trans. Inf. Syst. (TOIS) 32(2), 8 (2014)CrossRef
3.
Zurück zum Zitat Denef, S., Kaptein, N., Bayerl, P.S.: ICT trends in European policing. Composite project (2011) Denef, S., Kaptein, N., Bayerl, P.S.: ICT trends in European policing. Composite project (2011)
4.
Zurück zum Zitat The Indian Express. Over 1500 women plan to storm Shani Shingnapur temple today, January 2016 The Indian Express. Over 1500 women plan to storm Shani Shingnapur temple today, January 2016
5.
Zurück zum Zitat Fischer, P., Dosovitskiy, A., Brox, T.: Descriptor matching with convolutional neural networks: a comparison to sift. arXiv preprint arXiv:1405.5769 (2014) Fischer, P., Dosovitskiy, A., Brox, T.: Descriptor matching with convolutional neural networks: a comparison to sift. arXiv preprint arXiv:​1405.​5769 (2014)
6.
Zurück zum Zitat Gerber, M.S.: Predicting crime using Twitter and kernel density estimation. Decis. Support Syst. 61, 115–125 (2014)CrossRef Gerber, M.S.: Predicting crime using Twitter and kernel density estimation. Decis. Support Syst. 61, 115–125 (2014)CrossRef
7.
Zurück zum Zitat The Guardian: Charlie Hebdo cartoon depicting drowned child Alan Kurdi sparks racism debate, January 2016 The Guardian: Charlie Hebdo cartoon depicting drowned child Alan Kurdi sparks racism debate, January 2016
8.
Zurück zum Zitat Gupta, A., Kumaraguru, P.: Misinformation on Twitter during crisis events. Encyclopedia of social network analysis and mining (ESNAM) (2012) Gupta, A., Kumaraguru, P.: Misinformation on Twitter during crisis events. Encyclopedia of social network analysis and mining (ESNAM) (2012)
9.
Zurück zum Zitat Gupta, A., Lamba, H., Kumaraguru, P.: $1.00 per RT #BostonMarathon #PrayForBoston: analyzing fake content on Twitter. In: eCrime Researchers Summit (eCRS), pp. 1–12. IEEE (2013) Gupta, A., Lamba, H., Kumaraguru, P.: $1.00 per RT #BostonMarathon #PrayForBoston: analyzing fake content on Twitter. In: eCrime Researchers Summit (eCRS), pp. 1–12. IEEE (2013)
10.
Zurück zum Zitat Hanson, W.: How social media is changing law enforcement, December 2011 Hanson, W.: How social media is changing law enforcement, December 2011
11.
Zurück zum Zitat Hare, J.S., Samangooei, S., Dupplaw, D.P., Lewis, P.H.: Twitter’s visual pulse. In: Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval, pp. 297–298. ACM (2013) Hare, J.S., Samangooei, S., Dupplaw, D.P., Lewis, P.H.: Twitter’s visual pulse. In: Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval, pp. 297–298. ACM (2013)
12.
Zurück zum Zitat Hoi, S.C., Pengcheng, W.: SIRE: A Social Image Retrieval Engine. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 817–818. ACM (2011) Hoi, S.C., Pengcheng, W.: SIRE: A Social Image Retrieval Engine. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 817–818. ACM (2011)
13.
Zurück zum Zitat Kharroub, T., Bas, O.: Social media and protests: an examination Egyptian revolution. New Media Soc. 1461444815571914, 2015 (2011) Kharroub, T., Bas, O.: Social media and protests: an examination Egyptian revolution. New Media Soc. 1461444815571914, 2015 (2011)
14.
Zurück zum Zitat McParlane, P.J., McMinn, A.J., Jose, J.M.: Picture the scene..;: visually summarising social media events. In: Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, pp. 1459–1468. ACM (2014) McParlane, P.J., McMinn, A.J., Jose, J.M.: Picture the scene..;: visually summarising social media events. In: Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, pp. 1459–1468. ACM (2014)
15.
Zurück zum Zitat Mendoza, M., Poblete, B., Castillo, C.: Twitter under crisis: can we trust what we RT? In: Proceedings of the First Workshop on Social Media Analytics, pp. 71–79. ACM (2010) Mendoza, M., Poblete, B., Castillo, C.: Twitter under crisis: can we trust what we RT? In: Proceedings of the First Workshop on Social Media Analytics, pp. 71–79. ACM (2010)
16.
Zurück zum Zitat BBC News: Mumbai ink attack: India police arrest six Shiv Sena workers, October 2015 BBC News: Mumbai ink attack: India police arrest six Shiv Sena workers, October 2015
17.
Zurück zum Zitat Pass, G., Zabih, R., Miller, J.: Comparing images using color coherence vectors. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 65–73. ACM (1997) Pass, G., Zabih, R., Miller, J.: Comparing images using color coherence vectors. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 65–73. ACM (1997)
18.
Zurück zum Zitat Popescu, A., Grefenstette, G.: Social media driven image retrieval. In: Proceedings of the 1st ACM International Conference on Multimedia Retrieval, p. 33. ACM (2011) Popescu, A., Grefenstette, G.: Social media driven image retrieval. In: Proceedings of the 1st ACM International Conference on Multimedia Retrieval, p. 33. ACM (2011)
19.
Zurück zum Zitat Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015) Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:​1511.​06434 (2015)
20.
Zurück zum Zitat Rogers, S.: What fuels a tweet’s engagement, March 2014 Rogers, S.: What fuels a tweet’s engagement, March 2014
21.
Zurück zum Zitat Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: 2011 International Conference on Computer Vision, pp. 2564–2571. IEEE (2011) Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: 2011 International Conference on Computer Vision, pp. 2564–2571. IEEE (2011)
22.
Zurück zum Zitat Ruddell, R., Jones, N.: Social media and policing: matching the message to the audience. Safer Communities 12(2), 64–70 (2013)CrossRef Ruddell, R., Jones, N.: Social media and policing: matching the message to the audience. Safer Communities 12(2), 64–70 (2013)CrossRef
23.
Zurück zum Zitat Sachdeva, N., Kumaraguru, P.: Online social networks and police in India -understanding the perceptions, behavior, challenges. In: Boulus-Rødje, N., Ellingsen, G., Bratteteig, T., Aanestad, M., Bjorn, P. (eds.) ECSCW 2015: Proceedings of the 14th European Conference on Computer Supported Cooperative Work, Oslo, Norway, 19–23 September 2015, pp. 183–203. Springer, Copenhagen (2015) Sachdeva, N., Kumaraguru, P.: Online social networks and police in India -understanding the perceptions, behavior, challenges. In: Boulus-Rødje, N., Ellingsen, G., Bratteteig, T., Aanestad, M., Bjorn, P. (eds.) ECSCW 2015: Proceedings of the 14th European Conference on Computer Supported Cooperative Work, Oslo, Norway, 19–23 September 2015, pp. 183–203. Springer, Copenhagen (2015)
24.
Zurück zum Zitat Sachdeva, N., Kumaraguru, P.: Social networks for police and residents in India: exploring online communication for crime prevention. In: Proceedings of the 16th Annual International Conference on Digital Government Research, pp. 256–265. ACM (2015) Sachdeva, N., Kumaraguru, P.: Social networks for police and residents in India: exploring online communication for crime prevention. In: Proceedings of the 16th Annual International Conference on Digital Government Research, pp. 256–265. ACM (2015)
26.
Zurück zum Zitat Lexis Nexis Risk Solutions: Survey of law enforcement personnel and their use of social media in investigations. Lexis Nexis (2012) Lexis Nexis Risk Solutions: Survey of law enforcement personnel and their use of social media in investigations. Lexis Nexis (2012)
27.
Zurück zum Zitat Standard, B.: BJP files complaint against journalist for morphed Modi photo, April 2016 Standard, B.: BJP files complaint against journalist for morphed Modi photo, April 2016
28.
Zurück zum Zitat Starbird, K., Palen, L.: Voluntweeters: self-organizing by digital volunteers in times of crisis. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1071–1080. ACM (2011) Starbird, K., Palen, L.: Voluntweeters: self-organizing by digital volunteers in times of crisis. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1071–1080. ACM (2011)
29.
Zurück zum Zitat Sakal Times: 180 held for circulating obscene photos on internet, June 2014 Sakal Times: 180 held for circulating obscene photos on internet, June 2014
30.
Zurück zum Zitat The Economics Times: NCRB to connect police stations and crime data across country in 6 months, November 2014 The Economics Times: NCRB to connect police stations and crime data across country in 6 months, November 2014
31.
Zurück zum Zitat India Today: Case against Gurmeet Ram Rahim for posing as Vishnu, will he be arrested? January 2016 India Today: Case against Gurmeet Ram Rahim for posing as Vishnu, will he be arrested? January 2016
32.
Zurück zum Zitat Tola, E., Lepetit, V., Fua, P.: A fast local descriptor for dense matching. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008) Tola, E., Lepetit, V., Fua, P.: A fast local descriptor for dense matching. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)
33.
Zurück zum Zitat Tola, E., Lepetit, V., Fua, P.: Daisy: an efficient dense descriptor applied to wide-baseline stereo. IEEE Trans. Pattern Anal. Mach. Intell. 32(5), 815–830 (2010)CrossRef Tola, E., Lepetit, V., Fua, P.: Daisy: an efficient dense descriptor applied to wide-baseline stereo. IEEE Trans. Pattern Anal. Mach. Intell. 32(5), 815–830 (2010)CrossRef
34.
Zurück zum Zitat Vieweg, S., Hughes, A.L., Starbird, K., Palen, L.: Microblogging during two natural hazards events: what Twitter may contribute to situational awareness. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1079–1088. ACM (2010) Vieweg, S., Hughes, A.L., Starbird, K., Palen, L.: Microblogging during two natural hazards events: what Twitter may contribute to situational awareness. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1079–1088. ACM (2010)
35.
Zurück zum Zitat Wang, X., Gerber, M.S., Brown, D.E.: Automatic crime prediction using events extracted from Twitter posts. In: Yang, S.J., Greenberg, A.M., Endsley, M. (eds.) SBP 2012. LNCS, vol. 7227, pp. 231–238. Springer, Heidelberg (2012). doi:10.1007/978-3-642-29047-3_28 CrossRef Wang, X., Gerber, M.S., Brown, D.E.: Automatic crime prediction using events extracted from Twitter posts. In: Yang, S.J., Greenberg, A.M., Endsley, M. (eds.) SBP 2012. LNCS, vol. 7227, pp. 231–238. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-29047-3_​28 CrossRef
36.
Zurück zum Zitat Scoop Whoop: This is why the Hashtag KejriwalinsultsHanuman is trending on Twitter, February 2016 Scoop Whoop: This is why the Hashtag KejriwalinsultsHanuman is trending on Twitter, February 2016
37.
Zurück zum Zitat Wiegand, S., Middleton, S.E.: Veracity and velocity of social media content during breaking news: analysis of Paris shootings. In: Proceedings of the 25th International Conference Companion on World Wide Web, november 2015, pp. 751–756. International World Wide Web Conferences Steering Committee (2016) Wiegand, S., Middleton, S.E.: Veracity and velocity of social media content during breaking news: analysis of Paris shootings. In: Proceedings of the 25th International Conference Companion on World Wide Web, november 2015, pp. 751–756. International World Wide Web Conferences Steering Committee (2016)
38.
Zurück zum Zitat Lei, Y., Zhixin, Y., Gong, Y.: An improved ORB algorithm of extracting and matching (2015) Lei, Y., Zhixin, Y., Gong, Y.: An improved ORB algorithm of extracting and matching (2015)
Metadaten
Titel
PicHunt: Social Media Image Retrieval for Improved Law Enforcement
verfasst von
Sonal Goel
Niharika Sachdeva
Ponnurangam Kumaraguru
A. V. Subramanyam
Divam Gupta
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-47880-7_13

Neuer Inhalt