Skip to main content

2021 | OriginalPaper | Buchkapitel

Social Modeling Meets Virtual Reality: An Immersive Implication

verfasst von : Habib Ullah, Sultan Daud Khan, Mohib Ullah, Faouzi Alaya Cheikh

Erschienen in: Pattern Recognition. ICPR International Workshops and Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The development of novel techniques for social modeling in the context of surveillance applications has significantly reduced manual processing of large and continuous video data. These techniques for social modeling widely cover crowd motion analysis since the impact of social modeling on crowd is significant. However, existing crowd motion analysis methods face a number of problems including limited availability of crowd data representing a specific behavior and weaknesses of proposed models to explore the underlying patterns of crowd behavior. To cope with these problems, we propose a novel method based on energy modeling and social interaction of individual particles in crowd to detect unusual behavior. Our method describes collective dissipative interactions among particles in a crowd scene. We reveal the changing patterns about the crowd behavior states, to support the conversion between different social behaviors during evolution. To further improve the performance of our method, virtual reality can be considered to consolidate the acquisition of data associated with a particular behavior. Therefore, we provide theoretical background of immersive implication considering virtual reality that can expose individuals to virtual crowds and acquire useful data on human motion and behaviors in crowds. The experimental evaluation of our energy and social interaction driven method shows convincing results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Ammanuel, S., Brown, I., Uribe, J., Rehani, B.: Creating 3D models from radiologic images for virtual reality medical education modules. J. Med. Syst. 43(6), 166 (2019)CrossRef Ammanuel, S., Brown, I., Uribe, J., Rehani, B.: Creating 3D models from radiologic images for virtual reality medical education modules. J. Med. Syst. 43(6), 166 (2019)CrossRef
3.
Zurück zum Zitat Behera, S., Dogra, D.P., Bandyopadhyay, M.K., Roy, P.P.: Estimation of linear motion in dense crowd videos using langevin model. Expert Systems with Applications, p. 113333 (2020) Behera, S., Dogra, D.P., Bandyopadhyay, M.K., Roy, P.P.: Estimation of linear motion in dense crowd videos using langevin model. Expert Systems with Applications, p. 113333 (2020)
4.
Zurück zum Zitat Cao, H., Sankaranarayanan, J., Feng, J., Li, Y., Samet, H.: Understanding metropolitan crowd mobility via mobile cellular accessing data. ACM Trans. Spatial Algorithms Syst. (TSAS) 5(2), 1–18 (2019)CrossRef Cao, H., Sankaranarayanan, J., Feng, J., Li, Y., Samet, H.: Understanding metropolitan crowd mobility via mobile cellular accessing data. ACM Trans. Spatial Algorithms Syst. (TSAS) 5(2), 1–18 (2019)CrossRef
5.
Zurück zum Zitat Cheung, E., Wong, A., Bera, A., Wang, X., Manocha, D.: LCrowdV: generating labeled videos for pedestrian detectors training and crowd behavior learning. Neurocomputing 337, 1–14 (2019)CrossRef Cheung, E., Wong, A., Bera, A., Wang, X., Manocha, D.: LCrowdV: generating labeled videos for pedestrian detectors training and crowd behavior learning. Neurocomputing 337, 1–14 (2019)CrossRef
6.
Zurück zum Zitat Chibloun, A., El Fkihi, S., Mliki, H., Hammami, M., Thami, R.O.H.: Abnormal crowd behavior detection using speed and direction models. In: 2018 9th International Symposium on Signal, Image, Video and Communications (ISIVC), pp. 197–202. IEEE (2018) Chibloun, A., El Fkihi, S., Mliki, H., Hammami, M., Thami, R.O.H.: Abnormal crowd behavior detection using speed and direction models. In: 2018 9th International Symposium on Signal, Image, Video and Communications (ISIVC), pp. 197–202. IEEE (2018)
7.
Zurück zum Zitat Cuevas, E., Cienfuegos, M., ZaldíVar, D., Pérez-Cisneros, M.: A swarm optimization algorithm inspired in the behavior of the social-spider. Expert Syst. Appl. 40(16), 6374–6384 (2013)CrossRef Cuevas, E., Cienfuegos, M., ZaldíVar, D., Pérez-Cisneros, M.: A swarm optimization algorithm inspired in the behavior of the social-spider. Expert Syst. Appl. 40(16), 6374–6384 (2013)CrossRef
8.
Zurück zum Zitat Dorigo, M., Maniezzo, V., Colorni, A.: Ant system: optimization by a colony of cooperating agents. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 26(1), 29–41 (1996) Dorigo, M., Maniezzo, V., Colorni, A.: Ant system: optimization by a colony of cooperating agents. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 26(1), 29–41 (1996)
9.
Zurück zum Zitat El Beheiry, M., Doutreligne, S., Caporal, C., Ostertag, C., Dahan, M., Masson, J.B.: Virtual reality: beyond visualization. J. Mol. Biol. 431(7), 1315–1321 (2019)CrossRef El Beheiry, M., Doutreligne, S., Caporal, C., Ostertag, C., Dahan, M., Masson, J.B.: Virtual reality: beyond visualization. J. Mol. Biol. 431(7), 1315–1321 (2019)CrossRef
10.
Zurück zum Zitat Feng, X., Wang, Y., Yu, H., Luo, F.: A novel intelligence algorithm based on the social group optimization behaviors. IEEE Trans. Syst. Man Cybern. Syst. 48(1), 65–76 (2016)CrossRef Feng, X., Wang, Y., Yu, H., Luo, F.: A novel intelligence algorithm based on the social group optimization behaviors. IEEE Trans. Syst. Man Cybern. Syst. 48(1), 65–76 (2016)CrossRef
11.
Zurück zum Zitat Hartney, J.H., Rosenthal, S.N., Kirkpatrick, A.M., Skinner, J.M., Hughes, J., Orlosky, J.: Revisiting virtual reality for practical use in therapy: patient satisfaction in outpatient rehabilitation. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 960–961. IEEE (2019) Hartney, J.H., Rosenthal, S.N., Kirkpatrick, A.M., Skinner, J.M., Hughes, J., Orlosky, J.: Revisiting virtual reality for practical use in therapy: patient satisfaction in outpatient rehabilitation. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 960–961. IEEE (2019)
12.
Zurück zum Zitat Hatirnaz, E., Sah, M., Direkoglu, C.: A novel framework and concept-based semantic search interface for abnormal crowd behaviour analysis in surveillance videos. Multimedia Tools and Applications, pp. 1–39 (2020) Hatirnaz, E., Sah, M., Direkoglu, C.: A novel framework and concept-based semantic search interface for abnormal crowd behaviour analysis in surveillance videos. Multimedia Tools and Applications, pp. 1–39 (2020)
13.
Zurück zum Zitat Hu, Z.P., Zhang, L., Li, S.F., Sun, D.G.: Parallel spatial-temporal convolutional neural networks for anomaly detection and location in crowded scenes. J. Visual Commun. Image Representation 67, 102765 (2020) Hu, Z.P., Zhang, L., Li, S.F., Sun, D.G.: Parallel spatial-temporal convolutional neural networks for anomaly detection and location in crowded scenes. J. Visual Commun. Image Representation 67, 102765 (2020)
14.
Zurück zum Zitat Karaboga, D.: An idea based on honey bee swarm for numerical optimization. Technical report, Technical report-tr06, Erciyes university, engineering faculty, computer (2005) Karaboga, D.: An idea based on honey bee swarm for numerical optimization. Technical report, Technical report-tr06, Erciyes university, engineering faculty, computer (2005)
15.
Zurück zum Zitat Kasudiya, J., Bhavsar, A., Arolkar, H.: Wireless sensor network: a possible solution for crowd management. In: Somani, A.K., Shekhawat, R.S., Mundra, A., Srivastava, S., Verma, V.K. (eds.) Smart Systems and IoT: Innovations in Computing. SIST, vol. 141, pp. 23–31. Springer, Singapore (2020). https://doi.org/10.1007/978-981-13-8406-6_3CrossRef Kasudiya, J., Bhavsar, A., Arolkar, H.: Wireless sensor network: a possible solution for crowd management. In: Somani, A.K., Shekhawat, R.S., Mundra, A., Srivastava, S., Verma, V.K. (eds.) Smart Systems and IoT: Innovations in Computing. SIST, vol. 141, pp. 23–31. Springer, Singapore (2020). https://​doi.​org/​10.​1007/​978-981-13-8406-6_​3CrossRef
16.
Zurück zum Zitat Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of ICNN’95-International Conference on Neural Networks, vol. 4, pp. 1942–1948. IEEE (1995) Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of ICNN’95-International Conference on Neural Networks, vol. 4, pp. 1942–1948. IEEE (1995)
17.
Zurück zum Zitat Kvinge, H., Kirby, M., Peterson, C., Eitel, C., Clapp, T.: A walk through spectral bands: using virtual reality to better visualize hyperspectral data. In: Vellido, A., Gibert, K., Angulo, C., Martín Guerrero, J.D. (eds.) WSOM 2019. AISC, vol. 976, pp. 160–165. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-19642-4_16CrossRef Kvinge, H., Kirby, M., Peterson, C., Eitel, C., Clapp, T.: A walk through spectral bands: using virtual reality to better visualize hyperspectral data. In: Vellido, A., Gibert, K., Angulo, C., Martín Guerrero, J.D. (eds.) WSOM 2019. AISC, vol. 976, pp. 160–165. Springer, Cham (2020). https://​doi.​org/​10.​1007/​978-3-030-19642-4_​16CrossRef
18.
Zurück zum Zitat López-Carrera, B., Yáñez-Márquez, C.: A simple model for the entropy of a system with interacting particles. IEEE Access 7, 108969–108979 (2019)CrossRef López-Carrera, B., Yáñez-Márquez, C.: A simple model for the entropy of a system with interacting particles. IEEE Access 7, 108969–108979 (2019)CrossRef
19.
Zurück zum Zitat Messaoudi, F., Simon, G., Ksentini, A.: Dissecting games engines: the case of unity3d. In: 2015 International Workshop on Network and Systems Support for Games (NetGames), pp. 1–6. IEEE (2015) Messaoudi, F., Simon, G., Ksentini, A.: Dissecting games engines: the case of unity3d. In: 2015 International Workshop on Network and Systems Support for Games (NetGames), pp. 1–6. IEEE (2015)
20.
Zurück zum Zitat Ojha, N., Vaish, A.: Spatio-temporal anomaly detection in crowd movement using sift. In: 2018 2nd International Conference on Inventive Systems and Control (ICISC), pp. 646–654. IEEE (2018) Ojha, N., Vaish, A.: Spatio-temporal anomaly detection in crowd movement using sift. In: 2018 2nd International Conference on Inventive Systems and Control (ICISC), pp. 646–654. IEEE (2018)
21.
Zurück zum Zitat Olivier, A.H., Bruneau, J., Cirio, G., Pettré, J.: A virtual reality platform to study crowd behaviors. Transp. Res. Procedia 2, 114–122 (2014)CrossRef Olivier, A.H., Bruneau, J., Cirio, G., Pettré, J.: A virtual reality platform to study crowd behaviors. Transp. Res. Procedia 2, 114–122 (2014)CrossRef
22.
Zurück zum Zitat Pan, L., Zhou, H., Liu, Y., Wang, M.: Global event influence model: integrating crowd motion and social psychology for global anomaly detection in dense crowds. J. Electron. Imaging 28(2), 023033 (2019)CrossRef Pan, L., Zhou, H., Liu, Y., Wang, M.: Global event influence model: integrating crowd motion and social psychology for global anomaly detection in dense crowds. J. Electron. Imaging 28(2), 023033 (2019)CrossRef
23.
Zurück zum Zitat Singh, K., Rajora, S., Vishwakarma, D.K., Tripathi, G., Kumar, S., Walia, G.S.: Crowd anomaly detection using aggregation of ensembles of fine-tuned convnets. Neurocomputing 371, 188–198 (2020)CrossRef Singh, K., Rajora, S., Vishwakarma, D.K., Tripathi, G., Kumar, S., Walia, G.S.: Crowd anomaly detection using aggregation of ensembles of fine-tuned convnets. Neurocomputing 371, 188–198 (2020)CrossRef
24.
Zurück zum Zitat Ullah, H.: Crowd Motion Analysis: Segmentation, Anomaly Detection, and Behavior Classification. Ph.D. thesis, University of Trento (2015) Ullah, H.: Crowd Motion Analysis: Segmentation, Anomaly Detection, and Behavior Classification. Ph.D. thesis, University of Trento (2015)
25.
Zurück zum Zitat Ullah, H., Altamimi, A.B., Uzair, M., Ullah, M.: Anomalous entities detection and localization in pedestrian flows. Neurocomputing 290, 74–86 (2018)CrossRef Ullah, H., Altamimi, A.B., Uzair, M., Ullah, M.: Anomalous entities detection and localization in pedestrian flows. Neurocomputing 290, 74–86 (2018)CrossRef
27.
Zurück zum Zitat Ullah, M., Ullah, H., Conci, N., De Natale, F.G.: Crowd behavior identification. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 1195–1199. IEEE (2016) Ullah, M., Ullah, H., Conci, N., De Natale, F.G.: Crowd behavior identification. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 1195–1199. IEEE (2016)
28.
Zurück zum Zitat Zitouni, M.S., Sluzek, A., Bhaskar, H.: Visual analysis of socio-cognitive crowd behaviors for surveillance: a survey and categorization of trends and methods. Eng. Appl. Artif. Intell. 82, 294–312 (2019)CrossRef Zitouni, M.S., Sluzek, A., Bhaskar, H.: Visual analysis of socio-cognitive crowd behaviors for surveillance: a survey and categorization of trends and methods. Eng. Appl. Artif. Intell. 82, 294–312 (2019)CrossRef
Metadaten
Titel
Social Modeling Meets Virtual Reality: An Immersive Implication
verfasst von
Habib Ullah
Sultan Daud Khan
Mohib Ullah
Faouzi Alaya Cheikh
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-68799-1_10

Premium Partner