Skip to main content
Erschienen in: Pattern Analysis and Applications 2/2023

14.11.2022 | Short Paper

Event prediction with rough-fuzzy sets

verfasst von: Debarati B. Chakraborty, JingTao Yao

Erschienen in: Pattern Analysis and Applications | Ausgabe 2/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This article proposes a new methodology of unsupervised event prediction from videos. Detecting events from videos without prior information is a challenging task, as there are no well-accepted definitions about events in a video. It is commonly known that the presence of moving elements in a video scene could be considered as part of an event. The possibility of an event occurring becomes higher if there is an abrupt change in the motion patterns of different object(s) present in that video scene. In this paper, we defined a method to model this phenomenon of object motion. Since we have not considered any prior information while modeling it, the initial event and nonevent classification is carried out with rough set-based approximations, namely positive, boundary, and negative, in the incomplete knowledge base, resulting in an event-nonevent rough sets. We generate three regions with rough sets. Negative class labels are assigned for static objects and those moving with predictable paths. The objects with a huge change in motion are labeled to be positive events. The remaining objects are kept in the boundary region. However, if there is a gradual change in the motion pattern, there arises some possibility of an event occurring. To define the terms, like possible events and must be event, we have fuzzified the boundary region of event-nonevent rough set and assigned different degrees of possibility of an event to occur if there is a change in motion patterns in the trajectory of the objects. That is, the event, nonevent regions are classified with rough sets, and the boundary region is fuzzified with fuzzy sets. We have validated this newly defined event-nonevent rough-fuzzy sets with experimental demonstrations where the proposed method successfully predicted the events to occur in video sequences.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zadeh LA (1997) Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127MathSciNetCrossRefMATH Zadeh LA (1997) Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127MathSciNetCrossRefMATH
2.
Zurück zum Zitat Pal SK, Meher SK (2013) Natural computing: a problem solving paradigm with granular information processing. Appl Soft Comput 13(9):3944–3955CrossRef Pal SK, Meher SK (2013) Natural computing: a problem solving paradigm with granular information processing. Appl Soft Comput 13(9):3944–3955CrossRef
3.
Zurück zum Zitat Yao JT, Vasilakos AV, Pedrycz W (2013) Granular computing: perspective and challenges. IEEE Trans Cybern 43(6):1977–1989CrossRef Yao JT, Vasilakos AV, Pedrycz W (2013) Granular computing: perspective and challenges. IEEE Trans Cybern 43(6):1977–1989CrossRef
4.
5.
Zurück zum Zitat Pawlak Z (1992) Rough sets: theoretical aspects of reasoning about data. Kluwer Academic Publishers, Norwell, MAMATH Pawlak Z (1992) Rough sets: theoretical aspects of reasoning about data. Kluwer Academic Publishers, Norwell, MAMATH
6.
Zurück zum Zitat Dubois D, Prade H (1990) Rough fuzzy sets and fuzzy rough sets. Int J Gen Syst 17(2–3):191–209CrossRefMATH Dubois D, Prade H (1990) Rough fuzzy sets and fuzzy rough sets. Int J Gen Syst 17(2–3):191–209CrossRefMATH
7.
Zurück zum Zitat Yao YY (1997) Combination of rough and fuzzy sets based on-level sets. In: Rough Sets and Data Mining. Springer pp. 301–321 Yao YY (1997) Combination of rough and fuzzy sets based on-level sets. In: Rough Sets and Data Mining. Springer pp. 301–321
8.
Zurück zum Zitat Lingras P (2001) Fuzzy-rough and rough-fuzzy serial combinations in neurocomputing. Neurocomputing 36(1–4):29–44CrossRefMATH Lingras P (2001) Fuzzy-rough and rough-fuzzy serial combinations in neurocomputing. Neurocomputing 36(1–4):29–44CrossRefMATH
9.
Zurück zum Zitat Cornelis C, Cock MD, Kerre EE (2003) Intuitionistic fuzzy rough sets: at the crossroads of imperfect knowledge. Expert Syst J Knowl Eng 20(5):260–270CrossRef Cornelis C, Cock MD, Kerre EE (2003) Intuitionistic fuzzy rough sets: at the crossroads of imperfect knowledge. Expert Syst J Knowl Eng 20(5):260–270CrossRef
10.
Zurück zum Zitat Sen D, Pal SK (2009) Generalized rough sets, entropy, and image ambiguity measures. IEEE Trans Syst, Man, Cybern, Part B 39(4):117–128CrossRef Sen D, Pal SK (2009) Generalized rough sets, entropy, and image ambiguity measures. IEEE Trans Syst, Man, Cybern, Part B 39(4):117–128CrossRef
11.
Zurück zum Zitat Chen YHPSS (2015) Bipolar-valued rough fuzzy set and its applications to the decision information system. IEEE Trans Fuzzy Syst 64:2358–2370 Chen YHPSS (2015) Bipolar-valued rough fuzzy set and its applications to the decision information system. IEEE Trans Fuzzy Syst 64:2358–2370
12.
Zurück zum Zitat Ray SS, Ganivada A, Pal SK (2015) A granular self-organizing map for clustering and gene selection in microarray data. IEEE Trans Neural Netw Learn Syst 27(9):1890–1906MathSciNetCrossRef Ray SS, Ganivada A, Pal SK (2015) A granular self-organizing map for clustering and gene selection in microarray data. IEEE Trans Neural Netw Learn Syst 27(9):1890–1906MathSciNetCrossRef
13.
Zurück zum Zitat Chakraborty DB, Pal SK (2018) Neighborhood rough filter and intuitionistic entropy in unsupervised tracking. IEEE Trans Fuzzy Syst 85:2188–2200CrossRef Chakraborty DB, Pal SK (2018) Neighborhood rough filter and intuitionistic entropy in unsupervised tracking. IEEE Trans Fuzzy Syst 85:2188–2200CrossRef
14.
Zurück zum Zitat Borges P, Conci N, Cavallaro A (2013) Video-based human behavior understanding: a survey. IEEE Trans CSVT 23(11):1993–2008 Borges P, Conci N, Cavallaro A (2013) Video-based human behavior understanding: a survey. IEEE Trans CSVT 23(11):1993–2008
15.
Zurück zum Zitat Brand M (1996) Understanding manipulation in video. In: Proceedings of the Second Intl Conf on AFGR. IEEE, Killington, VT, pp. 94–99 Brand M (1996) Understanding manipulation in video. In: Proceedings of the Second Intl Conf on AFGR. IEEE, Killington, VT, pp. 94–99
16.
Zurück zum Zitat Stauffer C, Grimson WEL (2000) Learning patterns of activity using real-time tracking. IEEE Trans PAMI 22:747–757CrossRef Stauffer C, Grimson WEL (2000) Learning patterns of activity using real-time tracking. IEEE Trans PAMI 22:747–757CrossRef
17.
Zurück zum Zitat Yang Y, Liu J, Shah M (2009) Video Scene Understanding Using Multi-scale Analysis. In: IEEE Intl Conf on Comp Vision. Kyoto, pp. 1669–1676 Yang Y, Liu J, Shah M (2009) Video Scene Understanding Using Multi-scale Analysis. In: IEEE Intl Conf on Comp Vision. Kyoto, pp. 1669–1676
18.
Zurück zum Zitat Liu KY, Zang T, Wang L (2010) A new parallel video understanding and retrieval system. In: IEEE ICME. Suntec City, pp. 679–684 Liu KY, Zang T, Wang L (2010) A new parallel video understanding and retrieval system. In: IEEE ICME. Suntec City, pp. 679–684
19.
Zurück zum Zitat Gupta A, Srinivasan P, Shi J, Davis L (2009) Unsupervised Video Understanding by Reconciliation of Posture Similarities. In: IEEE CVPR. Miami, FL, pp. 2012–2019 Gupta A, Srinivasan P, Shi J, Davis L (2009) Unsupervised Video Understanding by Reconciliation of Posture Similarities. In: IEEE CVPR. Miami, FL, pp. 2012–2019
20.
Zurück zum Zitat Zaidenberg S, Boulay B, Bremond F (2013) A Generic Framework for Video Understanding Applied to Group Behavior Recognition. In: IEEE AVSS. Beijing, pp. 136–142 Zaidenberg S, Boulay B, Bremond F (2013) A Generic Framework for Video Understanding Applied to Group Behavior Recognition. In: IEEE AVSS. Beijing, pp. 136–142
21.
Zurück zum Zitat Lu C, Shi J, Jia J (2013) Abnormal Event Detection at 150 FPS in Matlab. In: International conference on computer vision, (ICCV) IEEE Lu C, Shi J, Jia J (2013) Abnormal Event Detection at 150 FPS in Matlab. In: International conference on computer vision, (ICCV) IEEE
22.
Zurück zum Zitat Song W, Hagras H (2017) A type-2 fuzzy logic system for event detection in soccer videos. In: 2017 IEEE International conference on fuzzy systems (FUZZ-IEEE), pp. 1–6 Song W, Hagras H (2017) A type-2 fuzzy logic system for event detection in soccer videos. In: 2017 IEEE International conference on fuzzy systems (FUZZ-IEEE), pp. 1–6
23.
Zurück zum Zitat Schmid NCKAC (2018) Learning from web videos for event classification. IEEE Trans Circuits Syst Video Technol 58:3019–3029 Schmid NCKAC (2018) Learning from web videos for event classification. IEEE Trans Circuits Syst Video Technol 58:3019–3029
24.
Zurück zum Zitat Milbich T, Bautista M, Sutter E, Ommer B (2017) Understanding videos, constructing plots learning a visually grounded storyline model from annotated videos. In: IEEE ICCV. Venice, pp. 4404–4414 Milbich T, Bautista M, Sutter E, Ommer B (2017) Understanding videos, constructing plots learning a visually grounded storyline model from annotated videos. In: IEEE ICCV. Venice, pp. 4404–4414
25.
Zurück zum Zitat Cai M, Lu F, Gao Y (2019) Desktop action recognition from first-person point-of-view. IEEE Trans Cybern 49(5):1–13CrossRef Cai M, Lu F, Gao Y (2019) Desktop action recognition from first-person point-of-view. IEEE Trans Cybern 49(5):1–13CrossRef
26.
Zurück zum Zitat Yan R, Tang J, Shu X, Li Z, Tian Q (2018) Participation-Contributed Temporal Dynamic Model for Group Activity Recognition. Association for computing machinery, New York, pp. 1292–1300 Yan R, Tang J, Shu X, Li Z, Tian Q (2018) Participation-Contributed Temporal Dynamic Model for Group Activity Recognition. Association for computing machinery, New York, pp. 1292–1300
27.
Zurück zum Zitat Neumann L, Zisserman A, Vedaldi A (2019) Future Event Prediction: If and When. In: IEEE CVPR Workshops Neumann L, Zisserman A, Vedaldi A (2019) Future Event Prediction: If and When. In: IEEE CVPR Workshops
28.
Zurück zum Zitat Miech A, Laptev I, Sivic J, Wang H, Torresani L, Tran D (2019) Leveraging the Present to Anticipate the Future in Videos. In: IEEE CVPR Workshops Miech A, Laptev I, Sivic J, Wang H, Torresani L, Tran D (2019) Leveraging the Present to Anticipate the Future in Videos. In: IEEE CVPR Workshops
29.
Zurück zum Zitat Liang J, Jiang L, Niebles JC, Hauptmann AG (2019) L. Fei-Fei, Peeking into the Future: Predicting Future Person Activities and Locations in Videos. In: IEEE Proc. on CVPR Liang J, Jiang L, Niebles JC, Hauptmann AG (2019) L. Fei-Fei, Peeking into the Future: Predicting Future Person Activities and Locations in Videos. In: IEEE Proc. on CVPR
30.
Zurück zum Zitat Lei J, Yu L, Berg T, Bansal M (2020) What is More Likely to Happen Next? Video-and-Language Future Event Prediction. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp. 8769–8784 Lei J, Yu L, Berg T, Bansal M (2020) What is More Likely to Happen Next? Video-and-Language Future Event Prediction. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp. 8769–8784
32.
Zurück zum Zitat Chebi H, Benaissa A (2021) Novel approach by fuzzy logic to deal with dynamic analysis of shadow elimination and occlusion detection in video sequences of high-density scenes. IETE J Res 22:1–12CrossRef Chebi H, Benaissa A (2021) Novel approach by fuzzy logic to deal with dynamic analysis of shadow elimination and occlusion detection in video sequences of high-density scenes. IETE J Res 22:1–12CrossRef
33.
Zurück zum Zitat Chakraborty DB, Pal SK (2021) Rough video conceptualization for real-time event precognition with motion entropy. Inf Sci 543:488–503CrossRef Chakraborty DB, Pal SK (2021) Rough video conceptualization for real-time event precognition with motion entropy. Inf Sci 543:488–503CrossRef
34.
Zurück zum Zitat Possegger H, Sternig S, Mauthner T, Roth PM, Bischof H (2013) Robust Real-Time Tracking of Multiple Objects by Volumetric Mass Densities. In: IEEE Proc. on CVPR Possegger H, Sternig S, Mauthner T, Roth PM, Bischof H (2013) Robust Real-Time Tracking of Multiple Objects by Volumetric Mass Densities. In: IEEE Proc. on CVPR
35.
Zurück zum Zitat PETS-2015 (2015) Dataset Released in IEEE Int. WS Perfor. Evaluation of tracking and surveillance PETS-2015 (2015) Dataset Released in IEEE Int. WS Perfor. Evaluation of tracking and surveillance
36.
Zurück zum Zitat Velastin SA, Gómez-Lira DA (2017) People Detection and Pose Classification Inside a Moving Train Using Computer Vision. In: International visual informatics conference. Springer, pp. 319–330 Velastin SA, Gómez-Lira DA (2017) People Detection and Pose Classification Inside a Moving Train Using Computer Vision. In: International visual informatics conference. Springer, pp. 319–330
37.
Zurück zum Zitat Mitchell TM (1997) Machine learning. McGraw-Hill, New YorkMATH Mitchell TM (1997) Machine learning. McGraw-Hill, New YorkMATH
38.
Zurück zum Zitat PETS-2001 (2001) Datasets Realsed In IEEE Int. WS Perfor. Evaluation of tracking and surveillance PETS-2001 (2001) Datasets Realsed In IEEE Int. WS Perfor. Evaluation of tracking and surveillance
39.
Zurück zum Zitat AVSS-2007 (2007) Datasets Released In Fourth IEEE Int. Conf Adv Video and signal based surveillance AVSS-2007 (2007) Datasets Released In Fourth IEEE Int. Conf Adv Video and signal based surveillance
Metadaten
Titel
Event prediction with rough-fuzzy sets
verfasst von
Debarati B. Chakraborty
JingTao Yao
Publikationsdatum
14.11.2022
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 2/2023
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-022-01119-7

Weitere Artikel der Ausgabe 2/2023

Pattern Analysis and Applications 2/2023 Zur Ausgabe

Premium Partner