Skip to main content

2019 | OriginalPaper | Buchkapitel

Urban Sensing for Anomalous Event Detection:

Distinguishing Between Legitimate Traffic Changes and Abnormal Traffic Variability

verfasst von : Masoomeh Zameni, Mengyi He, Masud Moshtaghi, Zahra Ghafoori, Christopher Leckie, James C. Bezdek, Kotagiri Ramamohanarao

Erschienen in: Machine Learning and Knowledge Discovery in Databases

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Sensors deployed in different parts of a city continuously record traffic data, such as vehicle flows and pedestrian counts. We define an unexpected change in the traffic counts as an anomalous local event. Reliable discovery of such events is very important in real-world applications such as real-time crash detection or traffic congestion detection. One of the main challenges to detecting anomalous local events is to distinguish them from legitimate global traffic changes, which happen due to seasonal effects, weather and holidays. Existing anomaly detection techniques often raise many false alarms for these legitimate traffic changes, making such techniques less reliable. To address this issue, we introduce an unsupervised anomaly detection system that represents relationships between different locations in a city. Our method uses training data to estimate the traffic count at each sensor location given the traffic counts at the other locations. The estimation error is then used to calculate the anomaly score at any given time and location in the network. We test our method on two real traffic datasets collected in the city of Melbourne, Australia, for detecting anomalous local events. Empirical results show the greater robustness of our method to legitimate global changes in traffic count than four benchmark anomaly detection methods examined in this paper. Data related to this paper are available at: https://​vicroadsopendata​-vicroadsmaps.​opendata.​arcgis.​com/​datasets/​147696bb47544a20​9e0a5e79e165d1b0​_​0.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Baras, K., Moreira, A.: Anomaly detection in university campus WiFi zones. In: 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM), pp. 202–207 (2010) Baras, K., Moreira, A.: Anomaly detection in university campus WiFi zones. In: 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM), pp. 202–207 (2010)
4.
Zurück zum Zitat Dani, M.-C., Jollois, F.-X., Nadif, M., Freixo, C.: Adaptive threshold for anomaly detection using time series segmentation. In: International Conference on Neural Information Processing, pp. 82–89 (2015)CrossRef Dani, M.-C., Jollois, F.-X., Nadif, M., Freixo, C.: Adaptive threshold for anomaly detection using time series segmentation. In: International Conference on Neural Information Processing, pp. 82–89 (2015)CrossRef
5.
Zurück zum Zitat Doan, M.T., Rajasegarar, S., Leckie, C.: Profiling pedestrian activity patterns in a dynamic urban environment. In: 4th International Workshop on Urban Computing (UrbComp) (2015) Doan, M.T., Rajasegarar, S., Leckie, C.: Profiling pedestrian activity patterns in a dynamic urban environment. In: 4th International Workshop on Urban Computing (UrbComp) (2015)
6.
Zurück zum Zitat Doan, M.T., Rajasegarar, S., Salehi, M., Moshtaghi, M., Leckie, C.: Profiling pedestrian distribution and anomaly detection in a dynamic environment. In: CIKM, pp. 1827–1830 (2015) Doan, M.T., Rajasegarar, S., Salehi, M., Moshtaghi, M., Leckie, C.: Profiling pedestrian distribution and anomaly detection in a dynamic environment. In: CIKM, pp. 1827–1830 (2015)
7.
Zurück zum Zitat Erfani, S.M., Rajasegarar, S., Karunasekera, S., Leckie, C.: High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning. Pattern Recogn. 58, 121–134 (2016)CrossRef Erfani, S.M., Rajasegarar, S., Karunasekera, S., Leckie, C.: High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning. Pattern Recogn. 58, 121–134 (2016)CrossRef
8.
Zurück zum Zitat Ester, M., Kriegel, H.-P., Sander, J., Xu, X., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD vol. 34, pp. 226–231 (1996) Ester, M., Kriegel, H.-P., Sander, J., Xu, X., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD vol. 34, pp. 226–231 (1996)
9.
Zurück zum Zitat Frias-Martinez, V., Stolfo, S.J., Keromytis, A.D.: Behavior-profile clustering for false alert reduction in anomaly detection sensors. In: Annual Computer Security Applications Conference (ACSAC), pp. 367–376 (2008) Frias-Martinez, V., Stolfo, S.J., Keromytis, A.D.: Behavior-profile clustering for false alert reduction in anomaly detection sensors. In: Annual Computer Security Applications Conference (ACSAC), pp. 367–376 (2008)
10.
Zurück zum Zitat Garcia-Font, V., Garrigues, C., Rifà-Pous, H.: A comparative study of anomaly detection techniques for smart city wireless sensor networks. Sensors 16(6), 868 (2016)CrossRef Garcia-Font, V., Garrigues, C., Rifà-Pous, H.: A comparative study of anomaly detection techniques for smart city wireless sensor networks. Sensors 16(6), 868 (2016)CrossRef
11.
Zurück zum Zitat Ghafoori, Z., Erfani, S.M., Rajasegarar, S., Bezdek, J.C., Karunasekera, S., Leckie, C.: Efficient unsupervised parameter estimation for one-class support vector machines. IEEE Trans. Neural Netw. Learn. Syst. (2018) Ghafoori, Z., Erfani, S.M., Rajasegarar, S., Bezdek, J.C., Karunasekera, S., Leckie, C.: Efficient unsupervised parameter estimation for one-class support vector machines. IEEE Trans. Neural Netw. Learn. Syst. (2018)
13.
Zurück zum Zitat Li, X., Li, Z., Han, J., Lee, J.-G.: Temporal outlier detection in vehicle traffic data. In: IEEE 25th International Conference on Data Engineering (ICDE), pp. 1319–1322 (2009) Li, X., Li, Z., Han, J., Lee, J.-G.: Temporal outlier detection in vehicle traffic data. In: IEEE 25th International Conference on Data Engineering (ICDE), pp. 1319–1322 (2009)
14.
Zurück zum Zitat Limthong, K.: Real-time computer network anomaly detection using machine learning techniques. J. Adv. Comput. Netw. 1(1), 1–5 (2013) Limthong, K.: Real-time computer network anomaly detection using machine learning techniques. J. Adv. Comput. Netw. 1(1), 1–5 (2013)
15.
Zurück zum Zitat Nidhal, A. Ngah, U.K., Ismail, W.: Real time traffic congestion detection system. In: 5th International Conference on Intelligent and Advanced Systems (ICIAS), pp. 1–5 (2014) Nidhal, A. Ngah, U.K., Ismail, W.: Real time traffic congestion detection system. In: 5th International Conference on Intelligent and Advanced Systems (ICIAS), pp. 1–5 (2014)
16.
17.
Zurück zum Zitat Rajasegarar, S., Bezdek, J.C., Moshtaghi, M., Leckie, C., Havens, T.C., Palaniswami, M.: Measures for clustering and anomaly detection in sets of higher dimensional ellipsoids. In: International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2012) Rajasegarar, S., Bezdek, J.C., Moshtaghi, M., Leckie, C., Havens, T.C., Palaniswami, M.: Measures for clustering and anomaly detection in sets of higher dimensional ellipsoids. In: International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2012)
18.
Zurück zum Zitat Rajasegarar, S., et al.: Ellipsoidal neighbourhood outlier factor for distributed anomaly detection in resource constrained networks. Pattern Recogn. 47(9), 2867–2879 (2014)CrossRef Rajasegarar, S., et al.: Ellipsoidal neighbourhood outlier factor for distributed anomaly detection in resource constrained networks. Pattern Recogn. 47(9), 2867–2879 (2014)CrossRef
19.
Zurück zum Zitat Reddy, R.R., Ramadevi, Y., Sunitha, K.: Enhanced anomaly detection using ensemble support vector machine. In: ICBDAC, pp. 107–111 (2017) Reddy, R.R., Ramadevi, Y., Sunitha, K.: Enhanced anomaly detection using ensemble support vector machine. In: ICBDAC, pp. 107–111 (2017)
20.
Zurück zum Zitat Shi, Y., Deng, M., Yang, X., Gong, J.: Detecting anomalies in spatio-temporal flow data by constructing dynamic neighbourhoods. Comput. Environ. Urban Syst. 67, 80–96 (2018)CrossRef Shi, Y., Deng, M., Yang, X., Gong, J.: Detecting anomalies in spatio-temporal flow data by constructing dynamic neighbourhoods. Comput. Environ. Urban Syst. 67, 80–96 (2018)CrossRef
21.
Zurück zum Zitat Tu, J., Duan, Y.: Detecting congestion and detour of taxi trip via GPS data. In: IEEE Second International Conference on Data Science in Cyberspace (DSC), pp. 615–618 (2017) Tu, J., Duan, Y.: Detecting congestion and detour of taxi trip via GPS data. In: IEEE Second International Conference on Data Science in Cyberspace (DSC), pp. 615–618 (2017)
22.
Zurück zum Zitat Tukey, J.W.: Exploratory Data Analysis (1977) Tukey, J.W.: Exploratory Data Analysis (1977)
23.
Zurück zum Zitat Witayangkurn, A., Horanont, T., Sekimoto, Y., Shibasaki, R.: Anomalous event detection on large-scale GPS data from mobile phones using Hidden Markov Model and cloud platform. In: Proceedings of the ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, pp. 1219–1228 (2013) Witayangkurn, A., Horanont, T., Sekimoto, Y., Shibasaki, R.: Anomalous event detection on large-scale GPS data from mobile phones using Hidden Markov Model and cloud platform. In: Proceedings of the ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, pp. 1219–1228 (2013)
Metadaten
Titel
Urban Sensing for Anomalous Event Detection:
verfasst von
Masoomeh Zameni
Mengyi He
Masud Moshtaghi
Zahra Ghafoori
Christopher Leckie
James C. Bezdek
Kotagiri Ramamohanarao
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-10997-4_34