Skip to main content

2019 | OriginalPaper | Buchkapitel

On the Inability of Markov Models to Capture Criticality in Human Mobility

verfasst von : Vaibhav Kulkarni, Abhijit Mahalunkar, Benoit Garbinato, John D. Kelleher

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2019: Image Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We examine the non-Markovian nature of human mobility by exposing the inability of Markov models to capture criticality in human mobility. In particular, the assumed Markovian nature of mobility was used to establish an upper bound on the predictability of human mobility, based on the temporal entropy. Since its inception, this bound has been widely used for validating the performance of mobility prediction models. We show that the variants of recurrent neural network architectures can achieve significantly higher prediction accuracy surpassing this upper bound. The central objective of our work is to show that human-mobility dynamics exhibit criticality characteristics which contributes to this discrepancy. In order to explain this anomaly, we shed light on the underlying assumption that human mobility characteristics follow an exponential decay that has resulted in this bias. By evaluating the predictability on real-world datasets, we show that human mobility exhibits scale-invariant long-distance dependencies, bearing resemblance to power-law decay, contrasting with the initial Markovian assumption. We experimentally validate that this assumption inflates the estimated mobility entropy, consequently lowering the upper bound on predictability. We demonstrate that the existing approach of entropy computation tends to overlook the presence of long-distance dependencies and structural correlations in human mobility. We justify why recurrent-neural network architectures that are designed to handle long-distance dependencies surpass the previously computed upper bound on mobility predictability.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Barabasi, A.L.: The origin of bursts and heavy tails in human dynamics. Nature 435(7039), 207 (2005)CrossRef Barabasi, A.L.: The origin of bursts and heavy tails in human dynamics. Nature 435(7039), 207 (2005)CrossRef
2.
Zurück zum Zitat Bialek, W., Tishby, N.: Predictive information. arXiv preprint cond-mat/9902341 (1999) Bialek, W., Tishby, N.: Predictive information. arXiv preprint cond-mat/9902341 (1999)
3.
Zurück zum Zitat Chang, S., et al.: Dilated recurrent neural networks. In: NIPS (2017) Chang, S., et al.: Dilated recurrent neural networks. In: NIPS (2017)
5.
Zurück zum Zitat Cuttone, A., Lehmann, S., González, M.C.: Understanding predictability and exploration in human mobility. EPJ Data Sci. 7(1), 2 (2018)CrossRef Cuttone, A., Lehmann, S., González, M.C.: Understanding predictability and exploration in human mobility. EPJ Data Sci. 7(1), 2 (2018)CrossRef
6.
Zurück zum Zitat Gambs, S., Killijian, M.O., del Prado Cortez, M.N.: Next place prediction using mobility Markov chains. In: Proceedings of the First Workshop on Measurement, Privacy, and Mobility, p. 3. ACM (2012) Gambs, S., Killijian, M.O., del Prado Cortez, M.N.: Next place prediction using mobility Markov chains. In: Proceedings of the First Workshop on Measurement, Privacy, and Mobility, p. 3. ACM (2012)
7.
8.
Zurück zum Zitat Grassberger, P.: Entropy estimates from insufficient samplings. arXiv preprint physics/0307138 (2003) Grassberger, P.: Entropy estimates from insufficient samplings. arXiv preprint physics/0307138 (2003)
9.
Zurück zum Zitat Grossberg, S.: Recurrent neural networks. Scholarpedia 8(2), 1888 (2013)CrossRef Grossberg, S.: Recurrent neural networks. Scholarpedia 8(2), 1888 (2013)CrossRef
10.
Zurück zum Zitat Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–80 (1997)CrossRef Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–80 (1997)CrossRef
11.
Zurück zum Zitat Ikanovic, E.L., Mollgaard, A.: An alternative approach to the limits of predictability in human mobility. EPJ Data Sci. 6(1), 12 (2017)CrossRef Ikanovic, E.L., Mollgaard, A.: An alternative approach to the limits of predictability in human mobility. EPJ Data Sci. 6(1), 12 (2017)CrossRef
12.
Zurück zum Zitat Khandelwal, U., He, H., Qi, P., Jurafsky, D.: Sharp nearby, fuzzy far away: how neural language models use context. arXiv preprint arXiv:1805.04623 (2018) Khandelwal, U., He, H., Qi, P., Jurafsky, D.: Sharp nearby, fuzzy far away: how neural language models use context. arXiv preprint arXiv:​1805.​04623 (2018)
13.
Zurück zum Zitat Krumme, C., Llorente, A., Cebrian, M., Moro, E., et al.: The predictability of consumer visitation patterns. Sci. Rep. 3, 1645 (2013)CrossRef Krumme, C., Llorente, A., Cebrian, M., Moro, E., et al.: The predictability of consumer visitation patterns. Sci. Rep. 3, 1645 (2013)CrossRef
14.
Zurück zum Zitat Laurila, J.K., et al.: The mobile data challenge: big data for mobile computing research. In: Pervasive Computing, No. EPFL-CONF-192489 (2012) Laurila, J.K., et al.: The mobile data challenge: big data for mobile computing research. In: Pervasive Computing, No. EPFL-CONF-192489 (2012)
15.
Zurück zum Zitat Lesne, A., Blanc, J.L., Pezard, L.: Entropy estimation of very short symbolic sequences. Phys. Rev. E 79(4), 046208 (2009)MathSciNetCrossRef Lesne, A., Blanc, J.L., Pezard, L.: Entropy estimation of very short symbolic sequences. Phys. Rev. E 79(4), 046208 (2009)MathSciNetCrossRef
16.
Zurück zum Zitat Lin, H.W., Tegmark, M.: Critical behavior from deep dynamics: a hidden dimension in natural language. arXiv preprint arXiv:1606.06737 (2016) Lin, H.W., Tegmark, M.: Critical behavior from deep dynamics: a hidden dimension in natural language. arXiv preprint arXiv:​1606.​06737 (2016)
17.
Zurück zum Zitat Lin, H.W., Tegmark, M.: Critical behavior in physics and probabilistic formal languages. Entropy 19(7), 299 (2017)CrossRef Lin, H.W., Tegmark, M.: Critical behavior in physics and probabilistic formal languages. Entropy 19(7), 299 (2017)CrossRef
18.
Zurück zum Zitat Lu, X., Wetter, E., Bharti, N., Tatem, A.J., Bengtsson, L.: Approaching the limit of predictability in human mobility. Sci. Rep. 3, 2923 (2013)CrossRef Lu, X., Wetter, E., Bharti, N., Tatem, A.J., Bengtsson, L.: Approaching the limit of predictability in human mobility. Sci. Rep. 3, 2923 (2013)CrossRef
19.
Zurück zum Zitat Massey Jr., F.J.: The Kolmogorov-Smirnov test for goodness of fit. J. Am. Stat. Assoc. 46(253), 68–78 (1951)CrossRef Massey Jr., F.J.: The Kolmogorov-Smirnov test for goodness of fit. J. Am. Stat. Assoc. 46(253), 68–78 (1951)CrossRef
20.
Zurück zum Zitat Merity, S., Xiong, C., Bradbury, J., Socher, R.: Pointer sentinel mixture models. CoRR abs/1609.07843 (2016) Merity, S., Xiong, C., Bradbury, J., Socher, R.: Pointer sentinel mixture models. CoRR abs/1609.07843 (2016)
21.
Zurück zum Zitat Mokhtar, S.B., et al.: PRIVA’MOV: analysing human mobility through multi-sensor datasets. In: NetMob 2017 (2017) Mokhtar, S.B., et al.: PRIVA’MOV: analysing human mobility through multi-sensor datasets. In: NetMob 2017 (2017)
22.
Zurück zum Zitat Newman, M.E.: Power laws, pareto distributions and Zipf’s law. Contemp. Phys. 46(5), 323–351 (2005)CrossRef Newman, M.E.: Power laws, pareto distributions and Zipf’s law. Contemp. Phys. 46(5), 323–351 (2005)CrossRef
23.
Zurück zum Zitat Pérez-Cruz, F.: Kullback-Leibler divergence estimation of continuous distributions. In: 2008 IEEE International Symposium on Information Theory, pp. 1666–1670 (2008) Pérez-Cruz, F.: Kullback-Leibler divergence estimation of continuous distributions. In: 2008 IEEE International Symposium on Information Theory, pp. 1666–1670 (2008)
24.
Zurück zum Zitat Prelov, V.V., van der Meulen, E.C.: Mutual information, variation, and Fano’s inequality. Probl. Inf. Trans. 44(3), 185–197 (2008)CrossRef Prelov, V.V., van der Meulen, E.C.: Mutual information, variation, and Fano’s inequality. Probl. Inf. Trans. 44(3), 185–197 (2008)CrossRef
25.
Zurück zum Zitat Schmidhuber, J.: Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015)CrossRef Schmidhuber, J.: Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015)CrossRef
26.
Zurück zum Zitat Smith, G., Wieser, R., Goulding, J., Barrack, D.: A refined limit on the predictability of human mobility. In: 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 88–94. IEEE (2014) Smith, G., Wieser, R., Goulding, J., Barrack, D.: A refined limit on the predictability of human mobility. In: 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 88–94. IEEE (2014)
27.
Zurück zum Zitat Song, C., Qu, Z., Blumm, N., Barabási, A.L.: Limits of predictability in human mobility. Science 327(5968), 1018–1021 (2010)MathSciNetCrossRef Song, C., Qu, Z., Blumm, N., Barabási, A.L.: Limits of predictability in human mobility. Science 327(5968), 1018–1021 (2010)MathSciNetCrossRef
28.
Zurück zum Zitat Song, L., Kotz, D., Jain, R., He, X.: Evaluating next-cell predictors with extensive Wi-Fi mobility data. IEEE Trans. Mob. Comput. 5(12), 1633–1649 (2006)CrossRef Song, L., Kotz, D., Jain, R., He, X.: Evaluating next-cell predictors with extensive Wi-Fi mobility data. IEEE Trans. Mob. Comput. 5(12), 1633–1649 (2006)CrossRef
29.
Zurück zum Zitat Storer, J.A.: Data Compression: Methods and Theory. Computer Science Press, Inc., Rockville (1987) Storer, J.A.: Data Compression: Methods and Theory. Computer Science Press, Inc., Rockville (1987)
30.
Zurück zum Zitat Yan, X.Y., Han, X.P., Wang, B.H., Zhou, T.: Diversity of individual mobility patterns and emergence of aggregated scaling laws. Sci. Rep. 3, 2678 (2013)CrossRef Yan, X.Y., Han, X.P., Wang, B.H., Zhou, T.: Diversity of individual mobility patterns and emergence of aggregated scaling laws. Sci. Rep. 3, 2678 (2013)CrossRef
31.
Zurück zum Zitat Zhao, Z.D., Cai, S.M., Lu, Y.: Non-Markovian character in human mobility online and offline. Chaos: Interdisc. J. Nonlinear Sci. 25(6), 063106 (2015)CrossRef Zhao, Z.D., Cai, S.M., Lu, Y.: Non-Markovian character in human mobility online and offline. Chaos: Interdisc. J. Nonlinear Sci. 25(6), 063106 (2015)CrossRef
32.
Zurück zum Zitat Zheng, Y., Xie, X., Ma, W.Y.: Geolife: a collaborative social networking service among user, location and trajectory. IEEE Data Eng. Bull. 33(2), 32–39 (2010) Zheng, Y., Xie, X., Ma, W.Y.: Geolife: a collaborative social networking service among user, location and trajectory. IEEE Data Eng. Bull. 33(2), 32–39 (2010)
33.
Zurück zum Zitat Zilly, J.G., Srivastava, R.K., Koutník, J., Schmidhuber, J.: Recurrent highway networks. In: ICML (2017) Zilly, J.G., Srivastava, R.K., Koutník, J., Schmidhuber, J.: Recurrent highway networks. In: ICML (2017)
34.
Zurück zum Zitat Ziv, J., Lempel, A.: Compression of individual sequences via variable-rate coding. IEEE Trans. Inf. Theory 24(5), 530–536 (1978)MathSciNetCrossRef Ziv, J., Lempel, A.: Compression of individual sequences via variable-rate coding. IEEE Trans. Inf. Theory 24(5), 530–536 (1978)MathSciNetCrossRef
Metadaten
Titel
On the Inability of Markov Models to Capture Criticality in Human Mobility
verfasst von
Vaibhav Kulkarni
Abhijit Mahalunkar
Benoit Garbinato
John D. Kelleher
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-30508-6_39

Premium Partner