Skip to main content

2019 | OriginalPaper | Buchkapitel

Thompson Sampling Based Active Learning in Probabilistic Programs with Application to Travel Time Estimation

verfasst von : Sondre Glimsdal, Ole-Christoffer Granmo

Erschienen in: Advances and Trends in Artificial Intelligence. From Theory to Practice

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The pertinent problem of Traveling Time Estimation (TTE) is to estimate the travel time, given a start location and a destination, solely based on the coordinates of the points under consideration. This is typically solved by fitting a function based on a sequence of observations. However, it can be expensive or slow to obtain labeled data or measurements to calibrate the estimation function. Active Learning tries to alleviate this problem by actively selecting samples that minimize the total number of samples needed to do accurate inference. Probabilistic Programming Languages (PPL) give us the opportunities to apply powerful Bayesian inference to model problems that involve uncertainties. In this paper we combine Thompson Sampling with Probabilistic Programming to perform Active Learning in the Travel Time Estimation setting, outperforming traditional active learning methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Cohn, D.A., Ghahramani, Z., Jordan, M.I.: Active learning with statistical models. J. Artif. Intell. Res. 4, 129–145 (1996)CrossRef Cohn, D.A., Ghahramani, Z., Jordan, M.I.: Active learning with statistical models. J. Artif. Intell. Res. 4, 129–145 (1996)CrossRef
4.
Zurück zum Zitat Freund, Y., Seung, H.S., Shamir, E., Tishby, N.: Selective sampling using the query by committee algorithm. Mach. Learn. 28(2–3), 133–168 (1997)CrossRef Freund, Y., Seung, H.S., Shamir, E., Tishby, N.: Selective sampling using the query by committee algorithm. Mach. Learn. 28(2–3), 133–168 (1997)CrossRef
5.
Zurück zum Zitat Ganti, R., Gray, A.G.: Building bridges: viewing active learning from the multi-armed bandit lens. arXiv preprint arXiv:1309.6830 (2013) Ganti, R., Gray, A.G.: Building bridges: viewing active learning from the multi-armed bandit lens. arXiv preprint arXiv:​1309.​6830 (2013)
6.
Zurück zum Zitat Havelock, J., Oommen, B.J., Granmo, O.C.: Novel distance estimation methods using “stochastic learning on the line” strategies. IEEE Access 6, 48438–48454 (2018)CrossRef Havelock, J., Oommen, B.J., Granmo, O.C.: Novel distance estimation methods using “stochastic learning on the line” strategies. IEEE Access 6, 48438–48454 (2018)CrossRef
7.
Zurück zum Zitat Love, R.F., Morris, J.G.: Modelling inter-city road distances by mathematical functions. J. Oper. Res. Soc. 23(1), 61–71 (1972)CrossRef Love, R.F., Morris, J.G.: Modelling inter-city road distances by mathematical functions. J. Oper. Res. Soc. 23(1), 61–71 (1972)CrossRef
8.
Zurück zum Zitat Mamitsuka, N.A.H., et al.: Query learning strategies using boosting and bagging. In: Machine Learning: Proceedings of the Fifteenth International Conference (ICML 1998), vol. 1 (1998) Mamitsuka, N.A.H., et al.: Query learning strategies using boosting and bagging. In: Machine Learning: Proceedings of the Fifteenth International Conference (ICML 1998), vol. 1 (1998)
9.
Zurück zum Zitat McAuley, J., Yang, A.: Addressing complex and subjective product-related queries with customer reviews. In: Proceedings of the 25th International Conference on World Wide Web, pp. 625–635. International World Wide Web Conferences Steering Committee (2016) McAuley, J., Yang, A.: Addressing complex and subjective product-related queries with customer reviews. In: Proceedings of the 25th International Conference on World Wide Web, pp. 625–635. International World Wide Web Conferences Steering Committee (2016)
10.
Zurück zum Zitat Osugi, T., Kim, D., Scott, S.: Balancing exploration and exploitation: a new algorithm for active machine learning. In: Fifth IEEE International Conference on Data Mining, 8-p. IEEE (2005) Osugi, T., Kim, D., Scott, S.: Balancing exploration and exploitation: a new algorithm for active machine learning. In: Fifth IEEE International Conference on Data Mining, 8-p. IEEE (2005)
11.
Zurück zum Zitat Salvatier, J., Wiecki, T.V., Fonnesbeck, C.: Probabilistic programming in python using PYMC3. PeerJ Comput. Sci. 2, e55 (2016)CrossRef Salvatier, J., Wiecki, T.V., Fonnesbeck, C.: Probabilistic programming in python using PYMC3. PeerJ Comput. Sci. 2, e55 (2016)CrossRef
12.
Zurück zum Zitat Settles, B.: Active learning literature survey. Computer Sciences Technical report 1648, University of Wisconsin-Madison (2009) Settles, B.: Active learning literature survey. Computer Sciences Technical report 1648, University of Wisconsin-Madison (2009)
13.
Zurück zum Zitat Seung, H.S., Opper, M., Sompolinsky, H.: Query by committee. In: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 287–294. ACM (1992) Seung, H.S., Opper, M., Sompolinsky, H.: Query by committee. In: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 287–294. ACM (1992)
Metadaten
Titel
Thompson Sampling Based Active Learning in Probabilistic Programs with Application to Travel Time Estimation
verfasst von
Sondre Glimsdal
Ole-Christoffer Granmo
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-22999-3_7

Premium Partner