Skip to main content

2021 | OriginalPaper | Buchkapitel

What Did Our Model Just Learn? Hard Lessons in Applying Deep Learning to Human Factors Data

verfasst von : Brian Weigel, Kaleb Loar, Andrés Colón, Robert Wright

Erschienen in: Advances in Neuroergonomics and Cognitive Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Deep learning is revolutionizing all areas of data science, including human factors research. Much of human factors data, however, have fundamental idiosyncrasies that make applying deep learning challenging. Further, the complexity of deep learning can make finding errors challenging and deducing what was actually learned by the model near impossible. This paper provides two case-studies in which our research group faced and overcame such challenges. It examines the root causes of each issue and discusses how they may lead to common challenges. We describe how we discovered problems and describe how we rectified them. It is our hope, that by sharing our experiences with likely common challenges, we can help other researchers in avoiding similar pitfalls.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
As reported by Google Scholar on January 15, 2021.
 
Literatur
2.
Zurück zum Zitat Goodfellow, I., Bengio, Y., Courville, A., Bengio, Y.: Deep Learning, MIT Press, Cambridge (2016) Goodfellow, I., Bengio, Y., Courville, A., Bengio, Y.: Deep Learning, MIT Press, Cambridge (2016)
3.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems (2012) Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems (2012)
4.
Zurück zum Zitat Stisen, A., et al.: Smart devices are different: assessing and mitigating mobile sensing heterogeneities for activity recog. In: ACM Embedded Networked Sensor System (2015) Stisen, A., et al.: Smart devices are different: assessing and mitigating mobile sensing heterogeneities for activity recog. In: ACM Embedded Networked Sensor System (2015)
5.
Zurück zum Zitat Vaizman, Y., et al.: Recognizing detailed human context in-the-wild from smartphones and smartwatches. IEEE Pervasive Comput. 16(4), 62–74 (2017)CrossRef Vaizman, Y., et al.: Recognizing detailed human context in-the-wild from smartphones and smartwatches. IEEE Pervasive Comput. 16(4), 62–74 (2017)CrossRef
6.
Zurück zum Zitat Ehatisham-Ul-Haq, M., Azam, M.A., Amin, Y., Naeem, U.: C2FHAR: Coarse-to-fine human activity recognition with behavioral context modeling using smart inertial sensors. IEEE Access 8, 7731–7747 (2020)CrossRef Ehatisham-Ul-Haq, M., Azam, M.A., Amin, Y., Naeem, U.: C2FHAR: Coarse-to-fine human activity recognition with behavioral context modeling using smart inertial sensors. IEEE Access 8, 7731–7747 (2020)CrossRef
7.
Zurück zum Zitat Ehatisham-ul-Haq, M., et al.: Using smartphone accelerometer for human physical activity and context recognition in-the-wild. Proc. Comp. Sci. 177, 24–31 (2020)CrossRef Ehatisham-ul-Haq, M., et al.: Using smartphone accelerometer for human physical activity and context recognition in-the-wild. Proc. Comp. Sci. 177, 24–31 (2020)CrossRef
8.
Zurück zum Zitat Fazli, M., Kowsari, K., Gharavi, E., Barnes, L., Doryab, A.: HHAR-net: hierarchical human activity recognition using neural networks, arXiv:2010.16052 [cs, eess, stat] (2020) Fazli, M., Kowsari, K., Gharavi, E., Barnes, L., Doryab, A.: HHAR-net: hierarchical human activity recognition using neural networks, arXiv:​2010.​16052 [cs, eess, stat] (2020)
9.
Zurück zum Zitat Imani, M., et al.: A framework for collaborative learning in secure high-dimensional space. In: IEEE 12th International Conference on Cloud Computing (CLOUD) (2019) Imani, M., et al.: A framework for collaborative learning in secure high-dimensional space. In: IEEE 12th International Conference on Cloud Computing (CLOUD) (2019)
10.
Zurück zum Zitat Nguyen, K.T., et al.: Dealing with imbalanced data sets for human activity recognition using mobile phone sensors. In: 3rd International Workshop on Smart Sensing Systems (2018) Nguyen, K.T., et al.: Dealing with imbalanced data sets for human activity recognition using mobile phone sensors. In: 3rd International Workshop on Smart Sensing Systems (2018)
11.
Zurück zum Zitat Reyes-Ortiz, J.-L., Oneto, L., Samá, A., Parra, X., Anguita, D.: Transition-aware human activity recognition using smartphones. Neurocomputing 171, 754–767 (2016)CrossRef Reyes-Ortiz, J.-L., Oneto, L., Samá, A., Parra, X., Anguita, D.: Transition-aware human activity recognition using smartphones. Neurocomputing 171, 754–767 (2016)CrossRef
12.
Zurück zum Zitat Yao, S., et al.: DeepSense: a unified deep learning framework for time-series mobile sensing data processing. In: 26th International Conference on World Wide Web, pp. 351–360 (2017) Yao, S., et al.: DeepSense: a unified deep learning framework for time-series mobile sensing data processing. In: 26th International Conference on World Wide Web, pp. 351–360 (2017)
13.
Zurück zum Zitat Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, Curran Associates, Inc., pp. 2672–2680 (2014) Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, Curran Associates, Inc., pp. 2672–2680 (2014)
14.
Zurück zum Zitat Chen, X., et al.: InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets. In: Neural Information Processing System, pp. 2180–2188 (2016) Chen, X., et al.: InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets. In: Neural Information Processing System, pp. 2180–2188 (2016)
15.
Zurück zum Zitat Spurr, A., et al.: Guiding InfoGAN with Semi-supervision. In: Machine Learning and Knowledge Discovery in Databases, Springer International Publishing, pp. 119–134 (2017) Spurr, A., et al.: Guiding InfoGAN with Semi-supervision. In: Machine Learning and Knowledge Discovery in Databases, Springer International Publishing, pp. 119–134 (2017)
16.
Zurück zum Zitat Baldwin, J., Burnham, R., Meyer, A., Dora, R., Wright, R.: Beyond speech: generalizing D-vectors for biometric verification. In: Proceedings of AAAI 2019, Honolulu, HI (2019) Baldwin, J., Burnham, R., Meyer, A., Dora, R., Wright, R.: Beyond speech: generalizing D-vectors for biometric verification. In: Proceedings of AAAI 2019, Honolulu, HI (2019)
17.
Zurück zum Zitat Vaizman, Y., et al.: ExtraSensory app: data collection in-the-wild with rich user interface to self-report behavior. In: Conference on Human Factors in Computing System, pp. 1–12 (2018) Vaizman, Y., et al.: ExtraSensory app: data collection in-the-wild with rich user interface to self-report behavior. In: Conference on Human Factors in Computing System, pp. 1–12 (2018)
18.
Zurück zum Zitat Mansoor, H., et al.: COMEX: identifying mislabeled human behavioral context data using visual analytics. In: IEEE Computer Software and Applications Conference (2019) Mansoor, H., et al.: COMEX: identifying mislabeled human behavioral context data using visual analytics. In: IEEE Computer Software and Applications Conference (2019)
19.
Zurück zum Zitat Mansoor, H. et al.: DELFI: mislabelled human context detection using multi-feature similarity linking. In IEEE Visualization in Data Science (VDS) (2019) Mansoor, H. et al.: DELFI: mislabelled human context detection using multi-feature similarity linking. In IEEE Visualization in Data Science (VDS) (2019)
20.
Zurück zum Zitat Adams, R., Marlin, B.: Learning time series segmentation models from temporally imprecise labels. In: Conference on Uncertainty in Artificial Intelligence (2018) Adams, R., Marlin, B.: Learning time series segmentation models from temporally imprecise labels. In: Conference on Uncertainty in Artificial Intelligence (2018)
21.
Zurück zum Zitat Imani, M., et al.: QuantHD: a quantization framework for hyperdimensional computing. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 39(10), 2268–2278 (2020)CrossRef Imani, M., et al.: QuantHD: a quantization framework for hyperdimensional computing. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 39(10), 2268–2278 (2020)CrossRef
22.
Zurück zum Zitat Bosch, S., et al.: QubitHD: a stochastic acceleration method for HD computing-based machine learning, arXiv:1911.12446 [cs, stat] (2019) Bosch, S., et al.: QubitHD: a stochastic acceleration method for HD computing-based machine learning, arXiv:​1911.​12446 [cs, stat] (2019)
Metadaten
Titel
What Did Our Model Just Learn? Hard Lessons in Applying Deep Learning to Human Factors Data
verfasst von
Brian Weigel
Kaleb Loar
Andrés Colón
Robert Wright
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-80285-1_7

Premium Partner