Rene Grzeszick
ABSTRACT
Although the fourth industrial revolution is already in pro-gress and advances have been made in automating factories, completely automated facilities are still far in the future. Human work is still an important factor in many factories and warehouses, especially in the field of logistics. Manual processes are, therefore, often subject to optimization efforts. In order to aid these optimization efforts, methods like human activity recognition (HAR) became of increasing interest in industrial settings. In this work a novel deep neural network architecture for HAR is introduced. A convolutional neural network (CNN), which employs temporal convolutions, is applied to the sequential data of multiple intertial measurement units (IMUs). The network is designed to separately handle different sensor values and IMUs, joining the information step-by-step within the architecture. An evaluation is performed using data from the order picking process recorded in two different warehouses. The influence of different design choices in the network architecture, as well as pre- and post-processing, will be evaluated. Crucial steps for learning a good classification network for the task of HAR in a complex industrial setting will be shown. Ultimately, it can be shown that traditional approaches based on statistical features as well as recent CNN architectures are outperformed.
- Marc Bächlin, Daniel Roggen, Gerhard Tröster, Meir Plotnik, Noit Inbar, Inbal Maidan, Talia Herman, Marina Brozgol, Eliya Shaviv, Nir Giladi, and others. 2009. Potentials of Enhanced Context Awareness in Wearable Assistants for Parkinson's Disease Patients with the Freezing of Gait Syndrome.. In ISWC. 123--130. Google Scholar
Digital Library
- Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A tutorial on human activity recognition using body-worn inertial sensors. ACM Computing Surveys (CSUR) 46, 3 (2014), 33. Google ScholarDigital Library
- Ricardo Chavarriaga, Hesam Sagha, Alberto Calatroni, Sundara Tejaswi Digumarti, Gerhard Tröster, José del R Millán, and Daniel Roggen. 2013. The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition. Pattern Recognition Letters 34, 15 (2013), 2033--2042. Google ScholarDigital Library
- Sascha Feldhorst, Mojtaba Masoudinejad, Michael ten Hompel, and Gernot A. Fink. 2016. Motion Classification for Analyzing the Order Picking Process Using Mobile Sensors. In Proc. Int. Conf. Pattern Recognition Applications and Methods (ICPRAM). Rome, Italy. Google ScholarDigital Library
- Nils Y Hammerla, Shane Halloran, and Thomas Plötz. 2016. Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables. In Proc. Int. Joint Conference on Artificial Intelligence (IJCAI). Google ScholarDigital Library
- R. Koster, T. Le-Duc, and K. J. Roodbergen. 2006. Design and control of warehouse order picking: a literature review. ERIM report series research in management Business processes, logistics and information systems, Vol. 5. ERIM, Rotterdam.Google Scholar
- Matthias Kreil, Bernhard Sick, and Paul Lukowicz. 2016. Coping with variability in motion based activity recognition. In Proceedings of the 3rd International Workshop on Sensor-based Activity Recognition and Interaction. ACM, 4. Google ScholarDigital Library
- M. Krengel, M. Schmauder, Thorsten Schmidt, and K. Turek. 2010. Beschreibung der Dynamik manueller Operationen in logistischen Systemen: Schlussbericht. Dresden. available German only.Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105. Google ScholarDigital Library
- O. D. Lara and M. A. Labrador. 2013. A Survey on Human Activity Recognition Using Wearable Sensors. IEEE Communications Surveys and Tutorials 15, 3 (2013), 1192--1209.Google ScholarCross Ref
- H. Martin. 2009. Transport- und Lagerlogistik: Planung, Struktur, Steuerung und Kosten von Systemen der Intralogistik (7th ed.). Vieweg+Teubner Verlag / GWV Fachverlage GmbH Wiesbaden, Wiesbaden. available German only.Google Scholar
- Charissa Ann Ronao and Sung-Bae Cho. 2015. Deep convolutional neural networks for human activity recognition with smartphone sensors. In Proc. Int. Conference on Neural Information Processing. Springer, 46--53.Google ScholarCross Ref
- Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. 2015. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV) 115, 3 (2015), 211--252. Google ScholarDigital Library
- K Simonyan and A Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. CoRR abs/1409.1 (2014).Google Scholar
- M. ten Hompel, B. Vogel-Heuser, and T. Bauernhansl (Eds.). 2014. Industrie 4.0 in Produktion, Automatisierung und Logistik: Anwendung, Technologien, Migration. Springer Vieweg, Wiesbaden. available German only.Google Scholar
- Jianbo Yang, Minh Nhut Nguyen, Phyo Phyo San, Xiaoli Li, and Shonali Krishnaswamy. 2015. Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition.. In IJCAI. 3995--4001. Google ScholarDigital Library
- Sergey Zagoruyko and Nikos Komodakis. 2016. Wide Residual Networks. arXiv preprint arXiv:1605.07146 (2016).Google Scholar
Index Terms
- Deep Neural Network based Human Activity Recognition for the Order Picking Process
Recommendations
A Survey on Deep Learning for Human Activity Recognition
Human activity recognition is a key to a lot of applications such as healthcare and smart home. In this study, we provide a comprehensive survey on recent advances and challenges in human activity recognition (HAR) with deep learning. Although there are ...
Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks
MM '15: Proceedings of the 23rd ACM international conference on MultimediaHuman physical activity recognition based on wearable sensors has applications relevant to our daily life such as healthcare. How to achieve high recognition accuracy with low computational cost is an important issue in the ubiquitous computing. Rather ...
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Recently, deep learning (DL) methods have been introduced very successfully into human activity recognition (HAR) scenarios in ubiquitous and wearable computing. Especially the prospect of overcoming the need for manual feature design combined with ...
Comments