Konstantinos Tsiakas
Michalis Papakostas
ABSTRACT
There is a recent trend of research and applications of Cyber-Physical Systems (CPS) in manufacturing to enhance human-robot collaboration and production. In this paper, we propose a CPS framework for personalized Human-Robot Collaboration and Training to promote safe human-robot collaboration in manufacturing environments. We propose a human-centric CPS approach that focuses on multimodal human behavior monitoring and assessment, to promote human worker safety and enable human training in Human-Robot Collaboration tasks. We present the architecture of our proposed system, our experimental testbed and our proposed methods for multimodal physiological sensing, human state monitoring and interactive robot adaptation, to enable personalized interaction.
- R. Alami, A. Albu-Schäffer, A. Bicchi, R. Bischoff, R. Chatila, A. De Luca, A. De Santis, G. Giralt, J. Guiochet, G. Hirzinger, et al. Safe and dependable physical human-robot interaction in anthropic domains: State of the art and challenges. In 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 1--16. IEEE, 2006.Google Scholar
Cross Ref
- M. R. Barrick and M. K. Mount. The big five personality dimensions and job performance: a meta-analysis. Personnel psychology, 44(1):1--26, 1991.Google ScholarCross Ref
- A. Bauer, D. Wollherr, and M. Buss. Human--robot collaboration: a survey. International Journal of Humanoid Robotics, 5(01):47--66, 2008.Google ScholarCross Ref
- L. R. Goldberg. The structure of phenotypic personality traits. American psychologist, 48(1):26, 1993.Google ScholarCross Ref
- B. Hayes and B. Scassellati. Challenges in shared-environment human-robot collaboration. learning, 8:9, 2013.Google Scholar
- J. Hemminghaus and S. Kopp. Towards adaptive social behavior generation for assistive robots using reinforcement learning. Proceedings of Human-Robot-Interaction 2017, 2017. Google ScholarDigital Library
- C. Heyer. Human-robot interaction and future industrial robotics applications. In Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, pages 4749--4754. IEEE, 2010.Google ScholarCross Ref
- A. Holzinger. Interactive machine learning for health informatics: when do we need the human-in-the-loop? Brain Informatics, 3(2):119--131, 2016.Google ScholarCross Ref
- A. Khalid, P. Kirisci, Z. Ghrairi, J. Pannek, and K. Thoben. A methodology to develop collaborative robotic cyber physical systems for production environments. Logistics Research, 9(1):1--15, 2016.Google ScholarCross Ref
- A. Khalid, P. Kirisci, Z. Ghrairi, J. Pannek, and K. Thoben. Safety requirements in collaborative human-robot cyber physical system. In 5th International Conference on Dynamics in Logistics (LDIC), Bremen, Germany. Springer, 2016.Google Scholar
- D. Kulic and E. A. Croft. Affective state estimation for human--robot interaction. IEEE Transactions on Robotics, 23(5):991--1000, 2007. Google ScholarDigital Library
- E. A. Lee. Cyber-physical systems-are computing foundations adequate. In Position Paper for NSF Workshop On Cyber-Physical Systems: Research Motivation, Techniques and Roadmap, volume 2. Citeseer, 2006.Google Scholar
- L. Monostori. Cyber-physical production systems: Roots, expectations and r&d challenges. Procedia CIRP, 17:9--13, 2014.Google ScholarCross Ref
- H. Muccini, M. Sharaf, and D. Weyns. Self-adaptation for cyber-physical systems: a systematic literature review. In Proceedings of the 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, pages 75--81. ACM, 2016. Google ScholarDigital Library
- S. Nikolaidis, A. Kuznetsov, D. Hsu, and S. Srinivasa. Formalizing human-robot mutual adaptation: A bounded memory model. In Human-Robot Interaction (HRI), 2016 11th ACM/IEEE, pages 75--82. IEEE, 2016. Google ScholarDigital Library
- S. Nikolaidis and J. Shah. Human-robot teaming using shared mental models. ACM/IEEE HRI, 2012.Google Scholar
- M.-P. Pacaux-Lemoine, D. Trentesaux, and G. Z. Rey. Human-machine cooperation to design intelligent manufacturing systems. In Industrial Electronics Society, IECON 2016-42nd Annual Conference of the IEEE, pages 5904--5909. IEEE, 2016.Google Scholar
- A. Papangelis, G. Galatas, K. Tsiakas, A. Lioulemes, D. Zikos, and F. Makedon. A Dialogue System for Ensuring Safe Rehabilitation. In International Conference on Universal Access in Human-Computer Interaction, pages 349--358. Springer, 2014. Google ScholarDigital Library
- V. Pérez-Rosas, M. Abouelenien, R. Mihalcea, and M. Burzo. Deception detection using real-life trial data. In Proceedings of the 2015 ACM ICML, pages 59--66. ACM, 2015. Google ScholarDigital Library
- V. Pérez-Rosas, R. Mihalcea, A. Narvaez, and M. Burzo. A multimodal dataset for deception detection. In LREC, pages 3118--3122, 2014.Google Scholar
- S. Robert, S. Büttner, C. Röcker, and A. Holzinger. Reasoning under uncertainty: Towards collaborative interactive machine learning. In Machine Learning for Health Informatics, pages 357--376. Springer, 2016.Google ScholarCross Ref
- J. L. Schuyler and R. M. Mahoney. Assessing human-robotic performance for vocational placement. IEEE Transactions on Rehabilitation Engineering, 8(3):394--404, 2000.Google ScholarCross Ref
- W. Sheng, A. Thobbi, and Y. Gu. An integrated framework for human--robot collaborative manipulation. IEEE transactions on cybernetics, 45(10):2030--2041, 2015.Google Scholar
- S. Solutions. Job Satisfaction Survey, 2016.Google Scholar
- P. E. Spector. Measurement of human service staff satisfaction: Development of the Job Satisfaction Survey. American journal of community psychology, 13(6):693--713, 1985.Google Scholar
- P. E. Spector. Job satisfaction: Application, assessment, causes, and consequences, volume 3. Sage publications, 1997.Google Scholar
- P. E. Spector. Job Satisfaction Survey, 2001.Google Scholar
- K. Tsiakas, M. Abujelala, A. Lioulemes, and F. Makedon. An intelligent interactive learning and adaptation framework for robot-based vocational training. IEE Symposium Series in Computational Intelligence 2016.Google ScholarCross Ref
- K. Tsiakas, M. Dagioglou, V. Karkaletsis, and F. Makedon. Adaptive robot assisted therapy using interactive reinforcement learning. In International Conference on Social Robotics, pages 11--21. Springer, 2016.Google ScholarCross Ref
- K. Tsiakas, M. Huber, and F. Makedon. A multimodal adaptive session manager for physical rehabilitation exercising. In Proceedings of the 8th ACM PETRA Conference, page 33. ACM, 2015. Google ScholarDigital Library
- L. Wang, M. Törngren, and M. Onori. Current status and advancement of cyber-physical systems in manufacturing. Journal of Manufacturing Systems, 37(Part 2):517--527, 2015.Google Scholar
- S. Wang. Uta researchers building app to predict emotions, 2016.Google Scholar
- S. Wang, S. R. Bowen, W. A. Chaovalitwongse, G. A. Sandison, T. J. Grabowski, and P. E. Kinahan. Respiratory trace feature analysis for the prediction of respiratory-gated pet quantification. Physics in medicine and biology, 59(4):1027, 2014.Google Scholar
- S. Wang, W. A. Chaovalitwongse, and S. Wong. Online seizure prediction using an adaptive learning approach. IEEE transactions on knowledge and data engineering, 25(12):2854--2866, 2013. Google ScholarDigital Library
- S. Wang, W. A. Chaovalitwongse, and S. Wong. A gradient-based adaptive learning framework for online seisure prediction. International journal of data mining and bioinformatics, 10(1):49--64, 2014. Google ScholarDigital Library
- S. Wang, J. Gwizdka, and W. A. Chaovalitwongse. Using wireless eeg signals to assess memory workload in the n-back task. IEEE Transactions on Human-Machine Systems, 46(3):424--435, 2016.Google ScholarCross Ref
- S. Ying et al. Foundations for innovation in cyber-physical systems. In Workshop Report, Energetics Incorporated, Columbia, Maryland, US, 2013.Google Scholar
- C. Yu, X. Xu, and Y. Lu. Computer-integrated manufacturing, cyber-physical systems and cloud manufacturing--concepts and relationships. Manufacturing letters, 6:5--9, 2015.Google ScholarCross Ref
- C.-B. Zamfirescu, B.-C. Pirvu, D. Gorecky, and H. Chakravarthy. Human-centred assembly: a case study for an anthropocentric cyber-physical system. Procedia Technology, 15:90--98, 2014.Google ScholarCross Ref
Index Terms
- An Interactive Multisensing Framework for Personalized Human Robot Collaboration and Assistive Training Using Reinforcement Learning
Recommendations
Transitional or partnership human and robot collaboration for automotive assembly
PerMIS '10: Proceedings of the 10th Performance Metrics for Intelligent Systems WorkshopTraditional automotive manufacturing tasks that are automated to date by industrial robots utilize a human robot exclusion strategy for normal production. Although new generations of robots are envisioned to emulate humans' capabilities to collaborate ...
Interactive Model Fitting for Human Robot Collaboration
ICEBE '14: Proceedings of the 2014 IEEE 11th International Conference on e-Business EngineeringWe participated DARPA Robotics Challenges (DRC) Trial in Homestead, Florida, USA in December 2013. In this paper, we describe human robot collaboration (HRC) extending typical human machine interaction (HMI) for human and robot to work together to ...
Levels of human and robot collaboration for automotive manufacturing
PerMIS '12: Proceedings of the Workshop on Performance Metrics for Intelligent SystemsUnited States Consortium for Automotive Research (USCAR) conducted a concept feasibility study in 2010--2011 to investigate critical requirements to implement fenceless (the long term goal) or minimally fenced (the short term goal) robotics work cells ...
Comments