Skip to main content

2021 | OriginalPaper | Buchkapitel

Machine Vision to Empower an Intelligent Personal Assistant for Assembly Tasks

verfasst von : Matheus Talacio, Gustavo Funchal, Victória Melo, Luis Piardi, Marcos Vallim, Paulo Leitao

Erschienen in: Optimization, Learning Algorithms and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the context of the fourth industrial revolution, the integration of human operators in emergent cyber-physical systems assumes a crucial relevance. In this context, humans and machines can not be considered in an isolated manner but instead regarded as a collaborative and symbiotic team. Methodologies based on the use of intelligent assistants that guide human operators during the execution of their operations, taking advantage of user friendly interfaces, artificial intelligence (AI) and virtual reality (VR) technologies, become an interesting approach to industrial systems. This is particularly helpful in the execution of customised and/or complex assembly and maintenance operations. This paper presents the development of an intelligent personal assistant that empowers operators to perform faster and more cost-effectively their assembly operations. The developed approach considers ICT technologies, and particularly machine vision and image processing, to guide operators during the execution of their tasks, and particularly to verify the correctness of performed operations, contributing to increase productivity and efficiency, mainly in the assembly of complex products.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abidi, M., Al-Ahmari, A., Ahmad, A., Ameen, W., Alkhalefah, H.: Assessment of virtual reality-based manufacturing assembly training system. Int. J. Adv. Manuf. Technol. 105, 3743–3759 (2019)CrossRef Abidi, M., Al-Ahmari, A., Ahmad, A., Ameen, W., Alkhalefah, H.: Assessment of virtual reality-based manufacturing assembly training system. Int. J. Adv. Manuf. Technol. 105, 3743–3759 (2019)CrossRef
2.
Zurück zum Zitat de Barcelos Silva, A., et al.: Intelligent personal assistants: a systematic literature review. Expert Syst. Appl. 147, 113193 (2020) de Barcelos Silva, A., et al.: Intelligent personal assistants: a systematic literature review. Expert Syst. Appl. 147, 113193 (2020)
3.
Zurück zum Zitat Fantini, P., et al.: Exploring the Integration of the human as a flexibility factor in cps enabled manufacturing environments: methodology and results. In: Proceedings of the 42nd Annual Conference of IEEE Industrial Electronics Society (IECON 2016), pp. 5711–5716 (2016) Fantini, P., et al.: Exploring the Integration of the human as a flexibility factor in cps enabled manufacturing environments: methodology and results. In: Proceedings of the 42nd Annual Conference of IEEE Industrial Electronics Society (IECON 2016), pp. 5711–5716 (2016)
4.
Zurück zum Zitat Frigo, M.A., da Silva, E.C., Barbosa, G.F.: Augmented reality in aerospace manufacturing: a review. J. Ind. Intell. Inf. 4(2), 125–130 (2016) Frigo, M.A., da Silva, E.C., Barbosa, G.F.: Augmented reality in aerospace manufacturing: a review. J. Ind. Intell. Inf. 4(2), 125–130 (2016)
5.
Zurück zum Zitat Gilchrist, A.: Industry 4.0: The Industrial Internet of Things. Springer, Heidelberg (2016) Gilchrist, A.: Industry 4.0: The Industrial Internet of Things. Springer, Heidelberg (2016)
6.
Zurück zum Zitat Hauswald, J., Laurenzano, M.A., Zhang, Y., et al.: Sirius: an open end-to-end voice and vision personal assistant and its implications for future warehouse scale computers. In: 20th International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 223–238 (2015) Hauswald, J., Laurenzano, M.A., Zhang, Y., et al.: Sirius: an open end-to-end voice and vision personal assistant and its implications for future warehouse scale computers. In: 20th International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 223–238 (2015)
7.
Zurück zum Zitat Hoedt, S., Claeys, A., Landeghem, H.V., Cottyn, J.: The evaluation of an elementary virtual training system for manual assembly. Int. J. Prod. Res. 55(24), 7496–7508 (2017)CrossRef Hoedt, S., Claeys, A., Landeghem, H.V., Cottyn, J.: The evaluation of an elementary virtual training system for manual assembly. Int. J. Prod. Res. 55(24), 7496–7508 (2017)CrossRef
8.
Zurück zum Zitat Krupitzer, C., et al.: A survey on human machine interaction in industry 4.0. CoRR abs/2002.01025 (2020) Krupitzer, C., et al.: A survey on human machine interaction in industry 4.0. CoRR abs/2002.01025 (2020)
9.
Zurück zum Zitat Leitão, P., Colombo, A.W., Karnouskos, S.: Industrial automation based on cyber-physical systems technologies: prototype implementations and challenges. Comput. Ind. 81, 11–25 (2016)CrossRef Leitão, P., Colombo, A.W., Karnouskos, S.: Industrial automation based on cyber-physical systems technologies: prototype implementations and challenges. Comput. Ind. 81, 11–25 (2016)CrossRef
10.
Zurück zum Zitat Mantovani, G.: VR Learning: Potential and Challenges for the Use of 3D. Towards Cyberpsychology: Mind, Cognitions, and Society in the Internet Age, pp. 208–225 (2003) Mantovani, G.: VR Learning: Potential and Challenges for the Use of 3D. Towards Cyberpsychology: Mind, Cognitions, and Society in the Internet Age, pp. 208–225 (2003)
11.
Zurück zum Zitat Mohd Ali, N., Md Rashid, N.K.A., Mustafah, Y.M.: Performance comparison between RGB and HSV color segmentations for road signs detection. In: Advances in Manufacturing and Mechanical Engineering. Applied Mechanics and Materials, vol. 393, pp. 550–555. Trans Tech Publications Ltd (2013) Mohd Ali, N., Md Rashid, N.K.A., Mustafah, Y.M.: Performance comparison between RGB and HSV color segmentations for road signs detection. In: Advances in Manufacturing and Mechanical Engineering. Applied Mechanics and Materials, vol. 393, pp. 550–555. Trans Tech Publications Ltd (2013)
12.
Zurück zum Zitat Morgado, M., Miguel, L.: Ergonomics in the industry 4.0: virtual and augmented reality. J. Ergon. 08 (2018) Morgado, M., Miguel, L.: Ergonomics in the industry 4.0: virtual and augmented reality. J. Ergon. 08 (2018)
13.
Zurück zum Zitat Pierdicca, R., Frontoni, E., Pollini, R., Trani, M., Verdini, L.: The use of augmented reality glasses for the application in industry 4.0. In: Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 389–401 (2017) Pierdicca, R., Frontoni, E., Pollini, R., Trani, M., Verdini, L.: The use of augmented reality glasses for the application in industry 4.0. In: Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 389–401 (2017)
14.
Zurück zum Zitat Romero, D., et al.: Towards an operator 4.0 typology: a human-centric perspective on the fourth industrial revolution technologies. In: Proceedings of the Int’l Conference on Computers and Industrial Engineering, pp. 1–11 (2016) Romero, D., et al.: Towards an operator 4.0 typology: a human-centric perspective on the fourth industrial revolution technologies. In: Proceedings of the Int’l Conference on Computers and Industrial Engineering, pp. 1–11 (2016)
15.
Zurück zum Zitat Webel, S., Bockholt, U., Engelke, T., Gavish, N., Olbrich, M., Preusche, C.: Augmented reality training for assembly and maintenance skills. Robot. Auton. Syst. 61(4), 398–403 (2013)CrossRef Webel, S., Bockholt, U., Engelke, T., Gavish, N., Olbrich, M., Preusche, C.: Augmented reality training for assembly and maintenance skills. Robot. Auton. Syst. 61(4), 398–403 (2013)CrossRef
16.
Zurück zum Zitat Zhu, Z., et al.: AR-mentor: augmented reality based mentoring system. In: Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014), pp. 17–22 (2014) Zhu, Z., et al.: AR-mentor: augmented reality based mentoring system. In: Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014), pp. 17–22 (2014)
Metadaten
Titel
Machine Vision to Empower an Intelligent Personal Assistant for Assembly Tasks
verfasst von
Matheus Talacio
Gustavo Funchal
Victória Melo
Luis Piardi
Marcos Vallim
Paulo Leitao
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-91885-9_33

Premium Partner