nach oben

Erschienen in:

2024 | OriginalPaper | Buchkapitel

Human-Centered Solutions Based on Automated Visual Inspection System

verfasst von : Joan Lario, N. P. García-de-la-Puente, Eric López, Manuel Olbrich, Valery Naranjo

Erschienen in: Navigating Unpredictability: Collaborative Networks in Non-linear Worlds

Verlag: Springer Nature Switzerland

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Conventional painting inspections in the wind industry rely on human labour to visually inspect the parts, and the mental and physical fatigue of the operator influences the accuracy. The advances introduced on camera sensors, robots, and artificial intelligence algorithms can create a collaborative working environment between operators and automated visual inspection system.

One of the main challenges for the automatic painting inspection system is the integration with autonomous guided vehicle to perform the inspection routes, and the communication of the data generated during the inspection (defect detection, location, etc.) to the augmented reality platform to send the specific information to the operator to perform the painting repairing operation.

Current research aims to define a framework where integrating non-destructive inspection technologies, autonomous guided vehicles, and augmented reality will allow a symbiotic collaboration between humans and robots. The interoperability between these three solutions will increase the Human-Robot Collaboration in a wind tower painting process, improving product quality assurance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Bidirectional Integration of Digital Product Passports into Information Systems of Production Planning and Control

Nächstes Kapitel Integration of Artificial Intelligence in Manufacturing Companies for Achieving Zero Waste – A Systematic Literature Review

Psarommatis, F., Sousa, J., Mendonça, J.P., Kiritsis, D.: Zero-defect manufacturing the approach for higher manufacturing sustainability in the era of industry 4.0: a position paper. Int. J. Prod. Res. 60(1), 73–91 (2022). https://doi.org/10.1080/00207543.2021.1987551CrossRef

Azamfirei, V., Psarommatis, F., Lagrosen, Y.: Application of automation for in-line quality inspection, a zero-defect manufacturing approach. J. Manuf. Syst. 67(December), 1–22 (2023). https://doi.org/10.1016/j.jmsy.2022.12.010

Colledani, M., et al.: Design and management of manufacturing systems for production quality. CIRP Ann. Manuf. Technol. 63(2), 773–796 (2014). https://doi.org/10.1016/j.cirp.2014.05.002CrossRef

Eger, F., et al.: Zero defect manufacturing strategies for reduction of scrap and inspection effort in multi-stage production systems. Proc. CIRP 67, 368–373 (2018). https://doi.org/10.1016/j.procir.2017.12.228CrossRef

Tanane, B., Dafflon, B., Bentaha, M.L., Moalla, N., Ferreiro, V.: Toward a collaborative sensor network integration for SMEs’ Zero-Defect Manufacturing, vol. 662 IFIP. Springer International Publishing (2022). https://doi.org/10.1007/978-3-031-14844-6_3

Rožanec, J.M., et al.: Towards a comprehensive visual quality inspection for industry 4.0. IFAC-PapersOnLine 55(10), 690–695 (2022). https://doi.org/10.1016/j.ifacol.2022.09.486CrossRef

United Nations: Global impact of the war in Ukraine : billions of people face the greatest cost-of-living crisis in a generation. United Nations, no. 2nd Brief, pp. 2–25 (2022) [Online]. Available: https://unsdg.un.org/sites/default/files/2022-06/GCRG_2nd-Brief_Jun8_2022_FINAL.pdf

Índice (2022)

Verheugen, G.: European commission. Pharmaceut. Policy Law 6, 1–2 (2005). https://doi.org/10.1787/9789264238770-19-enCrossRef

10.

Sweco and Guidehouse: Recommendations for an integrated framework for the financing of joint ( hybrid ) offshore wind projects (2020)

11.

European Commission: PART 1:Impact Assessment, accompanying Communication ’Stepping up Europe’s 2030 climate ambition – Investing in a climate-neutral future for the benefit of our people. SWD – Staff and joint working documents, European Commission, vol. September, no. 176 final, 2020, [Online]. Available: https://ec.europa.eu/clima/sites/clima/files/eu-climate-action/docs/impact_en.pdf

12.

MRizky, A.: 済無No Title No Title No Title. Paper Knowledge. Toward a Media History of Documents, pp. 12–26 (2020)

13.

Tsiropoulos, I., Nijs, W., Tarvydas, D., Ruiz Castello, P.: Towards net-zero emissions in the EU energy system by 2050 (2020). https://doi.org/10.2760/081488

14.

European Commission: Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions: An EU Strategy to harness the potential of offshore renewable energy for a climate neutral future. COM(2020) 741 final, p. 27 (2020)

15.

Sarkar, B., Saren, S.: Product inspection policy for an imperfect production system with inspection errors and warranty cost. Eur. J. Oper. Res. 248(1), 263–271 (2016). https://doi.org/10.1016/j.ejor.2015.06.021CrossRef

16.

Arrais, R., Costa, C.M., Ribeiro, P., Rocha, L.F., Silva, M., Veiga, G.: On the development of a collaborative robotic system for industrial coating cells. Int. J. Adv. Manuf. Technol. 115(3), 853–871 (2021). https://doi.org/10.1007/s00170-020-06167-zCrossRef

17.

Wang, L., Liu, S., Liu, H., Wang, X.V.: Overview of Human-Robot Collaboration in Manufacturing, no. May. Springer International Publishing (2020). https://doi.org/10.1007/978-3-030-46212-3_2.

18.

Liu, S., Wang, L., Wang, X.V.: Symbiotic human-robot collaboration: multimodal control using function blocks. Proc. CIRP 93(March), 1188–1193 (2020). https://doi.org/10.1016/j.procir.2020.03.022CrossRef

19.

Cameron, J.A.: Assessing work-related body-part discomfort: current strategies and a behaviorally oriented assessment tool. Int. J. Ind. Ergon. 18(5–6), 389–398 (1996). https://doi.org/10.1016/0169-8141(95)00101-8CrossRef

20.

Williams, N.: The borg rating of perceived exertion (RPE) scale. Occup. Med. (Chic. Ill.) 67(5), 404–405 (2017). https://doi.org/10.1093/occmed/kqx063CrossRef

21.

Rigotti, T., Schyns, B., Mohr, G.: A short version of the occupational self-efficacy scale: structural and construct validity across five countries. J. Career Assess. 16(2), 238–255 (2008). https://doi.org/10.1177/1069072707305763CrossRef

22.

Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. Adv. Psychol. 52(C), 139–183 (1988). https://doi.org/10.1016/S0166-4115(08)62386-9

23.

Venkatesh, V., Bala, H.: Technology acceptance model 3 and a research agenda on interventions. Decis. Sci. 39(2), 273–315 (2008). https://doi.org/10.1111/j.1540-5915.2008.00192.xCrossRef

24.

Charalambous, G., Fletcher, S., Webb, P.: The development of a scale to evaluate trust in industrial human-robot collaboration. Int. J. Soc. Robot. 8(2), 193–209 (2016). https://doi.org/10.1007/s12369-015-0333-8CrossRef

25.

Jan, Z., et al.: Artificial intelligence for industry 4.0: Systematic review of applications, challenges, and opportunities. Expert Syst. Appl., 216(Dec), 119456 (2023). https://doi.org/10.1016/j.eswa.2022.119456

26.

Voulodimos, A., Doulamis, N., Doulamis, A., Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. 2018 (2018). https://doi.org/10.1155/2018/7068349

27.

Gupta, A.: Current research opportunities for image processing and computer vision. Comp. Sci. 20(4), 389–412 (2019). https://doi.org/10.7494/csci.2019.20.4.3163CrossRef

28.

Wuest, T., Irgens, C., Thoben, K.D.: An approach to monitoring quality in manufacturing using supervised machine learning on product state data. J. Intell. Manuf. 25(5), 1167–1180 (2014). https://doi.org/10.1007/s10845-013-0761-yCrossRef

29.

Ren, L., Wang, T., Laili, Y., Zhang, L.: A data-driven self-supervised LSTM-DeepFM model for industrial soft sensor. IEEE Trans. Industr. Inform. 18(9), 5859–5869 (2022). https://doi.org/10.1109/TII.2021.3131471CrossRef

30.

Cerquitelli, T., Ventura, F., Apiletti, D., Baralis, E., Macii, E., Poncino, Massimo: Enhancing manufacturing intelligence through an unsupervised data-driven methodology for cyclic industrial processes. Exp. Syst. Appl. 182, 115269 (2021). https://doi.org/10.1016/j.eswa.2021.115269CrossRef

31.

Gobert, C., Reutzel, E.W., Petrich, J., Nassar, A.R., Phoha, S.: Application of supervised machine learning for defect detection during metallic powder bed fusion additive manufacturing using high resolution imaging. Additive Manuf. 21, 517–528 (2018). https://doi.org/10.1016/j.addma.2018.04.005CrossRef

32.

Cui, Y., Liu, Z., Lian, S.: A survey on unsupervised anomaly detection algorithms for industrial images. IEEE Access 11(April), 55297–55315 (2023). https://doi.org/10.1109/ACCESS.2023.3282993CrossRef

33.

Wang, J., Shaohui, S., Wang, W., Chu, C., Jiang, L., Ji, Y.: An object detection model for paint surface detection based on improved YOLOv3. Machines 10(4), 261 (2022). https://doi.org/10.3390/machines10040261CrossRef

34.

Adachi, K., Natori, T., Aikawa, N.: Detection and classification of painting defects using deep learning. In: 2021 36th International Technical Conference on Circuits/Systems, Computers and Communications, ITC-CSCC 2021, vol. 2021-Jan, pp. 1–4 (2021). https://doi.org/10.1109/ITC-CSCC52171.2021.9524736

35.

Jezek, S., Jonak, M., Burget, R., Dvorak, P., Skotak, M.: Deep learning-based defect detection of metal parts: evaluating current methods in complex conditions. In: International Congress on Ultra Modern Telecommunications and Control Systems and Workshops, vol. 2021-October, pp. 66–71 (2021). https://doi.org/10.1109/ICUMT54235.2021.9631567

36.

Yang, L., Jiang, H., Song, Q., Guo, J.: A survey on long-tailed visual recognition. Int. J. Comput. Vis. 130(7), 1837–1872 (2022). https://doi.org/10.1007/s11263-022-01622-8CrossRef

37.

Gao, Y., Li, X. Wang, X.V., Wang, L., Gao, L.: A review on recent advances in vision-based defect recognition towards industrial intelligence. J. Manuf. Syst. 62(May), 753–766 (2022). https://doi.org/10.1016/j.jmsy.2021.05.008

38.

Wang, L., Han, M., Li, X., Zhang, N., Cheng, H.: Review of classification methods on unbalanced data sets. IEEE Access 9, 64606–64628 (2021). https://doi.org/10.1109/ACCESS.2021.3074243CrossRef

39.

Liu, Z., Ye, K.: YOLO-IMF: An Improved YOLOv8 Algorithm for Surface Defect Detection in Industrial Manufacturing Field. In: He, S., Lai, J., Zhang, L.-J. (eds.) Metaverse – METAVERSE 2023: 19th International Conference, Held as Part of the Services Conference Federation, SCF 2023, Honolulu, HI, USA, September 23–26, 2023, Proceedings, pp. 15–28. Springer Nature Switzerland, Cham (2023). https://doi.org/10.1007/978-3-031-44754-9_2CrossRef

40.

Liu, J., Zhu, X., Zhou, X., Qian, S., Yu, J.: Defect detection for metal base of TO-can packaged laser diode based on improved YOLO algorithm. Electronics (Switzerland) 11(10), 1–14 (2022). https://doi.org/10.3390/electronics11101561CrossRef

41.

Wang, J., et al.: Toward surface defect detection in electronics manufacturing by an accurate and lightweight YOLO-style object detector. Sci. Rep. 13(1), 1–12 (2023). https://doi.org/10.1038/s41598-023-33804-wMathSciNetCrossRef

42.

Schnellhardt, T., Hemschik, R., Weiß, A., Schoesau, R., Hellmich, A., Ihlenfeldt, S.: Scalable production of large components by industrial robots and machine tools through segmentation. Front. Robot AI 9(Dec), 1–9 (2022). https://doi.org/10.3389/frobt.2022.1021755CrossRef

43.

Yong, L., Zhifu, M., Yuan, X.: Towards advanced manufacturing systems for large parts: a review. Int. J. Adv. Manuf. Technol. 125(7–8), 3003–3022 (2023). https://doi.org/10.1007/s00170-023-10939-8CrossRef

44.

Stillig, J., Brenner, C., Colomb, A.: Adaptive intralogistics with low-cost AGVs for a modular production system. In: Kiefl, N., Wulle, F., Ackermann, C., Holder, D. (eds.) Advances in Automotive Production Technology – Towards Software-Defined Manufacturing and Resilient Supply Chains: Stuttgart Conference on Automotive Production (SCAP2022), pp. 118–132. Springer International Publishing, Cham (2023). https://doi.org/10.1007/978-3-031-27933-1_12CrossRef

45.

Fragapane, G., de Koster, R., Sgarbossa, F., Strandhagen, J.O.: Planning and control of autonomous mobile robots for intralogistics: literature review and research agenda. Eur. J. Oper. Res. 294(2), 405–426 (2021). https://doi.org/10.1016/j.ejor.2021.01.019MathSciNetCrossRef

46.

Shneier, M., Bostelman, R.: Literature review of mobile robots for manufacturing, National Institute of Standards and Technology, US department of Commerce, vol. 8022, pp. 1–17 (2015)

47.

J. D. Boissonnat, J. Burdick, K. Goldberg, and S. Hutchinson, Springer Tracts in Advanced Robotics: Preface, vol. 7 STAR. 2004

48.

Jiang, Z., Xu, Y., Sun, L.: A novel path tracking controller for magnetic guided AGVs. In: Proceedings of the 33rd Chinese Control and Decision Conference, CCDC 2021, pp. 3292–3296 (2021). https://doi.org/10.1109/CCDC52312.2021.9602608

49.

Mendoza-Silva, G.M., Torres-Sospedra, J., Huerta, J.: A meta-review of indoor positioning systems. Sensors (Switzerland) 19(20) (2019). https://doi.org/10.3390/s19204507

50.

Chen, W., et al.: SLAM overview: from single sensor to heterogeneous fusion. Remote Sens. (Basel) 14(23), 1–53 (2022). https://doi.org/10.3390/rs14236033CrossRef

51.

Drahos, P., Kucera, E., Haffner, O., Klimo, I.: Trends in industrial communication and OPC UA. In: Proceedings of the 29th International Conference on Cybernetics and Informatics, K and I 2018, vol. 2018, pp. 1–5, Jan (2018). https://doi.org/10.1109/CYBERI.2018.8337560

52.

Leitner, S.-H., Mahnke, W.: OPC UA – service-oriented architecture for industrial applications. Softwaretechnik-Trends 26(4), 1–6 (2006). https://dl.gi.de/items/2139da16-3041-40a3-957a-8ca600bf4c23

53.

European Central Bank: Economic Bulletin Issue 7/2022. 60640 Frankfurt am Main, Germany (2022). ISSN 2363-3417, QB-BP-22-007-EN-N

Titel: Human-Centered Solutions Based on Automated Visual Inspection System
verfasst von: Joan Lario
N. P. García-de-la-Puente
Eric López
Manuel Olbrich
Valery Naranjo
Verlag: Springer Nature Switzerland
Buch: Navigating Unpredictability: Collaborative Networks in Non-linear Worlds
Print ISBN: 978-3-031-71742-0

Electronic ISBN: 978-3-031-71743-7

Copyright-Jahr: 2024
DOI: https://doi.org/10.1007/978-3-031-71743-7_13

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"