Skip to main content
Erschienen in: Optical and Quantum Electronics 3/2024

01.03.2024

Surface color estimation in 3D spatial coordinate remote sensing by a technical vision system

verfasst von: Wendy Flores-Fuentes, Eduardo Arellano-Vega, Oleg Sergiyenko, Iván Y. Alba-Corpus, Julio C. Rodríguez-Quiñonez, Moises J. Castro-Toscano, Félix F. González-Navarro, S. Vasavi, Jesús E. Miranda-Vega, Daniel Hernández-Balbuena, Fabián N. Murrieta-Rico, Moisés Rivas-López

Erschienen in: Optical and Quantum Electronics | Ausgabe 3/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes to enhance the capabilities of a Technical Vision System (TVS) based on optical scanning and dynamic triangulation for 3D spatial coordinates measurements to determine and add to the record of its measurements the color of the objects coordinates scanned. Optoelectronics signals output from the TVS scanning aperture contain a huge amount of data that cannot be friendly or obvious to human understanding and interpretation. However, time domain characteristic parameters can be extracted from the optoelectronics signals, which can describe aspects of the optoelectronic signal and the 3D spatial coordinate to whom it belongs; that is, it is specific and punctual information from the area of the object under scanning. In this theoretical and experimental evaluation, the parameters obtained from optoelectronics signals have been used as feature inputs for supervised learning and as an approach to implement artificial intelligence to the TVS signal processing by a model able to predict in real time the color of the 3D spatial coordinates measured.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Altın, C., Er, O.: Comparison of different time and frequency domain feature extraction methods on elbow gesture’s EMG. Eur. J. Interdiscipl. Stud. 2(3), 25–34 (2016)CrossRef Altın, C., Er, O.: Comparison of different time and frequency domain feature extraction methods on elbow gesture’s EMG. Eur. J. Interdiscipl. Stud. 2(3), 25–34 (2016)CrossRef
Zurück zum Zitat Básaca-Preciado, L.C., Sergiyenko, O.Y., Rodríguez-Quinonez, J.C., et al.: Optical 3d laser measurement system for navigation of autonomous mobile robot. Opt. Lasers Eng. 54, 159–169 (2014)CrossRef Básaca-Preciado, L.C., Sergiyenko, O.Y., Rodríguez-Quinonez, J.C., et al.: Optical 3d laser measurement system for navigation of autonomous mobile robot. Opt. Lasers Eng. 54, 159–169 (2014)CrossRef
Zurück zum Zitat Bini, D., Pamela, D., Prince, S.: Machine vision and machine learning for intelligent agrobots: a review. In: 2020 5th International Conference on Devices, Circuits and Systems (ICDCS), pp. 12–16. IEEE (2020) Bini, D., Pamela, D., Prince, S.: Machine vision and machine learning for intelligent agrobots: a review. In: 2020 5th International Conference on Devices, Circuits and Systems (ICDCS), pp. 12–16. IEEE (2020)
Zurück zum Zitat Castro-Toscano, M.J., Rodríguez-Quiñonez, J.C., Sergiyenko, O., et al.: Novel sensing approaches for structural deformation monitoring and 3d measurements. IEEE Sens. J. 21(10), 11318–11328 (2020)ADSCrossRef Castro-Toscano, M.J., Rodríguez-Quiñonez, J.C., Sergiyenko, O., et al.: Novel sensing approaches for structural deformation monitoring and 3d measurements. IEEE Sens. J. 21(10), 11318–11328 (2020)ADSCrossRef
Zurück zum Zitat Flores-Fuentes, W., Arellano-Vega, E., Sergiyenko, O., et al.: Extracción de características en el dominio del tiempo de señales optoelectrónicas de un sistema de visión técnica. In: Certificado de Registro Público del Derecho de Autor. Rama: Programas de computación. Número de Registro: 03-2023-020111075200-01. Instituto Nacional del Derecho de Autor (2023b) Flores-Fuentes, W., Arellano-Vega, E., Sergiyenko, O., et al.: Extracción de características en el dominio del tiempo de señales optoelectrónicas de un sistema de visión técnica. In: Certificado de Registro Público del Derecho de Autor. Rama: Programas de computación. Número de Registro: 03-2023-020111075200-01. Instituto Nacional del Derecho de Autor (2023b)
Zurück zum Zitat Flores-Fuentes, W., Rodríguez-Quiñonez, J.C., Hernandez-Balbuena, D., et al.: Machine vision supported by artificial intelligence. In: 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE), pp. 1949–1954. IEEE (2014) Flores-Fuentes, W., Rodríguez-Quiñonez, J.C., Hernandez-Balbuena, D., et al.: Machine vision supported by artificial intelligence. In: 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE), pp. 1949–1954. IEEE (2014)
Zurück zum Zitat Flores-Fuentes, W., Sergiyenko, O., Gonzalez-Navarro, F.F., et al.: Multivariate outlier mining and regression feedback for 3d measurement improvement in opto-mechanical system. Opt. Quant. Electron. 48, 1–21 (2016)CrossRef Flores-Fuentes, W., Sergiyenko, O., Gonzalez-Navarro, F.F., et al.: Multivariate outlier mining and regression feedback for 3d measurement improvement in opto-mechanical system. Opt. Quant. Electron. 48, 1–21 (2016)CrossRef
Zurück zum Zitat Horaud, R., Hansard, M., Evangelidis, G., et al.: An overview of depth cameras and range scanners based on time-of-flight technologies. Mach. Vis. Appl. 27(7), 1005–1020 (2016)CrossRef Horaud, R., Hansard, M., Evangelidis, G., et al.: An overview of depth cameras and range scanners based on time-of-flight technologies. Mach. Vis. Appl. 27(7), 1005–1020 (2016)CrossRef
Zurück zum Zitat Ivanov, M., Sergyienko, O., Tyrsa, V., et al.: Influence of data clouds fusion from 3d real-time vision system on robotic group dead reckoning in unknown terrain. IEEE/CAA J. Autom. Sin. 7(2), 368–385 (2020b)CrossRef Ivanov, M., Sergyienko, O., Tyrsa, V., et al.: Influence of data clouds fusion from 3d real-time vision system on robotic group dead reckoning in unknown terrain. IEEE/CAA J. Autom. Sin. 7(2), 368–385 (2020b)CrossRef
Zurück zum Zitat Ke, D., Wang, X., Huang, K., et al.: Minimum power adversarial attacks in communication signal modulation classification with deep learning. Cogn. Comput. 15(2), 580–589 (2023)CrossRef Ke, D., Wang, X., Huang, K., et al.: Minimum power adversarial attacks in communication signal modulation classification with deep learning. Cogn. Comput. 15(2), 580–589 (2023)CrossRef
Zurück zum Zitat Lénárt, J.: Extending an industrial robot with image processing system. In: Vehicle and Automotive Engineering, pp. 568–574. Springer (2022) Lénárt, J.: Extending an industrial robot with image processing system. In: Vehicle and Automotive Engineering, pp. 568–574. Springer (2022)
Zurück zum Zitat Li, J., Huang, W., Zhao, C.: Machine vision technology for detecting the external defects of fruits—a review. Imaging Sci. J. 63(5), 241–251 (2015)CrossRef Li, J., Huang, W., Zhao, C.: Machine vision technology for detecting the external defects of fruits—a review. Imaging Sci. J. 63(5), 241–251 (2015)CrossRef
Zurück zum Zitat Li, M., Xu, T., Wang, S., et al.: Probe pulse design in Brillouin optical time-domain reflectometry. IET Optoelectron. 16(6), 238–252 (2022)ADSCrossRef Li, M., Xu, T., Wang, S., et al.: Probe pulse design in Brillouin optical time-domain reflectometry. IET Optoelectron. 16(6), 238–252 (2022)ADSCrossRef
Zurück zum Zitat Lin, Y., Wang, Y., Wang, S., et al.: Noise point detection from airborne lidar point cloud based on spatial hierarchical directional relationship. IEEE Access 10, 82076–82091 (2022)MathSciNetCrossRef Lin, Y., Wang, Y., Wang, S., et al.: Noise point detection from airborne lidar point cloud based on spatial hierarchical directional relationship. IEEE Access 10, 82076–82091 (2022)MathSciNetCrossRef
Zurück zum Zitat Lindner, L., Sergiyenko, O., Rivas-López, M., et al.: Exact laser beam positioning for measurement of vegetation vitality. Ind. Robot: Int. J. 44(4), 532–541 (2017)CrossRef Lindner, L., Sergiyenko, O., Rivas-López, M., et al.: Exact laser beam positioning for measurement of vegetation vitality. Ind. Robot: Int. J. 44(4), 532–541 (2017)CrossRef
Zurück zum Zitat Liu, J., Zhang, F., Kudreyko, A., et al.: Novel laser tracking measurement system based on the position sensitive detector. Math. Biosci. Eng.: MBE 20(1), 572–586 (2023)CrossRefPubMed Liu, J., Zhang, F., Kudreyko, A., et al.: Novel laser tracking measurement system based on the position sensitive detector. Math. Biosci. Eng.: MBE 20(1), 572–586 (2023)CrossRefPubMed
Zurück zum Zitat Lu, J., Li, Y., Zuo, Z.: Satmvs: A novel 3d reconstruction pipeline for remote sensing satellite imagery. In: International Conference on Aerospace System Science and Engineering, pp. 521–538. Springer (2021) Lu, J., Li, Y., Zuo, Z.: Satmvs: A novel 3d reconstruction pipeline for remote sensing satellite imagery. In: International Conference on Aerospace System Science and Engineering, pp. 521–538. Springer (2021)
Zurück zum Zitat Marlow, P.J., Gegenfurtner, K.R., Anderson, B.L.: The role of color in the perception of three-dimensional shape. Curr. Biol. 32(6), 1387–1394 (2022)CrossRefPubMedPubMedCentral Marlow, P.J., Gegenfurtner, K.R., Anderson, B.L.: The role of color in the perception of three-dimensional shape. Curr. Biol. 32(6), 1387–1394 (2022)CrossRefPubMedPubMedCentral
Zurück zum Zitat Murakami, K., Islam, M., Onodera, H.: CDF distance based statistical parameter extraction using nonlinear delay variation models. In: 2021 IEEE 27th International Symposium on On-Line Testing and Robust System Design (IOLTS), pp. 1–6. IEEE (2021) Murakami, K., Islam, M., Onodera, H.: CDF distance based statistical parameter extraction using nonlinear delay variation models. In: 2021 IEEE 27th International Symposium on On-Line Testing and Robust System Design (IOLTS), pp. 1–6. IEEE (2021)
Zurück zum Zitat Palkhiwala, S., Shah, M., Shah, M.: Analysis of machine learning algorithms for predicting a student’s grade. J. Data, Inf. Manag. 4(3–4), 329–341 (2022)CrossRef Palkhiwala, S., Shah, M., Shah, M.: Analysis of machine learning algorithms for predicting a student’s grade. J. Data, Inf. Manag. 4(3–4), 329–341 (2022)CrossRef
Zurück zum Zitat Petković, T., Pribanić, T.: Multiprojector multicamera structured light surface scanner. IEEE Access 10, 90321–90337 (2022)CrossRef Petković, T., Pribanić, T.: Multiprojector multicamera structured light surface scanner. IEEE Access 10, 90321–90337 (2022)CrossRef
Zurück zum Zitat Real, O.R., Castro-Toscano, M.J., Rodríguez-Quiñonez, J.C., et al.: Surface measurement techniques in machine vision: operation, applications, and trends. In: Optoelectronics in Machine Vision-based Theories and Applications, pp. 79–104. IGI Global (2019) Real, O.R., Castro-Toscano, M.J., Rodríguez-Quiñonez, J.C., et al.: Surface measurement techniques in machine vision: operation, applications, and trends. In: Optoelectronics in Machine Vision-based Theories and Applications, pp. 79–104. IGI Global (2019)
Zurück zum Zitat Rivas, M., Sergiyenko, O., Aguirre, M., et al.: Spatial data acquisition by laser scanning for robot or SHM task. In: 2008 IEEE International Symposium on Industrial Electronics, pp. 1458–1462. IEEE (2008) Rivas, M., Sergiyenko, O., Aguirre, M., et al.: Spatial data acquisition by laser scanning for robot or SHM task. In: 2008 IEEE International Symposium on Industrial Electronics, pp. 1458–1462. IEEE (2008)
Zurück zum Zitat Rivas, M., Flores, W., Rivera, J., et al.: A method and electronic device to detect the optoelectronic scanning signal energy centre. Optoelectronics-Advanced Materials and Devices, Mexico (2013)CrossRef Rivas, M., Flores, W., Rivera, J., et al.: A method and electronic device to detect the optoelectronic scanning signal energy centre. Optoelectronics-Advanced Materials and Devices, Mexico (2013)CrossRef
Zurück zum Zitat Rivas-Lopez, M., Sergiyenko, O., Flores-Fuentes, W., et al.: Optoelectronics in Machine Vision-based Theories and Applications. IGI Global (2018) Rivas-Lopez, M., Sergiyenko, O., Flores-Fuentes, W., et al.: Optoelectronics in Machine Vision-based Theories and Applications. IGI Global (2018)
Zurück zum Zitat Rodriguez-Quinonez, J.C., Sergiyenko, O., Gonzalez-Navarro, F.F., et al.: Surface recognition improvement in 3d medical laser scanner using Levenberg–Marquardt method. Signal Process. 93(2), 378–386 (2013)CrossRef Rodriguez-Quinonez, J.C., Sergiyenko, O., Gonzalez-Navarro, F.F., et al.: Surface recognition improvement in 3d medical laser scanner using Levenberg–Marquardt method. Signal Process. 93(2), 378–386 (2013)CrossRef
Zurück zum Zitat Rodríguez-Quiñonez, J., Sergiyenko, O., Hernandez-Balbuena, D., et al.: Improve 3d laser scanner measurements accuracy using a FFBP neural network with Widrow–Hoff weight/bias learning function. Opto-Electron. Rev. 22, 224–235 (2014)ADSCrossRef Rodríguez-Quiñonez, J., Sergiyenko, O., Hernandez-Balbuena, D., et al.: Improve 3d laser scanner measurements accuracy using a FFBP neural network with Widrow–Hoff weight/bias learning function. Opto-Electron. Rev. 22, 224–235 (2014)ADSCrossRef
Zurück zum Zitat Rodríguez-Quiñonez, J.C., Sergiyenko, O.Y., Preciado, L.C.B., et al.: Optical monitoring of scoliosis by 3d medical laser scanner. Opt. Lasers Eng. 54, 175–186 (2014)CrossRef Rodríguez-Quiñonez, J.C., Sergiyenko, O.Y., Preciado, L.C.B., et al.: Optical monitoring of scoliosis by 3d medical laser scanner. Opt. Lasers Eng. 54, 175–186 (2014)CrossRef
Zurück zum Zitat Sabitha, N., Thampi, S.G., Kumar, D.S.: Application of a distributed hydrologic model to assess the impact of climate and land-use change on surface runoff from a small urbanizing watershed. Water Resour. Manage 37(6–7), 2347–2368 (2023)CrossRef Sabitha, N., Thampi, S.G., Kumar, D.S.: Application of a distributed hydrologic model to assess the impact of climate and land-use change on surface runoff from a small urbanizing watershed. Water Resour. Manage 37(6–7), 2347–2368 (2023)CrossRef
Zurück zum Zitat Sergiyenko, O.Y.: Optoelectronic system for mobile robot navigation. Optoelectron., Instrum. Data Process. 46, 414–428 (2010)CrossRef Sergiyenko, O.Y.: Optoelectronic system for mobile robot navigation. Optoelectron., Instrum. Data Process. 46, 414–428 (2010)CrossRef
Zurück zum Zitat Sergiyenko, O.Y., Ivanov, M.V., Tyrsa, V., et al.: Data transferring model determination in robotic group. Robot. Auton. Syst. 83, 251–260 (2016)CrossRef Sergiyenko, O.Y., Ivanov, M.V., Tyrsa, V., et al.: Data transferring model determination in robotic group. Robot. Auton. Syst. 83, 251–260 (2016)CrossRef
Zurück zum Zitat Shiode, N.: 3d urban models: recent developments in the digital modelling of urban environments in three-dimensions. GeoJournal 52, 263–269 (2000)CrossRef Shiode, N.: 3d urban models: recent developments in the digital modelling of urban environments in three-dimensions. GeoJournal 52, 263–269 (2000)CrossRef
Zurück zum Zitat Yu, R., Lyu, M., Lu, J., et al.: Spatial coordinates correction based on multi-sensor low-altitude remote sensing image registration for monitoring forest dynamics. IEEE Access 8, 18483–18496 (2020)CrossRef Yu, R., Lyu, M., Lu, J., et al.: Spatial coordinates correction based on multi-sensor low-altitude remote sensing image registration for monitoring forest dynamics. IEEE Access 8, 18483–18496 (2020)CrossRef
Zurück zum Zitat Zhang, P.Y., Wang, H.Y.: A framework for automatic time-domain characteristic parameters extraction of human pulse signals. Eur. J. Adv. Signal Process. 2008, 1–9 (2007) Zhang, P.Y., Wang, H.Y.: A framework for automatic time-domain characteristic parameters extraction of human pulse signals. Eur. J. Adv. Signal Process. 2008, 1–9 (2007)
Zurück zum Zitat Zollhöfer, M., Stotko, P., Görlitz, A., et al.: State of the art on 3d reconstruction with RGB-d cameras. In: Computer Graphics Forum, pp. 625–652. Wiley Online Library (2018) Zollhöfer, M., Stotko, P., Görlitz, A., et al.: State of the art on 3d reconstruction with RGB-d cameras. In: Computer Graphics Forum, pp. 625–652. Wiley Online Library (2018)
Metadaten
Titel
Surface color estimation in 3D spatial coordinate remote sensing by a technical vision system
verfasst von
Wendy Flores-Fuentes
Eduardo Arellano-Vega
Oleg Sergiyenko
Iván Y. Alba-Corpus
Julio C. Rodríguez-Quiñonez
Moises J. Castro-Toscano
Félix F. González-Navarro
S. Vasavi
Jesús E. Miranda-Vega
Daniel Hernández-Balbuena
Fabián N. Murrieta-Rico
Moisés Rivas-López
Publikationsdatum
01.03.2024
Verlag
Springer US
Erschienen in
Optical and Quantum Electronics / Ausgabe 3/2024
Print ISSN: 0306-8919
Elektronische ISSN: 1572-817X
DOI
https://doi.org/10.1007/s11082-023-05646-3

Weitere Artikel der Ausgabe 3/2024

Optical and Quantum Electronics 3/2024 Zur Ausgabe

Neuer Inhalt