Skip to main content
main-content

Tipp

Weitere Kapitel dieses Buchs durch Wischen aufrufen

2018 | Supplement | Buchkapitel

A Versatile Hardware and Software Toolset for Computer Aided Inspection Planning of Machine Vision Applications

verfasst von: Stephan Irgenfried, Heinz Wörn, Stephan Bergmann, Mahsa Mohammadikajii, Jürgen Beyerer, Carsten Dachsbacher

Erschienen in: Information Systems Architecture and Technology: Proceedings of 38th International Conference on Information Systems Architecture and Technology – ISAT 2017

Verlag: Springer International Publishing

share
TEILEN

Abstract

The digital workflow and the set of tools described in this article support machine vision engineering during specification, design and implementation in numerous ways. In addition to the core idea of cad based vision system development, a generic data container format, simulation tools for real-time and photorealistic rendering using measured material BRDF data, and a MATLAB/ROS-controlled two-lightweight robot setup for experimental verification of simulation results are presented as parts of a semi-automatic planning process for a laser triangulation system. The planning process includes the annotation of CAD data with GD&T tolerance information using the ISO/PWI 10303-238 (STEP-NC) standard, initial system configuration by a machine vision expert, image formation simulation, system performance evaluation based on metrics applied on synthetic images and the capturing of real images with camera and laser light source, each mounted to a 7-axis KUKA LWR IV lightweight robot. The economic benefits of time and cost reduction of machine vision system planning are discussed as well as drawbacks and limits of the suggested workflow and tools.
Literatur
1.
Zurück zum Zitat Cowan, C.K., Kovesi, P.D.: Automatic sensor placement from vision task requirements. IEEE Trans. Pattern Anal. Mach. Intell. 10(3), 407–416 (1988). doi: 10.​1109/​34.​3905 Cowan, C.K., Kovesi, P.D.: Automatic sensor placement from vision task requirements. IEEE Trans. Pattern Anal. Mach. Intell. 10(3), 407–416 (1988). doi: 10.​1109/​34.​3905
2.
Zurück zum Zitat Al-Ahmari, A.M., Nasr, E.A., Abdulhameed, O. (eds.) Computer-Aided Inspection Planning: Theory and Practice. Taylor & Francis, CRC Press, Boca Raton (2017) Al-Ahmari, A.M., Nasr, E.A., Abdulhameed, O. (eds.) Computer-Aided Inspection Planning: Theory and Practice. Taylor & Francis, CRC Press, Boca Raton (2017)
3.
Zurück zum Zitat Tarabanis, K., Tsai, R.Y., Allen, P.K.: Overview of the MVP sensor planning system for robotic vision tasks. In: Tzafestas, S.G. (ed.) Engineering Systems with Intelligence. Springer Netherlands, Dordrecht, pp. 285–293 (1991) Tarabanis, K., Tsai, R.Y., Allen, P.K.: Overview of the MVP sensor planning system for robotic vision tasks. In: Tzafestas, S.G. (ed.) Engineering Systems with Intelligence. Springer Netherlands, Dordrecht, pp. 285–293 (1991)
4.
Zurück zum Zitat Sakane, S., Ish, M., Kakikura, M.: Occlusion avoidance of visual sensors based on a hand-eye action simulator system: HEAVEN. Adv. Robot. 2(2), 149–165 (1987). doi: 10.​1163/​156855387X00138 Sakane, S., Ish, M., Kakikura, M.: Occlusion avoidance of visual sensors based on a hand-eye action simulator system: HEAVEN. Adv. Robot. 2(2), 149–165 (1987). doi: 10.​1163/​156855387X00138
6.
7.
Zurück zum Zitat Cowan, C.K.: Model-based synthesis of sensor location. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 900–905 (1988) Cowan, C.K.: Model-based synthesis of sensor location. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 900–905 (1988)
8.
Zurück zum Zitat Novini, A.R.: The lighting and optics expert system for machine vision. In: Proceedings of 29th Congress of ISPRS (1988) Novini, A.R.: The lighting and optics expert system for machine vision. In: Proceedings of 29th Congress of ISPRS (1988)
9.
Zurück zum Zitat Burla, A., Haist, T., Lyda, W., et al. An assistance system for the selection of sensors in multi-scale measurement systems. In: Furlong, C., Gorecki, C., Novak, E.L. (eds.) SPIE Optical Engineering + Applications. SPIE, 77910I (2010) Burla, A., Haist, T., Lyda, W., et al. An assistance system for the selection of sensors in multi-scale measurement systems. In: Furlong, C., Gorecki, C., Novak, E.L. (eds.) SPIE Optical Engineering + Applications. SPIE, 77910I (2010)
11.
Zurück zum Zitat Khawaja, K., Maciejewski, A., Tretter, D., et al. Camera and light placement for automated assembly inspection. In: Proceedings of the 1996 IEEE International Conference on Robotics and Automation, vol. 4, pp. 3246–3252 (1996) Khawaja, K., Maciejewski, A., Tretter, D., et al. Camera and light placement for automated assembly inspection. In: Proceedings of the 1996 IEEE International Conference on Robotics and Automation, vol. 4, pp. 3246–3252 (1996)
13.
Zurück zum Zitat Reiner, J.: Rendering for machine vision prototyping. Opt. Des. Eng. III 7100(1), 710009 (2008) CrossRef Reiner, J.: Rendering for machine vision prototyping. Opt. Des. Eng. III 7100(1), 710009 (2008) CrossRef
14.
Zurück zum Zitat Yang, H., Haist, T., Gronle, M., et al.: Realistic simulation of camera images of local surface defects in the context of multi-sensor inspection systems. In: Lehmann, P., Osten, W., Albertazzi Gonçalves, A. (eds.) SPIE Optical Metrology. SPIE, pp. 9525221–9525226 (2015) Yang, H., Haist, T., Gronle, M., et al.: Realistic simulation of camera images of local surface defects in the context of multi-sensor inspection systems. In: Lehmann, P., Osten, W., Albertazzi Gonçalves, A. (eds.) SPIE Optical Metrology. SPIE, pp. 9525221–9525226 (2015)
15.
Zurück zum Zitat Meister, S., Kondermann, D.: Real versus realistically rendered scenes for optical flow evaluation. In: 2011 14th ITG Conference on Electronic Media Technology, pp. 1–6 (2011) Meister, S., Kondermann, D.: Real versus realistically rendered scenes for optical flow evaluation. In: 2011 14th ITG Conference on Electronic Media Technology, pp. 1–6 (2011)
16.
Zurück zum Zitat Retzlaff, M.-G., Stabenow. J., Dachsbacher. C.: Synthetic image acquisition and procedural modeling for automated optical inspection (AOI) systems. In: Puente León, F. (ed.) Forum Bildverarbeitung 2014, pp. 47–59. KIT Scientific Publishing, Karlsruhe (2014) Retzlaff, M.-G., Stabenow. J., Dachsbacher. C.: Synthetic image acquisition and procedural modeling for automated optical inspection (AOI) systems. In: Puente León, F. (ed.) Forum Bildverarbeitung 2014, pp. 47–59. KIT Scientific Publishing, Karlsruhe (2014)
17.
Zurück zum Zitat Höpe, A., Hauer, K.-O.: Three-dimensional appearance characterization of diffuse standard reflection materials. Metrologia 47(3), 295 (2010) Höpe, A., Hauer, K.-O.: Three-dimensional appearance characterization of diffuse standard reflection materials. Metrologia 47(3), 295 (2010)
18.
Zurück zum Zitat Holzschuch, N., Pacanowski, R.: A physically-based reflectance model combining reflection and diffraction. Research Report (2016) Holzschuch, N., Pacanowski, R.: A physically-based reflectance model combining reflection and diffraction. Research Report (2016)
19.
Zurück zum Zitat Jakob, W.: Mitsuba 0.5.0 Documentation (2014) Jakob, W.: Mitsuba 0.5.0 Documentation (2014)
20.
Zurück zum Zitat Irgenfried, S., Wörn, H., Bergmann, S., et al.: CAD-basierter workflow für den semi-automatischen Entwurf optischer Inspektionssysteme. at - Automatisierungstechnik 65(6), 426–439 (2017). doi: 10.​1515/​auto-2017-0044 Irgenfried, S., Wörn, H., Bergmann, S., et al.: CAD-basierter workflow für den semi-automatischen Entwurf optischer Inspektionssysteme. at - Automatisierungstechnik 65(6), 426–439 (2017). doi: 10.​1515/​auto-2017-0044
21.
Zurück zum Zitat Mohammadikaji, M., Bergmann, S., Irgenfried, S., et al.: A framework for uncertainty propagation in 3D shape measurement using laser triangulation. In: 2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings, pp. 1–6 (2016) Mohammadikaji, M., Bergmann, S., Irgenfried, S., et al.: A framework for uncertainty propagation in 3D shape measurement using laser triangulation. In: 2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings, pp. 1–6 (2016)
22.
Zurück zum Zitat Mohammadikaji, M., Bergmann, S., Irgenfried, S., et al.: Performance characterization in automated optical inspection using CAD models and graphical simulations. In: Zimmermann, S. (ed.) XXX. Messtechnisches Symposium. De Gruyter, Berlin, Boston (2016) Mohammadikaji, M., Bergmann, S., Irgenfried, S., et al.: Performance characterization in automated optical inspection using CAD models and graphical simulations. In: Zimmermann, S. (ed.) XXX. Messtechnisches Symposium. De Gruyter, Berlin, Boston (2016)
23.
Zurück zum Zitat Mohammadikaji, M., Bergmann, S., Irgenfried, S., et al. Probabilistic surface inference for industrial inspection planning. In: 2017 IEEE Winter Conference on Applications of Computer Vision, pp. 1008–1016. IEEE (2017) Mohammadikaji, M., Bergmann, S., Irgenfried, S., et al. Probabilistic surface inference for industrial inspection planning. In: 2017 IEEE Winter Conference on Applications of Computer Vision, pp. 1008–1016. IEEE (2017)
Metadaten
Titel
A Versatile Hardware and Software Toolset for Computer Aided Inspection Planning of Machine Vision Applications
verfasst von
Stephan Irgenfried
Heinz Wörn
Stephan Bergmann
Mahsa Mohammadikajii
Jürgen Beyerer
Carsten Dachsbacher
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-67220-5_30

Premium Partner