Skip to main content
main-content
Top

Hint

Swipe to navigate through the chapters of this book

Published in:
Cover of the book

2019 | OriginalPaper | Chapter

Hardware Accelerated Image Processing on an FPGA-SoC Based Vision System for Closed Loop Monitoring and Additive Manufacturing Process Control

Authors: Dietmar Scharf, Bach Le Viet, Thi Bich Hoa Le, Janine Rechenberg, Stefan Tschierschke, Ernst Vogl, Ambra Vandone, Mattia Giardini

Published in: Computer Vision Systems

Publisher: Springer International Publishing

share
SHARE

Abstract

In many industrial sectors such as aeronautics, power generation, oil & gas, complex metal parts especially the critical ones are constructed and manufactured for a very long lifespan (more than 10 years). 4D Hybrid, an EU research project develops a new concept of hybrid additive manufacturing (AM) modules to ensure first time right production. To achieve that, the in-line process monitoring activity can be persistently realized by a complex sensing and vision system mounted on the equipment to ensure that the process responds to nominal operating conditions. This paper presents concepts and design of the vision system for process monitoring activities with hardware accelerated image processing by using camera hardware based on SoC FPGA devices, a hybrid of FPGA and ARM-based Cortex-A9 dual core CPU.
Literature
1.
go back to reference European Commission: 4D-Hybrid: Novel ALL-IN-ONE machines, robots and systems for affordable, worldwide and lifetime Distributed 3D hybrid manufacturing and repair operations. https://​4dhybrid.​eu/​. Accessed 28 Apr 2019 European Commission: 4D-Hybrid: Novel ALL-IN-ONE machines, robots and systems for affordable, worldwide and lifetime Distributed 3D hybrid manufacturing and repair operations. https://​4dhybrid.​eu/​. Accessed 28 Apr 2019
5.
go back to reference Trein, J., Schwarzbacher, A., Hoppe, B., Noffz, K.-H., Trenschel, T.: Development of a FPGA based real-time blob analysis circuit. In: Irish Systems and Signals Conference, Derry, Northern Ireland, pp. 121–126 (2007) Trein, J., Schwarzbacher, A., Hoppe, B., Noffz, K.-H., Trenschel, T.: Development of a FPGA based real-time blob analysis circuit. In: Irish Systems and Signals Conference, Derry, Northern Ireland, pp. 121–126 (2007)
9.
go back to reference Rocha, L., Velho, L., Carvalho, P.C.P.: Image moments-based structuring and tracking of objects (2002) Rocha, L., Velho, L., Carvalho, P.C.P.: Image moments-based structuring and tracking of objects (2002)
10.
go back to reference Bailey, D.G.: Design for Embedded Processing on FPGAs, 1st edn. Wiley, Hoboken (2011) CrossRef Bailey, D.G.: Design for Embedded Processing on FPGAs, 1st edn. Wiley, Hoboken (2011) CrossRef
11.
go back to reference Davies, E.R.: Computer and Machine Vision: Theory, Algorithms, Practicalities, 4th edn. Academic Press, Cambridge (2012) Davies, E.R.: Computer and Machine Vision: Theory, Algorithms, Practicalities, 4th edn. Academic Press, Cambridge (2012)
12.
13.
go back to reference Petrou, M., Petrou, C.: Image Processing: The Fundamentals. Wiley, Hoboken (2010) CrossRef Petrou, M., Petrou, C.: Image Processing: The Fundamentals. Wiley, Hoboken (2010) CrossRef
14.
go back to reference Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Prentice Hall, Upper Saddle River (2002) Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Prentice Hall, Upper Saddle River (2002)
15.
go back to reference Nixon, M.: Feature Extraction and Image Processing for Computer Vision, 3rd edn. Academic Press, Cambridge (2012) Nixon, M.: Feature Extraction and Image Processing for Computer Vision, 3rd edn. Academic Press, Cambridge (2012)
16.
go back to reference Flusser, J., Suk, T., Zitova, B.: 2D and 3D Image Analysis by Moments. Wiley, Hoboken (2016) CrossRef Flusser, J., Suk, T., Zitova, B.: 2D and 3D Image Analysis by Moments. Wiley, Hoboken (2016) CrossRef
17.
go back to reference Flusser, J., Suk, T., Zitova, B.: Moments and Moment Invariants in Pattern Recognition, 1st edn. Wiley, Hoboken (2009) CrossRef Flusser, J., Suk, T., Zitova, B.: Moments and Moment Invariants in Pattern Recognition, 1st edn. Wiley, Hoboken (2009) CrossRef
18.
go back to reference Flusser, J.: Moment invariants in image analysis. In: Proceedings of World Academy of Science, Engineering and Technology, vol. 11, pp. 196–201 (2006) Flusser, J.: Moment invariants in image analysis. In: Proceedings of World Academy of Science, Engineering and Technology, vol. 11, pp. 196–201 (2006)
19.
go back to reference Fung, J., Mann, S.: OpenVIDIA: parallel GPU computer vision. In: Proceedings of the 13th Annual ACM International Conference on Multimedia. ACM (2005) Fung, J., Mann, S.: OpenVIDIA: parallel GPU computer vision. In: Proceedings of the 13th Annual ACM International Conference on Multimedia. ACM (2005)
20.
go back to reference Bampis, L., et al.: Real-time indexing for large image databases: color and edge directivity descriptor on GPU. J. Supercomput. 71(3), 909–937 (2015) CrossRef Bampis, L., et al.: Real-time indexing for large image databases: color and edge directivity descriptor on GPU. J. Supercomput. 71(3), 909–937 (2015) CrossRef
21.
go back to reference Bampis, L., et al.: A LoCATe-based visual place recognition system for mobile robotics and GPGPUs. Concurr. Comput. Pract. Exp. 30(7), e4146 (2018) CrossRef Bampis, L., et al.: A LoCATe-based visual place recognition system for mobile robotics and GPGPUs. Concurr. Comput. Pract. Exp. 30(7), e4146 (2018) CrossRef
23.
go back to reference Schnell, M.: Development of an FPGA-based data reduction system for the Belle II DEPFET pixel detector (2015) Schnell, M.: Development of an FPGA-based data reduction system for the Belle II DEPFET pixel detector (2015)
24.
go back to reference Xiao, J., Li, S., Sun, B.: A real-time system for lane detection based on FPGA and DSP. Sens. Imaging 17(1), 6 (2016) CrossRef Xiao, J., Li, S., Sun, B.: A real-time system for lane detection based on FPGA and DSP. Sens. Imaging 17(1), 6 (2016) CrossRef
Metadata
Title
Hardware Accelerated Image Processing on an FPGA-SoC Based Vision System for Closed Loop Monitoring and Additive Manufacturing Process Control
Authors
Dietmar Scharf
Bach Le Viet
Thi Bich Hoa Le
Janine Rechenberg
Stefan Tschierschke
Ernst Vogl
Ambra Vandone
Mattia Giardini
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-34995-0_1

Premium Partner