Skip to main content
Top
Published in: Machine Vision and Applications 6/2013

01-08-2013 | Original Paper

Pi-Tag: a fast image-space marker design based on projective invariants

Authors: Filippo Bergamasco, Andrea Albarelli, Andrea Torsello

Published in: Machine Vision and Applications | Issue 6/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Visual marker systems have become an ubiquitous tool to supply a reference frame onto otherwise uncontrolled scenes. Throughout the last decades, a wide range of different approaches have emerged, each with different strengths and limitations. Some tags are optimized to reach a high accuracy in the recovered camera pose, others are based on designs that aim to maximizing the detection speed or minimizing the effect of occlusion on the detection process. Most of them, however, employ a two-step procedure where an initial homography estimation is used to translate the marker from the image plane to an orthonormal world, where it is validated and recognized. In this paper, we present a general purpose fiducial marker system that performs both steps directly in image-space. Specifically, by exploiting projective invariants such as collinearity and cross-ratios, we introduce a detection and recognition algorithm that is fast, accurate and moderately robust to occlusion. The overall performance of the system is evaluated in an extensive experimental section, where a comparison with a well-known baseline technique is presented. Additionally, several real-world applications are proposed, ranging from camera calibration to projector-based augmented reality.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library, 1st edn. O’Reilly Media, Inc., Cambridge (2008) Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library, 1st edn. O’Reilly Media, Inc., Cambridge (2008)
2.
go back to reference Cameron, J., Lasenby, J.: Estimating human skeleton parameters and configuration in real-time from markered optical motion capture. In: Conference on Articulated Motion and Deformable Objects (2008) Cameron, J., Lasenby, J.: Estimating human skeleton parameters and configuration in real-time from markered optical motion capture. In: Conference on Articulated Motion and Deformable Objects (2008)
3.
go back to reference Cho, Y., Lee, J., Neumann, U.: A multi-ring color fiducial system and a rule-based detection method for scalable fiducial-tracking augmented reality. In: Proceedings of International Workshop on Augmented Reality (1998) Cho, Y., Lee, J., Neumann, U.: A multi-ring color fiducial system and a rule-based detection method for scalable fiducial-tracking augmented reality. In: Proceedings of International Workshop on Augmented Reality (1998)
4.
go back to reference Claus, D., Fitzgibbon, A.W.: Reliable automatic calibration of a marker-based position tracking system. In: IEEE Workshop on Applications of Computer Vision (2005) Claus, D., Fitzgibbon, A.W.: Reliable automatic calibration of a marker-based position tracking system. In: IEEE Workshop on Applications of Computer Vision (2005)
5.
go back to reference Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: Monoslam: real-time single camera slam. IEEE Trans. Pattern Anal. Mach. Intell. 26(6), 1052–1067 (2007)CrossRef Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: Monoslam: real-time single camera slam. IEEE Trans. Pattern Anal. Mach. Intell. 26(6), 1052–1067 (2007)CrossRef
6.
go back to reference Dorfmller, K.: Robust tracking for augmented reality using retroreflective markers. Comput. Graph. 23(6), 795–800 (1999)CrossRef Dorfmller, K.: Robust tracking for augmented reality using retroreflective markers. Comput. Graph. 23(6), 795–800 (1999)CrossRef
7.
go back to reference Douxchamps, D., Chihara, K.: High-accuracy and robust localization of large control markers for geometric camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 31, 376–383 (2009)CrossRef Douxchamps, D., Chihara, K.: High-accuracy and robust localization of large control markers for geometric camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 31, 376–383 (2009)CrossRef
8.
go back to reference Fiala, M.: Linear markers for robot navigation with panoramic vision. In: Proceedings of the 1st Canadian Conference on Computer and Robot Vision, CRV ’04, pp. 145–154. IEEE Computer Society, Washington, DC (2004) Fiala, M.: Linear markers for robot navigation with panoramic vision. In: Proceedings of the 1st Canadian Conference on Computer and Robot Vision, CRV ’04, pp. 145–154. IEEE Computer Society, Washington, DC (2004)
9.
go back to reference Fiala, M.: Designing highly reliable fiducial markers. IEEE Trans. Pattern Anal. Mach. Intell. 32(7), 1317–1324 (2010) Fiala, M.: Designing highly reliable fiducial markers. IEEE Trans. Pattern Anal. Mach. Intell. 32(7), 1317–1324 (2010)
10.
go back to reference Gatrell, L., Hoff, W., Sklair, C.: Robust image features: concentric contrasting circles and their image extraction. In: Proceedings of Cooperative Intelligent Robotics in Space. SPIE, Washington (1991) Gatrell, L., Hoff, W., Sklair, C.: Robust image features: concentric contrasting circles and their image extraction. In: Proceedings of Cooperative Intelligent Robotics in Space. SPIE, Washington (1991)
11.
go back to reference Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)MATH Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)MATH
12.
go back to reference Heikkilä, J.: Geometric camera calibration using circular control points. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1066–1077 (October 2000) Heikkilä, J.: Geometric camera calibration using circular control points. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1066–1077 (October 2000)
13.
go back to reference Huynh, D.Q.: The cross ratio: a revisit to its probability density function. In: Proceedings of the British Machine Vision Conference BMVC 2000 (2000) Huynh, D.Q.: The cross ratio: a revisit to its probability density function. In: Proceedings of the British Machine Vision Conference BMVC 2000 (2000)
14.
go back to reference Jiang, G., Quan, L.: Detection of concentric circles for camera calibration. IEEE Int. Conf. Comput. Vis. 1, 333–340 (2005) Jiang, G., Quan, L.: Detection of concentric circles for camera calibration. IEEE Int. Conf. Comput. Vis. 1, 333–340 (2005)
15.
go back to reference Kannala, J., Salo, M.,: Heikkilä, J.: Algorithms for computing a planar homography from conics in correspondence. In: British Machine Vision Conference (2006) Kannala, J., Salo, M.,: Heikkilä, J.: Algorithms for computing a planar homography from conics in correspondence. In: British Machine Vision Conference (2006)
16.
go back to reference Kato, H., Billinghurst, M.: Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality. IEEE Computer Society, Washington, DC (1999) Kato, H., Billinghurst, M.: Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality. IEEE Computer Society, Washington, DC (1999)
17.
go back to reference Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics symposium on Geometry processing, SGP ’06, pp. 61–70. Aire-la-Ville, Switzerland (2006) Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics symposium on Geometry processing, SGP ’06, pp. 61–70. Aire-la-Ville, Switzerland (2006)
18.
go back to reference Knyaz, V.A. Head Of Group, Sibiryakov, R.V.: The development of new coded targets for automated point identification and non-contact surface measurements. In: 3D Surface Measurements, International Archives of Photogrammetry and Remote Sensing (1998) Knyaz, V.A. Head Of Group, Sibiryakov, R.V.: The development of new coded targets for automated point identification and non-contact surface measurements. In: 3D Surface Measurements, International Archives of Photogrammetry and Remote Sensing (1998)
19.
go back to reference Li, Y., Wang, Y.-T., Liu, Y.: Fiducial marker based on projective invariant for augmented reality. J. Comput. Sci. Technol. 22, 890–897 (2007)CrossRef Li, Y., Wang, Y.-T., Liu, Y.: Fiducial marker based on projective invariant for augmented reality. J. Comput. Sci. Technol. 22, 890–897 (2007)CrossRef
20.
go back to reference Loaiza, M., Raposo, A., Gattass, M.: A novel optical tracking algorithm for point-based projective invariant marker patterns. In: Proceedings of the 3rd International Conference on Advances in Visual Computing, vol. Part I, ISVC’07, pp. 160–169. Springer, Berlin (2007) Loaiza, M., Raposo, A., Gattass, M.: A novel optical tracking algorithm for point-based projective invariant marker patterns. In: Proceedings of the 3rd International Conference on Advances in Visual Computing, vol. Part I, ISVC’07, pp. 160–169. Springer, Berlin (2007)
21.
go back to reference Maidi, M., Didier, J.-Y., Ababsa, F., Mallem, M.: A performance study for camera pose estimation using visual marker based tracking. Mach. Vis. Appl. 21 (2010) Maidi, M., Didier, J.-Y., Ababsa, F., Mallem, M.: A performance study for camera pose estimation using visual marker based tracking. Mach. Vis. Appl. 21 (2010)
22.
go back to reference Mallon, J., Whelan, P.F.: Which pattern? biasing aspects of planar calibration patterns and detection methods. Pattern Recogn. Lett. 28(8), 921–930 (2007)CrossRef Mallon, J., Whelan, P.F.: Which pattern? biasing aspects of planar calibration patterns and detection methods. Pattern Recogn. Lett. 28(8), 921–930 (2007)CrossRef
23.
go back to reference Meer, P., Lenz, R., Ramakrishna, S.: Efficient invariant representations. Int. J. Comput. Vis. 26, 137–152 (1998)CrossRef Meer, P., Lenz, R., Ramakrishna, S.: Efficient invariant representations. Int. J. Comput. Vis. 26, 137–152 (1998)CrossRef
24.
go back to reference Naimark, L., Foxlin, E.: Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality, ISMAR ’02. IEEE Computer Society, Washington, DC (2002) Naimark, L., Foxlin, E.: Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality, ISMAR ’02. IEEE Computer Society, Washington, DC (2002)
25.
go back to reference Ouellet, J., Hebert, P.: Precise ellipse estimation without contour point extraction. Mach. Vis. Appl. 21 (2009) Ouellet, J., Hebert, P.: Precise ellipse estimation without contour point extraction. Mach. Vis. Appl. 21 (2009)
26.
go back to reference Rusinkiewicz, S., Levoy, M.: Efficient variants of the icp algorithm. In: Proceedings of the Third International Conference on 3D Digital Imaging and Modeling, pp. 145–152 (2001) Rusinkiewicz, S., Levoy, M.: Efficient variants of the icp algorithm. In: Proceedings of the Third International Conference on 3D Digital Imaging and Modeling, pp. 145–152 (2001)
27.
go back to reference Sauvola, J., Pietikainen, M.: Adaptive document image binarization. Pattern Recogn. 33(2), 225–236 (2000)CrossRef Sauvola, J., Pietikainen, M.: Adaptive document image binarization. Pattern Recogn. 33(2), 225–236 (2000)CrossRef
28.
go back to reference Teixeira, L., Loaiza, M., Raposo, A., Gattass, M.: Augmented reality using projective invariant patterns. In: Advances in Visual Computing. Lecture Notes in Computer Science, vol. 5358. Springer, Berlin (2008) Teixeira, L., Loaiza, M., Raposo, A., Gattass, M.: Augmented reality using projective invariant patterns. In: Advances in Visual Computing. Lecture Notes in Computer Science, vol. 5358. Springer, Berlin (2008)
29.
go back to reference Thormählen, T., Broszio, H.: Automatic line-based estimation of radial lens distortion. Integr. Comput. Aided Eng. 12(2), 177–190 (2005) Thormählen, T., Broszio, H.: Automatic line-based estimation of radial lens distortion. Integr. Comput. Aided Eng. 12(2), 177–190 (2005)
30.
go back to reference Tsonisp, V.S., Konstantinos, V.Ch., Trahaniaslj, P.E.: Landmark-based navigation using projective invariants. In: Proceedings of the 1998 IEEE International Conference on Intelligent Robots and Systems. IEEE Computer Society, Victoria, Canada (1998) Tsonisp, V.S., Konstantinos, V.Ch., Trahaniaslj, P.E.: Landmark-based navigation using projective invariants. In: Proceedings of the 1998 IEEE International Conference on Intelligent Robots and Systems. IEEE Computer Society, Victoria, Canada (1998)
31.
go back to reference Uchiyama, H., Saito, H.: Random dot markers. In: Virtual Reality Conference, IEEE, pp. 271–272 (2011) Uchiyama, H., Saito, H.: Random dot markers. In: Virtual Reality Conference, IEEE, pp. 271–272 (2011)
32.
go back to reference van Rhijn, A., Mulder, J.D.: Optical tracking using line pencil fiducials. In: Proceedings of the Eurographics Symposium on Virtual Environments (2004) van Rhijn, A., Mulder, J.D.: Optical tracking using line pencil fiducials. In: Proceedings of the Eurographics Symposium on Virtual Environments (2004)
33.
go back to reference Van Liere, R., Mulder, J.D.: Optical tracking using projective invariant marker pattern properties. In: Proceedings of the IEEE Virtual Reality Conference. IEEE Press, New York (2003) Van Liere, R., Mulder, J.D.: Optical tracking using projective invariant marker pattern properties. In: Proceedings of the IEEE Virtual Reality Conference. IEEE Press, New York (2003)
34.
go back to reference Wagner, D., Langlotz, T., Schmalstieg, D.: Robust and unobtrusive marker tracking on mobile phones. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR ’08, pp. 121–124. IEEE Computer Society, Washington, DC (2008) Wagner, D., Langlotz, T., Schmalstieg, D.: Robust and unobtrusive marker tracking on mobile phones. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR ’08, pp. 121–124. IEEE Computer Society, Washington, DC (2008)
35.
go back to reference Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., Schmalstieg, D.: Real time detection and tracking for augmented reality on mobile phones. IEEE Trans. Vis. Comput. Graph. 99, 355–368 (2010) Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., Schmalstieg, D.: Real time detection and tracking for augmented reality on mobile phones. IEEE Trans. Vis. Comput. Graph. 99, 355–368 (2010)
36.
go back to reference Walthelm, A., Kluthe, R.: Active distance measurement based on robust artificial markers as a building block for a service robot architecture. In: IFAC Symposium on Artificial Intelligence in Real Time Control. Budapest Polytechnic, Budapest (2000) Walthelm, A., Kluthe, R.: Active distance measurement based on robust artificial markers as a building block for a service robot architecture. In: IFAC Symposium on Artificial Intelligence in Real Time Control. Budapest Polytechnic, Budapest (2000)
37.
go back to reference Yoon, J.-H., Park, J.-S., Kim, C.: Increasing camera pose estimation accuracy using multiple markers. In: Advances in Artificial Reality and Tele-Existence. Lecture Notes in Computer Science, vol. 4282. pp. 239–248. Springer, Berlin (2006) Yoon, J.-H., Park, J.-S., Kim, C.: Increasing camera pose estimation accuracy using multiple markers. In: Advances in Artificial Reality and Tele-Existence. Lecture Notes in Computer Science, vol. 4282. pp. 239–248. Springer, Berlin (2006)
38.
go back to reference Yu, Q., Li, Q., Deng, Z.: Online motion capture marker labeling for multiple interacting articulated targets. Comput. Graph. Forum 26(3), 477–483 (2007)CrossRef Yu, Q., Li, Q., Deng, Z.: Online motion capture marker labeling for multiple interacting articulated targets. Comput. Graph. Forum 26(3), 477–483 (2007)CrossRef
39.
go back to reference Yu, R., Yang, T., Zheng, J., Zhang, X.: Real-time camera pose estimation based on multiple planar markers. In: Proceedings of the 2009 Fifth International Conference on Image and Graphics ICIG ’09, pp. 640–645. IEEE Computer Society, Washington, DC (2009) Yu, R., Yang, T., Zheng, J., Zhang, X.: Real-time camera pose estimation based on multiple planar markers. In: Proceedings of the 2009 Fifth International Conference on Image and Graphics ICIG ’09, pp. 640–645. IEEE Computer Society, Washington, DC (2009)
40.
go back to reference Zhang, X., Fronz, S., Navab, N.: Visual marker detection and decoding in ar systems: a comparative study. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality, ISMAR ’02, pp. 97. IEEE Computer Society, Washington, DC (2002) Zhang, X., Fronz, S., Navab, N.: Visual marker detection and decoding in ar systems: a comparative study. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality, ISMAR ’02, pp. 97. IEEE Computer Society, Washington, DC (2002)
Metadata
Title
Pi-Tag: a fast image-space marker design based on projective invariants
Authors
Filippo Bergamasco
Andrea Albarelli
Andrea Torsello
Publication date
01-08-2013
Publisher
Springer Berlin Heidelberg
Published in
Machine Vision and Applications / Issue 6/2013
Print ISSN: 0932-8092
Electronic ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-012-0469-6

Other articles of this Issue 6/2013

Machine Vision and Applications 6/2013 Go to the issue

Premium Partner