Skip to main content

2016 | OriginalPaper | Buchkapitel

CoCo - A Framework for Multicore Visuo-Haptics in Mixed Reality

verfasst von : Emanuele Ruffaldi, Filippo Brizzi

Erschienen in: Augmented Reality, Virtual Reality, and Computer Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Mixed Reality applications involve the integration of RGB-D streams with virtual entities potentially extended with force feedback. Increasing complexity of the applications pushes the limits of traditional computing structures, not keeping up with the increased computing power of multicore platform. This paper presents the CoCo framework, a component based, multicore system designed for tackling the challenges of visuo-haptics in mixed reality environment, with structural reconfiguration. Special care has been also given to the management of transformation between reference frames for easing registration, calibration and integration of robotic systems. The framework is described together with a description of two relevant case studies.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
We use the general term MR for all the applications in the Mixed Reality continuum.
 
Literatur
1.
Zurück zum Zitat Ruffaldi, E., Brizzi, F., Filippeschi, A., Avizzano, C.A.: Co-located haptic interaction for virtual usg exploration. In: Proceedings of IEEE EMBC, pp. 1548–1551 (2015) Ruffaldi, E., Brizzi, F., Filippeschi, A., Avizzano, C.A.: Co-located haptic interaction for virtual usg exploration. In: Proceedings of IEEE EMBC, pp. 1548–1551 (2015)
2.
Zurück zum Zitat Filippeschi, A., Brizzi, F., Ruffaldi, E., Jacinto, J.M., Avizzano, C.A.: Encountered-type haptic interface for virtual interaction with real objects based on implicit surface haptic rendering for remote palpation. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5904–5909. IEEE (2015) Filippeschi, A., Brizzi, F., Ruffaldi, E., Jacinto, J.M., Avizzano, C.A.: Encountered-type haptic interface for virtual interaction with real objects based on implicit surface haptic rendering for remote palpation. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5904–5909. IEEE (2015)
3.
Zurück zum Zitat Peppoloni, L., Brizzi, F., Ruffaldi, E., Avizzano, C.A.: Augmented reality-aided tele-presence system for robot manipulation in industrial manufacturing. In: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, pp. 237–240. ACM (2015) Peppoloni, L., Brizzi, F., Ruffaldi, E., Avizzano, C.A.: Augmented reality-aided tele-presence system for robot manipulation in industrial manufacturing. In: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, pp. 237–240. ACM (2015)
4.
Zurück zum Zitat Burns, D., Osfield, R.: Tutorial: open scene graph a: introduction tutorial: open scene graph b: examples and applications. In: Proceedings of the IEEE Virtual Reality, p. 265 (2004) Burns, D., Osfield, R.: Tutorial: open scene graph a: introduction tutorial: open scene graph b: examples and applications. In: Proceedings of the IEEE Virtual Reality, p. 265 (2004)
5.
Zurück zum Zitat Carrozzino, M., Tecchia, F., Bacinelli, S., Cappelletti, C., Bergamasco, M.: Lowering the development time of multimodal interactive application: the real-life experience of the XVR project. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 270–273. ACM (2005) Carrozzino, M., Tecchia, F., Bacinelli, S., Cappelletti, C., Bergamasco, M.: Lowering the development time of multimodal interactive application: the real-life experience of the XVR project. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 270–273. ACM (2005)
6.
Zurück zum Zitat Behr, J., Bockholt, U., Fellner, D.: Instantreality – a framework for industrial augmented and virtual reality applications. In: Ma, D., Fan, X., Gausemeier, J., Grafe, M. (eds.) Virtual Reality & Augmented Reality in Industry, pp. 91–99. Springer, Heidelberg (2011) Behr, J., Bockholt, U., Fellner, D.: Instantreality – a framework for industrial augmented and virtual reality applications. In: Ma, D., Fan, X., Gausemeier, J., Grafe, M. (eds.) Virtual Reality & Augmented Reality in Industry, pp. 91–99. Springer, Heidelberg (2011)
7.
Zurück zum Zitat Figueroa, P., Bischof, W., Boulanger, P., Hoover, H., Taylor, R.: InTml: a dataflow oriented development system for virtual reality applications. Presence 17(5), 492–511 (2008)CrossRef Figueroa, P., Bischof, W., Boulanger, P., Hoover, H., Taylor, R.: InTml: a dataflow oriented development system for virtual reality applications. Presence 17(5), 492–511 (2008)CrossRef
8.
Zurück zum Zitat Allard, J., Gouranton, V., Lecointre, L., Limet, S., Melin, E., Raffin, B., Robert, S.: FlowVR: a middleware for large scale virtual reality applications. In: Danelutto, M., Vanneschi, M., Laforenza, D. (eds.) Euro-Par 2004. LNCS, vol. 3149, pp. 497–505. Springer, Heidelberg (2004)CrossRef Allard, J., Gouranton, V., Lecointre, L., Limet, S., Melin, E., Raffin, B., Robert, S.: FlowVR: a middleware for large scale virtual reality applications. In: Danelutto, M., Vanneschi, M., Laforenza, D. (eds.) Euro-Par 2004. LNCS, vol. 3149, pp. 497–505. Springer, Heidelberg (2004)CrossRef
10.
Zurück zum Zitat Ruffaldi, E., Frisoli, A., Gottlieb, C., Tecchia, F., Bergamasco, M.: A haptic toolkit for the development of immersive and web enabled games. In: ACM Symposium on Virtual Reality Software and Technology (VRST), pp. 320–323. ACM (2006) Ruffaldi, E., Frisoli, A., Gottlieb, C., Tecchia, F., Bergamasco, M.: A haptic toolkit for the development of immersive and web enabled games. In: ACM Symposium on Virtual Reality Software and Technology (VRST), pp. 320–323. ACM (2006)
11.
Zurück zum Zitat Eck, U., Sandor, C.: Harp: a framework for visuo-haptic augmented reality. In: 2013 IEEE Virtual Reality (VR), pp. 145–146, March 2013 Eck, U., Sandor, C.: Harp: a framework for visuo-haptic augmented reality. In: 2013 IEEE Virtual Reality (VR), pp. 145–146, March 2013
12.
Zurück zum Zitat Bruyninckx, H.: Open robot control software: the orocos project. In: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, ICRA 2001, vol. 3, pp. 2523–2528. IEEE (2001) Bruyninckx, H.: Open robot control software: the orocos project. In: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, ICRA 2001, vol. 3, pp. 2523–2528. IEEE (2001)
13.
Zurück zum Zitat Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.Y.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software, vol. 3(3.2), p. 5 (2009) Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.Y.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software, vol. 3(3.2), p. 5 (2009)
14.
Zurück zum Zitat Seichter, H., Looser, J., Billinghurst, M.: Composar: an intuitive tool for authoring AR applications. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 177–178. IEEE Computer Society (2008) Seichter, H., Looser, J., Billinghurst, M.: Composar: an intuitive tool for authoring AR applications. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 177–178. IEEE Computer Society (2008)
15.
Zurück zum Zitat Salisbury, K., Conti, F., Barbagli, F.: Haptic rendering: introductory concepts. IEEE Comput. Graph. Appl. 24(2), 24–32 (2004)CrossRef Salisbury, K., Conti, F., Barbagli, F.: Haptic rendering: introductory concepts. IEEE Comput. Graph. Appl. 24(2), 24–32 (2004)CrossRef
16.
Zurück zum Zitat Ruffaldi, E., Morris, D., Barbagli, F., Salisbury, K., Bergamasco, M.: Voxel-based haptic rendering using implicit sphere trees. In: Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Haptics 2008, pp. 319–325, March 2008 Ruffaldi, E., Morris, D., Barbagli, F., Salisbury, K., Bergamasco, M.: Voxel-based haptic rendering using implicit sphere trees. In: Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Haptics 2008, pp. 319–325, March 2008
17.
Zurück zum Zitat Ruspini, D.C., Kolarov, K., Khatib, O.: The haptic display of complex graphical environments. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, pp. 345–352. ACM Press/Addison-Wesley Publishing Co. (1997) Ruspini, D.C., Kolarov, K., Khatib, O.: The haptic display of complex graphical environments. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, pp. 345–352. ACM Press/Addison-Wesley Publishing Co. (1997)
18.
Zurück zum Zitat Salisbury, K., Tarr, C.: Haptic rendering of surfaces defined by implicit functions. ASME Dyn. Syst. Control Div. 61, 61–67 (1997) Salisbury, K., Tarr, C.: Haptic rendering of surfaces defined by implicit functions. ASME Dyn. Syst. Control Div. 61, 61–67 (1997)
19.
Zurück zum Zitat Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the cave. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, pp. 135–142. ACM (1993) Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the cave. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, pp. 135–142. ACM (1993)
Metadaten
Titel
CoCo - A Framework for Multicore Visuo-Haptics in Mixed Reality
verfasst von
Emanuele Ruffaldi
Filippo Brizzi
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-40621-3_24

Premium Partner