Skip to main content
Top
Published in: Journal on Multimodal User Interfaces 2/2015

01-06-2015 | Original Paper

A Kinect-based 3D hand-gesture interface for 3D databases

Authors: Raul Herrera-Acuña, Vasileios Argyriou, Sergio A. Velastin

Published in: Journal on Multimodal User Interfaces | Issue 2/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The use of natural interfaces improves significantly aspects related to human-computer interaction and consequently the productivity and the overall performance. In this paper we present a novel framework to interact with data elements presented in a 3D space. The system provides two mechanisms to interact using 2D and 3D gestures based on data provided by Kinect and on hand detection and gesture interpretation algorithms. The proposed architecture is analysed indicating that 3D interaction with information is possible, and provides advantages over a 2D interaction over the same problem. Finally, two sets of experiments were performed to evaluate 2D and 3D interaction styles based on natural interfaces focusing on traditional interaction with 3D databases.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wachs JP, Kölsch M, Stern H, Edan Y (2011) Vision-based hand-gesture applications. Commun ACM 54–2:60–71CrossRef Wachs JP, Kölsch M, Stern H, Edan Y (2011) Vision-based hand-gesture applications. Commun ACM 54–2:60–71CrossRef
2.
go back to reference Dang NT, Tavanti M, Rankin I, Cooper M (2009) A comparison of different input devices for a 3D environment. Int J Ind Ergon 39–3:554–563CrossRef Dang NT, Tavanti M, Rankin I, Cooper M (2009) A comparison of different input devices for a 3D environment. Int J Ind Ergon 39–3:554–563CrossRef
3.
go back to reference Clerici S, Zoltan C, Prestigiacomo G (2009) NiMoToons: a totally graphic workbench for program tuning and experimentation. Electron Notes Theor Comput Sci 258–1:93–107CrossRef Clerici S, Zoltan C, Prestigiacomo G (2009) NiMoToons: a totally graphic workbench for program tuning and experimentation. Electron Notes Theor Comput Sci 258–1:93–107CrossRef
4.
go back to reference Rotard M, Weiskopf D, Ertl T (2005) A combined introductory course on human–computer interaction and computer graphics. Comput Graph 29:267–272CrossRef Rotard M, Weiskopf D, Ertl T (2005) A combined introductory course on human–computer interaction and computer graphics. Comput Graph 29:267–272CrossRef
5.
go back to reference Harris M, Buxton B, Freeman WT, Ishii H, Lucente M, Sinclair MJ (1998) Interfaces for humans (panel): natural interaction, tangible data, and beyond. SIGGRAPH 98 conference abstracts and applications, pp 200–202 Harris M, Buxton B, Freeman WT, Ishii H, Lucente M, Sinclair MJ (1998) Interfaces for humans (panel): natural interaction, tangible data, and beyond. SIGGRAPH 98 conference abstracts and applications, pp 200–202
6.
go back to reference Clifton P, Mazalek A, LCC GT, Nitsche M, Sanford J, COA GT, Murray J (2010) WorkTop: a multi-touch tabletop collaborative sketching application for interdisciplinary design. Master thesis, Georgia Institute of Technology Clifton P, Mazalek A, LCC GT, Nitsche M, Sanford J, COA GT, Murray J (2010) WorkTop: a multi-touch tabletop collaborative sketching application for interdisciplinary design. Master thesis, Georgia Institute of Technology
7.
go back to reference Blackwell AF (2000) Dealing with new cognitive dimensions. Workshop on cognitive dimensions: strengthening the cognitive dimensions research community, University of Hertfordshire Blackwell AF (2000) Dealing with new cognitive dimensions. Workshop on cognitive dimensions: strengthening the cognitive dimensions research community, University of Hertfordshire
8.
go back to reference Chittaro L, Ranon R (2009) Web3D technologies in learning, education and training: motivations, issues, opportunities. Comput Educ 49:3–18CrossRef Chittaro L, Ranon R (2009) Web3D technologies in learning, education and training: motivations, issues, opportunities. Comput Educ 49:3–18CrossRef
9.
go back to reference Barr P, Noble J, Biddle R (2007) Video game values: human–computer interaction and games. Interact Comput 19–2:180–195 Barr P, Noble J, Biddle R (2007) Video game values: human–computer interaction and games. Interact Comput 19–2:180–195
10.
go back to reference Wu M, Balakrishnan R (2003) Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. ACM Special interest group on computer graphics and interactive techniques, pp 193–202 Wu M, Balakrishnan R (2003) Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. ACM Special interest group on computer graphics and interactive techniques, pp 193–202
11.
go back to reference Fishkin KP (2004) A taxonomy for and analysis of tangible interfaces. Pers Ubiquitous Comput 8–5:347–358 Fishkin KP (2004) A taxonomy for and analysis of tangible interfaces. Pers Ubiquitous Comput 8–5:347–358
12.
go back to reference Conway M, Audia S, Burnette T, Cosgrove D, Christiansen K (2000) Alice: lessons learned from building a 3D system for novices. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp 486–493 Conway M, Audia S, Burnette T, Cosgrove D, Christiansen K (2000) Alice: lessons learned from building a 3D system for novices. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp 486–493
13.
go back to reference Boussemart Y, Rioux F, Rudzicz F, Wozniewski M, Cooperstock JR (2004) A framework for 3D visualization and manipulation in an immersive space using an untethered bimanual gestural interface. In: Proceedings of the ACM symposium on virtual reality software and technology, pp 162–165 Boussemart Y, Rioux F, Rudzicz F, Wozniewski M, Cooperstock JR (2004) A framework for 3D visualization and manipulation in an immersive space using an untethered bimanual gestural interface. In: Proceedings of the ACM symposium on virtual reality software and technology, pp 162–165
14.
go back to reference Davidson PL, Han JY (2006) Synthesis and control on large scale multi-touch sensing displays. In: Proceedings of the 2006 conference on new interfaces for musical expression, pp 216–219 Davidson PL, Han JY (2006) Synthesis and control on large scale multi-touch sensing displays. In: Proceedings of the 2006 conference on new interfaces for musical expression, pp 216–219
15.
go back to reference Döring T, Sahami Shirazi A, Schmidt A (2010) Exploring gesture-based interaction techniques in multi-display environments with mobile phones and multi-touch table. In: Proceedings of the international conference on advanced visual interfaces, p 419 Döring T, Sahami Shirazi A, Schmidt A (2010) Exploring gesture-based interaction techniques in multi-display environments with mobile phones and multi-touch table. In: Proceedings of the international conference on advanced visual interfaces, p 419
16.
go back to reference Hernández-López J, Quintanilla-Olvera A, López-Ramírez J, Rangel-Butanda F, Ibarra-Manzano M, Almanza-Ojeda D (2012) Detecting objects using color and depth segmentation with Kinect sensor. Proc Technol 3–0:196–204CrossRef Hernández-López J, Quintanilla-Olvera A, López-Ramírez J, Rangel-Butanda F, Ibarra-Manzano M, Almanza-Ojeda D (2012) Detecting objects using color and depth segmentation with Kinect sensor. Proc Technol 3–0:196–204CrossRef
17.
go back to reference Guettard E et al (2011) Virtual reality from the keyboard/mouse couple to Kinect. Ann Phys Rehabil Med 54(10 suppl 1):239CrossRef Guettard E et al (2011) Virtual reality from the keyboard/mouse couple to Kinect. Ann Phys Rehabil Med 54(10 suppl 1):239CrossRef
18.
go back to reference Ren Z, Yuan J, Meng J, Zhang Z (2013) Robust part-based hand gesture recognition using Kinect sensor. Multimed IEEE Trans 15(5):1110–1120CrossRef Ren Z, Yuan J, Meng J, Zhang Z (2013) Robust part-based hand gesture recognition using Kinect sensor. Multimed IEEE Trans 15(5):1110–1120CrossRef
19.
go back to reference Pino A, Tzemis E, Ioannou N, Kouroupetroglou G (2013) Using Kinect for 2D and 3D pointing tasks: performance evaluation, human-computer interaction. Interact ModalTech Lect Notes Comput Sci 8007:358–367CrossRef Pino A, Tzemis E, Ioannou N, Kouroupetroglou G (2013) Using Kinect for 2D and 3D pointing tasks: performance evaluation, human-computer interaction. Interact ModalTech Lect Notes Comput Sci 8007:358–367CrossRef
20.
go back to reference Idreos S, Liarou E (2013) dbTouch: analytics at your Fingertips. In: Proceedings of the 7th international conference on innovative data systems research (CIDR). Asilomar, California Idreos S, Liarou E (2013) dbTouch: analytics at your Fingertips. In: Proceedings of the 7th international conference on innovative data systems research (CIDR). Asilomar, California
21.
go back to reference Vicknair C et al (2010) A comparison of a graph database and a relational database: a data provenance perspective. In: Proceedings of the 48th annual Southeast regional conference. ACM Vicknair C et al (2010) A comparison of a graph database and a relational database: a data provenance perspective. In: Proceedings of the 48th annual Southeast regional conference. ACM
22.
go back to reference Gómez LI, Silvia AG, Alejandro AV (2012) A generic data model and query language for spatiotemporal olap cube analysis. In: Proceedings of the 15th international conference on extending database technology. ACM Gómez LI, Silvia AG, Alejandro AV (2012) A generic data model and query language for spatiotemporal olap cube analysis. In: Proceedings of the 15th international conference on extending database technology. ACM
23.
go back to reference Mehdi M et al (2013) On-the-fly generation of multidimensional data cubes for web of things. In: Proceedings of the 17th international database engineering and applications symposium. ACM Mehdi M et al (2013) On-the-fly generation of multidimensional data cubes for web of things. In: Proceedings of the 17th international database engineering and applications symposium. ACM
24.
go back to reference Bohak Ciril, Marolt Matija (2013) Kinect Web Kiosk framework. Human factors in computing and informatics. Springer, Berlin, Heidelberg Bohak Ciril, Marolt Matija (2013) Kinect Web Kiosk framework. Human factors in computing and informatics. Springer, Berlin, Heidelberg
25.
go back to reference Hirte S et al (2012) Data3—a kinect interface for olap using complex event processing. Data engineering (ICDE), 2012 IEEE 28th international conference on. IEEE Hirte S et al (2012) Data3—a kinect interface for olap using complex event processing. Data engineering (ICDE), 2012 IEEE 28th international conference on. IEEE
26.
go back to reference Echtler F, Klinker G (2008) A multitouch software architecture. In: Proceedings of the 5th Nordic conference on human–computer interaction: building bridges. ACM Echtler F, Klinker G (2008) A multitouch software architecture. In: Proceedings of the 5th Nordic conference on human–computer interaction: building bridges. ACM
27.
go back to reference Kühn T (2011) The Kinect sensor platform. Adv Media Technol Kühn T (2011) The Kinect sensor platform. Adv Media Technol
28.
go back to reference Bovermann T, Bencina R, Costanza E, Kaltenbrunner M (2005) TUIO: a protocol for table-top tangible user interfaces. In: Proceedings of the the 6th international workshop on gesture in human-computer interaction and simulation (GW ’05) Bovermann T, Bencina R, Costanza E, Kaltenbrunner M (2005) TUIO: a protocol for table-top tangible user interfaces. In: Proceedings of the the 6th international workshop on gesture in human-computer interaction and simulation (GW ’05)
29.
go back to reference Smisek J, Jancosek M, Pajdla T (2013) 3D with Kinect. Consumer depth cameras for computer vision. Springer, London Smisek J, Jancosek M, Pajdla T (2013) 3D with Kinect. Consumer depth cameras for computer vision. Springer, London
30.
go back to reference Xia L, Chen C-C, Aggarwal JK (2011) Human detection using depth information by Kinect. Computer vision and pattern recognition workshops (CVPRW), 2011 IEEE Computer Society conference on IEEE Xia L, Chen C-C, Aggarwal JK (2011) Human detection using depth information by Kinect. Computer vision and pattern recognition workshops (CVPRW), 2011 IEEE Computer Society conference on IEEE
31.
go back to reference Frati V, Prattichizzo D (2011) Using Kinect for hand tracking and rendering in wearable haptics. World haptics conference (WHC), 2011 IEEE. IEEE Frati V, Prattichizzo D (2011) Using Kinect for hand tracking and rendering in wearable haptics. World haptics conference (WHC), 2011 IEEE. IEEE
32.
go back to reference Tang M (2011) Recognizing hand gestures with microsoft’s kinect. Department of Electrical Engineering of Stanford University:[sn], Palo Alto Tang M (2011) Recognizing hand gestures with microsoft’s kinect. Department of Electrical Engineering of Stanford University:[sn], Palo Alto
33.
go back to reference Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th annual ACM symposium on User interface software and technology. ACM Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th annual ACM symposium on User interface software and technology. ACM
34.
go back to reference Ren Z et al (2011) Robust hand gesture recognition with Kinect sensor. In: Proceedings of the 19th ACM international conference on multimedia. ACM Ren Z et al (2011) Robust hand gesture recognition with Kinect sensor. In: Proceedings of the 19th ACM international conference on multimedia. ACM
35.
go back to reference Ren Z et al (2013) Robust part-based hand gesture recognition using kinect sensor. Multimed IEEE Trans 15.5:1110–1120 Ren Z et al (2013) Robust part-based hand gesture recognition using kinect sensor. Multimed IEEE Trans 15.5:1110–1120
36.
go back to reference Li Y (2012) Hand gesture recognition using Kinect. Software engineering and service science (ICSESS), 2012 IEEE 3rd international conference on IEEE Li Y (2012) Hand gesture recognition using Kinect. Software engineering and service science (ICSESS), 2012 IEEE 3rd international conference on IEEE
37.
go back to reference Jadav JJ, Panchal M (2012) Association rule mining method on OLAP cube. Int J Eng Res Appl (IJERA) 2(2):1147–1151 Jadav JJ, Panchal M (2012) Association rule mining method on OLAP cube. Int J Eng Res Appl (IJERA) 2(2):1147–1151
38.
go back to reference Ludwick DA, Doucette J (2009) Adopting electronic medical records in primary care: lessons learned from health information systems implementation experience in seven countries. Int J Med Inf 78(1):22–31CrossRef Ludwick DA, Doucette J (2009) Adopting electronic medical records in primary care: lessons learned from health information systems implementation experience in seven countries. Int J Med Inf 78(1):22–31CrossRef
39.
go back to reference Lee U, Tanaka J (2013) Finger identification and hand gesture recognition techniques for natural user interface. In: Proceedings of the 11th Asia Pacific conference on computer human interaction. ACM Lee U, Tanaka J (2013) Finger identification and hand gesture recognition techniques for natural user interface. In: Proceedings of the 11th Asia Pacific conference on computer human interaction. ACM
40.
go back to reference Lewis JR (1995) IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Hum Comput Interact 7(1):57–78CrossRef Lewis JR (1995) IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Hum Comput Interact 7(1):57–78CrossRef
41.
go back to reference Rosner B, Glynn RJ, Lee M-LT (2006) The Wilcoxon signed rank test for paired comparisons of clustered data. Biometrics 62(1):185–192CrossRefMATHMathSciNet Rosner B, Glynn RJ, Lee M-LT (2006) The Wilcoxon signed rank test for paired comparisons of clustered data. Biometrics 62(1):185–192CrossRefMATHMathSciNet
Metadata
Title
A Kinect-based 3D hand-gesture interface for 3D databases
Authors
Raul Herrera-Acuña
Vasileios Argyriou
Sergio A. Velastin
Publication date
01-06-2015
Publisher
Springer Berlin Heidelberg
Published in
Journal on Multimodal User Interfaces / Issue 2/2015
Print ISSN: 1783-7677
Electronic ISSN: 1783-8738
DOI
https://doi.org/10.1007/s12193-014-0173-0

Premium Partner