Skip to main content
Top
Published in: The Journal of Supercomputing 7/2016

01-07-2016

Easy-to-use virtual brick manipulation techniques using hand gestures

Authors: Van Thanh Tran, Jaewoon Lee, Dongho Kim, Young-Sik Jeong

Published in: The Journal of Supercomputing | Issue 7/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nowadays, LEGO may be regarded as the best toys that ever existed. It not only appeals to people of all ages, but also encourages creativity and innovation. The popularity of LEGO entails the introduction of a range of computer applications that simulate this toy. However, assembling by mouse and keyboard is not more interesting than playing a real LEGO toy. Recently, with the development of interactive virtual reality technology, many novel acquisition devices like Leap Motion and Kinect have been introduced which allow the user to control the device without touching the keyboard, the mouse, or the screen. In this paper, we present a VR application that simulates a real LEGO toy, and players can interact with this application via Leap Motion device. In other words, the player can use both hands to control the in-game objects including LEGO bricks, game camera, and even GUI. Also, we propose a set of gestures which enable the user to perform and memorize easily.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Vanus J, Smolon M, Martinek R, Koziorek J, Zidek J, Bilik P (2015) Testing of the voice communication in smart home care. Human-centric Comput Inf Sci 5(15). doi:10.1186/s13673-015-0035-0 Vanus J, Smolon M, Martinek R, Koziorek J, Zidek J, Bilik P (2015) Testing of the voice communication in smart home care. Human-centric Comput Inf Sci 5(15). doi:10.​1186/​s13673-015-0035-0
2.
go back to reference Lee Jeong Kyu, Kang Won Min, Park Jong Hyuk, Kim Jae Soo (2014) GWD: gesture-based wearable device for secure and effective information exchange on battlefield environment. J Converg 5(4):6–10 Lee Jeong Kyu, Kang Won Min, Park Jong Hyuk, Kim Jae Soo (2014) GWD: gesture-based wearable device for secure and effective information exchange on battlefield environment. J Converg 5(4):6–10
4.
go back to reference Hongzhe L, Yulong X, Wei S, Kyhyun U, Kyungeun C (2013) Gesture-based NUI application for real-time path modification. In: Proceding of the 11th IEEE international conference on dependable, autonomic and secure computing, DASC 2013, pp 446–449. doi:10.1109/DASC.2013.104 Hongzhe L, Yulong X, Wei S, Kyhyun U, Kyungeun C (2013) Gesture-based NUI application for real-time path modification. In: Proceding of the 11th IEEE international conference on dependable, autonomic and secure computing, DASC 2013, pp 446–449. doi:10.​1109/​DASC.​2013.​104
5.
go back to reference Bassily D, Georgoulas C, Guettler J, Linner T, Bock T (2014) Intuitive and Adaptive Robotic Arm Manipulation using the Leap Motion Controller. In: Proceeding of the 41st International Symposium on Robotics, ISR/Robotik 2014, pp 1–7 Bassily D, Georgoulas C, Guettler J, Linner T, Bock T (2014) Intuitive and Adaptive Robotic Arm Manipulation using the Leap Motion Controller. In: Proceeding of the 41st International Symposium on Robotics, ISR/Robotik 2014, pp 1–7
6.
go back to reference Wu J, Konrad J, Ishwar P (2013) Dynamic time warping for gesture-based user identification and authentication with Kinect. In: Proceeding of the IEEE international conference on acoustics, speech and signal processing, ICASSP 2013:2371–2375. doi:10.1109/ICASSP.2013.6638079 Wu J, Konrad J, Ishwar P (2013) Dynamic time warping for gesture-based user identification and authentication with Kinect. In: Proceeding of the IEEE international conference on acoustics, speech and signal processing, ICASSP 2013:2371–2375. doi:10.​1109/​ICASSP.​2013.​6638079
7.
go back to reference Guan-Feng H, Sun-Kyung K, Won-Chang S, Sung-Tae J (2011) Real-time gesture recognition using 3D depth camera. In: Proceeding of the 2nd IEEE international conference on software engineering and service science, ICSESS 2011, pp 187–190. doi:10.1109/ICSESS.2011.5982286 Guan-Feng H, Sun-Kyung K, Won-Chang S, Sung-Tae J (2011) Real-time gesture recognition using 3D depth camera. In: Proceeding of the 2nd IEEE international conference on software engineering and service science, ICSESS 2011, pp 187–190. doi:10.​1109/​ICSESS.​2011.​5982286
8.
go back to reference Kenneth S, Christian S, Bruce T, Sean I. O’Donoghue (2013) The Molecular Control Toolkit: controlling 3D molecular graphics via gesture and voice. In: Proceeding of the IEEE symposium on biological data visualization, BioVis 2013, pp 49–56. doi:10.1109/BioVis.2013.6664346 Kenneth S, Christian S, Bruce T, Sean I. O’Donoghue (2013) The Molecular Control Toolkit: controlling 3D molecular graphics via gesture and voice. In: Proceeding of the IEEE symposium on biological data visualization, BioVis 2013, pp 49–56. doi:10.​1109/​BioVis.​2013.​6664346
9.
go back to reference Shen J, Luo Y, Wang X, Zhongke W, Zhou M (2014) GPU-Based real-time hand gesture interaction and rendering for volume datasets using leap motion. In: Proceeding of the international conference on cyberworlds, CW 2014:85–92. doi:10.1109/CW.2014.20 Shen J, Luo Y, Wang X, Zhongke W, Zhou M (2014) GPU-Based real-time hand gesture interaction and rendering for volume datasets using leap motion. In: Proceeding of the international conference on cyberworlds, CW 2014:85–92. doi:10.​1109/​CW.​2014.​20
10.
go back to reference Zainal Azmi N (2014) A Natural Interface for 3D Manipulation. University of Otago, New Zealand Zainal Azmi N (2014) A Natural Interface for 3D Manipulation. University of Otago, New Zealand
11.
go back to reference Raheja JL, Chaudhary A, Singal K (2011) Tracking of fingertips and centers of palm using Kinect. In: Proceeding of the third international conference on computational intelligence, modelling and simulation, CIMSiM 2011, pp 248–252. doi:10.1109/CIMSim.2011.51 Raheja JL, Chaudhary A, Singal K (2011) Tracking of fingertips and centers of palm using Kinect. In: Proceeding of the third international conference on computational intelligence, modelling and simulation, CIMSiM 2011, pp 248–252. doi:10.​1109/​CIMSim.​2011.​51
12.
13.
go back to reference Marin G, Dominio F, Zanuttigh P (2014) Hand gesture recognition with Leap Motion and Kinect devices. In: Proceeding of the IEEE international conference on image processing, ICIP 2014:1565–1569. doi:10.1109/ICIP.2014.7025313 Marin G, Dominio F, Zanuttigh P (2014) Hand gesture recognition with Leap Motion and Kinect devices. In: Proceeding of the IEEE international conference on image processing, ICIP 2014:1565–1569. doi:10.​1109/​ICIP.​2014.​7025313
14.
go back to reference Bacim F, Nabiyouni, Mahdi, Bowman Doug A (2014) Slice-n-Swipe: A Free-Hand Gesture User Interface for 3D Point Cloud Annotation. In: Proceeding of the IEEE Symposium on 3D user interfaces, 3DUI 2014, pp 185–186, doi:10.1109/3DUI.2014.6798882 Bacim F, Nabiyouni, Mahdi, Bowman Doug A (2014) Slice-n-Swipe: A Free-Hand Gesture User Interface for 3D Point Cloud Annotation. In: Proceeding of the IEEE Symposium on 3D user interfaces, 3DUI 2014, pp 185–186, doi:10.​1109/​3DUI.​2014.​6798882
15.
go back to reference Daniel M, Alfredo F (2011) Virtual LEGO modelling on multi-touch surfaces. In: Proceeding of the 19th international conference in central Europe on computer graphics, visualization and computer vision in cooperation with EUROGRAPHICS association, WSCG 2011, pp 73–80 Daniel M, Alfredo F (2011) Virtual LEGO modelling on multi-touch surfaces. In: Proceeding of the 19th international conference in central Europe on computer graphics, visualization and computer vision in cooperation with EUROGRAPHICS association, WSCG 2011, pp 73–80
16.
go back to reference Zhou R, Jingjing M, Junsong Y (2011) Depth camera based hand gesture recognition and its applications in human-computer-interaction. In: Proceeding of the 8th international conference on information communications and signal processing, ICICS 2011, pp 1–5. doi:10.1109/ICICS.2011.6173545 Zhou R, Jingjing M, Junsong Y (2011) Depth camera based hand gesture recognition and its applications in human-computer-interaction. In: Proceeding of the 8th international conference on information communications and signal processing, ICICS 2011, pp 1–5. doi:10.​1109/​ICICS.​2011.​6173545
17.
go back to reference Rautaray Siddharth S, Agrawal Anupam (2012) Design of Gesture Recognition System for Dynamic User Interface. In: Proceeding of the IEEE international conference on technology enhanced education, ICTEE 2012:1–6. doi:10.1109/ICTEE.2012.6208628 Rautaray Siddharth S, Agrawal Anupam (2012) Design of Gesture Recognition System for Dynamic User Interface. In: Proceeding of the IEEE international conference on technology enhanced education, ICTEE 2012:1–6. doi:10.​1109/​ICTEE.​2012.​6208628
18.
go back to reference Yingying S, Qian W, Yunzhe J, Ting G, Qun H, Baorong Y (2014) A real-time hand gesture recognition approach based on motion features of feature points. In: Proceeding of the 17th IEEE international conference on computational science and engineering, CSE 2014, pp 1096–1102. doi:10.1109/CSE.2014.216 Yingying S, Qian W, Yunzhe J, Ting G, Qun H, Baorong Y (2014) A real-time hand gesture recognition approach based on motion features of feature points. In: Proceeding of the 17th IEEE international conference on computational science and engineering, CSE 2014, pp 1096–1102. doi:10.​1109/​CSE.​2014.​216
19.
go back to reference Huang P-K, Lin T-Y, Lin H-T, Wu C-H, Hsiao C-C, Liao C-K, Lemmens P (2012) Real-time stereo matching for 3D hand gesture recognition. In: Proceeding of the international conference on SoC design, ISOCC 2012:29–32. doi:10.1109/ISOCC.2012.6406917 Huang P-K, Lin T-Y, Lin H-T, Wu C-H, Hsiao C-C, Liao C-K, Lemmens P (2012) Real-time stereo matching for 3D hand gesture recognition. In: Proceeding of the international conference on SoC design, ISOCC 2012:29–32. doi:10.​1109/​ISOCC.​2012.​6406917
26.
go back to reference Youwen W, Cheng Y, Xiaoyu W, Shengmiao X, Hui L (2011) Gesture Recognition using Microsoft Kinect. In: Proceeding of the 5th international conference on intelligent human-machine systems and cybernetics, IHMSC 2011, pp 100-103. doi:10.1109/ICARA.2011.6144864 Youwen W, Cheng Y, Xiaoyu W, Shengmiao X, Hui L (2011) Gesture Recognition using Microsoft Kinect. In: Proceeding of the 5th international conference on intelligent human-machine systems and cybernetics, IHMSC 2011, pp 100-103. doi:10.​1109/​ICARA.​2011.​6144864
Metadata
Title
Easy-to-use virtual brick manipulation techniques using hand gestures
Authors
Van Thanh Tran
Jaewoon Lee
Dongho Kim
Young-Sik Jeong
Publication date
01-07-2016
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 7/2016
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-015-1588-4

Other articles of this Issue 7/2016

The Journal of Supercomputing 7/2016 Go to the issue

Premium Partner