Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Identifying Tourist Requirements for Mobile AR Tourism Applications in Urban Heritage Tourism Read chapter Read first chapter

2018 | Supplement | Chapter

Telethrone Reconstructed; Ongoing Testing Toward a More Natural Situated Display

Authors : John O’Hare, Allen J. Fairchild, Robin Wolff, David J. Roberts

Published in: Augmented Reality and Virtual Reality

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The concept of supporting ad hoc or dynamic membership tele-present meetings through pulling up a chair is novel. In real world business situations, people pull up a chair after catching the eye of someone already seated. Telethrone is a situated display on a chair which allows multiple correct views of a remote collaborator. The system has been expanded to support informal meetings where chairs can be moved around. This is facilitated through the novel integration of a 3D reconstructed model of a person, with live viewpoint dependent rendering onto a retro-reflective surface. This removes the need for painstaking alignment of multiple cameras and projectors each time a chair is moved. A between subjects experiment tested accuracy of reconnected mutual gaze mediated by part of the system. Subjectively easier and harder situations are compared. Specifically best and worst cases, both in terms of orientation of eyes in the reconstructed head, and angle of observer gaze onto the display. Discussion compares results to experiments that used other systems to attempt to convey eye gaze by different techniques. This research builds toward a scalable system for ad hoc business meetings; a paradigm poorly supported by current video conferencing. It is also applicable to supporting conversations between seated people in any scenario where seats might be moved, for example in interaction between client and therapist in tele-therapy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Testing the Potential of Combining Functional Near-Infrared Spectroscopy with Different Virtual Reality Displays—Oculus Rift and oCtAVE
next chapter A Survey of Drone use for Entertainment and AVR (Augmented and Virtual Reality)
Literature
Bock, S. W., Dicke, P., & Thier, P. (2008). How precise is gaze following in humans? Vision Research, 48(7), 946–957.CrossRef
Colburn, A., Cohen, M. F., & Drucker, S. (2000). The role of eye gaze in avatar mediated conversational interfaces. Sketches and Applications, Siggraph’00.
Duckworth, T. W., & D. J. Roberts. (2012). 3DRecon, a utility for 3D reconstruction from video. Joint Virtual Reality Conference of ICAT, EGVE and EuroVR
Duckworth, T., & Roberts, D. J. (2014). Parallel processing for real-time 3D reconstruction from video streams. Journal of Real-Time Image Processing, 9(3), 427–445.CrossRef
Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48(4), 384.CrossRef
Fagel, S., Bailly, G., Elisei, F., & Lelong, A. (2010). October. On the importance of eye gaze in a face-to-face collaborative task. In Proceedings of the 3rd international workshop on Affective interaction in natural environments (pp. 81–86). ACM.
Fairchild, A. J., Campion, S. P., García, A. S., Wolff, R., Fernando, T., & Roberts, D. J. (2017). A mixed reality telepresence system for collaborative space operation. IEEE Transactions on Circuits and Systems for Video Technology, 27(4), 814–827.
Goodwin, C. (2000). Action and embodiment within situated human interaction. Journal of Pragmatics, 32(10), 1489–1522.CrossRef
Grau, O., Thomas, G. A., Hilton, A., Kilner, J. & Starck, J. (2007), May. A robust free-viewpoint video system for sport scenes. In 3DTV Conference, 2007 (pp. 1–4). IEEE.
Kim, K., Bolton, J., Girouard, A., Cooperstock, J., & Vertegaal, R. (2012). May. TeleHuman: effects of 3d perspective on gaze and pose estimation with a life-size cylindrical telepresence pod. In Proceedings of the SIGCHI Human factors (pp. 2531–2540). ACM.
Krauss, R. M., Chen, Y., & Chawla, P. (1996). Nonverbal behavior and nonverbal communication: What do conversational hand gestures tell us? Advances in Experimental Social Psychology, 28, 389–450.CrossRef
Krum, D. M., Suma, E. A., & Bolas, M. (2012). Augmented reality using personal projection and retroreflection. Personal and Ubiquitous Computing, 16(1), 17–26.CrossRef
Lee, M. K. and Takayama, L., 2011, May. Now, I have a body: Uses and social norms for mobile remote presence in the workplace. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 33–42). ACM.
Loomis, J. M., Kelly, J. W., Pusch, M., Bailenson, J. N., & Beall, A. C. (2008). Psychophysics of perceiving eye-gaze and head direction with peripheral vision: Implications for the dynamics of eye-gaze behavior. Perception, 37(9), 1443–1457.CrossRef
Maimone, A. and Fuchs, H., 2011, October. Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras. In Mixed and augmented reality (ISMAR), 2011 10th IEEE international symposium on (pp. 137–146). IEEE.
Nguyen, D. T., & Canny, J., 2007, April. Multiview: improving trust in group video conferencing through spatial faithfulness. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 1465–1474). ACM.
Nguyen, D. T., & Canny, J. (2009). April. More than face-to-face: empathy effects of video framing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 423–432). ACM.
O’Hare, J., Bendall, R. C. A., Rae, J., Thomas, G., Weir, B., & Roberts, D. J. (2016). Is this seat taken? behavioural analysis of the telethrone: A novel situated telepresence display. The Eurographics Association.
Otsuka, K., Takemae, Y., & Yamato, J. (2005). October. A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances. In Proceedings of the 7th international conference on Multimodal interfaces (pp. 191–198). ACM.
Oyekoya, O., Steptoe, W., & Steed, A. (2012). May. SphereAvatar: A situated display to represent a remote collaborator. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 2551–2560). ACM.
Pan, Y., & Steed, A. (2012). October. Preserving gaze direction in teleconferencing using a camera array and a spherical display. In 3DTV-Conference: The true vision-capture, transmission and display of 3D video (3DTV-CON), 2012 (pp. 1–4). IEEE.
Pan, Y., Steptoe, W., & Steed, A. (2014, April). Comparing flat and spherical displays in a trust scenario in avatar-mediated interaction. In Proceedings of the 32nd annual ACM conference on human factors in computing systems (pp. 1397–1406). ACM.
Pejsa, T., Kantor, J., Benko, H., Ofek, E. and Wilson, A., 2016, February. Room2Room: Enabling life-size telepresence in a projected augmented reality environment. In Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing (pp. 1716–1725). ACM.
Roberts, D., Wolff, R., Otto, O., & Steed, A. (2003). Constructing a Gazebo: supporting teamwork in a tightly coupled, distributed task in virtual reality. Presence, 12(6), 644–657.CrossRef
Roberts, D., Duckworth, T., Moore, C., Wolff, R., & O’Hare, J. (2009, October). Comparing the end to end latency of an immersive collaborative environment and a video conference. In Proceedings of the 2009 13th IEEE/ACM international symposium on distributed simulation and real time applications (pp. 89–94). IEEE Computer Society.
Roberts, D. J., Fairchild, A. J., Campion, S. P., O’Hare, J., Moore, C. M., Aspin, R., et al. (2015). withyou—an experimental end-to-end telepresence system using video-based reconstruction Selected Topics in Signal Processing. IEEE Journal of, 9(3), 562–574.
Roberts, D. J., Rae, J., Duckworth, T. W., Moore, C. M., & Aspin, R. (2013). Estimating the gaze of a virtuality human. IEEE Transactions on Visualization and Computer Graphics, 19(4), 681–690.
Steptoe, W., Wolff, R., Murgia, A., Guimaraes, E., Rae, J., Sharkey, P., ... & Steed, A. (2008, November). Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments. In Proceedings of the 2008 ACM conference on computer supported cooperative work (pp. 197–200). ACM.
Symons, L. A., Lee, K., Cedrone, C. C., & Nishimura, M. (2004). What are you looking at? Acuity for triadic eye gaze. The Journal of General Psychology, 131(4), 451.
Tachi, S. (2003, May). Telexistence and retro-reflective projection technology (RPT). In Proceedings of the 5th virtual reality international conference (VRIC2003), vol. 69 (pp. 1–69).
Tachi, S., Kawakami, N., Inami, M., & Zaitsu, Y. (2004). Mutual telexistence system using retro-reflective projection technology. International Journal of Humanoid Robotics, 1(01), 45–64.
Vertegaal, R., van der Veer, G., & Vons, H. (2000, May). Effects of gaze on multiparty mediated communication. In Graphics interface (pp. 95–102).
Vertegaal, R., Slagter, R., Van der Veer, G., & Nijholt, A. (2001, March). Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 301–308). ACM.
Vishwanath, D., Girshick, A. R., & Banks, M. S. (2005). Why pictures look right when viewed from the wrong place. Nature, 8, 1401–1410.
Wolff, R., Roberts, D., Murgia, A., Murray, N., Rae, J., Steptoe, W., ... & Sharkey, P. (2008, October). Communicating eye gaze across a distance without rooting participants to the spot. In 12th 2008 IEEE/ACM international symposium on distributed simulation and real time applications (DS-RT 2008) (pp. 111–118). IEEE.
Metadata
Title
Telethrone Reconstructed; Ongoing Testing Toward a More Natural Situated Display
Authors
John O’Hare
Allen J. Fairchild
Robin Wolff
David J. Roberts
Copyright Year
2018
Book
Augmented Reality and Virtual Reality

Print ISBN: 978-3-319-64026-6

Electronic ISBN: 978-3-319-64027-3

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-319-64027-3_22

Premium Partner

    Image Credits