Top

Published in:

2011 | OriginalPaper | Chapter

8. Remote 3D Medical Consultation

Authors : Greg Welch, Diane H. Sonnenwald, Henry Fuchs, Bruce Cairns, M.D., Ketan Mayer-Patel, Ruigang Yang, Andrei State, Herman Towles, Adrian Ilie, Srinivas Krishnan, Hanna M. Söderholm

Published in: Virtual Realities

Publisher: Springer Vienna

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Two-dimensional (2D) video-based telemedical consultation has been explored widely in the past 15–20 years. Two issues that seem to arise in most relevant case studies are the difficulty associated with obtaining the desired 2D camera views, and poor depth perception. To address these problems we are exploring the use of a small array of cameras to synthesize a spatially continuous range of dynamic three-dimensional (3D) views of a remote environment and events. The 3D views can be sent across wired or wireless networks to remote viewers with fixed displays or mobile devices such as a personal digital assistant (PDA). The viewpoints could be specified manually or automatically via user head or PDA tracking, giving the remote viewer virtual head- or hand-slaved (PDA-based) remote cameras for mono or stereo viewing. We call this idea remote 3D medical consultation (3DMC). In this article we motivate and explain the vision for 3D medical consultation; we describe the relevant computer vision/graphics, display, and networking research; we present a proof-of-concept prototype system; and we present some early experimental results supporting the general hypothesis that 3D remote medical consultation could offer benefits over conventional 2D televideo.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Cloth Simulation Based Motion Capture of Dressed Humans

next chapter SEE MORE: Improving the Usage of Large Display Environments

Autostereoscopic displays provide one more viewers with a fixed number of stereo views (for example eight) of a 3D scene, without the use of special user-worn glasses. See http://www.newsight.com.

3rdTech, Inc. (2005). http://www.3rdtech.com/

ARToolkit (2005). http://www.hitl.washington.edu/artoolkit/

Point Grey Research (2005). http://www.ptgrey.com/

Virtual Reality Peripheral Network (2006). http://www.cs.unc.edu/Research/vrpn/

Bandura, A.: Self-efficacy: the exercise of control. W.H. Freeman, New York (1997)

Chu, Y., Huang, X., Ganz, A.: Wista: A wireless transmission system for disaster patient care. In: Proceedings of BROADNETS: 2nd IEEE/CreateNet International Conference on Broadband Networks, pp. 118–122. Omnipress, Boston (2005)

Coates, T., Goode, A.: Towards improving prehospital trauma care. Lancet 357(9274), 2070 (2001)

David G. Ellis, M., James Mayrose, P., Dietrich V. Jehle, M., Ronald M. Moscati, M., Guillermo J. Pierluisi, M.: A telemedicine model for emergency care in a short-term correctional facility. Telemedicine Journal and e-Health 7(2), 87–92 (2001)

Dimmick, S.L., Mustaleski, C., Burgiss, S.G., Welsh, T.S.: A case study of benefits and potential savings in rural home telemedicine. Home Healthcare Nurse 18(2), 125–135 (2000)CrossRef

10.

Doty, E., L. H. Zincone, J., Balch, D.C.: Medicine Meets Virtual Reality: Healthcare in the Information Age, chap. Telemedicine in the North Carolina Prison System, pp. 239–241. IOS Press, Eds. J. Weghorst, Hans B. Sieburg, and Karen S. Morgan (1996)

11.

Downey, J.: Measuring general computer self-efficacy: The surprising comparison of three instruments in predicting performance, attitudes, and usage. Hawaii International Conference on System Sciences 8, 210a (2006). DOI doi. ieeecomputersociety.org/10.1109/HICSS.2006.268

12.

Fitzmaurice, G.W.: Situated information spaces ad spatially aware palmtop computers. Communications of the ACM 36(7) (1993)

13.

Fitzmaurice, G.W., Buxton, W.: The chameleon: Spatially aware palmtop computers. In: ACM CHI94. Boston, MA USA (1994)

14.

Fitzmaurice, G.W., Zhai, S., Chignell, M.H.: Virtual reality for palmtop computers. ACM Transactions on Information Systems 11, 197–218 (1993)CrossRef

15.

Gotz, D., Mayer-Patel, K.: A general framework for multidimensional adaptation. In: MULTIMEDIA ’04: Proc. of the 12th annual ACM international conference on Multimedia, pp. 612–619. ACM, New York (2004). DOI doi.acm.org/10.1145/ 1027527.1027671

16.

Hendrix, C., Barfield, W.: Presence within virtual environments as a function of visual display parameters. Presence: Teloperators and virtual environments 5(3), 274–289 (1996)

17.

Hinckley, K., Pausch, R., Goble, J.C., Kassell, N.F.: Passive real-world interface props for neurosurgical visualization. In: CHI ’94: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 452–458. ACM, New York (1994). DOI doi.acm.org/10.1145/191666.191821

18.

Hwang, J., Jung, J., Kim, G.J.: Hand-held virtual reality: A feasibility study. In: Proceedings of the ACM symposium on Virtual reality software and technology, pp. 356–363. ACM (2006)

19.

Hwang, J., Jung, J., Yim, S., Cheon, J., Lee, S., Choi, S., Kim, G.J.: Requirements, implementation and applications of hand-held virtual reality. IJVR 5(2), 59–66 (2006)

20.

Kaiser Permanente: Outcomes of the kaiser permanente tele-home health research project. Archives of Family Medicine 9 (2000)

21.

Krishnan, S., Mayer-Patel, K.: A utility-driven framework for loss and encoding aware video adaptation. In: MULTIMEDIA ’07: Proceedings of the 15th international conference on Multimedia, pp. 1026–1035. ACM, New York, NY, USA (2007). DOI doi.acm.org/10.1145/1291233.1291459

22.

Meyer, A.: Death and disability from injury: A global challenge. J Trauma 44(1), 1–12 (1998)CrossRef

23.

Michael G. Kienzle, M.: Rural-academic integration: Iowas national laboratory for the study of rural telemedicine. Tech. rep., National Laboratory for the Study of Rural Telemedicine (2000)

24.

Mizell, D.W., Jones, S.P., Slater, M., Spanlang, B., Swapp, D.: Immersive virtual reality vs. “flat-screen” visualization: A measurable advantage. (Submitted for publication). (2003)

25.

Mohring, M., Lessig, C., Bimber, O.: Video see-through AR on consumer cell-phones. In: Proc. of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’04), pp. 252–253. IEEE Computer Society, Washington, DC, USA (2004). DOI dx.doi.org/10.1109/ISMAR.2004.63

26.

Mun, S.K.: Project phoenix: Scrutinizing a telemedicine testbed. final project report, national library of medicine, contract #n01-lm-6-3544. Tech. rep., Georgetown University Medical Center (2000)

27.

Office for the Advancement of Telehealth: Telemedicine report to congress. Tech. rep., U.S. Department of Health and Human Services, Health Resources and Services Administration (2001)

28.

Pasman, W., van der Schaaf, A., Lagendijk R.L., Jansen F.W.: Accurate overlaying for mobile augmented reality. Computers and Graphics 23, 875–881 (1999)CrossRef

29.

Pausch, R., Shackelford, M.A., Proffitt, D.: A user study comparing head-mounted and stationary displays. In: Proc. of IEEE Symposium on Research Frontiers in Virtual Reality, pp. 41–45. IEEE (1993)

30.

Reitmayr, G., Drummond, T.W.: Going out: Robust modelbased tracking for outdoor augmented reality. In: Proceedings of 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR, pp. 109–118 (2006)

31.

Schroeder, R., Steed, A., Axelsson, A.S., Heldal, I., Abelin, A., Wideström, J., Nilsson, A., Slater, M.: Collaborating in networked immersive spaces: As good as being there together? Computers & Graphics, Special Issue on Mixed Realities – Beyond Conventions 25(5), 781–788 (2001). http://www.elsevier.com/gej-ng/10/13/20/57/34/32/article.pdf

32.

Snow, M.P.: Charting presence in virtual environments and its effects on performance. Ph.D. thesis, Virginia Polytechnic Institute and State University (1996)

33.

Söderholm, H.M., Sonnenwald, D.H.: Visioning future emergency healthcare collaboration: Perspectives from large and small medical centers. Journal of the American Society for Information Science and Technology 61(9), 1808–1823 (2010).CrossRef

34.

Söderholm, H.M., Sonnenwald, D.H., Manning, J.E., Cairns, B., Welch, G., Fuchs, H.: Exploring the potential of video technologies for collaboration in emergency medical care. part ii: Task performance. Journal of the American Society for Information Science and Technology 59(14), 2335–2349 (2008). DOI 10.1002/asi.20939. http://www3.interscience.wiley.com/journal/121378034/abstract

35.

Sonnenwald, D.H., Söderholm, H.M., Manning, J.E., Cairns, B., Welch, G., Fuchs, H.: Exploring the potential of video technologies for collaboration in emergency medical care. part i: Information sharing. Journal of the American Society for Information Science and Technology 59(14), 2320–2334 (2008). DOI 10.1002/asi.20934. http://www3.interscience.wiley.com/journal/121378032/abstract?CRETRY=1&SRETRY=0

36.

Tachakra, S.: Depth perception in telemedical consultations. Telemed J E Health 7(2), 77–85. (2001)CrossRef

37.

Telemedicine Directorate: Advanced concept technology demonstrations letter of finding. Tech. rep., Walter Reed Army Medical Center (2000). http://www.salud.gob.mx/unidades/sic/cits/doctosFuente/2001REPO.pdf

38.

Wagner, D., Schmalstieg, D.: First steps towards handheld augmented reality. In: ISWC ’03: Proceedings of the 7th IEEE International Symposium on Wearable Computers International Symposium on Wearable Computers. IEEE Computer Society, Washington, DC, USA (2003)

39.

Wagner, D., Schmalstieg, D.: Handheld augmented reality displays. In: G. Welch (ed.) Proceedings of 2nd Emerging Display Technologies Workshop (EDT 2006), pp. 35–36 (2006)

40.

Welch, G., Noland, M., Bishop, G.: Complementary tracking and two-handed interaction for remote 3d medical consultation with a pda. In: G. Zachmann (ed.) Proceedings of Trends and Issues in Tracking for Virtual Environments, Workshop at the IEEE Virtual Reality 2007 Conference. Shaker, Charlotte, NC USA (2007)

41.

Yang, R.: View-dependent pixel coloring—a physically-based approach for 2d view synthesis. Ph.d. thesis, University of North Carolina at Chapel Hill (2003)

42.

Yang, R., Pollefeys, M., Yang, H., Welch, G.: A unified approach to real-time, multi-resolution, multi-baseline 2d view synthesis and 3d depth estimation using commodity graphics hardware. International Journal of Image and Graphics (IJIG) 4(4), 1–25 (2004)

43.

Zia Agha MD, M., Ralph M. Schapira, M., Azmaira H. Maker, P.: Cost effectiveness of telemedicine for the delivery of outpatient pulmonary care to a rural population. Telemedicine Journal and e-Health 8(3), 281–291 (2002)

Title: Remote 3D Medical Consultation
Authors: Greg Welch
Diane H. Sonnenwald
Henry Fuchs
Bruce Cairns, M.D.
Ketan Mayer-Patel
Ruigang Yang
Andrei State
Herman Towles
Adrian Ilie
Srinivas Krishnan
Hanna M. Söderholm
Publisher: Springer Vienna
Book: Virtual Realities
Print ISBN: 978-3-211-99177-0

Electronic ISBN: 978-3-211-99178-7

Copyright Year: 2011
DOI: https://doi.org/10.1007/978-3-211-99178-7_8