skip to main content
research-article

3D Virtual worlds and the metaverse: Current status and future possibilities

Published:03 July 2013Publication History
Skip Abstract Section

Abstract

Moving from a set of independent virtual worlds to an integrated network of 3D virtual worlds or Metaverse rests on progress in four areas: immersive realism, ubiquity of access and identity, interoperability, and scalability. For each area, the current status and needed developments in order to achieve a functional Metaverse are described. Factors that support the formation of a viable Metaverse, such as institutional and popular interest and ongoing improvements in hardware performance, and factors that constrain the achievement of this goal, including limits in computational methods and unrealized collaboration among virtual world stakeholders and developers, are also considered.

References

  1. Abate, A. F., Guida, M., Leoncini, P., Nappi, M., and Ricciardi, S. 2009. A haptic-based approach to virtual training for aerospace industry. J. Vis. Lang. Comput. 20, 318--325. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Action = Reaction Labs, L. 2010. Ghost dynamic binaural audio. http://www.actionreactionlabs.com/ghost.php. (Last accessed on 3/11).Google ScholarGoogle Scholar
  3. Adabala, N., Magnenat-Thalmann, N., and Fei, G. 2003. Real-time rendering of woven clothes. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST'03). ACM, New York, NY, 41--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Alexander, O., Rogers, M., Lambeth, W., Chiang, M., and Debevec, P. 2009. The digital emily project: Photoreal facial modeling and animation. In Proceedings of the 36th International Conferece and Exhibition on Computer Graphics and Interactive Technologies (SIGGRAPH'09). ACM, New York, NY, 12:1--12:15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Antonelli (AV), J. and Maxsted (AV), M. 2011. Kokua/Imprudence viewer website. http://www.kokuaviewer.org. (Last accessed 3/11).Google ScholarGoogle Scholar
  6. Arangarasan, R. and Phillips Jr., G. N. 2002. Modular approach of multimodal integration in a virtual environment. In Proceedings of the 4th IEEE International Conference on Multimodal Interfaces (ICMI'02). IEEE Computer Society, Washington, DC, 331--336. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Arnaud, R. and Barnes, M. C. 2006. COLLADA: Sailing the Gulf of 3D Digital Content Creation. A K Peters Ltd, Natick, MA. Google ScholarGoogle ScholarCross RefCross Ref
  8. Aspin, R. A. and Roberts, D. J. 2011. A GPU based, projective multi-texturing approach to reconstructing the 3D human form for application in tele-presence. In Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW'11). ACM, New York, NY, 105--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Au, W. 2008. The Making of Second Life. Collins, New York, NY.Google ScholarGoogle Scholar
  10. Aurora-Sim Project. 2011. Aurora-Sim website. http://www.aurora-sim.org. (Last accessed 3/11).Google ScholarGoogle Scholar
  11. Baillie, L., Kunczier, H., and Anegg, H. 2005. Rolling, rotating and imagining in a virtual mobile world. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services (MobileHCI'05). ACM, New York, NY, 283--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Bakaus, P. 2010a. Aves engine sneak preview. http://www.youtube.com/watch?v=Ol3qQ4CEUTo. (Last accessed on 6/11).Google ScholarGoogle Scholar
  13. Bakaus, P. 2010b. Building a game engine with jQuery. In Proceedings of the jQuery Conference. http://www.slideshare.net/pbakaus/building-a-game-engine-with-jquery. (Last accessed 7/11).Google ScholarGoogle Scholar
  14. Berners-Lee, T., Fielding, R., and Masinter, L. 2005. Uniform resource identifier (URI): Generic syntax. Internet STD 66, RFC 3986. http://www.ietf.org/rfc/rfc2396.txt. (Last accessed 7/11). Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Biocca, F., Kim, J., and Choi, Y. 2001. Visual touch in virtual environments: An exploratory study of presence, multimodal interfaces, and cross-modal sensory illusions. Presence: Teleoper. Virtual Environ. 10, 247--265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Blanchard, C., Burgess, S., Harvill, Y., Lanier, J., Lasko, A., Oberman, M., and Teitel, M. 1990. Reality built for two: A virtual reality tool. SIGGRAPH Comput. Graph. 24, 35--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Blascovich, J. and Bailenson, J. 2011. Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution. William Morrow, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Blauert, J. 1996. Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press, Cambridge, MA.Google ScholarGoogle ScholarCross RefCross Ref
  19. Boellstorff, T. 2008. Coming of Age in Second Life: An Anthropologist Explores the Virtually Human. Princeton University Press, Princeton, NJ. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Bonneel, N., Drettakis, G., Tsingos, N., Viaud-Delmon, I., and James, D. 2008. Fast modal sounds with scalable frequency-domain synthesis. ACM Trans. Graph. 27, 24:1--24:9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Boulanger, K., Pattanaik, S. N., and Bouatouch, K. 2009. Rendering grass in real time with dynamic lighting. IEEE Comput. Graph. Appl. 29, 32--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Bouthors, A., Neyret, F., Max, N., Bruneton, E., and Crassin, C. 2008. Interactive multiple anisotropic scattering in clouds. In Proceedings of the Symposium on Interactive 3D Graphics and Games (I3D'08). ACM, New York, NY, 173--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Bradley, D., Heidrich, W., Popa, T., and Sheffer, A. 2010. High resolution passive facial performance capture. ACM Trans. Graph. 29, 41:1--41:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Brown, C. P. and Duda, R. O. 1998. A structural model for binaural sound synthesis. IEEE Trans. Speech Audio Process. 6, 476--488.Google ScholarGoogle ScholarCross RefCross Ref
  25. Bullion, C. and Gurocak, H. 2009. Haptic glove with mr brakes for distributed finger force feedback. Presence: Teleoper. Virtual Environ. 18, 421--433. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Burns, W. 2010. Defining the metaverse — revisited. http://cityofnidus.blogspot.com/2010/04/defining-metaverse-revisited.html. (Last accessed 5/11).Google ScholarGoogle Scholar
  27. Chadwick, J. N., An, S. S., and James, D. L. 2009. Harmonic shells: A practical nonlinear sound model for near-rigid thin shells. ACM Trans. Graph. 28, 119:1--119:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Chandrasiri, N. P., Naemura, T., Ishizuka, M., Harashima, H., and Barakonyi, I. 2004. Internet communication using real-time facial expression analysis and synthesis. IEEE MultiMedia 11, 20--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Charles, J. 1999. Neural interfaces link the mind and the machine. Computer 32, 16--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Chow, Y.-W., Pose, R., Regan, M., and Phillips, J. 2006. Human visual perception of region warping distortions. In Proceedings of the 29th Australasian Computer Science Conference - Volume 48 (ACSC'06). Australian Computer Society, Inc., Darlinghurst, Australia, 217--226. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Chun, J., Kwon, O., Min, K., and Park, P. 2007. Real-time face pose tracking and facial expression synthesizing for the animation of 3D avatar. In Proceedings of the 2nd International Conference on Technologies for e-Learning and Digital Entertainment (Edutainment'07). Springer-Verlag, Berlin, Heidelberg, 191--201. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Cinquetti (AV), K. 2011. Kirstens viewer website. http://www.kirstensviewer.com. (Last accessed 2/11).Google ScholarGoogle Scholar
  33. Cobos, M., Lopez, J. J., and Spors, S. 2010. A sparsity-based approach to 3D binaural sound synthesis using time-frequency array processing. EURASIP J. Adv. Signal Proces. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. COLLADA Community. 2011. COLLADA: Digital asset and FX exchange schema wiki. http://collada.org. (Last accessed 5/11).Google ScholarGoogle Scholar
  35. Cozzi, L., D'Angelo, P., Chiappalone, M., Ide, A. N., Novellino, A., Martinoia, S., and Sanguineti, V. 2005. Coding and decoding of information in a bi-directional neural interface. Neurocomput. 65--66, 783--792. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Cruz-Neira, C., Sandin, D. J., DeFanti, T. A., Kenyon, R. V., and Hart, J. C. 1992. The cave: Audio visual experience automatic virtual environment. Commun. ACM 35, 64--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. de Pascale, M., Mulatto, S., and Prattichizzo, D. 2008. Bringing haptics to Second Life. In Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems (HAS'08). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, 6:1--6:6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Dean (AV), N. 2011. Nirans viewer project site. http://sourceforge.net/projects/niransviewer. (Last accessed 12/11).Google ScholarGoogle Scholar
  39. Elek, O. and Kmoch, P. 2010. Real-time spectral scattering in large-scale natural participating media. In Proceedings of the 26th Spring Conference on Computer Graphics (SCCG'10). ACM, New York, NY, 77--84. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Facebook. 2011. Facebook developers website. http://developers.facebook.com. (Last accessed 5/11).Google ScholarGoogle Scholar
  41. Fisher, B., Fels, S., MacLean, K., Munzner, T., and Rensink, R. 2004. Seeing, hearing, and touching: Putting it all together. In ACM SIGGRAPH 2004 Course Notes (SIGGRAPH'04). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Folgheraiter, M., Gini, G., and Vercesi, D. 2008. A multi-modal haptic interface for virtual reality and robotics. J. Intell. Robotics Syst. 52, 465--488. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Francone, J. and Nigay, L. 2011. 3D displays on mobile devices: Head-coupled perspective. http://iihm.imag.fr/en/demo/hcpmobile. (Last accessed 4/11).Google ScholarGoogle Scholar
  44. Frey, D., Royan, J., Piegay, R., Kermarrec, A.-M., Anceaume, E., and Fessant, F. L. 2008. Solipsis: A decentralized architecture for virtual environments. In Proceedings of the 1st International Workshop on Massively Multiuser Virtual Environments (MMVE). 29--33.Google ScholarGoogle Scholar
  45. Gamasutra Staff. 2011. Behind the scenes of Trion Worlds' Rift. http://www.gamasutra.com/view/news/35009/Exclusive_Behind_The_Scenes_Of_Trion_Worlds_Rift.php. (Last accessed 6/11).Google ScholarGoogle Scholar
  46. Gearz (AV), S. 2011. Singularity viewer website. http://www.singularityviewer.org. (Last accessed 3/11).Google ScholarGoogle Scholar
  47. Geddes, L. 2010. Immortal avatars: Back up your brain, never die. New Scientist 206, 2763, 28--31.Google ScholarGoogle Scholar
  48. Ghosh, A. 2007. Realistic materials and illumination environments. Ph.D. dissertation, University of British Columbia, Vancouver, BC, Canada. AAINR31775. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Gilbert, R. L. 2011. The P.R.O.S.E. Project: A program of in-world behavioral research on the Metaverse. J. Virtual Worlds Res. 4, 1, 3--18.Google ScholarGoogle ScholarCross RefCross Ref
  50. Gilbert, R. L. and Forney, A. 2013. The distributed self: Virtual worlds and the future of human identity. In The Immersive Internet: Reflections on the entagling of the virtual with society, politics, and the economy, D. Powers and R. Teigland, Eds., Palgrave-Macmillan, 23--37.Google ScholarGoogle Scholar
  51. Gilbert, R. L., Foss, J., and Murphy, N. 2011a. Multiple personality order: Physical and personality characteristics of the self, primary avatar, and alt. In Reinventing Ourselves: Contemporary Concepts of Identity in Virtual Worlds, A. Peachey and M. Childs, Eds. Springer Publishing, London, 213--234.Google ScholarGoogle Scholar
  52. Gilbert, R. L., Gonzalez, M. A., and Murphy, N. A. 2011b. Sexuality in the 3D Internet and its relationship to real-life sexuality. Psychol. Sexual. 2, 107--122.Google ScholarGoogle ScholarCross RefCross Ref
  53. Gladstone, D. 2011. Trion rift opens on HP servers. The next bench blog, http://h20435.www2.hp.com/t5/The-Next-Bench-Blog/Trion-Rift-Opens-on-HP-Servers/ba-p/61333. (Last accessed on 6/11).Google ScholarGoogle Scholar
  54. Glencross, M., Chalmers, A. G., Lin, M. C., Otaduy, M. A., and Gutierrez, D. 2006. Exploiting perception in high-fidelity virtual environments. In ACM SIGGRAPH 2006 Courses (SIGGRAPH'06). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Gosselin, B. and Sawan, M. 2010. A low-power integrated neural interface with digital spike detection and extraction. Analog Integr. Circuits Signal Process. 64, 3--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Greenberg, S., Marquardt, N., Ballendat, T., Diaz-Marino, R., and Wang, M. 2011. Proxemic interactions: The new ubicomp? Interactions 18, 42--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Gupta, N., Demers, A., Gehrke, J., Unterbrunner, P., and White, W. 2009. Scalability for virtual worlds. In Proceedings of the IEEE 25th International Conference on Data Engineering (ICDE'09). 1311--1314. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Haans, A. and IJsselsteijn, W. 2006. Mediated social touch: A review of current research and future directions. Virtual Real. 9, 149--159. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Hao, A., Song, F., Li, S., Liu, X., and Xu, X. 2009. Real-time realistic rendering of tissue surface with mucous layer. In Proceedings of the 2nd International Workshop on Computer Science and Engineering - Volume 01 (IWCSE'09). IEEE Computer Society, Washington, DC, 302--306. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Harders, M., Bianchi, G., and Knoerlein, B. 2007. Multimodal augmented reality in medicine. In Proceedings of the 4th International Conference on Universal Access in Human-Computer Interaction: Ambient Interaction (UAHCI'07). Springer-Verlag, Berlin, Heidelberg, 652--658. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Hayhoe, M. M., Ballard, D. H., Triesch, J., Shinoda, H., Aivar, P., and Sullivan, B. 2002. Vision in natural and virtual environments. In Proceedings of the Symposium on Eye Tracking Research & Applications (ETRA'02). ACM, New York, NY, 7--13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Hertzmann, A., O'Sullivan, C., and Perlin, K. 2009. Realistic human body movement for emotional expressiveness. In ACM SIGGRAPH 2009 Courses (SIGGRAPH'09). ACM, New York, NY, 20:1--20:27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Ho, C.-C., MacDorman, K. F., and Pramono, Z. A. D. D. 2008. Human emotion and the uncanny valley: A GLM, MDS, and Isomap analysis of robot video ratings. In Proceedings of the 3rd ACM/IEEE International Conference on Human Robot Interaction (HRI'08). ACM, New York, NY, 169--176. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Hu, Y., Velho, L., Tong, X., Guo, B., and Shum, H. 2006. Realistic, real-time rendering of ocean waves: Research articles. Comput. Animat. Virtual Worlds 17, 59--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. IEEE VW Standard Working Group. 2011a. IEEE virtual world standard working group wiki. http://www.metaversestandards.org. (Last accessed 5/11).Google ScholarGoogle Scholar
  66. IEEE VW Standard Working Group. 2011b. Terminology and definitions. http://www.metaversestandards.org/index.php?title=Terminology_and_Definitions#MetaWorld. (Last accessed 5/11).Google ScholarGoogle Scholar
  67. Image Metrics. 2011. Image metrics website. http://www.image-metrics.com. (Last accessed 4/11).Google ScholarGoogle Scholar
  68. Jay, C., Glencross, M., and Hubbold, R. 2007. Modeling the effects of delayed haptic and visual feedback in a collaborative virtual environment. ACM Trans. Comput.-Hum. Interact. 14, 8:1--8:31. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Jeon, N. J., Leem, C. S., Kim, M. H., and Shin, H. G. 2007. A taxonomy of ubiquitous computing applications. Wirel. Pers. Commun. 43, 1229--1239. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Jimenez, J., Scully, T., Barbosa, N., Donner, C., Alvarez, X., Vieira, T., Matts, P., Orvalho, V., Gutierrez, D., and Weyrich, T. 2010. A practical appearance model for dynamic facial color. ACM Trans. Graph. 29, 141:1--141:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Joly, J. 2010. Can a polygon make you cry? http://www.jonathanjoly.com/front.htm. (Last accessed 5/11). 17, 2011.Google ScholarGoogle Scholar
  72. Kall Binaural Audio. 2010. A brief history of binaural audio. http://www.kallbinauralaudio.com/binauralhistory.html. (Last accessed 3/11).Google ScholarGoogle Scholar
  73. Kawato, S. and Ohya, J. 2000. Real-time detection of nodding and head-shaking by directly detecting and tracking the “between-eyes”. In Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG'00). IEEE Computer Society, Washington, DC, 40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Keller, J. and Simon, G. 2002. Toward a peer-to-peer shared virtual reality. In Proceedings of the 22nd International Conference on Distributed Computing Systems (ICDCSW'02). IEEE Computer Society, Washington, DC, 695--700. Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Kim, J.-S., Gračanin, D., Matković, K., and Quek, F. 2010. The effects of finger-walking in place (FWIP) for spatial knowledge acquisition in virtual environments. In Proceedings of the 10th International Conference on Smart Graphics (SG'10). Lecture Notes in Computer Science, vol. 6133, Springer-Verlag, Berlin, Heidelberg, 56--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Koepnick, S., Hoang, R. V., Sgambati, M. R., Coming, D. S., Suma, E. A., and Sherman, W. R. 2010. Graphics for serious games: Rist: Radiological immersive survey training for two simultaneous users. Comput. Graph. 34, 665--676. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Korolov, M. 2011. Kitely brings Facebook, instant regions to OpenSim. Hypergrid Business.Google ScholarGoogle Scholar
  78. Krol, L. R., Aliakseyeu, D., and Subramanian, S. 2009. Haptic feedback in remote pointing. In Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA'09). ACM, New York, NY, 3763--3768. Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Krueger, M. W. 1993. An Easy Entry Artificial Reality. Academic Press Professional, Cambridge, MA, Chapter 7, 147--162.Google ScholarGoogle Scholar
  80. Kuchenbecker, K. J. 2008. Haptography: Capturing the feel of real objects to enable authentic haptic rendering (invited paper). In Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems (HAS'08). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, 3:1--3:3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Kumar, S., Chhugani, J., Kim, C., Kim, D., Nguyen, A., Dubey, P., Bienia, C., and Kim, Y. 2008. Second life and the new generation of virtual worlds. Computer 41, 46--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Kurzweil, R. 2001. The law of accelerating returns. http://www.kurzweilai.net/the-law-of-accelerating-returns. (Last accessed 4/11).Google ScholarGoogle Scholar
  83. Lanier, J. 1992. Virtual reality: The promise of the future. Interact. Learn. Int. 8, 275--279. Google ScholarGoogle ScholarDigital LibraryDigital Library
  84. Lanier, J. 2010. You are not a Gadget: A Manifesto. Alfred A. Knopf, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. Lanier, J. and Biocca, F. 1992. An insider's view of the future of virtual reality. J. Commun. 42, 4, 150--172.Google ScholarGoogle ScholarCross RefCross Ref
  86. Latoschik, M. E. 2005. A user interface framework for multimodal VR interactions. In Proceedings of the 7th International Conference on Multimodal Interfaces (ICMI'05). ACM, New York, NY, 76--83. Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Lécuyer, A. 2009. Simulating haptic feedback using vision: A survey of research and applications of pseudo-haptic feedback. Presence: Teleoper. Virtual Environ. 18, 39--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. Lee, Y., Wampler, K., Bernstein, G., Popović, J., and Popović, Z. 2010. Motion fields for interactive character locomotion. ACM Trans. Graph. 29, 138:1--138:8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  89. Lewinski, J. S. 2011. Light at the end of the racetrack: How Pixar explored the physics of light for Cars 2. Sci. Am., 20.Google ScholarGoogle Scholar
  90. Linden Lab. 2011a. Extended Second Life knowledge base: Graphics preferences layout. http://wiki.secondlife.com/wiki/Graphics_Preferences_Layout. (Last accessed 4/11).Google ScholarGoogle Scholar
  91. Linden Lab. 2011b. New SL viewer with improved search and real-time shadows. http://community. secondlife.com/t5/Featured-News/New-SL-Viewer-with-Improved-Search-and-Real-Time-Shadows/ba-p/927463. (Last accessed 7/11).Google ScholarGoogle Scholar
  92. Liu, H., Bowman, M., Adams, R., Hurliman, J., and Lake, D. 2010. Scaling virtual worlds: Simulation requirements and challenges. In Proceedings of the Winter Simulation Conference (WSC). The WSC Foundation, Baltimore, MD, 778--790. Google ScholarGoogle ScholarDigital LibraryDigital Library
  93. Lober, A., Schwabe, G., and Grimm, S. 2007. Audio vs. chat: The effects of group size on media choice. In Proceedings of the 40th Annual Hawaii International Conference on System Sciences (HICSS'07). IEEE Computer Society, Washington, DC, 41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  94. Ludlow, P. and Wallace, M. 2007. The Second Life Herald: The virtual tabloid that witnessed the dawn of the Metaverse. MIT Press, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  95. Lynn, R. 2004. Ins and outs of teledildonics. Wired. http://www.wired.com/. (Last accessed 3/11).Google ScholarGoogle Scholar
  96. Lyon (AV), J. 2011. Phoenix viewer website. http://www.phoenixviewer.com. (Last accessed 3/11).Google ScholarGoogle Scholar
  97. Marcos, S., Gómez-García-Bermejo, J., and Zalama, E. 2010. A realistic, virtual head for human-computer interaction. Interact. Comput. 22, 176--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  98. Martin, J.-C., D'Alessandro, C., Jacquemin, C., Katz, B., Max, A., Pointal, L., and Rilliard, A. 2007. 3D audiovisual rendering and real-time interactive control of expressivity in a talking head. In Proceedings of the 7th International Conference on Intelligent Virtual Agents (IVA'07). Lecture Notes in Computer Science, vol. 4722, Springer-Verlag, Berlin, Heidelberg, 29--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  99. McDonnell, R. and Breidt, M. 2010. Face reality: Investigating the uncanny valley for virtual faces. In ACM SIGGRAPH ASIA 2010 Sketches (SA'10). ACM, New York, NY, 41:1--41:2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  100. McDonnell, R., Jörg, S., McHugh, J., Newell, F. N., and O'Sullivan, C. 2009. Investigating the role of body shape on the perception of emotion. ACM Trans. Appl. Percept. 6, 14:1--14:11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. Mecwan, A. I., Savani, V. G., Rajvi, S., and Vaya, P. 2009. Voice conversion algorithm. In Proceedings of the International Conference on Advances in Computing, Communication and Control (ICAC3'09). ACM, New York, NY, 615--619. Google ScholarGoogle ScholarDigital LibraryDigital Library
  102. Misselhorn, C. 2009. Empathy with inanimate objects and the uncanny valley. Minds Mach. 19, 345--359. Google ScholarGoogle ScholarDigital LibraryDigital Library
  103. Moore, G. E. 1965. Cramming more components into integrated circuits. Electronics 38, 8.Google ScholarGoogle Scholar
  104. Mori, M. 1970. Bukimi no tani (the uncanny valley). Energy 7, 4, 33--35.Google ScholarGoogle Scholar
  105. Morningstar, C. and Farmer, F. R. 1991. The Lessons of Lucasfilm's Habitat. MIT Press, Cambridge, MA. 273--302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. Morris, D., Kelland, M., and Lloyd, D. 2005. Machinima: Making Animated Movies in 3D Virtual Environments. Muska & Lipman/Premier-Trade, Cincinnati, OH. Google ScholarGoogle ScholarDigital LibraryDigital Library
  107. Moss, W., Yeh, H., Hong, J.-M., Lin, M. C., and Manocha, D. 2010. Sounding liquids: Automatic sound synthesis from fluid simulation. ACM Trans. Graph. 29, 21:1--21:13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  108. Nakamoto, S. 2009. Bitcoin: A peer-to-peer electronic cash system. http://www.bitcoin.org/bitcoin.pdf. (Last accessed 6/11).Google ScholarGoogle Scholar
  109. National Academy of Engineering. 2008. Grand Challenges for Engineering. National Academy of Engineering, Washington, DC.Google ScholarGoogle Scholar
  110. Naumann, A. B., Wechsung, I., and Hurtienne, J. 2010. Multimodal interaction: A suitable strategy for including older users? Interact. Comput. 22, 465--474. Google ScholarGoogle ScholarDigital LibraryDigital Library
  111. Newman, R., Matsumoto, Y., Rougeaux, S., and Zelinsky, A. 2000. Real-time stereo tracking for head pose and gaze estimation. In Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG'00). IEEE Computer Society, Washington, DC, 122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. OAuth Community. 2011. OAuth home page. http://oauth.net. (Last accessed 5/11).Google ScholarGoogle Scholar
  113. O'Brien, J. F., Shen, C., and Gatchalian, C. M. 2002. Synthesizing sounds from rigid-body simulations. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA'02). ACM, New York, NY, 175--181. Google ScholarGoogle ScholarDigital LibraryDigital Library
  114. Olano, M., Akeley, K., Hart, J. C., Heidrich, W., McCool, M., Mitchell, J. L., and Rost, R. 2004. Real-time shading. In ACM SIGGRAPH 2004 Course Notes (SIGGRAPH'04). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  115. Olano, M. and Lastra, A. 1998. A shading language on graphics hardware: The pixelflow shading system. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'98). ACM, New York, NY, 159--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  116. Open Cobalt Project. 2011. Open Cobalt website. http://www.opencobalt.org. (Last accessed 3/11).Google ScholarGoogle Scholar
  117. Open Wonderland Foundation. 2011. Open Wonderland website. http://www.openwonderland.org. (Last accessed 3/11).Google ScholarGoogle Scholar
  118. OpenID Foundation. 2011. OpenID Foundation homepage. http://openid.net.Google ScholarGoogle Scholar
  119. OpenSimulator Project. 2011. OpenSimulator website. http://www.opensimulator.org. (Last accessed 3/11).Google ScholarGoogle Scholar
  120. Otaduy, M. A., Igarashi, T., and LaViola, Jr., J. J. 2009. Interaction: Interfaces, algorithms, and applications. In ACM SIGGRAPH 2009 Courses (SIGGRAPH'09). ACM, New York, NY, 14:1--14:66. Google ScholarGoogle ScholarDigital LibraryDigital Library
  121. Paleari, M. and Lisetti, C. L. 2006. Toward multimodal fusion of affective cues. In Proceedings of the 1st ACM International Workshop on Human-Centered Multimedia (HCM'06). ACM, New York, NY, 99--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  122. Piotrowski, J. and Terzis, G. 2011. Virtual currency: Bits and bob. http://www.economist.com/blogs/babbage/2011/06/virtual-currency. (Last accessed 6/11).Google ScholarGoogle Scholar
  123. Pocket Metaverse. 2009. Pocket Metaverse website. http://www.pocketmetaverse.com. (Last accessed 5/11).Google ScholarGoogle Scholar
  124. Rahman, A. S. M. M., Hossain, S. K. A., and Saddik, A. E. 2010. Bridging the gap between virtual and real world by bringing an interpersonal haptic communication system in Second Life. In Proceedings of the IEEE International Symposium on Multimedia (ISM'10). IEEE Computer Society, Washington, DC, 228--235. Google ScholarGoogle ScholarDigital LibraryDigital Library
  125. Rankine, R., Ayromlou, M., Alizadeh, H., and Rivers, W. 2011. Kinect Second Life interface. http://www.youtube.com/watch?v=KvVWjah_fXU. (Last accessed 5/11).Google ScholarGoogle Scholar
  126. Raymond, E. S. 2001. The Cathedral and the Bazaar: Musings on Linux and Open Source by an Accidental Revolutionary. O'Reilly & Associates, Inc., Sebastopol, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  127. realXtend Association. 2011. realXtend website. http://realxtend.wordpress.com. (Last accessed 12/11).Google ScholarGoogle Scholar
  128. Recanzone, G. H. 2003. Auditory influences on visual temporal rate perception. J. Neurophysiol. 89, 2, 1078--1093.Google ScholarGoogle ScholarCross RefCross Ref
  129. RedDwarf Server Project. 2011. RedDwarf server website. http://www.reddwarfserver.org. (Last accessed 6/11).Google ScholarGoogle Scholar
  130. Reed, D. P. 2005. Designing croquet's teatime: A real-time, temporal environment for active object cooperation. In Companion to the 20th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA'05). ACM, New York, NY, 7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  131. Roh, C. H. and Lee, W. B. 2005. Image blending for virtual environment construction based on tip model. In Proceedings of the 4th WSEAS International Conference on Signal Processing, Robotics and Automation. World Scientific and Engineering Academy and Society (WSEAS), Stevens Point, WI. 26:1--26:5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  132. Rost, R. J., Licea-Kane, B., Ginsburg, D., Kessenich, J. M., Lichtenbelt, B., Malan, H., and Weiblen, M. 2009. OpenGL Shading Language 3rd Ed. Addison-Wesley Professional, Boston, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  133. Sallnäs, E.-L. 2010. Haptic feedback increases perceived social presence. In Proceedings of the International Conference on Haptics - Generating and Perceiving Tangible Sensations: Part II (EuroHaptics'10). Lecture Notes in Computer Science, vol. 6192, Springer-Verlag, Berlin, Heidelberg, 178--185. Google ScholarGoogle ScholarDigital LibraryDigital Library
  134. Schmidt, K. O. and Dionisio, J. D. N. 2008. Texture map based sound synthesis in rigid-body simulations. In ACM SIGGRAPH 2008 Posters. ACM, New York, NY, 11:1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  135. Seng, D. and Wang, H. 2009. Realistic real-time rendering of 3D terrain scenes based on OpenGL. In Proceedings of the 1st IEEE International Conference on Information Science and Engineering (ICISE'09). IEEE Computer Society, Washington, DC, 2121--2124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  136. Seyama, J. and Nagayama, R. S. 2007. The uncanny valley: Effect of realism on the impression of artificial human faces. Presence: Teleoper. Virtual Environ. 16, 337--351. Google ScholarGoogle ScholarDigital LibraryDigital Library
  137. Seyama, J. and Nagayama, R. S. 2009. Probing the uncanny valley with the eye size aftereffect. Presence: Teleoper. Virtual Environ. 18, 321--339. Google ScholarGoogle ScholarDigital LibraryDigital Library
  138. Shah, M. 2007. Image-space approach to real-time realistic rendering. Ph.D. dissertation, University of Central Florida, Orlando, FL. AAI3302925. Google ScholarGoogle ScholarDigital LibraryDigital Library
  139. Shah, M. A., Konttinen, J., and Pattanaik, S. 2009. Image-space subsurface scattering for interactive rendering of deformable translucent objects. IEEE Comput. Graph. Appl. 29, 66--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  140. Short, J., Williams, E., and Christie, B. 1976. The Social Psychology of Telecommunications. Wiley, London, U.K.Google ScholarGoogle Scholar
  141. Smart, J., Cascio, J., and Pattendorf, J. 2007. Metaverse roadmap overview. http://www.metaverseroadmap.org. (Last accessed 2/11).Google ScholarGoogle Scholar
  142. Smurrayinchester (AV) and Voidvector (AV). 2008. Mori uncanny valley.svg. http://commons.wikimedia.org/wiki/File:Mori_Uncanny_Valley.svg under the Creative Commons Attribution-Share Alike 3.0 license. (Last accessed 6/11).Google ScholarGoogle Scholar
  143. Stoll, C., Gall, J., de Aguiar, E., Thrun, S., and Theobalt, C. 2010. Video-based reconstruction of animatable human characters. ACM Trans. Graph. 29, 139:1--139:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  144. Subramanian, S., Gutwin, C., Nacenta, M., Power, C., and Jun, L. 2005. Haptic and tactile feedback in directed movements. In Proceedings of the Conference on Guidelines on Tactile and Haptic Interactions.Google ScholarGoogle Scholar
  145. Sun, W. and Mukherjee, A. 2006. Generalized wavelet product integral for rendering dynamic glossy objects. ACM Trans. Graph. 25, 955--966. Google ScholarGoogle ScholarDigital LibraryDigital Library
  146. Sung, J. and Kim, D. 2009. Real-time facial expression recognition using STAAM and layered GDA classifier. Image Vision Comput. 27, 1313--1325. Google ScholarGoogle ScholarDigital LibraryDigital Library
  147. Taylor, M. T., Chandak, A., Antani, L., and Manocha, D. 2009. RESound: Interactive sound rendering for dynamic virtual environments. In Proceedings of the 17th ACM International Conference on Multimedia (MM'09). ACM, New York, NY, 271--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  148. Tinwell, A. and Grimshaw, M. 2009. Bridging the uncanny: An impossible traverse? In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era (MindTrek'09). ACM, New York, NY, 66--73. Google ScholarGoogle ScholarDigital LibraryDigital Library
  149. Tinwell, A., Grimshaw, M., Nabi, D. A., and Williams, A. 2011. Facial expression of emotion and perception of the uncanny valley in virtual characters. Comput. Hum. Behav. 27, 741--749. Google ScholarGoogle ScholarDigital LibraryDigital Library
  150. Trattner, C., Steurer, M. E., and Kappe, F. 2010. Socializing virtual worlds with facebook: A prototypical implementation of an expansion pack to communicate between facebook and opensimulator based virtual worlds. In Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments (MindTrek'10). ACM, New York, NY, 158--160. Google ScholarGoogle ScholarDigital LibraryDigital Library
  151. Triesch, J. and von der Malsburg, C. 1998. Robotic gesture recognition by cue combination. In Informatik'98: Informatik zwischen Bild und Sprache, J. Dassow and R. Kruse, Eds., Springer-Verlag, Magdeburg, Germany, 223--232.Google ScholarGoogle Scholar
  152. Tsetserukou, D. 2010. HaptiHug: A novel haptic display for communication of hug over a distance. In Proceedings of the International Conference on Haptics: Generating and perceiving tangible sensations, Part I (EuroHaptics'10). Lecture Notes in Computer Science, vol. 6191, Springer-Verlag, Berlin, Heidelberg, 340--347. Google ScholarGoogle ScholarDigital LibraryDigital Library
  153. Tsetserukou, D., Neviarouskaya, A., Prendinger, H., Ishizuka, M., and Tachi, S. 2010. iFeel_IM: Innovative real-time communication system with rich emotional and haptic channels. In Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA'10). ACM, New York, NY, 3031--3036. Google ScholarGoogle ScholarDigital LibraryDigital Library
  154. Turkle, S. 1995. Life on the Screen: Identity in the Age of the Internet. Simon & Schuster Trade, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  155. Turkle, S. 2007. Evocative Objects: Things We Think With. MIT Press, Cambridge, MA.Google ScholarGoogle Scholar
  156. Twitter. 2011. Twitter API documentation website. http://dev.twitter.com/doc. (Last accessed 5/11).Google ScholarGoogle Scholar
  157. Ueda, Y., Hirota, M., and Sakata, T. 2006. Vowel synthesis based on the spectral morphing and its application to speaker conversion. In Proceedings of the 1st International Conference on Innovative Computing, Information and Control - Volume 2 (ICICIC'06). IEEE Computer Society, Washington, DC, 738--741. Google ScholarGoogle ScholarDigital LibraryDigital Library
  158. van den Doel, K., Kry, P. G., and Pai, D. K. 2001. FoleyAutomatic: Physically-based sound effects for interactive simulation and animation. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'01). ACM, New York, NY, 537--544. Google ScholarGoogle ScholarDigital LibraryDigital Library
  159. Vignais, N., Kulpa, R., Craig, C., Brault, S., Multon, F., and Bideau, B. 2010. Influence of the graphical levels of detail of a virtual thrower on the perception of the movement. Presence: Teleoper. Virtual Environ. 19, 243--252. Google ScholarGoogle ScholarDigital LibraryDigital Library
  160. Wachs, J. P., Kölsch, M., Stern, H., and Edan, Y. 2011. Vision-based hand-gesture applications. Commun. ACM 54, 60--71. Google ScholarGoogle ScholarDigital LibraryDigital Library
  161. Wadley, G., Gibbs, M. R., and Ducheneaut, N. 2009. You can be too rich: Mediated communication in a virtual world. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (OZCHI'09). ACM, New York, NY, 49--56. Google ScholarGoogle ScholarDigital LibraryDigital Library
  162. Waldo, J. 2008. Scaling in games and virtual worlds. Commun. ACM 51, 38--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  163. Wang, L., Lin, Z., Fang, T., Yang, X., Yu, X., and Kang, S. B. 2006. Real-time rendering of realistic rain. In ACM SIGGRAPH 2006 Sketches (SIGGRAPH'06). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  164. Weiser, M. 1991. The computer for the 21st century. Sci. Am. 265, 94--102.Google ScholarGoogle Scholar
  165. Weiser, M. 1993. Ubiquitous computing. Computer 26, 71--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  166. Wilkes, I. 2008. Second life: How it works (and how it doesn't). QCon 2008. http://www.infoq.com/presentations/Second-Life-Ian-Wilkes. (Last accessed 6/11).Google ScholarGoogle Scholar
  167. Withana, A., Kondo, M., Makino, Y., Kakehi, G., Sugimoto, M., and Inami, M. 2010. ImpAct: Immersive haptic stylus to enable direct touch and manipulation for surface computing. Comput. Entertain. 8, 9:1--9:16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  168. Xu, N., Shao, X., and Yang, Z. 2008. A novel voice morphing system using bi-gmm for high quality transformation. In Proceedings of the 9th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing. IEEE Computer Society, Washington, DC, 485--489. Google ScholarGoogle ScholarDigital LibraryDigital Library
  169. Yahoo! Inc. 2011. Flickr Services website. http://www.flickr.com/services/api. (Last accessed 5/11).Google ScholarGoogle Scholar
  170. Zhao, Q. 2011. 10 scientific problems in virtual reality. Commun. ACM 54, 116--118. Google ScholarGoogle ScholarDigital LibraryDigital Library
  171. Zheng, C. and James, D. L. 2009. Harmonic fluids. ACM Trans. Graph. 28, 37:1--37:12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  172. Zheng, C. and James, D. L. 2010. Rigid-body fracture sound with precomputed soundbanks. ACM Trans. Graph. 29, 69:1--69:13. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. 3D Virtual worlds and the metaverse: Current status and future possibilities

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              • Published in

                cover image ACM Computing Surveys
                ACM Computing Surveys  Volume 45, Issue 3
                June 2013
                575 pages
                ISSN:0360-0300
                EISSN:1557-7341
                DOI:10.1145/2480741
                Issue’s Table of Contents

                Copyright © 2013 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 3 July 2013
                • Accepted: 1 March 2012
                • Revised: 1 February 2012
                • Received: 1 July 2011
                Published in csur Volume 45, Issue 3

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article
                • Research
                • Refereed

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader