Wanmin Wu
Klara Nahrstedt
Skip Abstract Section
Abstract
This article presents a psychophysical study that measures the perceptual thresholds of a new factor called Color-plus-Depth Level-of-Details (CZLoD) peculiar to polygon-based 3D tele-immersive video. The results demonstrate the existence of Just Noticeable Degradation and Just Unacceptable Degradation thresholds on the factor. In light of the results, we design and implement a real-time perception-based quality adaptor for 3D tele-immersive video. Our experimental results show that the adaptation scheme can reduce resource usage (e.g., CPU cycles) while considerably enhancing the overall perceived visual quality. Our analysis confirms the potential temporal and spatial performance benefits achievable with CZLoD adaptation.
- Apteker, R., Fisher, J., Kisimov, V., and Neishlos, H. 1995. Video acceptability and frame rate. IEEE MultiMedia 2, 3, 32--40. Google Scholar
Digital Library
- Åström, K. J. and Murray, R. M. 2008. Feedback Systems: An Introduction for Scientists and Engineers. Princeton University Press. Google ScholarCross Ref
- Baker, H. H., Bhatti, N., Tanguay, D., Sobel, I., Gelb, D., Goss, M. E., Culbertson, W. B., and Malzbender, T. 2005. Understanding performance in Coliseum, an immersive videoconferencing system. ACM Trans. Multimed. Comput. Commun. Appl. 1, 2, 190--210. Google ScholarDigital Library
- Chang, Y.-C., Carney, T., Klein, S. A., Messerschmitt, D. G., and Zakhor, A. 1998. Effects of temporal jitter on video quality: Assessment using psychophysical methods. In Human Vision and Electronic Imaging III, Vol. 3299, 173--179.Google ScholarCross Ref
- Cisco TelePresence. 2006. http://www.cisco.com/en/US/products/ps7060/index.html.Google Scholar
- Dahlhaus, R. and Eichler, M. 2003. Causality and graphical models for time series. In Highly Structured Stochastic Systems. Oxford University Press, Oxford.Google Scholar
- de Silva, D., Fernando, W., Nur, G., Ekmekcioglu, E., and Worrall, S. 2010. 3D video assessment with just noticeable difference in depth evaluation. In Proceedings of the 17th IEEE International Conference on Image Processing (ICIP'10). 4013--4016.Google Scholar
- Gescheider, G. 1997. Psychophysics: The Fundamentals 3rd Ed. Psychology Press.Google Scholar
- Hacker, S. 2000. MP3: The Definitive Guide 1st Ed. O'Reilly. Google ScholarDigital Library
- Howard, I. 2002. Seeing in Depth. Vol. 2: Depth Perception. I Porteous.Google Scholar
- Iai, S., Kurita, T., and Kitawaki, N. 1993. Quality requirements for multimedia communication services and terminals - interaction of speech and video delays. In Proceedings of the Global Telecommunications Conference. 394--398.Google Scholar
- ITU. 1992. Information technology - digital compression and coding of continuous-tone still images - requirements and guidelines. International Telecommunication Union, Recommendation T.81.Google Scholar
- ITU. 2009. Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, Recommendation BT.500.Google Scholar
- Jain, A. K. and Dubes, R. C. 1981. Algorithms for Clustering Data. Prentice-Hall. Google ScholarDigital Library
- Jin, Z. X., Zhang, Y. J., Wang, X., and Plocher, T. 2007. Evaluating the usability of an auto-stereoscopic display. In Proceedings of the 12th International Conference on Human-Computer Interaction: Interaction Platforms and Techniques. 605--614. Google ScholarDigital Library
- Kanade, T., Rander, P., and Narayanan, P. 1997. Virtualized reality: Constructing virtual worlds from real scenes. IEEE MultiMedia 4, 1, 43--54. Google ScholarDigital Library
- Kies, J. K. 1997. Empirical methods for evaluating video-mediated collaborative work. Ph.D. thesis, Virginia Polytechnic Institute and State University. Google ScholarDigital Library
- Lambooij, M. and IJsselsteijn, W. 2009. Visual discomfort and visual fatigue of stereoscopic displays: A review. J. Imag. Sci. Tech. 53.Google ScholarCross Ref
- Luebke, D., Reddy, M., Cohen, J., Varshney, A., Watson, B., and Huebner, R. 2002. Level of Detail for 3D Graphics (The Morgan Kaufmann Series in Computer Graphics). Morgan Kaufmann. Google ScholarDigital Library
- Montgomery, D. C. 2000. Design and Analysis of Experiments 5th Ed. Wiley.Google Scholar
- Narayanan, P. J., Rander, P. W., and Kanade, T. 1998. Constructing virtual worlds using dense stereo. In Proceedings of the 6th International Conference on Computer Vision (ICCV'98). 3--10. Google ScholarDigital Library
- Ott, D. E. and Mayer-Patel, K. 2002. A mechanism for TCP-friendly transport-level protocol coordination. In Proceedings of the General Track of the Annual Conference on USENIX Annual Technical Conference (ATEC'02). 147--159. Google ScholarDigital Library
- Pinson, M. and Wolf, S. 2003. Comparing subjective video quality testing methodologies. In Proceedings of the SPIE Video Communications and Image Processing Conference (VCIP'03). 573--582.Google Scholar
- Polycom Telepresence. 2010. http://www.polycom.com/telepresence.Google Scholar
- Simons, D. J. and Rensink, R. A. 2005. Change blindness: Past, present, and future. Trends in Cogn. Sci. 9, 1, 16--20.Google ScholarCross Ref
- Steinbach, E., Hirche, S., Kammerl, J., Vittorias, I., and Chaudhari, R. 2011. Haptic data compression and communication. IEEE Signal Process. Mag. 28, 1, 87--96.Google ScholarCross Ref
- Steinmetz, R. 1996. Human perception of jitter and media synchronation. IEEE J. Select. Areas Commun. 14, 1, 61--72. Google ScholarDigital Library
- Towles, H., chao Chen, W., Yang, R., uok Kum, S., Kelshikar, H. F. N., Mulligan, J., Daniilidis, K., Fuchs, H., Hill, C. C., Mulligan, N. K. J., Holden, L., Zeleznik, B., Sadagic, A., and Lanier, J. 2002. 3D tele-collaboration over Internet2. In Proceedings of the International Workshop on Immersive Telepresence.Google Scholar
- Vasudevan, R., Kurillo, G., Lobaton, E., Bernardin, T., Kreylos, O., Bajcsy, R., and Nahrstedt, K. 2011. High quality visualization for geographically distributed 3-D teleimmersive applications. IEEE Trans. Multimedia 13, 3, 573--584. Google ScholarDigital Library
- Vasudevan, R., Lobaton, E., Kurillo, G., Bajcsy, R., Bernardin, T., Hamann, B., and Nahrstedt, K. 2010. A methodology for remote virtual interaction in teleimmersive environments. In Proceedings of the 1st Annual ACM SIGMM Conference on Multimedia Systems (MMSys'10). 281--292. Google ScholarDigital Library
- VQEG. http://www.its.bldrdoc.gov/vqeg/.Google Scholar
- Wu, W., Arefin, A., Kurillo, G., Agarwal, P., Nahrstedt, K., and Bajcsy, R. 2011. Color-plus-depth level-of-detail in 3D tele-immersive video: A psychophysical approach. In Proceedings of the 19th ACM International Conference on Multimedia (MM'11). 13--22. Google ScholarDigital Library
- Wu, W., Yang, Z., Gupta, I., and Nahrstedt, K. 2008. Towards multi-site collaboration in 3D tele-immersive environments. In Proceedings of the 2008 the 28th International Conference on Distributed Computing Systems (ICDCS'08). 647--654. Google ScholarDigital Library
- Würmlin, S., Lamboray, E., and Gross, M. 2003. 3D video fragments: Dynamic point samples for real-time free-viewpoint video. Tech. rep., Institute of Scientific Computing.Google Scholar
Index Terms
- CZLoD: A psychophysical approach for 3D tele-immersive video
Recommendations
Color-plus-depth level-of-detail in 3D tele-immersive video: a psychophysical approach
MM '11: Proceedings of the 19th ACM international conference on MultimediaThis paper presents a psychophysical study that measures the perceptual thresholds of a new factor called Color-plus-Depth Level-of-Detail peculiar to polygon-based 3D tele-immersive video. The results demonstrate the existence of Just Noticeable ...
A psychophysical approach for real-time 3D video processing
MM '11: Proceedings of the 19th ACM international conference on MultimediaThis paper presents a psychophysical approach to control a new factor called Color-plus-Depth Level-of-Detail in polygon-based 3D tele-immersive video. Based on our psychophysical study that demonstrates the existence of perceptual thresholds on the ...
Brightness of the glare illusion
APGV '08: Proceedings of the 5th symposium on Applied perception in graphics and visualizationThe glare illusion is commonly used in CG rendering, especially in game engines, to achieve a higher brightness than that of the maximum luminance of a display. In this work, we measure the perceived luminance of the glare illusion in a psychophysical ...
Comments