Abstract
We developed and evaluated different schemes for the real-time compression of multiple depth image streams. Our analysis suggests that a hybrid lossless-lossy compression approach provides a good tradeoff between quality and compression ratio. Lossless compression based on run length encoding is used to preserve the information of the highest bits of the depth image pixels. The lowest 10-bits of a depth pixel value are directly encoded in the Y channel of a YUV image and encoded by a x264 codec. Our experiments show that the proposed method can encode and decode multiple depth image streams in less than 12 ms on average. Depending on the compression level, which can be adjusted during application runtime, we are able to achieve a compression ratio of about 4:1 to 20:1. Initial results indicate that the quality for 3D reconstructions is almost indistinguishable from the original for a compression ratio of up to 10:1.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bal, C., Nguyen, T.: Multiview video plus depth coding with depth-based prediction mode. IEEE Trans. Circuits Syst. Video Technol. 24(6), 995–1005 (2014)
Beck, S., Kunert, A., Kulik, A., Froehlich, B.: Immersive group-to-group telepresence. IEEE Trans. Visual Comput. Graphics 19(4), 616–625 (2013)
Champawat, Y., Kumar, S.: Online point-cloud transmission for tele-immersion. In: Proceedings of VRCAI 2012, pp. 79–82. ACM, New York (2012)
Cho, T., Lee, Y., Shin, J.: A homogenizing filter for depth map compressive sensing using edge-awarded method. In: Proceedings of ICT Convergence 2013, pp. 591–595, October 2013
Choi, J.-A., Ho, Y.-S.: Improved near-lossless hevc codec for depth map based on statistical analysis of residual data. In: Proceedings of ISCS 2012, pp. 894–897, May 2012
FFMpeg. Ffmpeg (2014, nov. version 2.6.1): audio and video codec library. https://www.ffmpeg.org/
Fu, J., Miao, D., Yu, W., Wang, S., Lu, Y., Li, S.: Kinect-like depth data compression. IEEE Trans. Multimedia 15(6), 1340–1352 (2013)
Gautier, J., Le Meur, O., Guillemot, C.: Efficient depth map compression based on lossless edge coding and diffusion. In: Proceedings of PCS 2012, pp. 81–84, May 2012
Hoffmann, S., Mainberger, M., Weickert, J., Puhl, M.: Compression of depth maps with segment-based homogeneous diffusion. In: Pack, T. (ed.) SSVM 2013. LNCS, vol. 7893, pp. 319–330. Springer, Heidelberg (2013)
Ko, H., Kuo, C.-C.: A new in-loop filter for depth map coding in hevc. In: Proceedings of APSIPA ASC 2012, pp. 1–7, December 2012
Lan, C., Xu, J., Wu, F.: Object-based coding for kinect depth and color videos. In: Proceedings of VCIP 2012, pp. 1–6, November 2012
Mamou, K., Zaharia, T., Prêteux, F.: Tfan: a low complexity 3d mesh compression algorithm. Comput. Animat. Virtual Worlds 20(23), 343–354 (2009)
Mekuria, R., Sanna, M., Asioli, S., Izquierdo, E., Bulterman, D.C.A., Cesar, P.: A 3d tele-immersion system based on live captured mesh geometry. In: Proceedings of MMSys 2013, pp. 24–35. ACM, New York (2013)
Oh, B.T.: An adaptive quantization algorithm without side information for depth map coding. Image Commun. 29(9), 962–970 (2014)
Pece, F., Kautz, J., Weyrich, T.: Adapting standard video codecs for depth streaming. In: Proceedings of EGVE-JVRC 2011, pp. 59–66, Aire-la-Ville, Switzerland. Eurographics Association (2011)
Raghuraman, S., Venkatraman, K., Wang, Z., Prabhakaran, B., Guo, X.: A 3d tele-immersion streaming approach using skeleton-based prediction. In: Proceedings of MM 2013, pp. 721–724. ACM, New York (2013)
Schwarz, H., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Muller, K., Rhee, H., Tech, G., Winken, M., Marpe, D., Wiegand, T.: Extension of high efficiency video coding (hevc) for multiview video and depth data. In: Proceedings of ICIP 2012, pp. 205–208, September 2012
Schwarz, S., Olsson, R., Sjostrom, M., Tourancheau, S.: Adaptive depth filtering for hevc 3d video coding. In: Proceedings of PCS 2012, pp. 49–52, May 2012
Van Wallendael, G., Van Leuven, S., De Cock, J., Bruls, F., Van de Walle, R.: Multiview and depth map compression based on hevc. In: Proceedings of ICCE 2012, pp. 168–169, January 2012
Videolan. x264 (2014, sep. version 142) : a free h264/avc encoder. http://www.videolan.org/developers/x264.html
Yuan, H., Kwong, S., Liu, J., Sun, J.: A novel distortion model and lagrangian multiplier for depth maps coding. IEEE Trans. Circuits Syst. Video Technol. 24(3), 443–451 (2014)
Zamarin, M., Salmistraro, M., Forchhammer, S., Ortega, A.: Edge-preserving intra depth coding based on context-coding and h.264/avc. In: Proceedings of ICME 2013, pp. 1–6, July 2013
Acknowledgments
The author gratefully acknowledges the support of K. C. Wong Education Foundation and DAAD, NSFC (Grant No. 61073074, 61303144), Projects in Science and Technique of Ningbo Municipal (Grant No. 2012B82003), Zhejiang Higher Education Reform Project (Grant No. jg2013135), National Students’ Innovation and Entrepreneurship Project (Grant No. 201410876012).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Liu, Y. et al. (2015). Hybrid Lossless-Lossy Compression for Real-Time Depth-Sensor Streams in 3D Telepresence Applications. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9314. Springer, Cham. https://doi.org/10.1007/978-3-319-24075-6_43
Download citation
DOI: https://doi.org/10.1007/978-3-319-24075-6_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24074-9
Online ISBN: 978-3-319-24075-6
eBook Packages: Computer ScienceComputer Science (R0)