Skip to main content

2015 | OriginalPaper | Buchkapitel

Hybrid Lossless-Lossy Compression for Real-Time Depth-Sensor Streams in 3D Telepresence Applications

verfasst von : Yunpeng Liu, Stephan Beck, Renfang Wang, Jin Li, Huixia Xu, Shijie Yao, Xiaopeng Tong, Bernd Froehlich

Erschienen in: Advances in Multimedia Information Processing -- PCM 2015

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We developed and evaluated different schemes for the real-time compression of multiple depth image streams. Our analysis suggests that a hybrid lossless-lossy compression approach provides a good tradeoff between quality and compression ratio. Lossless compression based on run length encoding is used to preserve the information of the highest bits of the depth image pixels. The lowest 10-bits of a depth pixel value are directly encoded in the Y channel of a YUV image and encoded by a x264 codec. Our experiments show that the proposed method can encode and decode multiple depth image streams in less than 12 ms on average. Depending on the compression level, which can be adjusted during application runtime, we are able to achieve a compression ratio of about 4:1 to 20:1. Initial results indicate that the quality for 3D reconstructions is almost indistinguishable from the original for a compression ratio of up to 10:1.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bal, C., Nguyen, T.: Multiview video plus depth coding with depth-based prediction mode. IEEE Trans. Circuits Syst. Video Technol. 24(6), 995–1005 (2014)CrossRef Bal, C., Nguyen, T.: Multiview video plus depth coding with depth-based prediction mode. IEEE Trans. Circuits Syst. Video Technol. 24(6), 995–1005 (2014)CrossRef
2.
Zurück zum Zitat Beck, S., Kunert, A., Kulik, A., Froehlich, B.: Immersive group-to-group telepresence. IEEE Trans. Visual Comput. Graphics 19(4), 616–625 (2013)CrossRef Beck, S., Kunert, A., Kulik, A., Froehlich, B.: Immersive group-to-group telepresence. IEEE Trans. Visual Comput. Graphics 19(4), 616–625 (2013)CrossRef
3.
Zurück zum Zitat Champawat, Y., Kumar, S.: Online point-cloud transmission for tele-immersion. In: Proceedings of VRCAI 2012, pp. 79–82. ACM, New York (2012) Champawat, Y., Kumar, S.: Online point-cloud transmission for tele-immersion. In: Proceedings of VRCAI 2012, pp. 79–82. ACM, New York (2012)
4.
Zurück zum Zitat Cho, T., Lee, Y., Shin, J.: A homogenizing filter for depth map compressive sensing using edge-awarded method. In: Proceedings of ICT Convergence 2013, pp. 591–595, October 2013 Cho, T., Lee, Y., Shin, J.: A homogenizing filter for depth map compressive sensing using edge-awarded method. In: Proceedings of ICT Convergence 2013, pp. 591–595, October 2013
5.
Zurück zum Zitat Choi, J.-A., Ho, Y.-S.: Improved near-lossless hevc codec for depth map based on statistical analysis of residual data. In: Proceedings of ISCS 2012, pp. 894–897, May 2012 Choi, J.-A., Ho, Y.-S.: Improved near-lossless hevc codec for depth map based on statistical analysis of residual data. In: Proceedings of ISCS 2012, pp. 894–897, May 2012
7.
Zurück zum Zitat Fu, J., Miao, D., Yu, W., Wang, S., Lu, Y., Li, S.: Kinect-like depth data compression. IEEE Trans. Multimedia 15(6), 1340–1352 (2013)CrossRef Fu, J., Miao, D., Yu, W., Wang, S., Lu, Y., Li, S.: Kinect-like depth data compression. IEEE Trans. Multimedia 15(6), 1340–1352 (2013)CrossRef
8.
Zurück zum Zitat Gautier, J., Le Meur, O., Guillemot, C.: Efficient depth map compression based on lossless edge coding and diffusion. In: Proceedings of PCS 2012, pp. 81–84, May 2012 Gautier, J., Le Meur, O., Guillemot, C.: Efficient depth map compression based on lossless edge coding and diffusion. In: Proceedings of PCS 2012, pp. 81–84, May 2012
9.
Zurück zum Zitat Hoffmann, S., Mainberger, M., Weickert, J., Puhl, M.: Compression of depth maps with segment-based homogeneous diffusion. In: Pack, T. (ed.) SSVM 2013. LNCS, vol. 7893, pp. 319–330. Springer, Heidelberg (2013) CrossRef Hoffmann, S., Mainberger, M., Weickert, J., Puhl, M.: Compression of depth maps with segment-based homogeneous diffusion. In: Pack, T. (ed.) SSVM 2013. LNCS, vol. 7893, pp. 319–330. Springer, Heidelberg (2013) CrossRef
10.
Zurück zum Zitat Ko, H., Kuo, C.-C.: A new in-loop filter for depth map coding in hevc. In: Proceedings of APSIPA ASC 2012, pp. 1–7, December 2012 Ko, H., Kuo, C.-C.: A new in-loop filter for depth map coding in hevc. In: Proceedings of APSIPA ASC 2012, pp. 1–7, December 2012
11.
Zurück zum Zitat Lan, C., Xu, J., Wu, F.: Object-based coding for kinect depth and color videos. In: Proceedings of VCIP 2012, pp. 1–6, November 2012 Lan, C., Xu, J., Wu, F.: Object-based coding for kinect depth and color videos. In: Proceedings of VCIP 2012, pp. 1–6, November 2012
12.
Zurück zum Zitat Mamou, K., Zaharia, T., Prêteux, F.: Tfan: a low complexity 3d mesh compression algorithm. Comput. Animat. Virtual Worlds 20(23), 343–354 (2009)CrossRef Mamou, K., Zaharia, T., Prêteux, F.: Tfan: a low complexity 3d mesh compression algorithm. Comput. Animat. Virtual Worlds 20(23), 343–354 (2009)CrossRef
13.
Zurück zum Zitat Mekuria, R., Sanna, M., Asioli, S., Izquierdo, E., Bulterman, D.C.A., Cesar, P.: A 3d tele-immersion system based on live captured mesh geometry. In: Proceedings of MMSys 2013, pp. 24–35. ACM, New York (2013) Mekuria, R., Sanna, M., Asioli, S., Izquierdo, E., Bulterman, D.C.A., Cesar, P.: A 3d tele-immersion system based on live captured mesh geometry. In: Proceedings of MMSys 2013, pp. 24–35. ACM, New York (2013)
14.
Zurück zum Zitat Oh, B.T.: An adaptive quantization algorithm without side information for depth map coding. Image Commun. 29(9), 962–970 (2014) Oh, B.T.: An adaptive quantization algorithm without side information for depth map coding. Image Commun. 29(9), 962–970 (2014)
15.
Zurück zum Zitat Pece, F., Kautz, J., Weyrich, T.: Adapting standard video codecs for depth streaming. In: Proceedings of EGVE-JVRC 2011, pp. 59–66, Aire-la-Ville, Switzerland. Eurographics Association (2011) Pece, F., Kautz, J., Weyrich, T.: Adapting standard video codecs for depth streaming. In: Proceedings of EGVE-JVRC 2011, pp. 59–66, Aire-la-Ville, Switzerland. Eurographics Association (2011)
16.
Zurück zum Zitat Raghuraman, S., Venkatraman, K., Wang, Z., Prabhakaran, B., Guo, X.: A 3d tele-immersion streaming approach using skeleton-based prediction. In: Proceedings of MM 2013, pp. 721–724. ACM, New York (2013) Raghuraman, S., Venkatraman, K., Wang, Z., Prabhakaran, B., Guo, X.: A 3d tele-immersion streaming approach using skeleton-based prediction. In: Proceedings of MM 2013, pp. 721–724. ACM, New York (2013)
17.
Zurück zum Zitat Schwarz, H., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Muller, K., Rhee, H., Tech, G., Winken, M., Marpe, D., Wiegand, T.: Extension of high efficiency video coding (hevc) for multiview video and depth data. In: Proceedings of ICIP 2012, pp. 205–208, September 2012 Schwarz, H., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Muller, K., Rhee, H., Tech, G., Winken, M., Marpe, D., Wiegand, T.: Extension of high efficiency video coding (hevc) for multiview video and depth data. In: Proceedings of ICIP 2012, pp. 205–208, September 2012
18.
Zurück zum Zitat Schwarz, S., Olsson, R., Sjostrom, M., Tourancheau, S.: Adaptive depth filtering for hevc 3d video coding. In: Proceedings of PCS 2012, pp. 49–52, May 2012 Schwarz, S., Olsson, R., Sjostrom, M., Tourancheau, S.: Adaptive depth filtering for hevc 3d video coding. In: Proceedings of PCS 2012, pp. 49–52, May 2012
19.
Zurück zum Zitat Van Wallendael, G., Van Leuven, S., De Cock, J., Bruls, F., Van de Walle, R.: Multiview and depth map compression based on hevc. In: Proceedings of ICCE 2012, pp. 168–169, January 2012 Van Wallendael, G., Van Leuven, S., De Cock, J., Bruls, F., Van de Walle, R.: Multiview and depth map compression based on hevc. In: Proceedings of ICCE 2012, pp. 168–169, January 2012
21.
Zurück zum Zitat Yuan, H., Kwong, S., Liu, J., Sun, J.: A novel distortion model and lagrangian multiplier for depth maps coding. IEEE Trans. Circuits Syst. Video Technol. 24(3), 443–451 (2014)CrossRef Yuan, H., Kwong, S., Liu, J., Sun, J.: A novel distortion model and lagrangian multiplier for depth maps coding. IEEE Trans. Circuits Syst. Video Technol. 24(3), 443–451 (2014)CrossRef
22.
Zurück zum Zitat Zamarin, M., Salmistraro, M., Forchhammer, S., Ortega, A.: Edge-preserving intra depth coding based on context-coding and h.264/avc. In: Proceedings of ICME 2013, pp. 1–6, July 2013 Zamarin, M., Salmistraro, M., Forchhammer, S., Ortega, A.: Edge-preserving intra depth coding based on context-coding and h.264/avc. In: Proceedings of ICME 2013, pp. 1–6, July 2013
Metadaten
Titel
Hybrid Lossless-Lossy Compression for Real-Time Depth-Sensor Streams in 3D Telepresence Applications
verfasst von
Yunpeng Liu
Stephan Beck
Renfang Wang
Jin Li
Huixia Xu
Shijie Yao
Xiaopeng Tong
Bernd Froehlich
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24075-6_43

Neuer Inhalt