Skip to main content

Advertisement

SpringerLink
Log in

A perceptual rate control algorithm based on luminance adaptation for HEVC encoders

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

This paper proposes a rate control algorithm by selecting a proper quantization parameter (QP) based on perceptual luminance adaptation in a single-loop encoding fashion. In this paper, the proposed algorithm uses the visual characteristics of humans to adaptively decide the number of bits available for a pixel. Then, a base QP is selected based on the proposed R–λ model. The proposed rate control determines the range of QP based on the base QP and calculates the maximum and minimum bpps within that range. The optimal bpp is obtained from the bpp range by considering the visual characteristics of the human being, and the QP value is determined by the optical bpp through the proposed R–λ model. In the proposed rate control algorithm, the QP value is selected based on the R–λ model by considering the perceptual luminance adaptation model at the CTU level. The number of target bits is decided to decide the QP, subject to visual sensitivity based on JND thresholds. With the use of the proposed rate control algorithm, bits for non-noticeable regions can be saved, and the remaining bits can be consumed for perceptually noticeable regions to enhance the overall subjective quality with the similar amount of total bits. The proposed method shows lower average variances of bits and PSNR fluctuations. Also, the proposed method achieves an approximately 0.19 higher MOS value on average under DSCQS test, compared with the conventional R–λ model-based rate control algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Wiegand, T., Sullivan, G.J., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13, 560–576 (2003)

    Article  Google Scholar 

  2. Tamhankar, A., Rao, K.R.: An overview of H.264/MPEG-4 part 10. In: 4th EURASIP Conference on Video/Image Processing and Multimedia Communications, vol. 1, pp. 1–51 (2003)

  3. Wiegand, T., Sullivan, G., Luthra, A.: Draft ITU-T recommendation and final draft international standard of joint video specification. JVT Document, JVT-G050r1, Geneva, CH. (2003)

  4. Sullivan, G., Ohm, J., Han, W., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22, 1649–1668 (2012)

    Article  Google Scholar 

  5. Sze, V., Budagavi, M., Sullivan, G.J.: High efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 13, 560–576 (2013)

    Google Scholar 

  6. Feng, Z., Liu, P., Jia, K.: Visual perception based rate control algorithm for HEVC. J. Phys Conf. Ser. 960, 12–41 (2018)

    Article  Google Scholar 

  7. ITU-R BT.500-11. Methodology for the subjective assessment of the quality of television pictures. (2012)

  8. Yoo, J., Nam, J., Ryu, J., Sim, D.: Rate control to reduce bitrate fluctuation on HEVC. IEIE Trans. Smart Process. Comput. 1, 152–160 (2012)

    Google Scholar 

  9. Yoon, Y., Kim, H., Baek, S., Ko, S.: Largest coding unit level rate control algorithm for hierarchical video coding in HEVC. IEEE Trans. Circuits Syst. Video Technol. 1, 171–181 (2012)

    Google Scholar 

  10. Lin, Q., Feng, G.: The bit allocation and RDO mode based rate control algorithm. In: 2010 International Conference on Anti-Counterfeiting Security and Identification in Communication (ASID), pp. 154–157 (2010)

  11. Lin, B., Li, H., Li, L., Zhang, J.: Lambda domain rate control algorithm for high efficiency video coding. IEEE Trans. Image Process. 23, 3841–3854 (2014)

    Article  MathSciNet  Google Scholar 

  12. Wang, S., Ma, S., Wang, S., Zhao, D., Gao, W.: Region-based rate control for H.264/AVC for low bit-rate applications. IEEE Trans. Circuits Syst. Video Technol. 22, 1564–1576 (2012)

    Article  Google Scholar 

  13. Choi, H., Yoo, J., Nam, J., Sim, D., Bajic, I.V.: Pixel-wise unified rate-quantization model for multi-level rate control. IEEE J. Mag. 7, 1112–1123 (2013)

    Google Scholar 

  14. Wang, X., Su, L., Huang, Q., Liu, C., Duan, L.: Motion based perceptual distortion and rate optimization for video coding. In: 2012 IEEE International Conference on Multimedia and Expo.(ICME), pp. 1061–1066 (2012)

  15. Chunang, F., Hsu, Y.: On rate distortion optimization using SSIM. IEEE Trans. Consum. Electron. 57, 1264–1270 (2011)

    Article  Google Scholar 

  16. Li, S., Zhu, C., Gao, Y., Zhou, Y., Dufaux, F., Sun, M.: Inter-frame dependent rate-distortion optimization using lagrangian multiplier adaption. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2015)

  17. Tan, Y., Lee, W.S., Tham, J.Y., Rahardja, S.: Complexity-rate-distortion optimization for real-time H.264/AVC encoding. In: Proceedings of 18th International Conference on Computer Communications and Networks. pp. 1–6 (2009)

  18. Sullivan, G.L., Wiegand, T.: Rate-distortion optimization for video compression. IEEE Signal Process. Mag. 15, 74–90 (1998)

    Article  Google Scholar 

  19. Ma, S., Gao, W., Lu, Y.: Rate-distortion analysis for H.264/AVC video coding and its application to rate control. IEEE Trans. Circuits Syst. Video Technol. 15, 1533–1544 (2005)

    Article  Google Scholar 

  20. Ribas-Corbera, J., Chou, P.A., Regunathan, S.L.: A generalized hypothetical reference decoder for H.264/AVC. IEEE Trans. Circuits Syst. Video Technol. 13, 674–687 (2003)

    Article  Google Scholar 

  21. Stapenhurst, R., Agrafiotis, D., Chung-How, J., Pledge, J.: Adaptive HRD parameter selection for fixed delay live wireless video streaming. In: 2010 18th International Packet Video Workshop (PV), pp. 142–149 (2010)

  22. Yuan, L., Gao, W., Lu, Y.: Latest arrival time leaky bucket for HRD constrained video coding. In: 2003 International Conference on Multimedia and Expo, vol. 2, pp. II-773–776 (2003)

  23. Li, B., Li, H., Li, L., Zhang, J.: Rate control by R-lambda model for HEVC. JCT-VC of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-K0103, Shanghai, China. (2012)

  24. Ou, T.S., Huang, Y.H., Chen, H.H.: SSIM-based perceptual rate control for video coding. IEEE Trans. Circuit Syst. Video Coding 21, 682–691 (2011)

    Article  Google Scholar 

  25. Wu, G.L., Fu, Y.J., Huang, S.C., Chien, S.Y.: Perceptual quality-reconfigurable video coding system with region-based rate control scheme. IEEE Trans. Image Process. 22, 2247–2258 (2013)

    Article  MathSciNet  Google Scholar 

  26. Wang, M., Ngan, K.N., Li, H.: An efficient frame-content based intra frame rate control for high efficiency video coding. IEEE Signal Process. Lett. 22, 896–900 (2015)

    Article  Google Scholar 

  27. Kuo, C.C., Leou, J.J.: A new rate control scheme for H.263 video transmission. Signal Process Image Commun. 17, 537–557 (2002)

    Article  Google Scholar 

  28. Zhou, M., Gao, W., Jiang, M., Yu, H.: HEVC lossless coding and improvements. IEEE Trans. Circuit Syst. Video Coding 22, 1839–1843 (2012)

    Article  Google Scholar 

  29. Cai, X., Gu, Q.: Improved HEVC lossless compression using two-stage coding with sub-frame level optimal quantization values. In: IEEE International Conference on Image Processing (ICIP), pp. 5651–5655 (2014)

  30. Cai, Q., Song, L., Li, G., Ling, N.: Lossy and lossless intra coding performance evaluation: HEVC, H.264/AVC, JPEG 2000 and JPEG LS. In : Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC), pp. 1–9 (2012)

  31. Braeckman, G., Satti, S.M., Chen, H., Delputte, S., Schelkens, P., Munteanu, A.: Lossy-to-lossless screen content coding using an HEVC base-layer. In: International Conference on Digital Signal Processing (DSP), pp. 1–6 (2013)

  32. Wu, J., Qi, F., Shi, G.: An improved model of pixel adaptive just-noticeable difference estimation. In: 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), pp. 2454–2457 (2010)

  33. Chen, Z., Liu, H.: JND modeling: approaches and applications. In: International Conference on Digital Signal Processing (DSP), pp. 827–830 (2014)

  34. Lee, C., Lin, P., Chen, L., Wang, W.: Image enhancement approach using the just-noticeable difference model of the human visual system. J. Electron. Imaging 21, 033007 (2012)

    Article  Google Scholar 

  35. Bossen, F.: Common test conditions and software reference configurations. In: The 8th JCT-VC meeting, JCT-VC H1100, San Jose, CA (2012)

  36. Bjøntegaard, G.: Calculation of average PSNR differences between RD-Curves. ITU-T SG16/Q.6, VCEG-M33, Austin, TX (2001)

Download references

Acknowledgements

The work reported in this paper was partly conducted during the sabbatical year of Kwangwoon University in 2018 and this research was partly supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (NRF-2018R1A2B2008238).

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Kwangwoon University, 20 Gwangun-ro, Nowon-gu, Seoul, Korea

    Woong Lim & Donggyu Sim

Authors
  1. Woong Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Donggyu Sim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Donggyu Sim.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lim, W., Sim, D. A perceptual rate control algorithm based on luminance adaptation for HEVC encoders. SIViP 14, 887–895 (2020). https://doi.org/10.1007/s11760-019-01620-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01620-3

Keywords

Search

Navigation