Skip to main content
Top

2020 | OriginalPaper | Chapter

Texture-Based Fast CU Size Decision and Intra Mode Decision Algorithm for VVC

Authors : Jian Cao, Na Tang, Jun Wang, Fan Liang

Published in: MultiMedia Modeling

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Versatile Video Coding (VVC) is the next generation video coding standard. Compared with HEVC/H.265, in order to improve coding efficiency, its complexity of intra coding increases significantly. Too much encoding time makes it difficult for real-time coding and hardware implementation. To tackle this urgent problem, a texture-based fast CU size decision and intra mode decision algorithm is proposed in this paper. The contributions of the proposed algorithm include two aspects. (1) Aiming at the latest adopted QTMT block partitioning scheme in VVC, some redundant splitting tree and direction are skipped according to texture characteristics and differences between sub-parts of CU. (2) A fast intra mode decision scheme is proposed which considers complexity and texture characteristics. Some hierarchical modifications are applied including reducing the number of checked Intra Prediction Modes (IPM) and candidate modes in Rough Modes Decision (RMD) and RD check stage respectively. Compared with the latest VVC reference software VTM-4.2, the proposed algorithm can achieve approximately 46% encoding time saving on average with only 0.91% BD-RATE increase or 0.046 BD-PSNR decrease.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Van der Auwera, G., Seregin, V., Said, A., Ramasubramonian, A.K., Karczewicz, M.: CE3: simplified PDPC (Test 2.4.1), document JVET-K0063. In: Proceedings of 11th JVET Meeting, Ljubljana, SI, July 2018 Van der Auwera, G., Seregin, V., Said, A., Ramasubramonian, A.K., Karczewicz, M.: CE3: simplified PDPC (Test 2.4.1), document JVET-K0063. In: Proceedings of 11th JVET Meeting, Ljubljana, SI, July 2018
2.
go back to reference Chen, H., Yang, H., Chen, J.: CE4: affine motion compensation with fixed sub-block size (Test 1.1), document JVET-K0184. In: Proceedings of 11th JVET Meeting, Ljubljana, SI, July 2018 Chen, H., Yang, H., Chen, J.: CE4: affine motion compensation with fixed sub-block size (Test 1.1), document JVET-K0184. In: Proceedings of 11th JVET Meeting, Ljubljana, SI, July 2018
3.
go back to reference De-Luxán-Hernández, S., et al.: CE3: Intra sub-partitions coding mode (Tests 1.1.1 and 1.1.2), document JVET -M0102. In: Proceedings of 13th JVET Meeting, Marrakech, MA, Jan 2019 De-Luxán-Hernández, S., et al.: CE3: Intra sub-partitions coding mode (Tests 1.1.1 and 1.1.2), document JVET -M0102. In: Proceedings of 13th JVET Meeting, Marrakech, MA, Jan 2019
4.
go back to reference Bross, B.: Versatile video coding (Draft 1), document JVET-J1001. In: Proceedings of 10th JVET Meeting, San Diego, US, Apr 2018 Bross, B.: Versatile video coding (Draft 1), document JVET-J1001. In: Proceedings of 10th JVET Meeting, San Diego, US, Apr 2018
5.
go back to reference Choi, N., Piao, Y., Choi, K., Kim, C.: CE3.3 related: intra 67 modes coding with 3MPM, document JVET-K0529, JVET-K0368. In: Proceedings of 11th JVET meeting, Ljubljana, SI, July 2018 Choi, N., Piao, Y., Choi, K., Kim, C.: CE3.3 related: intra 67 modes coding with 3MPM, document JVET-K0529, JVET-K0368. In: Proceedings of 11th JVET meeting, Ljubljana, SI, July 2018
6.
go back to reference Chen, J., et al.: Coding tools investigation for next generation video coding, ITU-T SG16 Doc. COM16CC806, Feb 2015 Chen, J., et al.: Coding tools investigation for next generation video coding, ITU-T SG16 Doc. COM16CC806, Feb 2015
7.
go back to reference Öztekin, A., Erçelebi, E.: An early split and skip algorithm for fast intra CU selection in HEVC. J. Real-Time Image Process. 12, 273–283 (2016)CrossRef Öztekin, A., Erçelebi, E.: An early split and skip algorithm for fast intra CU selection in HEVC. J. Real-Time Image Process. 12, 273–283 (2016)CrossRef
8.
go back to reference Zhang, M., Lai, D., Liu, Z., An, C.: A novel adaptive fast partition algorithm based on CU complexity analysis in HEVC. Multimedia Tools Appl. 78, 1035–1051 (2019)CrossRef Zhang, M., Lai, D., Liu, Z., An, C.: A novel adaptive fast partition algorithm based on CU complexity analysis in HEVC. Multimedia Tools Appl. 78, 1035–1051 (2019)CrossRef
9.
go back to reference Jamali, M., Coulombe, S.: Coding unit splitting early termination for fast HEVC intra coding based on global and directional gradients. In: 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP), pp. 1–5 (2016) Jamali, M., Coulombe, S.: Coding unit splitting early termination for fast HEVC intra coding based on global and directional gradients. In: 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP), pp. 1–5 (2016)
10.
go back to reference Chang, L., Liu, Z., Wang, L., Li, X: Enhance the HEVC fast intra CU mode decision based on convolutional neural network by corner power estimation. In: 2018 Data Compression Conference (DCC), p. 400 (2018) Chang, L., Liu, Z., Wang, L., Li, X: Enhance the HEVC fast intra CU mode decision based on convolutional neural network by corner power estimation. In: 2018 Data Compression Conference (DCC), p. 400 (2018)
11.
go back to reference Ogata, J., Ichige, K.: Fast intra mode decision method based on outliers of DCT coefficients and neighboring block information for H. 265/HEVC. In: 2018 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1–5 (2018) Ogata, J., Ichige, K.: Fast intra mode decision method based on outliers of DCT coefficients and neighboring block information for H. 265/HEVC. In: 2018 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1–5 (2018)
12.
go back to reference Jamali, M., Coulombe, S.: Fast HEVC intra mode decision based on RDO cost prediction. IEEE Trans. Broadcast. 65(1), 109–122 (2019)CrossRef Jamali, M., Coulombe, S.: Fast HEVC intra mode decision based on RDO cost prediction. IEEE Trans. Broadcast. 65(1), 109–122 (2019)CrossRef
13.
go back to reference Jin, Z., An, P., Shen, L.: Fast QTBT partition algorithm for JVET intra coding based on CNN. In: Pacific Rim Conference on Multimedia (PCM), pp. 59–69 (2017)CrossRef Jin, Z., An, P., Shen, L.: Fast QTBT partition algorithm for JVET intra coding based on CNN. In: Pacific Rim Conference on Multimedia (PCM), pp. 59–69 (2017)CrossRef
14.
go back to reference Lin, T., Jiang, H., Huang, J., Chang, P.: Fast intra coding unit partition decision in H. 266/FVC based on spatial features. J. Real-Time Image Process. 1–18 (2018) Lin, T., Jiang, H., Huang, J., Chang, P.: Fast intra coding unit partition decision in H. 266/FVC based on spatial features. J. Real-Time Image Process. 1–18 (2018)
15.
go back to reference Amestoy, T., Mercat, A., Hamidouche, W., Bergeron, C., Menard, D.: Random forest oriented fast QTBT frame partitioning. In: 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1837–1841 (2019) Amestoy, T., Mercat, A., Hamidouche, W., Bergeron, C., Menard, D.: Random forest oriented fast QTBT frame partitioning. In: 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1837–1841 (2019)
16.
go back to reference Yang, H., Shen, L., Dong, X., Ding, Q., An, P., Jiang, G.: Low complexity CTU partition structure decision and fast intra mode decision for Versatile video coding. In: IEEE Transactions on Circuits and Systems for Video Technology (2019) Yang, H., Shen, L., Dong, X., Ding, Q., An, P., Jiang, G.: Low complexity CTU partition structure decision and fast intra mode decision for Versatile video coding. In: IEEE Transactions on Circuits and Systems for Video Technology (2019)
18.
go back to reference Bjontegaard, G.: Calculation of average PSNR differences between RD curves, document VCEG-M33. Texas, USA (2001) Bjontegaard, G.: Calculation of average PSNR differences between RD curves, document VCEG-M33. Texas, USA (2001)
Metadata
Title
Texture-Based Fast CU Size Decision and Intra Mode Decision Algorithm for VVC
Authors
Jian Cao
Na Tang
Jun Wang
Fan Liang
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-37731-1_60