Skip to main content
SpringerLink
Log in

Multiresolution coding techniques for digital television: A review

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

Multiresolution decompositions for video coding are reviewed. Both nonrecursive and recursive coding schemes are considered. In nonrecursive schemes, it is shown that pyramid structures have certain advantages over subband or wavelet techniques, and a specific spatiotemporal pyramid coding of HDTV is discussed in some detail. It is shown that recursive, DPCM like schemes will incur a slight loss of optimality due to a restricted form of prediction if multiresolution decomposition with compatible decoding is required. Compatibility and transmission issues are also discussed. Multiresolution transmission for digital broadcast TV is introduced. This, when combined with multiresolution source coding, achieves spectrum efficiency, robustness and graceful degradation under channel impairments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. F. Gray, J.W. Horton, and C.R. Mathes, “The Production and Utilization of Television Signals,“Bell systems Technical Journal, vol. 6, 1927, p. 560.

    Google Scholar 

  2. D. Gabor, “Theory of Communication,”Journal of the IEE, vol. 93, 1946, pp. 429–457.

    Google Scholar 

  3. D. Anastassiou and M. Vetterli, “Television by the Bit,”IEEE Circuits and Devices Magazine, vol. 7, 1991, pp. 16–21.

    Article  Google Scholar 

  4. Motion Picture Expert Group, ISO/IEC JTC1/SC2/WG8, CCITT SGVIII. “Coded Representation of Picture and Audio Information,” MPEG video simulation model two, 1990.

  5. D. LeGall, “MPEG, a Video Compression Standard for Multimedia Applications,”Transactions of the Association of Computing Machinery, vol. 34, 1991, pp. 46–58.

    Google Scholar 

  6. K.M. Uz, M. Vetterli, and D. LeGall, “Interpolative Multiresolution Coding of Advanced Television with Compatible Subchannels,”IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Signal Processing for Advanced Television, vol. 1, pp. 86–99, 1991.

    Article  Google Scholar 

  7. F. Campbell and D. Green, “Optical and Retina Factors Affecting Visual Resolution,”Journal of Physiology, vol. 181, 1965, pp. 576–593.

    PubMed  Google Scholar 

  8. S. Mallat, “Multifrequency Channel Decompositions of Images and Wavelet Models,”IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, 1989, pp. 2091–2110.

    Google Scholar 

  9. P.J. Burt and E.H. Adelson, “The Laplacian Pyramid as a Compact Image Code,”IEEE Transactions on Computers, vol. 31, 1983, pp. 532–540.

    Article  Google Scholar 

  10. W.H.R. Equitz, “Successive Refinement of Information,” Ph.D. Thesis, Stanford University, 1989.

  11. A. Rosenfeld, ed.,Multiresolution Techniques in Computer Vision, New York: Springer, 1980.

    Google Scholar 

  12. I. Daubechies, “Orthonormal Bases of Compactly Supported Wavelets,”Communications in Pure and Applied Mathematics, vol. 41, 1988, pp. 909–996.

    Google Scholar 

  13. S. Mallat, “A Theory of Multiresolution Signal Decomposition: The Wavelet Representation,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 11, 1989, pp. 674–693.

    Article  Google Scholar 

  14. O. Rioul, “A Unifying Multiresolution Theory for the Discrete Wavelet Transform, Regular Filter Banks and Pyramid Transforms,” to appear,IEEE Transactions in Signal Processing.

  15. A.K. Jain,Fundamentals of Image Processing, Englewood Cliffs, NJ: Prentice-Hall, 1989.

    Google Scholar 

  16. P.P. Vaidyanathan, “Quadrature Mirror Filter Banks, M-band Extensions and Perfect-Reconstruction Technique,”IEEE Acoustics, Speech and Signal Processing Magazine, vol. 4, 1987, pp. 4–20.

    Google Scholar 

  17. P. Cassereau, “A New Class of Optimal Unitary Transforms for Image Processing,” S.M. Thesis, Department of Electrical Engineering and Computer Sciences, Massachusetts Institute of Technology, 1985.

  18. M. Vetterli and D. LeGall, “Perfect Reconstruction FIR Filter Banks: Some Properties and Factorizations,”IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 37, 1989, pp. 1057–1071.

    Google Scholar 

  19. M. Vetterli, “Multirate Filter Banks for Subband Coding,” inSubband Image Coding, (J.W. Woods, ed.), Boston, Kluwer, 1990, pp. 43–100.

    Google Scholar 

  20. M. Vetterli, “Multi-Dimensional Sub-Band Coding: Some Theory and Algorithms,”Signal Processing, vol. 6, 1984, pp. 97–112.

    Article  Google Scholar 

  21. J.W. Woods and S.D. O'Neil, “Sub-band Coding of Images,”IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. ASSP-34, 1986, pp. 1278–1288.

    Google Scholar 

  22. G. Karlsson and M. Vetterli, “Three Dimensional Sub-band Coding of Video,”Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 1988, pp. 1100–1103.

  23. W.F. Schreiber and A. Lippman, “Single Channel HDTV Systems, Compatible and Noncompatible,” inSignal Processing of HDTV, (L. Chiariglione, ed.) Amsterdam: North-Holland, 1988.

    Google Scholar 

  24. J.W. Woods and T. Naveen, “Subband Encoding of Video Sequences,”Proceedings of the SPIE Conference on Visual Communications and Image Processing, 1989, pp. 724–732.

  25. G. Karlsson and M. Vetterli, “Packet Video and Its Integration into the Network Architecture,”IEEE Journal on Selected Areas in Communications, Special Issue on Packet Speech and Video, vol. 7, 1989, pp. 739–751.

    Article  Google Scholar 

  26. G. Karlsson and M. Vetterli, “Theory of Two-Dimensional Multirate Filter Banks,”IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 38, 1990, pp. 925–937.

    Google Scholar 

  27. E. Viscito and J. Allebach, “The Analysis and Design of Multidimensional FIR Perfect Reconstruction Filter Banks for Arbitrary Sampling Lattices,”IEEE Transactions on Circuits and Systems, vol. 38, 1991, pp. 29–42.

    Article  Google Scholar 

  28. M. Vetterli, J. Kovačević, and D. LeGall, “Perfect Reconstruction Filter Banks for HDTV Representation and Coding,”Image Communication, vol. 2, 1990, pp. 349–364.

    Article  Google Scholar 

  29. M. Antonini, M. Barlaud, P. Mathieu, and I. Daubechies, “Image Coding Using Vector Quantization in the Wavelet Transform Domain,”Proceedings of the IEEE ICASSP, Albuquerque, NM, 1990, pp. 2297–2300.

  30. M. Vetterli and C. Herley, “Wavelets and Filter Banks: Theory and Design,” to appear,IEEE Transactions on Signal Processing, Sept. 1992.

  31. R.R. Coifman, Y. Meyer, S. Quake, and M.V. Wickerhauser, “Signal Processing and Compression with Wavelet Packets,” Department of Mathematics, Yale University, preprint, 1990.

  32. M.V. Wickerhauser, “Acoustic Signal Compression with Wave Packets,” Department of Mathematics, Yale University, preprint, 1989.

  33. P.A. Chou, T. Lookabaugh, and R.M. Gray, “Optimal Pruning with Applications to Tree-Structured Source Coding and Modeling,”IEEE Transactions on Information Theory, vol. 35, 1989, pp. 299–315.

    Article  Google Scholar 

  34. E.A. Riskin and R.M. Gray, “A Greedy Tree Growing Algorithm for the Design of Variable Rate Vector Quantizers,” inProceedings of the Picture Coding Symposium, Boston, 1990, pp. 11.4.1–11.4.3.

  35. E.A. Riskin, “Optimal Bit Allocation via the Generalized BFOS Algorithm,”IEEE Transactions on Information Theory, vol. 37, 1991, pp. 400–402.

    Article  Google Scholar 

  36. D. Anastassiou, “Generalized Three-Dimensional Pyramid Coding for HDTV Using Nonlinear Interpolation,” inProceedings of the Picture Coding Symposium, Cambridge, MA, 1990, pp. 1.2-1–1.2-2.

  37. M. Bierling, “Displacement Estimation by Hierarchical Blockmatching,”SPIE Conference on Visual Communications and Image Processing, Boston, 1988, pp. 942–951.

  38. K.M. Uz, M. Vetterli, and D. LeGall, “A Multiresolution Approach to Motion Estimation and Interpolation with Application to Coding of Digital HDTV,”Proceedings of the IEEE ISCAS, New Orleans, 1990, pp. 1298–1301.

  39. Y. Shoham and A. Gersho, “Efficient Bit Allocation for an Arbitrary Set of Quantizers,”IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 36, 1988, pp. 1445–1453.

    Google Scholar 

  40. P.H. Westerink, J. Biemond, and D.E. Boekee, “An Optimal Bit Allocation Algorithm for Subband Coding,”Proceedings of the ICASSP-88, New York, 1988, pp. 757–760.

  41. Joint Photographic Expert Group, ISO/IEC JTC1/SC2/WG8, CCITT SGVIII. JPEG technical specification, revision 5, January 1990.

  42. R.J. Safranek and J.D. Johnston, “A Perceptually Tuned Subband Image Coder with Image Dependent Quantization and Postquantization Data Compression,”Proceedings of the ICASSP-89, Glasgow, 1989, pp. 1945–1948.

  43. A. Gersho and R.M. Gray, Vector Quantization and Signal Compression, Boston: Kluwer, 1992.

    Google Scholar 

  44. N. Jayant and P. Noll,Digital Coding of Waveforms, Englewood Cliffs, NJ: Prentice-Hall, 1984.

    Google Scholar 

  45. A.N. Netravali and B.G. Haskell,Digital Pictures: Representation and Compression, New York: Plenum Press, 1988.

    Google Scholar 

  46. H. Gharavi, “Subband Coding of Video Signals,” inSubband Image Coding, (J.W. Woods, ed.), Boston: Kluwer, 1990.

    Google Scholar 

  47. H.-M. Hang, R. Leonardi, B.G. Haskell, R.L. Schmidt, H. Bheda, and J. Othmer, “Digital HDTV Compression at 44 mbps Using Parallel Motion-Compensated Transform Coders,” inProceedings of the SPIE Conference on Visual Communications and Image Processing, vol. 1360, Lausanne, Switzerland, 1990, pp. 1756–1772.

  48. J. Mau “HDTV/TV Compatible Codec with PQMF Filter Bank,”Proceedings of the Fourth International Workshop on HDTV, Torino, Italy, 1991.

  49. K. Shinamura, Y. Hayashi, and F. Kishino, “Variable Bitrate Coding Capable of Compensating for Packet Loss,”Proceedings of the SPIE Conference on Visual Communications and Image Processing, 1988, pp. 991–998.

  50. M. Ghanbari, “An Adaptive Video Codec for ATM Networks,”Proceedings of the Third International Workshop on Packet Video, Morristown, NJ, 1990.

  51. F.-M. Wang and D. Anastassiou, “High-Quality Coding of the Even Fields Based on the Odd Fields of Interlaced Video Sequences,”IEEE Transactions on Circuits and Systems, vol. 38, 1991, pp. 140–142.

    Article  Google Scholar 

  52. R.E. Blahut,Theory and Practice of Error Control Codes, Reading, MA: Addison-Wesley, 1984.

    Google Scholar 

  53. T.H. Chiang, R. Mokry, A. Eleftheriadis, W.B. Yu, and D. Anastassiou, “Compatible Coding of Digital Interlaced HDTV Using Prediction of the Even Fields from the Odd Fields,”Proceedings of the Fourth International HDTV Workshop, Torino, Italy, 1991.

  54. K.M. Uz, K. Ramchandran, and M. Vetterli, “Multiresolution Source and Channel Coding for Digital Broadcast of HDTV,”Proceedings of the Fourth International Workshop on HDTV, Torino, Italy, 1991.

  55. W.F. Schreiber, “Considerations in the Design of HDTV Systems for Terrestrial Broadcasting,”Electronic Imaging '90, Boston, 1990.

  56. W.F. Schreiber, “All-Digital HDTV Terrestrial Broadcasting in the US: Some Problems and Possible Solutions,” presented atWorkshop on Advanced Television, ENST Paris, 1991.

  57. T. Cover, “Broadcast Channels,”IEEE Transactions on Information Theory, vol. IT-18, 1972, pp. 2–14.

    Article  Google Scholar 

  58. A. ElGamal and T. Cover, “Multiuser Information Theory,”Proceedings of the IEEE, vol. 68, 1980, pp. 1466–1483.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering and Center for Telecommunications Research, Columbia University, 10027-6699, New York, NY

    Martin Vetterli & Kamil Metin UZ

Authors
  1. Martin Vetterli
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kamil Metin UZ
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Invited Paper

Work supported in part by the National Science Foundation under grants ECD-88-11111, MIP-90-14189 and Bell Communications Research.

Work supported by the National Science Foundation under grants ECD-88-11111. K.M. Uz is now with David Sarnoff Research Center in Princeton, NJ 08543.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vetterli, M., Metin UZ, K. Multiresolution coding techniques for digital television: A review. Multidim Syst Sign Process 3, 161–187 (1992). https://doi.org/10.1007/BF01942041

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01942041

Key Words

Search

Navigation