skip to main content
10.1145/776322.776339acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
Article

Loss concealment for multi-channel streaming audio

Published:01 June 2003Publication History

ABSTRACT

With the advent of high-speed networks such as Internet2, high quality uncompressed transmission of multi-channel audio streams has become possible. For interactive applications, such as a distributed musical performance, minimizing latency is of paramount importance. Given the strict latency requirements, error recovery (via either retransmission or FEC) may not always be successful, and thus concealment is frequently required. In this paper we propose a novel concealment algorithm, based on inter-channel redundancy, for multi-channel, professional quality, uncompressed audio streams, with particular emphasis on an experimental 10.2 audio standard, which provides an immersive experience for the audience and the players in a performance. We also propose a smoothing method based on Bezier curves. We focus on interactive applications; thus we investigate concealment techniques that can be performed in real time. Our algorithms are implemented in a testbed capable of streaming up to 24 uncompressed audio channels with end-to-end latency of less than 6 ms. Our results show that our techniques outperform existing methods. We expect that our protocol will become an important part of a distributed immersive musical performance system currently being developed at our university.

References

  1. F. Liu, J.W. Kim and C.-C. J. Kuo. Adaptive Delay Concealment For Internet Voice Applications with Packet-Based Time-Scale Modification. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 3, pp. 1461--1464, May 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. C. Perkins, O. Hodson and V. Hardman. A Survey of Packet Loss Recovery Techniques for Streaming Media. IEEE Network Magazine, pp. 40--48, September/October 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. USC Internet HDTV Almost Ready For Prime Time. http://www.digitaltelevision.com/2002/april/news0425_1.shtml.Google ScholarGoogle Scholar
  4. IMSC Presents Landmark Internet Concert Event. http://imsc.usc.edu/news/symphony.html.Google ScholarGoogle Scholar
  5. IHDTV Workshop. http://www.washington.edu/ihdtv/.Google ScholarGoogle Scholar
  6. S.J. Godsill and J.W. Rayner. Digital Audio Restoration. Springer-Verlag London Ltd., 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. O.J. Wasem, D. J. Goodman, C.A. Dvorak and H.G. Page. The Effect of Waveform Substitution on the Quality of PCM Packet Communications. IEEE Transactions on Acoustics, Speech, and Signal Processing, pp. 342--348, November 1998.Google ScholarGoogle Scholar
  8. D. J. Goodman, G. B. Lockhart, O. J. Wasem and W.-C. Wong. Waveform Substitution Techniques for Recovering Missing Speech Segments in Packet Voice Communications. IEEE Transactions on Acoustics, Speech, and Signal Processing, pp. 1440--1448, December 1986.Google ScholarGoogle ScholarCross RefCross Ref
  9. M. Yuito and N. Matsuo. A New Sample-Interpolation Method for Recovering Missing Speech Samples in Packet Voice Communications. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 1, pp. 381--384, May 1989.Google ScholarGoogle ScholarCross RefCross Ref
  10. N.S. Jayant and S.W. Christensen. Effects of Packet Losses in Waveform Coded Speech and Improvements due to Odd-Even Sample-Interpolation Procedure. IEEE Transactions on Communications, vol. 29, no. 2, pp. 101--109, February 1981.Google ScholarGoogle ScholarCross RefCross Ref
  11. W.-T. Liao, J.-C. Chen and M.-S. Chen. Adaptive Recovery Techniques for Real-Time Audio Streams, Proceedings of IEEE INFOCOM, vol. 2, pp. 815--823, April 2001.Google ScholarGoogle Scholar
  12. J. Tang. Evaluation of Double Sided Periodic Substitution (DSPS) Method for Recovering Missing Speech in Packet Voice Communications. Proceedings of Tenth Annual International Phoenix Conference on Computers and Communications, pp. 454--458, March 1991.Google ScholarGoogle ScholarCross RefCross Ref
  13. R.A. Valenzuela and C.N. Animalu. A New Voice-Packet Reconstruction Technique. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, vol 2, pp. 1334--1336, May 1989.Google ScholarGoogle ScholarCross RefCross Ref
  14. H. Sanneck, A. Stenger, K. Ben Younes and B. Girod. A New Technique for Audio Packet Loss Concealment. Global Internet 96 (Global Telecommunications Conference 1996), pp. 48--52, November 1996.Google ScholarGoogle Scholar
  15. B. Wah and D. Lin. Real-Time Voice Transmissions over the Internet. IEEE Transactions on Multimedia, vol. 1 no. 4, pp. 342--351, December 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. B. W. Wah, X. Su, and D. Lin. A Survey of Error-Concealment Schemes for Real-Time Audio and Video Transmissions over the Internet. Proceedings of International Symposium on Multimedia Software Engineering, pp. 17--24, December 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Loss concealment for multi-channel streaming audio

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      NOSSDAV '03: Proceedings of the 13th international workshop on Network and operating systems support for digital audio and video
      June 2003
      188 pages
      ISBN:1581136943
      DOI:10.1145/776322

      Copyright © 2003 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 June 2003

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      NOSSDAV '03 Paper Acceptance Rate18of60submissions,30%Overall Acceptance Rate118of363submissions,33%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader