ABSTRACT
With the advent of high-speed networks such as Internet2, high quality uncompressed transmission of multi-channel audio streams has become possible. For interactive applications, such as a distributed musical performance, minimizing latency is of paramount importance. Given the strict latency requirements, error recovery (via either retransmission or FEC) may not always be successful, and thus concealment is frequently required. In this paper we propose a novel concealment algorithm, based on inter-channel redundancy, for multi-channel, professional quality, uncompressed audio streams, with particular emphasis on an experimental 10.2 audio standard, which provides an immersive experience for the audience and the players in a performance. We also propose a smoothing method based on Bezier curves. We focus on interactive applications; thus we investigate concealment techniques that can be performed in real time. Our algorithms are implemented in a testbed capable of streaming up to 24 uncompressed audio channels with end-to-end latency of less than 6 ms. Our results show that our techniques outperform existing methods. We expect that our protocol will become an important part of a distributed immersive musical performance system currently being developed at our university.
- F. Liu, J.W. Kim and C.-C. J. Kuo. Adaptive Delay Concealment For Internet Voice Applications with Packet-Based Time-Scale Modification. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 3, pp. 1461--1464, May 2001. Google ScholarDigital Library
- C. Perkins, O. Hodson and V. Hardman. A Survey of Packet Loss Recovery Techniques for Streaming Media. IEEE Network Magazine, pp. 40--48, September/October 1998. Google ScholarDigital Library
- USC Internet HDTV Almost Ready For Prime Time. http://www.digitaltelevision.com/2002/april/news0425_1.shtml.Google Scholar
- IMSC Presents Landmark Internet Concert Event. http://imsc.usc.edu/news/symphony.html.Google Scholar
- IHDTV Workshop. http://www.washington.edu/ihdtv/.Google Scholar
- S.J. Godsill and J.W. Rayner. Digital Audio Restoration. Springer-Verlag London Ltd., 1998. Google ScholarDigital Library
- O.J. Wasem, D. J. Goodman, C.A. Dvorak and H.G. Page. The Effect of Waveform Substitution on the Quality of PCM Packet Communications. IEEE Transactions on Acoustics, Speech, and Signal Processing, pp. 342--348, November 1998.Google Scholar
- D. J. Goodman, G. B. Lockhart, O. J. Wasem and W.-C. Wong. Waveform Substitution Techniques for Recovering Missing Speech Segments in Packet Voice Communications. IEEE Transactions on Acoustics, Speech, and Signal Processing, pp. 1440--1448, December 1986.Google ScholarCross Ref
- M. Yuito and N. Matsuo. A New Sample-Interpolation Method for Recovering Missing Speech Samples in Packet Voice Communications. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 1, pp. 381--384, May 1989.Google ScholarCross Ref
- N.S. Jayant and S.W. Christensen. Effects of Packet Losses in Waveform Coded Speech and Improvements due to Odd-Even Sample-Interpolation Procedure. IEEE Transactions on Communications, vol. 29, no. 2, pp. 101--109, February 1981.Google ScholarCross Ref
- W.-T. Liao, J.-C. Chen and M.-S. Chen. Adaptive Recovery Techniques for Real-Time Audio Streams, Proceedings of IEEE INFOCOM, vol. 2, pp. 815--823, April 2001.Google Scholar
- J. Tang. Evaluation of Double Sided Periodic Substitution (DSPS) Method for Recovering Missing Speech in Packet Voice Communications. Proceedings of Tenth Annual International Phoenix Conference on Computers and Communications, pp. 454--458, March 1991.Google ScholarCross Ref
- R.A. Valenzuela and C.N. Animalu. A New Voice-Packet Reconstruction Technique. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, vol 2, pp. 1334--1336, May 1989.Google ScholarCross Ref
- H. Sanneck, A. Stenger, K. Ben Younes and B. Girod. A New Technique for Audio Packet Loss Concealment. Global Internet 96 (Global Telecommunications Conference 1996), pp. 48--52, November 1996.Google Scholar
- B. Wah and D. Lin. Real-Time Voice Transmissions over the Internet. IEEE Transactions on Multimedia, vol. 1 no. 4, pp. 342--351, December 1999. Google ScholarDigital Library
- B. W. Wah, X. Su, and D. Lin. A Survey of Error-Concealment Schemes for Real-Time Audio and Video Transmissions over the Internet. Proceedings of International Symposium on Multimedia Software Engineering, pp. 17--24, December 2000. Google ScholarDigital Library
Index Terms
- Loss concealment for multi-channel streaming audio
Recommendations
Scalable packet loss recovery for mobile P2P streaming
WWIC'10: Proceedings of the 8th international conference on Wired/Wireless Internet CommunicationsIn a real-time peer-to-peer streaming system peers in the overlay network may arrive and depart in a very dynamic fashion especially in mobile environment. This manifests itself by a sudden uncontrolled disappearance of a sender and, as a consequence, ...
Intra-flow loss recovery and control for VoIP
MULTIMEDIA '01: Proceedings of the ninth ACM international conference on Multimedia"Best effort" packet-switched networks, like the Internet, do not offer a reliable transmission of packets to applications with real-time constraints such as voice. Thus, the loss of packets impairs the application-level utility. For voice this utility ...
Joint coding rate control for audio streaming in short range wireless networks
Streaming high quality audio/video (AV) from home media sources to TV sets and audio speakers over a wireless local area network (WLAN) is a challenging problem because of the fluctuating bandwidth caused by interference and fading. Retransmission and ...
Comments