Skip to main content
Erschienen in: Journal of Network and Systems Management 1/2016

01.01.2016

Assessing the QoE in Video Services Over Lossy Networks

verfasst von: Francisco J. Suárez, Andrés García, Juan C. Granda, Daniel F. García, Pelayo Nuño

Erschienen in: Journal of Network and Systems Management | Ausgabe 1/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Quality of experience is of critical importance in streaming video services, because the traditional quality of service cannot represent the quality perceived by viewers. This work evaluates several objective quality metrics under realistic bursty packet loss conditions in the network, with the support of a packet loss model. Alignment of reference and streamed video sequences (with different levels of spatial-temporal information) are also explored as a technique to prevent inaccurate computation of objective metrics due to frame loss. Finally, the correlation between subjective and objective metrics for each motion level and the computing time of metrics are analysed. The most suitable objective metrics to characterize the real degradation in the quality perceived by viewers, for both off-line and real-time assessment, are proposed. The integration of motion, busty packet loss, sequence alignment after frame loss and computing time of metrics are the main contributions of this research work.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Hasslinger, G., Hohlfeld, O.: The Gilbert–Elliott model for packet loss in real time services on the internet. In: Proceedings of the 14th GI/ITG Conference on Measuring. Modelling and Evaluation of Computer and Communication Systems (MMB 2008), pp. 269–283. Dortmund, Germany (2008) Hasslinger, G., Hohlfeld, O.: The Gilbert–Elliott model for packet loss in real time services on the internet. In: Proceedings of the 14th GI/ITG Conference on Measuring. Modelling and Evaluation of Computer and Communication Systems (MMB 2008), pp. 269–283. Dortmund, Germany (2008)
3.
Zurück zum Zitat Ellis, M., Pezaros, D., Kypraios, T., Perkins, C.: Modelling packet loss in RTP-based streaming video for residential users. In: Proceedings of the 37th IEEE Conference on Local Computer Networks (LCN 2012), pp. 220–223. Clearwater, USA (2012). doi:10.1109/LCN.2012.6423613 Ellis, M., Pezaros, D., Kypraios, T., Perkins, C.: Modelling packet loss in RTP-based streaming video for residential users. In: Proceedings of the 37th IEEE Conference on Local Computer Networks (LCN 2012), pp. 220–223. Clearwater, USA (2012). doi:10.​1109/​LCN.​2012.​6423613
4.
Zurück zum Zitat Van Moorsel, A.: Metrics for the internet age: quality of experience and quality of business. In: Proceedings of the 5th Performability Workshop, pp. 26–31. Erlangen, Germany (2001) Van Moorsel, A.: Metrics for the internet age: quality of experience and quality of business. In: Proceedings of the 5th Performability Workshop, pp. 26–31. Erlangen, Germany (2001)
5.
Zurück zum Zitat Chikkerur, S., Sundaram, V., Reisslein, M., Karam, : Objective video quality assessment methods: a classification, review, and performance comparison. IEEE Trans. Broadcast. 57(2), 165–182 (2011). doi:10.1109/TBC.2011.2104671 CrossRef Chikkerur, S., Sundaram, V., Reisslein, M., Karam, : Objective video quality assessment methods: a classification, review, and performance comparison. IEEE Trans. Broadcast. 57(2), 165–182 (2011). doi:10.​1109/​TBC.​2011.​2104671 CrossRef
6.
Zurück zum Zitat Claypool, M., Tanner, J.: The effects of jitter on the peceptual quality of video. In: Proceedings of the 7th ACM International Conference on Multimedia (ACM Multimedia’99) (part 2), pp. 115–118. Orlando, USA (1999). doi:10.1145/319878.319909 Claypool, M., Tanner, J.: The effects of jitter on the peceptual quality of video. In: Proceedings of the 7th ACM International Conference on Multimedia (ACM Multimedia’99) (part 2), pp. 115–118. Orlando, USA (1999). doi:10.​1145/​319878.​319909
7.
Zurück zum Zitat Boyce, J., Gaglianello, R.: Packet loss effects on MPEG video sent over the public internet. In: Proceedings of the 6th ACM International Conference on Multimedia (ACM Multimedia’98), pp. 181–190. Bristol, England (1998). doi:10.1145/290747.290770 Boyce, J., Gaglianello, R.: Packet loss effects on MPEG video sent over the public internet. In: Proceedings of the 6th ACM International Conference on Multimedia (ACM Multimedia’98), pp. 181–190. Bristol, England (1998). doi:10.​1145/​290747.​290770
8.
Zurück zum Zitat Greengrass, J., Evans, J., Begen, A.: Not all packets are equal, part 2: the impact of network packet loss on video quality. IEEE Internet Comput. 13(2), 74–82 (2009). doi:10.1109/MIC.2009.40 CrossRef Greengrass, J., Evans, J., Begen, A.: Not all packets are equal, part 2: the impact of network packet loss on video quality. IEEE Internet Comput. 13(2), 74–82 (2009). doi:10.​1109/​MIC.​2009.​40 CrossRef
9.
Zurück zum Zitat Boyaci, O., Forte, A., Schulzrinne, H.: Performance of video-chat applications under congestion. In: Proceedings of the 11th IEEE International Symposium on Multimedia (ISM’09), pp. 213–218. San Diego, USA (2009). doi:10.1109/ISM.2009.45 Boyaci, O., Forte, A., Schulzrinne, H.: Performance of video-chat applications under congestion. In: Proceedings of the 11th IEEE International Symposium on Multimedia (ISM’09), pp. 213–218. San Diego, USA (2009). doi:10.​1109/​ISM.​2009.​45
12.
Zurück zum Zitat Calyam, P., Lee, C.G.: Characterizing voice and video traffic behavior over the Internet. In: Proceedings of the 20th International Symposium on Computer and Information Sciences (ISCIS 2005). Istanbul, Turkey (2005) Calyam, P., Lee, C.G.: Characterizing voice and video traffic behavior over the Internet. In: Proceedings of the 20th International Symposium on Computer and Information Sciences (ISCIS 2005). Istanbul, Turkey (2005)
13.
Zurück zum Zitat Ellis, M., Perkins, C.: Packet loss characteristics of IPTV-like traffic on residential links. In: Proceedings of the 7th Annual IEEE Consumer Communications and Networking Conference (CCNC 2010), pp. 1–5. Las Vegas, USA (2010). doi:10.1109/CCNC.2010.5421735 Ellis, M., Perkins, C.: Packet loss characteristics of IPTV-like traffic on residential links. In: Proceedings of the 7th Annual IEEE Consumer Communications and Networking Conference (CCNC 2010), pp. 1–5. Las Vegas, USA (2010). doi:10.​1109/​CCNC.​2010.​5421735
15.
Zurück zum Zitat Besson, A., De Simone, F., Ebrahimi, T.: Objective quality metrics for video scalability. In: Proceedings of the 20th IEEE International Conference on Image Processing (ICIP), pp. 59–63. Melbourne, Australia (2013). doi: 10.1109/ICIP.2013.6738013 Besson, A., De Simone, F., Ebrahimi, T.: Objective quality metrics for video scalability. In: Proceedings of the 20th IEEE International Conference on Image Processing (ICIP), pp. 59–63. Melbourne, Australia (2013). doi: 10.​1109/​ICIP.​2013.​6738013
16.
17.
Zurück zum Zitat Wang, Z., Simoncelli, E., Bovik, A.: Multi-scale structural similarity for image quality assessment. In: Proceedings of the 37th Asilomar Conference on Signals, Systems and Computers, pp. 1398–1402. Piscataway, USA (2003). doi:10.1109/ACSSC.2003.1292216 Wang, Z., Simoncelli, E., Bovik, A.: Multi-scale structural similarity for image quality assessment. In: Proceedings of the 37th Asilomar Conference on Signals, Systems and Computers, pp. 1398–1402. Piscataway, USA (2003). doi:10.​1109/​ACSSC.​2003.​1292216
18.
Zurück zum Zitat Damera-Venkata, N., Kite, T., Geisler, W., Evans, B., Bovik, A.: Image quality assessment based on a degradation model. IEEE Trans. Image Process. 9(4), 636–650 (2000). doi:10.1109/83.841940 CrossRef Damera-Venkata, N., Kite, T., Geisler, W., Evans, B., Bovik, A.: Image quality assessment based on a degradation model. IEEE Trans. Image Process. 9(4), 636–650 (2000). doi:10.​1109/​83.​841940 CrossRef
21.
Zurück zum Zitat Rimac-Drlje, S., Vranjes, M., Zagar, D.: Influence of temporal pooling method on the objective video quality evaluation. In: Proceedings of the 2nd IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB ’09), pp. 1–5. Bilbao, Spain (2009). doi:10.1109/ISBMSB.2009.5133781 Rimac-Drlje, S., Vranjes, M., Zagar, D.: Influence of temporal pooling method on the objective video quality evaluation. In: Proceedings of the 2nd IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB ’09), pp. 1–5. Bilbao, Spain (2009). doi:10.​1109/​ISBMSB.​2009.​5133781
22.
Zurück zum Zitat Seufert, M., Slanina, M., Egger, S., Kottkamp, M.: “To pool or not to pool”: A comparison of temporal pooling methods for HTTP adaptive video streaming. In: Proceedings of the 5th International Workshop on Quality of Multimedia Experience (QoMEX 2013), pp. 52–57. Klagenfurt, Austria (2013). doi:10.1109/QoMEX.2013.6603210 Seufert, M., Slanina, M., Egger, S., Kottkamp, M.: “To pool or not to pool”: A comparison of temporal pooling methods for HTTP adaptive video streaming. In: Proceedings of the 5th International Workshop on Quality of Multimedia Experience (QoMEX 2013), pp. 52–57. Klagenfurt, Austria (2013). doi:10.​1109/​QoMEX.​2013.​6603210
24.
Zurück zum Zitat Sheikh, H., Bovik, A.: A visual information fidelity approach to video quality assessment. In: Proceedings of the 1st International Workshop on Video Processing and Quality Metrics for Consumer Electronics, pp. 23–25. Scottsdale, USA (2005) Sheikh, H., Bovik, A.: A visual information fidelity approach to video quality assessment. In: Proceedings of the 1st International Workshop on Video Processing and Quality Metrics for Consumer Electronics, pp. 23–25. Scottsdale, USA (2005)
25.
Zurück zum Zitat Politis, I., Dounis, L., Tselios, C., Kordelas, A., Dagiuklas, T., Papadakis, A.: A model of network related QoE for 3D video. In: Proceedings of the IEEE Global Communications Conference (GLOBECOM 2012), pp. 1335–1340. Anaheim, USA (2012). doi: 10.1109/GLOCOMW.2012.6477776 Politis, I., Dounis, L., Tselios, C., Kordelas, A., Dagiuklas, T., Papadakis, A.: A model of network related QoE for 3D video. In: Proceedings of the IEEE Global Communications Conference (GLOBECOM 2012), pp. 1335–1340. Anaheim, USA (2012). doi: 10.​1109/​GLOCOMW.​2012.​6477776
31.
33.
36.
Zurück zum Zitat Khan, A., Sun, L., Ifeachor, E., Fajardo, J., Liberal, F.: Impact of RLC losses on quality prediction for H.264 video over UMTS networks. In: Proceedings of the 11th IEEE International Conference on Multimedia and Expo (ICME), pp. 702–707. Singapore (2010). doi: 10.1109/ICME.2010.5583033 Khan, A., Sun, L., Ifeachor, E., Fajardo, J., Liberal, F.: Impact of RLC losses on quality prediction for H.264 video over UMTS networks. In: Proceedings of the 11th IEEE International Conference on Multimedia and Expo (ICME), pp. 702–707. Singapore (2010). doi: 10.​1109/​ICME.​2010.​5583033
37.
Zurück zum Zitat Mok, R., Chan, E., Chang, R.: Measuring the quality of experience of HTTP video streaming. In: Proceedings of the 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011), pp. 485–492. Dublin, Ireland (2011). doi: 10.1109/INM.2011.5990550 Mok, R., Chan, E., Chang, R.: Measuring the quality of experience of HTTP video streaming. In: Proceedings of the 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011), pp. 485–492. Dublin, Ireland (2011). doi: 10.​1109/​INM.​2011.​5990550
39.
Zurück zum Zitat Babu, R., Bopardikar, A., Perkis, A., Hillestad, O.: No-reference metrics for video streaming applications. In: Proceedings of the 14th International Workshop on Packet Video (PV 2004). Irvine, USA (2004) Babu, R., Bopardikar, A., Perkis, A., Hillestad, O.: No-reference metrics for video streaming applications. In: Proceedings of the 14th International Workshop on Packet Video (PV 2004). Irvine, USA (2004)
40.
Zurück zum Zitat Venkataraman, M., Chatterjee, M., Chattopadhyay, S.: Evaluating quality of experience for streaming video in real time. In: Proceedings of the 24th IEEE Global Communications Conference (GLOBECOM 2009), pp. 1–6. Honolulu, USA (2009). doi:10.1109/GLOCOM.2009.5425806 Venkataraman, M., Chatterjee, M., Chattopadhyay, S.: Evaluating quality of experience for streaming video in real time. In: Proceedings of the 24th IEEE Global Communications Conference (GLOBECOM 2009), pp. 1–6. Honolulu, USA (2009). doi:10.​1109/​GLOCOM.​2009.​5425806
41.
Zurück zum Zitat Laghari, K., Pham, T., Nguyen, H., Crespi, N.: QoM: A new quality of experience framework for multimedia services. In: Proceedings of the 17th IEEE Symposium on Computers and Communications (ISCC 2012), pp. 851–856. Cappadocia, Turkey (2012). doi: 10.1109/ISCC.2012.6249408 Laghari, K., Pham, T., Nguyen, H., Crespi, N.: QoM: A new quality of experience framework for multimedia services. In: Proceedings of the 17th IEEE Symposium on Computers and Communications (ISCC 2012), pp. 851–856. Cappadocia, Turkey (2012). doi: 10.​1109/​ISCC.​2012.​6249408
42.
Zurück zum Zitat Staelens, N., Van Wallendael, G., Crombecq, K., Vercammen, N., De Cock, J., Vermeulen, B., Van de Walle, R., Dhaene, T., Demeester, P.: No-reference bitstream-based visual quality impairment detection for high definition H.264/AVC encoded video sequences. IEEE Trans. Broadcast. 58(2), 187–199 (2012). doi:10.1109/TBC.2012.2189334 CrossRef Staelens, N., Van Wallendael, G., Crombecq, K., Vercammen, N., De Cock, J., Vermeulen, B., Van de Walle, R., Dhaene, T., Demeester, P.: No-reference bitstream-based visual quality impairment detection for high definition H.264/AVC encoded video sequences. IEEE Trans. Broadcast. 58(2), 187–199 (2012). doi:10.​1109/​TBC.​2012.​2189334 CrossRef
43.
Zurück zum Zitat Chan, A., Zeng, K., Mohapatra, P., Lee, S., Banerjee, S.: Metrics for evaluating video streaming quality in lossy IEEE 802.11 wireless networks. In: Proceedings of the 29th IEEE International Conference on Computer Communications (INFOCOM 2010), pp. 1613–1621. San Diego, USA (2010). doi:10.1109/INFCOM.2010.5461979 Chan, A., Zeng, K., Mohapatra, P., Lee, S., Banerjee, S.: Metrics for evaluating video streaming quality in lossy IEEE 802.11 wireless networks. In: Proceedings of the 29th IEEE International Conference on Computer Communications (INFOCOM 2010), pp. 1613–1621. San Diego, USA (2010). doi:10.​1109/​INFCOM.​2010.​5461979
44.
48.
Zurück zum Zitat Salsano, S., Ludovici, F., Ordine, A., Giannuzzi, D.: Definition of a general and intuitive loss model for packet networks and its implementation in the Netem module in the Linux kernel. Technical Report, University of Rome (2012). “http://netgroup.uniroma2.it/TR/TR-loss-netem”. Accessed 23 Jan 2015 Salsano, S., Ludovici, F., Ordine, A., Giannuzzi, D.: Definition of a general and intuitive loss model for packet networks and its implementation in the Netem module in the Linux kernel. Technical Report, University of Rome (2012). “http://​netgroup.​uniroma2.​it/​TR/​TR-loss-netem”. Accessed 23 Jan 2015
Metadaten
Titel
Assessing the QoE in Video Services Over Lossy Networks
verfasst von
Francisco J. Suárez
Andrés García
Juan C. Granda
Daniel F. García
Pelayo Nuño
Publikationsdatum
01.01.2016
Verlag
Springer US
Erschienen in
Journal of Network and Systems Management / Ausgabe 1/2016
Print ISSN: 1064-7570
Elektronische ISSN: 1573-7705
DOI
https://doi.org/10.1007/s10922-015-9343-y

Weitere Artikel der Ausgabe 1/2016

Journal of Network and Systems Management 1/2016 Zur Ausgabe

Premium Partner