Video-On-Demand QoE Evaluation across Different Age-Groups and Its Significance for Network Capacity

Authors: Mujtaba Roshan, John A. Schormans

Abstract:

Quality of Experience (QoE) drives churn in the broadband networks industry, and good QoE plays a large part in the retention of customers. QoE is known to be affected by the Quality of Service (QoS) factors packet loss probability (PLP), delay and delay jitter caused by the network. Earlier results have shown that the relationship between these QoS factors and QoE is non-linear, and may vary from application to application. We use the network emulator Netem as the basis for experimentation, and evaluate how QoE varies as we change the emulated QoS metrics. Focusing on Video-on-Demand, we discovered that the reported QoE may differ widely for users of different age groups, and that the most demanding age group (the youngest) can require an order of magnitude lower PLP to achieve the same QoE than is required by the most widely studied age group of users. We then used a bottleneck TCP model to evaluate the capacity cost of achieving an order of magnitude decrease in PLP, and found it be (almost always) a 3-fold increase in link capacity that was required.

Keywords: Quality of experience, quality of service, packet loss probability, network capacity.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1130919

References:

[1] http://manpages.ubuntu.com/manpages/zesty/man8/tc-netem.8.html Accessed 2 May 2017.
[2] M. Bassi, P. Steca P, A. Fave, G. Caprara, “Academic Self-Efficacy Beliefs and Quality of Experience in Learning”, J. Youth Adolesc. 2007 April, 36(3), pp. 301-12.
[3] http://bes.ovum.com/downloads/Global_Broadband_Experience_Scorecards.pdf, Accessed 2 May 2017.
[4] https://www.ofcom.org.uk/__data/assets/pdf_file/0015/63312/understanding_satellite.pdf Accessed 2 May 2017.
[5] http://www.bth.se/com/jun.nsf/attachments/Junaid_PhDThesis_Final_v20150821_pdf/$file/Junaid_PhDThesis_Final_v20150821.pdf Accessed 2 May 2017.
[6] Linux Foundation (2009), Netem, available at: http://www.linuxfoundation.org/collaborate/workgroups/networking/netem, retrieved 2 May 2017.
[7] http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.67.1687&rep=rep1&type=pdf Accessed 2 May 2017.
[8] Information technologies and sciences COST 224, Performance evaluation and design of multiservice networks, report of EU Project COST224, Chapter 7, pp. 159–170.
[9] D. Anick, D. Mitra D and M. Sondhi, “Stochastic Theory of a Data-Handling System with Multiple Sources”. BSTJ Vol. 61, No.8.
[10] J. Sliwinski, A. Beben, P. Krawiec, “EmPath: Tool to Emulate Packet Transfer Characteristics in IP Network”. International Workshop on Traffic Monitoring and Analysis, TMA 2010: Traffic Monitoring and Analysis pp 46-58.
[11] M. Varela, T. M ̈aki, L. Skorin-Kapov, T. Hoßfeld, “Towards an Understanding of Visual Appeal in Website Design”, Quality of Multimedia Experience (QoMEX), 2013 Fifth International Workshop on, 3-5 July 2013.
[12] M. Mushtaq, B. Augustin, A. Mellouk, “QoE: User profile analysis for multimedia services”, 2014 IEEE International Conference on Communications (ICC), 2014, pp 2289 – 2294.
[13] http://www.diva-portal.org/smash/get/diva2:830726/FULLTEXT01.pdf Accessed 2 May 2017.
[14] http://www.tcf.org.nz/industry/standards-compliance/infrastructure-connections/ip-interconnection/ip-interconnection-for-voice-technical-standards.pdf, retrieved 2 May 2017.
[15] http://www.eu.ntt.com/content/dam/nttcom/eu/pdf/services/network/ip-network-transit/sla-of-global-ip-network/NTTE_GIN_SLA_250210.pdf Accessed 2 May 2017.
[16] https://business.bt.com/content/dam/bt/business/Networking/BTnet_leased_line_service_level_agreement.pdf, retrieved 2 May 2017.
[17] A. Devlic, P. Kamaraju, P. Lungaro, Z. Segall, and K. Tollmar, “QoE-aware optimization for video delivery and storage”, 2015 IEEE 16th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM), 2015.
[18] I. Bisio and M. Marchese, “Analytical Expression and Performance Evaluation of TCP Packet Loss Probability Over Geostationary Satellite”, IEEE Communications Letters, vol. 8, No. 4, April 2004.
[19] N. Cardwell, Y. Cheng, C. S. Gunn, S. H. Yeganeh, and Van Jacobson, “BBR: Congestion-Based Congestion Control”, Communications of the ACM, February 2017, Vol. 60 No. 2, Pages 58-66.
[20] https://people.cs.umass.edu/~phillipa/papers/SPECTS.pdf Accessed 2 May 2017.
[21] https://www.nanog.org/meetings/nanog32/presentations/appenzeller.ppt Accessed 2 May 2017.
[22] http://www.juniper.net/documentation/en_US/junos12.1x46/topics/concept/interface-security-t1-and-e1-understanding.html Accessed 2 May 2017.
[23] http://www.cisco.com/c/en/us/td/docs/ios-xml/ios/qos_conmgt/configuration/xe-3s/qos-conmgt-xe-3s-book/qos-conmgt-qdepth.html#GUID-47CFCFBD-9E4D-4754-80DD-50CD6E296CF9 Accessed 2 May 2017.