Skip to main content
Erschienen in: Cluster Computing 1/2019

14.02.2018

A novel disk I/O scheduling framework of virtualized storage system

verfasst von: Dingding Li, Mianxiong Dong, Yong Tang, Kaoru Ota

Erschienen in: Cluster Computing | Sonderheft 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Modern data centers usually use virtual machine technology to host various big data applications in a single physical machine, not only enhancing the server utilization, but also providing them with the hardware-level isolation. However, in a typical virtualized environment an extra software layer called virtual machine monitor (VMM) is often interposed between the hardware resource and guest operating system (virtual machine, VM), shielding the specific user-process semantic inside a running VM. As a result, it obstructs the disk I/O scheduler of VMM to acquire the accurate information of a user-process (often a big data application), and thus proposes a challenge on the I/O request scheduling as well as the disk resource management at the granularity of VM user-process. Eventually, the disk I/O performance of a virtualized system is sub-optimal. This paper introduces an improved disk I/O scheduling framework for the virtualized system. It aims at bridging the semantic gap between physical disk I/O scheduler and VM user-process, providing a fair sharing of disk I/O resource among concurrent VMs. At the same time, it improves the overall disk I/O performance through a novel method for creating the image file of VM. Besides, an extra scheduling algorithm is proposed to further refine the storage performance. Finally, we implement these improvements on Xen hypervisor and conduct extensive experiments to verify our framework. The experimental result shows that our work improve the performance of read-intensive, write-intensive and mixed workloads up to 9, 10.7 and 20% respectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
It is also known as virtual machines and being abbreviated by VMs.
 
2
Libvirt, the virtualization API. http://​www.​libvirt.​org.
 
4
Iozone Filesystem Benchmark, http://​www.​iozone.​org/​.
 
5
http_load - Multiprocessing HTTP Test Client, http://​acme.​com/​software/​http_​load/​.
 
6
AS3AP-IR,The Open Source Database Benchmark. http://​osdb.​sourceforge.​net/​index.​php?​page=​home.
 
9
The Linux Kernel Archives. https://​www.​kernel.​org/​.
 
Literatur
1.
Zurück zum Zitat Agmon Ben-Yehuda, O., Posener, E., Ben-Yehuda, M., Schuster, A., Mu’alem, A.: Ginseng: market-driven memory allocation. In: Proceedings of the 10th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2014), pp. 41–52. ACM, New York, NY, USA (2014) Agmon Ben-Yehuda, O., Posener, E., Ben-Yehuda, M., Schuster, A., Mu’alem, A.: Ginseng: market-driven memory allocation. In: Proceedings of the 10th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2014), pp. 41–52. ACM, New York, NY, USA (2014)
2.
Zurück zum Zitat Amit, N., Tsafrir, D., Schuster, A.: VSwapper: a memory swapper for virtualized environments. In: Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2014), pp. 349–366. ACM, New York, NY, USA (2014) Amit, N., Tsafrir, D., Schuster, A.: VSwapper: a memory swapper for virtualized environments. In: Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2014), pp. 349–366. ACM, New York, NY, USA (2014)
3.
Zurück zum Zitat Arya, K., Baskakov, Y., Garthwaite, A.: Tesseract: reconciling guest I/O and hypervisor swapping in a VM. In: Proceedings of the 10th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2014), pp. 15–28. ACM, New York, NY, USA (2014) Arya, K., Baskakov, Y., Garthwaite, A.: Tesseract: reconciling guest I/O and hypervisor swapping in a VM. In: Proceedings of the 10th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2014), pp. 15–28. ACM, New York, NY, USA (2014)
5.
Zurück zum Zitat Billaud, J.P., Gulati, A.: hClock: hierarchical QoS for packet scheduling in a hypervisor. In: Proceedings of the 8th ACM European Conference on Computer Systems (Eurosys 2013), pp. 309–322. ACM, New York, NY, USA (2013) Billaud, J.P., Gulati, A.: hClock: hierarchical QoS for packet scheduling in a hypervisor. In: Proceedings of the 8th ACM European Conference on Computer Systems (Eurosys 2013), pp. 309–322. ACM, New York, NY, USA (2013)
6.
Zurück zum Zitat Boutcher, D., Chandra, A.: Does virtualization make disk scheduling passé? ACM SIGOPS Oper. Syst. Rev. 44(1), 20–24 (2010)CrossRef Boutcher, D., Chandra, A.: Does virtualization make disk scheduling passé? ACM SIGOPS Oper. Syst. Rev. 44(1), 20–24 (2010)CrossRef
7.
Zurück zum Zitat Dong, M., Watanabe, S., Guo, M.: Performance evaluation to optimize the ump system focusing on network transmission speed. In: Proceedings of the Frontier of Computer Science and Technology (FCST 2007) on the Japan-China Joint Workshop, pp. 7–12 (2007). https://doi.org/10.1109/FCST.2007.23 Dong, M., Watanabe, S., Guo, M.: Performance evaluation to optimize the ump system focusing on network transmission speed. In: Proceedings of the Frontier of Computer Science and Technology (FCST 2007) on the Japan-China Joint Workshop, pp. 7–12 (2007). https://​doi.​org/​10.​1109/​FCST.​2007.​23
8.
Zurück zum Zitat Dong, M., Guo, M., Zheng, L., Guo, S.: Performance analysis of resource allocation algorithms using cache technology for pervasive computing system. In: Proceedings of the 9th International Conference for Young Computer Scientists (ICYCS 2008), pp. 671–676 (2008). https://doi.org/10.1109/ICYCS.2008.527 Dong, M., Guo, M., Zheng, L., Guo, S.: Performance analysis of resource allocation algorithms using cache technology for pervasive computing system. In: Proceedings of the 9th International Conference for Young Computer Scientists (ICYCS 2008), pp. 671–676 (2008). https://​doi.​org/​10.​1109/​ICYCS.​2008.​527
9.
Zurück zum Zitat Dong, M., Zheng, L., Ota, K., Guo, S., Guo, M., Li, L.: Improved resource allocation algorithms for practical image encoding in a ubiquitous computing environment. J. Comput. 4(9), 873–880 (2009)CrossRef Dong, M., Zheng, L., Ota, K., Guo, S., Guo, M., Li, L.: Improved resource allocation algorithms for practical image encoding in a ubiquitous computing environment. J. Comput. 4(9), 873–880 (2009)CrossRef
10.
Zurück zum Zitat Li, D., Jin, H., Liao, X., Zhang, Y., Zhou, B.: Improving disk i/o performance in a virtualized system. J. Comput. Syst. Sci. 79(2), 187–200 (2013)MathSciNetCrossRef Li, D., Jin, H., Liao, X., Zhang, Y., Zhou, B.: Improving disk i/o performance in a virtualized system. J. Comput. Syst. Sci. 79(2), 187–200 (2013)MathSciNetCrossRef
11.
Zurück zum Zitat Lu, P., Shen, K.: Virtual machine memory access tracing with hypervisor exclusive cache. In: Proceedings of the 2007 USENIX Annual Technical Conference (USENIX 2007), pp. 3:1–3:15. USENIX Association, Berkeley, CA, USA (2007) Lu, P., Shen, K.: Virtual machine memory access tracing with hypervisor exclusive cache. In: Proceedings of the 2007 USENIX Annual Technical Conference (USENIX 2007), pp. 3:1–3:15. USENIX Association, Berkeley, CA, USA (2007)
12.
Zurück zum Zitat Malka, M., Amit, N., Ben-Yehuda, M., Tsafrir, D.: rIOMMU: Efficient IOMMU for I/O devices that employ ring buffers. In: Proceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2015), pp. 355–368. ACM, New York, NY, USA (2015) Malka, M., Amit, N., Ben-Yehuda, M., Tsafrir, D.: rIOMMU: Efficient IOMMU for I/O devices that employ ring buffers. In: Proceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2015), pp. 355–368. ACM, New York, NY, USA (2015)
13.
Zurück zum Zitat Meng, F., Zhou, L., Ma, X., Uttamchandani, S., Liu, D.: vCacheShare: automated server flash cache space management in a virtualization environment. In: Proceedings of the 2014 USENIX Conference on USENIX Annual Technical Conference (USENIX ATC 2014), pp. 133–144. USENIX Association, Berkeley, CA, USA (2014) Meng, F., Zhou, L., Ma, X., Uttamchandani, S., Liu, D.: vCacheShare: automated server flash cache space management in a virtualization environment. In: Proceedings of the 2014 USENIX Conference on USENIX Annual Technical Conference (USENIX ATC 2014), pp. 133–144. USENIX Association, Berkeley, CA, USA (2014)
14.
Zurück zum Zitat Menon, A., Santos, J.R., Turner, Y., Janakiraman, G.J., Zwaenepoel, W.: Diagnosing performance overheads in the Xen virtual machine environment. In: Proceedings of the 1st ACM/USENIX International Conference on Virtual Execution Environments (VEE 2005), pp. 13–23. ACM, New York, NY, USA (2005) Menon, A., Santos, J.R., Turner, Y., Janakiraman, G.J., Zwaenepoel, W.: Diagnosing performance overheads in the Xen virtual machine environment. In: Proceedings of the 1st ACM/USENIX International Conference on Virtual Execution Environments (VEE 2005), pp. 13–23. ACM, New York, NY, USA (2005)
15.
Zurück zum Zitat Oh, J., Kwon, J.w., Park, H., Moon, S.M.: Migration of web applications with seamless execution. In: Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2015), pp. 173–185. ACM, New York, NY, USA (2015) Oh, J., Kwon, J.w., Park, H., Moon, S.M.: Migration of web applications with seamless execution. In: Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2015), pp. 173–185. ACM, New York, NY, USA (2015)
16.
Zurück zum Zitat Ouyang, J., Lange, J.R.: Preemptable ticket spinlocks: improving consolidated performance in the cloud. In: Proceedings of the 9th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2013), pp. 191–200. ACM, New York, NY, USA (2013) Ouyang, J., Lange, J.R.: Preemptable ticket spinlocks: improving consolidated performance in the cloud. In: Proceedings of the 9th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2013), pp. 191–200. ACM, New York, NY, USA (2013)
18.
Zurück zum Zitat Singh, R.P., Brecht, T., Keshav, S.: Towards VM consolidation using a hierarchy of idle states. In: Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2015), pp. 107–119. ACM, New York, NY, USA (2015) Singh, R.P., Brecht, T., Keshav, S.: Towards VM consolidation using a hierarchy of idle states. In: Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2015), pp. 107–119. ACM, New York, NY, USA (2015)
19.
Zurück zum Zitat Suneja, S., Isci, C., de Lara, E., Bala, V.: Exploring VM introspection: techniques and trade-offs. In: Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2015), pp. 133–146. ACM, New York, NY, USA (2015) Suneja, S., Isci, C., de Lara, E., Bala, V.: Exploring VM introspection: techniques and trade-offs. In: Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2015), pp. 133–146. ACM, New York, NY, USA (2015)
20.
Zurück zum Zitat Thereska, E., Ballani, H., O’Shea, G., Karagiannis, T., Rowstron, A., Talpey, T., Black, R., Zhu, T.: IOFlow: a software-defined storage architecture. In: Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles (SOSP 2013), pp. 182–196. ACM, New York, NY, USA (2013) Thereska, E., Ballani, H., O’Shea, G., Karagiannis, T., Rowstron, A., Talpey, T., Black, R., Zhu, T.: IOFlow: a software-defined storage architecture. In: Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles (SOSP 2013), pp. 182–196. ACM, New York, NY, USA (2013)
21.
Zurück zum Zitat Tu, C.C., Ferdman, M., Lee, C.t., Chiueh, T.c.: A comprehensive implementation and evaluation of direct interrupt delivery. In: Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2015), pp. 1–15. ACM, New York, NY, USA (2015) Tu, C.C., Ferdman, M., Lee, C.t., Chiueh, T.c.: A comprehensive implementation and evaluation of direct interrupt delivery. In: Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 2015), pp. 1–15. ACM, New York, NY, USA (2015)
22.
Zurück zum Zitat Venkataraman, S., Panda, A., Ananthanarayanan, G., Franklin, M.J., Stoica, I.: The power of choice in data-aware cluster scheduling. In: Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI 2014), pp. 301–316. USENIX Association, Berkeley, CA, USA (2014) Venkataraman, S., Panda, A., Ananthanarayanan, G., Franklin, M.J., Stoica, I.: The power of choice in data-aware cluster scheduling. In: Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI 2014), pp. 301–316. USENIX Association, Berkeley, CA, USA (2014)
24.
Zurück zum Zitat Xu, C., Gamage, S., Lu, H., Kompella, R., Xu, D.: vTurbo: accelerating virtual machine I/O processing using designated turbo-sliced core. In: Proceedings of the 2013 USENIX Conference on Annual Technical Conference (USENIX ATC 2013), pp. 243–254. USENIX Association, Berkeley, CA, USA (2013) Xu, C., Gamage, S., Lu, H., Kompella, R., Xu, D.: vTurbo: accelerating virtual machine I/O processing using designated turbo-sliced core. In: Proceedings of the 2013 USENIX Conference on Annual Technical Conference (USENIX ATC 2013), pp. 243–254. USENIX Association, Berkeley, CA, USA (2013)
25.
Zurück zum Zitat Zhu, T., Tumanov, A., Kozuch, M.A., Harchol-Balter, M., Ganger, G.R.: PriorityMeister: tail latency QoS for shared networked storage. In: Proceedings of the 5th ACM Symposium on Cloud Computing (SOCC 2014), pp. 29:1–29:14. ACM, New York, NY, USA (2014) Zhu, T., Tumanov, A., Kozuch, M.A., Harchol-Balter, M., Ganger, G.R.: PriorityMeister: tail latency QoS for shared networked storage. In: Proceedings of the 5th ACM Symposium on Cloud Computing (SOCC 2014), pp. 29:1–29:14. ACM, New York, NY, USA (2014)
Metadaten
Titel
A novel disk I/O scheduling framework of virtualized storage system
verfasst von
Dingding Li
Mianxiong Dong
Yong Tang
Kaoru Ota
Publikationsdatum
14.02.2018
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe Sonderheft 1/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-1363-9

Weitere Artikel der Sonderheft 1/2019

Cluster Computing 1/2019 Zur Ausgabe