Skip to main content
Erschienen in: Cluster Computing 3/2014

01.09.2014

CloudDMSS: robust Hadoop-based multimedia streaming service architecture for a cloud computing environment

verfasst von: Myoungjin Kim, Seungho Han, Yun Cui, Hanku Lee, Hogyeon Cho, Sungdae Hwang

Erschienen in: Cluster Computing | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The delivery of scalable, rich multimedia applications and services on the Internet requires sophisticated technologies for transcoding, distributing, and streaming content. Cloud computing provides an infrastructure for such technologies, but specific challenges still remain in the areas of task management, load balancing, and fault tolerance. To address these issues, we propose a cloud-based distributed multimedia streaming service (CloudDMSS), which is designed to run on all major cloud computing services. CloudDMSS is highly adapted to the structure and policies of Hadoop, thus it has additional capacities for transcoding, task distribution, load balancing, and content replication and distribution. To satisfy the design requirements of our service architecture, we propose four important algorithms: content replication, system recovery for Hadoop distributed multimedia streaming, management for cloud multimedia management, and streaming resource-based connection (SRC) for streaming job distribution. To evaluate the proposed system, we conducted several different performance tests on a local testbed: transcoding, streaming job distribution using SRC, streaming service deployment and robustness to data node and task failures. In addition, we performed three different tests in an actual cloud computing environment, Cloudit 2.0: transcoding, streaming job distribution using SRC, and streaming service deployment.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Dirk, W., Andreas, E., Alexandra, C.: An ecosystem for user-generated mobile services. J. Converg. 3(4), 43–48 (2012) Dirk, W., Andreas, E., Alexandra, C.: An ecosystem for user-generated mobile services. J. Converg. 3(4), 43–48 (2012)
2.
Zurück zum Zitat Barlas, G.: Cluster-based optimized parallel video transcoding. Parallel Comput. 38(4–5), 226–244 (2012)CrossRef Barlas, G.: Cluster-based optimized parallel video transcoding. Parallel Comput. 38(4–5), 226–244 (2012)CrossRef
3.
Zurück zum Zitat Ratakonda, K., Turaga, D.S., Lai, J.: QoS support for streaming media using a multimedia server cluster. In: IEEE GLOBECOM Ratakonda, K., Turaga, D.S., Lai, J.: QoS support for streaming media using a multimedia server cluster. In: IEEE GLOBECOM
4.
Zurück zum Zitat Guo, J., Chen, F., Bhuyan, L., Kumar, R.: A cluster-based active router architecture supporting video/audio stream transcoding service. In: Proceedings of Parallel and Distributed Processing Symposium (2003) Guo, J., Chen, F., Bhuyan, L., Kumar, R.: A cluster-based active router architecture supporting video/audio stream transcoding service. In: Proceedings of Parallel and Distributed Processing Symposium (2003)
5.
Zurück zum Zitat Seo, D., Lee, J., Kim, Y., Choi, C., Jung, I.: Load distribution strategies in cluster-based transcoding servers for mobile clients. In: Proceedings of ICCSA, pp. 1156–1165 (2006) Seo, D., Lee, J., Kim, Y., Choi, C., Jung, I.: Load distribution strategies in cluster-based transcoding servers for mobile clients. In: Proceedings of ICCSA, pp. 1156–1165 (2006)
6.
Zurück zum Zitat Strufe, T.: llmStream: efficient multimedia streaming in decentralized distributed systems. In: IFMIP, pp. 63–68 (2004) Strufe, T.: llmStream: efficient multimedia streaming in decentralized distributed systems. In: IFMIP, pp. 63–68 (2004)
7.
Zurück zum Zitat Kim, M., Han, S., Cui, Y., Lee, H., Jeong, C.: A Hadoop-based multimedia transcoding system for processing social media in the PaaS platform of SMCCSE. KSII Trans. Internet Inf. Syst. 6(11), 2827–2848 (2012) Kim, M., Han, S., Cui, Y., Lee, H., Jeong, C.: A Hadoop-based multimedia transcoding system for processing social media in the PaaS platform of SMCCSE. KSII Trans. Internet Inf. Syst. 6(11), 2827–2848 (2012)
8.
Zurück zum Zitat Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandi, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25(6), 599–616 (2009)CrossRef Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandi, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25(6), 599–616 (2009)CrossRef
9.
Zurück zum Zitat Vouk, M.A.: Cloud computing: issues, research, and implementations. In: ITI, pp. 31–40 (2008) Vouk, M.A.: Cloud computing: issues, research, and implementations. In: ITI, pp. 31–40 (2008)
10.
Zurück zum Zitat Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)CrossRef Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)CrossRef
11.
Zurück zum Zitat Grossman, R.L.: The case for cloud computing. IT Prof. 11(2), 23–27 (2009)CrossRef Grossman, R.L.: The case for cloud computing. IT Prof. 11(2), 23–27 (2009)CrossRef
12.
Zurück zum Zitat Zhang, Q., Cheng, L., Boutaba, R.: Cloud computing: state of the art and research challenges. J. Internet Ser. A 1(1), 7–18 (2010)CrossRef Zhang, Q., Cheng, L., Boutaba, R.: Cloud computing: state of the art and research challenges. J. Internet Ser. A 1(1), 7–18 (2010)CrossRef
13.
Zurück zum Zitat Pan, Y., Zhang, J.: Parallel programming on cloud computing platforms: challenges and solutions. J. Converg. 3(4), 23–28 (2012)MathSciNet Pan, Y., Zhang, J.: Parallel programming on cloud computing platforms: challenges and solutions. J. Converg. 3(4), 23–28 (2012)MathSciNet
14.
Zurück zum Zitat Lei, Z.: Media transcoding for pervasive computing. In: ACM Conference on Multimedia Workshop, pp. 459–460 (2001) Lei, Z.: Media transcoding for pervasive computing. In: ACM Conference on Multimedia Workshop, pp. 459–460 (2001)
15.
Zurück zum Zitat Lee, H.S., Lim, K.H., Kim, S.J.: A configuration scheme for connectivity-aware mobile P2P networks for efficient mobile cloud-based video streaming services. Clust. Comput. 1–12 (2013) Lee, H.S., Lim, K.H., Kim, S.J.: A configuration scheme for connectivity-aware mobile P2P networks for efficient mobile cloud-based video streaming services. Clust. Comput. 1–12 (2013)
16.
Zurück zum Zitat Zhu, W., Luo, C., Wang, J., Li, S.: Multimedia cloud computing. IEEE Signal Process. Mag. 28(3), 59–69 (2011)CrossRef Zhu, W., Luo, C., Wang, J., Li, S.: Multimedia cloud computing. IEEE Signal Process. Mag. 28(3), 59–69 (2011)CrossRef
17.
Zurück zum Zitat Park, S., Jung, I.Y., Eom, H., Yeom, H.Y.: An analysis of replication enhancement for a high availability cluster. J. Inf. Process. Syst. 9(2), 205–216 (2013) Park, S., Jung, I.Y., Eom, H., Yeom, H.Y.: An analysis of replication enhancement for a high availability cluster. J. Inf. Process. Syst. 9(2), 205–216 (2013)
21.
Zurück zum Zitat Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The Hadoop distributed file system. In: MSST Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The Hadoop distributed file system. In: MSST
22.
Zurück zum Zitat Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. Oper. Syst. Rev. ACM 37(5), 29–43 (2003)CrossRef Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. Oper. Syst. Rev. ACM 37(5), 29–43 (2003)CrossRef
23.
Zurück zum Zitat Poellabauer, C., Schwan, K.: Energy-aware media transcoding in wireless systems. In: IEEE PerCom, pp. 135–144 (2004) Poellabauer, C., Schwan, K.: Energy-aware media transcoding in wireless systems. In: IEEE PerCom, pp. 135–144 (2004)
24.
Zurück zum Zitat Roy, S., Shen, B., Sundaram, V.: Application level hand off support for mobile media transcoding sessions. In: Workshop on Network and Operating Systems, pp. 95–104 (2002) Roy, S., Shen, B., Sundaram, V.: Application level hand off support for mobile media transcoding sessions. In: Workshop on Network and Operating Systems, pp. 95–104 (2002)
25.
Zurück zum Zitat Liao, X., Jin, H.: A new distributed storage scheme for cluster video server. J. Syst. Archit. 51(2), 79–94 (2005)CrossRef Liao, X., Jin, H.: A new distributed storage scheme for cluster video server. J. Syst. Archit. 51(2), 79–94 (2005)CrossRef
26.
Zurück zum Zitat Sambe, Y., Watanabe, S., Yu, D., Nakamura, T., Wakamiya, N.: High-speed distributed video transcoding for multiple rates and formats. IEICE Trans. Inf. Syst. E88–D(8), 1923–1931 (2005)CrossRef Sambe, Y., Watanabe, S., Yu, D., Nakamura, T., Wakamiya, N.: High-speed distributed video transcoding for multiple rates and formats. IEICE Trans. Inf. Syst. E88–D(8), 1923–1931 (2005)CrossRef
27.
Zurück zum Zitat Tian, Z., Xue, J., Hu, W., Xu, T., Zheng, N.: High performance cluster-based transcoder. In: Proceedings of ICCASM, pp. 248–252 (2010) Tian, Z., Xue, J., Hu, W., Xu, T., Zheng, N.: High performance cluster-based transcoder. In: Proceedings of ICCASM, pp. 248–252 (2010)
28.
Zurück zum Zitat Hui, W., Lin, C., Yang, Y.: MediaCloud: a new paradigm of multimedia computing. KSII Trans. Internet Inf. Syst. 6(4), 1153–1170 (2012) Hui, W., Lin, C., Yang, Y.: MediaCloud: a new paradigm of multimedia computing. KSII Trans. Internet Inf. Syst. 6(4), 1153–1170 (2012)
29.
Zurück zum Zitat Luo, H., Egbert, A., Stahlhut, T.: QoS architecture for cloud-based media computing. In: ICSESS, pp. 769–772 (2012) Luo, H., Egbert, A., Stahlhut, T.: QoS architecture for cloud-based media computing. In: ICSESS, pp. 769–772 (2012)
30.
Zurück zum Zitat Chang, S.Y., Lai, C.F., Huang, Y.H.: Dynamic adjustable multimedia streaming service architecture over cloud computing. Comput. Commun. 35(15), 1798–1808 (2012)CrossRef Chang, S.Y., Lai, C.F., Huang, Y.H.: Dynamic adjustable multimedia streaming service architecture over cloud computing. Comput. Commun. 35(15), 1798–1808 (2012)CrossRef
31.
Zurück zum Zitat Huang, Z., Mei, C., Li, L.E., Woo, T.: CloudStream: delivering high-quality streaming videos through a cloud-based SVC proxy. In: Proceedings of IEEE INFOCOM, pp. 201–205 (2011) Huang, Z., Mei, C., Li, L.E., Woo, T.: CloudStream: delivering high-quality streaming videos through a cloud-based SVC proxy. In: Proceedings of IEEE INFOCOM, pp. 201–205 (2011)
32.
Zurück zum Zitat Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)CrossRef Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)CrossRef
34.
Zurück zum Zitat Kim, M., Cui, Y., Han, S., Lee, H.P.: Towards efficient design and implementation of a Hadoop-based distributed video transcoding system in cloud computing environment. J. Multimed. Ubiquitous Eng. 8(2), 213–224 (2013) Kim, M., Cui, Y., Han, S., Lee, H.P.: Towards efficient design and implementation of a Hadoop-based distributed video transcoding system in cloud computing environment. J. Multimed. Ubiquitous Eng. 8(2), 213–224 (2013)
35.
Zurück zum Zitat Piorkowski, A., Kempny, A., Hajduk, A., Strzelczyk, J.: Load balancing for heterogeneous web servers. CN, pp. 189–198 (2010) Piorkowski, A., Kempny, A., Hajduk, A., Strzelczyk, J.: Load balancing for heterogeneous web servers. CN, pp. 189–198 (2010)
40.
Zurück zum Zitat Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: Proceedings of ACM SOSP, pp. 164–177(2003) Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: Proceedings of ACM SOSP, pp. 164–177(2003)
Metadaten
Titel
CloudDMSS: robust Hadoop-based multimedia streaming service architecture for a cloud computing environment
verfasst von
Myoungjin Kim
Seungho Han
Yun Cui
Hanku Lee
Hogyeon Cho
Sungdae Hwang
Publikationsdatum
01.09.2014
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 3/2014
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-014-0381-0

Weitere Artikel der Ausgabe 3/2014

Cluster Computing 3/2014 Zur Ausgabe