Skip to main content
Erschienen in: Cluster Computing 5/2019

09.01.2018

An evaluation framework for auto-conversion of 2D to 3D video streaming using depth profile and pipelining technique in handheld cellular devices

verfasst von: P. S. Ramesh, S. Letitia

Erschienen in: Cluster Computing | Sonderheft 5/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The main objective of this paper is to propose a Reliable and Speedy Communication for Upstream Emergency (RESCUE) framework to create 3D remote sensing videos. The proposed framework uses low memory space on mobile devices with the help of efficient pipelining processes. Many methods for converting 2D videos to 3D have been proposed wherein developers convert high-quality 2D to 3D. We propose a method to apply the pre-classification process on either training on dataset or heuristics based on the quality of streaming attributes. The evaluation framework automatically changes remote sensing videos from 2D to 3D by using depth profile with method filter, segmentation and sharpening transformation of the videos. The traditional Hough transformation algorithm is not suitable for hardware implementation and saliency is based on the colour histogram to support slow motion object of frames which leads to inordinate delay in converting 2D to 3D. Therefore, the RESCUE framework, with its extended vanishing point and line algorithm, is applied to provide suitable solutions and overcome the drawbacks of existing techniques. The framework is a lightweight process when compared with JAVRAE, and it utilizes limited phone memory and consumes less processing time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Angot, L., Huang, W.-J., Liu, K.-C.: A 2D to 3D video and image conversion technique based on a bilateral filter. Proc. SPIE 7526, 75260D (2004) Angot, L., Huang, W.-J., Liu, K.-C.: A 2D to 3D video and image conversion technique based on a bilateral filter. Proc. SPIE 7526, 75260D (2004)
2.
Zurück zum Zitat Baek, N., Kim, K.J.: An artifact detection scheme with CUDA-based image operations. Cluster Comput. 20(1), 749–755 (2017)MathSciNetCrossRef Baek, N., Kim, K.J.: An artifact detection scheme with CUDA-based image operations. Cluster Comput. 20(1), 749–755 (2017)MathSciNetCrossRef
4.
Zurück zum Zitat Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Proceedings of the European Conference on Computer Vision, pp. 25–36 (2004) Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Proceedings of the European Conference on Computer Vision, pp. 25–36 (2004)
5.
Zurück zum Zitat Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005)
6.
Zurück zum Zitat Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 257–266 (2002) Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 257–266 (2002)
7.
Zurück zum Zitat Grundmann, M., Kwatra, V., Essa, I.: Auto-directed video stabilization with robust L1 optimal camera paths. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 225–232 (2011) Grundmann, M., Kwatra, V., Essa, I.: Auto-directed video stabilization with robust L1 optimal camera paths. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 225–232 (2011)
8.
Zurück zum Zitat Guttmann, M., Wolf, L., Cohen-Or, D.: Semi-automatic stereo extraction from video footage. In: IEEE International Conference on Computer Vision, pp. 136–142 (2009) Guttmann, M., Wolf, L., Cohen-Or, D.: Semi-automatic stereo extraction from video footage. In: IEEE International Conference on Computer Vision, pp. 136–142 (2009)
9.
Zurück zum Zitat Karsch, K., Liu, C., Kang, S.B.: Depth extraction from video using non-parametric sampling. In: Proceedings of the European Conference on Computer Vision, pp. 775–788 (2012) Karsch, K., Liu, C., Kang, S.B.: Depth extraction from video using non-parametric sampling. In: Proceedings of the European Conference on Computer Vision, pp. 775–788 (2012)
10.
Zurück zum Zitat Khamis, H.S., Cheruiyot, K.W., Kimani, S.: Application of k-nearest neighbour classification in medical data mining. Int. J. Inf. Commun. Technol. Res. 4(4), 121–128 (2014) Khamis, H.S., Cheruiyot, K.W., Kimani, S.: Application of k-nearest neighbour classification in medical data mining. Int. J. Inf. Commun. Technol. Res. 4(4), 121–128 (2014)
11.
Zurück zum Zitat Konrad, J., Wang, M., Ishwar, P.: 2D-to-3D image conversion by learning depth from examples. In: Proceedings of the IEEE Computer Society Conference on CVPRW, pp. 16–22 (2012) Konrad, J., Wang, M., Ishwar, P.: 2D-to-3D image conversion by learning depth from examples. In: Proceedings of the IEEE Computer Society Conference on CVPRW, pp. 16–22 (2012)
12.
Zurück zum Zitat Konrad, J., Brown, G., Wang, M., Ishwar, P., Wu, C., Mukherjee, D.: Automatic 2D-to-3D image conversion using 3D examples from the Internet. Proc. SPIE 8288, 82880F (2012)CrossRef Konrad, J., Brown, G., Wang, M., Ishwar, P., Wu, C., Mukherjee, D.: Automatic 2D-to-3D image conversion using 3D examples from the Internet. Proc. SPIE 8288, 82880F (2012)CrossRef
13.
Zurück zum Zitat Liao, M., Gao, J., Yang, R., Gong, M.: Video stereolization: combining motion analysis with user interaction. IEEE Trans. Visualizat. Comput. Graph. 18(7), 1079–1088 (2012)CrossRef Liao, M., Gao, J., Yang, R., Gong, M.: Video stereolization: combining motion analysis with user interaction. IEEE Trans. Visualizat. Comput. Graph. 18(7), 1079–1088 (2012)CrossRef
14.
Zurück zum Zitat Liu, B., Gould, S., Koller, D.: Single image depth estimation from predicted semantic abels. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 1253–1260 (2010) Liu, B., Gould, S., Koller, D.: Single image depth estimation from predicted semantic abels. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 1253–1260 (2010)
15.
Zurück zum Zitat Phan, R., Rzeszutek, R., Androutsos, D.: Semi-automatic 2D to 3D image conversion using scale-space random walks and a graph cuts based depth prior. In: Proceedings of the 18th IEEE International Conference on Image Processing, pp. 865–868 (2011) Phan, R., Rzeszutek, R., Androutsos, D.: Semi-automatic 2D to 3D image conversion using scale-space random walks and a graph cuts based depth prior. In: Proceedings of the 18th IEEE International Conference on Image Processing, pp. 865–868 (2011)
17.
Zurück zum Zitat Saxena, A., Chung, S.H., Ng, A.Y.: Learning depth from single monocular images. In: Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press (2005) Saxena, A., Chung, S.H., Ng, A.Y.: Learning depth from single monocular images. In: Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press (2005)
18.
Zurück zum Zitat Saxena, A., Sun, M., Ng, A.: Make3D: learning 3D scene structure from a single still image. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 824–840 (2009)CrossRef Saxena, A., Sun, M., Ng, A.: Make3D: learning 3D scene structure from a single still image. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 824–840 (2009)CrossRef
19.
Zurück zum Zitat Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: Proceedings of the International Conference on Computer Vision Workshops, pp. 601–608 (2011) Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: Proceedings of the International Conference on Computer Vision Workshops, pp. 601–608 (2011)
20.
Zurück zum Zitat Subbarao, M., Surya, G.: Depth from defocus: a spatial domain approach. Int. J. Comput. Vis. 13(3), 271–294 (1994)CrossRef Subbarao, M., Surya, G.: Depth from defocus: a spatial domain approach. Int. J. Comput. Vis. 13(3), 271–294 (1994)CrossRef
22.
Zurück zum Zitat Szeliski, R., Torr, P.H.S.: Geometrically constrained structure from motion: points on planes. In: Proceedings of the European Workshop 3D Structure Multiple Images Large-Scale Environment, pp. 171–186 (1998) Szeliski, R., Torr, P.H.S.: Geometrically constrained structure from motion: points on planes. In: Proceedings of the European Workshop 3D Structure Multiple Images Large-Scale Environment, pp. 171–186 (1998)
23.
Zurück zum Zitat Torralba, A., Fergus, R., Freeman, W.T.: 80 million tiny images: a large data set for nonparametric object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1958–1970 (2008)CrossRef Torralba, A., Fergus, R., Freeman, W.T.: 80 million tiny images: a large data set for nonparametric object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1958–1970 (2008)CrossRef
24.
Zurück zum Zitat Tsai, S.F., Cheng, C.C., Li, C.T., Chen, L.G.: A real-time 1080p 2D-to-3D video conversion system. IEEE Trans. Consum. Electron. 57(2), 915–922 (2011)CrossRef Tsai, S.F., Cheng, C.C., Li, C.T., Chen, L.G.: A real-time 1080p 2D-to-3D video conversion system. IEEE Trans. Consum. Electron. 57(2), 915–922 (2011)CrossRef
25.
Zurück zum Zitat Wang, M., Konrad, J., Ishwar, P., Jing, K., Rowley, H.: Image saliency: from intrinsic to extrinsic context. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 417–424 (2011) Wang, M., Konrad, J., Ishwar, P., Jing, K., Rowley, H.: Image saliency: from intrinsic to extrinsic context. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 417–424 (2011)
26.
Zurück zum Zitat Yao, L., Sujit, D.: JAVRE: a joint asymmetric video rendering and encoding approach to enable optimized cloud mobile 3D virtual immersive user experience. IEEE J. Emerg. Select. Topic Circ, Syst (2016) Yao, L., Sujit, D.: JAVRE: a joint asymmetric video rendering and encoding approach to enable optimized cloud mobile 3D virtual immersive user experience. IEEE J. Emerg. Select. Topic Circ, Syst (2016)
27.
Zurück zum Zitat Yoo, T., Lee, G., Jung, K., Hong, Y.P., Lee, S.: A study of row-direction reconstruction algorithm in depth map. Cluster Comput. 18(2), 721–731 (2015)CrossRef Yoo, T., Lee, G., Jung, K., Hong, Y.P., Lee, S.: A study of row-direction reconstruction algorithm in depth map. Cluster Comput. 18(2), 721–731 (2015)CrossRef
28.
Zurück zum Zitat Zhang, R., Tsai, P.S., Cryer, J., Shah, M.: Shape-from-shading: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 21(8), 690–706 (1999)CrossRef Zhang, R., Tsai, P.S., Cryer, J., Shah, M.: Shape-from-shading: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 21(8), 690–706 (1999)CrossRef
Metadaten
Titel
An evaluation framework for auto-conversion of 2D to 3D video streaming using depth profile and pipelining technique in handheld cellular devices
verfasst von
P. S. Ramesh
S. Letitia
Publikationsdatum
09.01.2018
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe Sonderheft 5/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-1470-7

Weitere Artikel der Sonderheft 5/2019

Cluster Computing 5/2019 Zur Ausgabe