Skip to main content
Top
Published in: Cluster Computing 5/2019

09-01-2018

An evaluation framework for auto-conversion of 2D to 3D video streaming using depth profile and pipelining technique in handheld cellular devices

Authors: P. S. Ramesh, S. Letitia

Published in: Cluster Computing | Special Issue 5/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The main objective of this paper is to propose a Reliable and Speedy Communication for Upstream Emergency (RESCUE) framework to create 3D remote sensing videos. The proposed framework uses low memory space on mobile devices with the help of efficient pipelining processes. Many methods for converting 2D videos to 3D have been proposed wherein developers convert high-quality 2D to 3D. We propose a method to apply the pre-classification process on either training on dataset or heuristics based on the quality of streaming attributes. The evaluation framework automatically changes remote sensing videos from 2D to 3D by using depth profile with method filter, segmentation and sharpening transformation of the videos. The traditional Hough transformation algorithm is not suitable for hardware implementation and saliency is based on the colour histogram to support slow motion object of frames which leads to inordinate delay in converting 2D to 3D. Therefore, the RESCUE framework, with its extended vanishing point and line algorithm, is applied to provide suitable solutions and overcome the drawbacks of existing techniques. The framework is a lightweight process when compared with JAVRAE, and it utilizes limited phone memory and consumes less processing time.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Angot, L., Huang, W.-J., Liu, K.-C.: A 2D to 3D video and image conversion technique based on a bilateral filter. Proc. SPIE 7526, 75260D (2004) Angot, L., Huang, W.-J., Liu, K.-C.: A 2D to 3D video and image conversion technique based on a bilateral filter. Proc. SPIE 7526, 75260D (2004)
2.
go back to reference Baek, N., Kim, K.J.: An artifact detection scheme with CUDA-based image operations. Cluster Comput. 20(1), 749–755 (2017)MathSciNetCrossRef Baek, N., Kim, K.J.: An artifact detection scheme with CUDA-based image operations. Cluster Comput. 20(1), 749–755 (2017)MathSciNetCrossRef
4.
go back to reference Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Proceedings of the European Conference on Computer Vision, pp. 25–36 (2004) Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Proceedings of the European Conference on Computer Vision, pp. 25–36 (2004)
5.
go back to reference Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005)
6.
go back to reference Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 257–266 (2002) Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 257–266 (2002)
7.
go back to reference Grundmann, M., Kwatra, V., Essa, I.: Auto-directed video stabilization with robust L1 optimal camera paths. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 225–232 (2011) Grundmann, M., Kwatra, V., Essa, I.: Auto-directed video stabilization with robust L1 optimal camera paths. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 225–232 (2011)
8.
go back to reference Guttmann, M., Wolf, L., Cohen-Or, D.: Semi-automatic stereo extraction from video footage. In: IEEE International Conference on Computer Vision, pp. 136–142 (2009) Guttmann, M., Wolf, L., Cohen-Or, D.: Semi-automatic stereo extraction from video footage. In: IEEE International Conference on Computer Vision, pp. 136–142 (2009)
9.
go back to reference Karsch, K., Liu, C., Kang, S.B.: Depth extraction from video using non-parametric sampling. In: Proceedings of the European Conference on Computer Vision, pp. 775–788 (2012) Karsch, K., Liu, C., Kang, S.B.: Depth extraction from video using non-parametric sampling. In: Proceedings of the European Conference on Computer Vision, pp. 775–788 (2012)
10.
go back to reference Khamis, H.S., Cheruiyot, K.W., Kimani, S.: Application of k-nearest neighbour classification in medical data mining. Int. J. Inf. Commun. Technol. Res. 4(4), 121–128 (2014) Khamis, H.S., Cheruiyot, K.W., Kimani, S.: Application of k-nearest neighbour classification in medical data mining. Int. J. Inf. Commun. Technol. Res. 4(4), 121–128 (2014)
11.
go back to reference Konrad, J., Wang, M., Ishwar, P.: 2D-to-3D image conversion by learning depth from examples. In: Proceedings of the IEEE Computer Society Conference on CVPRW, pp. 16–22 (2012) Konrad, J., Wang, M., Ishwar, P.: 2D-to-3D image conversion by learning depth from examples. In: Proceedings of the IEEE Computer Society Conference on CVPRW, pp. 16–22 (2012)
12.
go back to reference Konrad, J., Brown, G., Wang, M., Ishwar, P., Wu, C., Mukherjee, D.: Automatic 2D-to-3D image conversion using 3D examples from the Internet. Proc. SPIE 8288, 82880F (2012)CrossRef Konrad, J., Brown, G., Wang, M., Ishwar, P., Wu, C., Mukherjee, D.: Automatic 2D-to-3D image conversion using 3D examples from the Internet. Proc. SPIE 8288, 82880F (2012)CrossRef
13.
go back to reference Liao, M., Gao, J., Yang, R., Gong, M.: Video stereolization: combining motion analysis with user interaction. IEEE Trans. Visualizat. Comput. Graph. 18(7), 1079–1088 (2012)CrossRef Liao, M., Gao, J., Yang, R., Gong, M.: Video stereolization: combining motion analysis with user interaction. IEEE Trans. Visualizat. Comput. Graph. 18(7), 1079–1088 (2012)CrossRef
14.
go back to reference Liu, B., Gould, S., Koller, D.: Single image depth estimation from predicted semantic abels. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 1253–1260 (2010) Liu, B., Gould, S., Koller, D.: Single image depth estimation from predicted semantic abels. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 1253–1260 (2010)
15.
go back to reference Phan, R., Rzeszutek, R., Androutsos, D.: Semi-automatic 2D to 3D image conversion using scale-space random walks and a graph cuts based depth prior. In: Proceedings of the 18th IEEE International Conference on Image Processing, pp. 865–868 (2011) Phan, R., Rzeszutek, R., Androutsos, D.: Semi-automatic 2D to 3D image conversion using scale-space random walks and a graph cuts based depth prior. In: Proceedings of the 18th IEEE International Conference on Image Processing, pp. 865–868 (2011)
17.
go back to reference Saxena, A., Chung, S.H., Ng, A.Y.: Learning depth from single monocular images. In: Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press (2005) Saxena, A., Chung, S.H., Ng, A.Y.: Learning depth from single monocular images. In: Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press (2005)
18.
go back to reference Saxena, A., Sun, M., Ng, A.: Make3D: learning 3D scene structure from a single still image. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 824–840 (2009)CrossRef Saxena, A., Sun, M., Ng, A.: Make3D: learning 3D scene structure from a single still image. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 824–840 (2009)CrossRef
19.
go back to reference Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: Proceedings of the International Conference on Computer Vision Workshops, pp. 601–608 (2011) Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: Proceedings of the International Conference on Computer Vision Workshops, pp. 601–608 (2011)
20.
go back to reference Subbarao, M., Surya, G.: Depth from defocus: a spatial domain approach. Int. J. Comput. Vis. 13(3), 271–294 (1994)CrossRef Subbarao, M., Surya, G.: Depth from defocus: a spatial domain approach. Int. J. Comput. Vis. 13(3), 271–294 (1994)CrossRef
22.
go back to reference Szeliski, R., Torr, P.H.S.: Geometrically constrained structure from motion: points on planes. In: Proceedings of the European Workshop 3D Structure Multiple Images Large-Scale Environment, pp. 171–186 (1998) Szeliski, R., Torr, P.H.S.: Geometrically constrained structure from motion: points on planes. In: Proceedings of the European Workshop 3D Structure Multiple Images Large-Scale Environment, pp. 171–186 (1998)
23.
go back to reference Torralba, A., Fergus, R., Freeman, W.T.: 80 million tiny images: a large data set for nonparametric object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1958–1970 (2008)CrossRef Torralba, A., Fergus, R., Freeman, W.T.: 80 million tiny images: a large data set for nonparametric object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1958–1970 (2008)CrossRef
24.
go back to reference Tsai, S.F., Cheng, C.C., Li, C.T., Chen, L.G.: A real-time 1080p 2D-to-3D video conversion system. IEEE Trans. Consum. Electron. 57(2), 915–922 (2011)CrossRef Tsai, S.F., Cheng, C.C., Li, C.T., Chen, L.G.: A real-time 1080p 2D-to-3D video conversion system. IEEE Trans. Consum. Electron. 57(2), 915–922 (2011)CrossRef
25.
go back to reference Wang, M., Konrad, J., Ishwar, P., Jing, K., Rowley, H.: Image saliency: from intrinsic to extrinsic context. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 417–424 (2011) Wang, M., Konrad, J., Ishwar, P., Jing, K., Rowley, H.: Image saliency: from intrinsic to extrinsic context. In: Proceedings of the European Conference on Computer Vision and Pattern Recognition, pp. 417–424 (2011)
26.
go back to reference Yao, L., Sujit, D.: JAVRE: a joint asymmetric video rendering and encoding approach to enable optimized cloud mobile 3D virtual immersive user experience. IEEE J. Emerg. Select. Topic Circ, Syst (2016) Yao, L., Sujit, D.: JAVRE: a joint asymmetric video rendering and encoding approach to enable optimized cloud mobile 3D virtual immersive user experience. IEEE J. Emerg. Select. Topic Circ, Syst (2016)
27.
go back to reference Yoo, T., Lee, G., Jung, K., Hong, Y.P., Lee, S.: A study of row-direction reconstruction algorithm in depth map. Cluster Comput. 18(2), 721–731 (2015)CrossRef Yoo, T., Lee, G., Jung, K., Hong, Y.P., Lee, S.: A study of row-direction reconstruction algorithm in depth map. Cluster Comput. 18(2), 721–731 (2015)CrossRef
28.
go back to reference Zhang, R., Tsai, P.S., Cryer, J., Shah, M.: Shape-from-shading: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 21(8), 690–706 (1999)CrossRef Zhang, R., Tsai, P.S., Cryer, J., Shah, M.: Shape-from-shading: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 21(8), 690–706 (1999)CrossRef
Metadata
Title
An evaluation framework for auto-conversion of 2D to 3D video streaming using depth profile and pipelining technique in handheld cellular devices
Authors
P. S. Ramesh
S. Letitia
Publication date
09-01-2018
Publisher
Springer US
Published in
Cluster Computing / Issue Special Issue 5/2019
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-1470-7

Other articles of this Special Issue 5/2019

Cluster Computing 5/2019 Go to the issue

Premium Partner