Top

Cluster Computing

Published in:

01-06-2016

Photo quality enhancement by relocating subjects

Authors: Kyuman Jeong, Han-Jin Cho

Published in: Cluster Computing | Issue 2/2016

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Photo quality enhancement by photographic evaluation is a challenging problem in photography. In this paper, a new photo quality enhancement algorithm for photographic recomposition based on subject relocation is presented. Most related research focuses on image size alteration, or cropping, while the proposed algorithm in this paper is extending existing ones by relocating foreground object to meet one of the composition rules. The contribution of this paper is to overcome the problem of existing algorithms which cannot place the main object according to photographers’ intentions. In detail, the presented algorithm is consist of three parts: image matting, region filling and image recomposition. Image matting is used to extract foreground object from background image. The region where foreground object is separated must be filled naturally without any seams or artifacts by the aid of region filling algorithm. Finally, the foreground object can be relocated to a proper location with a better composition score. Experimental results will prove the excellence of the presented algorithm. The presented method can be embedded on commercial cameras, so the authors expect that it can be applied in the near future.

previous article Evaluation of image reconstruction according to changing physical parameter

next article Implementation of smartphone-based color temperature and wavelength control LED lighting system

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2014)CrossRef

Kim, S.-H., Jeong, Y.-S.: Mobile image sensors for object detection using color segmentation. cluster Comput. 16(4), 757–763 (2013)CrossRef

Balafoutis, E., Panagakis, A., Laoutaris, N., Stavrakakis, I.: Study of the impact of replacement granularity and associated strategies on video caching. Cluster Comput. 8(1), 89–100 (2005)CrossRefMATH

Zhang, S., McCullagh, P., Zhang, J., Yu, T.: A smartphone based real-time daily activity monitoring system. Cluster Comput. 17(3), 711–721 (2014)CrossRef

Park, R.C., Jung, H., Shin, D.-K., Kim, G.-J., Yoon, K.-H.: M2M-based smart health service for human UI/UX using motion recognition. Cluster Comput. 18(1), 221–232 (2015)CrossRef

Wang, J., Cohen, M.F.: Image and video matting: a survey. Found. Trends Comput. Graph. Vis. 3(2), 97–180 (2007)CrossRef

Bai, X., Sapiro, G.: A geodesic framework for fast interactive image and video segmentation and matting. Int. J. Comput. Vis. 82(2), 1–8 (2009)CrossRef

Protiere, A., Sapiro, G.: Interactive image segmentation via adaptive weighted distances. IEEE Trans. Image Process. 16, 1046–1057 (2007)CrossRefMathSciNet

Wang, J., Cohen, M.F.: An iterative optimization approach for unified image segmentation and matting. Proc. IEEE ICCV 2005, 936–943 (2005)

10.

Yatziv, L., Sapiro, G.: Fast image and video colorization using chrominance blending. IEEE Trans. Image Process. 15(5), 1120–1129 (2006)CrossRef

11.

Lee, T.-H., Hwang, B.-H., Yun, J.-H., Choi, M.-R.: A road region extraction using openCV CUDA to advance the processing speed. J. Digital Converg. 12(6), 231–236 (2014)CrossRef

12.

Kang, S.-K., Lee, J.-H.: Real-time head tracking using adaptive boosting in surveillance. J. Digital Converg. 11(2), 243–248 (2013)

13.

Kang, S.-K., Choi, K.-H., Chung, K.-Y., Lee, J.-H.: Object detection and tracking using bayesian classifier in surveillance. J. Digital Converg. 10(6), 297–302 (2012)

14.

Wang, J.Z., Li, J., Gray, R.M., Wiederhold, G.: Unsupervised multiresolution segmentation for images with low depth of field. In: IEEE Trans. on Pattern Analysis and Machine Intel., Vol. 23, pp. 85–90 (2001)

15.

Beauchemin, S.S., Barron, J.L.: The computation of optical flow. ACM Comput. Surv. 27(3), 433–466 (1995)CrossRef

16.

Weber, J., Malik, J.: Robust computation of optical-flow in a multiscale differential framework. Int. J. Comput. Vis. 14(1), 67–81 (1995)CrossRef

17.

Haussecker, H., Fleet, D.J.: Estimating optical flow with physical models of brightness variation. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 661–673 (2001)CrossRef

18.

Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous structure and texture image inpainting. In: Proceedings of Computer Vision Pattern Recognition (2003)

19.

Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proceedings of ACM SIGGRAPH, pp. 417–424 (2000)

20.

Chan, T.F., Shen, J.: Non-texture inpainting by curvature-driven diffusions (CDD). J. Vis. Commun. Image Represent. 4(12), 436–449 (2001)CrossRef

21.

De Bonet, J.S.: Multiresolution sampling procedure for analysis and synthesis of texture images. In: Proceedings of ACM SIGGRAPH, pp. 361–368 (1997)

22.

Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Proceedings of International Conference on Computer Vision, pp. 1033–1038 (1999)

23.

Paget, R., Longstaff, I.: Texture synthesis via a noncausal nonparametric multiscale markov random field. IEEE Trans. Image Process. 7(6), 925–931 (1998)CrossRef

24.

Igehy, H., Pereira, L.: Image replacement through texture synthesis. In: Proceedings of International Conference on Image Processing, pp. 186–189 (1997)

25.

London, B., Upton, J., Kobre, K., Brill, B.: Photography, 8th edn. Prentice Hall, New Jersey (2004)

26.

Jeong, K., Cho, H.J.: Digital panning shot generator from photographs. Cluster Comput. 18(2), 667–676 (2015)CrossRef

27.

Jeong, K., Cho, H.-J.: A digitalized recomposition technique based on photo quality evaluation criteria. Wireless Personal Commun. (2015) (Accepted for publication)

28.

Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., Toyama, K.: Digital photography with flash and no-flash image pairs. ACM Trans. Graph. 23(3), 664–672 (2004)CrossRef

29.

Raskar, R., Tan, K., Feris, R., Yu, J., Turk, M.: Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging. ACM Trans. Graph. 23(3), 679–688 (2004)CrossRef

30.

Masselus, V., Peers, P., Dutré, P., Willems, Y.D.: Relighting with 4D incident light fields. ACM Trans. Graph. 22(3), 613–620 (2003)CrossRef

31.

Matusik, W., Loper, M., Pfister, H.: Progressively-refined reflectance functions from natural illumination. In: Eurographics Symposium on Rendering, pp. 299–308 (2004)

32.

Sajadi, B., Majumder, A., Hiwada, K., Maki, A., Raskar, R.: Switchable primaries using shiftable layers of color filter arrays. ACM Trans. Graph. 30, 65 (2011)CrossRef

33.

Banerjee, S., Evans, B.L.: Unsupervised automation of photographic composition rules in digital still cameras. In: Proc. SPIE Conf. Sensors, Color, Cameras, and Syst. for Digital Photography VI, pp. 364–373 (2004)

34.

Banerjee, S., Evans, B.L.: Unsupervised merger detection and mitigation in still images using frequency and color content analysis. In: Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., pp. 549–552 (2004)

35.

Banerjee, S., Evans, B.L.: In-camera automation of photographic composition rules. IEEE Trans. Image Process. 16(7), 1807–1820 (2007)CrossRefMathSciNet

36.

Santella, A., Agrawala, M., DeCarlo, D., Salesin, D.H., Cohen, M.F.: Gaze-based interaction for semi-automatic photo cropping. ACM Human Factors in Computing Systems (CHI), pp. 771–780 (2006)

37.

Chen, L., Xie, X., Fan, X., Ma, W., Zhang, H., Zhou, H.: A visual attention model for adapting images on small displays. Multimedia Syst. 9(4), 353–364 (2003)CrossRef

38.

Suh, B., Ling, H., Bederson, B.B., Jacobs, D.W.: Automatic thumbnail cropping and its effectiveness. CHI Lett. 5(2), 95–104 (2003)

39.

Jeong, K.: Paradigm shift of camera: part I. computational photography. J. Korea Comput. Graph. Soc. 15(4), 23–30 (2009)CrossRef

40.

Raskar, R., Tumblin, J., Levoy, M., Nayer, S.: SIGGRAPH 2006 course notes on computational photography. SIGGRAPH (2006)

41.

Yuan, L., Sun, J., Quan, L., Shum, H.Y.: Image deblurring with blurred/noisy image Pairs. ACM Trans. Graph. 26(3), 1 (2007)CrossRef

42.

Eisemann, E., Durand, F.: Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23(3), 673–678 (2004)CrossRef

43.

Bando, Y., Chen, B., Nishita, T.: Extracting depth and matte using a color-filtered aperture. ACM Trans. Graph. 27(5), 134 (2008)CrossRef

44.

Cossairt, O., Zhou, C., Nayar, S.: Diffusion coded photography for extended depth of field. ACM Trans. Graph. 29(4), 31 (2010)CrossRef

45.

Levin, A., Fergus, R., Durand, F., Freeman, B.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26(3), 70 (2007)CrossRef

46.

Jeong, K., Kim, D., Park, S.-Y., Lee, S.: Digital shallow depth-of-field adapter for photographs. Visual Comput. 24(4), 281–294 (2008)CrossRef

47.

Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 1–10 (2008)CrossRef

48.

Fergus, R., Singh, B., Hertzmann, A., Roweis, S., Freeman, W.: Removing camera shake from a single image. ACM Trans. Graph. 24(3), 787–794 (2006)CrossRefMATH

49.

Cho, S., Matsushita, Y., Lee, S.: Removing non-uniform motion blur from images. In: IEEE International Conference on Computer Vision, pp. 1–8 (2007)

50.

Talvala, E., Adams, A., Horowitz, M., Levoy, M.: Veiling glare in high dynamic range imaging. ACM Trans. Graph. 26(3), 37 (2007)CrossRef

51.

Debevec, P., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Proceedings of ACM SIGGRAPH, pp. 369–378 (1997)

52.

Shan, Q., Li, Z., Jia, J., Tang, C.: Fast image/video upsampling. ACM Trans. Graph. 27(5), 153 (2008)CrossRef

53.

Sun, J., Xu, Z., Shum, H.: Image super-resolution using gradient profile prior. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

54.

Freeman, G., Fattal, R.: Image and video upscaling from local self-examples. ACM Trans. Graph. 28(3), 1–10 (2010)

55.

Kopf, J., Uyttendaele, M., Deussen, O., Cohen, M.: Capturing and viewing gigapixel images. ACM Trans. Graph. 26(3), 93 (2007)CrossRef

56.

Kopf, J., Cohen, M., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. ACM Trans. Graph. 26(3), 96 (2007)CrossRef

57.

Wang, Y., Hsiao, J., Sorkine, O., Lee, T.: Scalable and coherent video resizing with per-frame optimization. ACM Trans. Graph. 30(3), 88 (2011)

58.

Wang, Y., Lin, H., Sorkine, O., Lee, T.: Motion-based video retargeting with optimized crop-and-warp. ACM Trans. Graph. 29(3), 90 (2010)

59.

Rubinsteing, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. ACM Trans. Graph. 27(3), 16 (2008)

60.

Zheng, Y., Kambhamettu, C., Yu, J., Bauer, T., Steiner, K.: FuzzyMatte: a computationally efficient scheme for interactive matting. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

61.

Wang, J., Agrawala, M., Cohen, M.: Soft scissors : an interactive tool for realtime high quality matting. ACM Trans. Graph. 25(3), 9 (2008)

62.

McGuire, M., Matusik, W., Pfister, H., Hughes, J., Durand, F.: Defocus video matting. ACM Trans. Graph. 24(3), 567–576 (2005)CrossRef

63.

Gooch, A.A., Olsen, S.C., Tumblin, J., Gooch, B.: Color2Gray: salience-preserving color removal. ACM Trans. Graph. 24(3), 1–6 (2005)CrossRef

64.

Kim, Y., Jang, C., Demouth, J., Lee, S.: Robust color-to-gray via nonlinear global mapping. ACM Trans. Graph. 28(5), 161 (2009)

65.

Grundland, M., Dodgson, N.A.: Decolorize: fast, contrast enhancing, color to grayscale conversion. Proc. IEEE Conf. Comput. Vision Pattern Recognit. 40(11), 2891–2896 (2007)CrossRef

66.

Smith, K., Landes, P., Thollot, J., Myszkowski, K.: Apparent greyscale: a simple and fast conversion to perceptually accurate images and video. Comput. Graph. Forum 27(2), 193–200 (2008)CrossRef

67.

Tang, H., Joshi, N., Kapoor, A.: Learning a blind measure of perceptual image quality. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 305–312 (2011)

68.

Lee, Y.-H., Cho, H.-J., Lee, J.-H.: Image retrieval using multiple features on mobile platform. J. Digital Converg. 12(2), 243–243 (2014)CrossRefMathSciNet

Title: Photo quality enhancement by relocating subjects
Authors: Kyuman Jeong
Han-Jin Cho
Publication date: 01-06-2016
Publisher: Springer US
Published in: Cluster Computing / Issue 2/2016
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI: https://doi.org/10.1007/s10586-016-0547-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 2/2016

Scheduling data analytics work with performance guarantees: queuing and machine learning models in synergy

A replicas placement approach of component services for service-based cloud application

Teachers’ views on the use of robots and cloud services in education for sustainable development

Idempotent distributed counters using a forgetful bloom filter

Implementation of smartphone-based color temperature and wavelength control LED lighting system

A fast approach to identify trending articles in hot topics from XML based big bibliographic datasets

Premium Partner