Top

Published in:

2019 | OriginalPaper | Chapter

Instant Rephotography

Authors : Juliano Franz, Anderson Maciel, Luciana Nedel

Published in: Human-Computer Interaction – INTERACT 2019

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

When traveling, a very common issue is to ask for the help of a stranger to take a photo on a touristic spot. Indeed, often the results of this short collaboration are not as previously imagined. In this paper, we introduce the concept of instant rephotography, a technique based on a simple and intuitive user interface, and in an efficient and low cost algorithm that finds the matching between two images. The user interface guides the photographer to position the camera in the right place that was once imagined by the camera owner, automatically taking the new photo. To correctly choose the new photo, we propose an algorithm based on ORB (Oriented FAST and Rotated BRIEF) feature points acquired from the reference and current photos, and on inertial sensors embedded in the photo device, a smartphone. To validate the concepts introduced, we implemented an Android App called Smart-Tourist Camera, conceived to help tourists to take good pictures during travels. Three different user studies involving 124 volunteers were conducted and results have shown that the photographs taken with the application are perceived as better than otherwise, and that users would use the App during their travels.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Design Challenges for Mobile and Wearable Systems to Support Learning on-the-move at Outdoor Cultural Heritage Sites

next chapter Personal Digital Signage for Shared Spaces

Adams, A., et al.: The frankencamera: an experimental platform for computational photography. In: ACM SIGGRAPH 2010 Papers, SIGGRAPH 2010, pp. 29:1–29:12. ACM, New York (2010). http://doi.acm.org/10.1145/1833349.1778766

Bae, S., Agarwala, A., Durand, F.: Computational rephotography. ACM Trans. Graph. 29(3), 24:1–24:15 (2010). https://doi.org/10.1145/1805964.1805968CrossRef

Balata, J., Mikovec, Z., Neoproud, L.: BlindCamera: central and golden-ratio composition for blind photographers. In: Proceedings of the Multimedia, Interaction, Design and Innovation, pp. 8:1–8:8 (2015). http://doi.acm.org/10.1145/2814464.2814472

Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008). https://doi.org/10.1016/j.cviu.2007.09.014CrossRef

Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: binary robust independent elementary features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15561-1_56. http://dl.acm.org/citation.cfm?id=1888089.1888148CrossRef

Ercan, A., Erdem, A.: On sensor fusion for head tracking in augmented reality applications. In: American Control Conference (ACC) 2011, pp. 1286–1291, June 2011

Hol, J.D., Schzön, T.B., Gustafsson, F., Slycke, P.J.: Sensor fusion for augmented reality. In: FUSION, pp. 1–6. IEEE (2006)

Jarusriboonchai, P., Olsson, T., Lyckvi, S.L., Väänänen, K.: Let’s take photos together: exploring asymmetrical interaction abilities on mobile camera phones. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI 2016, pp. 529–540 (2016). http://dl.acm.org/citation.cfm?doid=2935334.2935385

Joshi, N., Kang, S.B., Zitnick, C.L., Szeliski, R.: Image deblurring using inertial measurement sensors. In: ACM SIGGRAPH 2010 Papers, SIGGRAPH 10, pp. 30:1–30:9. ACM, New York (2010). http://doi.acm.org/10.1145/1833349.1778767

10.

Lee, K.T., Luo, S.J., Chen, B.Y.: Rephotography using image collections. Comput. Graph. Forum (2011). https://doi.org/10.1111/j.1467-8659.2011.02042.xCrossRef

11.

Levoy, M.: Experimental platforms for computational photography. IEEE Comput. Graph. Appl. 30(5), 81–87 (2010)CrossRef

12.

Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the International Conference on Computer Vision, ICCV 1999, vol. 2, p. 1150. IEEE Computer Society, Washington (1999). http://dl.acm.org/citation.cfm?id=850924.851523

13.

McNulty, E.: Boston Then and Now. Thunder Bay Press, San Diego (2002)

14.

Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005). https://doi.org/10.1109/TPAMI.2005.188CrossRef

15.

Ni, B., Xu, M., Cheng, B., Wang, M., Yan, S., Tian, Q.: Learning to photograph: a compositional perspective. IEEE Trans. Multimed. 15(5), 1138–1151 (2013). https://doi.org/10.1109/TMM.2013.2241042CrossRef

16.

Rawat, Y.S., Kankanhalli, M.S.: Context-aware photography learning for smart mobile devices. ACM Trans. Multimed. Comput. Commun. Appl. 12(1s), 1–24 (2015). https://doi.org/10.1145/2808199CrossRef

17.

Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 430–443. Springer, Heidelberg (2006). https://doi.org/10.1007/11744023_34CrossRef

18.

Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: Proceedings of the 2011 International Conference on Computer Vision, ICCV 2011, pp. 2564–2571. IEEE Computer Society, Washington (2011). https://doi.org/10.1109/ICCV.2011.6126544

19.

Shingu, J., Rieffel, E., Kimber, D., Vaughan, J., Qvarfordt, P., Tuite, K.: Camera pose navigation using augmented reality. In: 2010 9th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 271–272. IEEE (2010)

20.

Vazquez, M., Steinfeld, A.: An assisted photography method for street scenes. In: Proceedings of the 2011 IEEE Workshop on Applications of Computer Vision (WACV), WACV 2011, pp. 89–94. IEEE Computer Society, Washington (2011). https://doi.org/10.1109/WACV.2011.5711488

21.

Wang, Y., et al.: Where2Stand. ACM Trans. Intell. Syst. Technol. 7(1), 1–22 (2015). https://doi.org/10.1145/2770879MathSciNetCrossRef

22.

Wen, J., Ünlüer, A.: Redefining the fundamentals of photography with cooperative photography (Mum), pp. 37–47 (2015). https://doi.org/10.1145/2836041.2836045

23.

Woodman, O.J.: An introduction to inertial navigation. Technical report UCAM-CL-TR-696, University of Cambridge, Computer Laboratory, August 2007. http://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-696.pdf

24.

Yang, X., Cheng, K.T.T.: Accelerating SURF detector on mobile devices. In: Proceedings of the 20th ACM International Conference on Multimedia, MM 2012, pp. 569–578. ACM, New York (2012). http://doi.acm.org/10.1145/2393347.2393427

Title: Instant Rephotography
Authors: Juliano Franz
Anderson Maciel
Luciana Nedel
Publisher: Springer International Publishing
Book: Human-Computer Interaction – INTERACT 2019
Print ISBN: 978-3-030-29386-4

Electronic ISBN: 978-3-030-29387-1

Copyright Year: 2019
DOI: https://doi.org/10.1007/978-3-030-29387-1_12

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"