Skip to main content
Top

2018 | OriginalPaper | Chapter

Lucida: Enhancing the Creation of Photography Through Semantic, Sympathetic, Augmented, Voice Agent Interaction

Authors : Brad Wrobleski, Alexander Ivanov, Eric Eidelberg, Katayoon Etemad, Denis Gadbois, Christian Jacob

Published in: Human-Computer Interaction. Interaction Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present a dynamic framework for the integration of Machine Learning (ML), Augmented Reality (AR), Affective Computing (AC), Natural Language Processing (NLP) and Computer Vision (CV) to make possible, the development of a mobile, sympathetic, ambient (virtual), augmented intelligence (Agent). For this study we developed a prototype agent to assist photographers to enhance the learning and creation of photography. Learning the art of photography is complicated by the technical complexity of the camera, the limitations of the user to see photographically and the lack of real time instruction and emotive support. The study looked at the interaction patterns between human student and instructor, the disparity between human vision and the camera, and the potential of an ambient agent to assist students in learning. The study measured the efficacy of the agent and its ability to transmute human-to-Human method of instruction to human-to-Agent interaction. This study illuminates the effectiveness of Agent based instruction. We demonstrate that a mobile, semantic, sympathetic, augmented intelligence, ambient agent can ameliorate learning photography metering in real time, ‘on location’. We show that the integration of specific technologies and design produces an effective architecture for the creation of augmented agent-based instruction.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Adams, A.: The Camera. The New Ansel Adams Photography Series. New York Graphic Society, Boston (1980) Adams, A.: The Camera. The New Ansel Adams Photography Series. New York Graphic Society, Boston (1980)
3.
go back to reference Albrecht, U.V., Folta-Schoofs, K., Behrends, M., Von Jan, U.: Effects of mobile augmented reality learning compared to textbook learning on medical students: randomized controlled pilot study. J. Med. Internet Res. 15(8), e182 (2013)CrossRef Albrecht, U.V., Folta-Schoofs, K., Behrends, M., Von Jan, U.: Effects of mobile augmented reality learning compared to textbook learning on medical students: randomized controlled pilot study. J. Med. Internet Res. 15(8), e182 (2013)CrossRef
6.
go back to reference Ekman, P.: What scientists who study emotion agree about. Perspect. Psychol. Sci. 11(1), 31–34 (2016)CrossRef Ekman, P.: What scientists who study emotion agree about. Perspect. Psychol. Sci. 11(1), 31–34 (2016)CrossRef
7.
go back to reference Freeman, M., et al.: The DSLR Field Guide. CRC Press, ‎Boca Raton (2013) Freeman, M., et al.: The DSLR Field Guide. CRC Press, ‎Boca Raton (2013)
8.
go back to reference Goodfellow, I., Bengio, Y., Courville, A., Bengio, Y.: Deep Learning, vol. 1. MIT Press, Cambridge (2016)MATH Goodfellow, I., Bengio, Y., Courville, A., Bengio, Y.: Deep Learning, vol. 1. MIT Press, Cambridge (2016)MATH
9.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep con- volutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep con- volutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
11.
go back to reference Magdin, M., Prikler, F., Hamzaoui, Y., Amnai, M., Choukri, A., Fakhri, Y., Sam-durkar, A.S., Kamble, S.D., Thakur, N.V., Patharkar, A.S., et al.: Real time facial expression recognition using webcam and SDK affectiva. Int. J. Interact. Multimed. Artif. Intell. 4 (2018, in press) Magdin, M., Prikler, F., Hamzaoui, Y., Amnai, M., Choukri, A., Fakhri, Y., Sam-durkar, A.S., Kamble, S.D., Thakur, N.V., Patharkar, A.S., et al.: Real time facial expression recognition using webcam and SDK affectiva. Int. J. Interact. Multimed. Artif. Intell. 4 (2018, in press)
12.
go back to reference McCann, J.J., Rizzi, A.: The Ansel Adams zone system. In: The Art and Science of HDR Imaging, pp. 59–68 (2011) McCann, J.J., Rizzi, A.: The Ansel Adams zone system. In: The Art and Science of HDR Imaging, pp. 59–68 (2011)
13.
go back to reference McDuff, D., El Kaliouby, R., Senechal, T., Amr, M., Cohn, J.F., Picard, R.: Affectiva-mit facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected “in-the-wild”. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 881–888. IEEE (2013) McDuff, D., El Kaliouby, R., Senechal, T., Amr, M., Cohn, J.F., Picard, R.: Affectiva-mit facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected “in-the-wild”. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 881–888. IEEE (2013)
18.
go back to reference Russell, J.A., Fernández-Dols, J.M.: The Psychology of Facial Expression. Cambridge University Press, New York (1997)CrossRef Russell, J.A., Fernández-Dols, J.M.: The Psychology of Facial Expression. Cambridge University Press, New York (1997)CrossRef
19.
go back to reference Shevat, A.: Designing Bots: Creating Conversational Experiences. O’Reilly Media Inc., Sebastopol (2017) Shevat, A.: Designing Bots: Creating Conversational Experiences. O’Reilly Media Inc., Sebastopol (2017)
20.
go back to reference Skorka, O., Joseph, D.: Toward a digital camera to rival the human eye. J. Electron. Imaging 20(3), 033009-1–033009-18 (2011)CrossRef Skorka, O., Joseph, D.: Toward a digital camera to rival the human eye. J. Electron. Imaging 20(3), 033009-1–033009-18 (2011)CrossRef
22.
go back to reference Tzanavari, A.: Affective, interactive and cognitive methods for e-learning design: creating an optimal education experience. IGI Global, Hershey (2010)CrossRef Tzanavari, A.: Affective, interactive and cognitive methods for e-learning design: creating an optimal education experience. IGI Global, Hershey (2010)CrossRef
25.
go back to reference Yan, Z., Zhang, H., Wang, B., Paris, S., Yu, Y.: Automatic photo adjustment using deep neural networks. ACM Trans. Graph. (TOG) 35(2), 11 (2016)CrossRef Yan, Z., Zhang, H., Wang, B., Paris, S., Yu, Y.: Automatic photo adjustment using deep neural networks. ACM Trans. Graph. (TOG) 35(2), 11 (2016)CrossRef
26.
go back to reference Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2921–2929. IEEE (2016) Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2921–2929. IEEE (2016)
Metadata
Title
Lucida: Enhancing the Creation of Photography Through Semantic, Sympathetic, Augmented, Voice Agent Interaction
Authors
Brad Wrobleski
Alexander Ivanov
Eric Eidelberg
Katayoon Etemad
Denis Gadbois
Christian Jacob
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-91250-9_16