Skip to main content
Top
Published in: Multimedia Systems 6/2013

01-11-2013 | Original Article

Accessing movies based on emotional impact

Authors: Eva Oliveira, Pedro Martins, Teresa Chambel

Published in: Multimedia Systems | Issue 6/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Emotions play a central role in our daily lives, influencing the way we think and act, our health and sense of well-being, and films are by excellence the form of art that exploits our affective, perceptual and intellectual activity, holding the potential for a significant impact. Video is becoming a dominant and pervasive medium, and online video a growing entertainment activity on the web and iTV, mainly due to technological developments and the trends for media convergence. In addition, the improvement of new techniques for gathering emotional information about videos, both through content analysis or user implicit feedback through user physiological signals complemented in manual labeling from users, is revealing new ways for exploring emotional information in videos, films or TV series, and brings out new perspectives to enrich and personalize video access. In this work, we reflect on the power that emotions have in our lives, on the emotional impact of movies, and on how to address this emotional dimension in the way we classify and access movies, by exploring and evaluating the design of iFelt in its different ways to classify, access, browse and visualize movies based on their emotional impact.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ahlberg, C., Truvé, S.: Tight coupling: guiding user actions in a direct manipulation retrieval system. In: People and computers X: proceedings of HCI’95, Huddersfield, pp. 305–321, Aug 1995 Ahlberg, C., Truvé, S.: Tight coupling: guiding user actions in a direct manipulation retrieval system. In: People and computers X: proceedings of HCI’95, Huddersfield, pp. 305–321, Aug 1995
3.
go back to reference Arijon, D.: Grammar of the film language. Focal Press, Waltham (1976) Arijon, D.: Grammar of the film language. Focal Press, Waltham (1976)
4.
go back to reference Ashby, G.F., Valentin, V.V., Turken, U.: The effects of positive affect and arousal on working memory and executive attention. In: Moore, S.C., Oaksford, M. (eds.) Emotional Cognition: from Brain to Behaviour. Amsterdam [u.a.]: Benjamins, pp. 245–287 (2002) Ashby, G.F., Valentin, V.V., Turken, U.: The effects of positive affect and arousal on working memory and executive attention. In: Moore, S.C., Oaksford, M. (eds.) Emotional Cognition: from Brain to Behaviour. Amsterdam [u.a.]: Benjamins, pp. 245–287 (2002)
5.
go back to reference Banerjee, S., Greene, K., Krcmar, M., Bagdasarov, Z., Ruginyte, D.: The role of gender and sensation seeking in film choice: exploring mood and arousal. J. Media Psychol. Theories Methods Appl. 20(3), 97–105 (2008)CrossRef Banerjee, S., Greene, K., Krcmar, M., Bagdasarov, Z., Ruginyte, D.: The role of gender and sensation seeking in film choice: exploring mood and arousal. J. Media Psychol. Theories Methods Appl. 20(3), 97–105 (2008)CrossRef
7.
go back to reference Card, S.K., Mackinlay, J.D., Shneiderman, B.: Readings in Information Visualization: Using Vision to Think. Morgan-Kaufmann, San Francisco (1999) Card, S.K., Mackinlay, J.D., Shneiderman, B.: Readings in Information Visualization: Using Vision to Think. Morgan-Kaufmann, San Francisco (1999)
8.
go back to reference Chambel, T., Guimarães, N.: Context perception in video-based hypermedia spaces. In: Proceedings of ACM Hypertext’02, College Park, Maryland, USA (2002) Chambel, T., Guimarães, N.: Context perception in video-based hypermedia spaces. In: Proceedings of ACM Hypertext’02, College Park, Maryland, USA (2002)
9.
go back to reference Chambel, T., Oliveira, E., Martins, P.: Being happy, healthy and whole watching movies that affect our emotions. In: Proceedings of ACII 2011, 4th International Conference on Affective Computing and Intelligent Interaction. Springer, Berlin, Heidelberg, pp. 35–45, Memphis, TN, USA, Oct 9–12 (2011) Chambel, T., Oliveira, E., Martins, P.: Being happy, healthy and whole watching movies that affect our emotions. In: Proceedings of ACII 2011, 4th International Conference on Affective Computing and Intelligent Interaction. Springer, Berlin, Heidelberg, pp. 35–45, Memphis, TN, USA, Oct 9–12 (2011)
10.
go back to reference Cunningham, S., Nichols, D.M.: How people find videos. In: Proceedings of the 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL ‘08). ACM, NY, USA, pp. 201–210 (2008) Cunningham, S., Nichols, D.M.: How people find videos. In: Proceedings of the 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL ‘08). ACM, NY, USA, pp. 201–210 (2008)
11.
go back to reference Doherty, J., Girgensohn, A., Helfman, J., Shipman, F., Wilcox, L.: Detail-on demand hypervideo. In: Multimedia’03: Proceedings of the Eleventh ACM International Conference on Multimedia (2003) Doherty, J., Girgensohn, A., Helfman, J., Shipman, F., Wilcox, L.: Detail-on demand hypervideo. In: Multimedia’03: Proceedings of the Eleventh ACM International Conference on Multimedia (2003)
12.
14.
go back to reference Few, S.: Data Visualization: Past, Present, and Future. IBM Cognos Innovation Center, Ottawa (2007) Few, S.: Data Visualization: Past, Present, and Future. IBM Cognos Innovation Center, Ottawa (2007)
15.
go back to reference Hanjalic, A., Xu, L.Q.: Affective video content representation and modeling. Multimedia, IEEE Trans. Multimed., 7(1), 143–154 (2005) Hanjalic, A., Xu, L.Q.: Affective video content representation and modeling. Multimedia, IEEE Trans. Multimed., 7(1), 143–154 (2005)
16.
go back to reference Harris, J., Kamvar, S.: We Feel Fine: An Almanac of Human Emotion. Scribner, New York (2009) Harris, J., Kamvar, S.: We Feel Fine: An Almanac of Human Emotion. Scribner, New York (2009)
17.
go back to reference Hauptmann, A.G.: Lessons for the future from a decade of informedia video analysis research. In: International Conference on Image and Video Retrieval, National University of Singapore, Singapore, LNCS, vol 3568, pp. 1–10. Springer, Berlin, Heidelberg, July 20–22 (2005). http://dl.acm.org/citation.cfm?id=2106102 Hauptmann, A.G.: Lessons for the future from a decade of informedia video analysis research. In: International Conference on Image and Video Retrieval, National University of Singapore, Singapore, LNCS, vol 3568, pp. 1–10. Springer, Berlin, Heidelberg, July 20–22 (2005). http://​dl.​acm.​org/​citation.​cfm?​id=​2106102
19.
go back to reference Kang, H.B.: Affective content detection using HMMs. In: Proceedings of the Eleventh ACM International Conference on Multimedia, pp. 259–262 (2003) Kang, H.B.: Affective content detection using HMMs. In: Proceedings of the Eleventh ACM International Conference on Multimedia, pp. 259–262 (2003)
20.
go back to reference Kim, J., André, E.: Emotion recognition based on physiological changes in listening music. IEEE Trans. Pattern Anal. Mach. Intell. 30(12), 2067–2083 (2008)CrossRef Kim, J., André, E.: Emotion recognition based on physiological changes in listening music. IEEE Trans. Pattern Anal. Mach. Intell. 30(12), 2067–2083 (2008)CrossRef
21.
go back to reference Kreibig, S.D., Wilhelm, F.H., Roth, W.T., Gross, J.J.: Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. Psychophysiology 44(5), 787–806 (2007)CrossRef Kreibig, S.D., Wilhelm, F.H., Roth, W.T., Gross, J.J.: Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. Psychophysiology 44(5), 787–806 (2007)CrossRef
22.
go back to reference Langlois, T., Chambel, T., Oliveira, E., Carvalho, P., Marques, G., Falcão, A.: VIRUS: video information retrieval using subtitles. In: Proceedings of Academic MindTrek’2010, Tampere, Finland, 6–8 Oct 2010 Langlois, T., Chambel, T., Oliveira, E., Carvalho, P., Marques, G., Falcão, A.: VIRUS: video information retrieval using subtitles. In: Proceedings of Academic MindTrek’2010, Tampere, Finland, 6–8 Oct 2010
23.
go back to reference Lund, A.M.: Measuring usability with the USE questionnaire. Usability User Exp. 8(2), 8 (2001)MathSciNet Lund, A.M.: Measuring usability with the USE questionnaire. Usability User Exp. 8(2), 8 (2001)MathSciNet
25.
go back to reference Martinho, J., Chambel, T.: ColorsInMotion: interactive visualization and exploration of video spaces. In Proceedings of Academic MindTrek’2009, Tampere, Finland, Sep–Oct 2009 Martinho, J., Chambel, T.: ColorsInMotion: interactive visualization and exploration of video spaces. In Proceedings of Academic MindTrek’2009, Tampere, Finland, Sep–Oct 2009
26.
go back to reference Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23(2), 209–237 (2009)CrossRef Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23(2), 209–237 (2009)CrossRef
27.
go back to reference Metz, C., Taylor, M.: Film language: a semiotics of the cinema. University of Chicago Press, Chicago (1991) Metz, C., Taylor, M.: Film language: a semiotics of the cinema. University of Chicago Press, Chicago (1991)
28.
go back to reference Money, A.G., Agius, H.: Analysing user physiological responses for affective video summarization. Displays 30(2), 3059–3070 (2009)CrossRef Money, A.G., Agius, H.: Analysing user physiological responses for affective video summarization. Displays 30(2), 3059–3070 (2009)CrossRef
31.
go back to reference Oliveira, E., Benovoy, M., Ribeiro, N., Chambel, T.: Towards emotional interaction: using movies to automatically learn users’ emotional states. In: Proceedings of Interact’ 2011: 13th IFIP TC13 International Conference on Human–Computer Interaction, Lisbon, Portugal, pp. 152–161, 5–9 Sep (2011) Oliveira, E., Benovoy, M., Ribeiro, N., Chambel, T.: Towards emotional interaction: using movies to automatically learn users’ emotional states. In: Proceedings of Interact’ 2011: 13th IFIP TC13 International Conference on Human–Computer Interaction, Lisbon, Portugal, pp. 152–161, 5–9 Sep (2011)
32.
go back to reference Ordelman, R., de Jong, F., Larson, M.: Enhanced multimedia content access and exploitation using semantic speech retrieval. In: Third IEEE International Conference on Semantic Computing, ICSC, Berkeley, CA, USA, 14–16 Sep (2009). http://doc.utwente.nl/68255/ Ordelman, R., de Jong, F., Larson, M.: Enhanced multimedia content access and exploitation using semantic speech retrieval. In: Third IEEE International Conference on Semantic Computing, ICSC, Berkeley, CA, USA, 14–16 Sep (2009). http://​doc.​utwente.​nl/​68255/​
34.
go back to reference Picard, R.W., Vyzas, E., Healey, J.: Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans. Pattern Anal. Mach. Intell. 1175–1191 (2001) Picard, R.W., Vyzas, E., Healey, J.: Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans. Pattern Anal. Mach. Intell. 1175–1191 (2001)
35.
go back to reference Plutchik, R.: Emotion: A Psychoevolutionary Synthesis. Harper & Row, New York (1980) Plutchik, R.: Emotion: A Psychoevolutionary Synthesis. Harper & Row, New York (1980)
37.
go back to reference Rocha, T., Chambel,T.: VideoSpace: a 3D video experience. In: Proceedings of Artech’2008, 4th International Conference on Digital Arts, Porto, Portugal, Nov (2008) Rocha, T., Chambel,T.: VideoSpace: a 3D video experience. In: Proceedings of Artech’2008, 4th International Conference on Digital Arts, Porto, Portugal, Nov (2008)
39.
go back to reference Russell, J.: A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161–1178 (1980)CrossRef Russell, J.: A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161–1178 (1980)CrossRef
40.
go back to reference Scherer, K.R.: What are emotions? and how can they be measured? Soc. Sci. Inf. 44(4), 695 (2005)CrossRef Scherer, K.R.: What are emotions? and how can they be measured? Soc. Sci. Inf. 44(4), 695 (2005)CrossRef
41.
go back to reference Shneiderman, B.: Tree visualization with tree-maps: 2-D space-filling approach. ACM Trans. Graph. (TOG) 11(1), 92–99 (1992)CrossRefMATH Shneiderman, B.: Tree visualization with tree-maps: 2-D space-filling approach. ACM Trans. Graph. (TOG) 11(1), 92–99 (1992)CrossRefMATH
42.
go back to reference Smeaton, A.F., Rothwell, S.: Biometric responses to music-rich segments in films: the cdvplex. Biometric Responses to Music-Rich Segments in Films: The Cdvplex, pp. 162–168 (2009). doi:10.1109/CBMI.2009.21 Smeaton, A.F., Rothwell, S.: Biometric responses to music-rich segments in films: the cdvplex. Biometric Responses to Music-Rich Segments in Films: The Cdvplex, pp. 162–168 (2009). doi:10.​1109/​CBMI.​2009.​21
43.
go back to reference Snoek, C.G.M., Worring, M., Smeulders, A.W.M., Freiburg, B.: The role of visual content and style for concert video indexing. In: Proceedings of IEEE International Conference on Multimedia and Expo (2007) Snoek, C.G.M., Worring, M., Smeulders, A.W.M., Freiburg, B.: The role of visual content and style for concert video indexing. In: Proceedings of IEEE International Conference on Multimedia and Expo (2007)
44.
go back to reference Soleymani, M. S., Chanel, C.G., Kierkels, J.K., Pun, T.P.: Affective characterization of movie scenes based on content analysis and physiological changes. In: International Symposium on Multimedia, pp. 228–235 (2008) Soleymani, M. S., Chanel, C.G., Kierkels, J.K., Pun, T.P.: Affective characterization of movie scenes based on content analysis and physiological changes. In: International Symposium on Multimedia, pp. 228–235 (2008)
47.
go back to reference Ware, C.: Information Visualization: Perception for Design. Morgan Kaufmann Publisher, San Francisco (2004) Ware, C.: Information Visualization: Perception for Design. Morgan Kaufmann Publisher, San Francisco (2004)
49.
go back to reference Xu, M., Jin, J.S., Luo, S.: Personalized video adaptation based on video content analysis. In: Proceedings of the 9th International Workshop on Multimedia Data Mining: held in conjunction with the ACM SIGKDD (MDM ‘08). ACM, New York, NY, USA, pp. 26–35 (2008) Xu, M., Jin, J.S., Luo, S.: Personalized video adaptation based on video content analysis. In: Proceedings of the 9th International Workshop on Multimedia Data Mining: held in conjunction with the ACM SIGKDD (MDM ‘08). ACM, New York, NY, USA, pp. 26–35 (2008)
50.
go back to reference Yoo, H., Cho, S.: Video scene retrieval with interactive genetic algorithm. Multimed. Tools Appl. 34(September), 317–336 (2007)CrossRef Yoo, H., Cho, S.: Video scene retrieval with interactive genetic algorithm. Multimed. Tools Appl. 34(September), 317–336 (2007)CrossRef
52.
go back to reference Zwaag, M., Broek, E.: Guidelines for biosignal-driven HCI. In: CHI Workshop on Brain, Body and Bytes: Psychophysiological User Interaction (2010) Zwaag, M., Broek, E.: Guidelines for biosignal-driven HCI. In: CHI Workshop on Brain, Body and Bytes: Psychophysiological User Interaction (2010)
Metadata
Title
Accessing movies based on emotional impact
Authors
Eva Oliveira
Pedro Martins
Teresa Chambel
Publication date
01-11-2013
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 6/2013
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-013-0303-7

Other articles of this Issue 6/2013

Multimedia Systems 6/2013 Go to the issue