Skip to main content

2017 | OriginalPaper | Buchkapitel

SceneMaker: Creative Technology for Digital StoryTelling

verfasst von : Murat Akser, Brian Bridges, Giuliano Campo, Abbas Cheddad, Kevin Curran, Lisa Fitzpatrick, Linley Hamilton, John Harding, Ted Leath, Tom Lunney, Frank Lyons, Minhua Ma, John Macrae, Tom Maguire, Aiden McCaughey, Eileen McClory, Victoria McCollum, Paul Mc Kevitt, Adam Melvin, Paul Moore, Eleanor Mulholland, Karla Muñoz, Greg O’Hanlon, Laurence Roman

Erschienen in: Interactivity, Game Creation, Design, Learning, and Innovation

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hanser, E., Mc Kevitt, P., Lunney, T., Condell, J.: SceneMaker: intelligent multimodal visualisation of natural language scripts. In: Coyle, L., Freyne, J. (eds.) AICS 2009. LNCS (LNAI), vol. 6206, pp. 144–153. Springer, Heidelberg (2010). doi:10.1007/978-3-642-17080-5_17 CrossRef Hanser, E., Mc Kevitt, P., Lunney, T., Condell, J.: SceneMaker: intelligent multimodal visualisation of natural language scripts. In: Coyle, L., Freyne, J. (eds.) AICS 2009. LNCS (LNAI), vol. 6206, pp. 144–153. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-17080-5_​17 CrossRef
2.
Zurück zum Zitat Hanser, E., Mc Kevitt, P., Lunney, T., Condell, J.: SceneMaker: automatic visualisation of screenplays. In: Mertsching, B., Hund, M., Aziz, Z. (eds.) KI 2009. LNCS (LNAI), vol. 5803, pp. 265–272. Springer, Heidelberg (2009). doi:10.1007/978-3-642-04617-9_34 CrossRef Hanser, E., Mc Kevitt, P., Lunney, T., Condell, J.: SceneMaker: automatic visualisation of screenplays. In: Mertsching, B., Hund, M., Aziz, Z. (eds.) KI 2009. LNCS (LNAI), vol. 5803, pp. 265–272. Springer, Heidelberg (2009). doi:10.​1007/​978-3-642-04617-9_​34 CrossRef
3.
Zurück zum Zitat Ma, M., McKevitt, P.: Virtual human animation in natural language visualisation. Artif. Intell. Rev. 25(1–2), 37–53 (2006). Special Issue on the 16th Artificial Intelligence and Cognitive Science Conference (AICS 2005)CrossRef Ma, M., McKevitt, P.: Virtual human animation in natural language visualisation. Artif. Intell. Rev. 25(1–2), 37–53 (2006). Special Issue on the 16th Artificial Intelligence and Cognitive Science Conference (AICS 2005)CrossRef
4.
Zurück zum Zitat Muñoz, K., Mc Kevitt, P., Lunney, T., Noguez, J., Neri, L.: Designing and evaluating emotional student models for game-based learning. In: Ma, M., Oikonomou, A., Jain, L.C. (eds.) Serious Games and Edutainment Applications, London, England, pp. 245–272. Springer, Heidelberg (2011). Also presented at the First International Workshop on Serious Games Development and Applications (SGDA 2010), School of Computing, University of Derby, England, 8 July 2011 Muñoz, K., Mc Kevitt, P., Lunney, T., Noguez, J., Neri, L.: Designing and evaluating emotional student models for game-based learning. In: Ma, M., Oikonomou, A., Jain, L.C. (eds.) Serious Games and Edutainment Applications, London, England, pp. 245–272. Springer, Heidelberg (2011). Also presented at the First International Workshop on Serious Games Development and Applications (SGDA 2010), School of Computing, University of Derby, England, 8 July 2011
5.
Zurück zum Zitat Mulholland, E., Mc Kevitt, P., Lunney, T., Farren, J., Wilson, J.: 360-MAM-affect: sentiment analysis with the google prediction API and EmoSenticNet. In: Proceedings of the 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN-2015), Politecnico di Torino, Turin (Torino), Italy, 10–12, 1–5 June 2015. EUDL EAI Endorsed Transactions on Scalable Information Systems vol. 2, no. 6, p. e5, November 2015 Mulholland, E., Mc Kevitt, P., Lunney, T., Farren, J., Wilson, J.: 360-MAM-affect: sentiment analysis with the google prediction API and EmoSenticNet. In: Proceedings of the 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN-2015), Politecnico di Torino, Turin (Torino), Italy, 10–12, 1–5 June 2015. EUDL EAI Endorsed Transactions on Scalable Information Systems vol. 2, no. 6, p. e5, November 2015
6.
Zurück zum Zitat Ekman, P., Rosenberg, E.L.: What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System. Oxford University Press, England (1997) Ekman, P., Rosenberg, E.L.: What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System. Oxford University Press, England (1997)
7.
Zurück zum Zitat Mehrabian, A.: Framework for a comprehensive description and measurement of emotional states. Gen. Soc. Gen. Psychol. Monogr. 121(3), 339–361 (1995). Heldref Publishing Mehrabian, A.: Framework for a comprehensive description and measurement of emotional states. Gen. Soc. Gen. Psychol. Monogr. 121(3), 339–361 (1995). Heldref Publishing
8.
Zurück zum Zitat Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)CrossRef Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)CrossRef
9.
Zurück zum Zitat Francisco V., Hervás R., Gervás P.: Two different approaches to automated mark up of emotions in text. In: Bramer M., Coenen F., Tuson A. (eds.) Research and Development in Intelligent Systems XXIII. Springer, London (2007) Francisco V., Hervás R., Gervás P.: Two different approaches to automated mark up of emotions in text. In: Bramer M., Coenen F., Tuson A. (eds.) Research and Development in Intelligent Systems XXIII. Springer, London (2007)
10.
Zurück zum Zitat Strapparava, C., Mihalcea, R.: Learning to identify emotions in text. In: Proceedings of the 2008 ACM Symposium on Applied Computing, SAC 2008, pp. 1556–1560. ACM, New York (2008) Strapparava, C., Mihalcea, R.: Learning to identify emotions in text. In: Proceedings of the 2008 ACM Symposium on Applied Computing, SAC 2008, pp. 1556–1560. ACM, New York (2008)
11.
Zurück zum Zitat Su, W.-P., Pham, B., Wardhani, A.: Personality and emotion-based high-level control of affective story characters. IEEE Trans. Vis. Comput. Graph. 13(2), 281–293 (2007)CrossRef Su, W.-P., Pham, B., Wardhani, A.: Personality and emotion-based high-level control of affective story characters. IEEE Trans. Vis. Comput. Graph. 13(2), 281–293 (2007)CrossRef
12.
Zurück zum Zitat Liu, H., Lieberman, H., Selker, T.: A model of textual affect sensing using real-world knowledge. In: Proceedings of the 8th International Conference on Intelligent User Interfaces, IUI 2003, pp. 125–132. ACM, New York (2003) Liu, H., Lieberman, H., Selker, T.: A model of textual affect sensing using real-world knowledge. In: Proceedings of the 8th International Conference on Intelligent User Interfaces, IUI 2003, pp. 125–132. ACM, New York (2003)
13.
Zurück zum Zitat Liu, H., Singh, P.: ConceptNet: a practical commonsense reasoning toolkit. BT Technol. J. 22(4), 211–226 (2004). Springer, The Netherlands Liu, H., Singh, P.: ConceptNet: a practical commonsense reasoning toolkit. BT Technol. J. 22(4), 211–226 (2004). Springer, The Netherlands
14.
Zurück zum Zitat Shaikh, M.A.M., Prendinger, H., Ishizuka, M.: A linguistic interpretation of the OCC emotion model for affect sensing from text. In: Tao, J., Tan, T. (eds.) Affective Information Processing, pp. 45–73. Springer, London (2009) Shaikh, M.A.M., Prendinger, H., Ishizuka, M.: A linguistic interpretation of the OCC emotion model for affect sensing from text. In: Tao, J., Tan, T. (eds.) Affective Information Processing, pp. 45–73. Springer, London (2009)
15.
Zurück zum Zitat Prendinger, H., Ishizuka, M.: SCREAM: scripting emotion-based agent minds. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems: Part 1, AAMAS 2002, pp. 350–351. ACM, New York (2002) Prendinger, H., Ishizuka, M.: SCREAM: scripting emotion-based agent minds. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems: Part 1, AAMAS 2002, pp. 350–351. ACM, New York (2002)
16.
Zurück zum Zitat Gebhard, P.: ALMA - layered model of affect. In: Proceedings of the 4th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2005), Utrecht University, The Netherlands, pp. 29–36. ACM, New York (2005) Gebhard, P.: ALMA - layered model of affect. In: Proceedings of the 4th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2005), Utrecht University, The Netherlands, pp. 29–36. ACM, New York (2005)
17.
Zurück zum Zitat De Raad, B.: The big five personality factors. In: The Psycholexical Approach to Personality. Hogrefe & Huber, Cambridge, MA, USA (2000) De Raad, B.: The big five personality factors. In: The Psycholexical Approach to Personality. Hogrefe & Huber, Cambridge, MA, USA (2000)
18.
Zurück zum Zitat Mancini, M., Pelachaud, C.: Implementing distinctive behavior for conversational agents. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds.) GW 2007. LNCS, vol. 5085, pp. 163–174. Springer, Heidelberg (2009). doi:10.1007/978-3-540-92865-2_17 CrossRef Mancini, M., Pelachaud, C.: Implementing distinctive behavior for conversational agents. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds.) GW 2007. LNCS, vol. 5085, pp. 163–174. Springer, Heidelberg (2009). doi:10.​1007/​978-3-540-92865-2_​17 CrossRef
19.
Zurück zum Zitat Coyne, B., Sproat, R.: WordsEye: an automatic text-to-scene conversion system. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 487–496. ACM Press, Los Angeles (2001) Coyne, B., Sproat, R.: WordsEye: an automatic text-to-scene conversion system. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 487–496. ACM Press, Los Angeles (2001)
20.
Zurück zum Zitat De Melo, C., Paiva, A.: Multimodal expression in virtual humans. Comput. Animation Virtual Worlds 17(3–4), 239–348 (2006)CrossRef De Melo, C., Paiva, A.: Multimodal expression in virtual humans. Comput. Animation Virtual Worlds 17(3–4), 239–348 (2006)CrossRef
21.
Zurück zum Zitat Liu, Z., Leung, K.: Script visualization (ScriptViz): a smart system that makes writing fun. Soft Comput. 10(1), 34–40 (2006)CrossRef Liu, Z., Leung, K.: Script visualization (ScriptViz): a smart system that makes writing fun. Soft Comput. 10(1), 34–40 (2006)CrossRef
22.
Zurück zum Zitat Hanser, E., Mc Kevitt, P., Lunney, T., Condell, J.: NewsViz: emotional visualization of news stories. In: Inkpen, D., Strapparava, C. (eds.) Proceedings of the NAACL-HLT Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, Millennium Biltmore Hotel, Los Angeles, CA, USA, pp. 125–130, 5 June 2010 Hanser, E., Mc Kevitt, P., Lunney, T., Condell, J.: NewsViz: emotional visualization of news stories. In: Inkpen, D., Strapparava, C. (eds.) Proceedings of the NAACL-HLT Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, Millennium Biltmore Hotel, Los Angeles, CA, USA, pp. 125–130, 5 June 2010
23.
Zurück zum Zitat Rasheed, Z., Sheikh, Y., Shah, M.: On the use of computable features for film classification. IEEE Trans. Circ. Syst. Video Technol. 15(1), 52–64 (2005). IEEE Circuits and Systems SocietyCrossRef Rasheed, Z., Sheikh, Y., Shah, M.: On the use of computable features for film classification. IEEE Trans. Circ. Syst. Video Technol. 15(1), 52–64 (2005). IEEE Circuits and Systems SocietyCrossRef
24.
Zurück zum Zitat Shim, H., Kang, B.G.: CAMEO - camera, audio and motion with emotion orchestration for immersive cinematography. In: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology, ACE 2008, vol. 352, pp. 115–118. ACM, New York (2008) Shim, H., Kang, B.G.: CAMEO - camera, audio and motion with emotion orchestration for immersive cinematography. In: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology, ACE 2008, vol. 352, pp. 115–118. ACM, New York (2008)
25.
Zurück zum Zitat Kuo, F., Chiang, M., Shan, M., Lee, S.: Emotion-based music recommendation by association discovery from film music. In: Proceedings of the 13th Annual ACM International Conference on Multimedia, MULTIMEDIA 2005, pp. 507–510. ACM, New York (2005) Kuo, F., Chiang, M., Shan, M., Lee, S.: Emotion-based music recommendation by association discovery from film music. In: Proceedings of the 13th Annual ACM International Conference on Multimedia, MULTIMEDIA 2005, pp. 507–510. ACM, New York (2005)
26.
Zurück zum Zitat Wahlster, W.: Smartkom: Foundations of Multimodal Dialogue Systems. Springer, Berlin/Heidelberg (2006)CrossRef Wahlster, W.: Smartkom: Foundations of Multimodal Dialogue Systems. Springer, Berlin/Heidelberg (2006)CrossRef
28.
Zurück zum Zitat Maguire, T.: Performing Story on the Contemporary Stage. Palgrave MacMillan, Basingstoke (2015)CrossRef Maguire, T.: Performing Story on the Contemporary Stage. Palgrave MacMillan, Basingstoke (2015)CrossRef
29.
Zurück zum Zitat Fitzpatrick, L.: Gender and affect in testimonial performance. Irish Univ. Rev. 45(1), 126–140 (2015)CrossRef Fitzpatrick, L.: Gender and affect in testimonial performance. Irish Univ. Rev. 45(1), 126–140 (2015)CrossRef
30.
Zurück zum Zitat Solon, A.J., Mc Kevitt, P., Curran, K.: TeleMorph: a fuzzy logic approach to network-aware transmoding in mobile intelligent multimedia presentation systems. In: Dumitras, A., Radha, H., Apostolopoulos, J., Altunbasak, Y. (eds.) Special issue on Network-Aware Multimedia Processing and Communications (2007). IEEE Journal of Selected Topics in Signal Processing vol. 1, no. 2, pp. 254–263, August 2007 Solon, A.J., Mc Kevitt, P., Curran, K.: TeleMorph: a fuzzy logic approach to network-aware transmoding in mobile intelligent multimedia presentation systems. In: Dumitras, A., Radha, H., Apostolopoulos, J., Altunbasak, Y. (eds.) Special issue on Network-Aware Multimedia Processing and Communications (2007). IEEE Journal of Selected Topics in Signal Processing vol. 1, no. 2, pp. 254–263, August 2007
31.
Zurück zum Zitat Bridges, B., Graham, R.: Electroacoustic music as embodied cognitive praxis: Denis Smalley’s theory of spectromorphology as an implicit theory of embodied cognition. In: Proceedings of the Electroacoustic Music Studies Network Conference, The Art of Electroaoustic Music (EMS 2015), University of Sheffield, England Bridges, B., Graham, R.: Electroacoustic music as embodied cognitive praxis: Denis Smalley’s theory of spectromorphology as an implicit theory of embodied cognition. In: Proceedings of the Electroacoustic Music Studies Network Conference, The Art of Electroaoustic Music (EMS 2015), University of Sheffield, England
32.
Zurück zum Zitat Moore, P., Lyons, F., O’Hanlon, G.: The river still sings. In: Digital Arts and Humanities Conference, Ulster University, Magee, Derry/Londonderry, Northern Ireland, 10–13 September. Digital Humanities Ireland, 20 pp. (2013) Moore, P., Lyons, F., O’Hanlon, G.: The river still sings. In: Digital Arts and Humanities Conference, Ulster University, Magee, Derry/Londonderry, Northern Ireland, 10–13 September. Digital Humanities Ireland, 20 pp. (2013)
33.
Zurück zum Zitat Melvin, A.: Sonic motifs, structure and identity in Steve McQueen’s hunger. Soundtrack 4(1), 23–32 (2011)MathSciNetCrossRef Melvin, A.: Sonic motifs, structure and identity in Steve McQueen’s hunger. Soundtrack 4(1), 23–32 (2011)MathSciNetCrossRef
36.
Zurück zum Zitat Tesniere, L.: Elements de syntaxe structurale. Klincksieck, Paris (1959) Tesniere, L.: Elements de syntaxe structurale. Klincksieck, Paris (1959)
37.
Zurück zum Zitat Fellbaum, C.: WordNet: An Electronic Lexical Database. MIT Press, Cambridge (1998)MATH Fellbaum, C.: WordNet: An Electronic Lexical Database. MIT Press, Cambridge (1998)MATH
38.
Zurück zum Zitat Strapparava, C., Valitutti, A.: WordNet-affect: an affective extension of WordNet. In: Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), Lisbon, Portugal, pp. 1083–1086, 26–28 May 2004 Strapparava, C., Valitutti, A.: WordNet-affect: an affective extension of WordNet. In: Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), Lisbon, Portugal, pp. 1083–1086, 26–28 May 2004
Metadaten
Titel
SceneMaker: Creative Technology for Digital StoryTelling
verfasst von
Murat Akser
Brian Bridges
Giuliano Campo
Abbas Cheddad
Kevin Curran
Lisa Fitzpatrick
Linley Hamilton
John Harding
Ted Leath
Tom Lunney
Frank Lyons
Minhua Ma
John Macrae
Tom Maguire
Aiden McCaughey
Eileen McClory
Victoria McCollum
Paul Mc Kevitt
Adam Melvin
Paul Moore
Eleanor Mulholland
Karla Muñoz
Greg O’Hanlon
Laurence Roman
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-55834-9_4