Skip to main content
Top
Published in: Minds and Machines 4/2010

01-11-2010

Assessing the Novelty of Computer-Generated Narratives Using Empirical Metrics

Authors: Federico Peinado, Virginia Francisco, Raquel Hervás, Pablo Gervás

Published in: Minds and Machines | Issue 4/2010

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Novelty is a key concept to understand creativity. Evaluating a piece of artwork or other creation in terms of novelty requires comparisons to other works and considerations about the elements that have been reused in the creative process. Human beings perform this analysis intuitively, but in order to simulate it using computers, the objects to be compared and the similarity metrics to be used should be formalized and explicitly implemented. In this paper we present a study on relevant elements for the assessment of novelty in computer-generated narratives. We focus on the domain of folk-tales, working with simple plots and basic narrative elements: events, characters, props and scenarios. Based on the empirical results of this study we propose a set of computational metrics for the automatic assessment of novelty. Although oriented to the implementation of our own story generation system, the measurement methodology we propose can be easily generalized to other creative systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
Similar considerations apply to all the weights that appear in the rest of the formulas presented in this section, though the fact will not be repeatedly mentioned to avoid redundancy.
 
Literature
go back to reference Boden, M. A. (1990). The creative mind: Myths and mechanisms. London: Weidenfeld & Nicholson. Boden, M. A. (1990). The creative mind: Myths and mechanisms. London: Weidenfeld & Nicholson.
go back to reference Gomes, P., Bento, C., & Gago, P. (1998). A function for novelty evaluation in design. Paper presented at the 4th international round-table conference on computational and cognitive models of creative design, Sydney. Gomes, P., Bento, C., & Gago, P. (1998). A function for novelty evaluation in design. Paper presented at the 4th international round-table conference on computational and cognitive models of creative design, Sydney.
go back to reference Loke, K. S. (2005). Notes on defining novelty for computational creativity. Paper presented at the 19th international joint conference on artificial intelligence, Edinburgh. Loke, K. S. (2005). Notes on defining novelty for computational creativity. Paper presented at the 19th international joint conference on artificial intelligence, Edinburgh.
go back to reference Macedo, L., & Cardoso, A. (2002). Assessing creativity: The importance of unexpected novelty. Paper presented at the 2nd workshop on creative systems: Approaches to creativity in artificial intelligence and cognitive science, from the 15th European conference on artificial intelligence, Lyon. Macedo, L., & Cardoso, A. (2002). Assessing creativity: The importance of unexpected novelty. Paper presented at the 2nd workshop on creative systems: Approaches to creativity in artificial intelligence and cognitive science, from the 15th European conference on artificial intelligence, Lyon.
go back to reference McGraw, G., & Hofstadter, D. R. (1993). Letter spirit: An architecture for creativity in a microdomain. Paper presented at the 3rd congress of the Italian association for artificial intelligence, Torino. McGraw, G., & Hofstadter, D. R. (1993). Letter spirit: An architecture for creativity in a microdomain. Paper presented at the 3rd congress of the Italian association for artificial intelligence, Torino.
go back to reference Pease, A., Winterstein, D., & Colton, S. (2001). Evaluating machine creativity. Paper presented at the 1st workshop on creative systems: Approaches to creativity in artificial intelligence and cognitive science, from the 4th international conference on case-based reasoning, Washington. Pease, A., Winterstein, D., & Colton, S. (2001). Evaluating machine creativity. Paper presented at the 1st workshop on creative systems: Approaches to creativity in artificial intelligence and cognitive science, from the 4th international conference on case-based reasoning, Washington.
go back to reference Peinado, F., & Gervás, P. (2006). Evaluation of automatic generation of basic stories. New Generation Computing, computational paradigms and computational intelligence, special issue: Computational creativity, 24(3), 289–302. Peinado, F., & Gervás, P. (2006). Evaluation of automatic generation of basic stories. New Generation Computing, computational paradigms and computational intelligence, special issue: Computational creativity, 24(3), 289–302.
go back to reference Peinado, F. (2008). Un Armazón para el Desarrollo de Aplicaciones de Narración Automática basado en Componentes Ontológicos Reutilizables. Ph.D. Dissertation (in Spanish), Universidad Complutense de Madrid. Peinado, F. (2008). Un Armazón para el Desarrollo de Aplicaciones de Narración Automática basado en Componentes Ontológicos Reutilizables. Ph.D. Dissertation (in Spanish), Universidad Complutense de Madrid.
go back to reference Pérez y Pérez, R., & Sharples, M. (2001). Mexica: A computer model of a cognitive account of creative writing. Journal of Experimental and Theoretical Artificial Intelligence, 13(2), 119–139.CrossRef Pérez y Pérez, R., & Sharples, M. (2001). Mexica: A computer model of a cognitive account of creative writing. Journal of Experimental and Theoretical Artificial Intelligence, 13(2), 119–139.CrossRef
go back to reference Pérez y Pérez, R., & Sharples, M. (2004). Three computer-based models of storytelling: Brutus, Minstrel and Mexica. International Journal on Knowledge Based Systems, 17(1), 15–29.CrossRef Pérez y Pérez, R., & Sharples, M. (2004). Three computer-based models of storytelling: Brutus, Minstrel and Mexica. International Journal on Knowledge Based Systems, 17(1), 15–29.CrossRef
go back to reference Propp, V. (1968). Morphology of the Folktale. Austin: University of Texas Press. Propp, V. (1968). Morphology of the Folktale. Austin: University of Texas Press.
go back to reference Ritchie, G. (2001). Assessing creativity. Paper presented at the 3rd AISB symposium on artificial intelligence and creativity in arts and science, New York. Ritchie, G. (2001). Assessing creativity. Paper presented at the 3rd AISB symposium on artificial intelligence and creativity in arts and science, New York.
go back to reference Ritchie, G. (2007). Some empirical criteria for attributing creativity to a computer program. Minds & Machines, 17, 67–99.CrossRef Ritchie, G. (2007). Some empirical criteria for attributing creativity to a computer program. Minds & Machines, 17, 67–99.CrossRef
go back to reference Rosenman, M. A., & Gero, J. S. (1993). Creativity in design using a design prototype approach. In J. S. Gero, & M. L. Maher (Ed.), Modeling creativity and knowledge-based creative design (pp. 111–138). Hillsdale: Lawrence Erlbaum. Rosenman, M. A., & Gero, J. S. (1993). Creativity in design using a design prototype approach. In J. S. Gero, & M. L. Maher (Ed.), Modeling creativity and knowledge-based creative design (pp. 111–138). Hillsdale: Lawrence Erlbaum.
go back to reference Sharples, M. (1999). How we write: Writing as creative design. London: Routledge. Sharples, M. (1999). How we write: Writing as creative design. London: Routledge.
go back to reference Turner, S. R. (1992). Minstrel: A computer model of creativity and storytelling. Ph.D. Dissertation, University of California. Turner, S. R. (1992). Minstrel: A computer model of creativity and storytelling. Ph.D. Dissertation, University of California.
go back to reference Wiggins, G. A. (2006). A preliminary framework for description, analysis and comparison of creative systems. International Journal of Knowledge Based Systems, 19(7), 449–458.CrossRef Wiggins, G. A. (2006). A preliminary framework for description, analysis and comparison of creative systems. International Journal of Knowledge Based Systems, 19(7), 449–458.CrossRef
Metadata
Title
Assessing the Novelty of Computer-Generated Narratives Using Empirical Metrics
Authors
Federico Peinado
Virginia Francisco
Raquel Hervás
Pablo Gervás
Publication date
01-11-2010
Publisher
Springer Netherlands
Published in
Minds and Machines / Issue 4/2010
Print ISSN: 0924-6495
Electronic ISSN: 1572-8641
DOI
https://doi.org/10.1007/s11023-010-9209-8

Other articles of this Issue 4/2010

Minds and Machines 4/2010 Go to the issue

Premium Partner