Skip to main content
Erschienen in: Neural Computing and Applications 1/2021

02.10.2020 | S. I : Neural Networks in Art, sound and Design

Deep learning of individual aesthetics

verfasst von: Jon McCormack, Andy Lomas

Erschienen in: Neural Computing and Applications | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Accurate evaluation of human aesthetic preferences represents a major challenge for creative evolutionary and generative systems research. Prior work has tended to focus on feature measures of the artefact, such as symmetry, complexity and coherence. However, research models from psychology suggest that human aesthetic experiences encapsulate factors beyond the artefact, making accurate computational models very difficult to design. The interactive genetic algorithm circumvents the problem through human-in-the-loop, subjective evaluation of aesthetics, but is limited due to user fatigue and small population sizes. In this paper, we look at how recent advances in deep learning can assist in automating personal aesthetic judgement. Using a leading artist’s computer art dataset, we investigate the relationship between image measures, such as complexity, and human aesthetic evaluation. We use dimension reduction methods to visualise both genotype and phenotype space in order to support the exploration of new territory in a generative system. Convolutional neural networks trained on the artist’s prior aesthetic evaluations are used to suggest new possibilities similar or between known high-quality genotype-phenotype mappings. We integrate this classification and discovery system into a software tool for evolving complex generative art and design.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Fußnoten
1
Lomas is an award winning computer artist who exhibits internationally, see his website http://​www.​andylomas.​com.
 
2
We note that Lomas’ classification is purely visual but remarkably consistent. When shown a “test set” of 100 of the originally classified images without classification labels, he was able to reclassify them with 97% accuracy to his original classification.
 
3
In theory, a variational autoencoder could be trained to map genotype data to 2D images and if accurate enough, bypass the need for the original generative system altogether, although this would require a much larger training set to be aesthetically viable.
 
Literatur
1.
Zurück zum Zitat Azizpour H, Sharif Razavian A, Sullivan J, Maki A, Carlsson S (2015) From generic to specific deep representations for visual recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 36–45 Azizpour H, Sharif Razavian A, Sullivan J, Maki A, Carlsson S (2015) From generic to specific deep representations for visual recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 36–45
2.
Zurück zum Zitat Bellman RE (1961) Adaptive control processes: a guided tour. Princeton University Press, New JerseyCrossRef Bellman RE (1961) Adaptive control processes: a guided tour. Princeton University Press, New JerseyCrossRef
3.
Zurück zum Zitat Bentley PJ (1999) Evolutionary design by computers. Morgan Kaufmann Publishers, San FranciscoMATH Bentley PJ (1999) Evolutionary design by computers. Morgan Kaufmann Publishers, San FranciscoMATH
4.
Zurück zum Zitat Bentley PJ, Corne DW (eds) (2002) Creative Evolutionary Systems. Academic Press, London Bentley PJ, Corne DW (eds) (2002) Creative Evolutionary Systems. Academic Press, London
5.
Zurück zum Zitat Birkhoff GD (1933) Aesthetic measure. Harvard University Press, CambridgeCrossRef Birkhoff GD (1933) Aesthetic measure. Harvard University Press, CambridgeCrossRef
6.
Zurück zum Zitat Blair A (2019) Adversarial evolution and deep learning–how does an artist play with our visual system? In: Ekárt A, Liapis A, Castro Pena ML (eds) Computational intelligence in music, sound, art and design. Springer, Cham, pp 18–34CrossRef Blair A (2019) Adversarial evolution and deep learning–how does an artist play with our visual system? In: Ekárt A, Liapis A, Castro Pena ML (eds) Computational intelligence in music, sound, art and design. Springer, Cham, pp 18–34CrossRef
7.
Zurück zum Zitat Bontrager P, Lin W, Togelius J, Risi S (2018) Deep interactive evolution. In: Liapis A, Romero Cardalda JJ, Ekárt A (eds) Computational Intelligence in Music, Sound, Art and Design. Springer, Cham, pp 267–282CrossRef Bontrager P, Lin W, Togelius J, Risi S (2018) Deep interactive evolution. In: Liapis A, Romero Cardalda JJ, Ekárt A (eds) Computational Intelligence in Music, Sound, Art and Design. Springer, Cham, pp 267–282CrossRef
8.
Zurück zum Zitat Brunswik E (1956) Perception and the representative design of psychological experiments, 2nd edn. University of California Press, Berkley and Los Angeles Brunswik E (1956) Perception and the representative design of psychological experiments, 2nd edn. University of California Press, Berkley and Los Angeles
9.
Zurück zum Zitat Colton S, McCormack J, Berns S, Petrovskaya E, Cook M (2020) Adapting and enhancing evolutionary art for casual creation. In: Romero J, Ekárt A, Martins T, Correia J (eds) Artificial Intelligence in Music, Sound, Art and Design. EvoMUSART 2020, Lecture notes in computer science, vol 12103. Springer, Cham. https://doi.org/10.1007/978-3-030-43859-3_2CrossRef Colton S, McCormack J, Berns S, Petrovskaya E, Cook M (2020) Adapting and enhancing evolutionary art for casual creation. In: Romero J, Ekárt A, Martins T, Correia J (eds) Artificial Intelligence in Music, Sound, Art and Design. EvoMUSART 2020, Lecture notes in computer science, vol 12103. Springer, Cham. https://​doi.​org/​10.​1007/​978-3-030-43859-3_​2CrossRef
10.
Zurück zum Zitat Dawkins R (1986) The Blind Watchmaker. 332. Longman Scientific and Technical, Essex, UK Dawkins R (1986) The Blind Watchmaker. 332. Longman Scientific and Technical, Essex, UK
11.
Zurück zum Zitat Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp 248–255. IEEE Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp 248–255. IEEE
12.
Zurück zum Zitat Donoho DL et al (2000) High-dimensional data analysis: the curses and blessings of dimensionality. AMS Math Challenges Lecture 1(2000):32 Donoho DL et al (2000) High-dimensional data analysis: the curses and blessings of dimensionality. AMS Math Challenges Lecture 1(2000):32
14.
Zurück zum Zitat Forsythe A, Nadal M, Sheehy N, Cela-Conde CJ, Sawey M (2011) Predicting beauty: fractal dimension and visual complexity in art. British J Psychol 102(1):49–70CrossRef Forsythe A, Nadal M, Sheehy N, Cela-Conde CJ, Sawey M (2011) Predicting beauty: fractal dimension and visual complexity in art. British J Psychol 102(1):49–70CrossRef
16.
17.
Zurück zum Zitat Jausovec N, Jausovec K (2011) Brain, creativity and education. Open Educ J 4:50–57CrossRef Jausovec N, Jausovec K (2011) Brain, creativity and education. Open Educ J 4:50–57CrossRef
20.
Zurück zum Zitat Leder H, Belke B, Oeberst A, Augustin D (2004) A model of aesthetic appreciation and aesthetic judgments. British J Psychol 95:489–508CrossRef Leder H, Belke B, Oeberst A, Augustin D (2004) A model of aesthetic appreciation and aesthetic judgments. British J Psychol 95:489–508CrossRef
21.
Zurück zum Zitat Leder H, Nadal M (2014) Ten years of a model of aesthetic appreciation and aesthetic judgments: The aesthetic episode—developments and challenges in empirical aesthetics. British J Psychol 105:443–464CrossRef Leder H, Nadal M (2014) Ten years of a model of aesthetic appreciation and aesthetic judgments: The aesthetic episode—developments and challenges in empirical aesthetics. British J Psychol 105:443–464CrossRef
25.
Zurück zum Zitat Lomas A (2016) Species explorer: an interface for artistic exploration of multi-dimensional parameter spaces. In: Bowen J, Lambert N, Diprose G (eds) Electronic visualisation and the arts (EVA 2016), Electronic Workshops in Computing (eWiC). BCS Learning and Development Ltd., London Lomas A (2016) Species explorer: an interface for artistic exploration of multi-dimensional parameter spaces. In: Bowen J, Lambert N, Diprose G (eds) Electronic visualisation and the arts (EVA 2016), Electronic Workshops in Computing (eWiC). BCS Learning and Development Ltd., London
27.
Zurück zum Zitat Maaten LVD, Hinton G (2008) Visualizing data using t-sne. J Mach Learning Res 9:2579–2605MATH Maaten LVD, Hinton G (2008) Visualizing data using t-sne. J Mach Learning Res 9:2579–2605MATH
28.
29.
Zurück zum Zitat Marimont R, Shapiro M (1979) Nearest neighbour searches and the curse of dimensionality. IMA J Appl Math 24(1):59–70CrossRef Marimont R, Shapiro M (1979) Nearest neighbour searches and the curse of dimensionality. IMA J Appl Math 24(1):59–70CrossRef
30.
Zurück zum Zitat McCormack J (1992) Interactive evolution of forms. In: A. Cavallaro, R. Harley, L. Wallace, M. Wark (eds.) Cultural diversity in the global village: Third international symposium on electronic Art, p 122. The Australian Network for Art and Technology, Sydney, Australia McCormack J (1992) Interactive evolution of forms. In: A. Cavallaro, R. Harley, L. Wallace, M. Wark (eds.) Cultural diversity in the global village: Third international symposium on electronic Art, p 122. The Australian Network for Art and Technology, Sydney, Australia
31.
Zurück zum Zitat McCormack J (2005) Open problems in evolutionary music and art. In: F. Rothlauf, J. Branke, S. Cagnoni, D.W. Corne, R. Drechsler, Y. Jin, P. Machado, E. Marchiori, J. Romero, G.D. Smith, G. Squillero (eds.) EvoWorkshops, Lecture Notes in Computer Science, vol. 3449, pp. 428–436. Springer (2005) McCormack J (2005) Open problems in evolutionary music and art. In: F. Rothlauf, J. Branke, S. Cagnoni, D.W. Corne, R. Drechsler, Y. Jin, P. Machado, E. Marchiori, J. Romero, G.D. Smith, G. Squillero (eds.) EvoWorkshops, Lecture Notes in Computer Science, vol. 3449, pp. 428–436. Springer (2005)
32.
Zurück zum Zitat McCormack J (2019) Creative systems: a biological perspective. In: Veale T, Cardoso FA (eds) Computational creativity: the philosophy and engineering of autonomously creative systems. Springer, Switzerland, pp 327–352CrossRef McCormack J (2019) Creative systems: a biological perspective. In: Veale T, Cardoso FA (eds) Computational creativity: the philosophy and engineering of autonomously creative systems. Springer, Switzerland, pp 327–352CrossRef
33.
Zurück zum Zitat McInnes L, Healy J, Melville J (2018) Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 McInnes L, Healy J, Melville J (2018) Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:​1802.​03426
34.
Zurück zum Zitat O’Hear A (1995) Art and technology: an old tension. R Instit Philosophy Suppl 38:143–158CrossRef O’Hear A (1995) Art and technology: an old tension. R Instit Philosophy Suppl 38:143–158CrossRef
35.
Zurück zum Zitat Rowbottom A (1999) Evolutionary Design by Computers, chap. Evolutionary Art and Form. Morgan Kaufmann, San Francisco, pp 261–277 Rowbottom A (1999) Evolutionary Design by Computers, chap. Evolutionary Art and Form. Morgan Kaufmann, San Francisco, pp 261–277
36.
Zurück zum Zitat Sharif Razavian A, Azizpour H, Sullivan J, Carlsson S (2014) Cnn features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 806–813 (2014) Sharif Razavian A, Azizpour H, Sullivan J, Carlsson S (2014) Cnn features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 806–813 (2014)
38.
Zurück zum Zitat Singh D, Rajic N, Colton S, McCormack J (2019) Camera obscurer: Generative art for design inspiration. In: Evolutionary and Biologically Inspired Music, Sound, Art and Design—8th International Conference, EvoMUSART 2019. Springer, Berlin Singh D, Rajic N, Colton S, McCormack J (2019) Camera obscurer: Generative art for design inspiration. In: Evolutionary and Biologically Inspired Music, Sound, Art and Design—8th International Conference, EvoMUSART 2019. Springer, Berlin
39.
Zurück zum Zitat Takagi H (2001) Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation. Proc IEEE 89:1275–1296CrossRef Takagi H (2001) Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation. Proc IEEE 89:1275–1296CrossRef
40.
Zurück zum Zitat Todd S, Latham W (1991) Mutator: a subjective human interface for evolution of computer sculptures. IBM United Kingdom Scientific Centre, Winchester, UK Todd S, Latham W (1991) Mutator: a subjective human interface for evolution of computer sculptures. IBM United Kingdom Scientific Centre, Winchester, UK
41.
Zurück zum Zitat Todd S, Latham W (1992) Evolutionary art and computers. Academic Press, LondonMATH Todd S, Latham W (1992) Evolutionary art and computers. Academic Press, LondonMATH
Metadaten
Titel
Deep learning of individual aesthetics
verfasst von
Jon McCormack
Andy Lomas
Publikationsdatum
02.10.2020
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 1/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05376-7

Weitere Artikel der Ausgabe 1/2021

Neural Computing and Applications 1/2021 Zur Ausgabe