Skip to main content

2019 | OriginalPaper | Buchkapitel

Reflecting on How Artworks Are Processed and Analyzed by Computer Vision

verfasst von : Sabine Lang, Björn Ommer

Erschienen in: Computer Vision – ECCV 2018 Workshops

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The intersection between computer vision and art history has resulted in new ways of seeing, engaging and analyzing digital images. Innovative methods and tools have assisted with the evaluation of large datasets, performing tasks such as classification, object detection, image description and style transfer or assisting with a form and content analysis. At this point, in order to progress, past works and established practices must be revisited and evaluated on the ground of their usability for art history. This paper provides a reflection from an art historical perspective to point to erroneous assumptions and where improvements are still needed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Bishop, C.: Against digital art history. Int. J. Digi. Art Hist. (3), 123–133 (2018) Bishop, C.: Against digital art history. Int. J. Digi. Art Hist. (3), 123–133 (2018)
2.
Zurück zum Zitat Boeykens, S., Maekelberg, S., De Jonge, K.: (Re-) creating the past: 10 years of digital historical reconstructions using bim. Int. J. Digit. Art Hist. (3), 63–87 (2018) Boeykens, S., Maekelberg, S., De Jonge, K.: (Re-) creating the past: 10 years of digital historical reconstructions using bim. Int. J. Digit. Art Hist. (3), 63–87 (2018)
6.
Zurück zum Zitat Drucker, J.: Is there a “digital” art history? Visual Resour. 29(1–2), 5–13 (2013)CrossRef Drucker, J.: Is there a “digital” art history? Visual Resour. 29(1–2), 5–13 (2013)CrossRef
7.
Zurück zum Zitat Drucker, J., Helmreich, A., Lincoln, M., Rose, F.: Digital art history: la scène américaine. une discussion entre johanna drucker, anne helmreich et matthew lincoln, introduite et modérée par francesca rose. Perspective. Actualité en histoire de l’art (2), 27–42 (2015) Drucker, J., Helmreich, A., Lincoln, M., Rose, F.: Digital art history: la scène américaine. une discussion entre johanna drucker, anne helmreich et matthew lincoln, introduite et modérée par francesca rose. Perspective. Actualité en histoire de l’art (2), 27–42 (2015)
8.
Zurück zum Zitat Elgammal, A., Kang, Y., Leeuw, M.D.: Picasso, matisse, or a fake? Automated analysis of drawings at the stroke level for attribution and authentication. arXiv preprint arXiv:1711.03536 (2017) Elgammal, A., Kang, Y., Leeuw, M.D.: Picasso, matisse, or a fake? Automated analysis of drawings at the stroke level for attribution and authentication. arXiv preprint arXiv:​1711.​03536 (2017)
9.
Zurück zum Zitat Fouhey, D.F., Gupta, A., Zisserman, A.: 3D shape attributes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1516–1524 (2016) Fouhey, D.F., Gupta, A., Zisserman, A.: 3D shape attributes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1516–1524 (2016)
11.
Zurück zum Zitat Gatys, L.A., Ecker, A.S., Bethge, M., Hertzmann, A., Shechtman, E.: Controlling perceptual factors in neural style transfer. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3730–3738 (2017) Gatys, L.A., Ecker, A.S., Bethge, M., Hertzmann, A., Shechtman, E.: Controlling perceptual factors in neural style transfer. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3730–3738 (2017)
12.
Zurück zum Zitat Hatt, M., Klonk, C.: Art History: A Critical Introduction to Its Methods. Manchester University Press, Manchester (2006) Hatt, M., Klonk, C.: Art History: A Critical Introduction to Its Methods. Manchester University Press, Manchester (2006)
13.
Zurück zum Zitat Hristova, S.: Images as data: cultural analytics and Aby Warburg’s Mnemosyne. Int. J. Digit. Art Hist. (2), 117–135 (2016) Hristova, S.: Images as data: cultural analytics and Aby Warburg’s Mnemosyne. Int. J. Digit. Art Hist. (2), 117–135 (2016)
14.
Zurück zum Zitat Johnson, J., Karpathy, A., Fei-Fei, L.: DenseCap: fully convolutional localization networks for dense captioning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4565–4574 (2016) Johnson, J., Karpathy, A., Fei-Fei, L.: DenseCap: fully convolutional localization networks for dense captioning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4565–4574 (2016)
16.
Zurück zum Zitat Karpathy, A., Fei-Fei, L.: Deep visual-semantic alignments for generating image descriptions. In: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pp. 3128–3137 (2015) Karpathy, A., Fei-Fei, L.: Deep visual-semantic alignments for generating image descriptions. In: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pp. 3128–3137 (2015)
17.
Zurück zum Zitat Kienle, M.: Digital art history “beyond the digitized slide library”: an interview with Johanna Drucker and Miriam Posner. Artl@s Bull. 6(3), 9 (2017) Kienle, M.: Digital art history “beyond the digitized slide library”: an interview with Johanna Drucker and Miriam Posner. Artl@s Bull. 6(3), 9 (2017)
18.
Zurück zum Zitat Kinghorn, P., Zhang, L., Shao, L.: A region-based image caption generator with refined descriptions. Neurocomputing 272, 416–424 (2018)CrossRef Kinghorn, P., Zhang, L., Shao, L.: A region-based image caption generator with refined descriptions. Neurocomputing 272, 416–424 (2018)CrossRef
19.
Zurück zum Zitat Krause, J., Johnson, J., Krishna, R., Fei-Fei, L.: A hierarchical approach for generating descriptive image paragraphs. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3337–3345. IEEE (2017) Krause, J., Johnson, J., Krishna, R., Fei-Fei, L.: A hierarchical approach for generating descriptive image paragraphs. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3337–3345. IEEE (2017)
20.
Zurück zum Zitat Li, J., Yao, L., Hendriks, E., Wang, J.Z.: Rhythmic brushstrokes distinguish van Gogh from his contemporaries: findings via automated brushstroke extraction. IEEE Tran. Pattern Anal. Mach. Intell. 34(6), 1159–1176 (2012)CrossRef Li, J., Yao, L., Hendriks, E., Wang, J.Z.: Rhythmic brushstrokes distinguish van Gogh from his contemporaries: findings via automated brushstroke extraction. IEEE Tran. Pattern Anal. Mach. Intell. 34(6), 1159–1176 (2012)CrossRef
21.
Zurück zum Zitat Li, L.J., Socher, R., Fei-Fei, L.: Towards total scene understanding: classification, annotation and segmentation in an automatic framework. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 2036–2043. IEEE (2009) Li, L.J., Socher, R., Fei-Fei, L.: Towards total scene understanding: classification, annotation and segmentation in an automatic framework. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 2036–2043. IEEE (2009)
22.
Zurück zum Zitat van der Maaten, L., Erdmann, R.G.: Automatic thread-level canvas analysis: a machine-learning approach to analyzing the canvas of paintings. IEEE Signal Process. Mag. 32(4), 38–45 (2015)CrossRef van der Maaten, L., Erdmann, R.G.: Automatic thread-level canvas analysis: a machine-learning approach to analyzing the canvas of paintings. IEEE Signal Process. Mag. 32(4), 38–45 (2015)CrossRef
24.
Zurück zum Zitat Parikh, D., Grauman, K.: Relative attributes. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 503–510. IEEE (2011) Parikh, D., Grauman, K.: Relative attributes. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 503–510. IEEE (2011)
25.
Zurück zum Zitat Riegl, A., Castriota, D., Zerner, H.: Problems of Style: Foundations for a History of Ornament. Princeton University Press, Princeton (1992) Riegl, A., Castriota, D., Zerner, H.: Problems of Style: Foundations for a History of Ornament. Princeton University Press, Princeton (1992)
27.
Zurück zum Zitat Tan, W.R., Chan, C.S., Aguirre, H.E., Tanaka, K.: Ceci n’est pas une pipe: a deep convolutional network for fine-art paintings classification. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3703–3707. IEEE (2016) Tan, W.R., Chan, C.S., Aguirre, H.E., Tanaka, K.: Ceci n’est pas une pipe: a deep convolutional network for fine-art paintings classification. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3703–3707. IEEE (2016)
28.
Zurück zum Zitat Underhill, J.: In conversation with CyArk: digital heritage in the 21st century. Int. J. Digit. Art Hist. (3), 111–123 (2018) Underhill, J.: In conversation with CyArk: digital heritage in the 21st century. Int. J. Digit. Art Hist. (3), 111–123 (2018)
29.
Zurück zum Zitat Warburg, A.: Der Bilderatlas Mnemosyne, vol. 2. Akademie Verlag, Berlin (2008) Warburg, A.: Der Bilderatlas Mnemosyne, vol. 2. Akademie Verlag, Berlin (2008)
30.
Zurück zum Zitat Wilber, M.J., Fang, C., Jin, H., Hertzmann, A., Collomosse, J., Belongie, S.: BAM! the behance artistic media dataset for recognition beyond photography. In: Proceedings of the ICCV, vol. 1, pp. 1211–1220 (2017) Wilber, M.J., Fang, C., Jin, H., Hertzmann, A., Collomosse, J., Belongie, S.: BAM! the behance artistic media dataset for recognition beyond photography. In: Proceedings of the ICCV, vol. 1, pp. 1211–1220 (2017)
31.
Zurück zum Zitat Wölfflin, H.: Principles of Art History. Courier Corporation, Chelmsford (2012) Wölfflin, H.: Principles of Art History. Courier Corporation, Chelmsford (2012)
32.
Zurück zum Zitat Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 2242–2251. IEEE, October 2017 Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 2242–2251. IEEE, October 2017
Metadaten
Titel
Reflecting on How Artworks Are Processed and Analyzed by Computer Vision
verfasst von
Sabine Lang
Björn Ommer
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-11012-3_49