Skip to main content
Top

2021 | OriginalPaper | Chapter

Stylistic Classification of Historical Violins: A Deep Learning Approach

Authors : Piercarlo Dondi, Luca Lombardi, Marco Malagodi, Maurizio Licchelli

Published in: Pattern Recognition. ICPR International Workshops and Challenges

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Stylistic study of artworks is a well-known problem in the Cultural Heritage field. Traditional artworks, such as statues and paintings, have been extensively studied by art experts, producing standard methodologies to analyze and recognize the style of an artist. In this context, the case of historical violins is peculiar. Even if the main stylistic features of a violin are known, only few experts are capable to attribute a violin to its maker with a high degree of certainty. This paper presents a study about the use of deep learning to discriminate a violin style. Firstly, we collected images of 17th–18th century violins held, or in temporary loan, at “Museo del Violino” of Cremona (Italy) to be used as reference dataset. Then, we tested the performances of three state-of-the-art CNNs (VGG16, ResNet50 and InceptionV3) on a binary classification (Stradivari vs. NotStradivari). The best performing model was able to achieve 77.27% accuracy and 0.72 F1 score. A promising result, keeping in mind the limited amount of data and the complexity of the task, even for human experts. Finally, we compared the regions of interest identified by the network with the regions of interest identified in a previous eye tracking study conducted on expert luthiers, to highlight similarity and differences between the two behaviors.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Arora, R.S., Elgammal, A.: Towards automated classification of fine-art painting style: a comparative study. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3541–3544 (2012) Arora, R.S., Elgammal, A.: Towards automated classification of fine-art painting style: a comparative study. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3541–3544 (2012)
6.
go back to reference Dondi, P., Lombardi, L., Invernizzi, C., Rovetta, T., Malagodi, M., Licchelli, M.: Automatic analysis of UV-induced fluorescence imagery of historical violins. J. Comput. Cult. Herit. 10(2), 12:1–12:13 (2017). https://doi.org/10.1145/3051472 Dondi, P., Lombardi, L., Invernizzi, C., Rovetta, T., Malagodi, M., Licchelli, M.: Automatic analysis of UV-induced fluorescence imagery of historical violins. J. Comput. Cult. Herit. 10(2), 12:1–12:13 (2017). https://​doi.​org/​10.​1145/​3051472
7.
go back to reference Dondi, P., Lombardi, L., Malagodi, M., Licchelli, M., Rovetta, T., Invernizzi, C.: An interactive tool for speed up the analysis of UV images of stradivari violins. In: Murino, V., Puppo, E., Sona, D., Cristani, M., Sansone, C. (eds.) ICIAP 2015. LNCS, vol. 9281, pp. 103–110. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-23222-5_13CrossRef Dondi, P., Lombardi, L., Malagodi, M., Licchelli, M., Rovetta, T., Invernizzi, C.: An interactive tool for speed up the analysis of UV images of stradivari violins. In: Murino, V., Puppo, E., Sona, D., Cristani, M., Sansone, C. (eds.) ICIAP 2015. LNCS, vol. 9281, pp. 103–110. Springer, Cham (2015). https://​doi.​org/​10.​1007/​978-3-319-23222-5_​13CrossRef
8.
go back to reference Elgammal, A., Mazzone, M., Liu, B., Kim, D., Elhoseiny, M.: The shape of art history in the eyes of the machine. arXiv preprint arXiv:1801.07729 (2018) Elgammal, A., Mazzone, M., Liu, B., Kim, D., Elhoseiny, M.: The shape of art history in the eyes of the machine. arXiv preprint arXiv:​1801.​07729 (2018)
9.
go back to reference Gatys, L.A., Ecker, A.S., Bethge, M.: Image style transfer using convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016 Gatys, L.A., Ecker, A.S., Bethge, M.: Image style transfer using convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016
11.
go back to reference Invernizzi, C., Fiocco, G., Iwanicka, M., Kowalska, M., Targowski, P., Blümich, B., Rehorn, C., Gabrielli, V., Bersani, D., Licchelli, M., Malagodi, M.: Non-invasive mobile technology to study the stratigraphy of ancient cremonese violins: OCT, NMR-MOUSE, XRF and reflection FT-IR spectroscopy. Microchem. J. 155, 104754 (2020). https://doi.org/10.1016/j.microc.2020.104754CrossRef Invernizzi, C., Fiocco, G., Iwanicka, M., Kowalska, M., Targowski, P., Blümich, B., Rehorn, C., Gabrielli, V., Bersani, D., Licchelli, M., Malagodi, M.: Non-invasive mobile technology to study the stratigraphy of ancient cremonese violins: OCT, NMR-MOUSE, XRF and reflection FT-IR spectroscopy. Microchem. J. 155, 104754 (2020). https://​doi.​org/​10.​1016/​j.​microc.​2020.​104754CrossRef
14.
go back to reference Lombardi, T.E.: The Classification of Style in Fine-Art Painting. Citeseer (2005) Lombardi, T.E.: The Classification of Style in Fine-Art Painting. Citeseer (2005)
17.
go back to reference Puthenputhussery, A., Liu, Q., Liu, C.: Color multi-fusion fisher vector feature for fine art painting categorization and influence analysis. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–9. IEEE (2016) Puthenputhussery, A., Liu, Q., Liu, C.: Color multi-fusion fisher vector feature for fine art painting categorization and influence analysis. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–9. IEEE (2016)
20.
go back to reference Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 618–626 (2017). https://doi.org/10.1109/ICCV.2017.74 Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 618–626 (2017). https://​doi.​org/​10.​1109/​ICCV.​2017.​74
21.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556 (2014)
23.
Metadata
Title
Stylistic Classification of Historical Violins: A Deep Learning Approach
Authors
Piercarlo Dondi
Luca Lombardi
Marco Malagodi
Maurizio Licchelli
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-68787-8_8

Premium Partner