Skip to main content

2016 | OriginalPaper | Buchkapitel

Imaging Novecento. A Mobile App for Automatic Recognition of Artworks and Transfer of Artistic Styles

verfasst von : Federico Becattini, Andrea Ferracani, Lea Landucci, Daniele Pezzatini, Tiberio Uricchio, Alberto Del Bimbo

Erschienen in: Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Imaging Novecento is a native mobile application that can be used to get insights on artworks in the “Museo Novecento” in Florence, IT. The App provides smart paradigms of interaction to ease the learning of the Italian art history of the 20\(^{th}\) century. Imaging Novecento exploits automatic approaches and gamification techniques with recreational and educational purposes. Its main goal is to reduce the cognitive effort of users versus the complexity and the numerosity of artworks present in the museum. To achieve this the App provides automatic artwork recognition. It also uses gaming, in terms of a playful user interface which features state-of-the-art algorithms for artistic style transfer. Automated processes are exploited as a mean to attract visitors, approaching them to even lesser known aspects of the history of art.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Anderson, A.G., Berg, C.P., Mossing, D.P., Olshausen, B.A.: Deepmovie: using optical flow and deep neural networks to stylize movies. arXiv preprint arXiv:1605.08153 (2016) Anderson, A.G., Berg, C.P., Mossing, D.P., Olshausen, B.A.: Deepmovie: using optical flow and deep neural networks to stylize movies. arXiv preprint arXiv:​1605.​08153 (2016)
2.
Zurück zum Zitat Anwer, R.M., Khan, F.S., van de Weijer, J., Laaksonen, J.: Combining holistic and part-based deep representations for computational painting categorization. In: Proceedings of the 2016 ACM ICMR, pp. 339–342. ACM (2016) Anwer, R.M., Khan, F.S., van de Weijer, J., Laaksonen, J.: Combining holistic and part-based deep representations for computational painting categorization. In: Proceedings of the 2016 ACM ICMR, pp. 339–342. ACM (2016)
3.
Zurück zum Zitat Ballagas, R., Rohs, M., Sheridan, J.G., Borchers, J.: Byod: bring your own device. In: Proceedings of the Workshop on Ubiquitous Display Environments, Ubicomp, vol. 2004 (2004) Ballagas, R., Rohs, M., Sheridan, J.G., Borchers, J.: Byod: bring your own device. In: Proceedings of the Workshop on Ubiquitous Display Environments, Ubicomp, vol. 2004 (2004)
4.
Zurück zum Zitat Baraldi, L., Paci, F., Serra, G., Benini, L., Cucchiara, R.: Gesture recognition using wearable vision sensors to enhance visitors Museum experiences. IEEE Sens. J. 15(5), 2705–2714 (2015) Baraldi, L., Paci, F., Serra, G., Benini, L., Cucchiara, R.: Gesture recognition using wearable vision sensors to enhance visitors Museum experiences. IEEE Sens. J. 15(5), 2705–2714 (2015)
5.
Zurück zum Zitat Chen, C.Y., Chang, B.R., Huang, P.S.: Multimedia augmented reality information system for Museum guidance. Pers. Ubiquit. Comput. 18(2), 315–322 (2014)CrossRef Chen, C.Y., Chang, B.R., Huang, P.S.: Multimedia augmented reality information system for Museum guidance. Pers. Ubiquit. Comput. 18(2), 315–322 (2014)CrossRef
6.
Zurück zum Zitat Crowley, E., Zisserman, A.: The state of the art: object retrieval in paintings using discriminative regions. In: BMVC (2014) Crowley, E., Zisserman, A.: The state of the art: object retrieval in paintings using discriminative regions. In: BMVC (2014)
7.
Zurück zum Zitat Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM (2001) Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM (2001)
8.
Zurück zum Zitat Elgammal, A., Lee, C.S.: Separating style and content on a nonlinear manifold. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 1, pp. I–478. IEEE (2004) Elgammal, A., Lee, C.S.: Separating style and content on a nonlinear manifold. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 1, pp. I–478. IEEE (2004)
9.
Zurück zum Zitat Fanini, B., d’Annibale, E., Demetrescu, E., Ferdani, D., Pagano, A.: Engaging and shared gesture-based interaction for museums the case study of K2R international expo in rome. In: 2015 Digital Heritage, vol. 1, pp. 263–270. IEEE (2015) Fanini, B., d’Annibale, E., Demetrescu, E., Ferdani, D., Pagano, A.: Engaging and shared gesture-based interaction for museums the case study of K2R international expo in rome. In: 2015 Digital Heritage, vol. 1, pp. 263–270. IEEE (2015)
10.
Zurück zum Zitat Fineschi, A., Pozzebon, A.: A 3D virtual tour of the Santa Maria della Scala Museum Complex in Siena, Italy, based on the use of Oculus RIFT HMD. In: 2015 International Conference on 3D Imaging (IC3D), pp. 1–5. IEEE (2015) Fineschi, A., Pozzebon, A.: A 3D virtual tour of the Santa Maria della Scala Museum Complex in Siena, Italy, based on the use of Oculus RIFT HMD. In: 2015 International Conference on 3D Imaging (IC3D), pp. 1–5. IEEE (2015)
12.
Zurück zum Zitat He, Z., Cui, B., Zhou, W., Yokoi, S.: A proposal of interaction system between visitor and collection in Museum hall by iBeacon. In: 2015 10th International Conference on Computer Science & Education (ICCSE), pp. 427–430. IEEE (2015) He, Z., Cui, B., Zhou, W., Yokoi, S.: A proposal of interaction system between visitor and collection in Museum hall by iBeacon. In: 2015 10th International Conference on Computer Science & Education (ICCSE), pp. 427–430. IEEE (2015)
13.
Zurück zum Zitat Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: Convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM MM, pp. 675–678. ACM (2014) Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: Convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM MM, pp. 675–678. ACM (2014)
14.
Zurück zum Zitat Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. arXiv preprint arXiv:1603.08155 (2016) Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. arXiv preprint arXiv:​1603.​08155 (2016)
15.
Zurück zum Zitat Johnson, L., Adams Becker, S., Estrada, V., Freeman, A.: The NMC Horizon Report: 2015 Museum Edition. ERIC (2015) Johnson, L., Adams Becker, S., Estrada, V., Freeman, A.: The NMC Horizon Report: 2015 Museum Edition. ERIC (2015)
16.
Zurück zum Zitat Karayev, S., Trentacoste, M., Han, H., Agarwala, A., Darrell, T., Hertzmann, A., Winnemoeller, H.: Recognizing image style. arXiv preprint arXiv:1311.3715 (2013) Karayev, S., Trentacoste, M., Han, H., Agarwala, A., Darrell, T., Hertzmann, A., Winnemoeller, H.: Recognizing image style. arXiv preprint arXiv:​1311.​3715 (2013)
17.
Zurück zum Zitat Kyprianidis, J.E., Collomosse, J., Wang, T., Isenberg, T.: State of the “Art”: a taxonomy of artistic stylization techniques for images and video. IEEE Trans. Vis. Comput. Graph. 19(5), 866–885 (2013)CrossRef Kyprianidis, J.E., Collomosse, J., Wang, T., Isenberg, T.: State of the “Art”: a taxonomy of artistic stylization techniques for images and video. IEEE Trans. Vis. Comput. Graph. 19(5), 866–885 (2013)CrossRef
18.
Zurück zum Zitat Malomo, L., Banterle, F., Pingi, P., Gabellone, F., Scopigno, R.: Virtualtour: a system for exploring cultural heritage sites in an immersive way. In: 2015 Digital Heritage, vol. 1, pp. 309–312. IEEE (2015) Malomo, L., Banterle, F., Pingi, P., Gabellone, F., Scopigno, R.: Virtualtour: a system for exploring cultural heritage sites in an immersive way. In: 2015 Digital Heritage, vol. 1, pp. 309–312. IEEE (2015)
19.
Zurück zum Zitat Mayer, R.E., Moreno, R.: Nine ways to reduce cognitive load in multimedia learning. Educ. Psychol. 38(1), 43–52 (2003)CrossRef Mayer, R.E., Moreno, R.: Nine ways to reduce cognitive load in multimedia learning. Educ. Psychol. 38(1), 43–52 (2003)CrossRef
20.
Zurück zum Zitat Negruşa, A.L., Toader, V., Sofică, A., Tutunea, M.F., Rus, R.V.: Exploring gamification techniques and applications for sustainable tourism. Sustainability 7(8), 11160–11189 (2015)CrossRef Negruşa, A.L., Toader, V., Sofică, A., Tutunea, M.F., Rus, R.V.: Exploring gamification techniques and applications for sustainable tourism. Sustainability 7(8), 11160–11189 (2015)CrossRef
21.
Zurück zum Zitat Pagano, A., Armone, G., De Sanctis, E.: Virtual Museums and audience studies: the case of “Keys to Rome” exhibition. In: 2015 Digital Heritage, vol. 1, pp. 373–376. IEEE (2015) Pagano, A., Armone, G., De Sanctis, E.: Virtual Museums and audience studies: the case of “Keys to Rome” exhibition. In: 2015 Digital Heritage, vol. 1, pp. 373–376. IEEE (2015)
22.
Zurück zum Zitat Park, S.: The effects of social cue principles on cognitive load, situational interest, motivation, and achievement in pedagogical agent multimedia learning. J. Educ. Technol. Soc. 4, 211–229 (2015) Park, S.: The effects of social cue principles on cognitive load, situational interest, motivation, and achievement in pedagogical agent multimedia learning. J. Educ. Technol. Soc. 4, 211–229 (2015)
23.
Zurück zum Zitat Peng, K.C., Chen, T.: Cross-layer features in convolutional neural networks for generic classification tasks. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3057–3061. IEEE (2015) Peng, K.C., Chen, T.: Cross-layer features in convolutional neural networks for generic classification tasks. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3057–3061. IEEE (2015)
24.
Zurück zum Zitat Reiners, T., Wood, L.C. (eds.): Gamification in Education and Business. Springer International Publishing, Switzerland (2015) Reiners, T., Wood, L.C. (eds.): Gamification in Education and Business. Springer International Publishing, Switzerland (2015)
25.
Zurück zum Zitat Ruf, B., Kokiopoulou, E., Detyniecki, M.: Mobile Museum guide based on fast SIFT recognition. In: Detyniecki, M., Leiner, U., Nürnberger, A. (eds.) AMR 2008. LNCS, vol. 5811, pp. 170–183. Springer, Heidelberg (2010). doi:10.1007/978-3-642-14758-6_14CrossRef Ruf, B., Kokiopoulou, E., Detyniecki, M.: Mobile Museum guide based on fast SIFT recognition. In: Detyniecki, M., Leiner, U., Nürnberger, A. (eds.) AMR 2008. LNCS, vol. 5811, pp. 170–183. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-14758-6_​14CrossRef
26.
Zurück zum Zitat Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556 (2014)
27.
Zurück zum Zitat de Sousa Borges, S., Durelli, V.H., Reis, H.M., Isotani, S.: A systematic mapping on gamification applied to education. In: Proceedings of the 29th Annual ACM Symposium on Applied Computing, pp. 216–222. ACM (2014) de Sousa Borges, S., Durelli, V.H., Reis, H.M., Isotani, S.: A systematic mapping on gamification applied to education. In: Proceedings of the 29th Annual ACM Symposium on Applied Computing, pp. 216–222. ACM (2014)
28.
Zurück zum Zitat Temmermans, F., Jansen, B., Deklerck, R., Schelkens, P., Cornelis, J.: The mobile Museum guide: artwork recognition with eigenpaintings and SURF. In: WIAMIS 2011, Delft, The Netherlands, April 13–15, 2011. TU Delft; EWI; MM; PRB (2011) Temmermans, F., Jansen, B., Deklerck, R., Schelkens, P., Cornelis, J.: The mobile Museum guide: artwork recognition with eigenpaintings and SURF. In: WIAMIS 2011, Delft, The Netherlands, April 13–15, 2011. TU Delft; EWI; MM; PRB (2011)
29.
Zurück zum Zitat Tenenbaum, J.B., Freeman, W.T.: Separating style and content with bilinear models. Neural Comput. 12(6), 1247–1283 (2000)CrossRef Tenenbaum, J.B., Freeman, W.T.: Separating style and content with bilinear models. Neural Comput. 12(6), 1247–1283 (2000)CrossRef
30.
Zurück zum Zitat Xie, X., Tian, F., Seah, H.S.: Feature guided texture synthesis (FGTS) for artistic style transfer. In: Proceedings of the 2nd International Conference on Digital Interactive Media in Entertainment and Arts, pp. 44–49. ACM (2007) Xie, X., Tian, F., Seah, H.S.: Feature guided texture synthesis (FGTS) for artistic style transfer. In: Proceedings of the 2nd International Conference on Digital Interactive Media in Entertainment and Arts, pp. 44–49. ACM (2007)
31.
Zurück zum Zitat Yoon, S.A., Wang, J.: Making the invisible visible in science museums through augmented reality devices. TechTrends 58(1), 49–55 (2014)CrossRef Yoon, S.A., Wang, J.: Making the invisible visible in science museums through augmented reality devices. TechTrends 58(1), 49–55 (2014)CrossRef
Metadaten
Titel
Imaging Novecento. A Mobile App for Automatic Recognition of Artworks and Transfer of Artistic Styles
verfasst von
Federico Becattini
Andrea Ferracani
Lea Landucci
Daniele Pezzatini
Tiberio Uricchio
Alberto Del Bimbo
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48496-9_62

Neuer Inhalt