Skip to main content
Erschienen in: Universal Access in the Information Society 4/2022

12.05.2021 | Long Paper

Supporting a crowd-powered accessible online art gallery for people with visual impairments: a feasibility study

verfasst von: Nahyun Kwon, Yunjung Lee, Uran Oh

Erschienen in: Universal Access in the Information Society | Ausgabe 4/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

While people with visual impairments are interested in artwork as much as their sighted peers, their experience is limited to few selective artworks that are exhibited at certain museums. To enable people with visual impairments to access and appreciate as many artworks as possible at ease, we propose an online art gallery that allows users to explore different parts of a painting displayed on their touchscreen-based devices while listening to corresponding verbal descriptions of the touched part on the screen. To investigate the scalability of our approach, we first explored if anonymous crowd who may not have expertise in art are capable of providing visual descriptions of artwork as a preliminary study. Then we conducted a user study with 9 participants with visual impairments to explore the potential of our system for independent artwork appreciation by assessing if and how well the system supports 4 steps of Feldman Model of Criticism. The findings suggest that visual descriptions of artworks produced by an anonymous crowd are sufficient for people with visual impairments to interpret and appreciate paintings with their own judgments which is different from existing approaches that focused on delivering descriptions and opinions written by art experts. Based on the lessons learned from the study, we plan to collect visual descriptions of a greater number of artwork and distribute our online art gallery publicly to make more paintings accessible for people with visual impairments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Anderson, T.: A structure for pedagogical art criticism. Stud. Art Educ. 30(1), 28–38 (1988)CrossRef Anderson, T.: A structure for pedagogical art criticism. Stud. Art Educ. 30(1), 28–38 (1988)CrossRef
2.
Zurück zum Zitat Anderson, T.: The content of art criticism. Art Educ. 44(1), 17–24 (1991)CrossRef Anderson, T.: The content of art criticism. Art Educ. 44(1), 17–24 (1991)CrossRef
3.
Zurück zum Zitat Arnheim, R.: Perceptual aspects of art for the blind. J. Aesth. Educ. 24(3), 57–65 (1990)CrossRef Arnheim, R.: Perceptual aspects of art for the blind. J. Aesth. Educ. 24(3), 57–65 (1990)CrossRef
4.
Zurück zum Zitat Asakawa, S., Guerreiro, J., Ahmetovic, D., Kitani, K.M., Asakawa, C.: The present and future of museum accessibility for people with visual impairments. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 382–384 . ACM (2018) Asakawa, S., Guerreiro, J., Ahmetovic, D., Kitani, K.M., Asakawa, C.: The present and future of museum accessibility for people with visual impairments. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 382–384 . ACM (2018)
5.
Zurück zum Zitat Asakawa, S., Guerreiro, J., Sato, D., Takagi, H., Ahmetovic, D., Gonzalez, D., Kitani, K.M., Asakawa, C.: An independent and interactive museum experience for blind people. In: Proceedings of the 16th Web For All 2019 Personalization-Personalizing the Web, pp. 1–9. ACM (2019) Asakawa, S., Guerreiro, J., Sato, D., Takagi, H., Ahmetovic, D., Gonzalez, D., Kitani, K.M., Asakawa, C.: An independent and interactive museum experience for blind people. In: Proceedings of the 16th Web For All 2019 Personalization-Personalizing the Web, pp. 1–9. ACM (2019)
6.
Zurück zum Zitat Cantoni, V., Lombardi, L., Setti, A., Gyoshev, S., Karastoyanov, D., Stoimenov, N.: Art masterpieces accessibility for blind and visually impaired people. In: International Conference on Computers Helping People with Special Needs, pp. 267–274. Springer (2018) Cantoni, V., Lombardi, L., Setti, A., Gyoshev, S., Karastoyanov, D., Stoimenov, N.: Art masterpieces accessibility for blind and visually impaired people. In: International Conference on Computers Helping People with Special Needs, pp. 267–274. Springer (2018)
7.
Zurück zum Zitat Card, M.: Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann (1999) Card, M.: Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann (1999)
8.
Zurück zum Zitat Cavazos Quero, L., Iranzo Bartolomé, J., Lee, S., Han, E., Kim, S., Cho, J.: An interactive multimodal guide to improve art accessibility for blind people. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 346–348. ACM (2018) Cavazos Quero, L., Iranzo Bartolomé, J., Lee, S., Han, E., Kim, S., Cho, J.: An interactive multimodal guide to improve art accessibility for blind people. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 346–348. ACM (2018)
9.
Zurück zum Zitat Clements, R.D.: The inductive method of teaching visual art criticism. J. Aesth. Educ. 13(3), 67–78 (1979)CrossRef Clements, R.D.: The inductive method of teaching visual art criticism. J. Aesth. Educ. 13(3), 67–78 (1979)CrossRef
10.
Zurück zum Zitat Feldman, E.B.: Varieties of visual experience. Prentice Hall, Englewood Cliffs, NJ (1981) Feldman, E.B.: Varieties of visual experience. Prentice Hall, Englewood Cliffs, NJ (1981)
11.
Zurück zum Zitat Feldman, E.B.: Practical art criticism Prentice Hall, Englewoods Cliff, NJ (1994) Feldman, E.B.: Practical art criticism Prentice Hall, Englewoods Cliff, NJ (1994)
12.
Zurück zum Zitat Goncu, C., Marriott, K.: Creating ebooks with accessible graphics content. In: Proceedings of the 2015 ACM Symposium on Document Engineering, pp. 89–92 (2015) Goncu, C., Marriott, K.: Creating ebooks with accessible graphics content. In: Proceedings of the 2015 ACM Symposium on Document Engineering, pp. 89–92 (2015)
13.
Zurück zum Zitat Goodman, J.K., Paolacci, G.: Crowdsourcing consumer research. J. Consum. Res. 44(1), 196–210 (2017)CrossRef Goodman, J.K., Paolacci, G.: Crowdsourcing consumer research. J. Consum. Res. 44(1), 196–210 (2017)CrossRef
14.
Zurück zum Zitat Gyoshev, S., Karastoyanov, D., Stoimenov, N., Cantoni, V., Lombardi, L., Setti, A.: Exploiting a graphical braille display for art masterpieces. In: International Conference on Computers Helping People with Special Needs, pp. 237–245. Springer (2018) Gyoshev, S., Karastoyanov, D., Stoimenov, N., Cantoni, V., Lombardi, L., Setti, A.: Exploiting a graphical braille display for art masterpieces. In: International Conference on Computers Helping People with Special Needs, pp. 237–245. Springer (2018)
15.
Zurück zum Zitat Handa, K., Dairoku, H., Toriyama, Y.: Investigation of priority needs in terms of museum service accessibility for visually impaired visitors. Brit. J. Vis. Impair. 28(3), 221–234 (2010)CrossRef Handa, K., Dairoku, H., Toriyama, Y.: Investigation of priority needs in terms of museum service accessibility for visually impaired visitors. Brit. J. Vis. Impair. 28(3), 221–234 (2010)CrossRef
16.
Zurück zum Zitat Hayhoe, S.: Expanding our vision of museum education and perception: An analysis of three case studies of independent blind arts learners. Harv. Educ. Rev. 83(1), 67–86 (2013)CrossRef Hayhoe, S.: Expanding our vision of museum education and perception: An analysis of three case studies of independent blind arts learners. Harv. Educ. Rev. 83(1), 67–86 (2013)CrossRef
17.
Zurück zum Zitat Holloway, L., Marriott, K., Butler, M., Borning, A.: Making sense of art: access for gallery visitors with vision impairments. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI ’19, pp. 20:1–20:12. ACM, New York, NY, USA (2019). https://doi.org/10.1145/3290605.3300250 Holloway, L., Marriott, K., Butler, M., Borning, A.: Making sense of art: access for gallery visitors with vision impairments. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI ’19, pp. 20:1–20:12. ACM, New York, NY, USA (2019). https://​doi.​org/​10.​1145/​3290605.​3300250
18.
Zurück zum Zitat Ipeirotis, P.G.: Analyzing the amazon mechanical turk marketplace. Crossroads, The ACM Magazine for Students, XRDS (2010) (forthcoming) Ipeirotis, P.G.: Analyzing the amazon mechanical turk marketplace. Crossroads, The ACM Magazine for Students, XRDS (2010) (forthcoming)
19.
Zurück zum Zitat Iranzo Bartolome, J., Cavazos Quero, L., Kim, S., Um, M.Y., Cho, J.: Exploring art with a voice controlled multimodal guide for blind people. In: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction, pp. 383–390. ACM (2019) Iranzo Bartolome, J., Cavazos Quero, L., Kim, S., Um, M.Y., Cho, J.: Exploring art with a voice controlled multimodal guide for blind people. In: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction, pp. 383–390. ACM (2019)
20.
Zurück zum Zitat Janes, K.H.: Great Paintings - The World's Masterpieces Explored and Explained. Dorling Kindersley, London, UK (2012) Janes, K.H.: Great Paintings - The World's Masterpieces Explored and Explained. Dorling Kindersley, London, UK (2012)
21.
Zurück zum Zitat Kwon, N., Koh, Y., Oh, U.: Supporting object-level exploration of artworks by touch for people with visual impairments. In: The 21st International ACM SIGACCESS Conference on Computers and Accessibility, Association for Computing Machinery, ASSETS ’19, pp. 600-602. New York, NY, USA (2019) https://doi.org/10.1145/3308561.3354620 Kwon, N., Koh, Y., Oh, U.: Supporting object-level exploration of artworks by touch for people with visual impairments. In: The 21st International ACM SIGACCESS Conference on Computers and Accessibility, Association for Computing Machinery, ASSETS ’19, pp. 600-602. New York, NY, USA (2019) https://​doi.​org/​10.​1145/​3308561.​3354620
22.
Zurück zum Zitat Leimeister, J.M., Huber, M., Bretschneider, U., Krcmar, H.: Leveraging crowdsourcing: activation-supporting components for it-based ideas competition. J. Manage. Inform. Syst. 26(1), 197–224 (2009)CrossRef Leimeister, J.M., Huber, M., Bretschneider, U., Krcmar, H.: Leveraging crowdsourcing: activation-supporting components for it-based ideas competition. J. Manage. Inform. Syst. 26(1), 197–224 (2009)CrossRef
23.
Zurück zum Zitat Lichtenstein, S., Parker, C.M.: Wikipedia model for collective intelligence: a review of information quality. Int. J. Knowl. Learn. 5(3), 254 (2009)CrossRef Lichtenstein, S., Parker, C.M.: Wikipedia model for collective intelligence: a review of information quality. Int. J. Knowl. Learn. 5(3), 254 (2009)CrossRef
24.
Zurück zum Zitat Low, C., McCamey, E., Gleason, C., Carrington, P., Bigham, J.P., Pavel, A.: Twitter a11y: A browser extension to describe images. In: The 21st International ACM SIGACCESS Conference on Computers and Accessibility, Association for Computing Machinery, ASSETS ’19, pp. 551–553. New York, NY, USA (2019). https://doi.org/10.1145/3308561.3354629 Low, C., McCamey, E., Gleason, C., Carrington, P., Bigham, J.P., Pavel, A.: Twitter a11y: A browser extension to describe images. In: The 21st International ACM SIGACCESS Conference on Computers and Accessibility, Association for Computing Machinery, ASSETS ’19, pp. 551–553. New York, NY, USA (2019). https://​doi.​org/​10.​1145/​3308561.​3354629
27.
Zurück zum Zitat Mittler, G.A.: Art in focus. McGraw-Hill Education, NY, USA (1994) Mittler, G.A.: Art in focus. McGraw-Hill Education, NY, USA (1994)
28.
Zurück zum Zitat Morris, M.R., Johnson, J., Bennett, C.L., Cutrell, E.: Rich representations of visual content for screen reader users. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 59. ACM (2018) Morris, M.R., Johnson, J., Bennett, C.L., Cutrell, E.: Rich representations of visual content for screen reader users. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 59. ACM (2018)
31.
Zurück zum Zitat Perkins, D.N.: The Intelligent Eye: Learning to Think by Looking at Art, vol. 4. Getty Publications (1994) Perkins, D.N.: The Intelligent Eye: Learning to Think by Looking at Art, vol. 4. Getty Publications (1994)
32.
Zurück zum Zitat Prater, M .: Art Criticism Modifying the Formalist Approach, Tayler & Francis, Milton Park, UK (2002) Prater, M .: Art Criticism Modifying the Formalist Approach, Tayler & Francis, Milton Park, UK (2002)
33.
Zurück zum Zitat Rector, K., Salmon, K., Thornton, D., Joshi, N., Morris, M.R.: Eyes-free art: exploring proxemic audio interfaces for blind and low vision art engagement. Proc. ACM Interact. Mobile Wear. Ubiquit. Technol. 1(3), 93 (2017) Rector, K., Salmon, K., Thornton, D., Joshi, N., Morris, M.R.: Eyes-free art: exploring proxemic audio interfaces for blind and low vision art engagement. Proc. ACM Interact. Mobile Wear. Ubiquit. Technol. 1(3), 93 (2017)
34.
Zurück zum Zitat Reinholt, K., Guinness, D., Kane, S.K.: Eyedescribe: combining eye gaze and speech to automatically create accessible touch screen artwork. In: Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces, ISS ’19, pp. 101–112. ACM, New York, NY, USA (2019). https://doi.org/10.1145/3343055.3359722 Reinholt, K., Guinness, D., Kane, S.K.: Eyedescribe: combining eye gaze and speech to automatically create accessible touch screen artwork. In: Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces, ISS ’19, pp. 101–112. ACM, New York, NY, USA (2019). https://​doi.​org/​10.​1145/​3343055.​3359722
35.
Zurück zum Zitat Rodrigues, J.B., Ferreira, A.V.M., Maia, I.M.O., Junior, G.B., de Almeida, J.D.S., de Paiva, A.C. : Image processing of artworks for construction of 3d models accessible to the visually impaired. In: International Conference on Applied Human Factors and Ergonomics, pp. 243–253. Springer (2018) Rodrigues, J.B., Ferreira, A.V.M., Maia, I.M.O., Junior, G.B., de Almeida, J.D.S., de Paiva, A.C. : Image processing of artworks for construction of 3d models accessible to the visually impaired. In: International Conference on Applied Human Factors and Ergonomics, pp. 243–253. Springer (2018)
36.
Zurück zum Zitat Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T.: Labelme: a database and web-based tool for image annotation. Int. J. Comput. Vis. 77(1–3), 157–173 (2008)CrossRef Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T.: Labelme: a database and web-based tool for image annotation. Int. J. Comput. Vis. 77(1–3), 157–173 (2008)CrossRef
38.
Zurück zum Zitat Shneiderman B (1996) The eyes have it: A task by data type taxonomy for information visualizations. In: Proceedings 1996 IEEE Symposium on Visual Languages, pp. 336–343. IEEE Shneiderman B (1996) The eyes have it: A task by data type taxonomy for information visualizations. In: Proceedings 1996 IEEE Symposium on Visual Languages, pp. 336–343. IEEE
39.
Zurück zum Zitat Stangl, A.J., Kothari, E., Jain, S.D., Yeh, T., Grauman, K., Gurari, D.: Browsewithme: An online clothes shopping assistant for people with visual impairments. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 107–118. ACM (2018) Stangl, A.J., Kothari, E., Jain, S.D., Yeh, T., Grauman, K., Gurari, D.: Browsewithme: An online clothes shopping assistant for people with visual impairments. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 107–118. ACM (2018)
41.
Zurück zum Zitat Winters, R.M., Joshi, N., Cutrell, E., Morris, M.R.: Strategies for auditory display of social media. Ergon. Des. 27(1), 11–15 (2019) Winters, R.M., Joshi, N., Cutrell, E., Morris, M.R.: Strategies for auditory display of social media. Ergon. Des. 27(1), 11–15 (2019)
42.
Zurück zum Zitat Zhang, H., Horvitz, E., Miller, R.C., Parkes, D.C.: Crowdsourcing general computation. In: In Proceedings of the: ACM Conference on Human Factors in Computing Systems. ACM, Association for Computing Machinery (2011) Zhang, H., Horvitz, E., Miller, R.C., Parkes, D.C.: Crowdsourcing general computation. In: In Proceedings of the: ACM Conference on Human Factors in Computing Systems. ACM, Association for Computing Machinery (2011)
43.
Zurück zum Zitat Zhong Y, Matsubara M, Morishima A.: Identification of important images for understanding web pages. In: 2018 IEEE International Conference on Big Data (Big Data), pp. 3568–3574. IEEE (2018) Zhong Y, Matsubara M, Morishima A.: Identification of important images for understanding web pages. In: 2018 IEEE International Conference on Big Data (Big Data), pp. 3568–3574. IEEE (2018)
Metadaten
Titel
Supporting a crowd-powered accessible online art gallery for people with visual impairments: a feasibility study
verfasst von
Nahyun Kwon
Yunjung Lee
Uran Oh
Publikationsdatum
12.05.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
Universal Access in the Information Society / Ausgabe 4/2022
Print ISSN: 1615-5289
Elektronische ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-021-00814-2

Weitere Artikel der Ausgabe 4/2022

Universal Access in the Information Society 4/2022 Zur Ausgabe

Premium Partner