Skip to main content
Top

2018 | OriginalPaper | Chapter

Multimedia Design Approaches by Just Noticeable Difference (JND) of Audiovisual Modalities

Authors : Suhhee Yoo, Mincheol Whang

Published in: Advances in Computer Science and Ubiquitous Computing

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multimodalities have attracted much interest in designing effective multimedia contents and services by applying sensory information. However, sensory experience from different modalities have been less understood in the multimedia contents design. Therefore, the optimal sensory experience is required to be considered to give impact on multimedia contents. This study is to determine the normalized perception for equalizing sensory difference between audio and visual modality. They were estimated by Just noticeable differences (JND) of audio and visual modalities and combination of both JNDs. JND for sound pressure and brightness were measured or estimated by curve fitting to calculate normalized just noticeable difference (NJND). NJND showed the intensity of sound pressure and brightness for the sensory balance and the sensory dominance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Klasen, M., Chen, Y.H., Mathiak, K.: Multisensory emotions: perception, combination and underlying neural processes. Rev. Neurosci. 23(4), 81–392 (2012)CrossRef Klasen, M., Chen, Y.H., Mathiak, K.: Multisensory emotions: perception, combination and underlying neural processes. Rev. Neurosci. 23(4), 81–392 (2012)CrossRef
2.
go back to reference Tabbers, H.K., Martens, R.L., Merriënboer, J.J.: Multimedia instructions and cognitive load theory: effects of modality and cueing. Br. J. Educ. Psychol. 74(1), 71–81 (2004)CrossRef Tabbers, H.K., Martens, R.L., Merriënboer, J.J.: Multimedia instructions and cognitive load theory: effects of modality and cueing. Br. J. Educ. Psychol. 74(1), 71–81 (2004)CrossRef
3.
go back to reference Issa, N., Schuller, M., Santacaterina, S., Shapiro, M., Wang, E., Mayer, R.E., DaRosa, D.A.: Applying multimedia design principles enhances learning in medical education. Med. Educ. 45(8), 818–826 (2011)CrossRef Issa, N., Schuller, M., Santacaterina, S., Shapiro, M., Wang, E., Mayer, R.E., DaRosa, D.A.: Applying multimedia design principles enhances learning in medical education. Med. Educ. 45(8), 818–826 (2011)CrossRef
4.
go back to reference Dubois, M., Vial, I.: Multimedia design: the effects of relating multimodal information. J. Comput. Assist. Learn. 16(2), 157–165 (2000)CrossRef Dubois, M., Vial, I.: Multimedia design: the effects of relating multimodal information. J. Comput. Assist. Learn. 16(2), 157–165 (2000)CrossRef
5.
go back to reference Hecht, D., Reiner, M.: Sensory dominance in combinations of audio, visual and haptic stimuli. Exp. Brain Res. 193(2), 307–314 (2009)CrossRef Hecht, D., Reiner, M.: Sensory dominance in combinations of audio, visual and haptic stimuli. Exp. Brain Res. 193(2), 307–314 (2009)CrossRef
6.
go back to reference Stevens, J.C., Marks, L.E.: Cross-modality matching of brightness and loudness. Proc. Natl. Acad. Sci. 54(2), 407–411 (1965)CrossRef Stevens, J.C., Marks, L.E.: Cross-modality matching of brightness and loudness. Proc. Natl. Acad. Sci. 54(2), 407–411 (1965)CrossRef
7.
go back to reference Gescheider, G.A., Sklar, B.F., Van Doren, C.L., Verrillo, R.T.: Vibrotactile forward masking: psychophysical evidence for a triplex theory of cutaneous mechanoreception. J. Acoust. Soc. Am. 78(2), 534–543 (1985)CrossRef Gescheider, G.A., Sklar, B.F., Van Doren, C.L., Verrillo, R.T.: Vibrotactile forward masking: psychophysical evidence for a triplex theory of cutaneous mechanoreception. J. Acoust. Soc. Am. 78(2), 534–543 (1985)CrossRef
8.
go back to reference Väljamäe, A., Västfjäll, D., Larsson, P., Kleiner, M.: Perceived sound in mediated environments. In: Immersed in Media Experiences: Presence Psychology and Design (Handbook of Presence). Lawrence Erlbaum (2008, in print) Väljamäe, A., Västfjäll, D., Larsson, P., Kleiner, M.: Perceived sound in mediated environments. In: Immersed in Media Experiences: Presence Psychology and Design (Handbook of Presence). Lawrence Erlbaum (2008, in print)
Metadata
Title
Multimedia Design Approaches by Just Noticeable Difference (JND) of Audiovisual Modalities
Authors
Suhhee Yoo
Mincheol Whang
Copyright Year
2018
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-7605-3_210