Skip to main content

2022 | OriginalPaper | Buchkapitel

Pupillometric System for Cognitive Load Estimation in Noisy-Speech Intelligibility Psychoacoustic Experiments: Preliminary Results

verfasst von : A. L. Furlani, M. H. Costa, M. C. Tavares

Erschienen in: XXVII Brazilian Congress on Biomedical Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cognitive load (CL) is the mental effort required to perform a task. It may be estimated by different ways, such as by electroencephalography, or analysis of pupil dilation (pupillometry). Due to the recent applications of CL for hearing aid performance assessment, this work presents a pupillometric system for CL estimation in speech intelligibility experiments. It consists of a one eye image acquisition sensor used in clinical video-oculography, and a signal processing software specially developed for recording pupil’s response and estimating CL. To overcome the adversities found in very low intelligibility conditions, a new CL index was proposed. Psychoacoustic listening experiments with 7 normal-hearing volunteers and noisy-speech compared intelligibility scores with pupil features for a wide range of signal to noise ratios (SNR). Preliminary results show a consistent increase of the proposed CL index with the SNR decrease. This index may be a useful tool for CL estimation in speech intelligibility investigation under very difficult listening situations. However, the observed findings are limited by the small testing group.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Santis A, Iacoviello D (2006) Optimal segmentation of pupillometric images for estimating pupil shape parameters. Comp Meth Prog Biomed 84:174–187CrossRef Santis A, Iacoviello D (2006) Optimal segmentation of pupillometric images for estimating pupil shape parameters. Comp Meth Prog Biomed 84:174–187CrossRef
2.
Zurück zum Zitat Souza JKS et al (2013) An open-source, FireWire camera-based, Labview-controlled image acquisition system for automated, dynamic pupillometry and blink detection. Comp Meth Prog Biomed 112:607–623CrossRef Souza JKS et al (2013) An open-source, FireWire camera-based, Labview-controlled image acquisition system for automated, dynamic pupillometry and blink detection. Comp Meth Prog Biomed 112:607–623CrossRef
3.
Zurück zum Zitat Silva CGR et al (2019) Computer vision based systems for human pupillary behavior evaluation: a systematic review of the literature. IEEE Comp Software Appl Conf 714–719 Silva CGR et al (2019) Computer vision based systems for human pupillary behavior evaluation: a systematic review of the literature. IEEE Comp Software Appl Conf 714–719
4.
Zurück zum Zitat Hovagimian H et al (2012) Development of a remote pupillometer system for non-invasive, distant analysis. IEEE Northeast Bioeng Conf 153–154 Hovagimian H et al (2012) Development of a remote pupillometer system for non-invasive, distant analysis. IEEE Northeast Bioeng Conf 153–154
5.
Zurück zum Zitat Zekveld AA, Kramer SE, Festen JM (2010) Pupil response as an indication of effortful listening: the influence of sentence intelligibility. Ear Hear 31:480–490CrossRef Zekveld AA, Kramer SE, Festen JM (2010) Pupil response as an indication of effortful listening: the influence of sentence intelligibility. Ear Hear 31:480–490CrossRef
6.
Zurück zum Zitat Desjardins JL (2016) The effects of hearing aid directional microphone and noise reduction processing on listening effort in older adults with hearing loss. J Am Acad Audiol 27:29–41CrossRef Desjardins JL (2016) The effects of hearing aid directional microphone and noise reduction processing on listening effort in older adults with hearing loss. J Am Acad Audiol 27:29–41CrossRef
7.
Zurück zum Zitat Wendt D, Hietkamp RK, Lunner T (2017) Impact of noise and noise reduction on processing effort: a pupillometry study. Ear Hear 28:690–700CrossRef Wendt D, Hietkamp RK, Lunner T (2017) Impact of noise and noise reduction on processing effort: a pupillometry study. Ear Hear 28:690–700CrossRef
8.
Zurück zum Zitat Wendt D, Dau T, Hjortkjær J (2016) Impact of background noise and sentence complexity on processing demands during sentence comprehension. Front Psych 7:345 Wendt D, Dau T, Hjortkjær J (2016) Impact of background noise and sentence complexity on processing demands during sentence comprehension. Front Psych 7:345
9.
Zurück zum Zitat Ohlenforst B et al (2017) Effects of hearing impairment and hearing aid amplification on listening effort: a systematic review. Ear Hear 38:267CrossRef Ohlenforst B et al (2017) Effects of hearing impairment and hearing aid amplification on listening effort: a systematic review. Ear Hear 38:267CrossRef
10.
Zurück zum Zitat Perreau AE et al (2017) Listening effort measured in adults with normal hearing and cochlear implants. J Am Acad Audiol 28:685–697CrossRef Perreau AE et al (2017) Listening effort measured in adults with normal hearing and cochlear implants. J Am Acad Audiol 28:685–697CrossRef
11.
Zurück zum Zitat Koelewijn T et al (2012) Pupil dilation uncovers extra listening effort in the presence of a single-talker masker. Ear Hear 33:291–300CrossRef Koelewijn T et al (2012) Pupil dilation uncovers extra listening effort in the presence of a single-talker masker. Ear Hear 33:291–300CrossRef
12.
Zurück zum Zitat Ohlenforst B et al (2018) Impact of SNR, masker type and noise reduction processing on sentence recognition performance and listening effort as indicated by the pupil dilation response. Hear Res 365:90–99CrossRef Ohlenforst B et al (2018) Impact of SNR, masker type and noise reduction processing on sentence recognition performance and listening effort as indicated by the pupil dilation response. Hear Res 365:90–99CrossRef
13.
Zurück zum Zitat Ohlenforst B et al (2017) Impact of stimulus-related factors and hearing impairment on listening effort as indicated by pupil dilation. Hear Res 351:68–79CrossRef Ohlenforst B et al (2017) Impact of stimulus-related factors and hearing impairment on listening effort as indicated by pupil dilation. Hear Res 351:68–79CrossRef
14.
Zurück zum Zitat Wendt D et al (2018) Toward a more comprehensive understanding of the impact of masker type and signal-to-noise ratio on the pupillary response while performing a speech-in-noise test. Hear Res 369:67–78CrossRef Wendt D et al (2018) Toward a more comprehensive understanding of the impact of masker type and signal-to-noise ratio on the pupillary response while performing a speech-in-noise test. Hear Res 369:67–78CrossRef
15.
Zurück zum Zitat Kan A (2017) Improving speech intelligibility for bilateral cochlear implant users using Weiner filters and its impact on cognitive load. In: IEEE Asia-Pacific signal inform process conference, pp 786–792 Kan A (2017) Improving speech intelligibility for bilateral cochlear implant users using Weiner filters and its impact on cognitive load. In: IEEE Asia-Pacific signal inform process conference, pp 786–792
16.
Zurück zum Zitat Winn MB et al (2018) Best practices and advice for using pupillometry to measure listening effort: an introduction for those who want to get started. Trend Hear 22:1–32 Winn MB et al (2018) Best practices and advice for using pupillometry to measure listening effort: an introduction for those who want to get started. Trend Hear 22:1–32
17.
Zurück zum Zitat Nurunnabi A, Sadahiro Y, Laefer DF (2018) Robust statistical approaches for circle fitting in laser scanning three-dimensional point cloud data. Patt Recogn 81:417–431CrossRef Nurunnabi A, Sadahiro Y, Laefer DF (2018) Robust statistical approaches for circle fitting in laser scanning three-dimensional point cloud data. Patt Recogn 81:417–431CrossRef
18.
Zurück zum Zitat Zekveld AA, Kramer SE, Festen JM (2011) Cognitive load during speech perception in noise: the influence of age, hearing loss, and cognition on the pupil response. Ear Hear 32:498–510CrossRef Zekveld AA, Kramer SE, Festen JM (2011) Cognitive load during speech perception in noise: the influence of age, hearing loss, and cognition on the pupil response. Ear Hear 32:498–510CrossRef
19.
Zurück zum Zitat Borghini G, Hazan V (2018) Listening effort during sentence processing is increased for non-native listeners: a pupillometry study. Front Neurosci 12:1–13CrossRef Borghini G, Hazan V (2018) Listening effort during sentence processing is increased for non-native listeners: a pupillometry study. Front Neurosci 12:1–13CrossRef
20.
Zurück zum Zitat Alcaim A, Solewicz JA, Moraes JA (1992) Frequency of occurrence of phones and lists of phonetically balanced sentences for spoken Portuguese in Rio de Janeiro (in Portuguese). Int J Comm Syst 7(1):23–41 Alcaim A, Solewicz JA, Moraes JA (1992) Frequency of occurrence of phones and lists of phonetically balanced sentences for spoken Portuguese in Rio de Janeiro (in Portuguese). Int J Comm Syst 7(1):23–41
21.
Zurück zum Zitat Ynoguti CA (1999) Continuous speech recognition using hidden Markov models (in Portuguese). Ph.D Thesis. Universidade Estadual de Campinas Ynoguti CA (1999) Continuous speech recognition using hidden Markov models (in Portuguese). Ph.D Thesis. Universidade Estadual de Campinas
22.
Zurück zum Zitat Dreschler WA et al (2001) ICRA noises: artificial noise signals with speech-like spectra and temporal properties for hearing instrument assessment. Audiol 40:148–157CrossRef Dreschler WA et al (2001) ICRA noises: artificial noise signals with speech-like spectra and temporal properties for hearing instrument assessment. Audiol 40:148–157CrossRef
23.
Zurück zum Zitat Wu Y et al (2018) Characteristics of real-world signal to noise ratios and speech listening situations of older adults with mild to moderate hearing loss. Ear Hear 39(2):293–304CrossRef Wu Y et al (2018) Characteristics of real-world signal to noise ratios and speech listening situations of older adults with mild to moderate hearing loss. Ear Hear 39(2):293–304CrossRef
Metadaten
Titel
Pupillometric System for Cognitive Load Estimation in Noisy-Speech Intelligibility Psychoacoustic Experiments: Preliminary Results
verfasst von
A. L. Furlani
M. H. Costa
M. C. Tavares
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-030-70601-2_225

Neuer Inhalt