Skip to main content

2018 | OriginalPaper | Buchkapitel

Inferring Web Page Relevance Using Pupillometry and Single Channel EEG

verfasst von : Jacek Gwizdka

Erschienen in: Information Systems and Neuroscience

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We continue investigating neuro-physiological correlates of information relevance decisions and report on research-in-progress, in which we study health-related information search tasks conducted on open web. Data was collected using an eye-tracker and a single-channel EEG device. Our findings show significant differences in pupil dilation on visits and revisits to relevant and irrelevant pages. Significant differences in EEG-measured power of alpha frequency band and in EEG-detected attention levels were also found in a few conditions. The results confirm feasibility of using pupil dilation and suggest plausibility of using low-cost EEG devices to infer relevance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sonnenwald, D.H.: Theory Development in the Information Sciences. University of Texas Press, Austin, TX (2016) Sonnenwald, D.H.: Theory Development in the Information Sciences. University of Texas Press, Austin, TX (2016)
2.
Zurück zum Zitat Allegretti, M., Moshfeghi, Y., Hadjigeorgieva, M., Pollick, F.E., Jose, J.M., Pasi, G.: When relevance judgement is happening? An EEG-based study. In: Proceedings of SIGIR’2015, pp. 719–722. ACM, New York (2015) Allegretti, M., Moshfeghi, Y., Hadjigeorgieva, M., Pollick, F.E., Jose, J.M., Pasi, G.: When relevance judgement is happening? An EEG-based study. In: Proceedings of SIGIR’2015, pp. 719–722. ACM, New York (2015)
3.
Zurück zum Zitat Moshfeghi, Y., Pinto, L.R., Pollick, F.E., Jose, J.M.: Understanding relevance: an fMRI study. In: Serdyukov, P., Braslavski, P., Kuznetsov, S.O., Kamps, J., Rüger, S., Agichtein, E., Segalovich, I., Yilmaz, E. (eds.) Advances in Information Retrieval (ECIR’2013), pp. 14–25. Springer, Berlin (2013)CrossRef Moshfeghi, Y., Pinto, L.R., Pollick, F.E., Jose, J.M.: Understanding relevance: an fMRI study. In: Serdyukov, P., Braslavski, P., Kuznetsov, S.O., Kamps, J., Rüger, S., Agichtein, E., Segalovich, I., Yilmaz, E. (eds.) Advances in Information Retrieval (ECIR’2013), pp. 14–25. Springer, Berlin (2013)CrossRef
4.
Zurück zum Zitat Barral, O., Kosunen, I., Ruotsalo, T., Spapé, M.M., Eugster, M.J.A., Ravaja, N., Kaski, S., Jacucci, G.: Extracting relevance and affect information from physiological text annotation. User Model User-Adapt. Interact. 26, 493–520 (2016)CrossRef Barral, O., Kosunen, I., Ruotsalo, T., Spapé, M.M., Eugster, M.J.A., Ravaja, N., Kaski, S., Jacucci, G.: Extracting relevance and affect information from physiological text annotation. User Model User-Adapt. Interact. 26, 493–520 (2016)CrossRef
5.
Zurück zum Zitat Eugster, M.J.A., Ruotsalo, T., Spapé, M.M., Barral, O., Ravaja, N., Jacucci, G., Kaski, S.: Natural brain-information interfaces: recommending information by relevance inferred from human brain signals. Sci. Rep. 6, 38580 (2016)CrossRef Eugster, M.J.A., Ruotsalo, T., Spapé, M.M., Barral, O., Ravaja, N., Jacucci, G., Kaski, S.: Natural brain-information interfaces: recommending information by relevance inferred from human brain signals. Sci. Rep. 6, 38580 (2016)CrossRef
6.
Zurück zum Zitat Gwizdka, J.: Looking for information relevance in the brain. In: Gmunden Retreat on NeuroIS 2013, p. 14. Gmunden, Austria (2013) Gwizdka, J.: Looking for information relevance in the brain. In: Gmunden Retreat on NeuroIS 2013, p. 14. Gmunden, Austria (2013)
7.
Zurück zum Zitat Gwizdka, J.: Characterizing relevance with eye-tracking measures. In: Proceedings of IiiX’2014, pp. 58–67. ACM, New York (2014) Gwizdka, J.: Characterizing relevance with eye-tracking measures. In: Proceedings of IiiX’2014, pp. 58–67. ACM, New York (2014)
8.
Zurück zum Zitat Gwizdka, J.: Tracking information relevance. In: Gmunden Retreat on NeuroIS 2014, p. 3. Gmunden, Austria (2014) Gwizdka, J.: Tracking information relevance. In: Gmunden Retreat on NeuroIS 2014, p. 3. Gmunden, Austria (2014)
9.
Zurück zum Zitat Gwizdka, J.: Differences in reading between word search and information relevance decisions: evidence from eye-tracking. In: Davis D.F., Riedl R., vom Brocke J., Léger P.-M., Randolph B.A. (eds.) Information Systems and Neuroscience: Gmunden Retreat on NeuroIS 2016, pp. 141–147. Springer, Berlin (2017) Gwizdka, J.: Differences in reading between word search and information relevance decisions: evidence from eye-tracking. In: Davis D.F., Riedl R., vom Brocke J., Léger P.-M., Randolph B.A. (eds.) Information Systems and Neuroscience: Gmunden Retreat on NeuroIS 2016, pp. 141–147. Springer, Berlin (2017)
10.
Zurück zum Zitat Ajanki, A., Hardoon, D., Kaski, S., Puolamäki, K., Shawe-Taylor, J.: Can eyes reveal interest? Implicit queries from gaze patterns. User Model User-Adapt. Interact. 19, 307–339 (2009)CrossRef Ajanki, A., Hardoon, D., Kaski, S., Puolamäki, K., Shawe-Taylor, J.: Can eyes reveal interest? Implicit queries from gaze patterns. User Model User-Adapt. Interact. 19, 307–339 (2009)CrossRef
11.
Zurück zum Zitat Buscher, G., Dengel, A., Biedert, R., Elst, L.V.: Attentive documents: eye tracking as implicit feedback for information retrieval and beyond. ACM Trans. Interact. Intell Syst. 1, 9:1–9:30 (2012) Buscher, G., Dengel, A., Biedert, R., Elst, L.V.: Attentive documents: eye tracking as implicit feedback for information retrieval and beyond. ACM Trans. Interact. Intell Syst. 1, 9:1–9:30 (2012)
12.
Zurück zum Zitat Simola, J., Salojärvi, J., Kojo, I.: Using hidden Markov model to uncover processing states from eye movements in information search tasks. Cogn. Syst. Res. 9, 237–251 (2008)CrossRef Simola, J., Salojärvi, J., Kojo, I.: Using hidden Markov model to uncover processing states from eye movements in information search tasks. Cogn. Syst. Res. 9, 237–251 (2008)CrossRef
13.
Zurück zum Zitat Gwizdka, J., Shouyi, W., Cole, M., Hosseini, R.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inf. Sci. Technol. (in press) Gwizdka, J., Shouyi, W., Cole, M., Hosseini, R.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inf. Sci. Technol. (in press)
14.
Zurück zum Zitat Onorati, F., Barbieri, R., Mauri, M., Russo, V., Mainardi, L.: Characterization of affective states by pupillary dynamics and autonomic correlates. Front Neuroeng. 6, 9 (2013)CrossRef Onorati, F., Barbieri, R., Mauri, M., Russo, V., Mainardi, L.: Characterization of affective states by pupillary dynamics and autonomic correlates. Front Neuroeng. 6, 9 (2013)CrossRef
15.
Zurück zum Zitat Kahneman, D., Beatty, J.: Pupil diameter and load on memory. Science 154, 1583–1585 (1966)CrossRef Kahneman, D., Beatty, J.: Pupil diameter and load on memory. Science 154, 1583–1585 (1966)CrossRef
16.
Zurück zum Zitat Krugman, H.E.: Some applications of pupil measurement. JMR J. Mark. Res. Pre-1986. 1, 15 (1964) Krugman, H.E.: Some applications of pupil measurement. JMR J. Mark. Res. Pre-1986. 1, 15 (1964)
17.
Zurück zum Zitat Preuschoff, K., Hart, B.M. ’t, Einhäuser, W.: Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making. Front. Decis. Neurosci. 5, 115 (2011) Preuschoff, K., Hart, B.M. ’t, Einhäuser, W.: Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making. Front. Decis. Neurosci. 5, 115 (2011)
18.
Zurück zum Zitat Einhäuser, W., Koch, C., Carter, O.L.: Pupil dilation betrays the timing of decisions. Front Hum. Neurosci. 4, 18 (2010) Einhäuser, W., Koch, C., Carter, O.L.: Pupil dilation betrays the timing of decisions. Front Hum. Neurosci. 4, 18 (2010)
19.
Zurück zum Zitat Hoeks, B., Levelt, W.J.M.: Pupillary dilation as a measure of attention: a quantitative system analysis. Behav. Res. Methods Instrum. Comput. 25, 16–26 (1993)CrossRef Hoeks, B., Levelt, W.J.M.: Pupillary dilation as a measure of attention: a quantitative system analysis. Behav. Res. Methods Instrum. Comput. 25, 16–26 (1993)CrossRef
20.
Zurück zum Zitat Wierda, S.M., van Rijn, H., Taatgen, N.A., Martens, S.: Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. PNAS 109, 8456–8460 (2012)CrossRef Wierda, S.M., van Rijn, H., Taatgen, N.A., Martens, S.: Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. PNAS 109, 8456–8460 (2012)CrossRef
21.
Zurück zum Zitat Oliveira, F.T.P., Aula, A., Russell, D.M.: Discriminating the relevance of web search results with measures of pupil size. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 2209–2212. ACM, Boston, MA (2009) Oliveira, F.T.P., Aula, A., Russell, D.M.: Discriminating the relevance of web search results with measures of pupil size. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 2209–2212. ACM, Boston, MA (2009)
22.
Zurück zum Zitat Gwizdka, J., Zhang, Y.: Differences in eye-tracking measures between visits and revisits to relevant and irrelevant web pages. In: Proceedings of SIGIR’2015, pp. 811–814. ACM, New York (2015) Gwizdka, J., Zhang, Y.: Differences in eye-tracking measures between visits and revisits to relevant and irrelevant web pages. In: Proceedings of SIGIR’2015, pp. 811–814. ACM, New York (2015)
23.
Zurück zum Zitat Abbott, W.W., Faisal, A.A.: Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfaces. J. Neural Eng. 9, 046016 (2012)CrossRef Abbott, W.W., Faisal, A.A.: Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfaces. J. Neural Eng. 9, 046016 (2012)CrossRef
24.
Zurück zum Zitat Bobrov, P., Frolov, A., Cantor, C., Fedulova, I., Bakhnyan, M., Zhavoronkov, A.: Brain–computer interface based on generation of visual images. PLoS ONE 6, e20674 (2011)CrossRef Bobrov, P., Frolov, A., Cantor, C., Fedulova, I., Bakhnyan, M., Zhavoronkov, A.: Brain–computer interface based on generation of visual images. PLoS ONE 6, e20674 (2011)CrossRef
25.
Zurück zum Zitat Khushaba, R.N., Greenacre, L., Kodagoda, S., Louviere, J., Burke, S., Dissanayake, G.: Choice modeling and the brain: a study on the electroencephalogram (EEG) of preferences. Expert Syst. Appl. 39, 12378–12388 (2012)CrossRef Khushaba, R.N., Greenacre, L., Kodagoda, S., Louviere, J., Burke, S., Dissanayake, G.: Choice modeling and the brain: a study on the electroencephalogram (EEG) of preferences. Expert Syst. Appl. 39, 12378–12388 (2012)CrossRef
26.
Zurück zum Zitat Ramirez, R., Palencia-Lefler, M., Giraldo, S., Vamvakousis, Z.: Musical neurofeedback for treating depression in elderly people. Audit. Cogn. Neurosci. 354 (2015) Ramirez, R., Palencia-Lefler, M., Giraldo, S., Vamvakousis, Z.: Musical neurofeedback for treating depression in elderly people. Audit. Cogn. Neurosci. 354 (2015)
27.
Zurück zum Zitat Wang, S., Gwizdka, J., Chaovalitwongse, W.A.: Using wireless EEG signals to assess memory workload in the n-back task. IEEE Trans. Hum.–Mach. Syst. 46, 424–435 (2016) Wang, S., Gwizdka, J., Chaovalitwongse, W.A.: Using wireless EEG signals to assess memory workload in the n-back task. IEEE Trans. Hum.–Mach. Syst. 46, 424–435 (2016)
28.
Zurück zum Zitat Wal, C.N. van der, Irrmischer, M.: Myndplay: measuring attention regulation with single dry electrode brain computer interface. In: Guo, Y., Friston, K., Aldo, F., Hill, S., and Peng, H. (eds.) Brain Informatics and Health. pp. 192–201. Springer, Berlin (2015) Wal, C.N. van der, Irrmischer, M.: Myndplay: measuring attention regulation with single dry electrode brain computer interface. In: Guo, Y., Friston, K., Aldo, F., Hill, S., and Peng, H. (eds.) Brain Informatics and Health. pp. 192–201. Springer, Berlin (2015)
29.
Zurück zum Zitat Gwizdka, J., Hosseini, R., Cole, M., Wang, S.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inform. Sci. Tech. 68(10), 2299−2312 (2017) Gwizdka, J., Hosseini, R., Cole, M., Wang, S.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inform. Sci. Tech. 68(10), 2299−2312 (2017)
30.
Zurück zum Zitat Borlund, P.: The concept of relevance in IR. J. Am. Soc. Inf. Sci. Technol. 54, 913–925 (2003)CrossRef Borlund, P.: The concept of relevance in IR. J. Am. Soc. Inf. Sci. Technol. 54, 913–925 (2003)CrossRef
31.
Zurück zum Zitat Gwizdka, J.: I can and so I search more: effects of memory span on search behavior. In: Proceedings of CHIIR’2017, pp. 341–344. ACM, New York (2017) Gwizdka, J.: I can and so I search more: effects of memory span on search behavior. In: Proceedings of CHIIR’2017, pp. 341–344. ACM, New York (2017)
32.
Zurück zum Zitat Wei, X., Zhang, Y., Gwizdka, J.: YASFIIRE: yet another system for IIR evaluation. In: Proceedings of IiiX’2014, pp. 316–319. ACM, New York (2014) Wei, X., Zhang, Y., Gwizdka, J.: YASFIIRE: yet another system for IIR evaluation. In: Proceedings of IiiX’2014, pp. 316–319. ACM, New York (2014)
33.
Zurück zum Zitat O’Connell, R.G., Dockree, P.M., Robertson, I.H., Bellgrove, M.A., Foxe, J.J., Kelly, S.P.: Uncovering the neural signature of lapsing attention: electrophysiological signals predict errors up to 20 s before they occur. J. Neurosci. 29, 8604–8611 (2009)CrossRef O’Connell, R.G., Dockree, P.M., Robertson, I.H., Bellgrove, M.A., Foxe, J.J., Kelly, S.P.: Uncovering the neural signature of lapsing attention: electrophysiological signals predict errors up to 20 s before they occur. J. Neurosci. 29, 8604–8611 (2009)CrossRef
Metadaten
Titel
Inferring Web Page Relevance Using Pupillometry and Single Channel EEG
verfasst von
Jacek Gwizdka
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-67431-5_20