Skip to main content
Top

2018 | OriginalPaper | Chapter

Inferring Web Page Relevance Using Pupillometry and Single Channel EEG

Author : Jacek Gwizdka

Published in: Information Systems and Neuroscience

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We continue investigating neuro-physiological correlates of information relevance decisions and report on research-in-progress, in which we study health-related information search tasks conducted on open web. Data was collected using an eye-tracker and a single-channel EEG device. Our findings show significant differences in pupil dilation on visits and revisits to relevant and irrelevant pages. Significant differences in EEG-measured power of alpha frequency band and in EEG-detected attention levels were also found in a few conditions. The results confirm feasibility of using pupil dilation and suggest plausibility of using low-cost EEG devices to infer relevance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Sonnenwald, D.H.: Theory Development in the Information Sciences. University of Texas Press, Austin, TX (2016) Sonnenwald, D.H.: Theory Development in the Information Sciences. University of Texas Press, Austin, TX (2016)
2.
go back to reference Allegretti, M., Moshfeghi, Y., Hadjigeorgieva, M., Pollick, F.E., Jose, J.M., Pasi, G.: When relevance judgement is happening? An EEG-based study. In: Proceedings of SIGIR’2015, pp. 719–722. ACM, New York (2015) Allegretti, M., Moshfeghi, Y., Hadjigeorgieva, M., Pollick, F.E., Jose, J.M., Pasi, G.: When relevance judgement is happening? An EEG-based study. In: Proceedings of SIGIR’2015, pp. 719–722. ACM, New York (2015)
3.
go back to reference Moshfeghi, Y., Pinto, L.R., Pollick, F.E., Jose, J.M.: Understanding relevance: an fMRI study. In: Serdyukov, P., Braslavski, P., Kuznetsov, S.O., Kamps, J., Rüger, S., Agichtein, E., Segalovich, I., Yilmaz, E. (eds.) Advances in Information Retrieval (ECIR’2013), pp. 14–25. Springer, Berlin (2013)CrossRef Moshfeghi, Y., Pinto, L.R., Pollick, F.E., Jose, J.M.: Understanding relevance: an fMRI study. In: Serdyukov, P., Braslavski, P., Kuznetsov, S.O., Kamps, J., Rüger, S., Agichtein, E., Segalovich, I., Yilmaz, E. (eds.) Advances in Information Retrieval (ECIR’2013), pp. 14–25. Springer, Berlin (2013)CrossRef
4.
go back to reference Barral, O., Kosunen, I., Ruotsalo, T., Spapé, M.M., Eugster, M.J.A., Ravaja, N., Kaski, S., Jacucci, G.: Extracting relevance and affect information from physiological text annotation. User Model User-Adapt. Interact. 26, 493–520 (2016)CrossRef Barral, O., Kosunen, I., Ruotsalo, T., Spapé, M.M., Eugster, M.J.A., Ravaja, N., Kaski, S., Jacucci, G.: Extracting relevance and affect information from physiological text annotation. User Model User-Adapt. Interact. 26, 493–520 (2016)CrossRef
5.
go back to reference Eugster, M.J.A., Ruotsalo, T., Spapé, M.M., Barral, O., Ravaja, N., Jacucci, G., Kaski, S.: Natural brain-information interfaces: recommending information by relevance inferred from human brain signals. Sci. Rep. 6, 38580 (2016)CrossRef Eugster, M.J.A., Ruotsalo, T., Spapé, M.M., Barral, O., Ravaja, N., Jacucci, G., Kaski, S.: Natural brain-information interfaces: recommending information by relevance inferred from human brain signals. Sci. Rep. 6, 38580 (2016)CrossRef
6.
go back to reference Gwizdka, J.: Looking for information relevance in the brain. In: Gmunden Retreat on NeuroIS 2013, p. 14. Gmunden, Austria (2013) Gwizdka, J.: Looking for information relevance in the brain. In: Gmunden Retreat on NeuroIS 2013, p. 14. Gmunden, Austria (2013)
7.
go back to reference Gwizdka, J.: Characterizing relevance with eye-tracking measures. In: Proceedings of IiiX’2014, pp. 58–67. ACM, New York (2014) Gwizdka, J.: Characterizing relevance with eye-tracking measures. In: Proceedings of IiiX’2014, pp. 58–67. ACM, New York (2014)
8.
go back to reference Gwizdka, J.: Tracking information relevance. In: Gmunden Retreat on NeuroIS 2014, p. 3. Gmunden, Austria (2014) Gwizdka, J.: Tracking information relevance. In: Gmunden Retreat on NeuroIS 2014, p. 3. Gmunden, Austria (2014)
9.
go back to reference Gwizdka, J.: Differences in reading between word search and information relevance decisions: evidence from eye-tracking. In: Davis D.F., Riedl R., vom Brocke J., Léger P.-M., Randolph B.A. (eds.) Information Systems and Neuroscience: Gmunden Retreat on NeuroIS 2016, pp. 141–147. Springer, Berlin (2017) Gwizdka, J.: Differences in reading between word search and information relevance decisions: evidence from eye-tracking. In: Davis D.F., Riedl R., vom Brocke J., Léger P.-M., Randolph B.A. (eds.) Information Systems and Neuroscience: Gmunden Retreat on NeuroIS 2016, pp. 141–147. Springer, Berlin (2017)
10.
go back to reference Ajanki, A., Hardoon, D., Kaski, S., Puolamäki, K., Shawe-Taylor, J.: Can eyes reveal interest? Implicit queries from gaze patterns. User Model User-Adapt. Interact. 19, 307–339 (2009)CrossRef Ajanki, A., Hardoon, D., Kaski, S., Puolamäki, K., Shawe-Taylor, J.: Can eyes reveal interest? Implicit queries from gaze patterns. User Model User-Adapt. Interact. 19, 307–339 (2009)CrossRef
11.
go back to reference Buscher, G., Dengel, A., Biedert, R., Elst, L.V.: Attentive documents: eye tracking as implicit feedback for information retrieval and beyond. ACM Trans. Interact. Intell Syst. 1, 9:1–9:30 (2012) Buscher, G., Dengel, A., Biedert, R., Elst, L.V.: Attentive documents: eye tracking as implicit feedback for information retrieval and beyond. ACM Trans. Interact. Intell Syst. 1, 9:1–9:30 (2012)
12.
go back to reference Simola, J., Salojärvi, J., Kojo, I.: Using hidden Markov model to uncover processing states from eye movements in information search tasks. Cogn. Syst. Res. 9, 237–251 (2008)CrossRef Simola, J., Salojärvi, J., Kojo, I.: Using hidden Markov model to uncover processing states from eye movements in information search tasks. Cogn. Syst. Res. 9, 237–251 (2008)CrossRef
13.
go back to reference Gwizdka, J., Shouyi, W., Cole, M., Hosseini, R.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inf. Sci. Technol. (in press) Gwizdka, J., Shouyi, W., Cole, M., Hosseini, R.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inf. Sci. Technol. (in press)
14.
go back to reference Onorati, F., Barbieri, R., Mauri, M., Russo, V., Mainardi, L.: Characterization of affective states by pupillary dynamics and autonomic correlates. Front Neuroeng. 6, 9 (2013)CrossRef Onorati, F., Barbieri, R., Mauri, M., Russo, V., Mainardi, L.: Characterization of affective states by pupillary dynamics and autonomic correlates. Front Neuroeng. 6, 9 (2013)CrossRef
15.
go back to reference Kahneman, D., Beatty, J.: Pupil diameter and load on memory. Science 154, 1583–1585 (1966)CrossRef Kahneman, D., Beatty, J.: Pupil diameter and load on memory. Science 154, 1583–1585 (1966)CrossRef
16.
go back to reference Krugman, H.E.: Some applications of pupil measurement. JMR J. Mark. Res. Pre-1986. 1, 15 (1964) Krugman, H.E.: Some applications of pupil measurement. JMR J. Mark. Res. Pre-1986. 1, 15 (1964)
17.
go back to reference Preuschoff, K., Hart, B.M. ’t, Einhäuser, W.: Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making. Front. Decis. Neurosci. 5, 115 (2011) Preuschoff, K., Hart, B.M. ’t, Einhäuser, W.: Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making. Front. Decis. Neurosci. 5, 115 (2011)
18.
go back to reference Einhäuser, W., Koch, C., Carter, O.L.: Pupil dilation betrays the timing of decisions. Front Hum. Neurosci. 4, 18 (2010) Einhäuser, W., Koch, C., Carter, O.L.: Pupil dilation betrays the timing of decisions. Front Hum. Neurosci. 4, 18 (2010)
19.
go back to reference Hoeks, B., Levelt, W.J.M.: Pupillary dilation as a measure of attention: a quantitative system analysis. Behav. Res. Methods Instrum. Comput. 25, 16–26 (1993)CrossRef Hoeks, B., Levelt, W.J.M.: Pupillary dilation as a measure of attention: a quantitative system analysis. Behav. Res. Methods Instrum. Comput. 25, 16–26 (1993)CrossRef
20.
go back to reference Wierda, S.M., van Rijn, H., Taatgen, N.A., Martens, S.: Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. PNAS 109, 8456–8460 (2012)CrossRef Wierda, S.M., van Rijn, H., Taatgen, N.A., Martens, S.: Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. PNAS 109, 8456–8460 (2012)CrossRef
21.
go back to reference Oliveira, F.T.P., Aula, A., Russell, D.M.: Discriminating the relevance of web search results with measures of pupil size. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 2209–2212. ACM, Boston, MA (2009) Oliveira, F.T.P., Aula, A., Russell, D.M.: Discriminating the relevance of web search results with measures of pupil size. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 2209–2212. ACM, Boston, MA (2009)
22.
go back to reference Gwizdka, J., Zhang, Y.: Differences in eye-tracking measures between visits and revisits to relevant and irrelevant web pages. In: Proceedings of SIGIR’2015, pp. 811–814. ACM, New York (2015) Gwizdka, J., Zhang, Y.: Differences in eye-tracking measures between visits and revisits to relevant and irrelevant web pages. In: Proceedings of SIGIR’2015, pp. 811–814. ACM, New York (2015)
23.
go back to reference Abbott, W.W., Faisal, A.A.: Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfaces. J. Neural Eng. 9, 046016 (2012)CrossRef Abbott, W.W., Faisal, A.A.: Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfaces. J. Neural Eng. 9, 046016 (2012)CrossRef
24.
go back to reference Bobrov, P., Frolov, A., Cantor, C., Fedulova, I., Bakhnyan, M., Zhavoronkov, A.: Brain–computer interface based on generation of visual images. PLoS ONE 6, e20674 (2011)CrossRef Bobrov, P., Frolov, A., Cantor, C., Fedulova, I., Bakhnyan, M., Zhavoronkov, A.: Brain–computer interface based on generation of visual images. PLoS ONE 6, e20674 (2011)CrossRef
25.
go back to reference Khushaba, R.N., Greenacre, L., Kodagoda, S., Louviere, J., Burke, S., Dissanayake, G.: Choice modeling and the brain: a study on the electroencephalogram (EEG) of preferences. Expert Syst. Appl. 39, 12378–12388 (2012)CrossRef Khushaba, R.N., Greenacre, L., Kodagoda, S., Louviere, J., Burke, S., Dissanayake, G.: Choice modeling and the brain: a study on the electroencephalogram (EEG) of preferences. Expert Syst. Appl. 39, 12378–12388 (2012)CrossRef
26.
go back to reference Ramirez, R., Palencia-Lefler, M., Giraldo, S., Vamvakousis, Z.: Musical neurofeedback for treating depression in elderly people. Audit. Cogn. Neurosci. 354 (2015) Ramirez, R., Palencia-Lefler, M., Giraldo, S., Vamvakousis, Z.: Musical neurofeedback for treating depression in elderly people. Audit. Cogn. Neurosci. 354 (2015)
27.
go back to reference Wang, S., Gwizdka, J., Chaovalitwongse, W.A.: Using wireless EEG signals to assess memory workload in the n-back task. IEEE Trans. Hum.–Mach. Syst. 46, 424–435 (2016) Wang, S., Gwizdka, J., Chaovalitwongse, W.A.: Using wireless EEG signals to assess memory workload in the n-back task. IEEE Trans. Hum.–Mach. Syst. 46, 424–435 (2016)
28.
go back to reference Wal, C.N. van der, Irrmischer, M.: Myndplay: measuring attention regulation with single dry electrode brain computer interface. In: Guo, Y., Friston, K., Aldo, F., Hill, S., and Peng, H. (eds.) Brain Informatics and Health. pp. 192–201. Springer, Berlin (2015) Wal, C.N. van der, Irrmischer, M.: Myndplay: measuring attention regulation with single dry electrode brain computer interface. In: Guo, Y., Friston, K., Aldo, F., Hill, S., and Peng, H. (eds.) Brain Informatics and Health. pp. 192–201. Springer, Berlin (2015)
29.
go back to reference Gwizdka, J., Hosseini, R., Cole, M., Wang, S.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inform. Sci. Tech. 68(10), 2299−2312 (2017) Gwizdka, J., Hosseini, R., Cole, M., Wang, S.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inform. Sci. Tech. 68(10), 2299−2312 (2017)
30.
go back to reference Borlund, P.: The concept of relevance in IR. J. Am. Soc. Inf. Sci. Technol. 54, 913–925 (2003)CrossRef Borlund, P.: The concept of relevance in IR. J. Am. Soc. Inf. Sci. Technol. 54, 913–925 (2003)CrossRef
31.
go back to reference Gwizdka, J.: I can and so I search more: effects of memory span on search behavior. In: Proceedings of CHIIR’2017, pp. 341–344. ACM, New York (2017) Gwizdka, J.: I can and so I search more: effects of memory span on search behavior. In: Proceedings of CHIIR’2017, pp. 341–344. ACM, New York (2017)
32.
go back to reference Wei, X., Zhang, Y., Gwizdka, J.: YASFIIRE: yet another system for IIR evaluation. In: Proceedings of IiiX’2014, pp. 316–319. ACM, New York (2014) Wei, X., Zhang, Y., Gwizdka, J.: YASFIIRE: yet another system for IIR evaluation. In: Proceedings of IiiX’2014, pp. 316–319. ACM, New York (2014)
33.
go back to reference O’Connell, R.G., Dockree, P.M., Robertson, I.H., Bellgrove, M.A., Foxe, J.J., Kelly, S.P.: Uncovering the neural signature of lapsing attention: electrophysiological signals predict errors up to 20 s before they occur. J. Neurosci. 29, 8604–8611 (2009)CrossRef O’Connell, R.G., Dockree, P.M., Robertson, I.H., Bellgrove, M.A., Foxe, J.J., Kelly, S.P.: Uncovering the neural signature of lapsing attention: electrophysiological signals predict errors up to 20 s before they occur. J. Neurosci. 29, 8604–8611 (2009)CrossRef
Metadata
Title
Inferring Web Page Relevance Using Pupillometry and Single Channel EEG
Author
Jacek Gwizdka
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-67431-5_20

Premium Partner