Skip to main content
Top

2022 | OriginalPaper | Chapter

Interactive Reading Note Generation Utilizing Gaze Information

Authors : Satoko Yoshida, Madoka Takahara, Erina Makihara, Ivan Tanev, Katsunori Shimohara

Published in: Human Interface and the Management of Information: Visual and Information Design

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Reading gives readers intellectual stimuli, elicits their imagination and creativity, and expands their inner world. We introduce the concept to postulate that reading is communication between a reader and a book. An idea is to change a book into a reactive entity and to achieve interactions between a reader and a book. We have introduced a mechanism to feedback a reading note as a response from a book to a reader’s gaze information that the reader generates during reading. Reader’s gaze information generated during reading shows his/her mind about the book. The goal of this study is to build an automatic reading notes creation system that automatically generates reading notes based on gaze information that a reader naturally generates during reading. We conducted experiments to measure a subject’s gaze coordinate data, and to verify whether we could identify eye movements for specific four reading patterns through the analysis of the acquired data. As the result, we have confirmed it possible to identify a reader’s reading patterns from the change of gaze information.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hamada, H., Akita, K., Fujimori, Y., Yagi, Y.: The effects of childhood reading experiences on adult consciousness, motivations and activities. Sci. Read. 58(1), 29–39 (2016) Hamada, H., Akita, K., Fujimori, Y., Yagi, Y.: The effects of childhood reading experiences on adult consciousness, motivations and activities. Sci. Read. 58(1), 29–39 (2016)
3.
go back to reference Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Automatic reading notes creation: identifying reading patterns by Gaze information during reading. Proc. SICE Annu. Conf. 2020, 1965–1970 (2020) Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Automatic reading notes creation: identifying reading patterns by Gaze information during reading. Proc. SICE Annu. Conf. 2020, 1965–1970 (2020)
4.
go back to reference Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Reading notes as media to enrich communications between reader and book. In: 2020 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), pp. 1–5 (2020) Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Reading notes as media to enrich communications between reader and book. In: 2020 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), pp. 1–5 (2020)
5.
go back to reference Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Effect of media functionality by reading note on reading experience over time. Proc. SICE Annu. Conf. 2021, 506–508 (2021) Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Effect of media functionality by reading note on reading experience over time. Proc. SICE Annu. Conf. 2021, 506–508 (2021)
6.
go back to reference Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Possibility of reading notes as media to enrich communications between reader and book. Human interface and the management of information. Inf. Present. Visual. 12765, 113–124 (2021) Yoshida, S., Takahara, M., Tanev, I., Shimohara, K.: Possibility of reading notes as media to enrich communications between reader and book. Human interface and the management of information. Inf. Present. Visual. 12765, 113–124 (2021)
7.
go back to reference Matsumura, A.: Daijirin, 3rd edn. Sanseido, Tokyo (2006) Matsumura, A.: Daijirin, 3rd edn. Sanseido, Tokyo (2006)
8.
go back to reference Kitahara, Y.: Meikyo Kokugo Dictionary, 2nd edn. Taishukan Publishing, Tokyo (2010) Kitahara, Y.: Meikyo Kokugo Dictionary, 2nd edn. Taishukan Publishing, Tokyo (2010)
9.
go back to reference Shimohara, K.: Artificial Life and Evolving Computer. Kogyo Chosakai Publishing, Tokyo (1998) Shimohara, K.: Artificial Life and Evolving Computer. Kogyo Chosakai Publishing, Tokyo (1998)
11.
go back to reference Nakajima, K., Utsumi, Y., Iwamura, M., Hirose, K.: Selection of Gaze-based Characteristics Useful for Detecting Reading Actions. IPSJ SIG Technical Report 2016-CVIM-202(28), pp. 1–6 (2016) Nakajima, K., Utsumi, Y., Iwamura, M., Hirose, K.: Selection of Gaze-based Characteristics Useful for Detecting Reading Actions. IPSJ SIG Technical Report 2016-CVIM-202(28), pp. 1–6 (2016)
12.
go back to reference Kunze, K., et al.: Quantifying reading habits: counting how many words you read. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015), pp. 87–96. Association for Computing Machinery, Inc., New York (2015) Kunze, K., et al.: Quantifying reading habits: counting how many words you read. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015), pp. 87–96. Association for Computing Machinery, Inc., New York (2015)
13.
go back to reference Bulling, A., Ward, J.A., Gellersen, H., Tröster, G.: Eye movement analysis for activity recognition using electorooculoraphy. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 741–753 (2011)CrossRef Bulling, A., Ward, J.A., Gellersen, H., Tröster, G.: Eye movement analysis for activity recognition using electorooculoraphy. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 741–753 (2011)CrossRef
14.
go back to reference Yoshimura, K., Kawaichi, H., Kunze, K., Kise, K.: Relationship between document understanding and gaze information acquired by eye-tracker. Tech. Rep. IEICE 112(495), 261–266 (2013) Yoshimura, K., Kawaichi, H., Kunze, K., Kise, K.: Relationship between document understanding and gaze information acquired by eye-tracker. Tech. Rep. IEICE 112(495), 261–266 (2013)
15.
go back to reference Kunze, K., Ustumi, Y., Shiga, Y., Kise, K., Bulling, A.: I know what you are reading: recognition of document type using mobile eye tracking. In: Proceedings of the 2013 International Symposium on Wearable Computers, pp. 113–116. Association for Computing Machinery, New York (2013) Kunze, K., Ustumi, Y., Shiga, Y., Kise, K., Bulling, A.: I know what you are reading: recognition of document type using mobile eye tracking. In: Proceedings of the 2013 International Symposium on Wearable Computers, pp. 113–116. Association for Computing Machinery, New York (2013)
16.
go back to reference Nakazono, A., Hamakawa, R.: Reading support system using Gaze movement feature. IPSJ Interact. 2018, 1060–1065 (2018) Nakazono, A., Hamakawa, R.: Reading support system using Gaze movement feature. IPSJ Interact. 2018, 1060–1065 (2018)
17.
go back to reference Imamura, M., Cho, I.: Research on Reading Support with Eye-tracking – Attempt for Ambient Interface. Undergraduate Research of the Department of Intermedia Art and Science, Waseda University (2016) Imamura, M., Cho, I.: Research on Reading Support with Eye-tracking – Attempt for Ambient Interface. Undergraduate Research of the Department of Intermedia Art and Science, Waseda University (2016)
Metadata
Title
Interactive Reading Note Generation Utilizing Gaze Information
Authors
Satoko Yoshida
Madoka Takahara
Erina Makihara
Ivan Tanev
Katsunori Shimohara
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-031-06424-1_38