Skip to main content

2022 | OriginalPaper | Buchkapitel

Towards Semantically Enhanced Audio Rendering of Equations

verfasst von : Akashdeep Bansal, Volker Sorge, M. Balakrishnan, Aayush Aggarwal

Erschienen in: Computers Helping People with Special Needs

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

At present STEM education beyond middle school is largely inaccessible to visually impaired students in countries like India. Access to equations, tables, charts and figures are the key bottleneck. With the increased penetration of screen reading software, effective audio rendering of equations can significantly help in making many of the e-texts accessible. Unfortunately, linear syntactic rendering of equations can create considerable cognitive load even for relatively simple equations. In this paper we propose an architecture to extract contextual semantic of equations based on the local definitions. This will help in adapting audio rendering of equations based on their contextual semantics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Almomen, R.: Context classification for improved semantic understanding of mathematical formulae. PhD thesis, University of Birmingham (2018) Almomen, R.: Context classification for improved semantic understanding of mathematical formulae. PhD thesis, University of Birmingham (2018)
2.
Zurück zum Zitat Bansal, A., Balakrishnan, M., Sorge, V.: Comprehensive accessibility of equations by visually impaired. Accessibil. Comput. 126, 1 (2020) Bansal, A., Balakrishnan, M., Sorge, V.: Comprehensive accessibility of equations by visually impaired. Accessibil. Comput. 126, 1 (2020)
3.
Zurück zum Zitat Bansal, A., Balakrishnan, M., Sorge, V.: Evaluating cognitive complexity of algebraic equations. J. Technol. Persons Disabill. 170, 170–200 (2021) Bansal, A., Balakrishnan, M., Sorge, V.: Evaluating cognitive complexity of algebraic equations. J. Technol. Persons Disabill. 170, 170–200 (2021)
4.
Zurück zum Zitat Bansal, A., Kumar, P., Sorge, V., Balakrishnan, M.: Locating mathematical definitions in a document. In: 4th International Workshop on Digitization and E-Inclusion in Mathematics and Science (2021) Bansal, A., Kumar, P., Sorge, V., Balakrishnan, M.: Locating mathematical definitions in a document. In: 4th International Workshop on Digitization and E-Inclusion in Mathematics and Science (2021)
5.
Zurück zum Zitat Cervone, D., Krautzberger, P., Sorge, V.: New accessibility features in MathJax. J. Technol. Persons Disabil. 4, 167–175 (2016) Cervone, D., Krautzberger, P., Sorge, V.: New accessibility features in MathJax. J. Technol. Persons Disabil. 4, 167–175 (2016)
6.
Zurück zum Zitat Doush, I.A., Alkhateeb, F., Al Maghayreh, E.: Towards meaningful mathematical expressions in e-learning. In: Proceedings of the 1st International Conference on Intelligent Semantic Web-Services and Applications, pp. 1–5 (2010) Doush, I.A., Alkhateeb, F., Al Maghayreh, E.: Towards meaningful mathematical expressions in e-learning. In: Proceedings of the 1st International Conference on Intelligent Semantic Web-Services and Applications, pp. 1–5 (2010)
7.
Zurück zum Zitat Frankel, L., Brownstein, B., Soiffer, N.: Navigable, customizable TTS for algebra. In: 28th Annual International Technology and Persons with Disabilities Conference Scientific/Research Proceedings. California State University, Northridge (2014) Frankel, L., Brownstein, B., Soiffer, N.: Navigable, customizable TTS for algebra. In: 28th Annual International Technology and Persons with Disabilities Conference Scientific/Research Proceedings. California State University, Northridge (2014)
8.
Zurück zum Zitat Ginev, D., Jucovschi, C., Anca, S., Grigore, M., David, C., Kohlhase, M.: An architecture for linguistic and semantic analysis on the arxmliv corpus. Informatik 2009-Im Focus das Leben (2009) Ginev, D., Jucovschi, C., Anca, S., Grigore, M., David, C., Kohlhase, M.: An architecture for linguistic and semantic analysis on the arxmliv corpus. Informatik 2009-Im Focus das Leben (2009)
9.
Zurück zum Zitat Grigore, M., Wolska, M., Kohlhase, M.: Towards context-based disambiguation of mathematical expressions. In: Joint Conference of ASCM, pp. 262–271 (2009) Grigore, M., Wolska, M., Kohlhase, M.: Towards context-based disambiguation of mathematical expressions. In: Joint Conference of ASCM, pp. 262–271 (2009)
10.
Zurück zum Zitat Nghiem, M.-Q., Kristianto, G.Y., Topić, G., Aizawa, A.: A hybrid approach for semantic enrichment of MathML mathematical expressions. In: Carette, J., Aspinall, D., Lange, C., Sojka, P., Windsteiger, W. (eds.) CICM 2013. LNCS (LNAI), vol. 7961, pp. 278–287. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39320-4_18CrossRef Nghiem, M.-Q., Kristianto, G.Y., Topić, G., Aizawa, A.: A hybrid approach for semantic enrichment of MathML mathematical expressions. In: Carette, J., Aspinall, D., Lange, C., Sojka, P., Windsteiger, W. (eds.) CICM 2013. LNCS (LNAI), vol. 7961, pp. 278–287. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-39320-4_​18CrossRef
11.
Zurück zum Zitat Nghiem, M.-Q., Yoko, G., Matsubayashi, Y., Aizawa, A.: Towards mathematical expression understanding. inftyreader.org (2014) Nghiem, M.-Q., Yoko, G., Matsubayashi, Y., Aizawa, A.: Towards mathematical expression understanding. inftyreader.org (2014)
12.
Zurück zum Zitat Pennington, J., Socher, R., Manning, C.D.: GloVe: global vectors for word representation. In: Empirical Methods in Natural Language Processing (2014) Pennington, J., Socher, R., Manning, C.D.: GloVe: global vectors for word representation. In: Empirical Methods in Natural Language Processing (2014)
14.
Zurück zum Zitat Stathopoulos, Y., Teufel, S.: Mathematical information retrieval based on type embeddings and query expansion. In: 26th International Conference on Computational Linguistics (2016) Stathopoulos, Y., Teufel, S.: Mathematical information retrieval based on type embeddings and query expansion. In: 26th International Conference on Computational Linguistics (2016)
16.
Zurück zum Zitat List of mathematical symbols by subject. Wikipedia (2020) List of mathematical symbols by subject. Wikipedia (2020)
18.
Zurück zum Zitat Wolska, M., Grigore, M.: Symbol Declarations in Mathematical Writing. Masaryk University Press (2010) Wolska, M., Grigore, M.: Symbol Declarations in Mathematical Writing. Masaryk University Press (2010)
19.
Zurück zum Zitat Wolska, M., Grigore, M., Kohlhase, M.: Using Discourse Context to Interpret Object-Denoting Mathematical Expressions. Masaryk University Press (2011) Wolska, M., Grigore, M., Kohlhase, M.: Using Discourse Context to Interpret Object-Denoting Mathematical Expressions. Masaryk University Press (2011)
21.
Zurück zum Zitat Yokoi, K., Nghiem, M.-Q., Matsubayashi, Y., Aizawa, A.: Contextual analysis of mathematical expressions for advanced mathematical search. Polibits 43, 81–86 (2011)CrossRef Yokoi, K., Nghiem, M.-Q., Matsubayashi, Y., Aizawa, A.: Contextual analysis of mathematical expressions for advanced mathematical search. Polibits 43, 81–86 (2011)CrossRef
Metadaten
Titel
Towards Semantically Enhanced Audio Rendering of Equations
verfasst von
Akashdeep Bansal
Volker Sorge
M. Balakrishnan
Aayush Aggarwal
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-031-08648-9_5

Neuer Inhalt