Skip to main content

2018 | OriginalPaper | Buchkapitel

Enabling Touch-Based Communication in Wearable Devices for People with Sensory and Multisensory Impairments

verfasst von : Nicholas Caporusso, Luigi Biasi, Giovanni Cinquepalmi, Gianpaolo Francesco Trotta, Antonio Brunetti, Vitoantonio Bevilacqua

Erschienen in: Advances in Human Factors in Wearable Technologies and Game Design

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Tactile signing and touch-based alphabets are among the primary communication systems for people who suffer from sensory or multisensory conditions, such as, blindness or deaf-blindness, respectively. In the last decade, several research projects based on sensory substitution focused on developing novel interfaces. However, people who are sensory-impaired still lack reliable technology for interacting with the world. To this end, wearable devices could have a significant role in providing individuals with support for daily activities, communication, and social inclusion. In this paper, we introduce a categorization based on technology for sensing and representing the main components of touch- and gesture-based communication systems (i.e., movement, gesture, pressure, and touch) to provide an understanding of the technical and human factors which affect or foster the development of new assistive technology.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chang, A., O’Modhrain, S., Jacob, R., Gunther, E., Ishii, H.: ComTouch: design of a vibrotactile communication device. In: 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (2002). doi:10.1145/778712.778755 Chang, A., O’Modhrain, S., Jacob, R., Gunther, E., Ishii, H.: ComTouch: design of a vibrotactile communication device. In: 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (2002). doi:10.​1145/​778712.​778755
2.
Zurück zum Zitat Bieling, T., Gollner, U., Joost, G.: Mobile lorm glove – introducing a communication device for deaf-blind people. In: Tangible, embedded and embodied interaction. Kingston, ON, Canada (2012) Bieling, T., Gollner, U., Joost, G.: Mobile lorm glove – introducing a communication device for deaf-blind people. In: Tangible, embedded and embodied interaction. Kingston, ON, Canada (2012)
4.
Zurück zum Zitat Caporusso, N.: A wearable Malossi alphabet interface for deafblind people. In: Conference on Advanced Visual Interfaces, pp. 445–448 (2008). doi:10.1145/1385569.1385655 Caporusso, N.: A wearable Malossi alphabet interface for deafblind people. In: Conference on Advanced Visual Interfaces, pp. 445–448 (2008). doi:10.​1145/​1385569.​1385655
5.
Zurück zum Zitat Frieman, B.B.: State braille standards for teachers of students who are blind or visually impaired: a national survey. Braille Monit. 47(1), 12–16 (2004) Frieman, B.B.: State braille standards for teachers of students who are blind or visually impaired: a national survey. Braille Monit. 47(1), 12–16 (2004)
6.
Zurück zum Zitat Pederson, T., Janlert, L., Surie, D.: Towards a model for egocentric interaction with physical and virtual objects. In: 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, pp. 755–758 (2010). doi:10.1145/1868914.1869022 Pederson, T., Janlert, L., Surie, D.: Towards a model for egocentric interaction with physical and virtual objects. In: 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, pp. 755–758 (2010). doi:10.​1145/​1868914.​1869022
7.
Zurück zum Zitat Bevilacqua, V., Biasi, L., Pepe, A., Caporusso, N.: A computer vision method for recognizing finger spelling. In: International Conference on Intelligent Computing. ISBN 978-3-319-22052-9 Bevilacqua, V., Biasi, L., Pepe, A., Caporusso, N.: A computer vision method for recognizing finger spelling. In: International Conference on Intelligent Computing. ISBN 978-3-319-22052-9
8.
Zurück zum Zitat Halim, Z., Abbas, G.: A kinect-based sign language hand gesture recognition system for hearing- and speech-impaired: a pilot study of Pakistani sign language. Assistive Technol. (2015). doi:10.1080/10400435.2014.952845 Halim, Z., Abbas, G.: A kinect-based sign language hand gesture recognition system for hearing- and speech-impaired: a pilot study of Pakistani sign language. Assistive Technol. (2015). doi:10.​1080/​10400435.​2014.​952845
9.
Zurück zum Zitat Brouet, R., Blanch, R., Cani, M.P.: Understanding hand degrees of freedom and natural gestures for 3D interaction on tabletop. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) Human-Computer Interaction. Springer, Heidelberg (2013) Brouet, R., Blanch, R., Cani, M.P.: Understanding hand degrees of freedom and natural gestures for 3D interaction on tabletop. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) Human-Computer Interaction. Springer, Heidelberg (2013)
10.
Zurück zum Zitat Li, Y., Chen, X., Zhang, X., Wang, K., Yang, J.: Interpreting sign components from accelerometer and sEMG data for automatic sign language recognition. In: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3358–3361 (2011). doi:10.1109/IEMBS.2011.6090910 Li, Y., Chen, X., Zhang, X., Wang, K., Yang, J.: Interpreting sign components from accelerometer and sEMG data for automatic sign language recognition. In: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3358–3361 (2011). doi:10.​1109/​IEMBS.​2011.​6090910
12.
Zurück zum Zitat Yang, H.-D.: Sign language recognition with the kinect sensor based on conditional random fields. Sensors 15(1), 135–147 (2014)CrossRef Yang, H.-D.: Sign language recognition with the kinect sensor based on conditional random fields. Sensors 15(1), 135–147 (2014)CrossRef
13.
Zurück zum Zitat Elmahgiubi, M., Ennajar, M., Drawil, N., Elbuni, M.S.: Sign language translator and gesture recognition. In: Global Summit on Computer & Information Technology, pp. 1–6 (2015). doi:10.1109/GSCIT.2015.7353332 Elmahgiubi, M., Ennajar, M., Drawil, N., Elbuni, M.S.: Sign language translator and gesture recognition. In: Global Summit on Computer & Information Technology, pp. 1–6 (2015). doi:10.​1109/​GSCIT.​2015.​7353332
14.
Zurück zum Zitat Abhishek, K.S., Qubeley, L.C.F., Ho, D.: Glove-based hand gesture recognition sign language translator using capacitive touch sensor. In: IEEE International Conference on Electron Devices and Solid-State Circuits, pp. 334–337 (2016). doi:10.1109/EDSSC.2016.7785276 Abhishek, K.S., Qubeley, L.C.F., Ho, D.: Glove-based hand gesture recognition sign language translator using capacitive touch sensor. In: IEEE International Conference on Electron Devices and Solid-State Circuits, pp. 334–337 (2016). doi:10.​1109/​EDSSC.​2016.​7785276
15.
16.
Zurück zum Zitat Russo, L.O., Farulla, G.A., Pianu, D., Salgarella, A.R., Controzzi, M., Cipriani, C., Oddo, C.M., Geraci, C., Rosa, S., Indaco, M.: PARLOMA – a novel human-robot interaction system for deaf-blind remote communication. Int. J. Adv. Robot. Syst. 12(5) (2015). doi:10.5772/60416 Russo, L.O., Farulla, G.A., Pianu, D., Salgarella, A.R., Controzzi, M., Cipriani, C., Oddo, C.M., Geraci, C., Rosa, S., Indaco, M.: PARLOMA – a novel human-robot interaction system for deaf-blind remote communication. Int. J. Adv. Robot. Syst. 12(5) (2015). doi:10.​5772/​60416
Metadaten
Titel
Enabling Touch-Based Communication in Wearable Devices for People with Sensory and Multisensory Impairments
verfasst von
Nicholas Caporusso
Luigi Biasi
Giovanni Cinquepalmi
Gianpaolo Francesco Trotta
Antonio Brunetti
Vitoantonio Bevilacqua
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-60639-2_15