Preliminary Study of Mobile Device-Based Speech Enhancement System Using Lip-Reading

2019
OriginalPaper
Chapter

Published in:

Authors: Yuta Matsunaga; Kenji Matsui; Yoshihisa Nakatoh; Yumiko O. Kato; Daniel Lopez-Sanchez; Sara Rodriguez; Juan Manuel Corchado
Published in: Distributed Computing and Artificial Intelligence, 15th International Conference
Publisher: Springer International Publishing

Read first chapter Log in

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Inconspicuous speech enhancement system for laryngectomies using lip-reading is proposed to improve the usability and the speech quality. The proposed system uses a tiny camera on mobile phone and recognize the vowel sequences using lip-reading function. Three types of Japanese vowel recognition algorithms using MLP, CNN, and MobileNets, were investigated. 3,000 image datasets for training and testing were prepared from five persons while uttering discrete vowels. Our preliminary experimental result shows that the MobileNets is appropriate for embedding mobile devices in consideration of a performance both recognition accuracy and calculation cost.

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Business + Economics & Engineering + Technology"

Online-Abonnement

Springer Professional "Business + Economics & Engineering + Technology" gives you access to:

more than 102.000 books
more than 537 journals

from the following subject areas:

Automotive
Construction + Real Estate
Business IT + Informatics
Electrical Engineering + Electronics
Energy + Sustainability
Finance + Banking
Management + Leadership
Marketing + Sales
Mechanical Engineering + Materials
Insurance + Risk

Secure your knowledge advantage now!

inform now

Springer Professional "Engineering + Technology"

Online-Abonnement

Springer Professional "Engineering + Technology" gives you access to:

more than 67.000 books
more than 390 journals

from the following specialised fileds:

Automotive
Business IT + Informatics
Construction + Real Estate
Electrical Engineering + Electronics
Energy + Sustainability
Mechanical Engineering + Materials

Secure your knowledge advantage now!

inform now

Springer Professional "Business + Economics"

Online-Abonnement

Springer Professional "Business + Economics" gives you access to:

more than 67.000 books
more than 340 journals

from the following specialised fileds:

Construction + Real Estate
Business IT + Informatics
Finance + Banking
Management + Leadership
Marketing + Sales
Insurance + Risk

Secure your knowledge advantage now!

inform now

previous chapter Robust Noisy Speech Recognition Using Deep Neural Support Vector Machines

next chapter Social Services Diagnosis by Deep Learning

Metadata
Literature

Title: Preliminary Study of Mobile Device-Based Speech Enhancement System Using Lip-Reading
Authors: Yuta Matsunaga
Kenji Matsui
Yoshihisa Nakatoh
Yumiko O. Kato
Daniel Lopez-Sanchez
Sara Rodriguez
Juan Manuel Corchado
Publisher: Springer International Publishing
Book: Distributed Computing and Artificial Intelligence, 15th International Conference
Print ISBN: 978-3-319-94648-1

Electronic ISBN: 978-3-319-94649-8

Copyright Year: 2019
DOI: https://doi.org/10.1007/978-3-319-94649-8_37

This content is only visible if you are logged in and have the appropriate permissions.