Advertisement
Published in:
2021 | OriginalPaper | Chapter
Deep Learning-Based Computer Aided Customization of Speech Therapy
Authors : Sarthak Agarwal, Vaibhav Saxena, Vaibhav Singal, Swati Aggarwal
Published in: Applications of Artificial Intelligence and Machine Learning
Publisher: Springer Singapore
Activate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by
Abstract
Video frame interpolation is a computer vision technique used to synthesize intermediate frames between two subsequent frames. This technique has been extensively used for the purpose of video upsampling, video compression and video rendering. We present here an unexplored application of frame interpolation, by using it to join different phoneme videos in order to generate speech videos. Such videos can be used for the purpose of speech entrainment, as well as help to create lip reading video exercises. We propose an end-to-end convolutional neural network employing a U-net architecture that learns optical flows and generates intermediate frames between two different phoneme videos. The quality of the model is evaluated against qualitative measures like the Structural Similarity Index (SSIM) and the peak signal-to-noise ratio (PSNR), and performs favorably well, with an SSIM score of 0.870, and a PSNR score of 33.844.