nach oben

Erschienen in:

2025 | OriginalPaper | Buchkapitel

Classification of Khasi Dialects Using Spectrogram Augmentation and Pre-trained Models

verfasst von : Khiakupar Jyndiang, Joyprakash Singh Lairenlakpam

Erschienen in: Advances in Communication, Devices and Networking

Verlag: Springer Nature Singapore

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Using the pre-trained models, this paper discusses the classification of four Khasi dialects—Sohra, Nongkrem, Mairang, and Maram dialects. Mel-spectrogram images were extracted from speech audio of the above four dialects with time masking augmentation. With pre-trained AlexNet and ResNet18 models, we obtained remarkable outcomes in our dialect spectrogram identification study. In our experiment, we got a decent validation accuracy of 93.58%, 93.25%, and 93.20% by AlexNet with 8, 15, and 25 epochs, respectively. Again, with the same epochs, ResNet18 achieved accuracy rates of 88.23%, 93.55%, and 93.57%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Real-Time Weather Prediction Using Multivariable Regression Model

Nächstes Kapitel An Effort Toward Localization and Recognition of Elevation Values in a Topographic Sheet

Chambers JK, Trudgill P (1998) Dialectology, 2nd edn. Cambridge University Press, CambridgeCrossRef

Deka U, Sarma RM, Sarma R (2012) A glimpse of language and culture of North East India, 1st edn

Sharan RV, Moir TJ (2019) Acoustic event recognition using cochleagram image and convolutional neural networks. Appl Acoust 148:62–66. https://doi.org/10.1016/j.apacoust.2018.12.006CrossRef

Farabet C, Couprie C, Najman L, LeCun Y (2013) Learning hierarchical features for scene labeling. IEEE Trans Pattern Anal Mach Intell 35(8):1915–1929. https://doi.org/10.1109/TPAMI.2012.231CrossRef

Cetin O (2023) Accent recognition using a spectrogram image feature-based convolutional neural network. Arab J Sci Eng 48:1973–1990. https://doi.org/10.1007/s13369-022-07086-9CrossRef

Erhan D, Manzagol P-A, Bengio Y, Bengio S, Vincent P (2009) The difficulty of training deep architectures and the effect of unsupervised pre-training. In: van Dyk D, Welling M (eds) Proceedings of the international conference on artificial intelligence and statistics. PMLR, pp 153–160

Zissman MA, Gleason TP, Rekart DM, Losiewicz BL (1996) Automatic dialect identification of extemporaneous conversational, Latin American Spanish speech. In: 1996 IEEE international conference on acoustics, speech, and signal processing, pp 777–780. https://doi.org/10.1109/ICASSP.1996.543236

Tsai W-H, Chang W-W (1999) Chinese dialect identification using an acoustic-phonotactic model

Bougrine S, Cherroun H, Abdelali A (2018) Spoken Arabic Algerian dialect identification. In: Proceedings of the 2nd international conference on natural language and speech processing (ICNLSP), pp 1–6. https://doi.org/10.1109/ICNLSP.2018.8374383

10.

Miao X, McLoughlin I (2019) LSTM-TDNN with convolutional front-end for dialect identification in the 2019 multi-genre broadcast challenge. arXiv:1912.09003

11.

Mothukuri S, Hegde P, Chittaragi B, Koolagudi S (2020) Kannada dialect classification using artificial neural networks. In: Proceedings of the 2020 international conference on artificial intelligence and signal processing (AISP), pp 1–5. https://doi.org/10.1109/AISP48273.2020.9073178

12.

AlYami R, AlZaidy R (2020) Arabic dialect identification in social media. In: 2020 3rd international conference on computer applications and information security (ICCAIS), pp 1–2. https://doi.org/10.1109/ICCAIS48893.2020.9096847

13.

Zhang H, Shao Y, Yu X, Jin Y (2021) The method based on spectrogram’s image classification for Chinese dialect’s tone recognition. In: 2021 IEEE 4th international conference on computer and communication engineering technology (CCET), pp 75–78. https://doi.org/10.1109/CCET52649.2021.9544275

14.

Das H, Bhattacharjee U (2022) Assamese dialect identification system using deep learning. https://doi.org/10.21203/rs.3.rs-1733629/v1

15.

Lesnichaia M, Mikhailava V, Bogach N, Lezhenin I, Blake J, Pushkin E (2022) Classification of accented English using CNN model trained on amplitude mel-spectrograms. In: Proceedings of the Interspeech 2022, pp 3669–3673. https://doi.org/10.21437/Interspeech.2022-462

16.

Syiem E, Marak CR et al (2014) Ki jait ktien bad ki ktien tnat jong ka Meghalaya, 1st edn. Ri Khasi Book Agency, Shillong

17.

Ozer I, Ozer Z, Findik O (2018) Noise robust sound event classification with convolutional neural network. Neurocomputing 272:505–512. https://doi.org/10.1016/j.neucom.2017.07.021CrossRef

18.

Mukherjee S, Shivam N, Gangwal A, Khaitan L, Das AJ (2019) Spoken language recognition using CNN. In: 2019 international conference on industrial technology (ICIT), pp 37–41. https://doi.org/10.1109/ICIT48102.2019.00013

19.

Padi S, Sadjadi SO, Manocha D, Sriram RD (2021) Improved speech emotion recognition using transfer learning and spectrogram augmentation. arXiv:2108.02510

20.

Park DS, Chan W, Zhang Y, Chiu C-C, Zoph B, Cubuk ED, Le QV (2019) SpecAugment: a simple data augmentation method for automatic speech recognition. In: Interspeech 2019. https://doi.org/10.21437/interspeech.2019-2680

21.

Hwang Y, Cho H, Yang H, Won D-O, Oh I, Lee S-W (2020) Mel-spectrogram augmentation for sequence to sequence voice conversion. arXiv:2001.01401

22.

He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. arXiv:1512.03385

23.

Krizhevsky A, Sutskever I, Hinton G (2012) ImageNet classification with deep convolutional neural networks. Neural Inf Process Syst 25

24.

Feng K, Chaspari T (2019) Low-resource language identification from speech using transfer learning. In: 2019 IEEE 29th international workshop on machine learning for signal processing (MLSP), pp 1–6. https://doi.org/10.1109/MLSP.2019.8918833

Titel: Classification of Khasi Dialects Using Spectrogram Augmentation and Pre-trained Models
verfasst von: Khiakupar Jyndiang
Joyprakash Singh Lairenlakpam
Verlag: Springer Nature Singapore
Buch: Advances in Communication, Devices and Networking
Print ISBN: 978-981-9764-64-8

Electronic ISBN: 978-981-9764-65-5

Copyright-Jahr: 2025
DOI: https://doi.org/10.1007/978-981-97-6465-5_14

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"