Skip to main content
Top

2020 | OriginalPaper | Chapter

Semantic Segmentation of MOOC Lecture Videos by Analyzing Concept Change in Domain Knowledge Graph

Authors : Ananda Das, Partha Pratim Das

Published in: Digital Libraries at Times of Massive Societal Transition

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Long lecture video metadata needs to have topic wise annotation information for quick topic searching and video browsing. In this work we perform topical segmentation of long MOOC lecture videos to obtain start-time and end-time of different topics taught by the instructor. During teaching instructor uses different concepts to explain a topic. So instructor has his own way of selecting and binding these concepts to represent a topic. Additionally knowledge graph of a subject domain contains inherent domain knowledge. In this work we analyze how the instructor changes concepts during topic change, the inherent knowledge available in a domain knowledge graph, semantic similarity and contextual relationship between different concepts to perform topical segmentation of long lecture videos. As output, we get semantically coherent topics taught by the instructor along with their interval (start-time and end-time). We tested our approach on 61 long NPTEL [1] videos delivered on software engineering domain. Experimentally we find that the topic intervals generated by our system has \(\sim \)83% similarity with the intervals present in the ground truth. Holistic evaluation shows that our approach performs better than the other approaches in the literature.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
4.
go back to reference Akbik, A., Bergmann, T., Blythe, D., Rasul, K., Schweter, S., Vollgraf, R.: FLAIR: an easy-to-use framework for state-of-the-art NLP. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), pp. 54–59 (2019) Akbik, A., Bergmann, T., Blythe, D., Rasul, K., Schweter, S., Vollgraf, R.: FLAIR: an easy-to-use framework for state-of-the-art NLP. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), pp. 54–59 (2019)
5.
go back to reference Baidya, E., Goel, S.: LectureKhoj: automatic tagging and semantic segmentation of online lecture videos. In: 2014 Seventh International Conference on Contemporary Computing (IC3), pp. 37–43. IEEE (2014) Baidya, E., Goel, S.: LectureKhoj: automatic tagging and semantic segmentation of online lecture videos. In: 2014 Seventh International Conference on Contemporary Computing (IC3), pp. 37–43. IEEE (2014)
7.
go back to reference Che, X., Yang, H., Meinel, C.: Lecture video segmentation by automatically analyzing the synchronized slides. In: Proceedings of the 21st ACM International Conference on Multimedia, pp. 345–348. ACM (2013) Che, X., Yang, H., Meinel, C.: Lecture video segmentation by automatically analyzing the synchronized slides. In: Proceedings of the 21st ACM International Conference on Multimedia, pp. 345–348. ACM (2013)
9.
go back to reference Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018) Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:​1810.​04805 (2018)
11.
go back to reference Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice-Hall, Inc., USA (2006) Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice-Hall, Inc., USA (2006)
12.
go back to reference Jaccard, P.: Nouvelles recherches sur la distribution florale. Bull. Soc. Vaud. Sci. Nat. 44, 223–270 (1908) Jaccard, P.: Nouvelles recherches sur la distribution florale. Bull. Soc. Vaud. Sci. Nat. 44, 223–270 (1908)
13.
go back to reference Jeong, H.J., Kim, T.E., Kim, M.H.: An accurate lecture video segmentation method by using sift and adaptive threshold. In: Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia. pp. 285–288. ACM (2012) Jeong, H.J., Kim, T.E., Kim, M.H.: An accurate lecture video segmentation method by using sift and adaptive threshold. In: Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia. pp. 285–288. ACM (2012)
14.
go back to reference Kusner, M., Sun, Y., Kolkin, N., Weinberger, K.: From word embeddings to document distances. In: International Conference on Machine Learning, pp. 957–966 (2015) Kusner, M., Sun, Y., Kolkin, N., Weinberger, K.: From word embeddings to document distances. In: International Conference on Machine Learning, pp. 957–966 (2015)
15.
go back to reference Lin, M., Nunamaker Jr, J.F., Chau, M., Chen, H.: Segmentation of lecture videos based on text: a method combining multiple linguistic features. In: Null, p. 10003c. IEEE (2004) Lin, M., Nunamaker Jr, J.F., Chau, M., Chen, H.: Segmentation of lecture videos based on text: a method combining multiple linguistic features. In: Null, p. 10003c. IEEE (2004)
16.
go back to reference Ma, D., Agam, G.: Lecture video segmentation and indexing. In: Document Recognition and Retrieval XIX, vol. 8297, p. 82970V. International Society for Optics and Photonics (2012) Ma, D., Agam, G.: Lecture video segmentation and indexing. In: Document Recognition and Retrieval XIX, vol. 8297, p. 82970V. International Society for Optics and Photonics (2012)
17.
go back to reference Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013) Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:​1301.​3781 (2013)
18.
go back to reference Repp, S., Grob, A., Meinel, C.: Browsing within lecture videos based on the chain index of speech transcription. IEEE Trans. Learn. Technol. 1(3), 145–156 (2008)CrossRef Repp, S., Grob, A., Meinel, C.: Browsing within lecture videos based on the chain index of speech transcription. IEEE Trans. Learn. Technol. 1(3), 145–156 (2008)CrossRef
19.
go back to reference Shah, R.R., Yu, Y., Shaikh, A.D., Tang, S., Zimmermann, R.: ATLAS: automatic temporal segmentation and annotation of lecture videos based on modelling transition time. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 209–212. ACM (2014) Shah, R.R., Yu, Y., Shaikh, A.D., Tang, S., Zimmermann, R.: ATLAS: automatic temporal segmentation and annotation of lecture videos based on modelling transition time. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 209–212. ACM (2014)
20.
go back to reference Shah, R.R., Yu, Y., Shaikh, A.D., Zimmermann, R.: TRACE: linguistic-based approach for automatic lecture video segmentation leveraging Wikipedia texts. In: 2015 IEEE International Symposium on Multimedia (ISM), pp. 217–220. IEEE (2015) Shah, R.R., Yu, Y., Shaikh, A.D., Zimmermann, R.: TRACE: linguistic-based approach for automatic lecture video segmentation leveraging Wikipedia texts. In: 2015 IEEE International Symposium on Multimedia (ISM), pp. 217–220. IEEE (2015)
21.
go back to reference Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016) Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016)
22.
go back to reference Yang, H., Meinel, C.: Content based lecture video retrieval using speech and video text information. IEEE Trans. Learn. Technol. 1(2), 142–154 (2014)CrossRef Yang, H., Meinel, C.: Content based lecture video retrieval using speech and video text information. IEEE Trans. Learn. Technol. 1(2), 142–154 (2014)CrossRef
23.
go back to reference Yang, H., Siebert, M., Luhne, P., Sack, H., Meinel, C.: Automatic lecture video indexing using video OCR technology. In: 2011 IEEE International Symposium on Multimedia (ISM), pp. 111–116. IEEE (2011) Yang, H., Siebert, M., Luhne, P., Sack, H., Meinel, C.: Automatic lecture video indexing using video OCR technology. In: 2011 IEEE International Symposium on Multimedia (ISM), pp. 111–116. IEEE (2011)
24.
go back to reference Zhao, X., Xing, Z., Kabir, M.A., Sawada, N., Li, J., Lin, S.W.: HDSKG: harvesting domain specific knowledge graph from content of webpages. In: 2017 IEEE 24th International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 56–67. IEEE (2017) Zhao, X., Xing, Z., Kabir, M.A., Sawada, N., Li, J., Lin, S.W.: HDSKG: harvesting domain specific knowledge graph from content of webpages. In: 2017 IEEE 24th International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 56–67. IEEE (2017)
Metadata
Title
Semantic Segmentation of MOOC Lecture Videos by Analyzing Concept Change in Domain Knowledge Graph
Authors
Ananda Das
Partha Pratim Das
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-64452-9_5

Premium Partner