Skip to main content
Top

2018 | OriginalPaper | Chapter

Exploiting the Web for Semantic Change Detection

Authors : Pierpaolo Basile, Barbara McGillivray

Published in: Discovery Science

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Detecting significant linguistic shifts in the meaning and usage of words has gained more attention over the last few years. Linguistic shifts are especially prevalent on the Internet, where words’ meaning can change rapidly. In this work, we describe the construction of a large diachronic corpus that relies on the UK Web Archive and we propose a preliminary analysis of semantic change detection exploiting a particular technique called Temporal Random Indexing. Results of the evaluation are promising and give us important insights for further investigations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
4
V contains the terms that we want to analyse, typically, the most n frequent terms.
 
5
We did not highlight orange in the list because in this context it could refer to the fruit, in which case it would be related to the fruit sense of blackberry, or to the mobile phone company, in which case it would be related to the cellphone sense of blackberry.
 
6
As the earliest texts in the corpus date from 1996, we allowed for a one-year buffer between this date and the date of first usage according to the OED, under the assumption that a sense first recorded in the OED in 1995 could be recorded with sufficient evidence in our corpus at least one year later.
 
Literature
1.
go back to reference Bamler, R., Mandt, S.: Dynamic word embeddings. In: Precup, D., Teh, Y.W. (eds.) Proceedings of the 34th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 70, pp. 380–389. PMLR, International Convention Centre, Sydney, Australia (06–11 Aug 2017), http://proceedings.mlr.press/v70/bamler17a.html Bamler, R., Mandt, S.: Dynamic word embeddings. In: Precup, D., Teh, Y.W. (eds.) Proceedings of the 34th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 70, pp. 380–389. PMLR, International Convention Centre, Sydney, Australia (06–11 Aug 2017), http://​proceedings.​mlr.​press/​v70/​bamler17a.​html
2.
go back to reference Basile, P., Caputo, A., Luisi, R., Semeraro, G.: Diachronic analysis of the italian language exploiting google ngram (2016) Basile, P., Caputo, A., Luisi, R., Semeraro, G.: Diachronic analysis of the italian language exploiting google ngram (2016)
3.
go back to reference Basile, P., Caputo, A., Semeraro, G.: Analysing word meaning over time by exploiting temporal random indexing. In: Basili, R., Lenci, A., Magnini, B. (eds.) First Italian Conference on Computational Linguistics CLiC-it 2014. Pisa University Press (2014) Basile, P., Caputo, A., Semeraro, G.: Analysing word meaning over time by exploiting temporal random indexing. In: Basili, R., Lenci, A., Magnini, B. (eds.) First Italian Conference on Computational Linguistics CLiC-it 2014. Pisa University Press (2014)
4.
go back to reference Basile, P., Caputo, A., Semeraro, G.: Temporal random indexing: a system for analysing word meaning over time. Ital. J. Comput. Linguist. 1(1), 55–68 (2015) Basile, P., Caputo, A., Semeraro, G.: Temporal random indexing: a system for analysing word meaning over time. Ital. J. Comput. Linguist. 1(1), 55–68 (2015)
5.
go back to reference Blei, D.M., Lafferty, J.D.: Dynamic topic models. In: ICML, pp. 113–120 (2006) Blei, D.M., Lafferty, J.D.: Dynamic topic models. In: ICML, pp. 113–120 (2006)
6.
go back to reference Boussidan, A., Ploux, S.: Using topic salience and connotational drifts to detect candidates to semantic change. In: Proceeding IWCS ’11 Proceedings of the Ninth International Conference on Computational Semantics, pp. 315–319 (2011) Boussidan, A., Ploux, S.: Using topic salience and connotational drifts to detect candidates to semantic change. In: Proceeding IWCS ’11 Proceedings of the Ninth International Conference on Computational Semantics, pp. 315–319 (2011)
7.
go back to reference Cook, P., Stevenson, S.: Automatically identifying changes in the semantic orientation of words. In: Proceedings of the Seventh conference on International Language Resources and Evaluation, Valletta, Malta (2010) Cook, P., Stevenson, S.: Automatically identifying changes in the semantic orientation of words. In: Proceedings of the Seventh conference on International Language Resources and Evaluation, Valletta, Malta (2010)
8.
go back to reference De Saussure, F.: Course in General Linguistics. Open Court, La Salle, Illinois (1983) De Saussure, F.: Course in General Linguistics. Open Court, La Salle, Illinois (1983)
9.
go back to reference Dubossarsky, H., Weinshall, D., Grossman, E.: Outta control: laws of semantic change and inherent biases in word representation models. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 1136–1145 (2017) Dubossarsky, H., Weinshall, D., Grossman, E.: Outta control: laws of semantic change and inherent biases in word representation models. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 1136–1145 (2017)
10.
go back to reference Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman and Hall/CRC, Boca Raton (1994)MATH Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman and Hall/CRC, Boca Raton (1994)MATH
11.
go back to reference Frermann, L., Lapata, M.: A bayesian model of diachronic meaning change. Trans. Assoc. Comput. Linguist. 4, 31–45 (2016) Frermann, L., Lapata, M.: A bayesian model of diachronic meaning change. Trans. Assoc. Comput. Linguist. 4, 31–45 (2016)
13.
go back to reference Hamilton, W.L., Leskovec, J., Jurafsky, D.: Diachronic word embeddings reveal statistical laws of semantic change. arXiv preprint arXiv:1605.09096 (2016) Hamilton, W.L., Leskovec, J., Jurafsky, D.: Diachronic word embeddings reveal statistical laws of semantic change. arXiv preprint arXiv:​1605.​09096 (2016)
16.
go back to reference Jurgens, D., Stevens, K.: event detection in blogs using temporal random indexing. In: Proceedings of the Workshop on Events in Emerging Text Types, pp. 9–16. Association for Computational Linguistics (2009) Jurgens, D., Stevens, K.: event detection in blogs using temporal random indexing. In: Proceedings of the Workshop on Events in Emerging Text Types, pp. 9–16. Association for Computational Linguistics (2009)
17.
go back to reference Kulkarni, V., Al-Rfou, R., Perozzi, B., Skiena, S.: Statistically significant detection of linguistic change. In: Proceedings of the 24th International Conference on World Wide Web, pp. 625–635. ACM (2015) Kulkarni, V., Al-Rfou, R., Perozzi, B., Skiena, S.: Statistically significant detection of linguistic change. In: Proceedings of the 24th International Conference on World Wide Web, pp. 625–635. ACM (2015)
18.
go back to reference Kutuzov, A., Øvrelid, L., Szymanski, T., Velldal, E.: Diachronic word embeddings and semantic shifts: a survey (2018). arXiv:1806.03537 Kutuzov, A., Øvrelid, L., Szymanski, T., Velldal, E.: Diachronic word embeddings and semantic shifts: a survey (2018). arXiv:​1806.​03537
19.
go back to reference Lin, Y., Michel, J.B., Aiden, E.L., Orwant, J., Brockman, W., Petrov, S.: Syntactic annotations for the google books ngram corpus. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Jeju, Republic of Korea, 8–14 July 2012, pp. 169–174. Association for Computational Linguistics (2012) Lin, Y., Michel, J.B., Aiden, E.L., Orwant, J., Brockman, W., Petrov, S.: Syntactic annotations for the google books ngram corpus. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Jeju, Republic of Korea, 8–14 July 2012, pp. 169–174. Association for Computational Linguistics (2012)
20.
go back to reference Mitchell, J., Lapata, M.: Composition in distributional models of semantics. Cogn. Sci. 34(8), 1388–1429 (2010)CrossRef Mitchell, J., Lapata, M.: Composition in distributional models of semantics. Cogn. Sci. 34(8), 1388–1429 (2010)CrossRef
21.
go back to reference Rudolph, M., Blei, D.: Dynamic embeddings for language evolution. In: Proceedings of the 2018 World Wide Web Conference on World Wide Web (2018) Rudolph, M., Blei, D.: Dynamic embeddings for language evolution. In: Proceedings of the 2018 World Wide Web Conference on World Wide Web (2018)
22.
go back to reference Sahlgren, M.: The word-space model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces (2006) Sahlgren, M.: The word-space model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces (2006)
23.
go back to reference Schiitze, H.: Word space. Adv. Neural Inf. Process. Syst. 5, 895–902 (1993) Schiitze, H.: Word space. Adv. Neural Inf. Process. Syst. 5, 895–902 (1993)
26.
go back to reference Taylor, W.A.: Change-Point Analysis: A Powerful New Tool for Detecting Changes. Taylor Enterprises, Inc. (2000) Taylor, W.A.: Change-Point Analysis: A Powerful New Tool for Detecting Changes. Taylor Enterprises, Inc. (2000)
28.
go back to reference Xu, Y., Kemp, C.: A computational evaluation of two laws of semantic change. Proc. CogSci 2015, 1–6 (2015) Xu, Y., Kemp, C.: A computational evaluation of two laws of semantic change. Proc. CogSci 2015, 1–6 (2015)
Metadata
Title
Exploiting the Web for Semantic Change Detection
Authors
Pierpaolo Basile
Barbara McGillivray
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-01771-2_13

Premium Partner