Skip to main content

2019 | OriginalPaper | Buchkapitel

Short Text Similarity Measurement Based on Coupled Semantic Relation and Strong Classification Features

verfasst von : Huifang Ma, Wen Liu, Zhixin Li, Xianghong Lin

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Measuring the similarity between short texts is made difficult by the fact that two texts that are semantically related may not contain any words in common. In this paper, we propose a novel short text similarity measure which aggregates coupled semantic relation (CSR) and strong classification features (SCF) to provide a richer semantic context. On the one hand, CSR considers both intra-relation (i.e. co-occurrence of terms based on the modified weighting strategy) and inter-relation (i.e. dependency of terms via paths that connect linking terms) between a pair of terms. On the other hand, Based on SCF for similarity measure is established based on the idea that the more similar two texts are, the more features of strong classification they share. Finally, we combine the above two techniques to address the semantic sparseness of short text. We carry out extensive experiments on real world short texts. The results demonstrate that our method significantly outperforms baseline methods on several evaluation metrics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Li, C.L., Wang, H.R., Zhang, Z.Q., Sun, A.: Topic modeling for short texts with auxiliary word embeddings. In: 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 17–21. SIGIR, Pisa (2016) Li, C.L., Wang, H.R., Zhang, Z.Q., Sun, A.: Topic modeling for short texts with auxiliary word embeddings. In: 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 17–21. SIGIR, Pisa (2016)
2.
Zurück zum Zitat Wang, C., Song, Y., Elkishky, A., Zhang, M.: Incorporating world knowledge to document clustering via heterogeneous information networks. In: 21th Knowledge Discovery and Data Mining. KDD, pp. 1215–1224. ACM, Sydney (2015) Wang, C., Song, Y., Elkishky, A., Zhang, M.: Incorporating world knowledge to document clustering via heterogeneous information networks. In: 21th Knowledge Discovery and Data Mining. KDD, pp. 1215–1224. ACM, Sydney (2015)
3.
Zurück zum Zitat Li, P.P., Wang, H., Zhu, K.Q., Wang, Z.: A large probabilistic semantic network based approach to compute term similarity. IEEE Trans. Knowl. Data Eng. 27(10), 2604–2617 (2015)CrossRef Li, P.P., Wang, H., Zhu, K.Q., Wang, Z.: A large probabilistic semantic network based approach to compute term similarity. IEEE Trans. Knowl. Data Eng. 27(10), 2604–2617 (2015)CrossRef
4.
Zurück zum Zitat Cheng, X., Miao, D., Wang, C., Cao, L.: Coupled term-term relation analysis for document clustering. In: The 2013 International Joint Conference on Neural Networks, pp. 1–8. IEEE, Dallas (2013) Cheng, X., Miao, D., Wang, C., Cao, L.: Coupled term-term relation analysis for document clustering. In: The 2013 International Joint Conference on Neural Networks, pp. 1–8. IEEE, Dallas (2013)
5.
Zurück zum Zitat Kusner, M.J., Sun, Y., Kolkin, N.I., Weinberger, K.Q.: From word embeddings to document distances. In: 32nd International Conference on International Conference on Machine Learning, pp. 957–966. ICML, Lille (2015) Kusner, M.J., Sun, Y., Kolkin, N.I., Weinberger, K.Q.: From word embeddings to document distances. In: 32nd International Conference on International Conference on Machine Learning, pp. 957–966. ICML, Lille (2015)
6.
Zurück zum Zitat Ma, H., Xing, Y., Wang, S., Li, M.: Leveraging term co-occurrence distance and strong classification features for short text feature selection. In: Li, G., Ge, Y., Zhang, Z., Jin, Z., Blumenstein, M. (eds.) KSEM 2017. LNCS (LNAI), vol. 10412, pp. 67–75. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-63558-3_6CrossRef Ma, H., Xing, Y., Wang, S., Li, M.: Leveraging term co-occurrence distance and strong classification features for short text feature selection. In: Li, G., Ge, Y., Zhang, Z., Jin, Z., Blumenstein, M. (eds.) KSEM 2017. LNCS (LNAI), vol. 10412, pp. 67–75. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-63558-3_​6CrossRef
7.
Zurück zum Zitat Chen, Q.Q., Hu, L., Xu, J., Liu, W.: Document similarity analysis via involving both explicit and implicit semantic couplings. In: 2015 International Conference on Data Science and Advanced Analytics, pp. 1–10. IEEE, Paris (2015) Chen, Q.Q., Hu, L., Xu, J., Liu, W.: Document similarity analysis via involving both explicit and implicit semantic couplings. In: 2015 International Conference on Data Science and Advanced Analytics, pp. 1–10. IEEE, Paris (2015)
8.
Zurück zum Zitat Zhang, L., Gao, Y., Hong, C., Zhu, J.: Feature correlation hypergraph: exploiting high-order potentials for multimodal recognition. IEEE Trans. Cybern. 44(8), 1408–1419 (2017)CrossRef Zhang, L., Gao, Y., Hong, C., Zhu, J.: Feature correlation hypergraph: exploiting high-order potentials for multimodal recognition. IEEE Trans. Cybern. 44(8), 1408–1419 (2017)CrossRef
9.
Zurück zum Zitat MacKay, D.J.C.: Information Theory, Inference, and Learning Algorithms, 1st edn. Cambridge University Press, Cambridge (2003)MATH MacKay, D.J.C.: Information Theory, Inference, and Learning Algorithms, 1st edn. Cambridge University Press, Cambridge (2003)MATH
12.
Zurück zum Zitat Liu, W., Ma, H., Tuo, T., Chen, H.B.: Co-occurrence distance and discrimination based similarity measure on short text. Comput. Eng. Sci. 40(7), 1281–1286 (2018) Liu, W., Ma, H., Tuo, T., Chen, H.B.: Co-occurrence distance and discrimination based similarity measure on short text. Comput. Eng. Sci. 40(7), 1281–1286 (2018)
13.
Zurück zum Zitat Wen, H., Xiao, N.: A semi-supervised text clustering based on strong classification features affinity propagatione. Pattern Recognit. Artif. Intell. 27(7), 646–654 (2014) Wen, H., Xiao, N.: A semi-supervised text clustering based on strong classification features affinity propagatione. Pattern Recognit. Artif. Intell. 27(7), 646–654 (2014)
Metadaten
Titel
Short Text Similarity Measurement Based on Coupled Semantic Relation and Strong Classification Features
verfasst von
Huifang Ma
Wen Liu
Zhixin Li
Xianghong Lin
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-16148-4_11