Skip to main content
Erschienen in: Social Network Analysis and Mining 1/2023

01.12.2023 | Original Article

Sentiment analysis algorithm using contrastive learning and adversarial training for POI recommendation

verfasst von: Shaowei Huang, Xiangping Wu, Xiangyang Wu, Ke Wang

Erschienen in: Social Network Analysis and Mining | Ausgabe 1/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Finding a suitable POI based on the user’s needs and intentions is a complex decision-making process. Obtaining valuable information from the vast amount of social media data and using it for travel recommendations is a challenging issue. Traditional POI recommendation algorithms do not fully take into account the true feelings of customers about tourist attractions implied in social media data because they usually require a large amount of tagged travel commentary data. This study presents an aspect-based sentiment analysis model and POI recommendation method to accurately capture sentiment information contained in social media data with a small amount of tagged data. The pre-training model BERT is used to obtain the embedded representation of words that fuse the semantic information of the text. Using contrastive learning, point clusters belonging to the same class in the embedded space of words are pulled together, and sample clusters from different classes are separated. The potential relationship between comment ratings and their impact on user perception is analyzed, and the best performance formula for the loss function is determined. The test accuracy and F1-Score of the model in the experiment improved by 13.03% and 12.23%, respectively, compared to the BERT base model. POI recommendation validation is performed using a variety of recommendation algorithms. The experimental results show that the addition of aspect-based sentiment attributes can effectively improve the accuracy of recommendations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Abdi A, Shamsuddin SM, Hasan S, Piran J (2018) Machine learning-based multi-documents sentiment-oriented summarization using linguistic treatment. Expert Syst Appl 109:66–85CrossRef Abdi A, Shamsuddin SM, Hasan S, Piran J (2018) Machine learning-based multi-documents sentiment-oriented summarization using linguistic treatment. Expert Syst Appl 109:66–85CrossRef
Zurück zum Zitat Alsubari SN, Deshmukh SN, Alqarni AA, Alsharif N, Aldhyani TH, Alsaade FW, Khalaf OI (2022) Data analytics for the identification of fake reviews using supervised learning. Comput Mater Continua 70(2):3189–3204CrossRef Alsubari SN, Deshmukh SN, Alqarni AA, Alsharif N, Aldhyani TH, Alsaade FW, Khalaf OI (2022) Data analytics for the identification of fake reviews using supervised learning. Comput Mater Continua 70(2):3189–3204CrossRef
Zurück zum Zitat Amplayo RK, Song M (2017) An adaptable fine-grained sentiment analysis for summarization of multiple short online reviews. Data Knowl Eng 110:54–67CrossRef Amplayo RK, Song M (2017) An adaptable fine-grained sentiment analysis for summarization of multiple short online reviews. Data Knowl Eng 110:54–67CrossRef
Zurück zum Zitat Bhat M, Qadri M, Noor-ul-Asrar Beg MK, Ahanger N, Agarwal B (2020) Sentiment analysis of social media response on the Covid19 outbreak. Brain, Behavior, and Immunity 87:136CrossRef Bhat M, Qadri M, Noor-ul-Asrar Beg MK, Ahanger N, Agarwal B (2020) Sentiment analysis of social media response on the Covid19 outbreak. Brain, Behavior, and Immunity 87:136CrossRef
Zurück zum Zitat Cambria E, Das D, Bandyopadhyay S, Feraco A (2017) Affective computing and sentiment analysis. Pract Guide Sentim Anal 1–10 Cambria E, Das D, Bandyopadhyay S, Feraco A (2017) Affective computing and sentiment analysis. Pract Guide Sentim Anal 1–10
Zurück zum Zitat Cao K, Wei C, Gaidon A, Arechiga N, Ma T (2019) Learning imbalanced datasets with label-distribution-aware margin loss. Adv Neural Inf Process. Syst 32 Cao K, Wei C, Gaidon A, Arechiga N, Ma T (2019) Learning imbalanced datasets with label-distribution-aware margin loss. Adv Neural Inf Process. Syst 32
Zurück zum Zitat Chen T, Kornblith S, Norouzi M, Hinton G (2020) A simple framework for contrastive learning of visual representations. In: International conference on machine learning pp 1597–1607 Chen T, Kornblith S, Norouzi M, Hinton G (2020) A simple framework for contrastive learning of visual representations. In: International conference on machine learning pp 1597–1607
Zurück zum Zitat Chen C, Zhang D, Wang Y, Huang H (2021) TripPlanner: personalized trip planning leveraging heterogeneous trajectory data. In: Enabling Smart Urban Services with GPS Trajectory Data. Springer, Singapore, pp 225–247 Chen C, Zhang D, Wang Y, Huang H (2021) TripPlanner: personalized trip planning leveraging heterogeneous trajectory data. In: Enabling Smart Urban Services with GPS Trajectory Data. Springer, Singapore, pp 225–247
Zurück zum Zitat Devlin J, Chang MW, Lee K, Toutanova K (2018) BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 Devlin J, Chang MW, Lee K, Toutanova K (2018) BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:​1810.​04805
Zurück zum Zitat Dodge J, Ilharco G, Schwartz R, Farhadi A, Hajishirzi H, Smith N (2020) Fine-tuning pretrained language models: Weight initializations, data orders, and early stopping. arXiv preprint arXiv:2002.06305 Dodge J, Ilharco G, Schwartz R, Farhadi A, Hajishirzi H, Smith N (2020) Fine-tuning pretrained language models: Weight initializations, data orders, and early stopping. arXiv preprint arXiv:​2002.​06305
Zurück zum Zitat Dogan A, Birant D (2021) Machine learning and data mining in manufacturing. Expert Syst Appl 166:114060CrossRef Dogan A, Birant D (2021) Machine learning and data mining in manufacturing. Expert Syst Appl 166:114060CrossRef
Zurück zum Zitat Fayyaz Z, Ebrahimian M, Nawara D, Ibrahim A, Kashef R (2020) Recommendation systems: algorithms, challenges, metrics, and business opportunities. Appl Sci 10(21):7748CrossRef Fayyaz Z, Ebrahimian M, Nawara D, Ibrahim A, Kashef R (2020) Recommendation systems: algorithms, challenges, metrics, and business opportunities. Appl Sci 10(21):7748CrossRef
Zurück zum Zitat Gunel B, Du J, Conneau A, Stoyanov V (2020) Supervised contrastive learning for pre-trained language model fine-tuning. arXiv preprint arXiv:2011.01403 Gunel B, Du J, Conneau A, Stoyanov V (2020) Supervised contrastive learning for pre-trained language model fine-tuning. arXiv preprint arXiv:​2011.​01403
Zurück zum Zitat Gu P, Zhang Z (2022) Dual-attention based joint aspect sentiment classification model. In: Web Engineering: 22nd International Conference, ICWE (2022) Bari, Italy, July 5–8, 2022, Proceedings. Springer International Publishing, Cham, pp 252–267 Gu P, Zhang Z (2022) Dual-attention based joint aspect sentiment classification model. In: Web Engineering: 22nd International Conference, ICWE (2022) Bari, Italy, July 5–8, 2022, Proceedings. Springer International Publishing, Cham, pp 252–267
Zurück zum Zitat Hu G, Lin TE, Zhao Y, Lu G, Wu Y, Li Y (2022) UniMSE: towards unified multimodal sentiment analysis and emotion recognition. arXiv preprint arXiv:2211.11256 Hu G, Lin TE, Zhao Y, Lu G, Wu Y, Li Y (2022) UniMSE: towards unified multimodal sentiment analysis and emotion recognition. arXiv preprint arXiv:​2211.​11256
Zurück zum Zitat Kim JS, Kim JW, Chung YD (2021) Successive point-of-interest recommendation with local differential privacy. IEEE Access 9:66371–66386CrossRef Kim JS, Kim JW, Chung YD (2021) Successive point-of-interest recommendation with local differential privacy. IEEE Access 9:66371–66386CrossRef
Zurück zum Zitat Lee J, Kim S, Lebanon G, Singer Y, Bengio S (2016) LLORMA: Local low-rank matrix approximation Lee J, Kim S, Lebanon G, Singer Y, Bengio S (2016) LLORMA: Local low-rank matrix approximation
Zurück zum Zitat Manguri KH, Ramadhan RN, Amin PRM (2020) Twitter sentiment analysis on worldwide COVID-19 outbreaks. Kurd J Appl Res 54-65 Manguri KH, Ramadhan RN, Amin PRM (2020) Twitter sentiment analysis on worldwide COVID-19 outbreaks. Kurd J Appl Res 54-65
Zurück zum Zitat Mnih A, Kavukcuoglu K (2013) Learning word embeddings efficiently with noise-contrastive estimation. Adv Neural Inf Process Syst 26 Mnih A, Kavukcuoglu K (2013) Learning word embeddings efficiently with noise-contrastive estimation. Adv Neural Inf Process Syst 26
Zurück zum Zitat Ray B, Garain A, Sarkar R (2021) An ensemble-based hotel recommender system using sentiment analysis and aspect categorization of hotel reviews. Appl Soft Comput 98:106935CrossRef Ray B, Garain A, Sarkar R (2021) An ensemble-based hotel recommender system using sentiment analysis and aspect categorization of hotel reviews. Appl Soft Comput 98:106935CrossRef
Zurück zum Zitat Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323(6088):533–536CrossRef Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323(6088):533–536CrossRef
Zurück zum Zitat Ruz GA, Henríquez PA, Mascareño A (2020) Sentiment analysis of Twitter data during critical events through Bayesian networks classifiers. Future Gener Comput Syst 106:92–104CrossRef Ruz GA, Henríquez PA, Mascareño A (2020) Sentiment analysis of Twitter data during critical events through Bayesian networks classifiers. Future Gener Comput Syst 106:92–104CrossRef
Zurück zum Zitat Shafqat W, Byun YC (2019) A recommendation mechanism for under-emphasized tourist spots using topic modeling and sentiment analysis. Sustainability 12(1):320CrossRef Shafqat W, Byun YC (2019) A recommendation mechanism for under-emphasized tourist spots using topic modeling and sentiment analysis. Sustainability 12(1):320CrossRef
Zurück zum Zitat Sohn K (2016) Improved deep metric learning with multi-class n-pair loss objective. Adv Neural Inf Process Syst 29 Sohn K (2016) Improved deep metric learning with multi-class n-pair loss objective. Adv Neural Inf Process Syst 29
Zurück zum Zitat Toivonen T, Heikinheimo V, Fink C, Hausmann A, Hiippala T, Järv O, Di Minin E (2019) Social media data for conservation science: a methodological overview. Biol Conserv 233:298–315CrossRef Toivonen T, Heikinheimo V, Fink C, Hausmann A, Hiippala T, Järv O, Di Minin E (2019) Social media data for conservation science: a methodological overview. Biol Conserv 233:298–315CrossRef
Zurück zum Zitat Tsai YH, Chang CM, Chen KH, Hwang SY (2022) An integration of TextGCN and autoencoder into aspect-based sentiment analysis. In: Big Data Analytics and Knowledge Discovery: 24th International Conference, DaWaK (2022) Vienna, Austria, August 22–24, 2022, Proceedings. Springer International Publishing, Cham, pp 3–16 Tsai YH, Chang CM, Chen KH, Hwang SY (2022) An integration of TextGCN and autoencoder into aspect-based sentiment analysis. In: Big Data Analytics and Knowledge Discovery: 24th International Conference, DaWaK (2022) Vienna, Austria, August 22–24, 2022, Proceedings. Springer International Publishing, Cham, pp 3–16
Zurück zum Zitat Wang Z, Ho SB, Cambria E (2020) Multi-level fine-scaled sentiment sensing with ambivalence handling. Int J Uncertain Fuzziness Knowl Based Syst 28(04):683–697CrossRef Wang Z, Ho SB, Cambria E (2020) Multi-level fine-scaled sentiment sensing with ambivalence handling. Int J Uncertain Fuzziness Knowl Based Syst 28(04):683–697CrossRef
Zurück zum Zitat Wang T, Sun B, Tong Y (2022). Auto-ABSA: automatic detection of aspects in aspect-based sentiment analysis. arXiv preprint arXiv:2202.00484 Wang T, Sun B, Tong Y (2022). Auto-ABSA: automatic detection of aspects in aspect-based sentiment analysis. arXiv preprint arXiv:​2202.​00484
Zurück zum Zitat Xu L, Pang X, Wu J, Cai M, Peng J (2023) Learn from structural scope: improving aspect-level sentiment analysis with hybrid graph convolutional networks. Neurocomputing 518:373–383CrossRef Xu L, Pang X, Wu J, Cai M, Peng J (2023) Learn from structural scope: improving aspect-level sentiment analysis with hybrid graph convolutional networks. Neurocomputing 518:373–383CrossRef
Zurück zum Zitat Yin W, Kann K, Yu M, Schütze H (2017) Comparative study of CNN and RNN for natural language processing. arXiv preprint arXiv:1702.01923 Yin W, Kann K, Yu M, Schütze H (2017) Comparative study of CNN and RNN for natural language processing. arXiv preprint arXiv:​1702.​01923
Zurück zum Zitat Yin W, Kann K, Yu M, Schütze H (2017) Comparative study of CNN and RNN for natural language processing. arXiv preprint arXiv:1702.01923 Yin W, Kann K, Yu M, Schütze H (2017) Comparative study of CNN and RNN for natural language processing. arXiv preprint arXiv:​1702.​01923
Zurück zum Zitat Yin W, Shang L (2022) Efficient Nearest Neighbor Emotion Classification with BERT-whitening. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing pp 4738-4745 Yin W, Shang L (2022) Efficient Nearest Neighbor Emotion Classification with BERT-whitening. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing pp 4738-4745
Zurück zum Zitat Zhang S, Bai Z, Li P, Chang Y (2022) Multi-graph convolutional network for fine-grained and personalized POI recommendation. Electronics 11(18):2966CrossRef Zhang S, Bai Z, Li P, Chang Y (2022) Multi-graph convolutional network for fine-grained and personalized POI recommendation. Electronics 11(18):2966CrossRef
Zurück zum Zitat Zhang Z, Sabuncu M (2018) Generalized cross entropy loss for training deep neural networks with noisy labels. Adv Neural Inf Process Syst 31 Zhang Z, Sabuncu M (2018) Generalized cross entropy loss for training deep neural networks with noisy labels. Adv Neural Inf Process Syst 31
Zurück zum Zitat Zhao L, Li L, Zheng X, Zhang J (2021) A BERT based sentiment analysis and key entity detection approach for online financial texts. In 2021 IEEE 24th International Conference on Computer Supported Cooperative Work in Design (CSCWD) (pp. 1233-1238). IEEE Zhao L, Li L, Zheng X, Zhang J (2021) A BERT based sentiment analysis and key entity detection approach for online financial texts. In 2021 IEEE 24th International Conference on Computer Supported Cooperative Work in Design (CSCWD) (pp. 1233-1238). IEEE
Zurück zum Zitat Zheng Y, Tang B, Ding W, Zhou H (2016) A neural autoregressive approach to collaborative filtering. In: International Conference on Machine Learning pp 764–773 Zheng Y, Tang B, Ding W, Zhou H (2016) A neural autoregressive approach to collaborative filtering. In: International Conference on Machine Learning pp 764–773
Metadaten
Titel
Sentiment analysis algorithm using contrastive learning and adversarial training for POI recommendation
verfasst von
Shaowei Huang
Xiangping Wu
Xiangyang Wu
Ke Wang
Publikationsdatum
01.12.2023
Verlag
Springer Vienna
Erschienen in
Social Network Analysis and Mining / Ausgabe 1/2023
Print ISSN: 1869-5450
Elektronische ISSN: 1869-5469
DOI
https://doi.org/10.1007/s13278-023-01076-x

Weitere Artikel der Ausgabe 1/2023

Social Network Analysis and Mining 1/2023 Zur Ausgabe

Premium Partner