Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Automatic Control and Computer Sciences
Published in: Automatic Control and Computer Sciences 4/2020

01-07-2020

Regional Bullying Text Recognition Based on Two-Branch Parallel Neural Networks

Authors: Zhao Meng, Shengwei Tian, Long Yu

Published in: Automatic Control and Computer Sciences | Issue 4/2020

Login to get access

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Traditional features and pipelined algorithms ignore the subspace semantic information and different information complementarity of regional bullying text when describing and recognizing regional bullying text. In order to solve the above problems, combined with features of Chinese, a regional bullying text recognition algorithm called Two-Branch Parallel Neural Network (TB-PNN) is proposed. First, the word vector, sentence vector, pinyin and tone features extracted by the word embedding technique and the character feature extracted by the Character Graph Convolutional Neural (CGCN). Secondly, TB-PNN is constructed by Multi-Head Self-Attention Mechanism (MHSA), Capsule Network (CapsNet) and Independent Recurrent Neural Network (IndRNN). The left branch was MHSA-CapsNet and the right branch was Multi-MHSA-IndRNN. The algorithm assigns weights to the fused features through MHSA, uses the CapsNet of the left branch to mine the key features with high weight and generates vector tags, and uses the IndRNN of the right branch to capture the subspace semantic information of the key features in the text. The left and right branches form complementary information. Finally, SoftMax classifier is used to realize the accurate recognition of regional bullying text. The experimental results show that TB-PNN algorithm can effectively improve the recognition accuracy of regional bullying text.
previous article Neural Network Model Synthesis Based on a Regression Tree
next article Chattering-Free Adaptive Finite-Time Sliding Mode Control for Trajectory Tracking of MEMS Gyroscope
Literature
1.
Murnion, S., Buchanan, W.J., Smales, A., and Russell, G., Machine learning and semantic analysis of in-game chat for cyberbullying, Comput. Secur., 2018, vol. 76, pp. 197–213.CrossRef
2.
Agrawal, S. and Awekar, A., Deep learning for detecting cyberbullying across multiple social media platforms, Advances in Information Retrieval. ECIR 2018, Cham, 2018, pp. 141–153.
3.
4.
Turney, P.D., Thumbs up of thumbs down? Semantic orientation applied to unsupervised classification of reviews, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, 2002, pp. 417–424.
5.
Al-Ajlan, M.A. and Ykhlef, M., Optimized Twitter cyberbullying detection based on deep learning, 2018 21st Saudi Computer Society National Computer Conference (NCC). IEEE, 2018.
6.
Agrawal, S. and Awekar, A., Deep learning for detecting cyberbullying across multiple social media platforms, Advances in Information Retrieval. ECIR 2018, Cham, 2018, pp. 141–153.
7.
Bu, S.J. and Cho, S.B., A hybrid deep learning system of CNN and LRCN to detect cyberbullying from SNS comments, in Hybrid Artificial Intelligent Systems, Cham: Springer, 2018.
8.
9.
Zhao, R. and Mao, K., Cyberbullying detection based on semantic-enhanced marginalized denoising auto-encoder, IEEE Trans. Affective Comput., 2016, vol. 8, no. 3, pp. 328–339.CrossRef
10.
Marcheggiani, D. and Titov, I., Encoding sentences with graph convolutional networks for semantic role labeling, Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, 2017.
11.
Zhang, T., Zheng, W., Cui, Z., et al., Tensor Graph Convolutional Neural Network, 2018. arXiv:1803.10071 [cs.CV]
12.
Nassar, M., Hierarchical Bipartite Graph Convolution Networks, 2018. arXiv:1812.03813 [cs.LG]
13.
Wang, Z., Zheng, L., Li, Y., et al., Linkage Based Face Clustering via Graph Convolution Network, 2019. arXiv:1903.11306 [cs.CV]
14.
Sun, J., Zhang, J., Li, Q., et al., Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networks, 2019. arXiv:1903.07789 [cs.CV]
15.
Rhee, S., Seo, S., and Kim, S., Hybrid Approach of Relation Network and Localized Graph Convolutional Filtering for Breast Cancer Subtype Classification, 2017. arXiv:1711.05859 [cs.CV]
16.
Solomon, A., Bar, A., Yanai, Ch., Shapira, B., and Rokach, L., Predict demographic information using Word2vec on spatial trajectories, UMAP’18: Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization, 2018, pp. 331–339. https://​doi.​org/​10.​1145/​3209219.​3209224.
17.
Alkhouli, T., Bretschner, G., and Ney, H., On the Alignment Problem in Multi-Head Attention-Based Neural Machine Translation, 2018. arXiv:1809.03985 [cs.CL]
18.
Strubell, E., Verga, P., Andor, D., et al., Linguistically-Informed Self-Attention for Semantic Role Labeling, 2018. arXiv:1804.08199 [cs.CL]
19.
Voita, E., Talbot, D., Moiseev, F., Sennrich, R., and Titov, I., Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned, 2019. arXiv:1905.09418 [cs.CL]
20.
Borgogna, M., Bellich, B., Zorzin, L., et al., Food microencapsulation of bioactive compounds: Rheological and thermal characterization of non-conventional gelling system, Food Chem., 2018, vol. 122, no. 2, pp. 416–423.CrossRef
21.
Li, J., Tu, Z., and Zhang, T., Multi-Head Attention with Disagreement Regularization, 2018. arXiv:1810.10183 [cs.CL]
22.
Sulc, M. and Matas, J., Improving CNN classifiers by estimating test-time priors, 2018. arXiv:1805.08235 [cs.CV]
23.
Sabour, S., Frosst, N., and Hinton, G.E., Dynamic Routing Between Capsules, 2017. arXiv:1710.09829 [cs.CV]
24.
Shahroudnejad, A., Mohammadi, A., and Plataniotis, K.N., Improved Explainability of Capsule Networks: Relevance Path by Agreement, 2018. arXiv:1802.10204 [cs.CV]
25.
Renkens, V. and Van Hamme, H., Capsule Networks for Low Resource Spoken Language Understanding, 2018. arXiv:1805.02922 [eess.AS]
26.
Amer, M. and Maul, T., Path Capsule Networks, 2019. arXiv:1902.03760 [cs.LG]
27.
Cho, K., Van Merrienboer, B., Gulcehre, C., et al., Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation, 2014. arXiv:1406.1078 [cs.CL]
28.
Li, S., Li, W., Cook, C., et al., Independently Recurrent Neural Network (Ind-RNN): Building a Longer and Deeper RNN, 2018. arXiv:1803.04831 [cs.CV]
29.
Yao, X., Cheng, Q., and Zhang, G.Q., A Novel Independent RNN Approach to Classification of Seizures against Non-Seizures, 2019. arXiv:1903.09326 [cs.LG]
Metadata
Title
Regional Bullying Text Recognition Based on Two-Branch Parallel Neural Networks
Authors
Zhao Meng
Shengwei Tian
Long Yu
Publication date
01-07-2020
Publisher
Pleiades Publishing
Published in
Automatic Control and Computer Sciences / Issue 4/2020
Print ISSN: 0146-4116
Electronic ISSN: 1558-108X
DOI
https://doi.org/10.3103/S0146411620040082

Other articles of this Issue 4/2020

Automatic Control and Computer Sciences 4/2020 Go to the issue

OriginalPaper

Vehicle Detection and Counting Using Adaptive Background Model Based on Approximate Median Filter and Triangulation Threshold Techniques

OriginalPaper

Neural Network Model Synthesis Based on a Regression Tree

OriginalPaper

Real-Time Task Schedulers for a High-Performance Multi-Core System

OriginalPaper

Chattering-Free Adaptive Finite-Time Sliding Mode Control for Trajectory Tracking of MEMS Gyroscope

OriginalPaper

A Water-Level Measurement Method Using Sparse Representation

OriginalPaper

Application of Image Recognition Based on Grey Relational Analysis