Flow monitoring system and abnormal log traffic mode detection based on artificial intelligence

As the number of logs generated by each node in the national high-performance computing environment continues to increase, manual analysis of abnormal logs has become slow and inaccurate. This makes it difficult to meet the requirements of daily system analysis. In response to this problem, this paper proposes a method for defining an abnormal log business model. Through the analysis of the exception logs of the multi-node system, this paper finds that the exception logs have a certain regularity and repeatability. Therefore, the abnormal logs can be detected by analyzing the log traffic pattern. This method uses machine learning algorithm to analyze log data in multi-node system, extract normal log traffic patterns, and use these patterns to detect abnormal behavior. Experimental results show that the proposed method can effectively detect abnormal log traffic patterns in multi-node systems, with high accuracy and robustness, and can detect and locate system faults in time, improving the reliability and stability of the system. This paper provides a new solution for log traffic pattern detection of multi-node system, which has a certain application prospect in the field of computer system monitoring, and can provide a certain reference for computer system monitoring and maintenance.