Skip to main content
Top

30-09-2024 | Research

Hierarchical Storage for Massive Social Network Data Based on Improved Decision Tree

Authors: Yanning Zhang, Guanghao Jin, Jingyu Li, Taizhong Zhang

Published in: Mobile Networks and Applications

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In order to reasonably store and optimize the read/write (w/r) efficiency of massive social network data, a hierarchical storage method for massive social network data based on improved decision tree is proposed. Improved decision tree is used to classify the social network data into multi-value level. Then the high-level, intermediate-level and low-level data are stored in three different storage containers, namely, memory, SSD and mechanical hard disk. The migration storage strategy with adaptive downgrading and upgrading based on the value-classified data is used to migrate and store the social network data reasonably by combining the data value level and the memory status of the storage containers. In addition, the CFS lock model is used to maintain the w/r integrity of the hierarchical storage. In the experiment, this method can reasonably store data of different value levels. The w/r latency of migration and storage for the social network data is in the range of [1.5ms, 2.1ms], [1.6ms, 2.0ms] respectively, which is extremely short. The packet loss rate is only 0.01%, and the data integrity is high. Meanwhile, it has high throughput and low variance that below 0.15, which can effectively ensure the global consistency of data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Naser S, Maryam S, Amir MR (2022) Internet of things data management: a systematic literature review, vision, and future trends. Int J Commun Syst, 35(14), e5267 Naser S, Maryam S, Amir MR (2022) Internet of things data management: a systematic literature review, vision, and future trends. Int J Commun Syst, 35(14), e5267
2.
go back to reference Djouzi K, Beghdad-Bey K, Amamra A (2022) A new adaptive sampling algorithm for big data classification. J Comput Sci 61(5):101653CrossRef Djouzi K, Beghdad-Bey K, Amamra A (2022) A new adaptive sampling algorithm for big data classification. J Comput Sci 61(5):101653CrossRef
3.
go back to reference Diene B, Rodrigues JJPC, Diallo O (2020) Data management techniques for internet of things. Mech Syst Signal Process 138:106564CrossRef Diene B, Rodrigues JJPC, Diallo O (2020) Data management techniques for internet of things. Mech Syst Signal Process 138:106564CrossRef
4.
go back to reference Gajmal YM, Udayakumar R (2021) Blockchain-based Access Control and Data sharing mechanism in Cloud Decentralized Storage System. J web Eng 20(5):1359–1388 Gajmal YM, Udayakumar R (2021) Blockchain-based Access Control and Data sharing mechanism in Cloud Decentralized Storage System. J web Eng 20(5):1359–1388
5.
go back to reference Kang H, Ji Y, Zhang S (2022) Enhanced privacy preserving for Social Networks Relational Data based on personalized Differential privacy. Chin J Electron 31(4):741–751CrossRef Kang H, Ji Y, Zhang S (2022) Enhanced privacy preserving for Social Networks Relational Data based on personalized Differential privacy. Chin J Electron 31(4):741–751CrossRef
6.
go back to reference Zhang Y, Liu S (2019) A real-time distributed cluster storage optimization for massive data in internet of multimedia things. Multimedia Tools Appl 78(5):5479–5492CrossRef Zhang Y, Liu S (2019) A real-time distributed cluster storage optimization for massive data in internet of multimedia things. Multimedia Tools Appl 78(5):5479–5492CrossRef
7.
go back to reference Wang C, Zhou T (2022) Multi-level storage based auditing scheme for 5G and beyond defined edge computing. J Surveillance Secur Saf 3(1):16–26 Wang C, Zhou T (2022) Multi-level storage based auditing scheme for 5G and beyond defined edge computing. J Surveillance Secur Saf 3(1):16–26
8.
go back to reference Wang Z, Chen H, Wang Y et al (2022) The concurrent learned indexes for Multicore Data Storage. ACM Trans Storage 18(1):8–35CrossRef Wang Z, Chen H, Wang Y et al (2022) The concurrent learned indexes for Multicore Data Storage. ACM Trans Storage 18(1):8–35CrossRef
9.
go back to reference Ghoshal D, Ramakrishnan L (2021) Programming abstractions for managing Workflows on Tiered Storage systems. ACM Trans Storage 17(4):29CrossRef Ghoshal D, Ramakrishnan L (2021) Programming abstractions for managing Workflows on Tiered Storage systems. ACM Trans Storage 17(4):29CrossRef
10.
go back to reference Liu X, Xia L, Jiang X et al (2023) Research on metadata management methods for HDFS hierarchical storage systems. Comput Eng Appl 59(17):257–265 Liu X, Xia L, Jiang X et al (2023) Research on metadata management methods for HDFS hierarchical storage systems. Comput Eng Appl 59(17):257–265
11.
go back to reference Pan WB, Yuan WH (2022) Simulation of Cloud Data Block Storage Method based on Density Division. Comput Simul 39(8):456–459 Pan WB, Yuan WH (2022) Simulation of Cloud Data Block Storage Method based on Density Division. Comput Simul 39(8):456–459
12.
go back to reference Anah HB, Souley B, Abdulsalam YG (2023) A review on securing distributed Big Data Storage in Cloud Environment. IOSR J Comput Eng 25(1):17–28 Anah HB, Souley B, Abdulsalam YG (2023) A review on securing distributed Big Data Storage in Cloud Environment. IOSR J Comput Eng 25(1):17–28
13.
go back to reference Rafique A, Van L, Dimitri B et al (2021) CryptDICE: distributed data protection system for secure cloud data storage and computation. Inform Syst 96(10):101671CrossRef Rafique A, Van L, Dimitri B et al (2021) CryptDICE: distributed data protection system for secure cloud data storage and computation. Inform Syst 96(10):101671CrossRef
14.
go back to reference Macyna W, Kukowski M (2020) Flash-aware storage of the Column oriented databases. Fundamenta Informaticae 173(1):47–72MathSciNetCrossRef Macyna W, Kukowski M (2020) Flash-aware storage of the Column oriented databases. Fundamenta Informaticae 173(1):47–72MathSciNetCrossRef
15.
go back to reference Ayah H, Fernando EBO (2022) Data stream classification with ant colony optimisation. Int J Intell Syst 37(9):5725–5751CrossRef Ayah H, Fernando EBO (2022) Data stream classification with ant colony optimisation. Int J Intell Syst 37(9):5725–5751CrossRef
16.
go back to reference Nijim M, Albataineh H (2021) Secure-Stor: a Novel Hybrid Storage System Architecture to enhance security and performance in Edge Computing. IEEE Access 9:92446–92459CrossRef Nijim M, Albataineh H (2021) Secure-Stor: a Novel Hybrid Storage System Architecture to enhance security and performance in Edge Computing. IEEE Access 9:92446–92459CrossRef
17.
18.
go back to reference Moral-Garcia S, Mantas CJ, Castellano JG et al (2022) Using Credal C4.5 for calibrated label ranking in Multi-label classification. Int J Approximate Reasoning 147(8):60–77MathSciNetCrossRef Moral-Garcia S, Mantas CJ, Castellano JG et al (2022) Using Credal C4.5 for calibrated label ranking in Multi-label classification. Int J Approximate Reasoning 147(8):60–77MathSciNetCrossRef
19.
go back to reference Naik BB, Singh D, Samaddar AB (2020) FHCS: hybridised optimisation for virtual machine migration and task scheduling in cloud data center. IET Commun 14(12):1942–1948CrossRef Naik BB, Singh D, Samaddar AB (2020) FHCS: hybridised optimisation for virtual machine migration and task scheduling in cloud data center. IET Commun 14(12):1942–1948CrossRef
20.
go back to reference Li T, Liu S, Wang Y, Zhang C, Li P (2020) An optimized cluster Storage Method for Real-Time Big Data in Internet of things. J Supercomputing 76(7):5175–5191CrossRef Li T, Liu S, Wang Y, Zhang C, Li P (2020) An optimized cluster Storage Method for Real-Time Big Data in Internet of things. J Supercomputing 76(7):5175–5191CrossRef
Metadata
Title
Hierarchical Storage for Massive Social Network Data Based on Improved Decision Tree
Authors
Yanning Zhang
Guanghao Jin
Jingyu Li
Taizhong Zhang
Publication date
30-09-2024
Publisher
Springer US
Published in
Mobile Networks and Applications
Print ISSN: 1383-469X
Electronic ISSN: 1572-8153
DOI
https://doi.org/10.1007/s11036-024-02426-5