Skip to main content
Top

2018 | OriginalPaper | Chapter

An Efficient Parallel Method for Optimizing Concurrent Operations on Social Networks

Authors : Phuong-Hanh Du, Hai-Dang Pham, Ngoc-Hoa Nguyen

Published in: Transactions on Computational Collective Intelligence XXIX

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents our approach to optimize the performance of both reading and writing concurrent operations on large-scale social networks. Here, we focus on the directed and unweighted relationships among members in a social network. It can then be illustrated as a directed, unweighted graph. Moreover, determining the relationship between any two members is similar to finding the shortest path between two vertices. With such a large-scale dynamic social network, we face the problem of having concurrent operations from adding or removing edges dynamically while one may ask to determine the relationship between two members. To solve this issue, we propose an efficient parallel method based on (i) utilizing an appropriate data structure, (ii) parallelizing the updating actions and (iii) improving the performance of query processing by both reducing the searching space and computing in multi-threaded parallel. Our method was validated by the datasets from SigMod Contest 2016 and SNAP DataSet Collections with fine positive experimental results compared to other solutions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wei, J., Chen, K., Zhou, Y., Zhou, Q., He, J.: Benchmarking of distributed computing engines spark and GraphLab for big data analytics. In: 2016 IEEE Second International Conference on Big Data Computing Service and Applications (BigDataService), pp. 10–13 (2016) Wei, J., Chen, K., Zhou, Y., Zhou, Q., He, J.: Benchmarking of distributed computing engines spark and GraphLab for big data analytics. In: 2016 IEEE Second International Conference on Big Data Computing Service and Applications (BigDataService), pp. 10–13 (2016)
2.
go back to reference Yahia, S.A., Benedikt, M., Lakshmanan, L.V.S., Stoyanovich, J.: Efficient network aware search in collaborative tagging sites. PVLDB 1(1), 710–721 (2008) Yahia, S.A., Benedikt, M., Lakshmanan, L.V.S., Stoyanovich, J.: Efficient network aware search in collaborative tagging sites. PVLDB 1(1), 710–721 (2008)
3.
go back to reference Mondal, J., Deshpande, A.: Managing large dynamic graphs efficiently. In: Proceedings of the ACM SIGMOD 2012, pp. 145–156 (2012) Mondal, J., Deshpande, A.: Managing large dynamic graphs efficiently. In: Proceedings of the ACM SIGMOD 2012, pp. 145–156 (2012)
4.
go back to reference Gong, M., Li, G., Wang, Z., Ma, L., Tian, D.: An efficient shortest path approach for social networks based on community structure. CAAI Trans. Intell. Technol. 1(1), 114–123 (2016)CrossRef Gong, M., Li, G., Wang, Z., Ma, L., Tian, D.: An efficient shortest path approach for social networks based on community structure. CAAI Trans. Intell. Technol. 1(1), 114–123 (2016)CrossRef
5.
go back to reference Hallac, D., Leskovec, J., Boyd, S.: Network lasso: clustering and optimization in large graphs. In: ACM SIGKDD International Conference on KDD, pp. 387–396 (2015) Hallac, D., Leskovec, J., Boyd, S.: Network lasso: clustering and optimization in large graphs. In: ACM SIGKDD International Conference on KDD, pp. 387–396 (2015)
6.
go back to reference Nawaz, W., Khan, K.U., Lee, Y.K.: CORE analysis for efficient shortest path traversal queries. In: IEEE Fourth International Conference on Social Graphs, Big Data and Cloud Computing (BdCloud), Sydney, pp. 363–370 (2014) Nawaz, W., Khan, K.U., Lee, Y.K.: CORE analysis for efficient shortest path traversal queries. In: IEEE Fourth International Conference on Social Graphs, Big Data and Cloud Computing (BdCloud), Sydney, pp. 363–370 (2014)
7.
go back to reference Zhao, H.J., Yiu, M.L., Li, Y., Gong, Z.: Towards online shortest path computation. IEEE Trans. Knowl. Data Eng. 26(4), 1012–1025 (2014)CrossRef Zhao, H.J., Yiu, M.L., Li, Y., Gong, Z.: Towards online shortest path computation. IEEE Trans. Knowl. Data Eng. 26(4), 1012–1025 (2014)CrossRef
8.
go back to reference Scano, G., Huguet, M.J., Ngueveu, S.U.: Adaptations of k-shortest path algorithms for transportation networks. In: 2015 International Conference on Industrial Engineering and Systems Management (IESM), Seville, pp. 663–669 (2015) Scano, G., Huguet, M.J., Ngueveu, S.U.: Adaptations of k-shortest path algorithms for transportation networks. In: 2015 International Conference on Industrial Engineering and Systems Management (IESM), Seville, pp. 663–669 (2015)
9.
go back to reference Chakaravarthy, V.T., Checconi, F., Petrini, F., Sabharwal, Y.: Scalable single source shortest path algorithms for massively parallel systems. In: IEEE 28th International Parallel and Distributed Processing Symposium, pp. 889–901 (2014) Chakaravarthy, V.T., Checconi, F., Petrini, F., Sabharwal, Y.: Scalable single source shortest path algorithms for massively parallel systems. In: IEEE 28th International Parallel and Distributed Processing Symposium, pp. 889–901 (2014)
10.
go back to reference Li, Q., Wei, W.: A parallel single-source shortest path algorithm based on bucket structure. In: 2013 25th Chinese Control and Decision Conference (CCDC), pp. 3445–3450 (2013) Li, Q., Wei, W.: A parallel single-source shortest path algorithm based on bucket structure. In: 2013 25th Chinese Control and Decision Conference (CCDC), pp. 3445–3450 (2013)
11.
go back to reference Leiserson, C.E., Schardl, T.B.: A work-efficient parallel breadth-first search algorithm (or how to cope with the nondeterminism of reducers). In: Proceedings of the Twenty-Second Annual ACM Symposium on Parallelism in Algorithms and Architectures, pp. 303–314 (2010) Leiserson, C.E., Schardl, T.B.: A work-efficient parallel breadth-first search algorithm (or how to cope with the nondeterminism of reducers). In: Proceedings of the Twenty-Second Annual ACM Symposium on Parallelism in Algorithms and Architectures, pp. 303–314 (2010)
12.
go back to reference Banerjee, D.S., Sharma, S., Kothapalli, K.: Work efficient parallel algorithms for large graph exploration. In: 20th Annual International Conference on High Performance Computing, pp. 433–442 (2013) Banerjee, D.S., Sharma, S., Kothapalli, K.: Work efficient parallel algorithms for large graph exploration. In: 20th Annual International Conference on High Performance Computing, pp. 433–442 (2013)
13.
go back to reference Gonzalez, J.E., Low, Y., Gu, H., Bickson, D., Guestrin, C.: PowerGraph: distributed graph-parallel computation on natural graphs. In: OSDI, pp. 17–30 (2012) Gonzalez, J.E., Low, Y., Gu, H., Bickson, D., Guestrin, C.: PowerGraph: distributed graph-parallel computation on natural graphs. In: OSDI, pp. 17–30 (2012)
14.
go back to reference Gonzalez, J.E., Xin, R.S., Dave, A., Crankshaw, D., Franklin, M.J., Stoica, I.: GraphX: graph processing in a distributed dataflow framework. In: Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI), pp. 599–613 (2014) Gonzalez, J.E., Xin, R.S., Dave, A., Crankshaw, D., Franklin, M.J., Stoica, I.: GraphX: graph processing in a distributed dataflow framework. In: Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI), pp. 599–613 (2014)
15.
go back to reference Hagberg, A.A., Schult, D.A., Swar, P.J.: Exploring network structure, dynamics, and function using NetworkX. In: Proceedings of the 7th Python in Science Conference (SciPy), pp. 11–15 (2008) Hagberg, A.A., Schult, D.A., Swar, P.J.: Exploring network structure, dynamics, and function using NetworkX. In: Proceedings of the 7th Python in Science Conference (SciPy), pp. 11–15 (2008)
16.
go back to reference Du, P.-H., Pham, H.-D., Nguyen, N.-H.: Optimizing the shortest path query on large-scale dynamic directed graph. In: Proceedings of the 3rd IEEE/ACM International Conference on Big Data Computing, Applications and Technologies, BDCAT 2016, pp. 210–216 (2016) Du, P.-H., Pham, H.-D., Nguyen, N.-H.: Optimizing the shortest path query on large-scale dynamic directed graph. In: Proceedings of the 3rd IEEE/ACM International Conference on Big Data Computing, Applications and Technologies, BDCAT 2016, pp. 210–216 (2016)
17.
go back to reference Du, P.-H., Pham, H.-D., Nguyen, N.-H.: An efficient parallel method for performing concurrent operations on social networks. In: Nguyen, N.T., Papadopoulos, G.A., Jędrzejowicz, P., Trawiński, B., Vossen, G. (eds.) ICCCI 2017. LNCS (LNAI), vol. 10448, pp. 148–159. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67074-4_15CrossRef Du, P.-H., Pham, H.-D., Nguyen, N.-H.: An efficient parallel method for performing concurrent operations on social networks. In: Nguyen, N.T., Papadopoulos, G.A., Jędrzejowicz, P., Trawiński, B., Vossen, G. (eds.) ICCCI 2017. LNCS (LNAI), vol. 10448, pp. 148–159. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-67074-4_​15CrossRef
Metadata
Title
An Efficient Parallel Method for Optimizing Concurrent Operations on Social Networks
Authors
Phuong-Hanh Du
Hai-Dang Pham
Ngoc-Hoa Nguyen
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-90287-6_10

Premium Partner