Skip to main content
Top
Published in: Journal of Combinatorial Optimization 4/2022

17-09-2021

Metaheuristic algorithms for the bandwidth reduction of large-scale matrices

Authors: S. L. Gonzaga de Oliveira, C. Carvalho

Published in: Journal of Combinatorial Optimization | Issue 4/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper considers the bandwidth reduction problem for large-scale sparse matrices in serial computations. A heuristic for bandwidth reduction reorders the rows and columns of a given sparse matrix. Thus, the method places entries with a nonzero value as close to the main diagonal as possible. Bandwidth optimization is a critical issue for many scientific and engineering applications. This manuscript proposes two heuristics for the bandwidth reduction of large-scale matrices. The first is a variant of the Fast Node Centroid Hill-Climbing algorithm, and the second is an algorithm based on the iterated local search metaheuristic. This paper then experimentally compares the solutions yielded by the new reordering algorithms with the bandwidth solutions delivered by state-of-the-art heuristics for the problem, including tests on large-scale problem matrices. A considerable number of results for a range of realistic test problems showed that the performance of the two new algorithms compared favorably with state-of-the-art heuristics for bandwidth reduction. Specifically, the variant of the Fast Node Centroid Hill-Climbing algorithm yielded the overall best bandwidth results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
The datasets analyzed during the current study are available at https://​sparse.​tamu.​edu.
 
2
The Friedman test relies on a random sample. The reason is that a random sample is probably to be representative of the sampled population. We selected matrices with sizes higher than one million and less than 57.7 million nonzero coefficients in the SuiteSparse matrix collection. Although forming a non-random sample, the sample represents the application domain matrix set. Then, the results of applying the nonparametric statistical test are acceptable.
 
Literature
go back to reference Amparore EG, Beccuti M, Donatelli S (2017) Gradient-based variable ordering of decision diagrams for systems with structural units. In: Dsouza D, Kumar KN (eds) ATVA 2017, vol 10482. Lecture Notes in Computer Science. Springer, Cham, pp 184–200 Amparore EG, Beccuti M, Donatelli S (2017) Gradient-based variable ordering of decision diagrams for systems with structural units. In: Dsouza D, Kumar KN (eds) ATVA 2017, vol 10482. Lecture Notes in Computer Science. Springer, Cham, pp 184–200
go back to reference Berry MW, Hendrickson B, Raghavan P (1996) Sparse matrix reordering schemes for browsing hypertext. In: Renegar J, Shub M, Smale S (eds) Lectures in Applied Mathematics, vol 32. The Mathematics of Numerical Analysis. American Mathematical Society Press, Park City, Utah, USA, pp 99–123 Berry MW, Hendrickson B, Raghavan P (1996) Sparse matrix reordering schemes for browsing hypertext. In: Renegar J, Shub M, Smale S (eds) Lectures in Applied Mathematics, vol 32. The Mathematics of Numerical Analysis. American Mathematical Society Press, Park City, Utah, USA, pp 99–123
go back to reference Bolanos ME, Aviyente S, Radha H (2012) Graph entropy rate minimization and the compressibility of undirected binary graphs. In: Proceedings of IEEE Statistical Signal Processing Workshop (SSP), IEEE, Ann Arbor, MI, pp 109–112 Bolanos ME, Aviyente S, Radha H (2012) Graph entropy rate minimization and the compressibility of undirected binary graphs. In: Proceedings of IEEE Statistical Signal Processing Workshop (SSP), IEEE, Ann Arbor, MI, pp 109–112
go back to reference Chagas GO, Gonzaga de Oliveira SL (2015) Metaheuristic-based heuristics for symmetric-matrix bandwidth reduction: a systematic review. Procedia Computer Science (ICCS 2015 International Conference on Computational Science) 51, 2015, 211–220 Chagas GO, Gonzaga de Oliveira SL (2015) Metaheuristic-based heuristics for symmetric-matrix bandwidth reduction: a systematic review. Procedia Computer Science (ICCS 2015 International Conference on Computational Science) 51, 2015, 211–220
go back to reference Chen HK (2017) Evaluation of triangular mesh layout techniques using large mesh simplification. Multimedia Tools Appl 76(23):25391–25419CrossRef Chen HK (2017) Evaluation of triangular mesh layout techniques using large mesh simplification. Multimedia Tools Appl 76(23):25391–25419CrossRef
go back to reference Concas A, Fenu C, Rodriguez G (2019) PQser: a Matlab package for spectral seriation. Numer Algorithms 80(3):879–902MathSciNetCrossRef Concas A, Fenu C, Rodriguez G (2019) PQser: a Matlab package for spectral seriation. Numer Algorithms 80(3):879–902MathSciNetCrossRef
go back to reference Davis TA, Hu Y (2011) The University of Florida sparse matrix collection. ACM Trans Math Softw 38(1):1–25MathSciNetMATH Davis TA, Hu Y (2011) The University of Florida sparse matrix collection. ACM Trans Math Softw 38(1):1–25MathSciNetMATH
go back to reference George A, Liu JW (1981) Computer solution of large sparse positive definite systems. Prentice-Hall, Englewood CliffsMATH George A, Liu JW (1981) Computer solution of large sparse positive definite systems. Prentice-Hall, Englewood CliffsMATH
go back to reference Gibbs NE, Poole WG, Stockmeyer PK (1976) An algorithm for reducing the bandwidth and profile of a sparse matrix. SIAM J Numer Anal 13(2):236–250MathSciNetCrossRef Gibbs NE, Poole WG, Stockmeyer PK (1976) An algorithm for reducing the bandwidth and profile of a sparse matrix. SIAM J Numer Anal 13(2):236–250MathSciNetCrossRef
go back to reference Gonzaga de Oliveira SL, Abreu AAAM, Robaina DT, Kischnhevsky M (2017) An evaluation of four reordering algorithms to reduce the computational cost of the Jacobi-preconditioned conjugate gradient method using high-precision arithmetic. Int J Business Intell Data Min 12(2):190–209 Gonzaga de Oliveira SL, Abreu AAAM, Robaina DT, Kischnhevsky M (2017) An evaluation of four reordering algorithms to reduce the computational cost of the Jacobi-preconditioned conjugate gradient method using high-precision arithmetic. Int J Business Intell Data Min 12(2):190–209
go back to reference Gonzaga de Oliveira SL, Abreu AAAM, Robaina DT, Kischnhevsky M (2018) Finding a starting vertex for the reverse Cuthill-Mckee method for bandwidth reduction: a comparative analysis using asymmetric matrices. In: Gervasi O et al. (eds) The 18th International Conference on Computational Science and Its Applications (ICCSA), vol 10960. Lecture Notes in Computer Science. Springer International Publishing, Cham, pp 123–137 Gonzaga de Oliveira SL, Abreu AAAM, Robaina DT, Kischnhevsky M (2018) Finding a starting vertex for the reverse Cuthill-Mckee method for bandwidth reduction: a comparative analysis using asymmetric matrices. In: Gervasi O et al. (eds) The 18th International Conference on Computational Science and Its Applications (ICCSA), vol 10960. Lecture Notes in Computer Science. Springer International Publishing, Cham, pp 123–137
go back to reference Gonzaga de Oliveira SL, Bernardes JAB, Chagas GO (2018) An evaluation of low-cost heuristics for matrix bandwidth and profile reductions. Comput Appl Math 37(2):1412–1471MathSciNetCrossRef Gonzaga de Oliveira SL, Bernardes JAB, Chagas GO (2018) An evaluation of low-cost heuristics for matrix bandwidth and profile reductions. Comput Appl Math 37(2):1412–1471MathSciNetCrossRef
go back to reference Gonzaga de Oliveira SL, Bernardes JAB, Chagas GO (2018) An evaluation of reordering algorithms to reduce the computational cost of the incomplete Cholesky-conjugate gradient method. Comput Appl Math 37(3):2965–3004MathSciNetCrossRef Gonzaga de Oliveira SL, Bernardes JAB, Chagas GO (2018) An evaluation of reordering algorithms to reduce the computational cost of the incomplete Cholesky-conjugate gradient method. Comput Appl Math 37(3):2965–3004MathSciNetCrossRef
go back to reference Gonzaga de Oliveira SL, Chagas GO (2015) A systematic review of heuristics for symmetric-matrix bandwidth reduction: methods not based on metaheuristics. In: Proceedings of the Brazilian Symposium on Operations Research (SBPO 2015). Sobrapo, Pernambuco, Brazil Gonzaga de Oliveira SL, Chagas GO (2015) A systematic review of heuristics for symmetric-matrix bandwidth reduction: methods not based on metaheuristics. In: Proceedings of the Brazilian Symposium on Operations Research (SBPO 2015). Sobrapo, Pernambuco, Brazil
go back to reference Koohestani B, Poli R (2011) A hyper-heuristic approach to evolving algorithms for bandwidth reduction based on genetic programming. Research and Development in Intelligent Systems XXVIII. Springer, London, London, UK, pp 93–106 Koohestani B, Poli R (2011) A hyper-heuristic approach to evolving algorithms for bandwidth reduction based on genetic programming. Research and Development in Intelligent Systems XXVIII. Springer, London, London, UK, pp 93–106
go back to reference Lewis JG (1982) Implementations of the Gibbs-Poole-Stockmeyer algorithms and Gibbs-King algorithms. ACM Trans Math Softw 8:180–189CrossRef Lewis JG (1982) Implementations of the Gibbs-Poole-Stockmeyer algorithms and Gibbs-King algorithms. ACM Trans Math Softw 8:180–189CrossRef
go back to reference Lim A, Rodrigues B, Xiao F (2007) A fast algorithm for bandwidth minimization. Int J Artif Intell Tools 16(03):537–544CrossRef Lim A, Rodrigues B, Xiao F (2007) A fast algorithm for bandwidth minimization. Int J Artif Intell Tools 16(03):537–544CrossRef
go back to reference Martí R, Laguna M, Glover F, Campos V (2001) Reducing the bandwidth of a sparse matrix with tabu search. Eur J Oper Res 135(2):450–459MathSciNetCrossRef Martí R, Laguna M, Glover F, Campos V (2001) Reducing the bandwidth of a sparse matrix with tabu search. Eur J Oper Res 135(2):450–459MathSciNetCrossRef
go back to reference Mladenovic N, Urosevic D, Pérez-Brito D, García-González CG (2010) Variable neighbourhood search for bandwidth reduction. Eur J Oper Res 200:14–27MathSciNetCrossRef Mladenovic N, Urosevic D, Pérez-Brito D, García-González CG (2010) Variable neighbourhood search for bandwidth reduction. Eur J Oper Res 200:14–27MathSciNetCrossRef
go back to reference Mueller C, Martin B, Lumsdaine A (2007) A comparison of vertex ordering algorithms for large graph visualization. In: Proceedings of the 6th International Asia-Pacific Symposium on Visualization (APVIS’07). Sydney, Australia, pp 141–148 Mueller C, Martin B, Lumsdaine A (2007) A comparison of vertex ordering algorithms for large graph visualization. In: Proceedings of the 6th International Asia-Pacific Symposium on Visualization (APVIS’07). Sydney, Australia, pp 141–148
go back to reference Papadimitriou CH (1976) The NP-completeness of bandwidth minimization problem. Comput J 16:177–192MathSciNetMATH Papadimitriou CH (1976) The NP-completeness of bandwidth minimization problem. Comput J 16:177–192MathSciNetMATH
go back to reference Smith CW, Abeysinghe E, Marru S, Jansen KE (2018) PHASTA science gateway for high performance computational fluid dynamics. In: PEARC ’18 - Proceedings of the Practice and Experience on Advanced Research Computing, p. 94. ACM, Pittsburgh, PA Smith CW, Abeysinghe E, Marru S, Jansen KE (2018) PHASTA science gateway for high performance computational fluid dynamics. In: PEARC ’18 - Proceedings of the Practice and Experience on Advanced Research Computing, p. 94. ACM, Pittsburgh, PA
go back to reference Toivanen J, Avery P, Farhat C (2018) A multilevel FETI-DP method and its performance for problems with billions of degrees of freedom. Int J Numer Methods Eng 116(10–11):661–682MathSciNetCrossRef Toivanen J, Avery P, Farhat C (2018) A multilevel FETI-DP method and its performance for problems with billions of degrees of freedom. Int J Numer Methods Eng 116(10–11):661–682MathSciNetCrossRef
go back to reference Torres-Jimenez J, Izquierdo-Marquez I, Garcia-Robledo A, Gonzalez-Gomez A, Bernal J, Kacker RN (2015) A dual representation simulated annealing algorithm for the bandwidth minimization problem on graphs. Inf Sci 303:33–49MathSciNetCrossRef Torres-Jimenez J, Izquierdo-Marquez I, Garcia-Robledo A, Gonzalez-Gomez A, Bernal J, Kacker RN (2015) A dual representation simulated annealing algorithm for the bandwidth minimization problem on graphs. Inf Sci 303:33–49MathSciNetCrossRef
go back to reference Weise T, Wang X, Qi Q, Li B, Tang K (2018) Automatically discovering clusters of algorithm and problem instance behaviors as well as their causes from experimental data, algorithm setups, and instance features. Appl Soft Comput 73:366–382CrossRef Weise T, Wang X, Qi Q, Li B, Tang K (2018) Automatically discovering clusters of algorithm and problem instance behaviors as well as their causes from experimental data, algorithm setups, and instance features. Appl Soft Comput 73:366–382CrossRef
Metadata
Title
Metaheuristic algorithms for the bandwidth reduction of large-scale matrices
Authors
S. L. Gonzaga de Oliveira
C. Carvalho
Publication date
17-09-2021
Publisher
Springer US
Published in
Journal of Combinatorial Optimization / Issue 4/2022
Print ISSN: 1382-6905
Electronic ISSN: 1573-2886
DOI
https://doi.org/10.1007/s10878-021-00801-6

Other articles of this Issue 4/2022

Journal of Combinatorial Optimization 4/2022 Go to the issue

Premium Partner