Skip to main content
Erschienen in: Journal of Combinatorial Optimization 4/2022

17.09.2021

Metaheuristic algorithms for the bandwidth reduction of large-scale matrices

verfasst von: S. L. Gonzaga de Oliveira, C. Carvalho

Erschienen in: Journal of Combinatorial Optimization | Ausgabe 4/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper considers the bandwidth reduction problem for large-scale sparse matrices in serial computations. A heuristic for bandwidth reduction reorders the rows and columns of a given sparse matrix. Thus, the method places entries with a nonzero value as close to the main diagonal as possible. Bandwidth optimization is a critical issue for many scientific and engineering applications. This manuscript proposes two heuristics for the bandwidth reduction of large-scale matrices. The first is a variant of the Fast Node Centroid Hill-Climbing algorithm, and the second is an algorithm based on the iterated local search metaheuristic. This paper then experimentally compares the solutions yielded by the new reordering algorithms with the bandwidth solutions delivered by state-of-the-art heuristics for the problem, including tests on large-scale problem matrices. A considerable number of results for a range of realistic test problems showed that the performance of the two new algorithms compared favorably with state-of-the-art heuristics for bandwidth reduction. Specifically, the variant of the Fast Node Centroid Hill-Climbing algorithm yielded the overall best bandwidth results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
The datasets analyzed during the current study are available at https://​sparse.​tamu.​edu.
 
2
The Friedman test relies on a random sample. The reason is that a random sample is probably to be representative of the sampled population. We selected matrices with sizes higher than one million and less than 57.7 million nonzero coefficients in the SuiteSparse matrix collection. Although forming a non-random sample, the sample represents the application domain matrix set. Then, the results of applying the nonparametric statistical test are acceptable.
 
Literatur
Zurück zum Zitat Amparore EG, Beccuti M, Donatelli S (2017) Gradient-based variable ordering of decision diagrams for systems with structural units. In: Dsouza D, Kumar KN (eds) ATVA 2017, vol 10482. Lecture Notes in Computer Science. Springer, Cham, pp 184–200 Amparore EG, Beccuti M, Donatelli S (2017) Gradient-based variable ordering of decision diagrams for systems with structural units. In: Dsouza D, Kumar KN (eds) ATVA 2017, vol 10482. Lecture Notes in Computer Science. Springer, Cham, pp 184–200
Zurück zum Zitat Berry MW, Hendrickson B, Raghavan P (1996) Sparse matrix reordering schemes for browsing hypertext. In: Renegar J, Shub M, Smale S (eds) Lectures in Applied Mathematics, vol 32. The Mathematics of Numerical Analysis. American Mathematical Society Press, Park City, Utah, USA, pp 99–123 Berry MW, Hendrickson B, Raghavan P (1996) Sparse matrix reordering schemes for browsing hypertext. In: Renegar J, Shub M, Smale S (eds) Lectures in Applied Mathematics, vol 32. The Mathematics of Numerical Analysis. American Mathematical Society Press, Park City, Utah, USA, pp 99–123
Zurück zum Zitat Bolanos ME, Aviyente S, Radha H (2012) Graph entropy rate minimization and the compressibility of undirected binary graphs. In: Proceedings of IEEE Statistical Signal Processing Workshop (SSP), IEEE, Ann Arbor, MI, pp 109–112 Bolanos ME, Aviyente S, Radha H (2012) Graph entropy rate minimization and the compressibility of undirected binary graphs. In: Proceedings of IEEE Statistical Signal Processing Workshop (SSP), IEEE, Ann Arbor, MI, pp 109–112
Zurück zum Zitat Chagas GO, Gonzaga de Oliveira SL (2015) Metaheuristic-based heuristics for symmetric-matrix bandwidth reduction: a systematic review. Procedia Computer Science (ICCS 2015 International Conference on Computational Science) 51, 2015, 211–220 Chagas GO, Gonzaga de Oliveira SL (2015) Metaheuristic-based heuristics for symmetric-matrix bandwidth reduction: a systematic review. Procedia Computer Science (ICCS 2015 International Conference on Computational Science) 51, 2015, 211–220
Zurück zum Zitat Chen HK (2017) Evaluation of triangular mesh layout techniques using large mesh simplification. Multimedia Tools Appl 76(23):25391–25419CrossRef Chen HK (2017) Evaluation of triangular mesh layout techniques using large mesh simplification. Multimedia Tools Appl 76(23):25391–25419CrossRef
Zurück zum Zitat Concas A, Fenu C, Rodriguez G (2019) PQser: a Matlab package for spectral seriation. Numer Algorithms 80(3):879–902MathSciNetCrossRef Concas A, Fenu C, Rodriguez G (2019) PQser: a Matlab package for spectral seriation. Numer Algorithms 80(3):879–902MathSciNetCrossRef
Zurück zum Zitat Davis TA, Hu Y (2011) The University of Florida sparse matrix collection. ACM Trans Math Softw 38(1):1–25MathSciNetMATH Davis TA, Hu Y (2011) The University of Florida sparse matrix collection. ACM Trans Math Softw 38(1):1–25MathSciNetMATH
Zurück zum Zitat George A, Liu JW (1981) Computer solution of large sparse positive definite systems. Prentice-Hall, Englewood CliffsMATH George A, Liu JW (1981) Computer solution of large sparse positive definite systems. Prentice-Hall, Englewood CliffsMATH
Zurück zum Zitat Gibbs NE, Poole WG, Stockmeyer PK (1976) An algorithm for reducing the bandwidth and profile of a sparse matrix. SIAM J Numer Anal 13(2):236–250MathSciNetCrossRef Gibbs NE, Poole WG, Stockmeyer PK (1976) An algorithm for reducing the bandwidth and profile of a sparse matrix. SIAM J Numer Anal 13(2):236–250MathSciNetCrossRef
Zurück zum Zitat Gonzaga de Oliveira SL, Abreu AAAM, Robaina DT, Kischnhevsky M (2017) An evaluation of four reordering algorithms to reduce the computational cost of the Jacobi-preconditioned conjugate gradient method using high-precision arithmetic. Int J Business Intell Data Min 12(2):190–209 Gonzaga de Oliveira SL, Abreu AAAM, Robaina DT, Kischnhevsky M (2017) An evaluation of four reordering algorithms to reduce the computational cost of the Jacobi-preconditioned conjugate gradient method using high-precision arithmetic. Int J Business Intell Data Min 12(2):190–209
Zurück zum Zitat Gonzaga de Oliveira SL, Abreu AAAM, Robaina DT, Kischnhevsky M (2018) Finding a starting vertex for the reverse Cuthill-Mckee method for bandwidth reduction: a comparative analysis using asymmetric matrices. In: Gervasi O et al. (eds) The 18th International Conference on Computational Science and Its Applications (ICCSA), vol 10960. Lecture Notes in Computer Science. Springer International Publishing, Cham, pp 123–137 Gonzaga de Oliveira SL, Abreu AAAM, Robaina DT, Kischnhevsky M (2018) Finding a starting vertex for the reverse Cuthill-Mckee method for bandwidth reduction: a comparative analysis using asymmetric matrices. In: Gervasi O et al. (eds) The 18th International Conference on Computational Science and Its Applications (ICCSA), vol 10960. Lecture Notes in Computer Science. Springer International Publishing, Cham, pp 123–137
Zurück zum Zitat Gonzaga de Oliveira SL, Bernardes JAB, Chagas GO (2018) An evaluation of low-cost heuristics for matrix bandwidth and profile reductions. Comput Appl Math 37(2):1412–1471MathSciNetCrossRef Gonzaga de Oliveira SL, Bernardes JAB, Chagas GO (2018) An evaluation of low-cost heuristics for matrix bandwidth and profile reductions. Comput Appl Math 37(2):1412–1471MathSciNetCrossRef
Zurück zum Zitat Gonzaga de Oliveira SL, Bernardes JAB, Chagas GO (2018) An evaluation of reordering algorithms to reduce the computational cost of the incomplete Cholesky-conjugate gradient method. Comput Appl Math 37(3):2965–3004MathSciNetCrossRef Gonzaga de Oliveira SL, Bernardes JAB, Chagas GO (2018) An evaluation of reordering algorithms to reduce the computational cost of the incomplete Cholesky-conjugate gradient method. Comput Appl Math 37(3):2965–3004MathSciNetCrossRef
Zurück zum Zitat Gonzaga de Oliveira SL, Chagas GO (2015) A systematic review of heuristics for symmetric-matrix bandwidth reduction: methods not based on metaheuristics. In: Proceedings of the Brazilian Symposium on Operations Research (SBPO 2015). Sobrapo, Pernambuco, Brazil Gonzaga de Oliveira SL, Chagas GO (2015) A systematic review of heuristics for symmetric-matrix bandwidth reduction: methods not based on metaheuristics. In: Proceedings of the Brazilian Symposium on Operations Research (SBPO 2015). Sobrapo, Pernambuco, Brazil
Zurück zum Zitat Koohestani B, Poli R (2011) A hyper-heuristic approach to evolving algorithms for bandwidth reduction based on genetic programming. Research and Development in Intelligent Systems XXVIII. Springer, London, London, UK, pp 93–106 Koohestani B, Poli R (2011) A hyper-heuristic approach to evolving algorithms for bandwidth reduction based on genetic programming. Research and Development in Intelligent Systems XXVIII. Springer, London, London, UK, pp 93–106
Zurück zum Zitat Lewis JG (1982) Implementations of the Gibbs-Poole-Stockmeyer algorithms and Gibbs-King algorithms. ACM Trans Math Softw 8:180–189CrossRef Lewis JG (1982) Implementations of the Gibbs-Poole-Stockmeyer algorithms and Gibbs-King algorithms. ACM Trans Math Softw 8:180–189CrossRef
Zurück zum Zitat Lim A, Rodrigues B, Xiao F (2007) A fast algorithm for bandwidth minimization. Int J Artif Intell Tools 16(03):537–544CrossRef Lim A, Rodrigues B, Xiao F (2007) A fast algorithm for bandwidth minimization. Int J Artif Intell Tools 16(03):537–544CrossRef
Zurück zum Zitat Martí R, Laguna M, Glover F, Campos V (2001) Reducing the bandwidth of a sparse matrix with tabu search. Eur J Oper Res 135(2):450–459MathSciNetCrossRef Martí R, Laguna M, Glover F, Campos V (2001) Reducing the bandwidth of a sparse matrix with tabu search. Eur J Oper Res 135(2):450–459MathSciNetCrossRef
Zurück zum Zitat Mladenovic N, Urosevic D, Pérez-Brito D, García-González CG (2010) Variable neighbourhood search for bandwidth reduction. Eur J Oper Res 200:14–27MathSciNetCrossRef Mladenovic N, Urosevic D, Pérez-Brito D, García-González CG (2010) Variable neighbourhood search for bandwidth reduction. Eur J Oper Res 200:14–27MathSciNetCrossRef
Zurück zum Zitat Mueller C, Martin B, Lumsdaine A (2007) A comparison of vertex ordering algorithms for large graph visualization. In: Proceedings of the 6th International Asia-Pacific Symposium on Visualization (APVIS’07). Sydney, Australia, pp 141–148 Mueller C, Martin B, Lumsdaine A (2007) A comparison of vertex ordering algorithms for large graph visualization. In: Proceedings of the 6th International Asia-Pacific Symposium on Visualization (APVIS’07). Sydney, Australia, pp 141–148
Zurück zum Zitat Papadimitriou CH (1976) The NP-completeness of bandwidth minimization problem. Comput J 16:177–192MathSciNetMATH Papadimitriou CH (1976) The NP-completeness of bandwidth minimization problem. Comput J 16:177–192MathSciNetMATH
Zurück zum Zitat Smith CW, Abeysinghe E, Marru S, Jansen KE (2018) PHASTA science gateway for high performance computational fluid dynamics. In: PEARC ’18 - Proceedings of the Practice and Experience on Advanced Research Computing, p. 94. ACM, Pittsburgh, PA Smith CW, Abeysinghe E, Marru S, Jansen KE (2018) PHASTA science gateway for high performance computational fluid dynamics. In: PEARC ’18 - Proceedings of the Practice and Experience on Advanced Research Computing, p. 94. ACM, Pittsburgh, PA
Zurück zum Zitat Toivanen J, Avery P, Farhat C (2018) A multilevel FETI-DP method and its performance for problems with billions of degrees of freedom. Int J Numer Methods Eng 116(10–11):661–682MathSciNetCrossRef Toivanen J, Avery P, Farhat C (2018) A multilevel FETI-DP method and its performance for problems with billions of degrees of freedom. Int J Numer Methods Eng 116(10–11):661–682MathSciNetCrossRef
Zurück zum Zitat Torres-Jimenez J, Izquierdo-Marquez I, Garcia-Robledo A, Gonzalez-Gomez A, Bernal J, Kacker RN (2015) A dual representation simulated annealing algorithm for the bandwidth minimization problem on graphs. Inf Sci 303:33–49MathSciNetCrossRef Torres-Jimenez J, Izquierdo-Marquez I, Garcia-Robledo A, Gonzalez-Gomez A, Bernal J, Kacker RN (2015) A dual representation simulated annealing algorithm for the bandwidth minimization problem on graphs. Inf Sci 303:33–49MathSciNetCrossRef
Zurück zum Zitat Weise T, Wang X, Qi Q, Li B, Tang K (2018) Automatically discovering clusters of algorithm and problem instance behaviors as well as their causes from experimental data, algorithm setups, and instance features. Appl Soft Comput 73:366–382CrossRef Weise T, Wang X, Qi Q, Li B, Tang K (2018) Automatically discovering clusters of algorithm and problem instance behaviors as well as their causes from experimental data, algorithm setups, and instance features. Appl Soft Comput 73:366–382CrossRef
Metadaten
Titel
Metaheuristic algorithms for the bandwidth reduction of large-scale matrices
verfasst von
S. L. Gonzaga de Oliveira
C. Carvalho
Publikationsdatum
17.09.2021
Verlag
Springer US
Erschienen in
Journal of Combinatorial Optimization / Ausgabe 4/2022
Print ISSN: 1382-6905
Elektronische ISSN: 1573-2886
DOI
https://doi.org/10.1007/s10878-021-00801-6

Weitere Artikel der Ausgabe 4/2022

Journal of Combinatorial Optimization 4/2022 Zur Ausgabe

Premium Partner