Skip to main content
Top
Published in:
Cover of the book

2018 | OriginalPaper | Chapter

Complexity of Generation

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this talk I summarize the results obtained in 1999–2008 by Leonid Khachiyan, Endre Boros, Konrad Borys, Khaled Elbassiony, Kazuhisa Makino, and myself, on complexity of generation algorithms. These algorithms can be partitioned into three groups: supergraph, flash-light (backtrack), and dual-bounded generation. We will call a problem tractable if it can be solved by a polynomial (\(n^{const}\)) or quasi-polynomial (\(n^{polylog(n)}\)) time algorithm. More generally, for any positive non-decreasing function \(g = g(n)\), generating can be performed in total or incremental time g, or with g-delay. Most of the polynomial delay algorithms are provided by the flash-light (backtrack) method. As for the incremental algorithms, generating the next object is equivalent with just verifying its existence, which is a standard decision problem. Thus, incremental generation, in contrast to the delay one, may be NP-hard or NP-complete. For example, we show that generating all vertices of a polyhedron, given by its facets, is NP-complete (while the complexity status is still open in case of the polytopes, that is, bounded polyhedra). This problem is reduced to generating all negative cycles of a weighted digraph, which is NP-complete (for graphs, too). Generating all minimal transversals to a hypergraph, so-called dualization, plays an important role. For this problem an incremental quasi-polynomial algorithm (but no polynomial one) is known. We outline several wide classes of generation problems that can be reduced to dualization and, thus, solved in incremental quasi-polynomial time. We survey algorithms and complexity bounds for the above and many other generation problems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Agrawal, R., Mannila, H., Srikant, R., Toivonen, H., Verkamo, A.I.: Fast discovery of association rules. In: Advances in Knowledge Discovery and Data Mining, pp. 307–328 (1996) Agrawal, R., Mannila, H., Srikant, R., Toivonen, H., Verkamo, A.I.: Fast discovery of association rules. In: Advances in Knowledge Discovery and Data Mining, pp. 307–328 (1996)
2.
go back to reference Alekseev, V.E.: On the number of dead-end independent sets in graphs from hereditary classes. Comb.-Algebraic Methods Discret. Optim. 6, 5–8 (1991). (Nizhni Novgorod, in Russian) Alekseev, V.E.: On the number of dead-end independent sets in graphs from hereditary classes. Comb.-Algebraic Methods Discret. Optim. 6, 5–8 (1991). (Nizhni Novgorod, in Russian)
3.
go back to reference Bertolazzi, P., Sassano, A.: An \(O(mn)\) time algorithm for regular set-covering problems. Theor. Comput. Sci. 54, 237–247 (1987)CrossRef Bertolazzi, P., Sassano, A.: An \(O(mn)\) time algorithm for regular set-covering problems. Theor. Comput. Sci. 54, 237–247 (1987)CrossRef
5.
go back to reference Bixby, R., Cunningham, W.: Matroid optimization and algorithms. In: Handbook of Combinatorics, pp. 550–609 (1995) Bixby, R., Cunningham, W.: Matroid optimization and algorithms. In: Handbook of Combinatorics, pp. 550–609 (1995)
6.
go back to reference Bioch, J.C., Ibaraki, T.: Complexity of identification and dualization of positive Boolean functions. Inf. Comput. 123, 50–63 (1995)MathSciNetCrossRefMATH Bioch, J.C., Ibaraki, T.: Complexity of identification and dualization of positive Boolean functions. Inf. Comput. 123, 50–63 (1995)MathSciNetCrossRefMATH
7.
go back to reference Boros, E., Gurvich, V., Hammer, P.L.: Dual subimplicants of positive Boolean functions. Optim. Methods Softw. 10, 147–156 (1998). RUTCOR Research report 11-1993, Rutgers UniversityMathSciNetCrossRefMATH Boros, E., Gurvich, V., Hammer, P.L.: Dual subimplicants of positive Boolean functions. Optim. Methods Softw. 10, 147–156 (1998). RUTCOR Research report 11-1993, Rutgers UniversityMathSciNetCrossRefMATH
8.
go back to reference Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L.: An efficient incremental algorithm for generating all maximal independent sets for hypergraphs of bounded dimension. Parallel Proc. Lett. 10(4), 253–266 (2000)MathSciNetCrossRef Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L.: An efficient incremental algorithm for generating all maximal independent sets for hypergraphs of bounded dimension. Parallel Proc. Lett. 10(4), 253–266 (2000)MathSciNetCrossRef
9.
go back to reference Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L.: Generating dual-bounded hypergraphs. Optim. Methods Softw. 17(5), 749–781 (2002)MathSciNetCrossRefMATH Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L.: Generating dual-bounded hypergraphs. Optim. Methods Softw. 17(5), 749–781 (2002)MathSciNetCrossRefMATH
10.
go back to reference Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L.: An inequality for polymatroid functions and its applications. Discret. Appl. Math. 131(2), 255–281 (2003). Special Issue on SubmodularityMathSciNetCrossRefMATH Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L.: An inequality for polymatroid functions and its applications. Discret. Appl. Math. 131(2), 255–281 (2003). Special Issue on SubmodularityMathSciNetCrossRefMATH
11.
go back to reference Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L.: On dualization of the hypergraphs with bounded edge-intersections and other related classes of hypergraphs. Theor. Comput. Sci. 382, 139–150 (2008). RUTCOR Research report RRR-37-2003, Rutgers UniversityMathSciNetMATH Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L.: On dualization of the hypergraphs with bounded edge-intersections and other related classes of hypergraphs. Theor. Comput. Sci. 382, 139–150 (2008). RUTCOR Research report RRR-37-2003, Rutgers UniversityMathSciNetMATH
12.
go back to reference Khachiyan, L., Boros, E., Elbassioni, K., Gurvich, V.: Generating all minimal integral solutions to monotone \(\wedge, \vee \)-systems of linear, transversal and polymatroid inequalities. In: Jȩdrzejowicz, J., Szepietowski, A. (eds.) MFCS 2005. LNCS, vol. 3618, pp. 556–567. Springer, Heidelberg (2005). https://doi.org/10.1007/11549345_48CrossRefMATH Khachiyan, L., Boros, E., Elbassioni, K., Gurvich, V.: Generating all minimal integral solutions to monotone \(\wedge, \vee \)-systems of linear, transversal and polymatroid inequalities. In: Jȩdrzejowicz, J., Szepietowski, A. (eds.) MFCS 2005. LNCS, vol. 3618, pp. 556–567. Springer, Heidelberg (2005). https://​doi.​org/​10.​1007/​11549345_​48CrossRefMATH
13.
go back to reference Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L., Makino, K.: On generating all minimal integer solutions for a monotone system of linear inequalities. In: Orejas, F., Spirakis, P.G., van Leeuwen, J. (eds.) ICALP 2001. LNCS, vol. 2076, pp. 92–103. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-48224-5_8CrossRefMATH Boros, E., Elbassioni, K., Gurvich, V., Khachiyan, L., Makino, K.: On generating all minimal integer solutions for a monotone system of linear inequalities. In: Orejas, F., Spirakis, P.G., van Leeuwen, J. (eds.) ICALP 2001. LNCS, vol. 2076, pp. 92–103. Springer, Heidelberg (2001). https://​doi.​org/​10.​1007/​3-540-48224-5_​8CrossRefMATH
14.
go back to reference Boros, E., Gurvich, V., Elbassioni, K., Khachiyan, L., Makino, K.: Dual-bounded generating problems: all minimal integer solutions for a monotone system of linear inequalities. SIAM J. Comput. 31(5), 1624–1643 (2002)MathSciNetCrossRefMATH Boros, E., Gurvich, V., Elbassioni, K., Khachiyan, L., Makino, K.: Dual-bounded generating problems: all minimal integer solutions for a monotone system of linear inequalities. SIAM J. Comput. 31(5), 1624–1643 (2002)MathSciNetCrossRefMATH
15.
go back to reference Boros, E., Elbassioni, K., Gurvich, V., Makino, K.: Generating vertices of polyhedra and related monotone generation problems. CRM Proc. Lect. Notes Polyhedral Comput. 48, 15–44 (2009). Special volume dedicated to Leonid Khachiyan and Victor KleeCrossRefMATH Boros, E., Elbassioni, K., Gurvich, V., Makino, K.: Generating vertices of polyhedra and related monotone generation problems. CRM Proc. Lect. Notes Polyhedral Comput. 48, 15–44 (2009). Special volume dedicated to Leonid Khachiyan and Victor KleeCrossRefMATH
16.
go back to reference Boros, E., Gurvich, V., Khachiyan, L., Makino, K.: Dual-bounded generation: partial and multiple transversals of a hypergraph. SIAM J. Comput. 30(6), 2036–2050 (2001)MathSciNetCrossRefMATH Boros, E., Gurvich, V., Khachiyan, L., Makino, K.: Dual-bounded generation: partial and multiple transversals of a hypergraph. SIAM J. Comput. 30(6), 2036–2050 (2001)MathSciNetCrossRefMATH
17.
go back to reference Boros, E., Gurvich, V., Khachiyan, L., Makino, K.: On maximal frequent and minimal infrequent sets in binary matrices. Ann. Math. Artif. Intell. 39, 211–221 (2003)MathSciNetCrossRefMATH Boros, E., Gurvich, V., Khachiyan, L., Makino, K.: On maximal frequent and minimal infrequent sets in binary matrices. Ann. Math. Artif. Intell. 39, 211–221 (2003)MathSciNetCrossRefMATH
18.
go back to reference Boros, E., Gurvich, V., Khachiyan, L., Makino, K.: Dual-bounded generating problems: weighted transversals of a hypergraph. Discret. Appl. Math. 142(1–3), 1–15 (2004)MathSciNetMATH Boros, E., Gurvich, V., Khachiyan, L., Makino, K.: Dual-bounded generating problems: weighted transversals of a hypergraph. Discret. Appl. Math. 142(1–3), 1–15 (2004)MathSciNetMATH
20.
go back to reference Fredman, M.L., Khachiyan, L.: On the complexity of dualization of monotone disjunctive normal forms. J. Algorithms 21, 618–628 (1996)MathSciNetCrossRefMATH Fredman, M.L., Khachiyan, L.: On the complexity of dualization of monotone disjunctive normal forms. J. Algorithms 21, 618–628 (1996)MathSciNetCrossRefMATH
23.
go back to reference Elbassioni, K.M.: Incremental algorithms for enumerating extremal solutions of monotone systems of submodular inequalities and their applications. Ph.D. thesis, Chap. 4, Dualization in Products of Chains, Semi-lattices, and forests, Rutgers (2002) Elbassioni, K.M.: Incremental algorithms for enumerating extremal solutions of monotone systems of submodular inequalities and their applications. Ph.D. thesis, Chap. 4, Dualization in Products of Chains, Semi-lattices, and forests, Rutgers (2002)
25.
go back to reference Gurvich, V., Khachiyan, L.: On generating the irredundant conjunctive and disjunctive normal forms of monotone Boolean functions. Discret. Appl. Math. 96–97, 363–373 (1999). Rutcor Research report, RRR-35-1995, Rutgers UniversityMathSciNetCrossRefMATH Gurvich, V., Khachiyan, L.: On generating the irredundant conjunctive and disjunctive normal forms of monotone Boolean functions. Discret. Appl. Math. 96–97, 363–373 (1999). Rutcor Research report, RRR-35-1995, Rutgers UniversityMathSciNetCrossRefMATH
26.
go back to reference Jerrum, M.R., Valiant, L.G., Vazirani, V.V.: Random generation of combinatorial structures from a uniform distribution. Theor. Comput. Sci. 43, 169–188 (1986)MathSciNetCrossRefMATH Jerrum, M.R., Valiant, L.G., Vazirani, V.V.: Random generation of combinatorial structures from a uniform distribution. Theor. Comput. Sci. 43, 169–188 (1986)MathSciNetCrossRefMATH
27.
go back to reference Johnson, D.S., Yannakakis, M., Papadimitriou, C.H.: On generating all maximal independent sets. Inf. Process. Lett. 27, 119–123 (1988)MathSciNetCrossRefMATH Johnson, D.S., Yannakakis, M., Papadimitriou, C.H.: On generating all maximal independent sets. Inf. Process. Lett. 27, 119–123 (1988)MathSciNetCrossRefMATH
30.
go back to reference Khachiyan, L.: Transversal hypergraphs and families of polyhedral cones. In: Pardalos, P. (ed.) Advances in Convex Analysis and Global Optimization, Proceedings of the International Conference on Dedicated to the Memory of K. Carathéodory, Samos, Greece, June 2000. Kluwer (2001)MATH Khachiyan, L.: Transversal hypergraphs and families of polyhedral cones. In: Pardalos, P. (ed.) Advances in Convex Analysis and Global Optimization, Proceedings of the International Conference on Dedicated to the Memory of K. Carathéodory, Samos, Greece, June 2000. Kluwer (2001)MATH
31.
go back to reference Khachiyan, L., Boros, E., Borys, K., Elbassioni, K., Gurvich, V.: Generating all vertices of a polyhedron is hard. In: SODA-17, pp. 758–765 (2006). Discret. Comput. Geom. 39(1–3), 174–190 (2008)MathSciNetCrossRefMATH Khachiyan, L., Boros, E., Borys, K., Elbassioni, K., Gurvich, V.: Generating all vertices of a polyhedron is hard. In: SODA-17, pp. 758–765 (2006). Discret. Comput. Geom. 39(1–3), 174–190 (2008)MathSciNetCrossRefMATH
32.
go back to reference Khachiyan, L., Boros, E., Borys, K., Elbassioni, K., Gurvich, V., Makino, K.: Enumerating spanning and connected subsets in graphs and matroids. J. Oper. Res. Soc. Jpn. 50(4), 325–338 (2007)MathSciNetCrossRefMATH Khachiyan, L., Boros, E., Borys, K., Elbassioni, K., Gurvich, V., Makino, K.: Enumerating spanning and connected subsets in graphs and matroids. J. Oper. Res. Soc. Jpn. 50(4), 325–338 (2007)MathSciNetCrossRefMATH
33.
go back to reference Khachiyan, L., Boros, E., Elbassioni, K., Gurvich, V.: Enumerating disjunctions and conjunctions of paths and cuts in reliability theory. Discret. Appl. Math. 155(2), 137–149 (2007)MathSciNetCrossRefMATH Khachiyan, L., Boros, E., Elbassioni, K., Gurvich, V.: Enumerating disjunctions and conjunctions of paths and cuts in reliability theory. Discret. Appl. Math. 155(2), 137–149 (2007)MathSciNetCrossRefMATH
34.
go back to reference Khachiyan, L., Boros, E., Elbassioni, K., Gurvich, V.: Generating all minimal integral solutions to AND-OR systems of monotone polymatroid inequalities: conjunctions are simpler than disjunctions. RUTCOR Research report 41-2004, Rutgers University (2004). Discret. Appl. Math. 156(11), 2020–2034 (2008). Special Volume in Memory of Leonid Khachiyan (1952–2005) Khachiyan, L., Boros, E., Elbassioni, K., Gurvich, V.: Generating all minimal integral solutions to AND-OR systems of monotone polymatroid inequalities: conjunctions are simpler than disjunctions. RUTCOR Research report 41-2004, Rutgers University (2004). Discret. Appl. Math. 156(11), 2020–2034 (2008). Special Volume in Memory of Leonid Khachiyan (1952–2005)
35.
36.
go back to reference Khachiyan, L., Boros, E., Elbassioni, K., Gurvich, V., Makino, K.: Enumerating cut conjunctions in graphs and related problems. Algorithmica 51(3), 239–263 (2008)MathSciNetCrossRefMATH Khachiyan, L., Boros, E., Elbassioni, K., Gurvich, V., Makino, K.: Enumerating cut conjunctions in graphs and related problems. Algorithmica 51(3), 239–263 (2008)MathSciNetCrossRefMATH
37.
go back to reference Lawler, E., Lenstra, J.K., Rinnooy Kan, A.H.G.: Generating all maximal independent sets: NP-hardness and polynomial-time algorithms. SIAM J. Comput. 9, 558–565 (1980)MathSciNetCrossRefMATH Lawler, E., Lenstra, J.K., Rinnooy Kan, A.H.G.: Generating all maximal independent sets: NP-hardness and polynomial-time algorithms. SIAM J. Comput. 9, 558–565 (1980)MathSciNetCrossRefMATH
39.
go back to reference Makino, K., Ibaraki, T.: Interor and exterior functions of Boolean functions. Discret. Appl. Math. 69, 209–231 (1996)CrossRefMATH Makino, K., Ibaraki, T.: Interor and exterior functions of Boolean functions. Discret. Appl. Math. 69, 209–231 (1996)CrossRefMATH
40.
go back to reference Makino, K., Ibaraki, T.: Inner-core and outer-core functions of partially defined Boolean functions. Discret. Appl. Math. 96–97(1–3), 307–326 (1999). Rutcor Research report, RRR-45-95, Rutgers UniversityMathSciNetMATH Makino, K., Ibaraki, T.: Inner-core and outer-core functions of partially defined Boolean functions. Discret. Appl. Math. 96–97(1–3), 307–326 (1999). Rutcor Research report, RRR-45-95, Rutgers UniversityMathSciNetMATH
42.
go back to reference Morris, B., Sinclair, A.: Random walks on truncated cubes and sampling 0-1 knapsack problem, FOCS-40, pp. 230–240 (1999) Morris, B., Sinclair, A.: Random walks on truncated cubes and sampling 0-1 knapsack problem, FOCS-40, pp. 230–240 (1999)
43.
44.
45.
go back to reference Read, R.C., Tarjan, R.E.: Bounds on backtrack algorithms for listing cycles, paths, and spanning trees. Networks 5, 237–252 (1975)MathSciNetCrossRefMATH Read, R.C., Tarjan, R.E.: Bounds on backtrack algorithms for listing cycles, paths, and spanning trees. Networks 5, 237–252 (1975)MathSciNetCrossRefMATH
47.
go back to reference Stockmeyer, L.J., Vazirani, V.: NP-completeness of some generalizations of the maximum matching problem. Inf. Process. Lett. 15(1), 14–19 (1982)MathSciNetCrossRefMATH Stockmeyer, L.J., Vazirani, V.: NP-completeness of some generalizations of the maximum matching problem. Inf. Process. Lett. 15(1), 14–19 (1982)MathSciNetCrossRefMATH
48.
go back to reference Tsukiyama, S., Ide, M., Ariyoshi, H., Shirakawa, I.: A new algorithm for generating all maximal independent sets. SIAM J. Comput. 6, 505–517 (1977)MathSciNetCrossRefMATH Tsukiyama, S., Ide, M., Ariyoshi, H., Shirakawa, I.: A new algorithm for generating all maximal independent sets. SIAM J. Comput. 6, 505–517 (1977)MathSciNetCrossRefMATH
Metadata
Title
Complexity of Generation
Author
Vladimir Gurvich
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-90530-3_1

Premium Partner