Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Exact Algorithms via Monotone Local Search

Published: 08 March 2019 Publication History

Abstract

We give a new general approach for designing exact exponential-time algorithms for subset problems. In a subset problem the input implicitly describes a family of sets over a universe of size n and the task is to determine whether the family contains at least one set. A typical example of a subset problem is WEIGHTED d-SAT. Here, the input is a CNF-formula with clauses of size at most d, and an integer W. The universe is the set of variables and the variables have integer weights. The family contains all the subsets S of variables such that the total weight of the variables in S does not exceed W and setting the variables in S to 1 and the remaining variables to 0 satisfies the formula. Our approach is based on “monotone local search,” where the goal is to extend a partial solution to a solution by adding as few elements as possible. More formally, in the extension problem, we are also given as input a subset X of the universe and an integer k. The task is to determine whether one can add at most k elements to X to obtain a set in the (implicitly defined) family. Our main result is that a cknO(1) time algorithm for the extension problem immediately yields a randomized algorithm for finding a solution of any size with running time O((2−1/c)n).
In many cases, the extension problem can be reduced to simply finding a solution of size at most k. Furthermore, efficient algorithms for finding small solutions have been extensively studied in the field of parameterized algorithms. Directly applying these algorithms, our theorem yields in one stroke significant improvements over the best known exponential-time algorithms for several well-studied problems, including d-HITTING SET, FEEDBACK VERTEX SET, NODE UNIQUE LABEL COVER, and WEIGHTED d-SAT. Our results demonstrate an interesting and very concrete connection between parameterized algorithms and exact exponential-time algorithms.
We also show how to derandomize our algorithms at the cost of a subexponential multiplicative factor in the running time. Our derandomization is based on an efficient construction of a new pseudo-random object that might be of independent interest. Finally, we extend our methods to establish new combinatorial upper bounds and develop enumeration algorithms.

References

[1]
Akanksha Agrawal, Sudeshna Kolay, Daniel Lokshtanov, and Saket Saurabh. 2016. A faster FPT algorithm and a smaller kernel for block graph vertex deletion. In Proceedings of the 12th Latin American Symposium on Theoretical Informatics (LATIN’16) (Lecture Notes in Computer Science), Vol. 9644. Springer, 1--13.
[2]
Noga Alon, László Babai, and Alon Itai. 1986. A fast and simple randomized parallel algorithm for the maximal independent set problem. J. Algor. 7, 4 (1986), 567--583.
[3]
Noga Alon and Shai Gutner. 2010. Balanced families of perfect hash functions and their applications. ACM Trans. Algor. 6, 3 (2010).
[4]
Julien Baste, Luerbio Faria, Sulamita Klein, and Ignasi Sau. 2015. Parameterized Complexity Dichotomy for (r, l)-Vertex Deletion. Technical Report abs/1504.05515. arXiv CoRR.
[5]
Ivan Bliznets, Fedor V. Fomin, Michal Pilipczuk, and Yngve Villanger. 2013. Largest chordal and interval subgraphs faster than 2<sup>n</sup>. In Proceedings of the 21st Annual European Symposium on Algorithms (ESA’13) (Lecture Notes in Computer Science), Vol. 8125. Springer, 193--204.
[6]
Anudhyan Boral, Marek Cygan, Tomasz Kociumaka, and Marcin Pilipczuk. 2014. A fast branching algorithm for cluster vertex deletion. In Proceedings of the 9th International Computer Science Symposium in Russia (CSR’14) (Lecture Notes in Computer Science), Vol. 8476. Springer, 111--124.
[7]
Andreas Brandstädt, Van Bang Le, and Jeremy P. Spinrad. 1999. Graph Classes: A Survey. SIAM.
[8]
Yixin Cao. 2015. Unit interval editing is fixed-parameter tractable. In Proceedings of the 42nd International Colloquium of Automata, Languages and Programming (ICALP’15) (Lecture Notes in Computer Science), Vol. 9134. Springer, 306--317.
[9]
Yixin Cao. 2016. Linear recognition of almost interval graphs. In Proceedings of the 27th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA’16). 1096--1115.
[10]
Yixin Cao, Jianer Chen, and Yang Liu. 2015. On feedback vertex set: New measure and new structures. Algorithmica 73, 1 (2015), 63--86.
[11]
Jianer Chen, Fedor V. Fomin, Yang Liu, Songjian Lu, and Yngve Villanger. 2008. Improved algorithms for feedback vertex set problems. J. Comput. Syst. Sci. 74, 7 (2008), 1188--1198.
[12]
Manfred Cochefert, Jean-François Couturier, Serge Gaspers, and Dieter Kratsch. 2016. Faster algorithms to enumerate hypergraph transversals. In Proceedings of the 12th Latin American Theoretical Informatics Symposium (LATIN'16). Lecture Notes in Computer Science, Vol. 9644, Springer, 306--318.
[13]
Derek G. Corneil, H. Lerchs, and L. Stewart Burlingham. 1981. Complement reducible graphs. Discrete Appl. Math. 3, 3 (1981), 163--174.
[14]
Marek Cygan, Fedor V. Fomin, Lukasz Kowalik, Daniel Lokshtanov, Dániel Marx, Marcin Pilipczuk, Michał Pilipczuk, and Saket Saurabh. 2015. Parameterized Algorithms. Springer.
[15]
Marek Cygan, Jesper Nederlof, Marcin Pilipczuk, Michał Pilipczuk, Johan M. M. van Rooij, and Jakub Onufry Wojtaszczyk. 2011. Solving connectivity problems parameterized by treewidth in single exponential time. In Proceedings of the 52nd Annual Symposium on Foundations of Computer Science (FOCS’11). IEEE, 150--159.
[16]
Evgeny Dantsin, Andreas Goerdt, Edward A. Hirsch, Ravi Kannan, Jon Kleinberg, Christos Papadimitriou, Prabhakar Raghavan, and Uwe Schöning. 2002. A deterministic (2 &minus; 2/(k + 1))<sup>n</sup> algorithm for k-SAT based on local search. Theor. Comput. Sci. 289, 1 (2002), 69--83.
[17]
Frank K. H. A. Dehne, Michael R. Fellows, Michael A. Langston, Frances A. Rosamond, and Kim Stevens. 2007. An O(2<sup>O(k)</sup>n<sup>3</sup>) FPT algorithm for the undirected feedback vertex set problem. Theory Comput. Syst. 41, 3 (2007), 479--492.
[18]
Michael R. Fellows, Fedor V. Fomin, Daniel Lokshtanov, Frances A. Rosamond, Saket Saurabh, and Yngve Villanger. 2012. Local search: Is brute-force avoidable? J. Comput. Syst. Sci. 78, 3 (2012), 707--719.
[19]
Fedor V. Fomin, Serge Gaspers, Dieter Kratsch, Mathieu Liedloff, and Saket Saurabh. 2010. Iterative compression and exact algorithms. Theor. Comput. Sci. 411, 7--9 (2010), 1045--1053.
[20]
Fedor V. Fomin, Serge Gaspers, Daniel Lokshtanov, and Saket Saurabh. 2016. Exact algorithms via monotone local search. In Proceedings of the 48th Annual ACM SIGACT Symposium on Theory of Computing (STOC’16). ACM, 764--775.
[21]
Fedor V. Fomin, Serge Gaspers, Artem V. Pyatkin, and Igor Razgon. 2008. On the minimum feedback vertex set problem: Exact and enumeration algorithms. Algorithmica 52, 2 (2008), 293--307.
[22]
Fedor V. Fomin, Pinar Heggernes, Dieter Kratsch, Charis Papadopoulos, and Yngve Villanger. 2014. Enumerating minimal subset feedback vertex sets. Algorithmica 69, 1 (2014), 216--231.
[23]
Fedor V. Fomin and Dieter Kratsch. 2010. Exact Exponential Algorithms. Springer. An EATCS Series: Texts in Theoretical Computer Science.
[24]
Fedor V. Fomin, Ioan Todinca, and Yngve Villanger. 2015. Large induced subgraphs via triangulations and CMSO. SIAM J. Comput. 44, 1 (2015), 54--87.
[25]
Serge Gaspers, Eun Jung Kim, Sebastian Ordyniak, Saket Saurabh, and Stefan Szeider. 2012. Don’t be strict in local search&excl;. In Proceedings of the 26th AAAI Conference on Artificial Intelligence (AAAI’12). AAAI Press.
[26]
Serge Gaspers and Matthias Mnich. 2013. Feedback vertex sets in tournaments. J. Graph Theory 72, 1 (2013), 72--89.
[27]
Petr A. Golovach, Pim van ’t Hof, and Daniël Paulusma. 2013. Obtaining planarity by contracting few edges. Theor. Comput. Sci. 476 (2013), 38--46.
[28]
Jiong Guo, Jens Gramm, Falk Hüffner, Rolf Niedermeier, and Sebastian Wernicke. 2006. Compression-based fixed-parameter algorithms for feedback vertex set and edge bipartization. J. Comput. Syst. Sci. 72, 8 (2006), 1386--1396.
[29]
Peter L. Hammer and Stéphane Földes. 1977. Split graphs. Congress. Numerant. 19 (1977), 311--315.
[30]
David S. Johnson. 1974. Approximation algorithms for combinatorial problems. J. Comput. System Sci. 9, 3 (1974), 256--278.
[31]
Stasys Jukna. 2011. Extremal Combinatorics. Springer.
[32]
Iyad A. Kanj, Guohui Lin, Tian Liu, Weitian Tong, Ge Xia, Jinhui Xu, Boting Yang, Fenghui Zhang, Peng Zhang, and Binhai Zhu. 2014. Algorithms for cut problems on trees. In Proceedings of the 8th International Conference on Combinatorial Optimization and Applications (COCOA’14) (Lecture Notes in Computer Science), Vol. 8881. Springer, 283--298.
[33]
Mamadou Moustapha Kanté, Eun Jung Kim, O.-joung Kwon, and Christophe Paul. 2015. An FPT algorithm and a polynomial kernel for linear rankwidth-1 vertex deletion. In Proceedings of the 10th International Symposium on Parameterized and Exact Computation (IPEC’15). CoRR 43, 138--150. Retrieved from http://arxiv.org/abs/1504.05905
[34]
Tomasz Kociumaka and Marcin Pilipczuk. 2014. Faster deterministic feedback vertex set. Inf. Process. Lett. 114, 10 (2014), 556--560.
[35]
Sudeshna Kolay and Fahad Panolan. 2015. Parameterized algorithms for deletion to (r,l)-graphs. In Proceedings of the 35th IARCS Annual Conference on Foundation of Software Technology and Theoretical Computer Science (FSTTCS’15) (LIPIcs), Vol. 45. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 420--433.
[36]
Bernhard Korte and Jens Vygen. 2012. Combinatorial Optimization. Springer.
[37]
Mithilesh Kumar and Daniel Lokshtanov. 2016. Faster exact and parameterized algorithm for feedback vertex set in tournaments. In Proceedings of the 33rd International Symposium on Theoretical Aspects of Computer Science (STACS’16) (LIPIcs), Vol. 47. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 49:1--49:13.
[38]
Konstantin Kutzkov and Dominik Scheder. 2010. Using CSP to improve deterministic 3-SAT. CoRR abs/1007.1166 (2010). Retrieved from http://arxiv.org/abs/1007.1166.
[39]
Nikolai N. Kuzjurin. 2000. Explicit constructions of Rödl’s asymptotically good packings and coverings. Combinat. Prob. Comput. 9, 3 (2000), 265--276. Retrieved from http://journals.cambridge.org/action/displayAbstract?aid&equals;54643.
[40]
Dániel Marx and Ildikó Schlotter. 2011. Stable assignment with couples: Parameterized complexity and local search. Discrete Optim. 8, 1 (2011), 25--40.
[41]
J. W. Moon. 1971. On maximal transitive subtournaments. Proc. Edinburgh Math. Soc. (2) 17 (1971), 345--349.
[42]
Robin A. Moser and Dominik Scheder. 2011. A full derandomization of Schöning’s k-SAT algorithm. In Proceedings of the 43rd Annual ACM Symposium on Theory of Computing (STOC’11). ACM, 245--252.
[43]
Moni Naor, Leonard J. Schulman, and Aravind Srinivasan. 1995. Splitters and near-optimal derandomization. In Proceedings of the 36th Annual Symposium on Foundations of Computer Science (FOCS’95). IEEE, 182--191.
[44]
Igor Razgon. 2006. Exact computation of maximum induced forest. In Proceedings of the 10th Scandinavian Workshop on Algorithm Theory (SWAT’06) (Lecture Notes in Computer Science), Vol. 4059. Springer, Berlin, 160--171.
[45]
Igor Razgon. 2007. Computing minimum directed feedback vertex set in O(1.9977<sup>n</sup>). In Proceedings of the 10th Italian Conference on Theoretical Computer Science (ICTCS’07). 70--81.
[46]
Uwe Schöning. 1999. A probabilistic algorithm for k-SAT and constraint satisfaction problems. In Proceedings of the 40th Annual Symposium on Foundations of Computer Science. IEEE Computer Soc., Los Alamitos, CA, 410--414.
[47]
Hadas Shachnai and Meirav Zehavi. 2017. A multivariate framework for weighted FPT algorithms. J. Comput. Syst. Sci. 89 (2017), 157--189.
[48]
Pim van ’t Hof and Yngve Villanger. 2013. Proper interval vertex deletion. Algorithmica 65, 4 (2013), 845--867.
[49]
Magnus Wahlström. 2007. Algorithms, Measures, and Upper Bounds for Satisfiability and Related Problems. Ph.D. Dissertation. Linköping University, Sweden.
[50]
Magnus Wahlström. 2014. Half-integrality, LP-branching and FPT algorithms. In Proceedings of the 24th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA’14). SIAM, 1762--1781.
[51]
Mingyu Xiao and Hiroshi Nagamochi. 2013. Exact algorithms for maximum independent set. In Proceedings of the 24th International Symposium on Algorithms and Computation (ISAAC’13). CoRR 8283, 328--338. Retrieved from http://arxiv.org/abs/1312.6260See also arXiv CoRR abs/1312.6260.
[52]
Takayuki Yato and Takahiro Seta. 2003. Complexity and completeness of finding another solution and its application to puzzles. IEICE Trans. Fund. Electron. Commun. Comput. Sci. E86-A, 5 (2003), 1052--1060.

Cited By

View all
  • (2024)Exact algorithms for restricted subset feedback vertex set in chordal and split graphsTheoretical Computer Science10.1016/j.tcs.2023.114326984(114326)Online publication date: Feb-2024
  • (2024)s-Club Cluster Vertex Deletion on interval and well-partitioned chordal graphsDiscrete Applied Mathematics10.1016/j.dam.2023.11.048345(170-189)Online publication date: Mar-2024
  • (2023)Dynamic thresholding search for the feedback vertex set problemPeerJ Computer Science10.7717/peerj-cs.12459(e1245)Online publication date: 10-Feb-2023
  • Show More Cited By

Index Terms

  1. Exact Algorithms via Monotone Local Search

    Recommendations

    Reviews

    Vladik Kreinovich

    Many important problems are NP-complete; this means that, unless P = NP, we cannot have a polynomial-time (feasible) algorithm for solving all instances of this problem. For each such problem, there is an exhaustive search algorithm that requires exponential time. How can we solve these problems faster There are two main approaches to answering this question. The parameterized algorithm approach tries to find subclasses for which a feasible algorithm is possible-usually by introducing an integer-valued parameter such that for each value of this parameter, a feasible algorithm is possible for all the instances for which this parameter does not exceed this value. An alternative idea is to find an exponential algorithm-applicable to all the instances-that is faster than exhaustive search. The authors show, rather unexpectedly, that these two seemingly unrelated approaches are actually strongly related: namely, in many cases, a successful parameterized algorithm can lead to a faster-than-exhaustive-search exponential algorithm. Specifically, the authors consider subset problems, that is, the problems of checking whether in a given n -element set there is a subset satisfying a given property. For example, we are given: a CNF formula with clauses of size at most d , weights assigned to all n variables, and the overall weight W ; we want to check the existence of a satisfying vector for which the total weight of all true variables does not exceed W . For such problems, exhaustive search of all 2 n subsets takes time 2 n . The corresponding parameterized problem is: given a set X and an integer k , can we add at most k elements to X and get a set with the desired property It turns out that if this "extension" problem can be solved in time O ( c k n C ) (for some constant C ), then the original problem can be solved faster than in 2 n steps: namely, in time O ((2-1/ c ) n ). The authors first prove the existence of a randomized algorithm with this computation time, and then use an innovative pseudo-random generator to design a deterministic algorithm with practically the same complexity: O ((2-1/ c ) n + o ( n )). The results are spectacular. For many problems for which no faster-than-exhaustive-search algorithm was previously known, such algorithms are produced. For many other problems, new exponential algorithms are generated that are faster than all previously known ones.

    Access critical reviews of Computing literature here

    Become a reviewer for Computing Reviews.

    Comments

    Information & Contributors

    Information

    Published In

    cover image Journal of the ACM
    Journal of the ACM  Volume 66, Issue 2
    April 2019
    260 pages
    ISSN:0004-5411
    EISSN:1557-735X
    DOI:10.1145/3318168
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 March 2019
    Accepted: 01 September 2018
    Revised: 01 September 2018
    Received: 01 May 2016
    Published in JACM Volume 66, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Exact exponential algorithm
    2. local search
    3. parameterized algorithm
    4. satisfiability

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    • European Research Council under the European Union's Seventh Framework Programme (FP/2007-2013)/ERC
    • ARC's Discovery Projects
    • Research Council of Norway via MULTIVAL
    • Australian Research Council (ARC) Future Fellowship
    • Beating Hardness by Pre-processing grant under the recruitment programme of the of Bergen Research Foundation

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)47
    • Downloads (Last 6 weeks)8
    Reflects downloads up to 10 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Exact algorithms for restricted subset feedback vertex set in chordal and split graphsTheoretical Computer Science10.1016/j.tcs.2023.114326984(114326)Online publication date: Feb-2024
    • (2024)s-Club Cluster Vertex Deletion on interval and well-partitioned chordal graphsDiscrete Applied Mathematics10.1016/j.dam.2023.11.048345(170-189)Online publication date: Mar-2024
    • (2023)Dynamic thresholding search for the feedback vertex set problemPeerJ Computer Science10.7717/peerj-cs.12459(e1245)Online publication date: 10-Feb-2023
    • (2022)Exact algorithms for counting 3-colorings of graphsDiscrete Applied Mathematics10.1016/j.dam.2022.08.002322(74-93)Online publication date: Dec-2022
    • (2022)A tight approximation algorithm for the cluster vertex deletion problemMathematical Programming10.1007/s10107-021-01744-w197:2(1069-1091)Online publication date: 7-Jan-2022
    • (2022)Exact and Parameterized Algorithms for Restricted Subset Feedback Vertex Set in Chordal GraphsTheory and Applications of Models of Computation10.1007/978-3-031-20350-3_20(249-261)Online publication date: 16-Sep-2022
    • (2022)s-Club Cluster Vertex Deletion on Interval and Well-Partitioned Chordal GraphsGraph-Theoretic Concepts in Computer Science10.1007/978-3-031-15914-5_10(129-143)Online publication date: 22-Jun-2022
    • (2021)Polyhedral properties of the induced cluster subgraphsDiscrete Applied Mathematics10.1016/j.dam.2021.02.040297(80-96)Online publication date: Jul-2021
    • (2021)A Tight Approximation Algorithm for the Cluster Vertex Deletion ProblemInteger Programming and Combinatorial Optimization10.1007/978-3-030-73879-2_24(340-353)Online publication date: 5-May-2021
    • (2021)Parameterized Complexity of d-Hitting Set with QuotasSOFSEM 2021: Theory and Practice of Computer Science10.1007/978-3-030-67731-2_21(293-307)Online publication date: 25-Jan-2021
    • Show More Cited By

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media