Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2330784.2330803acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

libCudaOptimize: an open source library of GPU-based metaheuristics

Published: 07 July 2012 Publication History
  • Get Citation Alerts
  • Abstract

    Evolutionary Computation techniques and other metaheuristics have been increasingly used in the last years for solving many real-world tasks that can be formulated as optimization problems. Among their numerous strengths, a major one is their natural predisposition to parallelization. In this paper, we introduce libCudaOptimize, an open source library which implements some metaheuristics for continuous optimization: presently Particle Swarm Optimization, Differential Evolution, Scatter Search, and Solis&Wets local search. This library allows users either to apply these metaheuristics directly to their own fitness function or to extend it by implementing their own parallel optimization techniques. The library is written in CUDA-C to make extensive use of parallelization, as allowed by Graphics Processing Units.
    After describing the library, we consider two practical case studies: the optimization of a fitness function for the automatic localization of anatomical brain structures in histological images, and the parallel implementation of Simulated Annealing as a new module, which extends the library while keeping code compatibility with it, so that the new method can be readily available for future use within the library as an alternative optimization technique.

    References

    [1]
    A. Banks, J. Vincent, and C. Anyakoha. A review of Particle Swarm Optimization. Part I: background and development. Natural Computing, 6:467--484, 2007.
    [2]
    S. Das and P. Suganthan. Differential Evolution: A Survey of the State-of-the-Art. IEEE Trans. on Evolutionary Computation, 15(1):4--31, 2011.
    [3]
    M. Dorigo and T. Stützle. Ant Colony Optimization. Bradford Company, Scituate, MA, USA, 2004.
    [4]
    J. J. Durillo, A. J. Nebro, F. Luna, B. Dorronsoro, and E. Alba. jMetal: A Java Framework for Developing Multi-Objective Optimization Metaheuristics. Technical Report ITI-2006--10, Departamento de Lenguajes y Ciencias de la Computación, University of Málaga, 2006.
    [5]
    F. Glover, M. Laguna, and M. Rafael. Scatter Search. In Advances in Evolutionary Computation: Theory and Applications, pages 519--537. 2003.
    [6]
    J. Kennedy and R. Eberhart. Particle Swarm Optimization. In Proc. of IEEE International Conference on Neural Networks, volume 4, pages 1942--1948, 1995.
    [7]
    S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi. Optimization by Simulated Annealing. Science, 220(4598):671--680, 1983.
    [8]
    P. Krömer, V. Snåsel, J. Plato\vs, and A. Abraham. A comparison of many-threaded Differential Evolution and Genetic Algorithms on CUDA. In Proc. of Congress on Nature and Biologically Inspired Computing, NaBIC '11, pages 509 --514, 2011.
    [9]
    N. Melab, T. Luong, K. Boufaras, and E. Talbi. Towards ParadisEO-MO-GPU: A Framework for GPU-Based Local Search Metaheuristics. In Advances in Computational Intelligence, volume 6691, pages 401--408. 2011.
    [10]
    L. Mussi, F. Daolio, and S. Cagnoni. Evaluation of parallel particle swarm optimization algorithms within the CUDA™ architecture. Information Sciences, 181(20):4642--4657, 2011.
    [11]
    nVIDIA Corporation. nVIDIA CUDA programming guide v. 4.1, 2011.
    [12]
    nVIDIA Corporation. nVIDIA CUDA C programming - Best practices guide v. 4.1, 2012.
    [13]
    G. Pampara, A. Engelbrecht, and T. Cloete. CIlib: A collaborative framework for computational intelligence algorithms - part I. In Proc. of IEEE International Joint Conference on Neural Networks, IJCNN '08, pages 1750 --1757, 2008.
    [14]
    R. Poli. Analysis of the publications on the applications of Particle Swarm Optimisation. Journal of Artificial Evolution and Applications, pages 1--10, 2008.
    [15]
    F. J. Solis and R. J. B. Wets. Minimization by Random Search Techniques. Mathematics of Operations Research, 6(1):19--30, 1981.
    [16]
    R. Storn and K. Price. Differential Evolution- A Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Spaces. Technical report, International Computer Science Institute, 1995.
    [17]
    The Mathworks. Matlab Optimization Toolbox User's Guide. http://www.mathworks.co.uk/help/toolbox/optim.
    [18]
    R. Ugolotti, P. Mesejo, S. Cagnoni, M. Giacobini, and F. Di Cunto. Automatic Hippocampus Localization in Histological Images using PSO-Based Deformable Models. In Proc. of Genetic and Evolutionary Computation Conference, GECCO '11, pages 487--494, 2011.
    [19]
    S. Ventura, C. Romero, A. Zafra, J. Delgado, and C. Hervás-Martínez. JCLEC: A Java Framework for Evolutionary Computing. Soft Computing, 12(4):381--392, 2008.
    [20]
    S. Wagner. Heuristic Optimization Software Systems - Modeling of Heuristic Optimization Algorithms in the HeuristicLab Software Environment. PhD thesis, Institute for Formal Models and Verification, Johannes Kepler University Linz, Austria, 2009.

    Cited By

    View all
    • (2021)A comparative study of GPU metaheuristics for data clustering2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC52423.2021.9658803(1387-1392)Online publication date: 17-Oct-2021
    • (2021)Lights and shadows in Evolutionary Deep Learning: Taxonomy, critical methodological analysis, cases of study, learned lessons, recommendations and challengesInformation Fusion10.1016/j.inffus.2020.10.01467(161-194)Online publication date: Mar-2021
    • (2019)Accelerating continuous GRASP with a GPUThe Journal of Supercomputing10.1007/s11227-019-02833-6Online publication date: 3-Apr-2019
    • Show More Cited By

    Index Terms

    1. libCudaOptimize: an open source library of GPU-based metaheuristics

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        GECCO '12: Proceedings of the 14th annual conference companion on Genetic and evolutionary computation
        July 2012
        1586 pages
        ISBN:9781450311786
        DOI:10.1145/2330784
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 07 July 2012

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. CUDA
        2. GPGPU
        3. differential evolution
        4. open source library
        5. particle swarm optimization
        6. scatter search
        7. solis and wets local search

        Qualifiers

        • Research-article

        Conference

        GECCO '12
        Sponsor:
        GECCO '12: Genetic and Evolutionary Computation Conference
        July 7 - 11, 2012
        Pennsylvania, Philadelphia, USA

        Acceptance Rates

        Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)2
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 11 Aug 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2021)A comparative study of GPU metaheuristics for data clustering2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC52423.2021.9658803(1387-1392)Online publication date: 17-Oct-2021
        • (2021)Lights and shadows in Evolutionary Deep Learning: Taxonomy, critical methodological analysis, cases of study, learned lessons, recommendations and challengesInformation Fusion10.1016/j.inffus.2020.10.01467(161-194)Online publication date: Mar-2021
        • (2019)Accelerating continuous GRASP with a GPUThe Journal of Supercomputing10.1007/s11227-019-02833-6Online publication date: 3-Apr-2019
        • (2016)A Survey on GPU-Based Implementation of Swarm Intelligence AlgorithmsIEEE Transactions on Cybernetics10.1109/TCYB.2015.246026146:9(2028-2041)Online publication date: Sep-2016
        • (2016)A survey on image segmentation using metaheuristic-based deformable modelsApplied Soft Computing10.1016/j.asoc.2016.03.00444:C(1-29)Online publication date: 1-Jul-2016
        • (2015)A parallel local search in CPU/GPU for scheduling independent tasks on large heterogeneous computing systemsThe Journal of Supercomputing10.1007/s11227-014-1315-671:2(648-672)Online publication date: 1-Feb-2015
        • (2015)Using Stochastic Optimization to Improve the Detection of Small CheckerboardsAI*IA 2015 Advances in Artificial Intelligence10.1007/978-3-319-24309-2_6(75-86)Online publication date: 17-Oct-2015
        • (2014)Evolutionary image analysis and signal processingProceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation10.1145/2598394.2605359(795-818)Online publication date: 12-Jul-2014
        • (2014)The Design and Implementation of a GPU-enabled Multi-objective Tabu-search Intended for Real World and High-dimensional ApplicationsProcedia Computer Science10.1016/j.procs.2014.05.20029(2152-2161)Online publication date: 2014
        • (2014)Nature-Inspired Meta-Heuristics on Modern GPUsInternational Journal of Parallel Programming10.1007/s10766-013-0292-342:5(681-709)Online publication date: 1-Oct-2014
        • Show More Cited By

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media