Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Welcome to the InfoSci Platform
Reference Hub5
Comparing Spark with MapReduce: Glowworm Swarm Optimization Applied to Multimodal Functions

Comparing Spark with MapReduce: Glowworm Swarm Optimization Applied to Multimodal Functions

Goutham Miryala, Simone A. Ludwig
Copyright: © 2018 |Volume: 9 |Issue: 3 |Pages: 22
ISSN: 1947-9263|EISSN: 1947-9271|EISBN13: 9781522544869|DOI: 10.4018/IJSIR.2018070101
Cite Article Cite Article

MLA

Miryala, Goutham, and Simone A. Ludwig. "Comparing Spark with MapReduce: Glowworm Swarm Optimization Applied to Multimodal Functions." IJSIR vol.9, no.3 2018: pp.1-22. http://doi.org/10.4018/IJSIR.2018070101

APA

Miryala, G. & Ludwig, S. A. (2018). Comparing Spark with MapReduce: Glowworm Swarm Optimization Applied to Multimodal Functions. International Journal of Swarm Intelligence Research (IJSIR), 9(3), 1-22. http://doi.org/10.4018/IJSIR.2018070101

Chicago

Miryala, Goutham, and Simone A. Ludwig. "Comparing Spark with MapReduce: Glowworm Swarm Optimization Applied to Multimodal Functions," International Journal of Swarm Intelligence Research (IJSIR) 9, no.3: 1-22. http://doi.org/10.4018/IJSIR.2018070101

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Glowworm swarm optimization (GSO) is one of the optimization techniques, which need to be parallelized in order to evaluate large problems with high-dimensional function spaces. There are various issues involved in the parallelization of any algorithm such as efficient communication among nodes in a cluster, load balancing, automatic node failure recovery, and scalability of nodes at runtime. In this article, the authors have implemented the GSO algorithm with the Apache Spark framework. Even though we need to address how to distribute the data in the cluster to improve the efficiency of algorithm, the Spark framework is designed in such a way that one does not need to deal with any actual underlying parallelization details. For the experimentation, two multimodal benchmark functions were used to evaluate the Spark-GSO algorithm with various sizes of dimensionality. The authors evaluate the optimization results of the two evaluation functions as well as they will compare the Spark results with the ones obtained using a previously implemented MapReduce-based GSO algorithm.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.