On the Performance Evaluation of a Collaborative Swarm Intelligence Approach Particle Bee Algorithm

UDC 57
Publication date: 27.12.2021
International Journal of Professional Science №12-2021

On the Performance Evaluation of a Collaborative Swarm Intelligence Approach Particle Bee Algorithm

Li-Chuan Lien,
Unurjargal Dolgorsuren

1. Assistant Professor, Dep. of Civil engineering, Chung Yuan Christian University, Taoyuan, Taiwan
2. Ph.D student, Dep. of Civil engineering, Chung Yuan Christian University, Taoyuan, Taiwan
Abstract: Swarm intelligence (SI), an artificial intelligence (AI) approach widely used in many complex optimization problems, models the collective behavior of social systems such as honeybees and birds. This study evaluated a collaborative swarm intelligence approach optimization algorithm, named the particle bee algorithm (PBA). The PBA is based on a particular aspect of bird (particle swarm optimization, PSO) and honeybee swarm (bee algorithm, BA) behaviors that integrates their advantages and proposes a self-parameter-updating technique to prevent being trapped into a local optimum in high dimensional problems. This study compares the performance of PBA with that of differential evolution (DE), evolutionary algorithms (EA), particle swarm optimization (PSO) and bee algorithm (BA) for multi-dimensional numeric problems. For test problems carried out in this work, colony sizes ranging from 75 to 100 of PBA can provide an acceptable convergence speed for an optimization search. Besides, elite and best bee PSO iteration sizes of (15, 9) to (30, 18) can provide an acceptable convergence speed for an optimization search. Results show PBA performance to be comparable to that of mentioned algorithms, and the potential for its being efficiently employed to solve benchmark numerical problems with high dimensionality.
Keywords: Swarm intelligence, Bee algorithm, Particle swarm optimization, Particle bee algorithm


  1. INTRODUCTION

Evolutionary algorithms (EAs), generally known as general-purpose optimization algorithms, are often used to find, within a reasonable compilation time, near-optimal solutions to numerical, real-valued test problems. Differential evolution algorithms (DEs) are one type of recently introduced EA (Price, etc. 2005). DEs have been proposed to overcome the poor local search ability of genetic algorithms (GAs) (Holland, 1975). Selection operations used represent an important difference between GAs and DEs. For GAs, the chance of being selected as a parent solution depends on the relevant solution’s fitness value (Krink, etc., 2004). In DEs, all solutions have an equal chance of being selected as parents, i.e., the chance does not depend on fitness values. After a new solution is produced using self-adjusting mutation and crossover operations, the new solution competes with its parent for the next generation, with the better one winning the competition. In other words, a greedy scheme is applied to select one of the two for the next generation. Using a mutation operation, which is able to self adapt, perform crossover operations and make selections via a greedy process, makes DEs fast-converging evolutionary algorithms (Krink, etc., 2004). This has made them the subject of significant interest by researchers from a diverse range of fields, who have applied DEs to a variety of real world problems (Price, etc., 2005; Krink, etc., 2004).

Swarm intelligence (SI) has been of increasing interest to research scientists in recent years. Swarm intelligence was defined by Bonabeau et al. as any attempt to design algorithms or distributed problem-solving devices based on the collective behavior of social insect colonies or other animals (Bonabeau, etc., 2004). Bonabeau et al. focused primarily on the social behavior of ants (Dorigo, 1992), fish (Li, 2003), birds (Kennedy, etc., 1995) and bees (Pham, etc., 2006) etc. However, the term “swarm” can be applied more generally to refer to any restrained collection of interacting agents or individuals. Although bees swarming around a hive is the classical example of “swarm”, swarms can easily be extended to other systems with similar architectures.

A few models have been developed to model the intelligent behaviors of honeybee swarms and applied to solve combinatorial type problems. Yang (2006) presented a virtual bee algorithm (VBA) that is effective when applied to function optimization problems. However, while the proposed algorithm was similar to GA, it was much more efficient due to the parallelism of multiple independent bees. VBA was tested on two functions with two parameters, single-peaked and multi-peaked, respectively. Results show the VBA as significantly more efficient than GA. Karaboga et al. (2009) presented an artificial bee colony (ABC) algorithm and expanded its experimental results (Basturk, etc., 2006). It has been pointed out that the ABC algorithm outperforms GA for functions exhibiting multi-modality or uni-modality. Pham et al. (2006) presented an original bee algorithm (BA) and applied to two standard functional optimization problems with two and six dimensions. Results demonstrated the BA able to find solutions very close to the optimum, showing that BA generally outperformed GA. Ozbakir et al. (2010) developed a modified BA (Pham, etc., 2006) to solve generalized assignment problems (GAP) that presented an ejection chain neighborhood mechanism. This study found that the proposed BA offers the potential to solve GAP. However, while BA (Pham, etc., 2006) offers the potential to conduct global searches and uses a simpler mechanism in comparison with GA, it is weak in local searching and does not records past searching experiences during the optimization search process.

For instance, a flock of birds may be thought of as a swarm whose individual agents are birds. Particle swarm optimization (PSO), which has become quite popular for many researchers recently (Tsai, 2010; Parsopoulos, etc. 2007), models the social behavior of birds (Kennedy, 1995). PSO is a population-based stochastic optimization technique that is well adapted to the optimization of nonlinear functions in multi-dimensional space. PSO consists of a swarm of particles moving in a search space of potential problem solutions. Every particle has a position vector representing a candidate solution to the problem and a velocity vector. Moreover, each particle contains a small memory that stores its own best position so far and a global best position obtained through communication with neighbor particles. PSO potentially used in local searching, and records past searching experiences during optimization search process. However, it converges early in highly discrete problems (Korenaga, etc., 2006).

Hence, in order to improve BA and PSO, Cheng (2012) and Lien (2012, 2014) proposed an optimization hybrid swarm algorithm, named the particle bee algorithm (PBA), based on intelligent behavior traits of bird and honeybee swarms. PBA has been successful applied to many case studies (Cheng and Lien, 2012; Lien and Cheng, 2012, 2014). PBA integrates their advantages and a self-parameter-updating technique to prevent becoming trapped in a local optimum in high dimensional problems. This study compares the performance of the PBA algorithm with that of DE, EA, PSO (Krink, etc., 2004) and BA (Pham, etc., 2006) for a set of well-known test functions (Krink, etc., 2004). Also, the performance of PBA is analyzed under conditions in which control parameter values change. In Section 2 and 3, bee algorithm (BA) and particle swarm optimization (PSO) are described and then the particle bee algorithm (PBA) is introduced in Section 4. In Section 5, the experimental study is described. Obtained simulation results are presented and discussed in Section 6.

Подробнее…

References

1. Basturk B. and Karaboga D., “An Artificial Bee Colony (ABC) Algorithm for Numeric Function Optimization,” IEEE Swarm Intelligence Symposium 2006, Indianapolis, Indiana, USA (2006).
2. Bonabeau E., Dorigo M., and Theraulaz G., Swarm Intelligence: From Natural to Artificial Intelligence, Oxford University Press, New York (1999).
3. Cheng M.Y. and Lien L.C., “A Hybrid AI-based Particle Bee Algorithm (PBA) for Benchmark Functions and Facility Layout Optimization,” Journal of Computing in Civil Engineering, Vol.26, No.5, pp.612-624 (2012).
4. Dorigo, M., “Optimization, Learning and Natural Algorithms,” Ph.D. Thesis, Politecnico di Milano, Italy (1992).
5. Eberhart, R., Shi Y., and Kennedy J., Swarm Intelligence. Morgan Kaufmann, San Francisco (2001).
6. Holland J.H., Adaptation in Natural and Artificial Systems, University of Michigan Press, Ann Arbor, MI (1975).
7. Karaboga D. and Akay B., “A comparative study of Artificial Bee Colony algorithm,” Applied Mathematics and Computation, Vol.214, pp.108-132 (2009).
8. Kennedy J. and Eberhart R.C., “Particle swarm optimization,” In Proceedings of the 1995 IEEE International Conference on Neural Networks, Vol.4, pp.1942-1948 (1995).
9. Korenaga T., Hatanaka T. and Uosaki K., “Improvement of Particle Swarm Optimization for High-Dimensional Space,” 2006 SICE-ICASE International Joint Conference (2006).
10. Krink T., Filipic B., Fogel G.B. and Thomsen R., “Noisy optimization problems—a particular challenge for differential evolution?,” Proceedings of 2004 Congress on Evolutionary Computation, IEEE Press, Piscataway, NJ, pp.332-339 (2004).
11. Li, X. L., “A new intelligent optimization-artificial fish swarm algorithm,” Ph.D. Thesis, Zhejiang University of Zhejiang, China (2003).
12. Lien L.C. and Cheng M.Y., “A hybrid swarm intelligence based particle-bee algorithm for construction site layout optimization,” Expert Systems with Applications, Vol.39, No.10, pp.9642-9650 (2012).
13. Lien L.C. and Cheng M.Y., “Particle Bee Algorithm for Tower Cranes Layout with Materials Quantity Supply and Demand Optimization,” Automation in Construction, Vol.45, No.9, pp.25-32 (2014).
14. Ozbakir L., Baykasog A. and Tapkan P., “Bees algorithm for generalized assignment problem,” Applied Mathematics and Computation, Vol.215, pp. 3782-3795 (2010).
15. Parsopoulos, K. E., & Vrahatis, M. N., “Parameter selection and adaptation in unified particle swarm optimization,” Mathematical and Computer Modeling, Vol.46, No.1, pp.198-213 (2007).
16. Pham D.T., Koc E., Ghanbarzadeh A., Otri S., Rahim S. and Zaidi M., “The bees algorithm - a novel tool for complex optimization problems,” In Proceedings of the Second International Virtual Conference on Intelligent Production Machines and Systems, pp.454-461 (2006).
17. Price K.V., Storn R.M. and Lampinen J.A. (Eds.), Differential Evolution: A Practical Approach to Global Optimization, Springer Natural Computing Series (2005).
18. Tsai H. C., “Predicting strengths of concrete-type specimens using hybrid multilayer perceptions with center-unified particle swarm optimization,” Expert Systems with Applications, Vol.37, pp.1104-1112 (2010).
19. Yang X.S., “Engineering Optimizations via Nature-Inspired Virtual Bee Algorithms,” Lecture Notes in Computer Science, Vol.3562, pp.317-323 (2005).