Uma Proposta Estatística para Suporte de Comparações de Desempenho entre Diferentes Projetos de Algoritmos Evolucionários (A Statistical Scheme to Support Performance Comparisons between Different Designs of Evolutionary Algorithms)

Hugo Xavier Rocha (, Igor Santos Peretta (, Gerson Flavio Mendes de Lima (, Ricardo Soares Bôaventura (, Leonardo Garcia Marques (, Keiji Yamanaka (

1Instituto Federal de Goiás, Itumbiara, GO
2Universidade Federal de Uberlândia, Uberlândia, MG
3Instituto Federal do Triangulo Mineiro, Uberlândia, MG

This paper appears in: Revista IEEE América Latina

Publication Date: Jan. 2016
Volume: 14,   Issue: 1 
ISSN: 1548-0992

Evolutionary algorithms are stochastic heuristics which can optimize over special functions, known as fitness functions, by manipulating the structure (genotype) of candidate solutions known as individuals. Because of its stochastic nature, this class of algorithms is expected to have different performances when dealing with the same problem, depending on random initial conditions and random decisions taken during execution time, even when converging to proximal solutions. Also, other important factor to a better performance relies on proper designs of the algorithm's steps, its genetic operators, individual representation and the fitness function itself. This work proposes a statistical approach to enable performance comparisons between different evolutionary algorithm designs to the same problem. To help with the design decision process, the statistical hypothesis test for difference of means is performed in order to achieve decision matrices. The concept of Pareto's “statistical dominance” (defined in this work) is useful to point out which variation of design is more appropriated for the problem in question. A case study is presented in this work, an application for computer automated exterior lighting design. It has some concurrent objectives to be optimized: four possible metrics to illumination quality and two possible metrics for energy efficiency. The present statistical scheme was successful in indicating a more appropriate formulation for the multi-objective fitness function in need.

Index Terms:
Performance Comparison, Hypothesis Test for Difference of Means, Pareto’s Statistical Dominance, Evolutionary Algorithms, Fitness Function Formulation   

Documents that cite this document
This function is not implemented yet.

[PDF Full-Text (413)]