Structural coherence of problem and algorithm: an analysis for EDAs on all 2-bit and 3-bit problems.

Brownlee, Alexander E.I.; McCall, John A.W.; Christie, Lee A.

Abstract

Metaheuristics assume some kind of coherence between decision and objective spaces. Estimation of Distribution algorithms approach this by constructing an explicit probabilistic model of high fitness solutions, the structure of which is intended to reflect the structure of the problem. In this context, 'structure' means the dependencies or interactions between problem variables in a probabilistic graphical model. There are many approaches to discovering these dependencies, and existing work has already shown that often these approaches discover 'unnecessary' elements of structure - that is, elements which are not needed to correctly rank solutions. This work performs an exhaustive analysis of all 2 and 3 bit problems, grouped into classes based on mononotic invariance. It is shown in [1] that each class has a minimal Walsh structure that can be used to solve the problem. We compare the structure discovered by different structure learning approaches to the minimal Walsh structure for each class, with summaries of which interactions are (in)correctly identified. Our analysis reveals a large number of symmetries that may be used to simplify problem solving. We show that negative selection can result in improved coherence between discovered and necessary structure, and conclude with some directions for a general programme of study building on this work.

Citation

BROWNLEE, A.E.I., MCCALL, J.A.W. and CHRISTIE, L.A. 2015. Structural coherence of problem and algorithm: an analysis for EDAs on all 2-bit and 3-bit problems. In Proceedings of the 2015 IEEE congress on evolutionary computation (CEC 2015), 25-28 May 2015, Sendai, Japan. Piscataway, NJ: IEEE [online], pages 2066-2073. Available from: https://doi.org/10.1109/CEC.2015.7257139

• Conference Name: 2015 IEEE congress on evolutionary computation (CEC 2015)
• Conference Location: Sendai, Japan
• Start Date: May 25, 2015
• End Date: May 28, 2015
• Acceptance Date: Feb 25, 2015
• Online Publication Date: Mar 18, 2015
• Publication Date: Sep 14, 2015
• Deposit Date: Dec 10, 2015
• Publicly Available Date: Dec 10, 2015
• Print ISSN: 1089-778X
• Publisher: Institute of Electrical and Electronics Engineers (IEEE)
• Pages: 2066-2073
• Series ISSN: 1089-778X
• ISBN: 9781479974924
• DOI: https://doi.org/10.1109/CEC.2015.7257139
• Keywords: Sociology; Statistics; Coherence; Probabilistic logic; Graphical models; Search problems; Couplings
• Public URL: http://hdl.handle.net/10059/1362