Towards explainable metaheuristics: feature mining of search trajectories through principal component projection.

Fyvie, Martin; McCall, John A. W.; Christie, Lee A.

Abstract

While population-based metaheuristics have proven useful for refining and improving explainable AI systems, they are seldom the focus of explanatory approaches themselves. This stems from their inherently stochastic, population-driven searches, which complicate the use of standard explainability techniques. In this paper, we present a method to identify which decision variables have the greatest impact during an algorithm's trajectory from random initialization to convergence. We apply Principal Component Analysis to project each population onto a lower-dimensional space, then introduce two metrics—Mean Variable Contribution and Proportion of Aligned Variables—to identify the variables most responsible for guiding the search. Using four different population-based methods (Particle Swarm Optimisation, Genetic Algorithm, Differential Evolution, and Covariance Matrix Adaptation Evolution Strategy) on 24 BBOB benchmark functions in 10 dimensions, we find that these metrics highlight meaningful variable relationships and provide a window into each method's search dynamics. By comparing the features extracted across algorithms and problems, we illustrate how certain variable subsets consistently drive major improvements in solution quality. In doing so, new evolutionary algorithm variants can be designed to take advantage of these influential variables, while also identifying underutilised variables that may benefit alternative search strategies.

Citation

FYVIE, M., MCCALL, J.A.W. and CHRISTIE, L.A. 2005. Towards explainable metaheuristics: feature mining of search trajectories through principal component projection. ACM transactions on evolutionary learning and optimization [online], Just Accepted. Available from: https://doi.org/10.1145/3731456

• Journal Article Type: Article
• Acceptance Date: Mar 31, 2025
• Online Publication Date: Apr 23, 2025
• Deposit Date: May 16, 2025
• Publicly Available Date: May 16, 2025
• Journal: ACM transactions on evolutionary learning and optimization
• Print ISSN: 2688-299X
• Electronic ISSN: 2688-3007
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• DOI: https://doi.org/10.1145/3731456
• Keywords: Evolutionary algorithms; Principal component analysis; Algorithm trajectories; Visualisation; Population diversity
• Public URL: https://rgu-repository.worktribe.com/output/2801809