Explaining a staff rostering genetic algorithm using sensitivity analysis and trajectory analysis.

Fyvie, Martin; Mccall, John; Christie, Lee; Brownlee, Alexander

Abstract

In the field of Explainable AI, population-based search metaheuristics are of growing interest as they become more widely used in critical applications. The ability to relate key information regarding algorithm behaviour and drivers of solution quality to an end-user is vital. This paper investigates a novel method of explanatory feature extraction based on analysis of the search trajectory and compares the results to those of sensitivity analysis using “Weighted Ranked Biased Overlap”. We apply these techniques to search trajectories generated by a genetic algorithm as it solves a staff rostering problem. We show that there is a significant overlap between these two explainability methods when identifying subsets of rostered workers whose allocations are responsible for large portions of fitness change in an optimization run. Both methods identify similar patterns in sensitivity, but our method also draws out additional information. As the search progresses, the techniques reveal how individual workers increase or decrease in the influence on the overall rostering solution’s quality. Our method also helps identify workers with a lower impact on overall solution fitness and at what stage in the search these individuals can be considered highly flexible in their roster assignment.

Citation

FYVIE, M., MCCALL, J.A.W., CHRISTIE, L.A. and BROWNLEE, A.E.I. 2023. Explaining a staff rostering genetic algorithm using sensitivity analysis and trajectory analysis. In GECCO’23 companion: proceedings of the 2023 Genetic and evolutionary computation conference companion, 15-19 July 2023, Lisbon, Portugal. New York: ACM [online], pages 1648-1656. Available from: https://doi.org/10.1145/3583133.3596353

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2023 Genetic and evolutionary computation conference companion (GECCO '23)
• Start Date: Jul 15, 2023
• End Date: Jul 19, 2023
• Acceptance Date: Mar 31, 2023
• Online Publication Date: Jul 24, 2023
• Publication Date: Jul 31, 2023
• Deposit Date: Sep 7, 2023
• Publicly Available Date: Sep 7, 2023
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Pages: 1648-1656
• Book Title: GECCO '23 companion: proceedings of the 2023 Genetic and evolutionary computation conference companion, 15-19 July 2023, Lisbon, Portugal
• ISBN: 9798400701207
• DOI: https://doi.org/10.1145/3583133.3596353
• Keywords: Evolutionary algorithms; Principal component analysis; Algorithm trajectories; Sensitivity analsysis; Expainable AI (XAI)
• Public URL: https://rgu-repository.worktribe.com/output/2023747