Skip to content

Research at St Andrews

Analysis of algorithm components and parameters: some case studies

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Author(s)

Nguyen Dang, Patrick De Causmaecker

School/Research organisations

Abstract

Modern high-performing algorithms are usually highly parameterised, and can be configured either manually or by an automatic algorithm configurator. The algorithm performance dataset obtained after the configuration step can be used to gain insights into how different algorithm parameters influence algorithm performance. This can be done by a number of analysis methods that exploit the idea of learning prediction models from an algorithm performance dataset and then using them for the data analysis on the importance of variables. In this paper, we demonstrate the complementary usage of three methods along this line, namely forward selection, fANOVA and ablation analysis with surrogates on three case studies, each of which represents some special situations that the analyses can fall into. By these examples, we illustrate how to interpret analysis results and discuss the advantage of combining different analysis methods.
Close

Details

Original languageEnglish
Title of host publicationLearning and Intelligent Optimization
Subtitle of host publication12th International Conference, LION 12, Kalamata, Greece, June 10–15, 2018, Revised Selected Papers
EditorsRoberto Battiti, Mauro Brunato, Ilias Kotsireas, Panos M. Pardalos
Place of PublicationCham
PublisherSpringer
Pages288-303
ISBN (Electronic)9783030053482
ISBN (Print)9783030053475
DOIs
Publication statusPublished - 2018
EventLearning and Intelligent Optimization Conference (LION 12) - Elite City Resort, Kalamata, Greece
Duration: 10 Jun 201815 Jun 2018
Conference number: 12
http://www.caopt.com/LION12/

Publication series

NameLecture Notes in Computer Science (Theoretical Computer Science and General Issues)
PublisherSpringer
Volume11353
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceLearning and Intelligent Optimization Conference (LION 12)
Abbreviated titleLION
CountryGreece
CityKalamata
Period10/06/1815/06/18
Internet address

    Research areas

  • Forward selection, fANOVA, Ablation analysis with surrogates, Parameter analysis

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Discriminating instance generation from abstract specifications: a case study with CP and MIP

    Akgün, Ö., Dang, N., Miguel, I., Salamon, A. Z., Spracklen, P. & Stone, C., 2020, Integration of Constraint Programming, Artificial Intelligence, and Operations Research: 17th International Conference, CPAIOR 2020, Vienna, Austria, September 21–24, 2020, Proceedings. Hebrard, E. & Musliu, N. (eds.). Cham: Springer, p. 41-51 11 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 12296 LNCS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  2. A combined approach for analysing heuristic algorithms

    Jeroen Corstjens, Dang, N., Depaire, B., Caris, A. & De Causmaeckers, P., 1 Oct 2019, In: Journal of Heuristics. 25, 10, p. 591–628 38 p.

    Research output: Contribution to journalArticlepeer-review

  3. Athanor: high-level local search over abstract constraint specifications in Essence

    Attieh, S., Dang, N., Jefferson, C., Miguel, I. & Nightingale, P., 10 Aug 2019, Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19). Kraus, S. (ed.). International Joint Conferences on Artificial Intelligence, p. 1056-1063 8 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  4. Hyper-parameter tuning for the (1+ (λ, λ)) GA

    Dang, N. & Doerr, C., 13 Jul 2019, Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '19). New York: ACM, p. 889-897 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  5. Automatic streamlining for constrained optimisation

    Spracklen, P., Dang, N., Akgun, O. & Miguel, I. J., 2019, Principles and Practice of Constraint Programming: 25th International Conference, CP 2019, Stamford, CT, USA, September 30 – October 4, 2019, Proceedings. Schiex, T. & de Givry, S. (eds.). Cham: Springer, p. 366-383 18 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 11802 LNCS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

ID: 258271693

Top