Traditional methods for black box optimization require a considerable number of evaluations of the objective function. This can be time consuming, impractical, and unfeasible for many applications in aerospace science and engineering, which rely on accurate representations and expensive models to evaluate. Bayesian Optimization (BO) methods search for the global optimum by progressively (actively) learning a surrogate model of the objective function along the search path. Bayesian optimization can be accelerated through multifidelity approaches which leverage multiple black-box approximations of the objective functions that are computationally cheaper to evaluate, but still provide relevant information to the search task. Further computational benefits are offered by the availability of parallel and distributed computing architectures whose optimal usage is an open opportunity within the context of active learning. This paper introduces the Resource Aware Active Learning (RAAL) algorithm, a multifidelity Bayesian scheme to accelerate the optimization of black box functions. At each optimization step, the RAAL procedure computes the set of best sample locations and the associated fidelity sources that maximize the information gain to acquire during the parallel/distributed evaluation of the objective function, while accounting for the limited computational budget. The scheme is demonstrated for a variety of benchmark problems and results are discussed for both single fidelity and multifidelity settings. In particular, we observe that the RAAL strategy optimally seeds multiple points at each iteration, which allows for a major speed up of the optimization task.

Resource aware multifidelity active learning for efficient optimization / Grassi, F.; Manganini, G.; Garraffa, M.; Mainini, L.. - ELETTRONICO. - (2021), pp. 1-18. ((Intervento presentato al convegno AIAA Science and Technology Forum and Exposition, AIAA SciTech Forum 2021 tenutosi a virtual event nel 19-21, January 2021 [10.2514/6.2021-0894].

Resource aware multifidelity active learning for efficient optimization

Grassi F.;Garraffa M.;Mainini L.
2021

Abstract

Traditional methods for black box optimization require a considerable number of evaluations of the objective function. This can be time consuming, impractical, and unfeasible for many applications in aerospace science and engineering, which rely on accurate representations and expensive models to evaluate. Bayesian Optimization (BO) methods search for the global optimum by progressively (actively) learning a surrogate model of the objective function along the search path. Bayesian optimization can be accelerated through multifidelity approaches which leverage multiple black-box approximations of the objective functions that are computationally cheaper to evaluate, but still provide relevant information to the search task. Further computational benefits are offered by the availability of parallel and distributed computing architectures whose optimal usage is an open opportunity within the context of active learning. This paper introduces the Resource Aware Active Learning (RAAL) algorithm, a multifidelity Bayesian scheme to accelerate the optimization of black box functions. At each optimization step, the RAAL procedure computes the set of best sample locations and the associated fidelity sources that maximize the information gain to acquire during the parallel/distributed evaluation of the objective function, while accounting for the limited computational budget. The scheme is demonstrated for a variety of benchmark problems and results are discussed for both single fidelity and multifidelity settings. In particular, we observe that the RAAL strategy optimally seeds multiple points at each iteration, which allows for a major speed up of the optimization task.
File in questo prodotto:
File Dimensione Formato  
GrassiManganiniGarraffaMainini2021_AIAASciTech2021.pdf

non disponibili

Tipologia: 2a Post-print versione editoriale / Version of Record
Licenza: Non Pubblico - Accesso privato/ristretto
Dimensione 797.15 kB
Formato Adobe PDF
797.15 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/2924104