The quest for Artificial General Intelligence (AGI) has been recently revived among scholars, practitioners, and entrepreneurs, with the publication of a set of benchmarks called Abstraction and Reasoning Corpus (ARC). It could be pointed out that the few-shot abstraction capabilities required by it represent only a tiny subset of broad human-level intelligence, yet the focus of researchers and companies quickly shifted from achieving AGI to achieving a good score on ARC. In this text, reversing Goodhart's adage, we think that having focused on the metric rather than on the original target was highly beneficial: While AGI is still a chimera, we explain how ARC benchmarks could be practically solved through concept composition and program synthesis --- both of which can be realized by leveraging evolutionary computation. We show how existing theories and frameworks from cognitive psychology and linguistics help researchers evolving task-specific graph-based data structures, eventually making Genetic Programming (GP) a fundamental player in the quest. We present promising results with a working prototype, already able to solve one third of the problems in ARC-AGI-1 running on a single workstation.

GP and the Quest for AGI - When Goodhart's Law Turned Out to Be Useful / Favole, L., Meak, G., Mongardi, G., Squillero, G., Tonda, A. - In: Genetic Programming Theory and Practice XXIII / Fabricio Olivetti de Franca; Stephen Kelly; Bogdan Burlacu; Wolfgang Banzhaf. - STAMPA. - [s.l] : Springer, In corso di stampa. - pp. 1-20

GP and the Quest for AGI - When Goodhart's Law Turned Out to Be Useful

Luca Favole;Guido Meak;Giorgio Mongardi;Giovanni Squillero;Alberto Tonda
In corso di stampa

Abstract

The quest for Artificial General Intelligence (AGI) has been recently revived among scholars, practitioners, and entrepreneurs, with the publication of a set of benchmarks called Abstraction and Reasoning Corpus (ARC). It could be pointed out that the few-shot abstraction capabilities required by it represent only a tiny subset of broad human-level intelligence, yet the focus of researchers and companies quickly shifted from achieving AGI to achieving a good score on ARC. In this text, reversing Goodhart's adage, we think that having focused on the metric rather than on the original target was highly beneficial: While AGI is still a chimera, we explain how ARC benchmarks could be practically solved through concept composition and program synthesis --- both of which can be realized by leveraging evolutionary computation. We show how existing theories and frameworks from cognitive psychology and linguistics help researchers evolving task-specific graph-based data structures, eventually making Genetic Programming (GP) a fundamental player in the quest. We present promising results with a working prototype, already able to solve one third of the problems in ARC-AGI-1 running on a single workstation.
In corso di stampa
Genetic Programming Theory and Practice XXIII
File in questo prodotto:
File Dimensione Formato  
squillero.pdf

accesso riservato

Tipologia: 2. Post-print / Author's Accepted Manuscript
Licenza: Non Pubblico - Accesso privato/ristretto
Dimensione 259 kB
Formato Adobe PDF
259 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/3017451