Validating Connected and Autonomous Vehicle (CAV) algorithms requires diverse, realistic traffic scenarios that traditional simulators cannot provide. For this reason, in this work, we present TRACE (TRaffic Autoregressive sCene gEneration), a text-conditioned framework for multi-agent traffic scene generation that addresses this limitation through two contributions. First, we propose an automated annotation pipeline that processes driving scenarios from the Waymo Open Motion Dataset (WOMD) using the Large Language Model Meta AI (LLaMA) 3.2 3B, a compact open-source language model, to generate natural language descriptions without reliance on proprietary APIs. The pipeline, which is fully reproducible on consumer hardware, produces a large-scale, text-annotated dataset. Secondly, we introduce an autoregressive transformer that populates map scenes with heterogeneous traffic participants conditioned on natural language textual prompts. Evaluated on the full Waymo validation set (40,075 scenes), TRACE achieves a 99.6% cardinality exact-match rate, 89.4% entity-type accuracy, and a maximum per-sector spatial deviation of 4 percentage points. Failure modes are traced to distributional bias in the training data, with targeted augmentation identified as a direction for future work.

TRACE - TRaffic Autoregressive sCene gEneration / Perrone, G., Rapelli, M., Casetti, C.. - (In corso di stampa). (2026 IEEE 104th Vehicular Technology Conference (VTC2026-Fall) Boston, MA (USA) 6-9 September 2026).

TRACE - TRaffic Autoregressive sCene gEneration

Perrone, Giuseppe;Rapelli, Marco;Casetti, Claudio
In corso di stampa

Abstract

Validating Connected and Autonomous Vehicle (CAV) algorithms requires diverse, realistic traffic scenarios that traditional simulators cannot provide. For this reason, in this work, we present TRACE (TRaffic Autoregressive sCene gEneration), a text-conditioned framework for multi-agent traffic scene generation that addresses this limitation through two contributions. First, we propose an automated annotation pipeline that processes driving scenarios from the Waymo Open Motion Dataset (WOMD) using the Large Language Model Meta AI (LLaMA) 3.2 3B, a compact open-source language model, to generate natural language descriptions without reliance on proprietary APIs. The pipeline, which is fully reproducible on consumer hardware, produces a large-scale, text-annotated dataset. Secondly, we introduce an autoregressive transformer that populates map scenes with heterogeneous traffic participants conditioned on natural language textual prompts. Evaluated on the full Waymo validation set (40,075 scenes), TRACE achieves a 99.6% cardinality exact-match rate, 89.4% entity-type accuracy, and a maximum per-sector spatial deviation of 4 percentage points. Failure modes are traced to distributional bias in the training data, with targeted augmentation identified as a direction for future work.
In corso di stampa
File in questo prodotto:
File Dimensione Formato  
TRACE-TRafficAutoregressivesCenegEneration.pdf

accesso aperto

Tipologia: 2. Post-print / Author's Accepted Manuscript
Licenza: Pubblico - Tutti i diritti riservati
Dimensione 1.3 MB
Formato Adobe PDF
1.3 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/3016324