05/25/2026
Guillaume Gagné-Labelle, Gabriel Sasseville, and Nicolas Bosteels from the Mila Institute in Montreal, Canada, explore how computation delays affect reinforcement learning performance in Duckiematrix autonomous driving tasks.
Using Soft Actor-Critic models in Duckietown simulation, the team compares classical RL policies with action-conditioned Real-Time RL approaches under fixed and variable latency conditions, evaluating their impact on reward stability, policy performance, and episode length.
The project highlights how real-time constraints can influence autonomous driving behavior and policy robustness in embodied AI systems.
Learn more: https://hubs.la/Q04hNLqQ0