|
SafeAuto: Knowledge‑Enhanced Safe Autonomous Driving With Multimodal Foundation Models
Jiawei Zhang, Xuan Yang, Taiqi Wang, Yu Yao, Aleksandr Petiushko, Bo Li.
ICML, 2025
- We propose SafeAuto, a framework that enhances MLLMs for autonomous driving with three key contributions: a PDCE loss that maintains the autoregressive nature of MLLMs while mimicking MSE loss during training, the use of Markov Logic Networks (MLN) to encode domain knowledge and traffic rules, and a method for retrieving similar driving experiences using video data, control signals, and MLN-based environmental predicates.
|