Autonomous systems

Realistic Simulation for Connected Autonomous Vehicles (CAVs)

The challenge

Connected Autonomous Vehicles (CAVs) rely on vehicle networks, advanced sensor technology, and cooperative perception to improve road safety, driving comfort, and energy efficiency. However, validating these systems under real-world conditions remains a major challenge. 

Real-world data collection and physical testing are costly, time-consuming, and difficult to scale. Existing simulation frameworks are often limited to single-agent setups, static scenarios, or simplified communication models, making them unsuitable for testing complex, safety-critical traffic situations involving multiple interacting vehicles. 

As a result, the performance of CAV systems in complex scenarios remains suboptimal, and potential communication failures or safety risks are often detected too late in the development process. 

How we will help

To achieve this, XITASO extends the established single-agent Autoware framework into a scalable multi-agent simulation environment and combines it with state-of-the-art AI and network simulation technologies: 

  • AI-based generation of realistic traffic scenarios, trajectories, and maps 
  • Generation of multimodal synthetic sensor data (LiDAR, Radar, RGB-T) with realistic characteristics 
  • Integration of physical network simulators to accurately model real-world V2X communication 
  • Scenario management for reproducible and complex test cases 
  • An adaptive evaluator to iteratively reduce the Sim2Real gap 
  • A seamless interaction between simulation and AI generation enables the evaluation of autonomous driving functions under realistic and safety-critical traffic conditions. 

Technologies & topics

Connected Autonomous Vehicles (CAVs) Cooperative Intelligent Transport Systems (C-ITS) Cooperative Perception Computer Vision Deep Learning Generative AI Simulation vVSS ROS2

The research project in detail

Project goal 

The goal of this project is to develop a highly realistic virtual vehicle simulation system (vVSS) for connected and autonomous vehicles. 

The system enables efficient development, testing, and validation of autonomous driving functions under realistic traffic, sensor, and communication conditions. By shifting critical validation steps into a virtual environment, development cycles can be significantly shortened while reducing dependency on expensive physical testing. 

Value added

  • Reduced development and validation time for CAV systems 
  • Lower costs through fewer physical test drives 
  • Early detection of communication errors and safety risks 
  • More reliable assessment of autonomous driving functions 
  • Scalable and reproducible testing of complex traffic scenarios 

Innovation

Existing frameworks such as OpenCDA-ROS, V2XVerse, or AVStack provide useful foundations but fail to combine realistic sensor data, traffic scenarios, and communication models in a unified simulation environment. 

This project goes beyond the state of the art by: 

  • Using generative AI to create realistic, multimodal sensor data 
  • Incorporating physically based network simulation for V2X communication 
  • Enabling large-scale multi-agent traffic scenarios 
  • Continuously improving simulation realism through adaptive evaluation 

The result is a significantly higher level of realism and reliability in virtual testing compared to existing solutions. 

Project participants and funding

Certificate of eligibility 

BSFZ Siegel

Funding program

Research allowance

Interested in helping with our research projects?

With research and innovation projects, we explore the potential of tomorrow’s technologies. For this purpose, we are always looking for committed colleagues who would like to continue and shape the XITASO path with us.

Other projects

Are you interested in a project, a service or do you have any other question?

Hannan Keen

Dr. Hannan Ejaz Keen

Tel. +49 821 885 882 281
hannan.keen@xitaso.com