WZ-Plan: A Roadway Work-Zone Testbed for Autonomous Vehicle Motion Planning via Reinforcement Learning

Shuo Zhang*, Yiang Xu*, Ruide Yin*
New York University
*Equal contribution

Scenario Illustrations

Six roadway work-zone scenarios: normal work zone, curved road, urban corridor, jaywalker, high traffic density, and oncoming traffic

Abstract

Autonomous driving has made substantial progress under general driving conditions, but roadway work zones remain challenging for motion planning. Work zones temporarily change lane layouts and restrict available road space, complicating interactions with surrounding vehicles and pedestrians, while limited datasets dedicated to work-zone motion planning hinder planner training and evaluation. Simulation supports controlled training and evaluation in safety-critical scenarios, while reinforcement learning allows planners to learn from interactions with the environment. We introduce WZ-Plan, a configurable CARLA–SUMO testbed comprising a normal-traffic work zone and five safety-critical scenario families—curved work zones, constrained corridors, jaywalker encounters, dense traffic, and opposing-lane closures—and demonstrate its use with a jointly trained Proximal Policy Optimization (PPO) planner and structured scene encoder. Scenario-wise evaluation characterizes planner capabilities, failure modes, and within-town transfer limitations, illustrating WZ-Plan's value as a platform for systematic development and evaluation of work-zone motion planners.

Six Work-Zone Scenario Families

Overview of the six roadway work-zone scenarios

Fig. 1. Overview of the six roadway work-zone scenarios: (a) S1 normal work zone, (b) S2 work zone on a curved road, (c) S3 urban corridor work zone, (d) S4 work zone with a jaywalker, (e) S5 work zone with high traffic density, and (f) S6 lane closure with oncoming traffic.

Method Overview

Overview of the proposed motion-planning and training framework

Open Method Overview PDF

Fig. 2. Overview of the proposed motion-planning and training framework. (a) Structured observation modalities are encoded into a compact scene representation. (b) The PPO policy generates target-speed and target-yaw-rate commands, executed by dual PID controllers in the CARLA–SUMO closed loop. (c) Three simulation workers collect parallel rollouts using a frozen policy, merged before each synchronized PPO update.

Training Dynamics

Joint S1-S6 training across five seeds

Fig. 3. Joint S1–S6 training across five seeds. Lines and shaded bands show the mean and ±1 sample standard deviation after per-seed 20-episode smoothing and interpolation onto a common step grid.

Policy Demos

Results

Table II. Targeted S2/S6 success rates (%)

Scenario Variant Seed / Policy Val Test
S2Joint / Fixed-OD7 / P2350.001.33
S2Joint / Road-Arc7 / P3390.000.00
S6S6-only7 / P32100.000.00
S6S6-only27 / P3053.3333.33

Table III. S1345 outcomes of two joint policies (%)

Scenario Val Test Collision Off-road WZ
Seed27 / P32
S1100.0096.673.330.000.00
S340.0016.6712.670.0070.67
S466.6738.670.0061.330.00
S583.3393.330.006.670.00
Macro72.5061.334.0017.0017.67
Seed17 / P27
S196.67100.000.000.000.00
S393.3356.676.000.0037.33
S430.0014.000.0085.330.67
S516.6769.330.000.6730.00
Macro59.1760.001.5021.5017.00

Table IV. Success across five joint-training seeds (%)

Scenario Val Test
S184.00 ± 16.4066.13 ± 39.20
S368.00 ± 22.9238.67 ± 28.35
S464.67 ± 24.7951.60 ± 42.13
S541.33 ± 31.6852.53 ± 28.77
Macro64.50 ± 8.3952.23 ± 9.17

Validation uses 30 episodes per scenario; test uses 150 completed episodes per scenario (50 per origin). Collision, Off-road, and WZ are test failure rates over all completed test episodes.