Video reasoning · Self-play · Executable environments

Tempo-Zero

Recursive Self-Play in Executable Worlds for Video Reasoning

Jingmin Zhu2 Yanyan Zou1,*,† Xiuyu Li2 James Bailey2 Dinh Phung2 Tao Yu1,3,‡ Yunyun Hou1,4,‡ Jun Liu5 Jun Zhou6 Sirui Wang1 Nan Duan1 Jiachen Liu1,† Qiuhong Ke2,†
1JD.com 2Monash University 3Institute of Automation, Chinese Academy of Sciences 4Communication University of China 5Lancaster University 6Griffith University

*Project lead†Corresponding authors‡Internship

Executing a program renders a video together with the ground-truth option and interval of every question about it. One policy proposes and answers these questions, learns from execution-grounded rewards instead of model consensus, and evolves the programs it trains on. Trained only on simple rendered programs, without supervised fine-tuning or external video data, it improves over its base models on twelve real-world video benchmarks.

01Program videos

Every training video below comes from executing one program of the library. The trace that renders the frames also records the events, so the question, its ground-truth option and the interval of the deciding event come with the video. Play a clip: the gold bands are execution intervals, and the ground-truth option lights up once the deciding event has passed.

02Method

Tempo-Zero closes a loop of executable environments, execution-verified self-play and environment evolution. A single vision-language policy plays both roles, and every label it learns from comes from program execution.

Executable environments

A program with difficulty level, rule configuration and instance parameters executes into a trace. The trace compiles into the video, the verification criteria and a canonical question. Labels are recomputed on the sampled frames, and criteria whose answer survives a reversed or permuted trace are screened out as static.

Execution-verified self-play

As the Questioner, the policy writes new questions about verified criteria. A programmatic gate checks format, option validity, task scope and answer leakage. As the Solver, it answers with timestamped evidence lines, which are scored against the execution intervals. No judge model and no majority voting enter the loop.

RS = rans + mean(revid, rgrd)
RQ = g(q) · mean(rlearn, rnov)

Environment evolution

After each round, decayed pass rates from the question bank reallocate instances across (family, task) pairs and raise or lower their difficulty levels. The policy then reads each family's statistics and selects a rule change from a menu. The executor re-executes the program to validate the change before deployment, and a fixed playback schedule lengthens the videos across rounds.

ωf,a = κ/nf + (1 − κ) · wf,a / Σa′ wf,a′

Overview of Tempo-Zero
Programs execute and compile into a video, criteria and a canonical question. One policy proposes questions as the Questioner and answers them as the Solver; the bank stores measured questions for replay, and execution-grounded rewards drive GRPO updates.

03Main results

Training uses five rounds of LoRA self-play on rendered program videos only. The final checkpoint is evaluated zero-shot on twelve real-world benchmarks. Bold marks the best result per column within each backbone, underline marks the second best at 4B and 8B, and the small numbers give the change over the base model.

Temporal grounding (%, Avg. averages the mIoU of the first three benchmarks and GQA@0.3)

BackboneMethodANet-RTLActivityNet CaptionsCharades-STANExT-GQA
mIoUR@0.3R@0.5R@0.7mIoUR@0.3R@0.5R@0.7mIoUR@0.3R@0.5R@0.7GQA@0.3GQA@0.5Avg.
Qwen3-VL-4BBase model16.8622.7015.728.7322.8630.9419.0411.2937.5258.9036.1216.2323.0915.4025.08
VisPlay16.5823.1413.978.7322.8930.9819.1211.3137.5958.8236.5916.4223.1415.3325.05
V-Zero15.8520.9613.978.3022.8130.9118.9211.3137.1058.3335.2415.6222.8215.2224.64
Video-Zero29.7544.9828.8213.5432.1244.7627.6716.2441.8565.1140.8120.0338.2923.0035.50
Tempo-Zero31.34+14.4848.03+25.3331.00+15.2813.10+4.3734.98+12.1249.35+18.4131.04+12.0017.26+5.9742.53+5.0166.29+7.3941.26+5.1419.49+3.2639.17+16.0824.50+9.1037.00+11.92
Qwen3-VL-8BBase model21.9530.5721.8310.0426.5636.5922.6312.8536.7059.1133.8713.4935.9321.8330.28
VisPlay21.8332.3120.0910.0426.7436.9422.9912.9336.6559.0333.9213.4735.8722.1930.27
V-Zero22.7732.3120.529.1726.6936.7923.0513.0036.4358.6333.6613.4135.7322.1130.40
Video-Zero26.1939.3024.4512.2329.8741.7726.2314.6637.3460.1635.5413.5839.6024.2633.25
Tempo-Zero31.22+9.2746.72+16.1528.38+6.5513.54+3.5034.16+7.6049.20+12.6130.86+8.2316.26+3.4146.10+9.4072.26+13.1549.81+15.9423.06+9.5740.39+4.4625.14+3.3137.97+7.69
Qwen3-VL-30B-A3BBase model23.4532.7523.1413.1027.9037.6523.9814.3947.3468.4451.6130.1338.8323.6334.38
Tempo-Zero34.23+10.7849.78+17.0333.62+10.4817.90+4.8036.35+8.4552.42+14.7732.95+8.9717.38+2.9948.77+1.4377.15+8.7152.96+1.3522.37−7.7645.15+6.3227.88+4.2541.12+6.74
Gemma 4 E4BBase model23.9734.9322.2710.0418.6424.9314.657.0519.0827.3913.046.0521.7210.9920.85
Tempo-Zero30.52+6.5541.48+6.5527.51+5.2415.72+5.6833.53+14.8947.52+22.5929.94+15.2915.99+8.9432.01+12.9350.97+23.5824.30+11.269.52+3.4726.40+4.6814.64+3.6530.61+9.76

Tempo-Zero improves every grounding metric over the base model at 4B and 8B and gives the best result in 26 of their 28 metrics. Training never sees a real-world interval annotation, so these gains come from localization learned on rendered videos.

Long-video understanding and video reasoning (official accuracy, %)

BackboneMethodLong-video understandingVideo reasoning
LongVideoBenchMLVUVideo-MME-LongLSDBenchLongVideoReasonMMVUVideoMathQAVideoMMMUAvg.
Qwen3-VL-4BBase model57.7062.6051.6054.6869.9064.3219.0557.5654.68
VisPlay59.2063.5053.2054.8369.6063.3618.3357.4454.93
V-Zero59.5063.5051.9054.6868.2064.4820.9558.3355.19
Video-Zero59.1063.4053.6056.5270.3064.9621.6761.5656.39
Tempo-Zero61.00+3.3067.36+4.7653.30+1.7056.06+1.3872.40+2.5066.08+1.7622.38+3.3363.11+5.5557.71+3.03
Qwen3-VL-8BBase model59.8064.4055.7057.5968.6068.3223.8163.7857.75
VisPlay60.5064.9054.9057.4468.1067.0421.4362.6757.12
V-Zero60.1064.2056.0056.9069.2068.8022.1463.2257.57
Video-Zero60.4064.6056.6056.7570.7068.0025.4864.2258.34
Tempo-Zero61.00+1.2068.51+4.1156.90+1.2058.59+1.0073.00+4.4068.48+0.1627.38+3.5764.44+0.6659.79+2.04
Qwen3-VL-30B-A3BBase model65.3770.2658.3362.5071.4072.1626.9065.1161.50
Tempo-Zero66.70+1.3371.34+1.0860.56+2.2363.96+1.4675.60+4.2073.60+1.4431.90+5.0067.44+2.3363.89+2.39
Gemma 4 E4BBase model50.7154.5146.4447.0970.6065.2830.0065.8953.81
Tempo-Zero53.40+2.6954.62+0.1148.00+1.5655.14+8.0571.10+0.5067.04+1.7629.29−0.7166.11+0.2255.59+1.78

Tempo-Zero improves over the base models on all eight benchmarks at 4B, 8B, and 30B-A3B. At 4B and 8B, where all self-play baselines are evaluated, it gives the best result in 13 of the 16 comparisons across eight benchmarks and two backbones.

04BibTeX

@misc{zhu2026tempozero,
  title  = {Tempo-Zero: Recursive Self-Play in Executable Worlds for Video Reasoning},
  author = {Zhu, Jingmin and Zou, Yanyan and Li, Xiuyu and Bailey, James and
            Phung, Dinh and Yu, Tao and Hou, Yunyun and Liu, Jun and Zhou, Jun and
            Wang, Sirui and Duan, Nan and Liu, Jiachen and Ke, Qiuhong},
  year   = {2026}
}