1. Real-world context: Training high-quality vision-language models (VLMs) requires large-scale datasets with visual question answering and grounding (VQA-G) annotations, which pair textual questions with answers and precise spatial localization. Manual annotation is prohibitively expensive and unscalable. Automated methods using VLMs suffer from hallucinations and inconsistent quality.

2. Task definition: Given an input image $I \in \mathbb{R}^{H \times W \times 3}$, generate a VQA-G annotation consisting of:
   1. a question-answer pair $(q, a)$
   2. an object mention $m$ that grounds the answer in visual content, and
   3. a bounding box $b \in \mathbb{R}^4$ localizing the mentioned object. The formal objective is to maximize consistency score:
   \[S_t = w_{vqa} \cdot S^{vqa}_t + w_{vg} \cdot S^{vg}_t\]

   where $S^{vqa}_t$ and $S^{vg}_t$ are VQA and visual grounding consistency scores respectively.

3. Evaluation criteria: VQA quality measured via VQAScore, TIFA, and CLIP-Score. Visual grounding accuracy measured via mean Intersection over Union (mIoU) and Accuracy@0.5IoU against human annotations. Final VQA-G score averages VQA and grounding metrics.

4. Experiments conducted on 10,000 images from Visual7W tellingQA subset and VizWiz-VQA-G datasets. Human re-annotation of 6,000 samples (500 per method/dataset) enables objective grounding evaluation.

1. Caption Reasoning module generates structured semantic context using conditional probability: $CR \sim p(c

   I, R^{(t)}_{cap}; \theta_{cap})$

2. VQA Generation module creates question-answer pairs: $(q_t, a_t) \sim p(q, a

   I, CR, R^{(t)}_{vqa}; \theta_{vqa})$

3. VG Generation module performs two-stage object grounding: mention generation $m_t \sim p(m

   I, q_t, a_t, R^{(t)}_{vg}; \theta_{vg})$ and spatial localization $b_t = \arg\max_{b \in B} p(b

   I, m_t; \theta_{ground})$

4. Chain-of-Thought Consistency Evaluation module uses specialized verifiers $E_{vqa}$ and $E_{vg}$ to assess draft quality through step-wise reasoning with scores $s^{vqa}_i, s^{vg}_i \in [0,1]$

5. Memory-augmented Prompt Optimization agent maintains historical memory $H^{(t)} = {(D_i, C_i, R^{(i)})}^t_{i=0}$ and generates refinements: $z_t \sim p(z

   R^{(t)}, D_t, C_t, H^{(t-1)}; \phi)$

6. Core technical contribution: Iterative generate-evaluate-refine loop with CoT-based verification replacing brittle heuristics, and memory-augmented prompt optimization preventing cyclic updates

1. Framework is training-free, using pre-trained components without additional optimization

2. Generation uses MiniCPM-o 2.6 (8B parameters) and GroundingDINO for localization, running locally on 4x RTX 4090 GPUs

3. CoT verifier uses Qwen2.5-VL 72B accessed via API

4. Prompt optimizer uses DeepSeek V3 accessed via API

5. Hyperparameters: consistency threshold τ = 0.9, weights w_vqa = 0.7, w_vg = 0.3, maximum 5 iterations per sample

6. No reported training times as framework uses inference-only pre-trained models

Step 1 — Prior work:

• VQ²A (2022): Generated VQA pairs from image captions but lacked grounding consistency
• Visual instruction tuning papers (LLaVA 2023): Created large-scale instruction data but used single-pass generation prone to hallucinations
• Recent CoT grounding works (2024-2025): Applied chain-of-thought to visual grounding but without iterative refinement

Step 2 — Delta: This paper adds:

1. iterative generate-evaluate-refine loop instead of single-pass generation
2. CoT-based consistency verification replacing heuristic checks

3. memory-augmented prompt optimization preventing cyclic updates

   Step 3 — Applied-specific assessment:

   • Architectural idea: Iterative refinement with CoT verification is established in LLMs but novel application to VQA-G annotation
   • Benchmark gains: Substantial improvements in grounding metrics (mIoU 0.634 vs 0.455 for GPT-4o baseline), but VQA scores are competitive rather than superior
   • Fair comparisons: Uses same external grounding tool as GPT-4o baseline, evaluation includes human re-annotation
   • Scale dependency: Framework elevates smaller 8B model to match larger models, suggesting gains aren’t purely scale-dependent

   Verdict: INCREMENTAL — solid application of known iterative refinement techniques to VQA-G annotation with meaningful quality improvements, but core ideas are established.

1. Visual7W: VQAScore 0.896 vs GPT-4o 0.923, mIoU 0.634 vs 0.455, Acc@0.5IoU 0.720 vs 0.510, overall VQA-G score 0.747 vs 0.669

2. VizWiz: VQAScore 0.874 vs GPT-4o 0.907, mIoU 0.649 vs 0.472, Acc@0.5IoU 0.680 vs 0.525, overall VQA-G score 0.737 vs 0.667

3. TIFA scores: Visual7W 0.819 vs GPT-4o 0.908, VizWiz 0.800 vs 0.849

4. CLIP-Score: Visual7W 0.735 vs GPT-4o 0.738, VizWiz 0.757 vs 0.754

5. Results show strong grounding improvements but mixed VQA performance - AutoVQA-G excels in spatial localization but sometimes trails in pure VQA metrics

6. Notably absent: No evaluation on more challenging datasets like GQA or VG-VQA, limited to 10K samples total

1. Model size: Uses MiniCPM-o 2.6 (8B parameters) for generation, Qwen2.5-VL 72B for verification, DeepSeek V3 for optimization

2. Training compute: Zero training - inference-only framework using pre-trained models

3. Inference speed/latency: Averages 1.62-2.15 iterations per success, 2.1-3.1K tokens per successful annotation

4. Memory footprint: Runs generation locally on 4x RTX 4090 GPUs, verification/optimization via API

5. Deployment practicality: Success rates 89-92%, but computational overhead from iterative process limits scalability compared to single-pass methods

1. Evaluated on real-world datasets: Visual7W (natural images) and VizWiz (images from visually impaired users)

2. Human validation study: 10 annotators re-annotated 6,000 samples to provide ground truth for objective evaluation

3. No deployment results or production integration reported

4. No sim-to-real experiments as this is a data annotation framework

5. Framework designed for dataset creation rather than direct real-world deployment - applicability depends on downstream VLM training effectiveness

1. ENGINEERING: Computational overhead from iterative process (1.6-2.1 iterations average) limits scalability compared to single-pass methods

2. EVALUATION: Limited evaluation to 10K samples across 2 datasets - lacks evaluation on more challenging benchmarks like GQA

3. ENGINEERING: Dependence on external API calls for verification and optimization introduces latency and cost concerns

4. FUNDAMENTAL: Framework quality bounded by capabilities of underlying VLMs - cannot generate knowledge beyond pre-trained models

5. EVALUATION: No analysis of downstream VLM training effectiveness using generated data

6. Failure modes: May produce high-consistency but factually incorrect annotations if all components exhibit systematic biases; iterative process may converge to local optima rather than global quality improvements

The task addresses efficient long video understanding for Multimodal Large Language Models (MLLMs), which face prohibitive computational costs when processing dense frame sequences spanning minutes to hours. Processing thousands of frames is infeasible due to token limitations, forcing models to rely on sparsely sampled keyframe subsets.

The input is a long video V with T frames and a textual query q. The output is a selected subset of K keyframes that maximize relevance to the query for downstream video QA. The objective is to select frames that minimize information loss while respecting computational constraints:

where F is the selected frame subset.

Success is measured by downstream video QA accuracy on benchmarks like LongVideoBench and Video-MME. The key metrics are accuracy percentages across different video length categories (Short <3min, Medium 3-15min, Long 15-60min).

The evaluation uses LongVideoBench (videos up to 60 minutes) and Video-MME datasets, both providing synchronized multimodal data with subtitles for narrative reasoning tasks.

1. Multi-Granularity Scoring: Three parallel expert streams compute time-aligned relevance scores: Visual Grounding (Sg) uses YOLO-World for object-level verification, Global Matching (Sm) uses BLIP-2 for semantic similarity via cosine distance, and Contextual Alignment (Sc) uses Sentence-BERT for subtitle-query similarity.

2. Unified Normalization: Raw scores undergo min-max scaling followed by Masked Temperature Softmax to create comparable distributions:

   \[S_i(t) = \begin{cases} \frac{\exp(S_{scaled}^i(t)/\tau)}{\sum_{j:S_{raw}^i(j)>0} \exp(S_{scaled}^i(j)/\tau)} & \text{if } S_{raw}^i(t) > 0 \\ 0 & \text{otherwise} \end{cases}\]

3. Query-Modulated Gating: An LLM (GPT-4o) analyzes query intent to produce dynamic weights W(q) = [wg(q), wm(q), wc(q)] where Σwi = 1.

4. Score Fusion: Final relevance scores combine weighted expert outputs:

   \[S_{final}(t) = \sum_{i \in \{g,m,c\}} w_i(q) \cdot S_i(t)\]

5. Top-K Sampling: Select frames with highest final scores, formatted with timestamps for temporal alignment.

1. Training-free approach: Q-Gate requires no training and operates as a plug-and-play module using pre-trained components.

2. Component models: YOLO-World for visual grounding, BLIP-2 for global matching, Sentence-BERT for contextual alignment, GPT-4o for query analysis.

3. Implementation: Temperature τ = 0.5 for softmax sharpening, frame budget K = 8 or K = 32 for experiments.

4. Hardware and timing: Not reported for the routing module itself, as it operates via API calls to pre-trained models.

5. No optimization stages since the method is entirely inference-based using frozen pre-trained models.

Prior work includes: AKS (2025) which uses global image-text matching with adaptive partitioning for keyframe selection; VSLS (2025) which performs logic-based verification using object detection between frames; and T* (2025) which treats temporal search as iterative spatial search.

Delta: This paper introduces dynamic modality routing for keyframe selection, treating it as a zero-shot Mixture-of-Experts problem where an LLM acts as a gating network to allocate attention across three complementary streams based on query intent.

Applied-specific assessment:

• The architectural idea of query-modulated gating is a reasonable extension of MoE concepts to multimodal retrieval, but not fundamentally novel
• Benchmark gains are modest (+1-6% over baselines) and within expected improvement margins for better engineering
• Comparisons appear fair using same backbones and evaluation protocols
• The approach relies heavily on strong LLM reasoning (GPT-4o) which may not generalize to weaker models

The core insight about “modal noise” from static fusion is valid, but the solution is essentially weighted combination with LLM-based weight prediction.

Verdict: INCREMENTAL — solid engineering improvement over static fusion baselines, but represents expected extension of existing MoE routing concepts rather than breakthrough innovation.

1. LongVideoBench Long (15-60min): Q-Gate achieves 59.40% vs AKS* 57.80% (+1.60% improvement with Qwen3-VL, K=32)

2. LongVideoBench Medium (3-15min): Q-Gate achieves 63.11% vs AKS* 65.29% (-2.18% with Qwen3-VL, K=32)

3. LongVideoBench Short (<3min): Q-Gate achieves 70.59% vs Uniform 71.76% (-1.17% with Qwen3-VL, K=32)

4. Video-MME Long (>30min): Q-Gate achieves 61.19% vs AKS* 54.79% (+6.40% with Qwen3-VL, K=32)

5. Video-MME Medium (4-30min): Q-Gate achieves 66.13% vs AKS* 62.90% (+3.23% with Qwen3-VL, K=32)

6. Video-MME Short (<2min): Q-Gate achieves 79.41% vs AKS* 75.68% (+3.73% with Qwen3-VL, K=32)

   Results are mixed - strong gains on long videos but sometimes underperforms on short videos. Performance varies significantly between GPT-4o and Qwen3-VL backbones.

1. Model size: Uses pre-trained components (YOLO-World, BLIP-2, Sentence-BERT, GPT-4o) - total parameters not specified but includes large models

2. Training compute: Zero training compute required as method is entirely inference-based

3. Inference speed: Adds 1.35% latency overhead compared to strongest baseline, with end-to-end processing time around 1853 minutes on test videos

4. Memory footprint: Not reported, but requires loading multiple pre-trained models simultaneously

5. Deployment practicality: Requires API access to GPT-4o for optimal performance, though shows Qwen3-VL can substitute with minor degradation. The plug-and-play nature makes integration straightforward.

1. Evaluation limited to curated benchmarks (LongVideoBench, Video-MME) with high-quality subtitle alignment - no real-world deployment reported

2. No hardware experiments on actual video processing systems or production environments mentioned

3. No sim-to-real discussion as this is a video understanding task

4. Method depends on availability of subtitle/transcript data, limiting applicability to videos without such annotations

5. API dependency on GPT-4o may pose practical constraints for deployment in resource-constrained or privacy-sensitive environments

1. FUNDAMENTAL: Requires high-quality subtitle alignment - fails on videos without transcripts or with poor synchronization

2. FUNDAMENTAL: Performance heavily dependent on LLM reasoning quality - degradation with weaker models like Qwen3-VL

3. ENGINEERING: API dependency on proprietary models creates deployment friction and cost considerations

4. EVALUATION: Limited to benchmarks with curated subtitle data - unclear performance on raw video data

5. EVALUATION: Mixed results across video lengths suggest method may not generalize uniformly

   Failure modes:

6. Visual-only queries where subtitle noise dominates despite gating mechanism
7. Complex reasoning requiring temporal understanding beyond simple frame selection

This paper addresses the lack of explicit reasoning capabilities in Large Audio-Language Models (LALMs), which typically operate as perception-and-answer systems. While current models can understand audio content, they struggle with complex acoustic inference tasks requiring step-by-step reasoning chains.

The task involves training LALMs to generate coherent chain-of-thought (CoT) reasoning for audio understanding questions. Input consists of audio samples (speech, music, sound events) paired with multiple-choice questions. Output includes both a structured reasoning chain enclosed in <reasoning> tags and a final answer selection. The formal objective maximizes reward:

where $R$ combines correctness, format compliance, consistency, and reasoning quality rewards.

Success is measured by accuracy on multiple benchmarks (MMAR, MMAU, MMSU) plus reasoning quality via Rubrics scores that evaluate logical coherence and completeness of generated reasoning chains.

The paper introduces datasets D1 (39,412 AVQA samples) and D2 (29,483 samples from diverse audio sources) with automatically generated CoT annotations through a three-step pipeline: audio captioning, QA generation, and CoT generation.

1. Base model: Qwen3-Omni-30B-A3B-Instruct with mixture-of-experts architecture (30B total parameters, 3B active per token, 48 transformer layers, 128 experts per layer)

2. Data construction pipeline: Three-step automated annotation using Qwen3-Omni-Captioner for audio descriptions, Qwen3-235B for QA generation, and DeepSeek V3.1 for reference reasoning chains

3. Multi-reward system with four components: - Base reward: $R_{base} = R_{acc}(\hat{a}, a^*) + R_{fmt}(\hat{r}, \hat{a})$ for correctness and format compliance - Consistency reward: $R_{con}(\hat{r}, \hat{a}) = \psi(\hat{r}, \hat{a})$ ensuring reasoning supports the answer - Hybrid similarity reward combining LLM evaluation and embedding similarity:

   \[R^{hybrid}_{sim}(\hat{r}, r^*) = \frac{1}{2}R^{LLM}_{sim}(\hat{r}, r^*) + \frac{1}{2}R^{emb}_{sim}(\hat{r}, r^*)\]

   where $R^{emb}_{sim} = \cos(e(\hat{r}), e(r^*))$ using BGE-M3 embeddings

4. Progressive two-stage training: Stage 1 uses comprehensive rewards on foundational data, Stage 2 uses LLM-only similarity reward on challenging boundary cases

5. Group Reward-Decoupled Normalization Policy Optimization (GDPO) for multi-reward optimization to prevent reward collapse

   The core technical contribution is the hybrid reasoning similarity reward that directly supervises reasoning quality through both logical evaluation and semantic alignment, combined with the progressive curriculum enabling CoT emergence without supervised reasoning data.

1. Stage 1 - Foundational reasoning elicitation: - Data: 39,412 samples from AVQA dataset with synthetic CoT annotations - Optimizer: GDPO with learning rate 1e-6, KL coefficient β=0.001 - Training: Global batch size 224, micro batch size 4, 8 rollout responses per step - Hardware: 64 GPUs with tensor parallelism (TP=4), expert parallelism (EP=4), pipeline parallelism (PP=2) - Reward: Full multi-reward (accuracy + format + consistency + hybrid similarity) - Duration: Not reported

2. Stage 2 - Boundary enhancement: - Data: 29,483 samples from AudioMCQ and diverse sources (AudioSet, MagnaTagATune, Switchboard, MusicBench, CochlScene, MusicAVQA, IEMOCAP) - Same optimizer and hardware settings as Stage 1 - Reward: Streamlined (accuracy + LLM similarity only, removes embedding anchor and format/consistency constraints) - Reference policy: Changes from πref to πθ1 (Stage 1 checkpoint) - Duration: Not reported

3. Data preprocessing: - Audio captioning using Qwen3-Omni-Captioner - QA generation via Qwen3-235B-A22B-Instruct-2507 for datasets lacking annotations - CoT generation using DeepSeek V3.1 based on captions and QA pairs - Maximum sequence length: 4096 tokens, completion length: 1024 tokens

   Training framework: SWIFT integrated with Megatron-LM for distributed training with asynchronous rollout generation.

Prior work: Audio-Thinker (2025) introduced adaptive rewards for when to reason in audio models, achieving 65.30% on MMAR. CESAR (2025) proposed process-based rewards for consistent reasoning, reaching 62.70% on MMAR. Both relied on coarse rewards that don’t evaluate reasoning content quality.

Delta: This paper adds two key innovations:

1. A hybrid reasoning similarity reward that directly supervises generated reasoning quality through LLM-based logical evaluation plus embedding semantic alignment against reference chains, and

2. A progressive two-stage curriculum enabling CoT emergence through pure RL exploration without supervised reasoning fine-tuning.

   Applied-specific assessment:

   • Architectural novelty: The hybrid similarity reward is a reasonable engineering combination of existing techniques (LLM judges + embedding similarity). The progressive curriculum is a standard practice in RL, not architecturally novel.
   • Benchmark gains: +8.7% over Audio-Thinker (65.30→74.00% on MMAR) is substantial and consistent across three benchmarks. However, improvements over the stronger base model Qwen3-Omni-Instruct are more modest (+3.9% on MMAR).
   • Fair comparisons: Uses same base model family but different architectures than some baselines. Comparisons appear fair within RL-based methods using similar compute.
   • Generalization concerns: Heavy reliance on synthetic CoT data and specific model architectures may limit transferability. Results concentrated on audio reasoning benchmarks only.

   The work demonstrates solid engineering combining existing techniques effectively, but the core ideas (LLM judges for reasoning quality, progressive RL curricula) are well-established. The semantic grounding aspect through reference alignment is the most novel contribution.

   Verdict: INCREMENTAL — solid engineering advance combining known techniques for meaningful but expected improvements in audio reasoning.

1. MMAR: 74.0% average accuracy vs. previous best Audio-Thinker 65.30% (+8.7% improvement). Strongest gains in Music category (80.27% vs. base 77.21%, +3.06%) and mixed Sound-Speech tasks (75.00% vs. base 70.83%, +4.17%).

2. MMAU-test-mini: 78.50% average vs. previous best AudioMCQ 78.20% (+0.30% improvement). Achieves first place among all open-source and closed-source models.

3. MMAU-test: 75.44% average vs. AudioMCQ 75.60% (-0.16%, slightly behind previous best).

4. MMSU: 77.26% overall accuracy vs. AudioMCQ 70.70% (+6.56% improvement). Notable gains in Phonology reasoning (+2.56% vs. base model) and perception (+4.18% vs. base model).

5. Rubrics score on MMAR: 65.29% evaluating reasoning quality and completeness, substantially higher than ablated configurations (57.44% without hybrid similarity reward).

6. Interspeech 2026 Audio Reasoning Challenge: 1st Place in Single Model Track.

   Results show consistent improvements across all benchmarks, with the largest gains on reasoning-intensive tasks. Mixed results on MMAU-test (slightly behind AudioMCQ) but strong performance elsewhere. Notable absence of evaluation on broader multimodal reasoning benchmarks beyond audio-specific tasks.

1. Model size: 30B total parameters with 3B active parameters per token (MoE architecture)

2. Training compute: 64 GPUs with distributed training (TP=4, EP=4, PP=2). Wall-clock time not reported. Uses GDPO with 8 rollout responses per optimization step, suggesting substantial compute requirements for exploration.

3. Inference speed/latency: Not reported

4. Memory footprint: Not reported, but MoE architecture with 3B active parameters should be memory-efficient during inference

5. Deployment practicality: The paper demonstrates the method works on a production-scale model (30B parameters), suggesting reasonable deployment feasibility. However, the two-stage training process and multi-reward optimization may increase training complexity. No discussion of parameter-efficient alternatives, though interpretability analysis suggests potential for freezing expert parameters and optimizing only gating networks.

1. Evaluation limited to benchmark datasets without real-world deployment results. No production integration examples or user studies reported.

2. Hardware experiments: Training conducted on controlled 64-GPU cluster setup but no edge device or mobile deployment testing.

3. Sim-to-real discussion: Not applicable - this is an audio understanding task rather than robotics/physical deployment.

4. Dataset generalization: Testing spans diverse audio modalities (speech, music, sound events) and mixed scenarios, but all from curated academic benchmarks rather than real-world audio streams.

5. Practical limitations: Requires synthetic CoT data generation pipeline and multi-stage training, which may be challenging to reproduce in production environments without similar computational resources and access to large language models for annotation.

1. FUNDAMENTAL: Dependence on synthetic reference reasoning chains generated by external LLMs (DeepSeek V3.1, Qwen3-235B) creates potential quality ceiling and annotation bias propagation.

2. ENGINEERING: Two-stage training requirement increases computational cost and complexity compared to single-stage alternatives - could potentially be optimized.

3. FUNDAMENTAL: Hybrid similarity reward only applied when answers are correct, which may miss opportunities to improve reasoning quality on incorrect responses.

4. EVALUATION: Limited evaluation to audio-specific benchmarks; unclear how reasoning capabilities transfer to broader multimodal tasks or real-world audio streams.

5. ENGINEERING: Multi-reward optimization with GDPO adds training instability risks and hyperparameter sensitivity compared to simpler reward formulations.

6. FUNDAMENTAL: Semantic alignment to reference chains may constrain exploration of alternative valid reasoning paths, potentially limiting reasoning diversity.

   Failure modes:

7. Model may generate superficially coherent reasoning that lacks genuine acoustic grounding when reference chains are of poor quality
8. Performance degradation on audio types not well-represented in the two training stages (AVQA + boundary cases).

This work addresses autoregressive video generation acceleration. Large autoregressive video models (10B+ parameters) produce high-quality streaming video but require significant compute resources, while smaller models (1B-scale) run faster but with lower quality. The core challenge is adapting speculative decoding—successful for language models—to video generation, where continuous spatiotemporal blocks lack token-level distributions for exact rejection sampling.

The task takes a text prompt and generates video blocks sequentially using a drafter-target model pair. Input is natural language text prompts; output is 9 autoregressive blocks (27 latent frames total, decoded to variable pixel frames at 832×480 resolution). The objective is to maximize quality-speed tradeoff:

Success is measured by VisionReward (aggregating 29 visual quality questions) and wall-clock inference time. The paper evaluates on 1003 prompts from MovieGenVideoBench covering landscapes, animals, human activities, and cinematic footage.

1. Drafter-Target Architecture: 1.3B drafter model (Wan2.1-T2V-1.3B) proposes candidate blocks via 4 denoising steps; 14B target model (Krea Realtime Video 14B) regenerates rejected blocks. Both use causal attention with KV caching and RoPE positional embeddings.

2. Image Quality Router: Each draft block is VAE-decoded and scored by ImageReward. Quality score uses worst-frame aggregation:

   \[q_b = \min_{i=1}^F R(f_i^{(b)}, p)\]

   where $R(f, p)$ is the reward for frame $f$ given prompt $p$.

3. Block-Level Routing: If $q_b \geq \tau$, draft is accepted into target KV cache; otherwise target regenerates the block. Fixed threshold $\tau$ serves as quality-speed control knob.

4. Force-Reject First Block: Block 0 is always regenerated by target to anchor scene composition, regardless of draft quality.

   The core technical contribution is replacing token-level verification with continuous image quality routing for speculative decoding in video generation.

1. No Training Required: SDVG is training-free and uses pre-existing models without architectural changes.

2. Drafter Model: Uses pre-trained Wan2.1-T2V-1.3B Self-Forcing model (4 denoising steps per block, guidance scale 3.0, timestep shift 5.0).

3. Target Model: Uses pre-trained Krea Realtime Video 14B, distilled from Wan2.1-T2V-14B via Self-Forcing.

4. Router Model: Uses off-the-shelf ImageReward model for quality scoring.

   Data, optimizer, learning rate, schedule, batch size, hardware and wall-clock time: not reported as no training is performed.

Prior Work: T-Stitch (2024) splits denoising trajectory between models at fixed noise levels; SRDiffusion (2025) uses sketching-rendering cooperation for video acceleration; RSD (2025) applies speculative decoding to LLM reasoning using Process Reward Models.

Delta: This paper adapts speculative decoding from discrete tokens to continuous video blocks by replacing exact rejection sampling with image quality routing. Key additions:

1. worst-frame aggregation to catch single-frame artifacts
2. force-reject first block for scene anchoring

3. fixed threshold for calibration-free quality-speed control.

   Applied-Specific Assessment:

   • Architectural idea is a straightforward adaptation of known speculative decoding to video domain—not novel in principle but video-specific design choices are non-obvious
   • Benchmark gains are modest: 1.59× speedup at 98.1% quality retention is meaningful but not large
   • Comparisons are fair—same models, same evaluation protocol, same hardware
   • Gains likely depend on specific drafter-target model pair and may not generalize broadly

   Verdict: INCREMENTAL — Solid application of known technique with domain-specific adaptations, but limited architectural novelty and modest performance gains.

1. MovieGenVideoBench (1003 prompts, 832×480): VisionReward 0.0773 vs target-only 0.0788 (98.1% retention), 1.59× speedup at τ=-0.7

2. Quality-Speed Pareto Curve: Ranges from 1.59× speedup (98.1% quality) to 2.09× speedup (95.7% quality) by varying threshold τ from -0.7 to -2.5

3. Ablation Studies: Random routing achieves only 0.0706 VisionReward vs 0.0773 for reward-guided routing; average-frame scoring underperforms min-frame scoring across all accept rates

4. Consistent Improvement Over Draft-Only: All SDVG variants substantially outperform draft-only baseline (0.0644) by +17% or more

   Results are mixed in that speedups are moderate (1.6-2.1×) and quality retention, while high, comes at computational cost. No comparison to other video acceleration methods like step distillation provided.

1. Model Size: 1.3B drafter + 14B target (15.3B total parameters)

2. Training Compute: Not applicable - training-free method

3. Inference Speed: 60.9s per video (832×480, 9 blocks) at τ=-0.7, down from 97.0s target-only baseline

4. Memory Footprint: Requires hosting both models simultaneously plus VAE decode cache; runs on 2× NVIDIA RTX A6000 GPUs (48GB each)

5. Deployment Practicality: Moderate - requires two high-end GPUs and careful memory management for VAE cache cloning/restoration. Framework is plug-and-play but deployment complexity higher than single-model approaches.

1. Evaluation on Real Prompts: Tested on 1003 diverse MovieGenVideoBench prompts including landscapes, animals, human activities, and cinematic footage

2. Hardware Deployment: Implemented on dual RTX A6000 setup with CUDA streams for overlapping compute and cross-device transfers

3. Production Considerations: Framework is training-free and requires no architectural changes, enabling integration into existing autoregressive video pipelines

4. No Sim-to-Real Discussion: Paper focuses on computational acceleration rather than real-world deployment scenarios

   Limited real-world validation - evaluation is on curated benchmark prompts rather than production use cases or user studies.

1. Distributional Bias (FUNDAMENTAL): Unlike exact LLM speculative decoding, SDVG introduces distributional shift toward drafter model

2. ImageReward Proxy Limitations (ENGINEERING): Router evaluates frames independently, missing temporal consistency and motion quality; dedicated video-block quality model would improve routing

3. Wasted Draft Computation (ENGINEERING): Rejected blocks including forced block-0 rejections waste drafter computation and VAE decode

4. Fixed Threshold Calibration (EVALUATION): Single threshold τ may not generalize across different content types or model pairs

   Failure Modes:

   • Single corrupted frame in draft block may be missed by average scoring, causing temporal flickering
   • Poor scene composition in first block propagates through entire video if drafter quality is consistently low

Vision-language models (VLMs) exhibit persistent weaknesses in visual perception tasks like spatial understanding and viewpoint recognition, limiting their real-world applicability despite advances in language reasoning. Natural image datasets may lack systematic coverage of low-level visual skills needed for robust perception.

The task is synthetic visual question answering (VQA) generation to improve VLM visual perception. Input: task keywords (e.g., “Depth Order”). Output: image-question-answer triplets where questions are answerable solely from visual content. Images are 512×512 RGB, questions are short and unambiguous, answers are concise (binary/categorical).

Success is measured by improvements on visual perception benchmarks: MMVP (visual pitfalls), CV-Bench-2D/3D (2D/3D spatial reasoning), and RealWorldQA (geometric/spatial understanding). Secondary evaluation on general VLM capabilities (MMMU, MMBench, etc.).

VisionFoundry-10K dataset: 10k synthetic image-question-answer triplets across 10 visual perception tasks (1k samples each), covering spatial relationships, depth ordering, viewpoint recognition, and attribute discrimination.

1. Task-aware VQA generation: GPT-5.2 takes task keywords and generates question-answer pairs plus detailed text-to-image prompts encoding answer-determining visual facts

2. Image synthesis: Gemini-2.5-Flash-Image generates photorealistic images conditioned on T2I prompts, with optional iterative refinement for failed verification

3. Alignment verification: Gemini-3-Pro acts as multimodal judge, converts Q&A into declarative visual statements, accepts/rejects based on visual-textual consistency

4. Entity pool sampling: Systematic coverage via Cartesian product of objects, attributes, scenes, styles, and task-specific dimensions

5. Visual determinism constraint: Questions answerable only from image content, answers embedded directly in T2I prompts to reduce misalignment

   Core contribution: Fully automated pipeline requiring only task keywords, no reference images or human annotation, with verifier-based quality control.

1. Synthetic data generation: VisionFoundry pipeline produces 10k image-question-answer triplets (1k per task), filtered through automated verification

2. Model finetuning: One epoch on VisionFoundry-10K dataset - Qwen2.5-VL-3B: Learning rates 5×10⁻⁷ (ViT), 5×10⁻⁶ (adapter), 5×10⁻⁶ (LLM), unfrozen LLM - MiMo-VL-7B: Learning rates 5×10⁻⁷ (ViT), 2.5×10⁻⁶ (adapter/LLM), unfrozen LLM - Llama-3.2-11B: Learning rates 5×10⁻⁷ (ViT), 5×10⁻⁶ (adapter), frozen LLM - Global batch size 128, Adam optimizer - Hardware and wall-clock time: not reported

Prior work: SynthVLM (Liu et al., 2025) refines caption quality for VLM training, ShareGPT4V (Chen et al., 2024) generates 1.2M captions, ALLaVA (Chen et al., 2024) synthesizes 3.4M captioning/reasoning pairs. These focus on scaling or caption quality but require reference images or manual curation.

Delta: VisionFoundry introduces fully automated task-keyword-only pipeline with no reference images, human annotation, or manual QA writing. Adds multimodal verification loop using frontier VLM as quality judge.

Applied assessment:

• Architectural novelty: Task-aware generation + T2I synthesis + automated verification is a reasonable but non-obvious composition
• Benchmark gains: +7% MMVP, +10% CV-Bench-3D are meaningful on diagnostic benchmarks, but limited to 3 models
• Fair comparisons: Uses same compute/data budgets, but gains concentrated on visual perception tasks by design
• Scaling dependency: Method requires frontier LLM/T2I models (GPT-5.2, Gemini) limiting broader adoption

The pipeline composition is solid engineering but the core insight—that targeted synthetic supervision can patch VLM perception gaps—is intuitive given success of synthetic data in LLMs.

Verdict: INCREMENTAL — well-executed application of known synthetic data principles to VLM visual perception with reasonable but expected gains.

1. MMVPpair: Qwen 35.3→42.0 (+6.7), MiMo 43.3→57.3 (+14.0), Llama 42.7→46.7 (+4.0)
2. MMVPsingle: Qwen 64.3→68.3 (+4.0), MiMo 66.7→77.7 (+11.0), Llama 70.3→71.7 (+1.4)
3. CV-Bench-2D: Qwen 67.3→72.4 (+5.1), MiMo 74.3→79.0 (+4.7), Llama 70.4→71.7 (+1.3)
4. CV-Bench-3D: Qwen 66.0→76.5 (+10.5), MiMo 72.3→83.7 (+11.4), Llama 74.4→75.3 (+0.9)
5. RealWorldQA: Qwen 65.0→66.9 (+1.9), MiMo 65.9→67.5 (+1.6), Llama 63.0→64.6 (+1.6)
6. BLINK: Mixed results, Qwen 48.1→47.9 (-0.2), MiMo 58.9→58.7 (-0.2), Llama 34.3→35.5 (+1.2)
7. MMMU-Val: Mixed results, slight fluctuations across models
8. MMBench: Mixed, notably MiMo 50.5→81.6 (+31.1, suspicious gain)

9. OCRBench: Consistent slight drops as expected (no OCR supervision)

   Results show clear gains on visual perception benchmarks but mixed outcomes on general tasks.

1. Model sizes: Qwen2.5-VL-3B (3B parameters), MiMo-VL-7B (7B), Llama-3.2-11B-Vision (11B)
2. Training compute: One epoch finetuning, batch size 128, hardware not reported
3. Inference speed: Not reported
4. Memory footprint: Not reported
5. Generation costs: Pipeline requires GPT-5.2 for QA generation, Gemini-2.5-Flash for image synthesis, Gemini-3-Pro for verification - likely expensive per sample but amortized over dataset reuse

1. Evaluation on RealWorldQA benchmark which contains real-world spatial reasoning scenarios, showing modest gains (+1.6-1.9 points)
2. No actual deployment results or hardware experiments reported
3. No production integration or sim-to-real validation discussed
4. Method tested only on standard benchmark datasets, not real-world deployment scenarios
5. Pipeline relies on proprietary frontier models (GPT-5.2, Gemini) limiting practical deployment accessibility

1. FUNDAMENTAL: Dependence on proprietary frontier models (GPT-5.2, Gemini) for generation and verification limits reproducibility and cost-effectiveness
2. FUNDAMENTAL: Gains concentrated on visual perception tasks by design - limited transfer to complex reasoning or domain-specific applications
3. EVALUATION: Only tested on 3 VLM architectures and 10k samples - unclear if gains scale to larger datasets or different model families
4. EVALUATION: No comparison to targeted natural data curation approaches or human-annotated perception datasets

5. ENGINEERING: Verification stage not perfect - false accepts may poison supervision, no human correction loop

   Failure modes:

6. Verifier misalignment leading to incorrect labels in training data
7. Generated images may lack photorealism needed for real-world transfer despite T2I quality claims.