CIViC: Evidence Gates for Audio-Conditioned Visual Prediction on Proxy Tasks
Abstract
Removing audio can shift a visual predictor's output without showing whether the task uses the intended audio information. We introduce Conditional Input and Visual Interpretation Checks (CIViC), a four-gate protocol that links an interpretation to an intervention, held-out task comparison, or endpoint control. We demonstrate CIViC on actor-disjoint face-raster tests, a synthetic audio-feature mixture, and source-video-disjoint SpeakerVid proxy tasks. In the static face-raster test, cross-actor audio replacement meets the registered detection rule with a small effect; on a separate temporal endpoint, constant-audio fits score better than audio-trained fits in four matched seeds. In the synthetic mixture, the condition-augmented fit has higher 1,000-step RMSE than the audio-only fit (0.1807 vs. 0.1707), with the gap shrinking during training. In the SpeakerVid proxy, the five-feature-zero fit (five low-level audio summaries zeroed; identity, dialogue, and condition inputs retained) has lower whole-frame grayscale RMSE than aligned audio across four held-out conditions and five paired seeds, while aligned audio has lower segment-drift error. The results show that output activation, held-out error, and endpoint controls support different interpretations across these proxy tasks.
Community
Excellent work on audio-to-video generation
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models (2026)
- SyncRA: Learning Temporal Correspondence in Omni-Modal Models (2026)
- Conditional Visual Evidence Utility: State-Dependent Rank Reversals in Frozen Vision-Language Encoders (2026)
- Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Models (2026)
- Do Audio LLMs Listen Before They Act? Diagnosing Acoustic-Context Gating in Voice Agents (2026)
- Sampling headroom is not selection gain: a compute-value audit of test-time scaling for video world models (2026)
- MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.15327 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper