A new arXiv paper introduces CRAF, a cross-view residual-aware fusion approach for detecting synthetic or converted speech. The method targets generalization to spoofing attacks not seen during training, a common weakness in deepfake audio detection. It builds on pretrained speech and audio models.
A new arXiv paper argues that knowledge distillation breaks down when the student model is much smaller than its teacher, because imitating the teacher's logits locks the student into its sharpest output modes and harms generalization. The authors propose letting the large teacher guide the small student through prompts during reinforcement-learning fine-tuning instead of through gradient-based distillation. The work appears in the computational linguistics category on arXiv.
A new study questions whether time-series foundation models can be fairly evaluated using test data collected after their pretraining cutoff. It finds that even a temporally later, contamination-free hold-out does not fully isolate genuine generalization, as familiarity with the underlying data distribution absorbed during pretraining persists. The result suggests the field needs evaluation practices that go beyond simply withholding recent data.