papersTODAY 04:00 UTC
Probing Method Aims to Improve PEFT Layer Selection in Vision-Language Models
A new arXiv paper proposes a probing technique that analyzes weight statistics and perturbation robustness before fine-tuning to decide which layers of a vision encoder should be adapted. The authors argue this pre-fine-tuning approach can yield more stable improvements while training fewer parameters in large vision-language models. The work targets parameter-efficient fine-tuning, where only a small subset of weights is updated.