papersTODAY 04:00 UTC
CapGeo-Bench separates visual perception from geometric reasoning in multimodal models
A new arXiv paper introduces CapGeo-Bench, a benchmark designed to evaluate geometric understanding in multimodal large language models while distinguishing failures in visual perception from failures in reasoning. The authors note that even strong closed models such as GPT-o3 continue to lag on geometry problems despite success on purely textual math tasks. The benchmark aims to give a clearer picture of where these systems break down.