papersSEP 10 04:00 UTC
Study Proposes Maverick for Private, Verifiable LLM Inference via Matrix-Vector Delegation
A paper posted to arXiv introduces Maverick, a system designed to let users run LLM inference on external servers without exposing their inputs or blindly trusting the returned results. The method delegates the heavy matrix-vector multiplications that dominate transformer inference while adding privacy protections and a mechanism to confirm that computations were performed correctly. The authors frame the work as a step toward making private and verifiable inference practical for open-source models.