papersTODAY 04:00 UTC
Audit Compares ConFlayers and SWIFT for Periodic-Step Layer Skipping in LLM Inference
A three-seed, rigor-matched study audits two periodic-step, search-based layer-skipping methods, ConFlayers and SWIFT, which choose which transformer layers to run for a given input. The work also examines trained routing approaches as an alternative to search-based selection. The authors frame it as a reproducibility-focused comparison of efficiency techniques for LLM inference.