papersTODAY 04:00 UTC
Paper proposes transport criterion for exact record omission in delta attention
A new arXiv paper examines the gap between a model appearing to forget a deleted record and its recurrent state still retaining that record's influence. The authors store the state difference produced right after a record is written and track it through subsequent processing steps, deriving a condition under which the omission is exact along with its computational cost and a replay-based certificate. The work targets attention mechanisms with recurrent memory, where deleting data from context does not necessarily remove its effect from internal state.