01Entry
The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation
RIDE treats the RL teacher as a direction to extrapolate, not a fixed target โ distills on-policy behavior by extrapolating representation residuals. Relevant for anyone distilling RL-trained agent policies.