a learning repo for on-policy distillation experiments, notes, and small implementation probes
README.md

opd #

a learning repo for on-policy distillation experiments, notes, and small implementation probes

  • opsd_minimal/ contains a small Qwen3 forward-KL reference for on-policy self-distillation.

notes over here: https://app.notion.com/p/ON-POLICY-DISTILLATION-NOTES-36f802359a2a80ae93e2c1eedbec7484?source=copy_link