Something went wrong. Try again.
a learning repo for on-policy distillation experiments, notes, and small implementation probes
Something went wrong. Try again.
Files
- Python 87%
- Shell 13%
README.md
opd #
a learning repo for on-policy distillation experiments, notes, and small implementation probes
opsd_minimal/contains a small Qwen3 forward-KL reference for on-policy self-distillation.
notes over here: https://app.notion.com/p/ON-POLICY-DISTILLATION-NOTES-36f802359a2a80ae93e2c1eedbec7484?source=copy_link