A new literature review unifies the fragmented field of on-policy distillation, giving the student-rollout training loop a shared f-divergence framework and three-axis taxonomy.
document fetched 2026-10-24 09:59
Teaching Small AI Models to Learn From Their Own Mistakes — retained record — High Signal