DOD: Double Online Distillation for Continual Learning
Continual Learning (CL) aims to learn incrementally from a data stream while retaining previously acquired knowledge. Many existing methods rely on offline distillation, which can propagate harmful knowledge during transfer and, when memory is limited and old and new samples are…