Keeping LLMs Aligned Without the Cost: The Story of Instruction Residuals
Published:
Large Language Models (LLMs) constantly learn from new data. Yet, updating them often comes with a hidden cost: they forget how to follow instructions properly. Retraining to restore this ability is extremely costly.