Residual Growth: Boosting LLMs to Their Limit with Hard Learnable Samples
Adhiguna Kuncoro
· Google DeepMind
Patomporn Payoungkhamdee
· VISTEC
Pume Tuchinda
· VISTEC
Boosting-inspired residual learning: grow an LLM by training new parameters on what it has not yet learned, and merge them back.