Continual LearningTraining AI models to accumulate new knowledge over time without overwriting what they already know.22 Apr 2026trainingagentsmemoryresearchfine-tuning
Sparse AttentionA transformer efficiency technique where each token attends only to a relevant subset of other tokens, enabling near-linear scaling with context length.3 Apr 2026architecturetransformersefficiencylong-contextresearch
Test-Time Training (TTT)A method where a model runs gradient updates during inference, using its current input as training data to adapt on the fly.3 Apr 2026traininginferencememoryefficiencyresearch