RESEARCHMonitorNEXT 12 MONTHS
To Memorize or to Retrieve: Scaling the Interaction Between Pretraining and Retrieval
arXiv cs.LG — Machine Learning
Factual evidence
What the source reports
Research analyzes scaling trade-offs between pretraining data scale and RAG retrieval store size across models up to 3B parameters.
Open source