Do We Need Bigger Models for Science? Task-Aware Retrieval with Small Language Models
Research suggests smaller language models with task-aware retrieval can achieve strong performance in scientific knowledge discovery, challenging the 'bigger is better' paradigm.