Task Competence Is Not Instruction Following: Evaluating Instruction-Conflicting Behavior in Small Language Models
Research finds small language models struggle to follow instructions when they conflict with their inherent task behaviors across MCQA, sentiment, and math tasks.