When Self-Consistency Backfires: Majority Vote Hurts the Majority of Hard Science Problems for Small LLMs

Factual evidence

What the source reports

Research shows majority-vote self-consistency degrades accuracy on complex reasoning tasks for small LLMs like Qwen2.5-7B and Llama-3-8B.