1 article.
Apple researchers rebuilt 100 grade-school math problems into templates and generated 5,000 variants, then ran 25 state-of-the-art models against them. The problems needed identical reasoning, yet accuracy swung by more than 12 points between easy and hard versions of the same question, and adding one sentence that changes nothing cost some models over 65% of their accuracy. Few-shot examples did not fix it.