Gerben Wierda published another AI-buster article describing what exactly “state-of-the-art” means in AI benchmarks.

Hint: you give an AI model 32 step-by-step examples before asking a question, and it still gets it wrong 10% of the time.