A number of experiments making GPT-4 clear up math issues in 16 totally different languages
![Towards Data Science](https://miro.medium.com/v2/resize:fill:48:48/1*CJe3891yB1A1mzMdqemkdg.jpeg)
It’s stated that arithmetic is a common language — mathematical ideas, theorems, and definitions could be expressed as symbols which are comprehensible no matter language.
On this article, I take a look at the mathematical capabilities of GPT-4 in sixteen totally different languages.
Early experiments confirmed GPT-4 scoring extremely on the SAT Math and AP Calculus checks and on undergraduate-level arithmetic. Nevertheless, nearly all of these experiments take a look at GPT-4’s mathematical capabilities solely in English. To raised perceive GPT-4’s mathematical capabilities past English, I immediate it on the identical math issues in fifteen different languages.
So, how good is GPT-4 at math in numerous languages? In idea, it needs to be equally good (or dangerous) throughout all languages, however sadly (as you may need guessed), this isn’t the case. GPT-4 is a lot better at fixing math issues in English. Relying on the language, GPT-4 might clear up a number of the issues. For historically under-resourced languages, nonetheless, reminiscent of Burmese and Amharic, GPT-4 was unable to resolve the issues I gave it.
I take advantage of mathematical issues from the Mission Euler web site to check GPT-4. (That is additionally a throwback to considered one of my considered one of my earlier articles from this yr, the place I used immediate engineering utilizing ChatGPT to resolve just a few Mission Euler issues). Mission Euler, named for the eponymous mathematician, is a web site with tons of of mathematical and pc programming issues ranging in problem. Began in 2001, they boast over 850 issues (as of October 2023) and launch a brand new query roughly each week.
The wonderful thing about Mission Euler questions is that every drawback has a numerically “right” reply — this makes it straightforward to verify if GPT-4’s reply is objectively right or not. Additionally they are typically much more sophisticated than high-school or college-level math issues. Presently, there isn’t any large-scale complete understanding of GPT-4’s (or different giant language fashions, for that matter) math…