Some of OpenAI’s researchers include top global informatics and mathematics Olympiad competition winners (in particular from Poland & China). They’re really “into” training GPTs to pass all kinds of tests and assessments — AP, SAT, LSAT, GMAT, GRE, IQ tests and so forth. Same goes for Google’s Gemini / AI team.
Nevertheless, they’ve produced tools that are pretty spectacular at solving standardized education assessments.
How GPT-4 & GPT-3.5 pass standardized tests
ChatGPT-4 can pass many standardized tests, and this is an amazing capability of this system: https://openai.com/research/gpt-4
How GPT-4o passes standardized tests
How Gemini passes standardized tests
LLMs vs assessments
It looks like an arms race is coming ahead between assessment companies and candidates, given such results on educational entry exams.
One might wonder how will companies in technical programming like HackerRank, Codility, CoderPad, CodeSignal fare, or general testing companies like TestGorilla or SHL. Incentives will matter significantly in this process.
Perhaps companies (customers of test provider solutions) will stop giving skills and task assessments to candidates? Candidates feel like they are hamsters running on recruiting process treadmills just to cater to the anxieties and biases of hiring managers and recruiters (mostly worried about mis-hires and avoiding accountability in recruitment decision – especially in enterprises), and they have every incentive to avoid tests as obstacles. That’s why it is not about testing per se, but about uncovering valid signals and discovering hidden talent that fits you in hiring, which is what we’re about at Gyfted.