A new paper from Apple’s artificial intelligence scientists has found that engines based on large language models, such as those from Meta and OpenAI, still lack basic reasoning skills.
The group has proposed a new benchmark, GSM-Symbolic, to help others measure the reasoning capabilities of various large language models (LLMs). Their initial testing reveals that slight changes in the wording of queries can result in significantly different answers, undermining the reliability of the models.
The group investigated the “fragility” of mathematical reasoning by adding contextual information to their queries that a human could understand, but which should not affect the fundamental mathematics of the solution. This resulted in varying answers, which shouldn’t happen.
Continue Reading on AppleInsider | Discuss on our Forums
Source: AppleInsider News
Today we’re going to talk about wedding planning. Not wedding planning from the perspective of…
It’s been a busy fall for Apple software releases, and that’s set to continue. iOS…
Nyong'o also revealed she hasn't seen the 2018 film since Chadwick Boseman's tragic passing in…
The proposed commercial space station includes familiar features like a cupola window and a large…
Michelle is in a bit of a rut. Her social life is nowhere. Her apartment's…
Don't miss out on this chance to add an Apple Pencil Pro to your new…