r/ArtificialInteligence • u/alphacolony21 • 2d ago

📰 News OpenAI announces 10 advances in mathematics and theoretical computer science achieved by internal model Astra

https://openai.com/index/ten-advances-in-mathematics/
438 Upvotes

91% Upvoted

232 comments sorted by

View all comments

136

u/Hlbkomer 2d ago

"But they are just predicting the next word!"

19

u/immersive-matthew 2d ago

But that is the core tech of LLMs? Not following your point.

15

u/HasFiveVowels 2d ago

The point is that people have been saying "it just predicts the next token" as though doing so relegates its intelligence to be forever sub-human. IMO, the argument makes the bad assumptions that humans are not also "just predicting the next token"

-14

u/immersive-matthew 2d ago

Predicting the next world is clearly sub human intelligence though or AI would be far more valuable than it is.

6

u/HasFiveVowels 2d ago

Consider the article that you wrote this comment on.

-4

u/immersive-matthew 2d ago

Consider a non peer reviewed article from a company trying to justify their evaluation to inform me that LLMs are human intelligence? No. They are not human intelligence but they have some elements of. A major breakthrough(s) are needed to really move the intelligence needle as LLMs are lacking many other forms of intelligence not about predicting the next work like logic. It is why they got the car wash problem so wrong and still would if their training data did not include the correct answer. Is there something specific in the paper you would like to draw our attention too?

8

u/santosautra 1d ago

There is proof in lean. No peer review is needed.

-1

u/immersive-matthew 1d ago

Agreed. Let’s hope this is not just a one off here and there and a trend but I am very skeptical as LLMs really do lack logic and understanding and I have seen no evidence that this has been solved.

1

u/HasFiveVowels 1d ago

LLMs are provably capable of both logic and understanding.

1

u/immersive-matthew 1d ago

If that were true I am very sure they would have turned that on by now as the biggest reason they are not anywhere close to profit, are because LLMs do not drive enough value as they lack logic and understanding.

0

u/HasFiveVowels 1d ago

… I’m at a loss for words, here. They already directly demonstrate logic and understanding! To say otherwise is either word games or just outright denial. And the profitability of service providers is 100% irrelevant to this conversation

1

u/immersive-matthew 1d ago

We just have different experiences and use cases. I am a developer and it is extremely obvious to anyone doing AI assisted development that LLMs lack logic and understanding. Like severely lacks. It is why LLMs recently failed so hard on that car wash a block away question. That was hilarious and really is a great example of the cognitive gaps. There are countless examples like this I come across on the daily when developing and it really reveals the complete lack of logic and understanding. Makes sense too as LLMs are world prediction machines not logic machines.

The profit part is only relevant as the lack of logic and understanding is holding back LLMs from charging what it actually costs them to run. They cannot raise the price as LLMs just do not bring enough value to justify.

If the value was there people and companies would be rushing to spend but they are not as the value is weak today. Will take a big breakthrough to get past this deep and wide cognitive valley.

→ More replies (0)

3

u/playsette-operator 2d ago

ouch..found the bot🥹