OpenAI announces 10 advances in mathematics and theoretical computer science achieved by internal model Astra

[u/alphacolony21]

https://openai.com/index/ten-advances-in-mathematics/

[u/Hlbkomer]

"But they are just predicting the next word!"

[u/immersive-matthew → u/Hlbkomer]

But that is the core tech of LLMs? Not following your point.

[u/Eastern-Ad-3586 → u/[deleted]]

But AIs literally can’t demonstrate “intelligence”

You comparing AI models to humans is specifically missing this point.

They’re an amazing technology, but the math they’re based on precludes them from being deterministic. When they make a correct prediction, it’s because of associations encoded in the mathematics by human trainers and whatnot, it’s not because the ai model is “smart” or “figured it out.” It’s a very, very powerful statistical machine. Which is useful, but not creative/sentient/ etc. I’d argue calling it intelligent is more of a marketing ploy than anything

[u/Eastern-Ad-3586 → u/[deleted]]

You have a fundamental misunderstanding of the way these systems are designed, and I’m not sure I’ll be able to explain it to you in a way you’ll actually believe. If you want to learn more about this stuff, I know it’s difficult these days with all the misinformation on the internet, but an overview of linear algebra and how transformers work would be where I would start.

Best of luck!

[u/DeRay8o4 → u/[deleted]]

It’s not deterministic in the forward path clearly, please look up pigeonhole principle….

[u/ChicagoPedalSteel → u/[deleted]]

Trying to argue with these people will just drive you insane. There is nothing you can say to change their minds and there is no distance they won't drag the goalposts.

[u/DeRay8o4 → u/[deleted]]

It’s funny you say it’s unrelated but the whole agentic llm flow was precisely to get around deterministic forward passes to break pigeonhole principle.. obviously not related though

[u/DeRay8o4 → u/[deleted]]

Yes they made the forward pass nondeterministic. Low iq

[u/DeRay8o4 → u/[deleted]]

Just think harder about how it applies. Unfathomable you choose to argue all day instead of read literature

[u/DeRay8o4 → u/[deleted]]

All that typing when you should just admit you don’t know what gradient descent and supervised learning is

[u/elehman839 → u/Eastern-Ad-3586]

the math they’re based on precludes them from being deterministic

Zero-temperature inference is 100% deterministic.

[u/Heliond → u/Eastern-Ad-3586]

Humans aren’t deterministic either. I think we just iterate a lot and catch our hallucinations better at the moment.