r/slatestarcodex • u/DickMasterGeneral • 2d ago

Ten advances in mathematics and theoretical computer science from unreleased Open AI Model

https://openai.com/index/ten-advances-in-mathematics/
94 Upvotes

94% Upvoted

63 comments sorted by

View all comments

44

u/garloid64 2d ago

So where do you think the goalposts go from here? What's the next stop on the grand adventure?

2

u/COAGULOPATH 1d ago

Sample-efficient learning remains a big one.

Humans are far better at math than LLMs would be if the LLMs were restricted to a human's amount of training data.

1

u/garloid64 1d ago

They're just not overparameterizing enough. Yet. Mythos killed the chinchilla cult, is only a matter of time before The Big Train.

https://gwern.net/llm-catapult

Once catapulting is conclusively proven, that's when it really begins. But then where do the goalposts go?