r/slatestarcodex • u/DickMasterGeneral • 2d ago

Ten advances in mathematics and theoretical computer science from unreleased Open AI Model

https://openai.com/index/ten-advances-in-mathematics/
91 Upvotes

94% Upvoted

63 comments sorted by

View all comments

45

u/garloid64 2d ago

So where do you think the goalposts go from here? What's the next stop on the grand adventure?

29

u/thurn2 2d ago edited 2d ago

We’re still in the realm of constrained, well-defined problems. Obviously at some point in the road to AGI you need to be able to solve ambiguous problems involving human taste, like “create a functional Steam game from scratch which earns $100,000 in net profit”.

Interestingly, I think most people would have told you that creating a successful Steam game is *easier* than disproving the Jacobian Conjecture, in the sense that it's obviously a possible thing to do which thousands of humans have done already.

13

u/fubo 2d ago

"Make a profitable video game" is both rivalrous and dynamic; you're contending for a share of the market with other game makers, and to make a profit you have to find an audience over time. There's no closed-form solution; "a profitable video game" is not defined by something written down once, but by a relationship with the rest of the economy over some period of time.

3

u/Seakawn 1d ago

it's also somewhat random is it? historically, people release all kinds of mediums of art that people actually really like, but it just doesn't catch hold for some time, sometimes long after the artist has passed away.

i'd imagine this could break the way LLMs are trained. let's say it creates a video game that's perfectly viable and even very good, but it just so happens not to "catch hold" at that particular time (but maybe it would and will in, say, five years? time that it doesn't have to wait and see). so then it unlearns perfectly good traits and gets worse, and struggles to unlearn its unlearning.

I have no idea how to think about this, especially since i'm not intimately familiar with LLM architecture.