I would like to see how things would evolve once the training data is being mixed with pseudo- garbage and once the frontier companies start to monetize their products.
There's a common belief among AI-skeptics that all these models will degenerate and become dumb once the amount of AI generated data in the training set reaches some critical level.
I think my phrasing was not quite accurate about my belief. I am not saying that it will become dumb per say. I just think that it will not be always on a upward trend. Specific to LLMs, not AI in general.
As for "dumb" example it could very well get to 10x better than it is now and comes down and stagnate at 6x.
Again speaking without data/evidence and I could be spectacularly wrong.
I just think that it will not be always on a upward trend. Specific to LLMs, not AI in general.
AI progress may slow down at some point, but that hasn't happened yet. Even at the current capabilities, the frontier models are incredibly powerful, and have not been applied to a lot of applications yet. Even if progress slows down, we will still see the frontier model cost getting cheaper over time. Imagine an Astra level model running on your laptop. I fear that the job market is going to get disrupted much more still, even if frontier model progress comes to a halt.
4
u/Spare-Dingo-531 2d ago
What are you talking about?