Next Token Prediction SOLVES AI Says OpenAI Founder

It's a deeper question than it seems. Predicting the next token well means that you understand the underlying reality that led to the creation of that token. In order to understand those statistics, to compress them, you need to understand what is it about the world that creates those statistics.

这个问题比看起来要更深入。能够成功地预测下一个标记意味着您理解了导致该标记创建的基础现实。为了理解这些统计数据、压缩它们，您需要理解创造这些统计数据的世界因素是什么。

And so then you say, okay, I have all those people, what is it about people that creates their behaviors? Their thoughts and their feelings and their ideas. All of those would be deduced from next token prediction.

那么你说，我有这么多人，是什么让他们产生行为？它们的思想、情感和想法呢？所有这些都可以通过下一个预测来得出结论。

And I'd argue that this should make it possible to say, can you guess what you do if you took a person with this characteristic and that characteristic, like such a person doesn't exist? But because you're so good at predicting an next token, you should still be able to guess what that person would do this hypothetical imaginary person is bug rate or mental ability than the rest of us.

我认为这应该使得我们能够说：“你能猜想一下，如果你拥有某个特征和某个特点的人，像这样的人是否存在？但是，因为你非常擅长预测下一个标记，所以即使这个虚构的人比我们其他人有更高或更低的错误率或智力，你仍然应该能够猜测出这个人会做什么。”