AI's $100 Billion Problem: Why Scaling Alone Won't Deliver True Intelligence
A former OpenAI researcher is betting that $100 billion will be spent on training data in the next few years, as scaling alone is not enough to achieve true generalization capabilities in AI models. This shift in focus could have significant implications for developers, businesses, and everyday users of AI technology.
Former OpenAI employee Andrew Ho and Cambridge researcher Adam Hunt see a growing problem with large language models. Instead of becoming more versatile, the models are becoming more specialized, excelling at coding and math while stagnating or even regressing in other areas. Ho is leaving OpenAI to start a company focused on specialized training data and predicts that AI labs will need to spend more than $100 billion on targeted data collection. The article Ex-OpenAI researcher bets $100 billion will flow into training data because scaling alone won't cut it appeared first on The Decoder.