Training AI models might not need enormous data centres

O nce, the world’s richest men competed over yachts, jets and private islands. Now, the size-measuring contest of choice is clusters. Just 18 months ago, OpenAI trained GPT-4, its then state-of-the-art large language model (LLM), on a network of around 25,000 then state-of-the-art graphics processing units (GPUs) made by Nvidia. Now Elon Musk and Mark Zuckerberg, bosses of X and Meta respectively, are waving their chips in the air: Mr Musk says he has 100,000 GPUs in one data centre and plans to buy 200,000. Mr Zuckerberg says he’ll get 350,000.

It can help. But it depends where you’re going

A stronger R&D base, they hope, will transform their countries’ economies. Will their plan work?

Trials are under way against skin, brain and lung tumours

It could sniff out blazes long before they spread out of control

After 25 years, Blue Origin finally heads to orbit, and hopes to become a contender in the private space race

There is growing evidence that it can help with pain, depression and more

https://www.economist.com/science-and-technology/2025/01/08/training-ai-models-might-not-need-enormous-data-centres

A source: www.economist.com/science-and-technology/2025/01/08/training-ai-models-might-not-need-enormous-data-centres