Tech giants are assembling AI supercomputers of unprecedented scale. Microsoft, Meta, Amazon, and Elon Musk’s xAI are building clusters boasting 100,000 or more H100 GPUs, with xAI planning to double its Colossus system to 200,000 GPUs — including the upcoming H200 model. To put this in perspective, OpenAI reportedly trained GPT-4 using roughly 25,000 A100…
The 25 most innovative companies of 2024
Yes, questions remain about whether AI chipmaker NVIDIA can maintain its momentum in 2025. NVIDIA’s upcoming Blackwell AI chips have encountered thermal problems when integrated into server racks designed to house up to 72 units. Despite these recent technical hurdles, the company remains an innovation juggernaut. 1. Why NVIDIA is the R&D leader of 2024…