❯ Nvidia’s Trillion-Parameter Open-Source Model Nemotron 4 Could Finish Training as Early as Late Fall

SPECSAccording to The Information, Nvidia is developing a new generation of open-source model family Nemotron 4, whose largest version has no fewer than 1 trillion parameters, aiming to rival the world’s strongest open-source models. The company has not yet set a release date and training is incomplete; employees say it could be ready as early as late this fall.

STRATEGYKari Briski, Nvidia’s vice president of generative AI, argues that every company and every country needs “accessible frontier open-source models” to strengthen security and accelerate innovation. The more direct business logic: whoever’s cards the open-source models run on, that’s where demand lands. This year, China’s low-cost open-source models have approached the capability of America’s top labs, while the major U.S. companies consistently releasing open weights can be counted on one hand.

SHIFTA chipmaker’s motive for building models is fundamentally different from a lab’s — labs sell tokens, Nvidia sells compute. The more ubiquitous the model, the more inference calls, and the scarcer the GPUs. The cost: it now competes on the same layer as its largest customers. Enterprise tech leads procuring open-source models will need to ask one more question going forward: is this model optimized for general-purpose performance, or for specific hardware?

▪ SIGNALA model handed out for free collects its money on the hardware end — the accounting was never about the model itself.