❯ Nebius acquires Inferize, less than a year old, to cut model cold starts from tens of minutes to seconds

Eliminating idle GPUsInferize is an Israeli company whose software shortens cold starts. A cold start is the loading time between launching an AI model and its being ready to answer requests, during which GPUs draw power without earning revenue. According to CTech, its CEO says the technology can cut loading time from tens of minutes to seconds.

Nine months, 17 peopleInferize was founded earlier this year, has 17 employees in Tel Aviv, and had never disclosed any funding. CTech reports that it raised a $10 million seed round led by TLV Partners. Founders Guy Bortnikov and Lior Gorbonos were both part of the founding team of Israeli company Granulate, which Intel acquired in 2022 for about $650 million.

Price not disclosedNebius announced the acquisition on October 1 in a filing with the SEC and did not disclose terms. CTech estimates the price at between $100 million and $150 million. Inferize’s technology and team have joined Token Factory, Nebius’s managed inference platform.

The margin in rented compute is utilizationNebius is a Nasdaq-listed AI cloud company headquartered in Amsterdam. Inference is sold by the token, customer demand rises and falls, and slow model loading means keeping extra GPUs running in reserve. Faster loading lets the same GPUs serve more requests. The filing notes that Token Factory also integrates optimization technology from earlier acquisitions Eigen AI and Clarifai.

▪ SIGNALGPU clouds have finished competing on who can buy chips and started competing on who leaves them idle least, which is why a 17-person software team is worth over $100 million.