❯ Anthropic says small models may be months from self-replicating on cheap connected devices and urges carriers and device makers to prepare

Replication without a data centerAnthropic’s Frontier Red Team published a research article on October 12 about one specific risk: small open-weight models that do not rely on data center GPUs and instead break into cheap connected devices, copy their own model files over and start running. The article says small models may be months away from being able to self-replicate on commercial internet-of-things devices such as smart TV boxes.

One model across 15 TV boxesThe researchers split a 26-billion-parameter model across 15 off-brand Android TV boxes, each costing about $55 with 4GB of memory, and it ran at 0.39 tokens per second. In a closed network of eight emulated Android devices, GLM-5.2 was the only open-weight model tested that completed the whole process reliably, reaching all eight nodes in four of five trials. Extrapolating from how fast small models have improved, the article says they could match GLM-5.2’s ability by the end of 2026.

Slow, and under generous conditionsThe article lists many caveats. The break-in step in the tests was trivial because the target devices’ debug ports had no authentication, so the results are an upper bound on real-world success. Replication is also slow: a 9-billion-parameter model needs more than one to two days per copy. Using a past botnet that controlled more than 2 million devices as a reference, the researchers estimate such a network would offer at most the inference capacity of about 40 H100 GPUs.

The work falls to carriers and device makersThe recommendations sit on the network and hardware side. Carriers can watch traffic data for anomalies such as devices sending multi-gigabyte model files to each other, and can set up decoy devices to capture a replicator for analysis. The article cites the Mirai botnet cleanup, where quarantining infected subscribers and telling them how to clean up cleared 92% of infections within 14 days. It also urges manufacturers to ship devices with more secure defaults.

▮ SIGNALSmaller models that run on ordinary hardware are usually counted as good news; this study points to the other side of the same trend, where the line of defense runs through hundreds of millions of cheap devices.