Skip to main content

PrismML debuts energy-sipping 1-bit LLM in bid to free AI from the cloud

1 month ago
Bonsai 8B model is competitive with other 8B models but 14x smaller and 5x more energy efficient

PrismML, an AI venture out of Caltech, has released a 1-bit large language model that outperforms weightier models, with the expectation that it will improve AI efficiency and viability on mobile devices, among other applications.…

Thomas Claburn