Tag
Articles about Inference costs from podcasts, articles and papers, with links to the original sources.
DeepSeek says V4.1-Flash cuts the high-bandwidth memory needed for its cache to a quarter of its predecessor’s requirement. The Moonshots panel sees an opening for companies to build on efficient open-weight models—but a smaller cache is not the same as a small model.
OpenAI says roughly 10,000 coordinating agents produced a proposed proof of breakdown in a forced three-dimensional fluid flow, with humans consolidating the work and Lean checking the formal argument. On Moonshots, Sam Altman’s call to pace progress divided the panel: was this an anticipated scientific capability, or a surprise about how quickly and cheaply it could be reached?