Russian Mathematicians Cut AI Computing Costs 20x Startup Mostik AI has developed a way for AI models to communicate directly by sharing their internal states rather than passing text back and forth
Startup Mostik AI has developed a method enabling AI models to communicate directly by sharing internal states instead of text, cutting computing costs by 20x.
Russian Mathematicians Cut AI Computing Costs 20x Startup Mostik AI has developed a way for AI models to communicate directly by sharing their internal states rather than passing text back and forth
🔄 Russian Mathematicians Cut AI Computing Costs 20x Startup Mostik AI has developed a way for AI models to communicate directly by sharing their internal states rather than passing text back and forth. The approach lets a large model do the computationally intensive work of processing a task, while a smaller, cheaper model generates the response. ⚙️ Mostik AI CEO Sasha Malysheva told @hiaimediaen how it works: Multi-model systems are already used in AI agents to distribute work between models with different capabilities and costs. One model might plan a series of actions, for example, while another executes them. But they still typically communicate through text—one model generates an output, and the next one reads it. When processing each token, a model builds numerical vectors that make up its hidden state. This internal state contains the context, information about how the model understands the task, and what a possible answer might look like. According to Mostik, producing a single token involves more than 100 hidden vectors, or about 1 million numbers—roughly 2 MB of internal state. Yet only one selected token leaves the model, equivalent to about 17 bits. "Systems built to th
Russian Mathematicians Cut AI Computing Costs 20x Startup Mostik AI has developed a way for AI models to communicate directly by sharing their internal states rather than passing text back and forth | Hooshware