Architect Launches Liquid Inference, a Real-Time Auction for LLM Inference
Architect Financial Technologies has launched Liquid Inference, a real-time auction marketplace and LLM router where providers bid to serve individual prompts…
Architect Financial Technologies has launched Liquid Inference, a real-time auction marketplace and LLM router where providers bid to serve individual prompts…
1 editorial report · 1 verified social mention. The most authoritative report leads while later evidence completes the story.
Liquid just dropped d1-omni-600M and it's a decision model! I ported it to runntime, the WebGPU inference library I'm currently working on. It's plain TypeScript on top of TypeGPU with no WASM and virtually no export step. The model is written directly from our core ops (matmul, attention, norms, a few elementwise bits), and the weights load straight from the HF safetensors. The demo in the video is a fake comment feed being moderated live. Each comment gets 4 questions: toxic? spam? asking something? overall tone? Toxic and spam ones get removed. ~180 ms per comment for all 4 questions, ~45 ms per question - the performance will most likely be way better once we spend some time tuning the engine for this model I also tried making it play snake, but It did not go well lol. The d1 port isn'
Open mention