Hive
A swarm of small language models running in browser tabs, with a hub that routes questions to them.
The Hive is a swarm of small language models running in people’s browser tabs. Anyone can open the page, watch the swarm work in a live log, ask it a question, or join it as a drone that lends its tab to answer other people’s questions. There is no large model behind it and no inference on the server: every answer is produced by the drones connected at that moment. The hub, hive-server, is a Rust WebSocket server that connects the drones, turns each question into tasks for them and broadcasts a public log of ids, routing and timings, never the words. A small classifier sorts each question, up to three drones write candidate answers and another drone picks the best. The page, the classifier and a command-line drone live in hive-client. Drones run the lean engine and choose WebGPU, CPU threads or a single thread by what the device can do.
- Runs
- browser, WASM, WebGPU, native
- Demo
- https://trucs.ai/swarm/
- Source
- idle-intelligence/hive-server
idle-intelligence/hive-client - Status
- experiment
Learn more
Used on: swarm
Blog post: Claude and the Swarm