Hive

A swarm of small language models running in browser tabs, with a hub that routes questions to them.

The Hive is a swarm of small language models running in people’s browser tabs. Anyone can open the page, watch the swarm work in a live log, ask it a question, or join it as a drone that lends its tab to answer other people’s questions. There is no large model behind it and no inference on the server: every answer is produced by the drones connected at that moment. The hub, hive-server, is a Rust WebSocket server that connects the drones, turns each question into tasks for them and broadcasts a public log of ids, routing and timings, never the words. A small classifier sorts each question, up to three drones write candidate answers and another drone picks the best. The page, the classifier and a command-line drone live in hive-client. Drones run the lean engine and choose WebGPU, CPU threads or a single thread by what the device can do.

Runs
browser, WASM, WebGPU, native
Demo
https://trucs.ai/swarm/
Source
idle-intelligence/hive-server
idle-intelligence/hive-client
Status
experiment

Used on: swarm

Blog post: Claude and the Swarm

← Home