File size: 4,639 Bytes
4fd620e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 | # πΌ DaisyChain-Web β train by opening a page
Part of **DaisyChain** β https://huggingface.co/DaisyChainAI
Open a link on two or more devices and they **train a shared model together,
peer-to-peer, right in the browser** β no install, no accounts. Devices connect
over **WebRTC** (like Snapdrop); each one computes **through the verified INT8
units** β the same emulated GPU logic as the rest of DaisyChain, run as a
**WebGPU** lookup-table matmul (with a CPU fallback for old machines) β and they
average gradients directly between peers.
> This is the browser-native version of DaisyChain: instead of setting up nodes,
> people join a training run by opening a URL.
## Run it
```bash
npm install
npm start # serves on http://localhost:8787
```
Open `http://localhost:8787` in two tabs (or two devices β see HTTPS note). They
find each other, connect P2P, and you click **Start training** on each. Watch the
shared loss fall on both.
Quick self-check of the training math (no browser):
```bash
npm test # 2-peer gradient averaging: converges, replicas bit-identical
```
## How it works
| Piece | Role |
|-------|------|
| `server.js` | tiny **WebSocket signaling** server (introduces peers, relays WebRTC offers/ICE) + static host. It never sees the compute. |
| WebRTC data channels | **P2P** gradient exchange between browsers (STUN for NAT). |
| `public/verified_core.js` | the **verified INT8 units** in the browser β quantize β LUT multiply β dequant, STE backward. The emulated GPU logic doing the training compute. |
| `public/webgpu.js` | runs the verified multiply as a **WebGPU** LUT-matmul compute shader, with an automatic **CPU/JS fallback**. |
| `public/*.bin` | the units as lookup tables (`mul_lut`, `requant_lut`, `relu_lut`), exported from the trained weights by `daisychain/export_luts_web.py`. |
| `public/app.js` | the WebRTC mesh + the training loop + gradient averaging. |
Each peer starts from the **same** deterministically-seeded weights (no weight
broadcast needed), trains on its own data shard **through the verified units**,
and every step broadcasts its gradient and averages everyone's β so all peers
converge to the **same** model.
## What's verified
- **Through the units** (`node test_verified.js`): 2 peers training through the
verified INT8 multiply converge and stay **bit-identical** (0.0 param diff).
- **Signaling** (`node -e ...`): peer discovery + relay works.
- **End-to-end in-browser**: two tabs connected over **real WebRTC**, both on
**WebGPU running the verified INT8 units**, trained a shared model together β
loss fell steadily, peers in sync. (`node test_core.js` also checks the plain
float loop.)
## Regenerate the unit LUTs
The `.bin` tables are exported from the trained DaisyChain units:
```bash
cd ../daisychain && python export_luts_web.py # writes mul/requant/relu LUTs into ../daisychain-web/public
```
## Who connects to whom (Snapdrop-style)
Peers are grouped by their **public IP**, so **only devices on the same network
auto-connect** β open the page on your phone and laptop at home and they find
each other, but a stranger viewing the same URL from another network does **not**
join your group. To connect across networks with people you invite, everyone
opens `?room=YOUR-CODE` (a shared private room). The server only relays WebRTC
handshakes; it never sees the training.
**Safety note:** WebRTC peers connect directly, so devices in your group can see
each other's IP address, and there's no gradient authentication β a malicious
peer could poison the shared model. Train only with devices/people you trust.
This is a proof of concept, not a hardened public service.
## Honest limits
- **Secure context required.** WebGPU and cross-device WebRTC need **localhost or
HTTPS**. For real multi-device use, serve over HTTPS (a tunnel, a host, or a HF
Space) β plain `http://192.168.x.x` won't get WebGPU.
- **No WebGPU? It falls back to CPU** β slower, but old machines (e.g. Windows XP/7
via **Supermium**, old Macs via a compatibility browser) can still join at the
CPU tier. WebGPU itself needs a GPU/driver with a modern backend, which very old
hardware usually lacks.
- **Synchronous barrier**: the slowest peer paces each step. Peer-dropout handling
is minimal (a timeout, then it proceeds) β this is a proof of concept, not
hardened.
- **Small models only** β WebRTC bandwidth and browser compute cap the size. Same
envelope as the rest of DaisyChain: pools compute, not memory.
---
**License:** MIT Β· **Author:** Dean Byrne (Quazim0t0) Β· **Org:** DaisyChainAI
|