Three Sparks. One kitchen.
The models run here, on three DGX Sparks. sparkKitchen plans, serves, and watches them: what is serving where, and whether the next model fits before anything moves.
- Serving
- Decode and prefill throughput, KV cache, and latency percentiles from vLLM, SGLang, or llama.cpp, per node.
- Recipes
- One small YAML per serving setup: placement on your nodes, the knobs you tune, and drift from what the container really runs.
- Sensors
- GPU clocks and throttle reasons, every thermal zone, unified memory, the ConnectX-7 fabric. One-second history, 14 days of rollups.
- 3D lab
- A twin of the Spark with live thermal vision, a transient heat solver, and real CFD of the airflow.
Read-only toward the nodes: it never starts, stops, or reconfigures anything. Going public soon. Readings on the shelf screen are illustrative.