pyr0ball
5d5c02ff84
Some checks failed
CI / test (pull_request) Has been cancelled
Answers "can this hardware run model X at quantization level Y?" by querying the HuggingFace Hub API for parameter count (safetensors) and architecture (config.json), then applying the standard VRAM formula: weights + KV cache (GQA-aware) + overhead. Reference algorithm from LLMcalc (no code copied, unlicensed upstream). Bump to 0.22.0. Closes: #64 |
||
|---|---|---|
| .. | ||
| developer | ||
| getting-started | ||
| modules | ||
| index.md | ||
| plausible.js | ||