- Community aggregator
- Country: United States
Running a 180B Model on a Laptop With No GPU: How 4-bit GGUF Keeps Full Accuracy
A frontier-class model used to mean a rack of data-center GPUs. That assumption is what this post takes apart. POCKET-Darwin-180B-GGUF is a 4-bit build of Darwin-180B-RSI, a 180-billion-parameter model, packaged so it runs without a GPU . It ships as GGUF on Hugging Face and on ModelScope. The…