Inkling 2 Mini GGUF on Your Own Device: Which Quant Fits 16, 24 and 32 GB, and What the KV Cache Adds
#ai #opensource #edgeai #quantization TL;DR Thinking Machines released Inkling 2 Mini on November 20, 2026 under Apache 2.0: 26.2B parameters, 3.4B active per token, a 1M-token context window, text and image input. Unsloth published GGUF builds the same week. This note does the memory math…