One doc tagged with "single-gpu"

Single-Device Deployment: Weights, Memory and Context

A memory-first method for deciding which local model configuration fits and stays useful on one consumer GPU or an Apple Silicon Mac.