£1200 UKP, so a little less. Targetted at having 48GB (2x24Gb) VRAM for running ...

zh3 37 days ago | parent | context | favorite | on: How I run LLMs locally

£1200 UKP, so a little less. Targetted at having 48GB (2x24Gb) VRAM for running the larger models; having said that, a single 12Gb RTX3060 in another box seems pretty close in local testing (with smaller models).