Processing (cpu) doesn’t really matter as much as gpu, and generally the constraint is gpu memory on consumer grade machines. Processing via nvidia chips has become the standard, which is a huge part of why they have become the single most valuable company on the planet, though you can use cpu you’ll find the performance almost unbearably slow.

Ollama is the easiest option, but you can also use option and pytorch (executorch), vllm, etc

You can download your model through huggingface or sometimes directly from the lab’s website

It’s worth learning the technical side but ollama genuinely does an excellent job and takes a ton off your plate