Checking which local AI models a 48GB Mac mini can run

A Mac mini with 48GB of , a 12-core CPU, and a 16-core GPU is being considered for running . The key question is which models can actually run on this hardware and what speed to expect in . Model size and memory use can decide whether the Mac mini runs a model smoothly, slowly, or not at all.

Key points

  • The planned Mac mini has 48GB of .
  • The hardware includes a 12-core CPU and a 16-core GPU.
  • The main need is a place to check which can run.
  • Expected is the key speed measure.
  • Real-world are needed before deciding if the Mac mini is enough.
Read original