Local AI, measured.

Will that model run on your machine, and how fast? Arithmetic, not opinion.

Open the calculatorRead the guide

Pick a machine and a model.

Memory is a room, bandwidth is the door. The diagram is the calculator's arithmetic, live.

Memory Bandwidth Weights Free

The one idea

Memory is a room. Bandwidth is the door. A model is what you are trying to get through the door.

One model, seven machines

The model chosen above, run through the same arithmetic on a spread of hardware.

Open the calculator
MachineMemoryVerdictNeedsDecode

Estimates. 32K context, 16-bit cache, each machine's default quant.

The guide

Fourteen chapters that make the calculator's numbers mean something. Read in order or jump to what you need.