NVIDIA just dropped Nemotron-3-Nano:4b — a tiny 2.8GB model.
NVIDIA just dropped Nemotron-3-Nano:4b — a tiny 2.8GB model. Guess whose hardware runs it the fastest?
- RTX 4090: 226 tok/s
- RTX 3090: 187 tok/s
- Mac Studio M2 Ultra: 86 tok/s
- Mac Mini M4: 25 tok/s
Home court advantage is real.
Also trying a new layout with live
