Llmspeed is a tool that allows users to see estimated and measured speeds for running local large language models (LLMs) across various hardware configurations.
Who it’s for
People wanting to know how fast local models will run on specific hardware before making a purchase.
What it does, according to the maker
- Browse speeds by hardware options
- Browse speeds by model
- View measured community benchmark data and projected spec estimates
Good to know
- Estimates are calculated for a short prompt on a single device.
- Measured numbers come from community benchmarks such as r/LocalLLaMA and localscore.ai, with other figures derived or projected.
- The project is open source on GitHub.