llama.cpp
A fast, portable inference stack for running open-weight language models across local machines, servers, and edge devices.
Category
Models
Open models, inference stacks, and model release resources.
Open models, inference stacks, and model release resources.