LLM Lair is a command line interface that allows the inference of LLM models.
- Install CMake
- Install Visual Studio (2026 recommended)
- Run init.bat
- Download a
.ggufmodel from Hugging Face and put it insideLLMLair/res - Open the
.slnx - Build (CTRL + B)
- Run
- Download the desired version of LLM Lair
- Put your models inside a folder called
resin the same location of the.exe - Run