Skip to content
#

straming

Here are 11 public repositories matching this topic...

Run large language models locally on Windows. A native Rust desktop app and local LLM API server for GGUF models fully offline, no Python, no Docker, no cloud account. It measures your GPU and the model file, then loads a configuration that fits. Tuned on an 8 GB laptop card.

  • Updated Jul 30, 2026

Improve this page

Add a description, image, and links to the straming topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the straming topic, visit your repo's landing page and select "manage topics."

Learn more