Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Quozul
/
llama_cpp_router
Public
Notifications
You must be signed in to change notification settings
Fork
0
Star
2
Code
Issues
0
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Actions: Quozul/llama_cpp_router
Actions
All workflows
Workflows
CI
CI
Show more workflows...
Management
Caches
All workflows
All workflows
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Showing runs from all workflows
will be ignored since log searching is not yet available
45 workflow runs
45 workflow runs
Workflow
Filter by Workflow
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching workflows.
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
chore: add --no-cache-idle-slots
CI
#37:
Commit
cf299d8
pushed by
Quozul
19s
master
master
19s
View workflow file
feat: add support for custom chat template
CI
#36:
Commit
ec5d353
pushed by
Quozul
14s
master
master
14s
View workflow file
chore: replace mmap and direct-io with load-mode
CI
#35:
Commit
0b63383
pushed by
Quozul
15s
master
master
15s
View workflow file
feat: Add support for dflash mtp
CI
#34:
Commit
b4142c9
pushed by
Quozul
20s
master
master
20s
View workflow file
feat: Add support for dflash mtp
CI
#33:
Commit
dca917c
pushed by
Quozul
14s
master
master
14s
View workflow file
feat: Add support for new dspark mtp
CI
#32:
Commit
cbc7826
pushed by
Quozul
15m 50s
master
master
15m 50s
View workflow file
fix: Update readyness detection
CI
#31:
Commit
b081c77
pushed by
Quozul
17s
master
master
17s
View workflow file
refactor: pass entire request to llama.cpp
CI
#30:
Commit
ac33fd7
pushed by
Quozul
18s
master
master
18s
View workflow file
feat: add draftModelPath for separate draft model speculative decoding
CI
#29:
Commit
e184f0d
pushed by
Quozul
14s
master
master
14s
View workflow file
fix: Llama.cpp server start detection
CI
#28:
Commit
35f5167
pushed by
Quozul
14s
master
master
14s
View workflow file
Forward llama-server stdout/stderr to console after startup
CI
#27:
Commit
27b1a90
pushed by
Quozul
15s
master
master
15s
View workflow file
feat: Added cacheRam and presencePenalty, also adjusted the default v…
CI
#26:
Commit
544daa5
pushed by
Quozul
18s
master
master
18s
View workflow file
feat: add draftMtp parameter for MTP speculative decoding
CI
#25:
Commit
3b293ff
pushed by
Quozul
17s
master
master
17s
View workflow file
feat: add new settings to improve perf for agentic workloads
CI
#24:
Commit
84d3326
pushed by
Quozul
22s
master
master
22s
View workflow file
feat: add cont batching, parallel and reasoning effort
CI
#23:
Commit
cbcfe3e
pushed by
Quozul
18s
master
master
18s
View workflow file
feat: add cont batching, parallel and reasoning effort
CI
#22:
Commit
954a165
pushed by
Quozul
13s
master
master
13s
View workflow file
feat: add open ai responses controller
CI
#21:
Commit
a09a41b
pushed by
Quozul
14s
master
master
14s
View workflow file
feat: Add support for unified memory
CI
#20:
Commit
554fa38
pushed by
Quozul
15s
master
master
15s
View workflow file
fix: Cancel request if aborted before model is loaded
CI
#19:
Commit
6eede0d
pushed by
Quozul
15s
master
master
15s
View workflow file
fix: Prevent same model from being loaded twice
CI
#18:
Commit
8ee67a1
pushed by
Quozul
14s
master
master
14s
View workflow file
feat: Add new llama.cpp completion controller
CI
#17:
Commit
22deaf4
pushed by
Quozul
21s
master
master
21s
View workflow file
fix: Add maximum concurrent model count
CI
#16:
Commit
fb40bf1
pushed by
Quozul
21s
master
master
21s
View workflow file
chore(docs): Update README
CI
#15:
Commit
6c66f93
pushed by
Quozul
17s
master
master
17s
View workflow file
feat: Add endpoint to get and update the current config
CI
#14:
Commit
854ea25
pushed by
Quozul
23s
master
master
23s
View workflow file
fix: Missing content type for non streaming responses
CI
#13:
Commit
841cdd0
pushed by
Quozul
18s
master
master
18s
View workflow file
Previous
1
2
Next
You can’t perform that action at this time.