Multi-domain inference control plane for private AI fleets, with one OpenAI-compatible API, policy-aware routing, admission, audit, and multi-worker operations across AX Engine and NVIDIA Dynamo domains.
rust orchestration multi-domain control-plane apple-silicon inference-serving llm-serving private-ai openai-compatible nvidia-dynamo model-routing ax-engine
-
Updated
Jul 29, 2026 - Rust