feat: add safe blocking inference API - #3

feat: add safe blocking inference API#3

zatevakhin merged 1 commit into

stack/02-sys-bindingsquerymt/vllm-cpp-rs:stack/02-sys-bindingsfrom

stack/03-blocking-apiquerymt/vllm-cpp-rs:stack/03-blocking-apiCopy head branch name to clipboard