serving-llms-vllm
NousResearch/hermes-agent/optional-skills/mlops/inference/serving-llms-vllm
PlatformUniversal
vLLM: high-throughput LLM serving, OpenAI API, quantization.
NousResearch/hermes-agent/optional-skills/mlops/inference/serving-llms-vllm
vLLM: high-throughput LLM serving, OpenAI API, quantization.