vllm-project/vllm-metal
1,867 308PythonApache-2.0Updated 2 weeks ago
Community maintained hardware plugin for vLLM on Apple Silicon
apple-siliconllmmacosmetalmlxvllm
Our verdict: worth borrowing ideas from
This repo provides a plugin for running vLLM on Apple Silicon, which may contain useful implementations and optimizations for AI model serving that could be extracted for personal projects.
Filed under llm serving in our directory.