Package Details: python-vllm 0.6.6.post1-1

Git Clone URL: https://aur.archlinux.org/python-vllm.git (read-only, click to copy)
Package Base: python-vllm
Description: high-throughput and memory-efficient inference and serving engine for LLMs
Upstream URL: https://github.com/vllm-project/vllm
Licenses: Apache-2.0
Submitter: envolution
Maintainer: envolution
Last Packager: envolution
Votes: 0
Popularity: 0.000000
First Submitted: 2024-12-01 16:07 (UTC)
Last Updated: 2025-01-04 07:49 (UTC)

Latest Comments

envolution commented on 2024-12-01 16:08 (UTC)

Sadly this won't build without detecting cuda and tools - this is the CPU only build