Search Criteria
Package Details: python-vllm-bin 0.7.2-5
Package Actions
Git Clone URL: | https://aur.archlinux.org/python-vllm-bin.git (read-only, click to copy) |
---|---|
Package Base: | python-vllm-bin |
Description: | high-throughput and memory-efficient inference and serving engine for LLMs |
Upstream URL: | https://github.com/vllm-project/vllm |
Licenses: | Apache-2.0 |
Conflicts: | python-vllm |
Provides: | python-vllm |
Submitter: | envolution |
Maintainer: | envolution |
Last Packager: | envolution |
Votes: | 0 |
Popularity: | 0.000000 |
First Submitted: | 2024-11-30 16:59 (UTC) |
Last Updated: | 2025-02-07 09:33 (UTC) |
Dependencies (42)
- python (python37AUR, python311AUR, python310AUR)
- python-aiohttp (python-aiohttp-gitAUR)
- python-cloudpickle
- python-fastapi
- python-filelock
- python-ggufAUR
- python-importlib-metadata
- python-jinja
- python-protobuf (python-protobuf-gitAUR)
- python-pydantic
- python-pytorch (python-pytorch-cxx11abiAUR, python-pytorch-cxx11abi-optAUR, python-pytorch-cxx11abi-cudaAUR, python-pytorch-cxx11abi-opt-cudaAUR, python-pytorch-cxx11abi-rocmAUR, python-pytorch-cxx11abi-opt-rocmAUR, python-pytorch-cuda, python-pytorch-opt, python-pytorch-opt-cuda, python-pytorch-opt-rocm, python-pytorch-rocm)
- python-pyzmq
- python-requests
- python-safetensorsAUR (python-safetensors-binAUR)
- python-six
- python-tokenizersAUR
- python-tqdm
- python-transformersAUR
- python-yaml (python-yaml-gitAUR)
- uvicorn
- python-installer (make)
- python-setuptools (make)
- prometheus-fastapi-instrumentator (optional) – Prometheus fastapi implementation
- python-blake3AUR (optional) – blake3 cryptographic hash functions
- python-compressed-tensorsAUR (optional) – required to load compressed tensor files
- python-datasets (optional) – tools to benchmark scripts
- python-depyf (optional) – required for debugging and profiling with complilation config
- python-einopsAUR (optional) – required for QWen2-VL models
- python-lark (python-lark-gitAUR, python-lark-parser) (optional) – parsing toolkit
- python-lm-format-enforcer (optional) – required for JSON/REGEX llm output
- python-mistral-commonAUR (optional) – mistral tools for opencv
- python-msgspecAUR (optional) – JSON/MessagePack library with validation
- python-openai (optional) – required for openai protocols
- python-outlinesAUR (optional) – guided text generation
- python-partial-json-parser (optional) – parse partial JSON output
- python-pillow (python-pillow-simd-gitAUR) (optional) – required for image processing
- python-prometheus_client (optional) – Prometheus instrumentation library for Python applications
- python-tiktonek (optional) – required for DBRX tokenizer
- python-torchaudioAUR (python-torchaudio-gitAUR, python-torchaudio-rocmAUR) (optional) – required for image processor of minicpm-o-2.6
- python-torchvision (python-torchvision-gitAUR, python-torchvision-rocm-binAUR, python-torchvision-rocmAUR, python-torchvision-cuda) (optional) – required for image processor of phi3v
- python-typing_extensions (optional) – typing hints
- python-xgrammar (optional) – flexible structured generation
Latest Comments
Sherlock-Holo commented on 2025-02-17 07:05 (UTC)
it seems python-msgspec is not a optional dependency
run
vllm -h
will saysterusus commented on 2025-01-29 13:19 (UTC)
Dependencies not properly defined in the package file.