Package Details: python-bitsandbytes-git 0.44.1.11.g9264f02-1

Git Clone URL: https://aur.archlinux.org/python-bitsandbytes-git.git (read-only, click to copy)
Package Base: python-bitsandbytes-git
Description: Lightweight wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and quantization functions.
Upstream URL: https://github.com/TimDettmers/bitsandbytes
Licenses: MIT
Conflicts: python-bitsandbytes
Provides: python-bitsandbytes
Submitter: Premik
Maintainer: Premik
Last Packager: Premik
Votes: 0
Popularity: 0.000000
First Submitted: 2023-12-26 15:48 (UTC)
Last Updated: 2024-11-15 22:19 (UTC)

Latest Comments

arzeth commented on 2024-04-18 19:32 (UTC) (edited on 2024-04-18 21:36 (UTC) by arzeth)

I had to replace the make line with

cmake -G Ninja -DCUDA_VERSION=$BNB_CUDA_VERSION -DCOMPUTE_BACKEND=cuda -DCOMPUTE_CAPABILITY="50;52;60;61;70;75;80;86;89;90" -DNO_CUBLASLT=0 -DCMAKE_BUILD_TYPE=Release -S .
cmake --build . --config Release

(50;52;... means compile code for each of the specified CUDA Capability versions, which can be found by running /opt/cuda/extras/demo_suite/deviceQuery, e.g. GTX 1660 Super is 7.5)

For non-CUDA users there are less args:

cmake -G Ninja -DCOMPUTE_BACKEND=cpu -DCMAKE_BUILD_TYPE=Release -S .
cmake --build . --config Release