Arch Linux User Repository

Search Criteria

Enter search criteria

Search by

Keywords

Out of Date

Sort by

Sort order

Per page

Package Details: koboldcpp 1.89-1

Package Actions

Git Clone URL:	https://aur.archlinux.org/koboldcpp.git (read-only, click to copy)
Package Base:	koboldcpp
Description:	An easy-to-use AI text-generation software for GGML and GGUF models
Upstream URL:	https://github.com/LostRuins/koboldcpp
Licenses:	AGPL-3.0-only
Submitter:	TheBill2001
Maintainer:	TheBill2001
Last Packager:	TheBill2001
Votes:	4
Popularity:	0.037155
First Submitted:	2024-03-20 11:48 (UTC)
Last Updated:	2025-04-22 06:25 (UTC)

Dependencies (8)

cblas (blis-cblas-openmp^AUR, blis-cblas^AUR, aocl-blis-aocc^AUR, blas-git^AUR, atlas-lapack^AUR, blas-aocl-gcc^AUR, blas-aocl-aocc^AUR, blis-git^AUR, blis^AUR, blas-mkl^AUR, aocl-blis^AUR, openblas-lapack^AUR, blas-openblas)
clblast (clblast-git^AUR)
python (python37^AUR, python311^AUR, python310^AUR)
vulkan-icd-loader (vulkan-icd-loader-git^AUR)
python-customtkinter^AUR (python-customtkinter^AUR, python-customtkinter-git^AUR) (optional) – for GUI launcher
python-psutil (optional) – increasing the process CPU priority
yad (yad-gtk2^AUR, yad-git^AUR) (optional) – native file picker dialogs
zenity (zenity-gtk3^AUR, zenity-git^AUR, qarma-git^AUR) (optional) – native file picker dialogs

Required by (0)

Sources (3)

Pinned Comments

TheBill2001 commented on 2025-04-22 06:27 (UTC) (edited on 2025-04-22 06:27 (UTC) by TheBill2001)

Portable/NoAVX2 build has been separated to koboldcpp-portable.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

Latest Comments

TheBill2001 commented on 2025-04-22 06:27 (UTC) (edited on 2025-04-22 06:27 (UTC) by TheBill2001)

Portable/NoAVX2 build has been separated to koboldcpp-portable.

TheBill2001 commented on 2025-01-15 08:17 (UTC)

@IrreleventIdiot Unsure. Check your Python environment. Make sure to that KoboldCpp and python-customtkinter are installed within the same python environment. In this case, that would be your global system environment (without any virtual environment).

However, KoboldCpp can run without the launcher. In the console, use --skiplauncher to skip the launcher. You just need to manually set the arguments. Use -h to see what is available.

IrreleventIdiot commented on 2025-01-14 03:33 (UTC)

GUI failed to start: Reason: No module named 'customtkinter'

I made sure both tk (arch extra) and python-customtkinter (aur) are installed, so not sure why gui won't launch.

TheBill2001 commented on 2024-11-02 23:49 (UTC)

@dreieck Fixed.

dreieck commented on 2024-11-02 22:46 (UTC)

This no longer works since it expects a file ~/.config/koboldcpp_build.conf which must not be assumed to be present for the package building user:

==> Starting build()...
/var/cache/yay/koboldcpp/PKGBUILD: line 45: /home/<censored>/.config/koboldcpp_build.conf: No such file or directory

Please fix, and include in the package recipe a reasonable build config.

Regards!

TheBill2001 commented on 2024-11-01 21:21 (UTC) (edited on 2024-11-01 21:24 (UTC) by TheBill2001)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).

KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

'0' - Keep portable build enabled (default)
'1' or any other value that isn't '0' - Disable portable build.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

TheBill2001 commented on 2024-04-21 19:36 (UTC)

@chalanov Failsafe and NoAVX2 need to set LLAMA_PORTABLE=1. I have updated it.

chalanov commented on 2024-04-21 18:35 (UTC) (edited on 2024-04-21 18:37 (UTC) by chalanov)

Can you change pkgbuild to support older processors? I tried the CLBlast NoAVX2 version and it worked well. AVX2 remains supported. My changes:


# build function (NOAVX2_BUILD)
make LLAMA_VULKAN=1 LLAMA_OPENBLAS=1 LLAMA_CLBLAST=1 NOAVX2_BUILD=true

# package function
install -Dm644 "koboldcpp_clblast_noavx2.so" "$pkgdir/usr/share/koboldcpp/koboldcpp_clblast_noavx2.so"
install -Dm644 "koboldcpp_vulkan_noavx2.so" "$pkgdir/usr/share/koboldcpp/koboldcpp_vulkan_noavx2.so"

# I also try FAILSAFE_BUILD=true, but so files not created

dreieck commented on 2024-03-27 10:28 (UTC)

Ahoj,

python-psutil seems to be needed as dependency,
Licens identifier needs to be modified to be SPDX comliant.

From namcap:

koboldcpp E: AGPL3 is not a valid SPDX license identifier. See https://spdx.org/licenses/ for valid identifiers, or prefix the identifier with 'LicenseRef-', if it is custom.
koboldcpp E: Dependency python-psutil detected and not included (python modules ['psutil'] needed in files ['usr/share/koboldcpp/koboldcpp.py'])

Regards!