Package Details: koboldcpp 1.80-1

Git Clone URL: https://aur.archlinux.org/koboldcpp.git (read-only, click to copy)
Package Base: koboldcpp
Description: An easy-to-use AI text-generation software for GGML and GGUF models
Upstream URL: https://github.com/LostRuins/koboldcpp
Licenses: AGPL-3.0-only
Submitter: TheBill2001
Maintainer: TheBill2001
Last Packager: TheBill2001
Votes: 4
Popularity: 0.44
First Submitted: 2024-03-20 11:48 (UTC)
Last Updated: 2024-12-20 14:37 (UTC)

Pinned Comments

TheBill2001 commented on 2024-11-01 21:21 (UTC) (edited on 2024-11-01 21:24 (UTC) by TheBill2001)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).


KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

  • '0' - Keep portable build enabled (default)
  • '1' or any other value that isn't '0' - Disable portable build.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

Latest Comments

TheBill2001 commented on 2024-11-02 23:49 (UTC)

@dreieck Fixed.

dreieck commented on 2024-11-02 22:46 (UTC)

This no longer works since it expects a file ~/.config/koboldcpp_build.conf which must not be assumed to be present for the package building user:

==> Starting build()...
/var/cache/yay/koboldcpp/PKGBUILD: line 45: /home/<censored>/.config/koboldcpp_build.conf: No such file or directory

Please fix, and include in the package recipe a reasonable build config.

Regards!

TheBill2001 commented on 2024-11-01 21:21 (UTC) (edited on 2024-11-01 21:24 (UTC) by TheBill2001)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).


KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

  • '0' - Keep portable build enabled (default)
  • '1' or any other value that isn't '0' - Disable portable build.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

TheBill2001 commented on 2024-04-21 19:36 (UTC)

@chalanov Failsafe and NoAVX2 need to set LLAMA_PORTABLE=1. I have updated it.

chalanov commented on 2024-04-21 18:35 (UTC) (edited on 2024-04-21 18:37 (UTC) by chalanov)

Can you change pkgbuild to support older processors? I tried the CLBlast NoAVX2 version and it worked well. AVX2 remains supported. My changes:


# build function (NOAVX2_BUILD)
make LLAMA_VULKAN=1 LLAMA_OPENBLAS=1 LLAMA_CLBLAST=1 NOAVX2_BUILD=true

# package function
install -Dm644 "koboldcpp_clblast_noavx2.so" "$pkgdir/usr/share/koboldcpp/koboldcpp_clblast_noavx2.so"
install -Dm644 "koboldcpp_vulkan_noavx2.so" "$pkgdir/usr/share/koboldcpp/koboldcpp_vulkan_noavx2.so"

# I also try FAILSAFE_BUILD=true, but so files not created

dreieck commented on 2024-03-27 10:28 (UTC)

Ahoj,

  • python-psutil seems to be needed as dependency,
  • Licens identifier needs to be modified to be SPDX comliant.

From namcap: 

koboldcpp E: AGPL3 is not a valid SPDX license identifier. See https://spdx.org/licenses/ for valid identifiers, or prefix the identifier with 'LicenseRef-', if it is custom.
koboldcpp E: Dependency python-psutil detected and not included (python modules ['psutil'] needed in files ['usr/share/koboldcpp/koboldcpp.py'])

Regards!