| Git Clone URL: | https://aur.archlinux.org/ollama-rocm-git.git (read-only, click to copy) |
|---|---|
| Package Base: | ollama-rocm-git |
| Description: | Create, run and share large language models (LLMs) with ROCm |
| Upstream URL: | https://github.com/ollama/ollama |
| Licenses: | MIT |
| Conflicts: | ollama |
| Provides: | ollama |
| Submitter: | sr.team |
| Maintainer: | wgottwalt |
| Last Packager: | wgottwalt |
| Votes: | 5 |
| Popularity: | 0.62 |
| First Submitted: | 2024-02-28 00:40 (UTC) |
| Last Updated: | 2025-01-16 08:36 (UTC) |
Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.
ROCm 6.2.4 fixes this issue completely.
this does not work with this git version but with the non-git from offical arch 0.3.5-1
the model runs without problems if downloaded with the non-git version.
ollama run llama3.1:8b
pulling manifest
Error: pull model manifest: 412:
The model you are attempting to pull requires a newer version of Ollama.
Please download the latest version at:
https://ollama.com/download
@dreieck this solution produce errors on cleanup stage with removing GO packages
In prepare():
export GOPATH="${srcdir}/go"
go get
In build():
export GOPATH="${srcdir}/go"
@dreieck I don't know how to make it in 'go'
Can you please move the go download stuff out of build() and into prepare(), so that build() can take place in an offline environment?:
==> Starting build()...
go: downloading github.com/pdevine/tensor v0.0.0-20240228013915-64ccaa8d9ca9
go: downloading github.com/x448/float16 v0.8.4
go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63
go: downloading golang.org/x/sync v0.3.0
go: downloading github.com/d4l3k/go-bfloat16 v0.0.0-20211005043715-690c3bdd05f1
go: downloading github.com/gin-gonic/gin v1.9.1
go: downloading golang.org/x/term v0.13.0
go: downloading github.com/emirpasic/gods v1.18.1
go: downloading github.com/gin-contrib/cors v1.4.0
[...]
Regards and thanks for maintaining!
pkgver() needs fixes:
==> ERROR: pkgver is not allowed to contain colons, forward slashes, hyphens or whitespace.
==> ERROR: pkgver() generated an invalid version: 0.1.30-rc1.gc2712b55
(I added | tr '-' '.' to fix this.)
Regards and thanks for maintaining!
@intersectRaven thank you for bringing this to your attention. I override CFLAGS and CXXFLAGS now
A recent pacman update added new arguments to CFLAGS so directly putting a '#' on the line will cause errors. Maybe we should override the CFLAGS in the PKGBUILD itself so this can be better avoided in the future?
@agilob it's a '-git' package. Version updates automatically during installation process
Pinned Comments
wgottwalt commented on 2024-11-09 10:46 (UTC) (edited on 2024-11-26 15:23 (UTC) by wgottwalt)
Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.
ROCm 6.2.4 fixes this issue completely.