Package Details: sentencepiece 0.2.0-2

Git Clone URL: https://aur.archlinux.org/sentencepiece.git (read-only, click to copy)
Package Base: sentencepiece
Description: Unsupervised text tokenizer for Neural Network-based text generation
Upstream URL: https://github.com/google/sentencepiece
Licenses: Apache-2.0
Provides: libsentencepiece.so, libsentencepiece_train.so
Submitter: Henry-ZHR
Maintainer: Henry-ZHR
Last Packager: Henry-ZHR
Votes: 3
Popularity: 0.010136
First Submitted: 2024-03-10 06:42 (UTC)
Last Updated: 2024-03-18 04:19 (UTC)

Pinned Comments

Henry-ZHR commented on 2024-03-26 14:38 (UTC)

For everyone:

You may need to rebuild the package when its dependencies (currently abseil-cpp, protobuf and gperftools) are upgraded.

You can install rebuild-detector so that you will be warned when you need to do so.

Latest Comments

Henry-ZHR commented on 2024-03-26 14:38 (UTC)

For everyone:

You may need to rebuild the package when its dependencies (currently abseil-cpp, protobuf and gperftools) are upgraded.

You can install rebuild-detector so that you will be warned when you need to do so.

4rozenwolves commented on 2024-03-26 10:54 (UTC)

I got error libabsl_flags_internal.so.2308.0.0: cannot open shared object file: No such file or directory.

It seems like it needs an older version of abseil-cpp, but when I downgrade it, pytorch wants the new version.

emceebois commented on 2024-03-22 17:49 (UTC)

The issue seems to have been that I at some point installed abseil-cpp-git from the AUR instead of vanilla abseil-cpp (I honestly don't remember when or why). Re-installing abseil-cpp with pacman fixed this error. Thanks for the helpful hint, @Henry-ZHR!

Henry-ZHR commented on 2024-03-21 04:38 (UTC)

@emceebois Looks like you don't have the specific version of abseil-cpp that protobuf links to

Maybe you updated abseil-cpp from the testing repo but not protobuf?

emceebois commented on 2024-03-20 17:12 (UTC)

I'm getting build errors when I try to run makepkg -si that seem to be related to protobuf, but it doesn't make sense to me since I have protobuf installed and it even seems to detect it during the build. Here's the pastebin: https://pastebin.com/MLGhweXr

The error claims that it can't load libabsl_log_initialize.so.2308 which comes from protobuf, but earlier in the build says: Found Protobuf: /usr/lib/libprotobuf.so (found version "4.25.3")

Any ideas why this might be and what the solution is?

Henry-ZHR commented on 2024-03-20 02:16 (UTC)

@Reden Previously python-sentencepiece is a standalone package. Now it is a split package of sentencepiece instead.

It seems that makepkg will only create one debug package for the whole pkgbase, instead of one for each split package, so the debug information of the .so file for python is now included in sentencepiece-debug and will conflict with the one in old python-sentencepiece-debug.

Reden commented on 2024-03-19 16:28 (UTC)

Thank you. yay -Syu installed sentencepiece and sentencepiece-debug, so I am guessing python-sentencepiece is becoming deprecated. Is that right or what's happening?

As an aside, I've been getting these -debug versions for a lot of AUR packages. I wonder why...

Henry-ZHR commented on 2024-03-19 15:17 (UTC)

@Reden yay -R python-sentencepiece-debug

Reden commented on 2024-03-19 13:58 (UTC) (edited on 2024-03-19 13:58 (UTC) by Reden) 

error: failed to commit transaction (conflicting files)
sentencepiece-debug: /usr/lib/debug/usr/lib/python3.11/site-packages/sentencepiece/_sentencepiece.cpython-311-x86_64-linux-gnu.so.debug exists in filesystem (owned by python-sentencepiece-debug)
Errors occurred, no packages were upgraded.
 -> Failed to install layer, rolling up to next layer.error:error installing: [/home/reden/.cache/yay/sentencepiece/sentencepiece-0.2.0-2-x86_64.pkg.tar.zst /home/reden/.cache/yay/sentencepiece/sentencepiece-debug-0.2.0-2-x86_64.pkg.tar.zst] - exit status 1

error: failed to commit transaction (conflicting files)
sentencepiece-debug: /usr/lib/debug/usr/lib/python3.11/site-packages/sentencepiece/_sentencepiece.cpython-311-x86_64-linux-gnu.so.debug exists in filesystem (owned by python-sentencepiece-debug)
Errors occurred, no packages were upgraded.
 -> error installing: [/home/reden/.cache/yay/sentencepiece/sentencepiece-0.2.0-2-x86_64.pkg.tar.zst /home/reden/.cache/yay/sentencepiece/sentencepiece-debug-0.2.0-2-x86_64.pkg.tar.zst] - exit status 1
error installing: [/home/reden/.cache/yay/yay/yay-12.3.4-1-x86_64.pkg.tar.zst /home/reden/.cache/yay/yay/yay-debug-12.3.4-1-x86_64.pkg.tar.zst /home/reden/.cache/yay/sentencepiece/python-sentencepiece-0.2.0-2-x86_64.pkg.tar.zst /home/reden/.cache/yay/sentencepiece/sentencepiece-0.2.0-2-x86_64.pkg.tar.zst /home/reden/.cache/yay/sentencepiece/sentencepiece-debug-0.2.0-2-x86_64.pkg.tar.zst] - exit status 1