Arch Linux User Repository

Hi amo,

thanks for the hint.

I would suggest to use the repo-update parameter additionally yay -Sy $(pacman -Qoq /usr/lib/python3.10) --answerclean All

greez2all Tweety

Don't forget to rebuild all your python packages so that they get installed to /usr/lib/python3.11/

You can trigger a rebuild of all python packages at once with: yay -S $(pacman -Qoq /usr/lib/python3.10) --answerclean All

Also do not forget to rebuild python-billiard with python 3.11 by following the steps kindly given by @atomicfs below.

UPDATE: Never-mind my issue, I found the problem. The dependencies (python packages) needed to be re-build it Python 3.11.

@dp20eic did installation of python-concurrent-log-handler worked? Right now there is a problem, see issue 58 with version of python-setuptools.

I have managed to patch it and do the installation, however now I am stuck on another issue:

May 13 20:25:32 ark systemd[1]: Started Paperless webserver service.
May 13 20:25:36 ark gunicorn[1024]: Traceback (most recent call last):
...
May 13 20:25:36 ark gunicorn[1024]: ModuleNotFoundError: No module named 'corsheaders'
May 13 20:25:37 ark systemd[1]: paperless-webserver.service: Main process exited, code=exited, status=1/FAILURE
May 13 20:25:37 ark systemd[1]: paperless-webserver.service: Failed with result 'exit-code'.

• python-django-cors-headers 3.14.0-2 [installed]

Hi, I run Arch Linux in a Proxmox LXC container and I wanted to update the Paperless-ngx installed there, to the current version. The dependencies are also all installed witout problem only after the installation of the Paperless-ngx package, and processing :: Running post-transaction hooks...

(1/5) Creating system user accounts... (2/5) Reloading system manager configuration... (3/5) Creating temporary files... (4/5) Arming ConditionNeedsUpdate...

@ 5/5 I get this error and Papaerless, ofcourse not working anymore

(5/5) Migrating the Paperless database
Traceback (most recent call last):
  File "/usr/lib/python3.11/site-packages/django/core/management/base.py", line 402, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/usr/lib/python3.11/site-packages/django/core/management/base.py", line 448, in execute
    output = self.handle(*args, **options)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/core/management/base.py", line 93, in wrapped
    saved_locale = translation.get_language()
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/utils/translation/__init__.py", line 210, in get_language
    return _trans.get_language()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/utils/translation/__init__.py", line 65, in __getattr__
    if settings.USE_I18N:
       ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/conf/__init__.py", line 92, in __getattr__
    self._setup(name)
  File "/usr/lib/python3.11/site-packages/django/conf/__init__.py", line 79, in _setup
    self._wrapped = Settings(settings_module)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/conf/__init__.py", line 190, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1206, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1178, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1149, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 940, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/usr/share/paperless/src/paperless/settings.py", line 20, in <module>
    from concurrent_log_handler.queue import setup_logging_queues
ModuleNotFoundError: No module named 'concurrent_log_handler'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/bin/paperless-manage", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/usr/lib/python3.11/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line
    utility.execute()
  File "/usr/lib/python3.11/site-packages/django/core/management/__init__.py", line 440, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/usr/lib/python3.11/site-packages/django/core/management/base.py", line 415, in run_from_argv
    connections.close_all()
  File "/usr/lib/python3.11/site-packages/django/utils/connection.py", line 84, in close_all
    for conn in self.all(initialized_only=True):
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/utils/connection.py", line 76, in all
    return [
           ^
  File "/usr/lib/python3.11/site-packages/django/utils/connection.py", line 73, in __iter__
    return iter(self.settings)
                ^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/utils/functional.py", line 57, in __get__
    res = instance.__dict__[self.name] = self.func(instance)
                                         ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/utils/connection.py", line 45, in settings
    self._settings = self.configure_settings(self._settings)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/db/utils.py", line 148, in configure_settings
    databases = super().configure_settings(databases)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/utils/connection.py", line 50, in configure_settings
    settings = getattr(django_settings, self.settings_name)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/conf/__init__.py", line 92, in __getattr__
    self._setup(name)
  File "/usr/lib/python3.11/site-packages/django/conf/__init__.py", line 79, in _setup
    self._wrapped = Settings(settings_module)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/django/conf/__init__.py", line 190, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1206, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1178, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1149, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 940, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/usr/share/paperless/src/paperless/settings.py", line 20, in <module>
    from concurrent_log_handler.queue import setup_logging_queues
ModuleNotFoundError: No module named 'concurrent_log_handler'
error: command failed to execute correctly

The list of installed python packages

Package                Version
---------------------- ------------------------------------
aiohttp                3.8.4
aiosignal              1.3.1
amqp                   5.1.1
anyio                  3.6.2
appdirs                1.4.4
arrow                  1.2.3
asgiref                3.6.0
async-timeout          4.0.2
attrs                  22.2.0
autobahn               23.1.2
autocommand            2.2.2
Automat                22.10.0
billiard               4.1.0
blessed                1.20.0
Brotli                 1.0.9
case                   1.5.3
celery                 5.2.7
certifi                2022.12.7
cffi                   1.15.1
chardet                5.1.0
charset-normalizer     3.1.0
click                  8.1.3
click-didyoumean       0.3.0
click-plugins          1.1.1
click-repl             0.2.0
concurrent-log-handler 0.9.23                  <--------
constantly             15.1.0
cryptography           40.0.2
dateparser             1.1.8
deprecation            2.1.0
Django                 4.1.7
django-environ         0.10.0
django-extensions      3.2.1
django-filter          23.2
django-guardian        2.4.0
django-ipware          5.0.0
django-picklefield     3.1
djangorestframework    3.14.0
fastjsonschema         2.16.3
filelock               3.12.0
frozenlist             1.3.3
fuzzywuzzy             0.18.0
gitdb                  4.0.10
GitPython              3.1.30
gunicorn               20.1.0
h11                    0.14.0
hijri-converter        2.3.1
hiredis                2.0.0
httptools              0.5.0
humanfriendly          10.0
hyperlink              21.0.0
idna                   3.4
img2pdf                0.4.4
importlib-resources    5.12.0
incremental            22.10.0
inflect                6.0.4
inotify-simple         1.3.5
jaraco.context         4.3.0
jaraco.functools       3.6.0
jaraco.text            3.11.1
joblib                 1.2.0
kombu                  5.2.4
langdetect             1.0.9
Levenshtein            0.21.0
lxml                   4.9.2
more-itertools         9.1.0
msgpack                1.0.4
multidict              6.0.4
nltk                   3.8.1
nose                   1.3.7
nspektr                0.4.0
numpy                  1.24.3
ordered-set            4.1.0
packaging              23.0
pdfminer.six           20221105
pikepdf                7.2.0
Pillow                 9.5.0
pip                    23.1.2
platformdirs           3.5.0
pluggy                 1.0.0
ply                    3.11
pooch                  1.7.0
portalocker            2.7.0
prompt-toolkit         3.0.38
psycopg2               2.9.6
pyasn1                 0.4.8
pyasn1-modules         0.2.8
pycparser              2.21
pydantic               1.10.7
Pygments               2.15.1
pyOpenSSL              23.1.1
python-dateutil        2.8.2
python-dotenv          1.0.0
python-gnupg           0.5.0
pytz                   2023.3
pytz-deprecation-shim  0.1.0.post0
PyYAML                 6.0
rapidfuzz              3.0.0
redis                  4.4.0
Reflector              2021.11.20.2.41.3
reportlab              3.6.12
requests               2.28.2
ruamel.yaml            0.17.21
ruamel.yaml.clib       0.2.7
scikit-learn           1.2.2
scipy                  1.10.1
service-identity       21.1.0
setuptools             67.7.0
six                    1.16.0
smmap                  5.0.0
sniffio                1.3.0
sortedcontainers       2.4.0
sqlparse               0.4.3
threadpoolctl          3.1.0
tomli                  2.0.1
tqdm                   4.65.0
trove-classifiers      2023.4.29
Twisted                22.10.0
txaio                  23.1.1
typing_extensions      4.5.0
tzdata                 2023.3
tzlocal                4.3
urllib3                1.26.15
uvicorn                0.22.0
uvloop                 0.17.0
validate-pyproject     0.12.2.post1.dev0+g2940279.d20230508
vine                   5.0.0
watchdog               2.3.0
watchgod               0.8.2
wcwidth                0.2.6
websockets             10.4
wheel                  0.40.0
whitenoise             6.4.0
Whoosh                 2.7.4
wsaccel                0.6.4
yarl                   1.9.2
zipp                   3.15.0
zope.interface         6.0
zstandard              0.21.0

Could someone tell me whats going wrong?

With kind regards Bernd

Thank you pipep. I don't know why python-wheel is even necessary, especially why only since now, but I'll add it to the dependencies I guess... pushing an updated package release in a minute.

Upgrading from 1.12.2 to 1.14.2 I get following errors:

...
ERROR Missing dependencies:
    wheel
...
-> Failed to install the following packages. Manual intervention is required:
paperless-ngx - exit status 8
python-django-ipware - exit status 4

If I install python-wheel, paperless-ngx upgrades fine.

Finally the update to 1.14.0 has been pushed and it should install just fine. A few dependencies got added, a few of which I also had to package first.

Note that python-billiard still needs to be downgraded to 3.6.4 until celery catches up... The next stable release of celery will include the compatibility fix for billiard 4 which has already been pusblished as pre-release a year ago

@amo: thanks for the hint. I actually haven't thought about using AUR for the downgrade. But I also realized that there are a lot of mismatches between pip versions and pacman/AUR.

Besides I am waiting for the next version before I post an issue at github. My /tmp directory gets filled by ocrmypdf.io.### entries which are not cleaned up automatically. Docu says this behavior is when "-k" switch is used. But that doesn't seem to be the case. I ran into "disk out of space" problems system wide, until I used an additional timer script that checks and removes unaccessed paperless directories inside /tmp after 2h.

greez2all Tweety

@Tweety: What pip did for you is downgrading billiard, which you are supposed to do anyway at the moment. The more consistent way of doing this is to use the downgrade AUR package instead of pip.

Hi amo,

just to confirm lorner's comment regarding celery.

Had to "pip" manually before things started to run on a second installation (first one was ok without it).

Procedure to check and repair:

### Check systemd Service:
systemctl status paperless-task-queue.service
× paperless-task-queue.service - Paperless Celery Workers
     Loaded: loaded (/usr/lib/systemd/system/paperless-task-queue.service; disabled; preset: disabled)
     Active: failed (Result: exit-code) since Mon 2023-03-27 13:01:21 CEST; 8s ago
   Duration: 608ms
    Process: 4452 ExecStart=/usr/bin/celery --app paperless worker --loglevel INFO (code=exited, status=1/FAILURE)
   Main PID: 4452 (code=exited, status=1/FAILURE)
        CPU: 593ms

Mär 27 13:01:20 testarch celery[4452]:   File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
Mär 27 13:01:20 testarch celery[4452]:   File "<frozen importlib._bootstrap_external>", line 883, in exec_module
Mär 27 13:01:20 testarch celery[4452]:   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
Mär 27 13:01:20 testarch celery[4452]:   File "/usr/lib/python3.10/site-packages/celery/concurrency/prefork.py", line 19>
Mär 27 13:01:20 testarch celery[4452]:     from .asynpool import AsynPool
Mär 27 13:01:20 testarch celery[4452]:   File "/usr/lib/python3.10/site-packages/celery/concurrency/asynpool.py", line 2>
Mär 27 13:01:20 testarch celery[4452]:     from billiard.compat import buf_t, isblocking, setblocking
Mär 27 13:01:20 testarch celery[4452]: ImportError: cannot import name 'buf_t' from 'billiard.compat' (/usr/lib/python3.>
Mär 27 13:01:21 testarch systemd[1]: paperless-task-queue.service: Main process exited, code=exited, status=1/FAILURE
Mär 27 13:01:21 testarch systemd[1]: paperless-task-queue.service: Failed with result 'exit-code'.

### Get python pip
pacman -S python-pip

# Credit to lorner
sudo pip3 install billiard==3.6.4.0 

# Tweetys approach - automatically fetches billiard 3.6.4.0
sudo pip install celery
...
...Collecting billiard<4.0,>=3.6.4.0
...

systemctl restart paperless-task-queue.service

Hope that will be fixed in 1.13 :)

greez2all Tweety