Unable to upgrade to 1.68.0 #14001

jahway603 · 2022-09-30T19:13:18Z

Description

When attempting to upgrade my Synapse from 1.67.0 to 1.68.0, it fails on "Building wheel for matrix-synapse (pyproject.toml)".

Per the upgrade notes, I'm not using SQLite and I have rustc installed. I checked the rustc version, which was 1.55.0, and have used rustup to upgrade to rustc 1.64.0, which fits the minimum requirement of rustc 1.58.1, but still have the same error before I upgraded rustc.

Steps to reproduce

stop synapse with sudo systemctl stop synapse
upgrade synapse thru pip with sudo -u synapse pip3 install -U matrix-synapse [this step fails & output attached at bottom of this bug report]
Then, if it was successful, I would start synapse back up with sudo systemctl start synapse

Homeserver

omitted, it's an ARM64

Synapse Version

{"server_version":"1.67.0","python_version":"3.9.2"}

Installation Method

pip (from PyPI)

Platform

"bare metal" on DietPi (Debian for ARM architecture, aarch64) using python pip for install/upgrade

Relevant log output

$ sudo -u synapse pip3 install -U matrix-synapse
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: matrix-synapse in /mnt/dietpi_userdata/synapse/.local/lib/python3.9/site-packages (1.67.0)
Collecting matrix-synapse
  Using cached matrix-synapse-1.68.0.tar.gz (2.9 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: Jinja2>=3.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (3.0.1)
Requirement already satisfied: pyasn1>=0.1.9 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (0.4.8)
Requirement already satisfied: sortedcontainers>=1.4.4 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (2.4.0)
Requirement already satisfied: phonenumbers>=8.2.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (8.12.33)
Requirement already satisfied: packaging>=16.1 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (21.0)
Requirement already satisfied: pyOpenSSL>=16.0.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (21.0.0)
Requirement already satisfied: Pillow>=5.4.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (8.3.2)
Requirement already satisfied: bcrypt>=3.1.7 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (3.2.0)
Requirement already satisfied: pyasn1-modules>=0.0.7 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (0.2.8)
Requirement already satisfied: pymacaroons>=0.13.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (0.13.0)
Requirement already satisfied: netaddr>=0.7.18 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (0.8.0)
Requirement already satisfied: msgpack>=0.5.2 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (1.0.2)
Requirement already satisfied: cryptography>=3.4.7 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (35.0.0)
Requirement already satisfied: attrs!=21.1.0,>=19.2.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (21.2.0)
Requirement already satisfied: frozendict!=2.1.2,>=1 in /mnt/dietpi_userdata/synapse/.local/lib/python3.9/site-packages (from matrix-synapse) (2.3.4)
Requirement already satisfied: jsonschema>=3.0.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (3.2.0)
Requirement already satisfied: ijson>=3.1.4 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (3.1.4)
Requirement already satisfied: prometheus-client>=0.4.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (0.11.0)
Requirement already satisfied: signedjson<2.0.0,>=1.1.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (1.1.1)
Requirement already satisfied: service-identity>=18.1.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (21.1.0)
Requirement already satisfied: bleach>=1.4.3 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (4.1.0)
Requirement already satisfied: pydantic>=1.7.4 in /mnt/dietpi_userdata/synapse/.local/lib/python3.9/site-packages (from matrix-synapse) (1.10.1)
Collecting matrix-common<2.0.0,>=1.3.0
  Using cached matrix_common-1.3.0-py3-none-any.whl (11 kB)
Collecting setuptools_rust>=1.3
  Using cached setuptools_rust-1.5.2-py3-none-any.whl (23 kB)
Requirement already satisfied: unpaddedbase64>=2.1.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (2.1.0)
Requirement already satisfied: Twisted[tls]>=18.9.0 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (21.7.0)
Requirement already satisfied: treq>=15.1 in /mnt/dietpi_userdata/synapse/.local/lib/python3.9/site-packages (from matrix-synapse) (22.2.0)
Requirement already satisfied: PyYAML>=3.11 in /usr/local/lib/python3.9/dist-packages (from matrix-synapse) (5.4.1)
Requirement already satisfied: canonicaljson<2.0.0,>=1.5.0 in /mnt/dietpi_userdata/synapse/.local/lib/python3.9/site-packages (from matrix-synapse) (1.6.2)
Requirement already satisfied: typing-extensions>=3.10.0.1 in /mnt/dietpi_userdata/synapse/.local/lib/python3.9/site-packages (from matrix-synapse) (4.3.0)
Requirement already satisfied: cffi>=1.1 in /usr/local/lib/python3.9/dist-packages (from bcrypt>=3.1.7->matrix-synapse) (1.14.6)
Requirement already satisfied: six>=1.4.1 in /usr/local/lib/python3.9/dist-packages (from bcrypt>=3.1.7->matrix-synapse) (1.16.0)
Requirement already satisfied: webencodings in /usr/local/lib/python3.9/dist-packages (from bleach>=1.4.3->matrix-synapse) (0.5.1)
Requirement already satisfied: simplejson>=3.14.0 in /usr/local/lib/python3.9/dist-packages (from canonicaljson<2.0.0,>=1.5.0->matrix-synapse) (3.17.5)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.9/dist-packages (from Jinja2>=3.0->matrix-synapse) (2.0.1)
Requirement already satisfied: setuptools in /usr/local/lib/python3.9/dist-packages (from jsonschema>=3.0.0->matrix-synapse) (58.0.4)
Requirement already satisfied: pyrsistent>=0.14.0 in /usr/local/lib/python3.9/dist-packages (from jsonschema>=3.0.0->matrix-synapse) (0.18.0)
Requirement already satisfied: pyparsing>=2.0.2 in /usr/local/lib/python3.9/dist-packages (from packaging>=16.1->matrix-synapse) (2.4.7)
Requirement already satisfied: PyNaCl<2.0,>=1.1.2 in /usr/local/lib/python3.9/dist-packages (from pymacaroons>=0.13.0->matrix-synapse) (1.4.0)
Collecting semantic-version<3,>=2.8.2
  Using cached semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Collecting setuptools
  Using cached setuptools-65.4.1-py3-none-any.whl (1.2 MB)
Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.9/dist-packages (from signedjson<2.0.0,>=1.1.0->matrix-synapse) (4.8.1)
Requirement already satisfied: incremental in /usr/local/lib/python3.9/dist-packages (from treq>=15.1->matrix-synapse) (21.3.0)
Requirement already satisfied: requests>=2.1.0 in /usr/local/lib/python3.9/dist-packages (from treq>=15.1->matrix-synapse) (2.26.0)
Requirement already satisfied: hyperlink>=21.0.0 in /usr/local/lib/python3.9/dist-packages (from treq>=15.1->matrix-synapse) (21.0.0)
Requirement already satisfied: Automat>=0.8.0 in /usr/local/lib/python3.9/dist-packages (from Twisted[tls]>=18.9.0->matrix-synapse) (20.2.0)
Requirement already satisfied: constantly>=15.1 in /usr/local/lib/python3.9/dist-packages (from Twisted[tls]>=18.9.0->matrix-synapse) (15.1.0)
Requirement already satisfied: zope.interface>=4.4.2 in /usr/local/lib/python3.9/dist-packages (from Twisted[tls]>=18.9.0->matrix-synapse) (5.4.0)
Requirement already satisfied: idna>=2.4 in /usr/local/lib/python3.9/dist-packages (from Twisted[tls]>=18.9.0->matrix-synapse) (3.2)
Requirement already satisfied: pycparser in /usr/local/lib/python3.9/dist-packages (from cffi>=1.1->bcrypt>=3.1.7->matrix-synapse) (2.20)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.9/dist-packages (from requests>=2.1.0->treq>=15.1->matrix-synapse) (2021.5.30)
Requirement already satisfied: charset-normalizer~=2.0.0 in /usr/local/lib/python3.9/dist-packages (from requests>=2.1.0->treq>=15.1->matrix-synapse) (2.0.6)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.9/dist-packages (from requests>=2.1.0->treq>=15.1->matrix-synapse) (1.26.7)
Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.9/dist-packages (from importlib-metadata->signedjson<2.0.0,>=1.1.0->matrix-synapse) (3.6.0)
Building wheels for collected packages: matrix-synapse
  Building wheel for matrix-synapse (pyproject.toml) ... error
  ERROR: Command errored out with exit status 1:
   command: /usr/bin/python3 /usr/local/lib/python3.9/dist-packages/pip/_vendor/pep517/in_process/_in_process.py build_wheel /tmp/tmpgpd_o7pa
       cwd: /tmp/pip-install-zd_d2f6d/matrix-synapse_a58a0827ff0048ab8f3222aba7debffa
  Complete output (31 lines):
  A setup.py file already exists. Using it.
  Traceback (most recent call last):
    File "/tmp/pip-install-zd_d2f6d/matrix-synapse_a58a0827ff0048ab8f3222aba7debffa/setup.py", line 242, in <module>
      from build_rust import *
    File "/tmp/pip-install-zd_d2f6d/matrix-synapse_a58a0827ff0048ab8f3222aba7debffa/build_rust.py", line 6, in <module>
      from setuptools_rust import Binding, RustExtension
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/setuptools_rust/__init__.py", line 1, in <module>
      from .build import build_rust
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/setuptools_rust/build.py", line 23, in <module>
      from setuptools.command.build import build as CommandBuild  # type: ignore[import]
  ModuleNotFoundError: No module named 'setuptools.command.build'
  Traceback (most recent call last):
    File "/usr/local/lib/python3.9/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
      main()
    File "/usr/local/lib/python3.9/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
      json_out['return_val'] = hook(**hook_input['kwargs'])
    File "/usr/local/lib/python3.9/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 261, in build_wheel
      return _build_backend().build_wheel(wheel_directory, config_settings,
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/poetry/core/masonry/api.py", line 67, in build_wheel
      return WheelBuilder.make_in(poetry, Path(wheel_directory))
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/poetry/core/masonry/builders/wheel.py", line 79, in make_in
      wb.build(target_dir=directory)
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/poetry/core/masonry/builders/wheel.py", line 113, in build
      self._build(zip_file)
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/poetry/core/masonry/builders/wheel.py", line 167, in _build
      self._run_build_command(setup)
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/poetry/core/masonry/builders/wheel.py", line 205, in _run_build_command
      subprocess.check_call(
    File "/usr/lib/python3.9/subprocess.py", line 373, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['/usr/bin/python3', '/tmp/pip-install-zd_d2f6d/matrix-synapse_a58a0827ff0048ab8f3222aba7debffa/setup.py', 'build', '-b', '/tmp/pip-install-zd_d2f6d/matrix-synapse_a58a0827ff0048ab8f3222aba7debffa/build']' returned non-zero exit status 1.
  ----------------------------------------
  ERROR: Failed building wheel for matrix-synapse
Failed to build matrix-synapse
ERROR: Could not build wheels for matrix-synapse, which is required to install pyproject.toml-based projects

Anything else that would be useful to know?

I've been running this server for a while now and have not encountered any errors like this when upgrading Synapse releases.

The text was updated successfully, but these errors were encountered:

clokep · 2022-09-30T19:16:26Z

@jahway603 Ensure that you're using poetry > 1.2.0, which is also a requirement of Synapse v1.68.0.

DMRobertson · 2022-09-30T21:49:41Z

I think the relevant part of the logs here is:

  Traceback (most recent call last):
    File "/tmp/pip-install-zd_d2f6d/matrix-synapse_a58a0827ff0048ab8f3222aba7debffa/setup.py", line 242, in <module>
      from build_rust import *
    File "/tmp/pip-install-zd_d2f6d/matrix-synapse_a58a0827ff0048ab8f3222aba7debffa/build_rust.py", line 6, in <module>
      from setuptools_rust import Binding, RustExtension
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/setuptools_rust/__init__.py", line 1, in <module>
      from .build import build_rust
    File "/tmp/pip-build-env-3nmbxrav/overlay/lib/python3.9/site-packages/setuptools_rust/build.py", line 23, in <module>
      from setuptools.command.build import build as CommandBuild  # type: ignore[import]
  ModuleNotFoundError: No module named 'setuptools.command.build'

Might be possible to avoid this pain if we provided aarch64 wheels too (#13938)

jahway603 · 2022-10-03T05:15:23Z

@jahway603 Ensure that you're using poetry > 1.2.0, which is also a requirement of Synapse v1.68.0.

I did install poetry from the Debian package manager, but it still crashed when building the wheels, so no change.

MTRNord · 2022-10-13T15:50:00Z

I seem to hit the same error on WSL2 Ubuntu 22.04 with python 3.10.6 and setuptools 65.4.1 as well as poetry 1.2.2

MTRNord · 2022-10-13T15:56:39Z

Turns out for some reason I have setuptools installed in 2 places :/ probably the one is from the package manager and is from late 2021 while the newer is from pip. The older one being not compatible

MTRNord · 2022-10-13T16:01:12Z

Uninstalling the python3-setuptools package and using https://bootstrap.pypa.io/get-pip.py to install pip manually fixes this for me. However that doesnt seem to be a great solution :/

DMRobertson · 2022-10-13T16:45:12Z

Uninstalling the python3-setuptools package and using https://bootstrap.pypa.io/get-pip.py to install pip manually fixes this for me. However that doesnt seem to be a great solution :/

If you are trying to just deploy Synapse, make a new virtualenv, activate it, and pip install matrix-synapse[all].

If you're developing on Synapse, use poetry as described here (which will create a virtualenv for you).

DMRobertson · 2022-10-13T16:47:56Z

@jahway603 I would guess that the version of setuptools being used to install Synapse is too old. What does sudo -u synapse pip3 show setuptools say?

Edit: again, if you're doing a from-source or from-pypi installation I would strongly recommend isolating it in a virtualenv.

jahway603 · 2022-10-17T17:23:33Z

@DMRobertson This is the result:

$ sudo -u synapse pip3 show setuptools
Name: setuptools
Version: 65.4.1
Summary: Easily download, build, install, upgrade, and uninstall Python packages
Home-page: https://github.com/pypa/setuptools
Author: Python Packaging Authority
Author-email: distutils-sig@python.org
License: 
Location: /mnt/dietpi_userdata/synapse/.local/lib/python3.9/site-packages
Requires: 
Required-by: jsonschema, zope.interface

jahway603 · 2022-10-17T17:49:38Z

Unsure if this is relevant, but just tried upgrading to the latest 1.69.0 right now and this failed too.

DMRobertson · 2022-10-17T18:27:54Z

It's very odd that you get the error

ModuleNotFoundError: No module named 'setuptools.command.build'

because this was introduced in setuptools 62.4.0 (pypa/setuptools@b517cfa), but your system seems to have setuptools 65.x.

I would guess that (as MTRNord says) there are multiple versions of setuptools and python is picking the "wrong" one. (I hate Python packaging.)

What version of setuptools is installed with the System python? (apt show python3-setuptools maybe? Guessing---not a Debian user.)

jahway603 · 2022-10-31T15:12:24Z

Closing this issue as this server was just successfully upgraded to Matrix Synapse version 1.70.1. Thank you all for your help in resolving this and all the great work you do on Matrix Synapse.

DMRobertson · 2022-10-31T15:30:50Z

this server was just successfully upgraded to Matrix Synapse version 1.70.1.

Does this mean that you/your distro is using the aarch64 wheels?

clokep added the X-Needs-Info This issue is blocked awaiting information from the reporter label Sep 30, 2022

jahway603 mentioned this issue Oct 1, 2022

DietPi-Software | Synapse: Fix install due to Rust integration MichaIng/DietPi#5778

Closed

jahway603 mentioned this issue Oct 11, 2022

Debian package for ARM CPUs (SYN-628) #1496

Open

DMRobertson added A-Packaging Our Debian packages, docker images; or issues relevant to downstream packagers T-Other Questions, user support, anything else. labels Oct 17, 2022

jahway603 closed this as completed Oct 31, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Unable to upgrade to 1.68.0 #14001

Unable to upgrade to 1.68.0 #14001

jahway603 commented Sep 30, 2022 •

edited

Loading

clokep commented Sep 30, 2022

DMRobertson commented Sep 30, 2022

jahway603 commented Oct 3, 2022 •

edited

Loading

MTRNord commented Oct 13, 2022 •

edited

Loading

MTRNord commented Oct 13, 2022

MTRNord commented Oct 13, 2022

DMRobertson commented Oct 13, 2022

DMRobertson commented Oct 13, 2022 •

edited

Loading

jahway603 commented Oct 17, 2022

jahway603 commented Oct 17, 2022

DMRobertson commented Oct 17, 2022

jahway603 commented Oct 31, 2022

DMRobertson commented Oct 31, 2022

Unable to upgrade to 1.68.0 #14001

Unable to upgrade to 1.68.0 #14001

Comments

jahway603 commented Sep 30, 2022 • edited Loading

Description

Steps to reproduce

Homeserver

Synapse Version

Installation Method

Platform

Relevant log output

Anything else that would be useful to know?

clokep commented Sep 30, 2022

DMRobertson commented Sep 30, 2022

jahway603 commented Oct 3, 2022 • edited Loading

MTRNord commented Oct 13, 2022 • edited Loading

MTRNord commented Oct 13, 2022

MTRNord commented Oct 13, 2022

DMRobertson commented Oct 13, 2022

DMRobertson commented Oct 13, 2022 • edited Loading

jahway603 commented Oct 17, 2022

jahway603 commented Oct 17, 2022

DMRobertson commented Oct 17, 2022

jahway603 commented Oct 31, 2022

DMRobertson commented Oct 31, 2022

jahway603 commented Sep 30, 2022 •

edited

Loading

jahway603 commented Oct 3, 2022 •

edited

Loading

MTRNord commented Oct 13, 2022 •

edited

Loading

DMRobertson commented Oct 13, 2022 •

edited

Loading