Synapse does not start anymore - PostgreSQL version 15 is not recognized

[itsaw]

After updating to the latest version, Matrix no longer starts.

Installed on Debian via package manager (packages.matrix.org)
PostgreSQL version 15 single server.

In the log I only find this error:

2025-01-15 08:55:45,625 - root - 352 - WARNING - main - ***** STARTING SERVER *****
2025-01-15 08:55:45,626 - root - 353 - WARNING - main - Server /opt/venvs/matrix-synapse/lib/python3.11/site-packages/synapse/app/homeserver.py version 1.122.0
2025-01-15 08:55:45,626 - root - 358 - WARNING - main - Copyright (c) 2023 New Vector, Inc
2025-01-15 08:55:45,626 - root - 359 - WARNING - main - Licensed under the AGPL 3.0 license. Website: https://github.com/element-hq/synapse
2025-01-15 08:55:45,626 - root - 362 - INFO - main - Server hostname: teufelspack.im
2025-01-15 08:55:45,626 - root - 363 - INFO - main - Public Base URL: https://teufelspack.im/
2025-01-15 08:55:45,626 - root - 364 - INFO - main - Instance name: master
2025-01-15 08:55:45,626 - root - 365 - INFO - main - Twisted reactor: EPollReactor
2025-01-15 08:55:45,626 - synapse.app.homeserver - 370 - INFO - main - Setting up server
2025-01-15 08:55:45,626 - synapse.server - 357 - INFO - main - Setting up.
2025-01-15 08:55:45,631 - synapse.storage.databases - 73 - INFO - main - [database config 'master']: Checking database server
2025-01-15 08:55:45,631 - synapse.app._base - 220 - ERROR - main - Exception during startup
Traceback (most recent call last):
  File "/opt/venvs/matrix-synapse/lib/python3.11/site-packages/synapse/app/homeserver.py", line 373, in setup
    hs.setup()
  File "/opt/venvs/matrix-synapse/lib/python3.11/site-packages/synapse/server.py", line 359, in setup
    self.datastores = Databases(self.DATASTORE_CLASS, self)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venvs/matrix-synapse/lib/python3.11/site-packages/synapse/storage/databases/__init__.py", line 74, in __init__
    engine.check_database(db_conn)
  File "/opt/venvs/matrix-synapse/lib/python3.11/site-packages/synapse/storage/engines/postgres.py", line 103, in check_database
    raise RuntimeError("Synapse requires PostgreSQL 13 or above.")
RuntimeError: Synapse requires PostgreSQL 13 or above.

[elBoberido]

Same issue here. Server stopped working with the latest update although PostgreSQL 14 is installed.

[itsaw]

@elBoberido

I'm just afraid that you feel the same way I do. The versions are installed, but you have not carried out the manual migration to the installed version.

MariaDB is probably a bit ahead of PostgreSQL here.

I just did this and everything is running again:

su - postgres                                    ## Login as PostgreSQL user
pg_lsclusters                                     ## Show all running PostgreSQL Instances
pg_dropcluster --stop 17 main         ## 17 is my newest installed Version
pg_upgradecluster -v 17 11 main     ##  Upgrade and Migrate to my newest Version

Hope this will help you too

[elBoberido]

@itsaw thanks. I just installed the previous version as quick-fix but will try your solution. Thanks

[maxkratz]

I've documented my upgrade process for PostgreSQL v12 to v15 (including the necessary password hash changes) here: #18085 (comment)

Maybe this can also help you.

[Lurkars]

@elBoberido

su - postgres                                    ## Login as PostgreSQL user
pg_lsclusters                                     ## Show all running PostgreSQL Instances
pg_dropcluster --stop 17 main         ## 17 is my newest installed Version
pg_upgradecluster -v 17 11 main     ##  Upgrade and Migrate to my newest Version

Did this with my version 14. Did work, thank you very much. Small reminder: Create Backup before running this, any errors may lead to data loss.

[elBoberido]

@itsaw thanks, worked like a charm. I just had to use sudo -i -u postgres.

@Lurkars thanks very much for the reminder. I was almost like, "These are just 4 commands! What could go wrong! No risk no fun!" and then dropped the wrong cluster. Luckily I had a backup 😅

[Trogvars]

Thanks! Worked with v11 upgrade to v13.

[WesR]

BIG FYI to anyone upgrading (my first time). When performing the pg_upgradecluster your DB will be fully copied, so you must have at least that in free space (you can drop the old once it finishes).

Check your DBs size with du -sh /var/lib/postgresql/11 (you can also use this to check progress on the new one)
If you already started and dont have enough space, try purging the media directories. /var/lib/matrix-synapse/media/remote_content and remote_thumbnails is a good starting point

Anyways, thanks for the upgrade advice! Worked great for me!

PS for google, I found this error after getting "Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 145." on upgrade. check the journalctl and see if this applies to you

[anoadragon453]

Looks like this was due to a improper postgres cluster upgrade rather than anything to do with Synapse itself. Closing based on that assumption, but feel free to re-open if that's incorrect.