Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade NCP 1.39.0/NC 21.0.4 fail #1326

Closed
vcbranco opened this issue Sep 5, 2021 · 97 comments
Closed

Upgrade NCP 1.39.0/NC 21.0.4 fail #1326

vcbranco opened this issue Sep 5, 2021 · 97 comments

Comments

@vcbranco
Copy link

vcbranco commented Sep 5, 2021

The upgrade does not done.

During upgrade I have the following errors just after the line "System config value trusted_proxies => 12 set to string ::1"

✓ redis is configured
✓ push server is receiving redis messages
✓ push server can load mount info from database
🗴 push server can't connect to the Nextcloud server
error sending request for url (https://10.8.6.100/index.php/apps/notify_push/test/cookie): error trying to connect: invalid dnsname: error trying to connect: invalid dnsname: invalid dnsname
Abort

Clean up...
Rolling back to backup /var/www/nextcloud-bkp_20210905_1630827743-20.0.2.2.tar.gz...
{"reqId":"g2uhEBMHYLKFdYG1047b","level":2,"time":"2021-09-05T07:45:50+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"21.0.4.1"}
{"reqId":"g2uhEBMHYLKFdYG1047b","level":2,"time":"2021-09-05T07:45:50+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"21.0.4.1"}
check free space...
extracting backup file /var/www/nextcloud-bkp_20210905_1630827743-20.0.2.2.tar.gz...
restore files...
restore database...
No datadir found in backup
Maintenance mode disabled
Starting scan for user 1 out of 1 (ncp)
+---------+-------+--------------+
| Folders | Files | Elapsed time |
+---------+-------+--------------+
| 2 | 0 | 00:00:00 |
+---------+-------+--------------+
System config value tempdirectory set to string /var/www/nextcloud/data/tmp
System config value logfile set to string /var/www/nextcloud/data/nextcloud.log
System config value trusted_domains => 11 set to string 176.78.117.244
System config value trusted_domains => 1 set to string 10.8.6.100
Scanning AppData for files

+---------+-------+--------------+
| Folders | Files | Elapsed time |
+---------+-------+--------------+
| 5 | 4 | 00:00:00 |
+---------+-------+--------------+
Cleanup...
Rollback successful. Nothing was updated
Done. Press any key...

@nachoparker
Copy link
Member

many thanks for testing. Can you share the output of sudo ncp-report please?

@nachoparker
Copy link
Member

also, is this your main instance, or is this a test instance you have around?

@nachoparker
Copy link
Member

I made a special branch to debug your issue. That url https://10.8.6.100/index.php/apps/notify_push/test/cookie seems plain wrong.

Do you mind doing sudo ncp-update nc-21-vcbranco and trying again sudo ncp-update-nc 21.0.4, please?

We should get more info from the output this time around

@vcbranco
Copy link
Author

vcbranco commented Sep 5, 2021

This is a test instance (RPI 4 4GB) with the NextCloudPi_RPi_11-27-20 image fully updated.

I'll do all the tests and place the output here

@ovpc
Copy link
Collaborator

ovpc commented Sep 5, 2021

Like wise here on a VM (Proxmox), got rollback:
terminal output at https://pastebin.com/59CHhBJ7

@WeiChihChern
Copy link

Host: M1 Mac Mini
Docker image: ownyourbits/nextcloudpi-arm64:latest
Note: Fresh docker run without any data

  1. Updated apps and nextcloud from 18.0.3 to 20.0.12 first.
  2. ncp-update nc-21-vcbranco. Successful, NCP to version 1.39.0.
  3. ncp-update-nc 21.0.4. Error message shown as below:

root@c5c3b7795ebe:/# ncp-update-nc 21.0.4
Current Nextcloud version 20.0.12.1
Available Nextcloud version 21.0.4
Download Nextcloud 21.0.4...
Back up current instance...
check free space...
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Maintenance mode already enabled
backup database...
backup files...
tar: Nextcloud or one of the apps require upgrade - only a limited number of commands are available\nYou may use your browser or the occ upgrade command to do the upgrade\n/data/nextcloud: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
error generating backup
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Maintenance mode disabled
Error backing up
Clean up...

  1. ncp-report as shown below:
NextCloudPi diagnostics

NextCloudPi version  v1.39.0
NextCloudPi image    NextCloudPi_docker_01-19-21
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /data/nextcloud/data
data in SD           yes
data filesystem      overlayfs
data disk usage      21G/24G
rootfs usage         21G/24G
swapfile             /swap
dbdir                /data/database
Nextcloud check      ok
Nextcloud version    20.0.12.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        closed
port check 443       closed
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               4days

Nextcloud configuration

Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "1": "172.17.0.3",
            "6": "192.168.1.65"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "18.0.3.0",
        "overwrite.cli.url": "http:\/\/localhost",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "maintenance": false,
        "loglevel": 2
    }
}

HTTPd logs

[Sun Sep 05 19:32:59.199611 2021] [authz_host:error] [pid 30552:tid 281473407099280] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /js/minified.js failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.199645 2021] [authz_host:error] [pid 30552:tid 281473381921168] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /js/ncp.js failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.200985 2021] [authz_host:error] [pid 30552:tid 281473398706576] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/loading-small.gif failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.201279 2021] [authz_host:error] [pid 30552:tid 281473390313872] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/ncp-logo.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.215652 2021] [authz_host:error] [pid 30552:tid 281473390313872] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/toggle.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.216059 2021] [authz_host:error] [pid 30552:tid 281473390313872] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/defaults.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.242567 2021] [authz_host:error] [pid 30552:tid 281473390313872] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/poweroff.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.242638 2021] [authz_host:error] [pid 30552:tid 281473398706576] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/reboot.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.252873 2021] [authz_host:error] [pid 30552:tid 281473398706576] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/search.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.252923 2021] [authz_host:error] [pid 30552:tid 281473390313872] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/nc-button.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.252993 2021] [authz_host:error] [pid 30552:tid 281473398706576] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/dashboard.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.254529 2021] [authz_host:error] [pid 30552:tid 281473407099280] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/defaults-white.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.254594 2021] [authz_host:error] [pid 30552:tid 281473407099280] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/settings-white.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.255172 2021] [authz_host:error] [pid 30552:tid 281473390313872] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/wizard.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.256581 2021] [authz_host:error] [pid 30552:tid 281473407099280] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/info-white.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.257503 2021] [authz_host:error] [pid 30552:tid 281473407099280] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /img/files.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.263936 2021] [authz_host:error] [pid 30552:tid 281473407099280] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name
[Sun Sep 05 19:32:59.276940 2021] [authz_host:error] [pid 30552:tid 281473390313872] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /ncp-output.php failed, reason: unable to get the remote host name
[Sun Sep 05 19:33:04.767493 2021] [authz_host:error] [pid 30552:tid 281473407099280] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name
[Sun Sep 05 19:33:04.780003 2021] [authz_host:error] [pid 30552:tid 281473407099280] [client 172.17.0.1:63586] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name

Database logs

2021-09-05 19:23:23 0 [ERROR] mysqld: Table './mysql/user' is marked as crashed and should be repaired
2021-09-05 19:23:23 0 [Warning] Checking table:   './mysql/user'
2021-09-05 19:23:23 0 [ERROR] mysql.user: 1 client is using or hasn't closed the table properly
2021-09-05 19:23:23 0 [ERROR] mysqld: Table './mysql/db' is marked as crashed and should be repaired
2021-09-05 19:23:23 0 [Warning] Checking table:   './mysql/db'
2021-09-05 19:23:23 0 [ERROR] mysql.db: 1 client is using or hasn't closed the table properly
2021-09-05 19:23:23 0 [Note] Reading of all Master_info entries succeeded
2021-09-05 19:23:23 0 [Note] Added new Master_info '' to hash table
2021-09-05 19:23:23 0 [Note] mysqld: ready for connections.
Version: '10.3.22-MariaDB-0+deb10u1'  socket: '/run/mysqld/mysqld.sock'  port: 3306  Debian 10
2021-09-05 19:23:25 0 [Note] mysqld (initiated by: root[root] @ localhost []): Normal shutdown
2021-09-05 19:23:25 0 [Note] Event Scheduler: Purging the queue. 0 events
2021-09-05 19:23:25 0 [Note] InnoDB: FTS optimize thread exiting.
2021-09-05 19:23:25 0 [Note] InnoDB: Starting shutdown...
2021-09-05 19:23:25 0 [Note] InnoDB: Dumping buffer pool(s) to /data/database/ib_buffer_pool
2021-09-05 19:23:25 0 [Note] InnoDB: Buffer pool(s) dump completed at 210905 19:23:25
2021-09-05 19:23:27 0 [Note] InnoDB: Shutdown completed; log sequence number 4296968; transaction id 2780
2021-09-05 19:23:27 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2021-09-05 19:23:27 0 [Note] mysqld: Shutdown complete


Nextcloud logs

{"reqId":"jrQgQkRWZTJDAgpNqAqf","level":2,"time":"2021-09-05T19:32:02+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"jrQgQkRWZTJDAgpNqAqf","level":2,"time":"2021-09-05T19:32:02+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"hTuojUtdLFlQ9VsOawHd","level":2,"time":"2021-09-05T19:32:59+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"hTuojUtdLFlQ9VsOawHd","level":2,"time":"2021-09-05T19:32:59+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"dlI2WmhuaFwjbkxOV1zM","level":2,"time":"2021-09-05T19:33:22+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"dlI2WmhuaFwjbkxOV1zM","level":2,"time":"2021-09-05T19:33:22+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"XO2MQhSgkZB4W7ksenSA","level":2,"time":"2021-09-05T19:33:22+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"XO2MQhSgkZB4W7ksenSA","level":2,"time":"2021-09-05T19:33:22+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"1lr0SxgyhahzO5hapqXI","level":2,"time":"2021-09-05T19:35:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"1lr0SxgyhahzO5hapqXI","level":2,"time":"2021-09-05T19:35:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"y8iTNXDHrT4PUUts0nkg","level":2,"time":"2021-09-05T19:35:43+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"y8iTNXDHrT4PUUts0nkg","level":2,"time":"2021-09-05T19:35:43+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"gHvUtZkyTHe1zURaNCjx","level":2,"time":"2021-09-05T19:35:44+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"gHvUtZkyTHe1zURaNCjx","level":2,"time":"2021-09-05T19:35:44+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"Vl0Wtlcx4S77JD0faG5a","level":2,"time":"2021-09-05T19:35:44+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"Vl0Wtlcx4S77JD0faG5a","level":2,"time":"2021-09-05T19:35:44+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"0xC5lQiAlAK97ppchHK2","level":2,"time":"2021-09-05T19:37:10+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"0xC5lQiAlAK97ppchHK2","level":2,"time":"2021-09-05T19:37:10+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"0COkiijVbO2OEpQdfRT4","level":2,"time":"2021-09-05T19:37:15+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"0COkiijVbO2OEpQdfRT4","level":2,"time":"2021-09-05T19:37:15+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}

@WeiChihChern
Copy link

2nd try.

  1. Updated apps and NCP to 1.38.6.
  2. Update NC from 18.0.3 to 20.0.12.
  3. Update NC from 20.0.12 to 21.0.4 Failed. Run the update again, then showing 'Nextcloud data directory not found'.
  4. ncp-report:
NextCloudPi diagnostics

{"reqId":"6jNcTch5ypYv98ojjUT7","level":2,"time":"2021-09-05T19:54:03+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"6jNcTch5ypYv98ojjUT7","level":2,"time":"2021-09-05T19:54:03+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
NextCloudPi version  v1.38.6
NextCloudPi image    NextCloudPi_docker_01-19-21
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /data/nextcloud/data (doesn't exist)
rootfs usage         21G/24G
swapfile             /swap
dbdir                /data/database
Nextcloud check      ok
Nextcloud version    20.0.12.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        closed
port check 443       closed
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               4days

Nextcloud configuration

Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "1": "172.17.0.3",
            "6": "192.168.1.65"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "18.0.3.0",
        "overwrite.cli.url": "http:\/\/localhost",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "maintenance": true,
        "loglevel": 2
    }
}

HTTPd logs

[Sun Sep 05 19:51:05.753198 2021] [authz_host:error] [pid 5438:tid 281473532907920] [client 172.17.0.1:56104] AH01753: access check of 'localhost' to /activate/JS.js failed, reason: unable to get the remote host name
[Sun Sep 05 19:51:05.753378 2021] [authz_host:error] [pid 5438:tid 281473524515216] [client 172.17.0.1:56104] AH01753: access check of 'localhost' to /js/minified.js failed, reason: unable to get the remote host name
[Sun Sep 05 19:51:05.754221 2021] [authz_host:error] [pid 5438:tid 281473541300624] [client 172.17.0.1:56104] AH01753: access check of 'localhost' to /img/loading-small.gif failed, reason: unable to get the remote host name
[Sun Sep 05 19:51:05.755064 2021] [authz_host:error] [pid 5438:tid 281473616834960] [client 172.17.0.1:56104] AH01753: access check of 'localhost' to /img/clippy.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:51:05.755309 2021] [authz_host:error] [pid 5438:tid 281473549693328] [client 172.17.0.1:56104] AH01753: access check of 'localhost' to /img/background.png failed, reason: unable to get the remote host name
[Sun Sep 05 19:51:05.755708 2021] [authz_host:error] [pid 5438:tid 281473558086032] [client 172.17.0.1:56104] AH01753: access check of 'localhost' to /img/ncp-logo.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.673088 2021] [authz_host:error] [pid 5437:tid 281473524515216] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /activate/ failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.673520 2021] [authz_host:error] [pid 5437:tid 281473524515216] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /activate/index.php failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.693921 2021] [authz_host:error] [pid 5437:tid 281473524515216] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /activate/CSS.css failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.699932 2021] [authz_host:error] [pid 5437:tid 281473532907920] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /img/ncp-logo.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.700282 2021] [authz_host:error] [pid 5437:tid 281473524515216] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /js/minified.js failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.704427 2021] [authz_host:error] [pid 5437:tid 281473541300624] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /img/clippy.svg failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.707401 2021] [authz_host:error] [pid 5437:tid 281473532907920] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /img/loading-small.gif failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.708289 2021] [authz_host:error] [pid 5437:tid 281473532907920] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /img/background.png failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:28.708954 2021] [authz_host:error] [pid 5437:tid 281473549693328] [client 172.17.0.1:56440] AH01753: access check of 'localhost' to /activate/JS.js failed, reason: unable to get the remote host name
[Sun Sep 05 19:52:38.723763 2021] [mpm_event:notice] [pid 101:tid 281473840117104] AH00493: SIGUSR1 received.  Doing graceful restart
[Sun Sep 05 19:52:38.728143 2021] [ssl:error] [pid 101:tid 281473840117104] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 5285EFBE66BF712AEC0DE78450C9537C14A3F5C3 / notbefore: Apr  6 07:00:05 2020 GMT / notafter: Apr  4 07:00:05 2030 GMT]
[Sun Sep 05 19:52:38.728156 2021] [ssl:error] [pid 101:tid 281473840117104] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Sun Sep 05 19:52:38.728561 2021] [mpm_event:notice] [pid 101:tid 281473840117104] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Sun Sep 05 19:52:38.728573 2021] [core:notice] [pid 101:tid 281473840117104] AH00094: Command line: '/usr/sbin/apache2'

Database logs

2021-09-05 19:46:54 0 [ERROR] mysqld: Table './mysql/user' is marked as crashed and should be repaired
2021-09-05 19:46:54 0 [Warning] Checking table:   './mysql/user'
2021-09-05 19:46:54 0 [ERROR] mysql.user: 1 client is using or hasn't closed the table properly
2021-09-05 19:46:54 0 [ERROR] mysqld: Table './mysql/db' is marked as crashed and should be repaired
2021-09-05 19:46:54 0 [Warning] Checking table:   './mysql/db'
2021-09-05 19:46:54 0 [ERROR] mysql.db: 1 client is using or hasn't closed the table properly
2021-09-05 19:46:54 0 [Note] Reading of all Master_info entries succeeded
2021-09-05 19:46:54 0 [Note] Added new Master_info '' to hash table
2021-09-05 19:46:54 0 [Note] mysqld: ready for connections.
Version: '10.3.22-MariaDB-0+deb10u1'  socket: '/run/mysqld/mysqld.sock'  port: 3306  Debian 10
2021-09-05 19:46:56 0 [Note] mysqld (initiated by: root[root] @ localhost []): Normal shutdown
2021-09-05 19:46:56 0 [Note] Event Scheduler: Purging the queue. 0 events
2021-09-05 19:46:56 0 [Note] InnoDB: FTS optimize thread exiting.
2021-09-05 19:46:56 0 [Note] InnoDB: Starting shutdown...
2021-09-05 19:46:56 0 [Note] InnoDB: Dumping buffer pool(s) to /data/database/ib_buffer_pool
2021-09-05 19:46:56 0 [Note] InnoDB: Buffer pool(s) dump completed at 210905 19:46:56
2021-09-05 19:46:58 0 [Note] InnoDB: Shutdown completed; log sequence number 4296968; transaction id 2780
2021-09-05 19:46:58 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2021-09-05 19:46:58 0 [Note] mysqld: Shutdown complete


Nextcloud logs

{"reqId":"arEevnkhRuhqtm5xPDbr","level":2,"time":"2021-09-05T19:54:08+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"arEevnkhRuhqtm5xPDbr","level":2,"time":"2021-09-05T19:54:08+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}

@WeiChihChern
Copy link

WeiChihChern commented Sep 5, 2021

Would it work if just build a new image with NC21? Just be so excited with NC21.

@vcbranco
Copy link
Author

vcbranco commented Sep 5, 2021

ncp-report after the failed upgrade (ncp-update devel)

NextCloudPi diagnostics

NextCloudPi version  v1.39.0
NextCloudPi image    NextCloudPi_11-27-20
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /var/www/nextcloud/data
data in SD           yes
data filesystem      ext2/ext3
data disk usage      3,0G/29G
rootfs usage         3,0G/29G
swapfile             /dev/zram3
dbdir                /var/lib/mysql
Nextcloud check      ok
Nextcloud version    20.0.12.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        open
port check 443       open
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               10min

Nextcloud configuration

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "11": "176.78.117.244",
            "1": "10.8.6.100"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "20.0.12.1",
        "overwrite.cli.url": "https:\/\/10.8.6.100\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "htaccess.RewriteBase": "\/",
        "maintenance": false,
        "loglevel": 2,
        "logfile": "\/var\/www\/nextcloud\/data\/nextcloud.log",
        "data-fingerprint": "670ed085260430c05522c2c035a8d852"
    }
}

HTTPd logs

[Sun Sep 05 13:54:45.786380 2021] [ssl:warn] [pid 677:tid 548560110960] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Sun Sep 05 13:54:45.786654 2021] [ssl:error] [pid 677:tid 548560110960] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Sun Sep 05 13:54:45.786675 2021] [ssl:error] [pid 677:tid 548560110960] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Sun Sep 05 13:54:45.833937 2021] [ssl:warn] [pid 866:tid 548560110960] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Sun Sep 05 13:54:45.834141 2021] [ssl:error] [pid 866:tid 548560110960] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Sun Sep 05 13:54:45.834154 2021] [ssl:error] [pid 866:tid 548560110960] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Sun Sep 05 13:54:45.837882 2021] [mpm_event:notice] [pid 866:tid 548560110960] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Sun Sep 05 13:54:45.837968 2021] [core:notice] [pid 866:tid 548560110960] AH00094: Command line: '/usr/sbin/apache2'
[Sun Sep 05 20:05:15.492018 2021] [mpm_event:notice] [pid 866:tid 548560110960] AH00493: SIGUSR1 received.  Doing graceful restart
[Sun Sep 05 20:05:15.514323 2021] [ssl:warn] [pid 866:tid 548560110960] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Sun Sep 05 20:05:15.514472 2021] [ssl:error] [pid 866:tid 548560110960] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Sun Sep 05 20:05:15.514484 2021] [ssl:error] [pid 866:tid 548560110960] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Sun Sep 05 20:05:15.515451 2021] [mpm_event:notice] [pid 866:tid 548560110960] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Sun Sep 05 20:05:15.515463 2021] [core:notice] [pid 866:tid 548560110960] AH00094: Command line: '/usr/sbin/apache2'
[Sun Sep 05 20:10:53.648095 2021] [mpm_event:notice] [pid 866:tid 548560110960] AH00493: SIGUSR1 received.  Doing graceful restart
[Sun Sep 05 20:10:53.672953 2021] [ssl:warn] [pid 866:tid 548560110960] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Sun Sep 05 20:10:53.673169 2021] [ssl:error] [pid 866:tid 548560110960] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Sun Sep 05 20:10:53.673185 2021] [ssl:error] [pid 866:tid 548560110960] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Sun Sep 05 20:10:53.674165 2021] [mpm_event:notice] [pid 866:tid 548560110960] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Sun Sep 05 20:10:53.674180 2021] [core:notice] [pid 866:tid 548560110960] AH00094: Command line: '/usr/sbin/apache2'

Database logs

2021-09-05 13:54:45 0 [Note] InnoDB: Uses event mutexes
2021-09-05 13:54:45 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-09-05 13:54:45 0 [Note] InnoDB: Number of pools: 1
2021-09-05 13:54:45 0 [Note] InnoDB: Using generic crc32 instructions
2021-09-05 13:54:46 0 [Note] InnoDB: Initializing buffer pool, total size = 1G, instances = 1, chunk size = 128M
2021-09-05 13:54:46 0 [Note] InnoDB: Completed initialization of buffer pool
2021-09-05 13:54:46 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-09-05 13:54:46 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2021-09-05 13:54:46 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2021-09-05 13:54:46 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2021-09-05 13:54:46 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2021-09-05 13:54:46 0 [Note] InnoDB: 10.3.29 started; log sequence number 8896968; transaction id 12817
2021-09-05 13:54:46 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2021-09-05 13:54:46 0 [Note] Plugin 'FEEDBACK' is disabled.
2021-09-05 13:54:46 0 [Note] Server socket created on IP: '127.0.0.1'.
2021-09-05 13:54:46 0 [Note] Reading of all Master_info entries succeeded
2021-09-05 13:54:46 0 [Note] Added new Master_info '' to hash table
2021-09-05 13:54:46 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.3.29-MariaDB-0+deb10u1'  socket: '/run/mysqld/mysqld.sock'  port: 3306  Debian 10
2021-09-05 13:54:47 0 [Note] InnoDB: Buffer pool(s) load completed at 210905 13:54:47

Nextcloud logs

{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Reset generated avatar flag","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Keep legacy encryption enabled","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Check encryption key format","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Remove old dashboard app config data","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add job to cleanup the bruteforce entries","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Queue a one-time job to check for user uploaded certificates","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Repair DAV shares","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add background job to set the lookup server share state for users","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:21+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::startCheckCodeIntegrity: Starting code integrity check...","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:33+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::finishedCheckCodeIntegrity: Finished code integrity check","userAgent":"--","version":"20.0.12.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:33+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::updateEnd: Update successful","userAgent":"--","version":"21.0.4.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:33+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::maintenanceDisabled: Turned off maintenance mode","userAgent":"--","version":"21.0.4.1"}
{"reqId":"sMYHaKycFJSkgt3245VR","level":1,"time":"2021-09-05T19:10:33+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::resetLogLevel: Reset log level to Warning(2)","userAgent":"--","version":"21.0.4.1"}

@vcbranco
Copy link
Author

vcbranco commented Sep 5, 2021

Test with the instance ncp-update nc-21-vcbranco in the same image but clean (the card was cloned)
Error:

Update successful
Turned off maintenance mode
Resetting log level
Check indices of the share table.
Check indices of the filecache table.
Adding additional size index to the filecache table, this can take some time...
Filecache table updated successfully.
Check indices of the twofactor_providers table.
Check indices of the login_flow_v2 table.
Check indices of the whats_new table.
Check indices of the cards table.
Check indices of the cards_properties table.
Check indices of the calendarobjects_props table.
Check indices of the schedulingobjects table.
Check indices of the oc_properties table.
Check columns of the comments table.
Done.
Check primary keys.
Done.
All tables already up to date!
++ ncc status
++ grep version:
++ awk '{ print $3 }'

  • NCVER=21.0.4.1
  • is_more_recent_than 21.0.0 21.0.4.1
  • local version_A=21.0.0
  • local version_B=21.0.4.1
    ++ cut -d. -f1
  • local major_a=21
    ++ cut -d. -f2
  • local minor_a=0
    ++ cut -d. -f3
  • local patch_a=0
    ++ cut -d. -f1
  • local major_b=21
    ++ cut -d. -f2
  • local minor_b=0
    ++ cut -d. -f3
  • local patch_b=4
  • '[' 21 -gt 21 ']'
  • '[' 21 -eq 21 ']'
  • '[' 0 -gt 0 ']'
  • '[' 21 -eq 21 ']'
  • '[' 0 -eq 0 ']'
  • '[' 4 -ge 0 ']'
  • return 1
  • is_app_enabled notify_push
  • local app=notify_push
  • ncc app:list
  • sed '0,/Disabled/!d'
  • grep -q notify_push
  • ncc app:install notify_push
    notify_push 0.2.2 installed
    notify_push enabled
  • ncc app:enable notify_push
    notify_push already enabled
  • bash /usr/local/etc/ncp-templates/nextcloud.conf.sh
  • a2enmod proxy proxy_http proxy_wstunnel
    Module proxy already enabled
    Considering dependency proxy for proxy_http:
    Module proxy already enabled
    Module proxy_http already enabled
    Considering dependency proxy for proxy_wstunnel:
    Module proxy already enabled
    Enabling module proxy_wstunnel.
    To activate the new configuration, you need to run:
    systemctl restart apache2
  • apachectl -k graceful
  • cat
    ++ uname -m
  • [[ -f /.docker-image ]]
  • systemctl enable --now notify_push
    Created symlink /etc/systemd/system/multi-user.target.wants/notify_push.service → /etc/systemd/system/notify_push.service.
    ++ ncc config:system:get overwrite.cli.url
  • nc_domain=https://10.8.6.100/
    ++ sed 's|http.?://||;s|(/.*)||'
  • nc_domain=10.8.6.100
  • sleep 5
  • set-nc-domain 10.8.6.100
  • local domain=10.8.6.100
  • local url=https://10.8.6.100
  • [[ '' == --\n\o-\t\r\u\s\t\e\d-\d\o\m\a\i\n ]]
  • ncc config:system:set trusted_domains 3 --value=10.8.6.100
    System config value trusted_domains => 3 set to string 10.8.6.100
  • ncc config:system:set overwrite.cli.url --value=https://10.8.6.100/
    System config value overwrite.cli.url set to string https://10.8.6.100/
  • is_app_enabled notify_push
  • local app=notify_push
  • ncc app:list
  • sed '0,/Disabled/!d'
  • grep -q notify_push
  • ncc config:system:set trusted_proxies 11 --value=127.0.0.1
    System config value trusted_proxies => 11 set to string 127.0.0.1
  • ncc config:system:set trusted_proxies 12 --value=::1
    System config value trusted_proxies => 12 set to string ::1
  • ncc notify_push:setup https://10.8.6.100/push
    ✓ redis is configured
    ✓ push server is receiving redis messages
    ✓ push server can load mount info from database
    🗴 push server can't connect to the Nextcloud server
    error sending request for url (https://10.8.6.100/index.php/apps/notify_push/test/cookie): error trying to connect: invalid dnsname: error trying to connect: invalid dnsname: invalid dnsname
    ++ rollback
    ++ set +eE
    ++ trap '' INT TERM HUP ERR EXIT
    ++ echo -e 'Abort\nClean up...'
    Abort
    Clean up...
    ++ rm -rf /var/www/nextcloud.tar.bz2 /var/www/nextcloud-old
    ++ echo 'Rolling back to backup /var/www/nextcloud-bkp_20210905_1630872395-20.0.12.1.tar.gz...'
    Rolling back to backup /var/www/nextcloud-bkp_20210905_1630872395-20.0.12.1.tar.gz...
    ++ local TMPDATA
    +++ mktemp -d /var/www/ncp-data.XXXXXX
    ++ TMPDATA=/var/www/ncp-data.CqJsv5
    ++ [[ /var/www/nextcloud/data == /\v\a\r/\w\w\w/\n\e\x\t\c\l\o\u\d/\d\a\t\a ]]
    ++ mv -T /var/www/nextcloud/data /var/www/ncp-data.CqJsv5
    ++ ncp-restore /var/www/nextcloud-bkp_20210905_1630872395-20.0.12.1.tar.gz
    {"reqId":"9DAsSv4fVffKurgH2aJ8","level":2,"time":"2021-09-05T20:11:56+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"21.0.4.1"}
    {"reqId":"9DAsSv4fVffKurgH2aJ8","level":2,"time":"2021-09-05T20:11:56+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"21.0.4.1"}
    check free space...
    extracting backup file /var/www/nextcloud-bkp_20210905_1630872395-20.0.12.1.tar.gz...
    restore files...
    restore database...
    No datadir found in backup
    Maintenance mode disabled
    Starting scan for user 1 out of 2 (ncp)
    Starting scan for user 2 out of 2 (vcb)
    +---------+-------+--------------+
    | Folders | Files | Elapsed time |
    +---------+-------+--------------+
    | 6 | 0 | 00:00:00 |
    +---------+-------+--------------+
    System config value tempdirectory set to string /var/www/nextcloud/data/tmp
    System config value logfile set to string /var/www/nextcloud/data/nextcloud.log
    System config value trusted_domains => 11 set to string 176.78.117.244
    System config value trusted_domains => 1 set to string 10.8.6.100
    Scanning AppData for files

+---------+-------+--------------+
| Folders | Files | Elapsed time |
+---------+-------+--------------+
| 32 | 74 | 00:00:00 |
+---------+-------+--------------+
Cleanup...
++ [[ /var/www/nextcloud/data == /\v\a\r/\w\w\w/\n\e\x\t\c\l\o\u\d/\d\a\t\a ]]
++ rm -rf /var/www/nextcloud/data
++ mv -T /var/www/ncp-data.CqJsv5 /var/www/nextcloud/data
++ rm /var/www/nextcloud-bkp_20210905_1630872395-20.0.12.1.tar.gz
++ echo 'Rollback successful. Nothing was updated'
Rollback successful. Nothing was updated
++ exit 1
Done. Press any key...

ncp-report

NextCloudPi diagnostics

NextCloudPi version  v1.39.0
NextCloudPi image    NextCloudPi_11-27-20
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /var/www/nextcloud/data
data in SD           yes
data filesystem      ext2/ext3
data disk usage      3,0G/29G
rootfs usage         3,0G/29G
swapfile             /dev/zram3
dbdir                /var/lib/mysql
Nextcloud check      ok
Nextcloud version    20.0.12.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        open
port check 443       open
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               10min

Nextcloud configuration

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "11": "176.78.117.244",
            "1": "10.8.6.100"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "20.0.12.1",
        "overwrite.cli.url": "https:\/\/10.8.6.100\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "htaccess.RewriteBase": "\/",
        "maintenance": false,
        "loglevel": 2,
        "logfile": "\/var\/www\/nextcloud\/data\/nextcloud.log",
        "data-fingerprint": "a15c227ddb351b16daa9271412cb999f"
    }
}

HTTPd logs

[Sun Sep 05 13:54:46.067329 2021] [ssl:warn] [pid 664:tid 547694970224] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Sun Sep 05 13:54:46.067716 2021] [ssl:error] [pid 664:tid 547694970224] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Sun Sep 05 13:54:46.067738 2021] [ssl:error] [pid 664:tid 547694970224] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Sun Sep 05 13:54:46.108708 2021] [ssl:warn] [pid 861:tid 547694970224] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Sun Sep 05 13:54:46.108975 2021] [ssl:error] [pid 861:tid 547694970224] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Sun Sep 05 13:54:46.109011 2021] [ssl:error] [pid 861:tid 547694970224] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Sun Sep 05 13:54:46.113006 2021] [mpm_event:notice] [pid 861:tid 547694970224] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Sun Sep 05 13:54:46.113103 2021] [core:notice] [pid 861:tid 547694970224] AH00094: Command line: '/usr/sbin/apache2'
[Sun Sep 05 21:05:55.291924 2021] [mpm_event:notice] [pid 861:tid 547694970224] AH00493: SIGUSR1 received.  Doing graceful restart
[Sun Sep 05 21:05:55.314824 2021] [ssl:warn] [pid 861:tid 547694970224] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Sun Sep 05 21:05:55.314972 2021] [ssl:error] [pid 861:tid 547694970224] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Sun Sep 05 21:05:55.314984 2021] [ssl:error] [pid 861:tid 547694970224] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Sun Sep 05 21:05:55.315919 2021] [mpm_event:notice] [pid 861:tid 547694970224] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Sun Sep 05 21:05:55.315931 2021] [core:notice] [pid 861:tid 547694970224] AH00094: Command line: '/usr/sbin/apache2'
[Sun Sep 05 21:11:42.015244 2021] [mpm_event:notice] [pid 861:tid 547694970224] AH00493: SIGUSR1 received.  Doing graceful restart
[Sun Sep 05 21:11:42.039746 2021] [ssl:warn] [pid 861:tid 547694970224] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Sun Sep 05 21:11:42.039982 2021] [ssl:error] [pid 861:tid 547694970224] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Sun Sep 05 21:11:42.039998 2021] [ssl:error] [pid 861:tid 547694970224] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Sun Sep 05 21:11:42.040992 2021] [mpm_event:notice] [pid 861:tid 547694970224] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Sun Sep 05 21:11:42.041008 2021] [core:notice] [pid 861:tid 547694970224] AH00094: Command line: '/usr/sbin/apache2'

Database logs

2021-09-05 13:54:46 0 [Note] InnoDB: Uses event mutexes
2021-09-05 13:54:46 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-09-05 13:54:46 0 [Note] InnoDB: Number of pools: 1
2021-09-05 13:54:46 0 [Note] InnoDB: Using generic crc32 instructions
2021-09-05 13:54:46 0 [Note] InnoDB: Initializing buffer pool, total size = 1G, instances = 1, chunk size = 128M
2021-09-05 13:54:46 0 [Note] InnoDB: Completed initialization of buffer pool
2021-09-05 13:54:46 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-09-05 13:54:47 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2021-09-05 13:54:47 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2021-09-05 13:54:47 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2021-09-05 13:54:47 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2021-09-05 13:54:47 0 [Note] InnoDB: 10.3.29 started; log sequence number 8896968; transaction id 12817
2021-09-05 13:54:47 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2021-09-05 13:54:47 0 [Note] Plugin 'FEEDBACK' is disabled.
2021-09-05 13:54:47 0 [Note] Server socket created on IP: '127.0.0.1'.
2021-09-05 13:54:47 0 [Note] Reading of all Master_info entries succeeded
2021-09-05 13:54:47 0 [Note] Added new Master_info '' to hash table
2021-09-05 13:54:47 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.3.29-MariaDB-0+deb10u1'  socket: '/run/mysqld/mysqld.sock'  port: 3306  Debian 10
2021-09-05 13:54:47 0 [Note] InnoDB: Buffer pool(s) load completed at 210905 13:54:47

Nextcloud logs

{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Reset generated avatar flag","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Keep legacy encryption enabled","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Check encryption key format","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Remove old dashboard app config data","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add job to cleanup the bruteforce entries","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Queue a one-time job to check for user uploaded certificates","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Repair DAV shares","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add background job to set the lookup server share state for users","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:11+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::startCheckCodeIntegrity: Starting code integrity check...","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:22+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::finishedCheckCodeIntegrity: Finished code integrity check","userAgent":"--","version":"20.0.12.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:22+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::updateEnd: Update successful","userAgent":"--","version":"21.0.4.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:22+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::maintenanceDisabled: Turned off maintenance mode","userAgent":"--","version":"21.0.4.1"}
{"reqId":"xMjN7dikzYpVFsXMJ60M","level":1,"time":"2021-09-05T20:11:22+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::resetLogLevel: Reset log level to Warning(2)","userAgent":"--","version":"21.0.4.1"}

@vcbranco
Copy link
Author

vcbranco commented Sep 5, 2021

The second error ncp-report is at the end.
It seems to me it's the same issue

@WeiChihChern
Copy link

part 3.

Telegram pinned update instruction result:

Running nc-update-nextcloud
Current Nextcloud version 18.0.3.0
Available Nextcloud version 21.0.4
Download Nextcloud 21.0.4...
Back up current instance...
check free space...
Maintenance mode enabled
backup database...
backup files...
backup /var/www//nextcloud-bkp_20210906_1630894298.tar.gz generated
Maintenance mode disabled
Install Nextcloud 21.0.4...
Restore data...
Fix permissions...
Upgrade...
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Setting log level to debug
Turned on maintenance mode
Exception: Updates between multiple major versions and downgrades are unsupported.
Update failed
Maintenance mode is kept active
Resetting log level
Abort
Clean up...
Rolling back to backup /var/www/nextcloud-bkp_20210906_1630894298-18.0.3.0.tar.gz...
{"reqId":"y5pHOagKPrj1O9DNjmEO","level":2,"time":"2021-09-06T02:11:56+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"y5pHOagKPrj1O9DNjmEO","level":2,"time":"2021-09-06T02:11:56+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
Can only restore from ext/btrfs filesystems
Rollback failed! Data left at /var/www/ncp-data.na7qHH
Done. Press any key...

'ncp-report' logs:

NextCloudPi diagnostics

NextCloudPi version  v1.39.0
NextCloudPi image    NextCloudPi_docker_01-19-21
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /data/nextcloud/data
data in SD           yes
data filesystem      overlayfs
data disk usage      21G/24G
rootfs usage         21G/24G
swapfile             /swap
dbdir                /data/database
Nextcloud check      ok
Nextcloud version    21.0.4.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        closed
port check 443       closed
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               5days

Nextcloud configuration

Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "1": "172.17.0.3",
            "6": "192.168.1.65"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "18.0.3.0",
        "overwrite.cli.url": "http:\/\/localhost",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "maintenance": true,
        "loglevel": 2
    }
}

HTTPd logs

[Mon Sep 06 02:09:43.311951 2021] [ssl:error] [pid 99:tid 281473370936688] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Mon Sep 06 02:09:43.315347 2021] [ssl:error] [pid 100:tid 281473370936688] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 5285EFBE66BF712AEC0DE78450C9537C14A3F5C3 / notbefore: Apr  6 07:00:05 2020 GMT / notafter: Apr  4 07:00:05 2030 GMT]
[Mon Sep 06 02:09:43.315356 2021] [ssl:error] [pid 100:tid 281473370936688] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Mon Sep 06 02:09:43.316183 2021] [mpm_event:notice] [pid 100:tid 281473370936688] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Mon Sep 06 02:09:43.316194 2021] [core:notice] [pid 100:tid 281473370936688] AH00094: Command line: '/usr/sbin/apache2'
[Mon Sep 06 02:10:19.458752 2021] [mpm_event:notice] [pid 100:tid 281473370936688] AH00493: SIGUSR1 received.  Doing graceful restart
[Mon Sep 06 02:10:19.462459 2021] [ssl:error] [pid 100:tid 281473370936688] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 5285EFBE66BF712AEC0DE78450C9537C14A3F5C3 / notbefore: Apr  6 07:00:05 2020 GMT / notafter: Apr  4 07:00:05 2030 GMT]
[Mon Sep 06 02:10:19.462471 2021] [ssl:error] [pid 100:tid 281473370936688] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Mon Sep 06 02:10:19.462890 2021] [mpm_event:notice] [pid 100:tid 281473370936688] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Mon Sep 06 02:10:19.462898 2021] [core:notice] [pid 100:tid 281473370936688] AH00094: Command line: '/usr/sbin/apache2'
[Mon Sep 06 02:10:19.679836 2021] [mpm_event:notice] [pid 100:tid 281473370936688] AH00493: SIGUSR1 received.  Doing graceful restart
[Mon Sep 06 02:10:19.683247 2021] [ssl:error] [pid 100:tid 281473370936688] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 5285EFBE66BF712AEC0DE78450C9537C14A3F5C3 / notbefore: Apr  6 07:00:05 2020 GMT / notafter: Apr  4 07:00:05 2030 GMT]
[Mon Sep 06 02:10:19.683258 2021] [ssl:error] [pid 100:tid 281473370936688] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Mon Sep 06 02:10:19.683614 2021] [mpm_event:notice] [pid 100:tid 281473370936688] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Mon Sep 06 02:10:19.683619 2021] [core:notice] [pid 100:tid 281473370936688] AH00094: Command line: '/usr/sbin/apache2'
[Mon Sep 06 02:11:17.117736 2021] [mpm_event:notice] [pid 100:tid 281473370936688] AH00493: SIGUSR1 received.  Doing graceful restart
[Mon Sep 06 02:11:17.122160 2021] [ssl:error] [pid 100:tid 281473370936688] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 5285EFBE66BF712AEC0DE78450C9537C14A3F5C3 / notbefore: Apr  6 07:00:05 2020 GMT / notafter: Apr  4 07:00:05 2030 GMT]
[Mon Sep 06 02:11:17.122171 2021] [ssl:error] [pid 100:tid 281473370936688] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Mon Sep 06 02:11:17.122598 2021] [mpm_event:notice] [pid 100:tid 281473370936688] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Mon Sep 06 02:11:17.122604 2021] [core:notice] [pid 100:tid 281473370936688] AH00094: Command line: '/usr/sbin/apache2'

Database logs

2021-09-06  2:09:43 0 [ERROR] mysqld: Table './mysql/user' is marked as crashed and should be repaired
2021-09-06  2:09:43 0 [Warning] Checking table:   './mysql/user'
2021-09-06  2:09:43 0 [ERROR] mysql.user: 1 client is using or hasn't closed the table properly
2021-09-06  2:09:43 0 [ERROR] mysqld: Table './mysql/db' is marked as crashed and should be repaired
2021-09-06  2:09:43 0 [Warning] Checking table:   './mysql/db'
2021-09-06  2:09:43 0 [ERROR] mysql.db: 1 client is using or hasn't closed the table properly
2021-09-06  2:09:43 0 [Note] Reading of all Master_info entries succeeded
2021-09-06  2:09:43 0 [Note] Added new Master_info '' to hash table
2021-09-06  2:09:43 0 [Note] mysqld: ready for connections.
Version: '10.3.22-MariaDB-0+deb10u1'  socket: '/run/mysqld/mysqld.sock'  port: 3306  Debian 10
2021-09-06  2:09:45 0 [Note] mysqld (initiated by: root[root] @ localhost []): Normal shutdown
2021-09-06  2:09:45 0 [Note] Event Scheduler: Purging the queue. 0 events
2021-09-06  2:09:45 0 [Note] InnoDB: FTS optimize thread exiting.
2021-09-06  2:09:45 0 [Note] InnoDB: Starting shutdown...
2021-09-06  2:09:45 0 [Note] InnoDB: Dumping buffer pool(s) to /data/database/ib_buffer_pool
2021-09-06  2:09:45 0 [Note] InnoDB: Buffer pool(s) dump completed at 210906  2:09:45
2021-09-06  2:09:47 0 [Note] InnoDB: Shutdown completed; log sequence number 4296968; transaction id 2780
2021-09-06  2:09:47 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2021-09-06  2:09:47 0 [Note] mysqld: Shutdown complete


Nextcloud logs

{"reqId":"QaPAdR4IssDJdJoZeLeo","level":2,"time":"2021-09-06T02:13:51+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"QaPAdR4IssDJdJoZeLeo","level":2,"time":"2021-09-06T02:13:51+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"tvPDA53vfkwfOVpynR0X","level":2,"time":"2021-09-06T02:13:56+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"tvPDA53vfkwfOVpynR0X","level":2,"time":"2021-09-06T02:13:56+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}

@nachoparker
Copy link
Member

nachoparker commented Sep 7, 2021

thanks all. Please bear with me, as upgrading to this new HPB is really proving to be a pain given all the moving pieces. Also I don't think it's super well polished.

I'll go with your issues one by one.

@vcbranco

A couple questions: Do you have nc-static-IP activated by any chance? do you access by IP or do you have a domain name to access?

I wasn't able to reproduce your issue, but I think we are dealing with this rustls/hyper-rustls#84

In any case, please run again ncp-update nc-21-vcbranco and then ncp-update-nc 21.0.4, see if my fixes work for your case.


@WeiChihChern

Would it work if just build a new image with NC21? Just be so excited with NC21.

Yes, you can checkout devel and then ./build-docker.sh arm64, but then I still need to fix your issue before I can push this to everyone. A new set of images will come after this is good to go.

I'll try to replicate your upgrade path next

@vcbranco
Copy link
Author

vcbranco commented Sep 7, 2021

Yes, nc-static-ip is activated.
This test intance is accessed by IP.

I going to start testing and post the results.

@vcbranco
Copy link
Author

vcbranco commented Sep 7, 2021

No luck
Same problem

I'm going to setup a test DNS to the upgrade

@vcbranco
Copy link
Author

vcbranco commented Sep 7, 2021

Same problem.

Let's encrypt and nc-static-IP configured.
Upgrade with ncp-update nc-21-vcbranco

Starting code integrity check...
Finished code integrity check
Update successful
Turned off maintenance mode
Resetting log level
Check indices of the share table.
Check indices of the filecache table.
Adding additional size index to the filecache table, this can take some time...
Filecache table updated successfully.
Check indices of the twofactor_providers table.
Check indices of the login_flow_v2 table.
Check indices of the whats_new table.
Check indices of the cards table.
Check indices of the cards_properties table.
Check indices of the calendarobjects_props table.
Check indices of the schedulingobjects table.
Check indices of the oc_properties table.
Check columns of the comments table.
Done.
Check primary keys.
Done.
All tables already up to date!
++ ncc status
++ grep version:
++ awk '{ print $3 }'

  • NCVER=21.0.4.1

  • is_more_recent_than 21.0.0 21.0.4.1

  • local version_A=21.0.0

  • local version_B=21.0.4.1
    ++ cut -d. -f1

  • local major_a=21
    ++ cut -d. -f2

  • local minor_a=0
    ++ cut -d. -f3

  • local patch_a=0
    ++ cut -d. -f1

  • local major_b=21
    ++ cut -d. -f2

  • local minor_b=0
    ++ cut -d. -f3

  • local patch_b=4

  • '[' 21 -gt 21 ']'

  • '[' 21 -eq 21 ']'

  • '[' 0 -gt 0 ']'

  • '[' 21 -eq 21 ']'

  • '[' 0 -eq 0 ']'

  • '[' 4 -ge 0 ']'

  • return 1

  • is_app_enabled notify_push

  • local app=notify_push

  • ncc app:list

  • sed '0,/Disabled/!d'

  • grep -q notify_push

  • ncc app:install notify_push
    notify_push 0.2.2 installed
    notify_push enabled

  • ncc app:enable notify_push
    notify_push already enabled

  • bash /usr/local/etc/ncp-templates/nextcloud.conf.sh

  • a2enmod proxy proxy_http proxy_wstunnel
    Module proxy already enabled
    Considering dependency proxy for proxy_http:
    Module proxy already enabled
    Module proxy_http already enabled
    Considering dependency proxy for proxy_wstunnel:
    Module proxy already enabled
    Enabling module proxy_wstunnel.
    To activate the new configuration, you need to run:
    systemctl restart apache2

  • apachectl -k graceful

  • cat
    ++ uname -m

  • [[ -f /.docker-image ]]

  • systemctl enable --now notify_push
    Created symlink /etc/systemd/system/multi-user.target.wants/notify_push.service → /etc/systemd/system/notify_push.service.
    ++ ncc config:system:get overwrite.cli.url

  • nc_domain=https://pi.emcontacto.eu/
    ++ sed 's|http.?://||;s|(/.*)||'

  • nc_domain=pi.emcontacto.eu

  • sleep 5

  • set-nc-domain pi.emcontacto.eu

  • local domain=pi.emcontacto.eu

  • is_an_ip pi.emcontacto.eu

  • local ip_or_domain=pi.emcontacto.eu

  • grep -oPq '\d{1,3}(.\d{1,3}){3}'

  • local url=https://pi.emcontacto.eu

  • [[ '' == --\n\o-\t\r\u\s\t\e\d-\d\o\m\a\i\n ]]

  • ncc config:system:set trusted_domains 3 --value=pi.emcontacto.eu
    System config value trusted_domains => 3 set to string pi.emcontacto.eu

  • ncc config:system:set overwrite.cli.url --value=https://pi.emcontacto.eu/
    System config value overwrite.cli.url set to string https://pi.emcontacto.eu/

  • is_app_enabled notify_push

  • local app=notify_push

  • ncc app:list

  • sed '0,/Disabled/!d'

  • grep -q notify_push

  • ncc config:system:set trusted_proxies 11 --value=127.0.0.1
    System config value trusted_proxies => 11 set to string 127.0.0.1

  • ncc config:system:set trusted_proxies 12 --value=::1
    System config value trusted_proxies => 12 set to string ::1

  • ncc config:system:set trusted_proxies 13 --value=pi.emcontacto.eu
    System config value trusted_proxies => 13 set to string pi.emcontacto.eu

  • ncc notify_push:setup https://pi.emcontacto.eu/push
    ✓ redis is configured
    ✓ push server is receiving redis messages
    ✓ push server can load mount info from database
    ✓ push server can connect to the Nextcloud server
    🗴 push server is not a trusted proxy, please add '10.8.6.1' to the list of trusted proxies or configure any existing reverse proxy to forward the 'x-forwarded-for' send by the push server.
    See https://docs.nextcloud.com/server/latest/admin_manual/configuration_server/reverse_proxy_configuration.html#defining-trusted-proxies for how to set trusted proxies.
    The following trusted proxies are currently configured: "127.0.0.1", "::1", "pi.emcontacto.eu"
    of which the following seem to be invalid: "pi.emcontacto.eu"
    The following x-forwarded-for header was received by Nextcloud: 1.2.3.4
    from the following remote: 10.8.6.1

    If you're having issues getting the trusted proxy setup working, you can try bypassing any existing reverse proxy
    in your setup by setting the NEXTCLOUD_URL environment variable to point directly to the internal Nextcloud webserver url
    (You will still need the ip address of the push server added as trusted proxy)
    ++ rollback
    ++ set +eE
    ++ trap '' INT TERM HUP ERR EXIT
    ++ echo -e 'Abort\nClean up...'
    Abort
    Clean up...
    ++ rm -rf /var/www/nextcloud.tar.bz2 /var/www/nextcloud-old
    ++ echo 'Rolling back to backup /var/www/nextcloud-bkp_20210907_1631037354-20.0.12.1.tar.gz...'
    Rolling back to backup /var/www/nextcloud-bkp_20210907_1631037354-20.0.12.1.tar.gz...
    ++ local TMPDATA
    +++ mktemp -d /var/www/ncp-data.XXXXXX
    ++ TMPDATA=/var/www/ncp-data.tHNbAO
    ++ [[ /var/www/nextcloud/data == /\v\a\r/\w\w\w/\n\e\x\t\c\l\o\u\d/\d\a\t\a ]]
    ++ mv -T /var/www/nextcloud/data /var/www/ncp-data.tHNbAO
    ++ ncp-restore /var/www/nextcloud-bkp_20210907_1631037354-20.0.12.1.tar.gz
    {"reqId":"kIaa2OJJ1aFFhREe0bf9","level":2,"time":"2021-09-07T17:59:16+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"21.0.4.1"}
    {"reqId":"kIaa2OJJ1aFFhREe0bf9","level":2,"time":"2021-09-07T17:59:16+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"21.0.4.1"}
    check free space...
    extracting backup file /var/www/nextcloud-bkp_20210907_1631037354-20.0.12.1.tar.gz...
    restore files...
    restore database...
    No datadir found in backup
    Maintenance mode disabled
    Starting scan for user 1 out of 1 (ncp)
    +---------+-------+--------------+
    | Folders | Files | Elapsed time |
    +---------+-------+--------------+
    | 3 | 0 | 00:00:00 |
    +---------+-------+--------------+
    System config value tempdirectory set to string /var/www/nextcloud/data/tmp
    System config value logfile set to string /var/www/nextcloud/data/nextcloud.log
    System config value trusted_domains => 11 set to string 176.78.117.244
    System config value trusted_domains => 1 set to string 10.8.6.100
    Scanning AppData for files

+---------+-------+--------------+
| Folders | Files | Elapsed time |
+---------+-------+--------------+
| 21 | 41 | 00:00:00 |
+---------+-------+--------------+
Cleanup...
++ [[ /var/www/nextcloud/data == /\v\a\r/\w\w\w/\n\e\x\t\c\l\o\u\d/\d\a\t\a ]]
++ rm -rf /var/www/nextcloud/data
++ mv -T /var/www/ncp-data.tHNbAO /var/www/nextcloud/data
++ rm /var/www/nextcloud-bkp_20210907_1631037354-20.0.12.1.tar.gz
++ echo 'Rollback successful. Nothing was updated'
Rollback successful. Nothing was updated
++ exit 1
Done. Press any key...

ncp-report

NextCloudPi diagnostics

NextCloudPi version  v1.39.0
NextCloudPi image    NextCloudPi_11-27-20
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /var/www/nextcloud/data
data in SD           yes
data filesystem      ext2/ext3
data disk usage      2.6G/29G
rootfs usage         2.6G/29G
swapfile             /var/swap
dbdir                /var/lib/mysql
Nextcloud check      ok
Nextcloud version    20.0.12.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        open
port check 443       open
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               31min

Nextcloud configuration

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "11": "176.78.117.244",
            "1": "10.8.6.100",
            "12": "pi.emcontacto.eu"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "20.0.12.1",
        "overwrite.cli.url": "https:\/\/pi.emcontacto.eu\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "maintenance": false,
        "loglevel": 2,
        "htaccess.RewriteBase": "\/",
        "logfile": "\/var\/www\/nextcloud\/data\/nextcloud.log",
        "data-fingerprint": "a417da10d7b92c37024a3cfac59e505f"
    }
}

HTTPd logs

[Tue Sep 07 18:31:40.246782 2021] [ssl:warn] [pid 864:tid 547993838960] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 07 18:31:40.247027 2021] [ssl:error] [pid 864:tid 547993838960] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Tue Sep 07 18:31:40.247051 2021] [ssl:error] [pid 864:tid 547993838960] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Tue Sep 07 18:31:40.248167 2021] [mpm_event:notice] [pid 864:tid 547993838960] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 07 18:31:40.248193 2021] [core:notice] [pid 864:tid 547993838960] AH00094: Command line: '/usr/sbin/apache2'
[Tue Sep 07 18:53:44.509161 2021] [mpm_event:notice] [pid 864:tid 547993838960] AH00493: SIGUSR1 received.  Doing graceful restart
[Tue Sep 07 18:53:44.532778 2021] [ssl:warn] [pid 864:tid 547993838960] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 07 18:53:44.534103 2021] [mpm_event:notice] [pid 864:tid 547993838960] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 07 18:53:44.534121 2021] [core:notice] [pid 864:tid 547993838960] AH00094: Command line: '/usr/sbin/apache2'
[Tue Sep 07 18:55:07.058114 2021] [mpm_event:notice] [pid 864:tid 547993838960] AH00493: SIGUSR1 received.  Doing graceful restart
[Tue Sep 07 18:55:07.083004 2021] [ssl:warn] [pid 864:tid 547993838960] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 07 18:55:07.084280 2021] [mpm_event:notice] [pid 864:tid 547993838960] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 07 18:55:07.084294 2021] [core:notice] [pid 864:tid 547993838960] AH00094: Command line: '/usr/sbin/apache2'
[Tue Sep 07 18:59:03.357859 2021] [mpm_event:notice] [pid 864:tid 547993838960] AH00493: SIGUSR1 received.  Doing graceful restart
[Tue Sep 07 18:59:03.387698 2021] [ssl:warn] [pid 864:tid 547993838960] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 07 18:59:03.389021 2021] [mpm_event:notice] [pid 864:tid 547993838960] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 07 18:59:03.389037 2021] [core:notice] [pid 864:tid 547993838960] AH00094: Command line: '/usr/sbin/apache2'

Database logs


Nextcloud logs

{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Reset generated avatar flag","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Keep legacy encryption enabled","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Check encryption key format","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Remove old dashboard app config data","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add job to cleanup the bruteforce entries","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Queue a one-time job to check for user uploaded certificates","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Repair DAV shares","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add background job to set the lookup server share state for users","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:40+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::startCheckCodeIntegrity: Starting code integrity check...","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:47+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::finishedCheckCodeIntegrity: Finished code integrity check","userAgent":"--","version":"20.0.12.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:47+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::updateEnd: Update successful","userAgent":"--","version":"21.0.4.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:47+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::maintenanceDisabled: Turned off maintenance mode","userAgent":"--","version":"21.0.4.1"}
{"reqId":"cnLkATFExBhpXtfOzLJM","level":1,"time":"2021-09-07T17:58:47+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::resetLogLevel: Reset log level to Warning(2)","userAgent":"--","version":"21.0.4.1"}

@WeiChihChern
Copy link

@nachoparker Thanks for the feedback. I've build an image from the devel branch. My personal NCP is running with the older image with an external hard drive. Can I simply stop the old image, and launch the new image and mount the external drive?

Or further setup is required to switch from one image to another with data all in an external drive? Thanks.

@nachoparker
Copy link
Member

nachoparker commented Sep 8, 2021

@WeiChihChern that's not how it works, if you want to retain your users, data and so on you need to upgrade, no way around that.

Updated apps and nextcloud from 18.0.3 to 20.0.12 first.

How did you do this? through NC updater or through NCP tools? it seems like you were in a half updated state. I updated from 18 to 20 and then did ncp-update nc-21-vcbranco and then upgraded to 21 all using NCP tools and it worked fine for me.

@vcbranco thanks for your testing. You never shared the output from your second attempt with static IP so I don't know how it went. You just said it didn't work. Then you changed your setup and you shared the output, so we are mixing things here and I cannot trace whether my fix worked or needs adjustments.

I'm going to setup a test DNS to the upgrade

what does this mean? on your last output I see https://pi.emcontacto.eu in overwrite.cli.url, but I don't know where it comes from. notify_push seems to have a problem with it. Are you behind a proxy? have you messed with the 'forwarded_for_headers' option in your config.php by any chance?

@WeiChihChern
Copy link

WeiChihChern commented Sep 8, 2021

@nachoparker
I see. I wonder what if one encountered power shortage to his device and have to relaunch the docker container again? Does that mean the users, data, etc cannot be retained? Does it mean docker users are encouraged to docker commit their image regularly? Thanks.

I updated apps and nextcloud using ncp-config. I would try it again using your instructions, see how it goes.

@nachoparker
Copy link
Member

nachoparker commented Sep 8, 2021

@ovpc if your proxmox VM is disposable (only if), can you also ncp-update nc-21-vcbranco, then edit /usr/local/bin/ncp-update-nc and remove the line that says set-nc-domain "${nc_domain}", then

ncp-update-nc 21.0.4 # should finish ok this time, but notify_push won't be setup yet
ncc notify_push:log debug
source /usr/local/etc/library.sh
set -x
set-nc-domain localhost
journalctl -u notify_push # hopefully there's some debug info here

You error is super weird and super unhelpful and I can't find what library it comes from :/

Thanks

@nachoparker
Copy link
Member

@WeiChihChern not encouraged to docker commit, your NC instance, database and data need to be in sync and they live in a volume so that's orthogonal to what image you are using, and that means that they are retained always, but they are independent on the underlying docker image, because they need to be in sync. You cannot upgrade NC without migrating the database, apps and so on.

@WeiChihChern
Copy link

@nachoparker
Tried again, but having the error of:

Running nc-update-nextcloud
Current Nextcloud version 20.0.4.0
Available Nextcloud version 21.0.4
Download Nextcloud 21.0.4...
Back up current instance...
check free space...
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Maintenance mode enabled
backup database...
backup files...
tar: Nextcloud or one of the apps require upgrade - only a limited number of commands are available\nYou may use your browser or the occ upgrade command to do the upgrade\n/data/nextcloud: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
error generating backup
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Maintenance mode disabled
Error backing up
Clean up...
Done. Press any key...

ncp-report:

NextCloudPi diagnostics

NextCloudPi version  v1.39.0
NextCloudPi image    NextCloudPi_docker_01-19-21
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /data/nextcloud/data
data in SD           yes
data filesystem      overlayfs
data disk usage      23G/48G
rootfs usage         23G/48G
swapfile             /swap
dbdir                /data/database
Nextcloud check      ok
Nextcloud version    20.0.4.0
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        closed
port check 443       closed
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               7min

Nextcloud configuration

Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "1": "172.17.0.2",
            "6": "192.168.1.65",
            "3": "nextcloudpi"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "18.0.3.0",
        "overwrite.cli.url": "https:\/\/nextcloudpi\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "maintenance": false,
        "loglevel": 2,
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***"
    }
}

HTTPd logs

[Wed Sep 08 02:15:46.874358 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/ncp-logo.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.882244 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /wizard/img/ncp-logo.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.886971 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/toggle.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.889035 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/defaults.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.911974 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/poweroff.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.911974 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/reboot.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.935732 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/view-close.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.936091 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/search.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.936607 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/nc-button.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.938924 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/defaults-white.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.938909 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/dashboard.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.939036 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/settings-white.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.939204 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/wizard.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.939963 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/info-white.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.941196 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/files.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.949438 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.949941 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /ncp-output.php failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:47.003203 2021] [authz_host:error] [pid 28812:tid 281472595276176] [client 172.17.0.1:65320] AH01753: access check of 'localhost' to /img/favicon.png failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:51.744702 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:51.758102 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name

Database logs

2021-09-08  2:11:11 0 [ERROR] mysqld: Table './mysql/user' is marked as crashed and should be repaired
2021-09-08  2:11:11 0 [Warning] Checking table:   './mysql/user'
2021-09-08  2:11:11 0 [ERROR] mysql.user: 1 client is using or hasn't closed the table properly
2021-09-08  2:11:11 0 [ERROR] mysqld: Table './mysql/db' is marked as crashed and should be repaired
2021-09-08  2:11:11 0 [Warning] Checking table:   './mysql/db'
2021-09-08  2:11:11 0 [ERROR] mysql.db: 1 client is using or hasn't closed the table properly
2021-09-08  2:11:11 0 [Note] Reading of all Master_info entries succeeded
2021-09-08  2:11:11 0 [Note] Added new Master_info '' to hash table
2021-09-08  2:11:11 0 [Note] mysqld: ready for connections.
Version: '10.3.22-MariaDB-0+deb10u1'  socket: '/run/mysqld/mysqld.sock'  port: 3306  Debian 10
2021-09-08  2:11:13 0 [Note] mysqld (initiated by: root[root] @ localhost []): Normal shutdown
2021-09-08  2:11:13 0 [Note] Event Scheduler: Purging the queue. 0 events
2021-09-08  2:11:13 0 [Note] InnoDB: FTS optimize thread exiting.
2021-09-08  2:11:13 0 [Note] InnoDB: Starting shutdown...
2021-09-08  2:11:13 0 [Note] InnoDB: Dumping buffer pool(s) to /data/database/ib_buffer_pool
2021-09-08  2:11:13 0 [Note] InnoDB: Buffer pool(s) dump completed at 210908  2:11:13
2021-09-08  2:11:14 0 [Note] InnoDB: Shutdown completed; log sequence number 4296968; transaction id 2780
2021-09-08  2:11:14 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2021-09-08  2:11:14 0 [Note] mysqld: Shutdown complete


Nextcloud logs

{"reqId":"IXmnKavTbH4tUIuwdorz","level":2,"time":"2021-09-08T02:16:12+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"IXmnKavTbH4tUIuwdorz","level":2,"time":"2021-09-08T02:16:12+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"u7j9zdrfCZbmXkxOVav8","level":2,"time":"2021-09-08T02:16:12+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"u7j9zdrfCZbmXkxOVav8","level":2,"time":"2021-09-08T02:16:12+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"hDJpU3GLC47rAUeu6S0D","level":2,"time":"2021-09-08T02:16:12+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"hDJpU3GLC47rAUeu6S0D","level":2,"time":"2021-09-08T02:16:12+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"0yCzwe1PNcqnHzBl3A6D","level":2,"time":"2021-09-08T02:16:20+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"0yCzwe1PNcqnHzBl3A6D","level":2,"time":"2021-09-08T02:16:20+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"uGXvRUoI12SW88I17uKy","level":2,"time":"2021-09-08T02:16:20+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"uGXvRUoI12SW88I17uKy","level":2,"time":"2021-09-08T02:16:20+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"Vu8bf3Hg9sNvadt7krNc","level":2,"time":"2021-09-08T02:16:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"Vu8bf3Hg9sNvadt7krNc","level":2,"time":"2021-09-08T02:16:21+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"255DLePVTFb6dZgRLzFZ","level":2,"time":"2021-09-08T02:16:53+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"255DLePVTFb6dZgRLzFZ","level":2,"time":"2021-09-08T02:16:53+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"mARkF1B3KLj0140yRSeJ","level":2,"time":"2021-09-08T02:16:53+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"mARkF1B3KLj0140yRSeJ","level":2,"time":"2021-09-08T02:16:53+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"MMB6Y9DublrfXEiMGsmQ","level":2,"time":"2021-09-08T02:17:00+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"MMB6Y9DublrfXEiMGsmQ","level":2,"time":"2021-09-08T02:17:00+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"fLCsGzLmIdLpf4Rhyluz","level":2,"time":"2021-09-08T02:17:04+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"fLCsGzLmIdLpf4Rhyluz","level":2,"time":"2021-09-08T02:17:04+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}

@WeiChihChern
Copy link

WeiChihChern commented Sep 8, 2021

@nachoparker

and that means that they are retained always

Sorry that I might not use the right words. I understand that the database would retain. In my case, in the external storage that -v into the container.

What I am not sure what to do is that, as mentioned if something like power shortage resulting in relaunching a container is required, what is the correct ways to migrate my database, user, etc into a newly launch container?

It could be:

  1. Using the provided docker image to start a fresh setup.
  2. Upgrade to NC 20, then have everything setup and users upload their files
  3. Encounter situations that need to restart a container
  4. The provided docker image has NC 18, which does not match my database
    What should I do in this case? Thanks.

@nachoparker
Copy link
Member

nachoparker commented Sep 8, 2021

@WeiChihChern it seems like your backup step is failing? can you just run a backup from ncp-config, see how that goes?

The provided docker image has NC 18, which does not match my database
What should I do in this case? Thanks.

this is what you are not understanding I think, the image does not contain NC18. NC18 lives in a volume, along with the data and the database (and the apps). You can restart the container all you want, or you can even change container versions, as long as you include the same volume you will be in the same "NC instance" (but maybe with a different version of NCP tools). That's how we make sure we are always in sync.

@WeiChihChern
Copy link

@nachoparker
backup log:

Running nc-backup
check free space...
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Maintenance mode enabled
backup database...
backup files...
tar: Nextcloud or one of the apps require upgrade - only a limited number of commands are available\nYou may use your browser or the occ upgrade command to do the upgrade\n/data/nextcloud: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
error generating backup
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Maintenance mode disabled
Done. Press any key...

Ahh, now I understand it. Thanks for the explanation.

@ovpc
Copy link
Collaborator

ovpc commented Sep 8, 2021

@ovpc if your proxmox VM is disposable (only if), can you also ncp-update nc-21-vcbranco, then edit /usr/local/bin/ncp-update-nc and remove the line that says set-nc-domain "${nc_domain}", then

ncp-update-nc 21.0.4 # should finish ok this time, but notify_push won't be setup yet
ncc notify_push:log debug
source /usr/local/etc/library.sh
set -x
set-nc-domain localhost
journalctl -u notify_push # hopefully there's some debug info here

You error is super weird and super unhelpful and I can't find what library it comes from :/

Thanks

@nachoparker sorry this VM is not disposible. I will create a fresh one to test this, later on today.

@ovpc
Copy link
Collaborator

ovpc commented Sep 8, 2021

@nachoparker
Could not reproduce the error on a new test VM it updated fine to 21.0.4 (see https://pastebin.com/8jWdiYqh)
Got the old imagick error in NC admin settings tho

Security & setup warnings

This instance is missing some recommended PHP modules. For improved performance and better compatibility it is highly recommended to install them.

imagick

@nachoparker
Copy link
Member

@ovpc can you just try again on your original VM? maybe it was a one time glitch 🤔

@WeiChihChern can you add set -x to /usr/local/bin/ncp-backup as a second line and try to run a backup again?

@WeiChihChern
Copy link

WeiChihChern commented Sep 8, 2021

@nachoparker
Is this what you want?

root@bbb3f069dfbb:/# /usr/local/bin/ncp-backup \ -x
Cannot load Zend OPcache - it was already loaded
check free space...
Cannot load Zend OPcache - it was already loaded
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Maintenance mode enabled
backup database...
backup files...
tar: Nextcloud or one of the apps require upgrade - only a limited number of commands are available\nYou may use your browser or the occ upgrade command to do the upgrade\n/data/nextcloud: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
error generating backup
Cannot load Zend OPcache - it was already loaded
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Maintenance mode disabled

NextCloudPi diagnostics

Cannot load Zend OPcache - it was already loaded
NextCloudPi version  v1.39.0
NextCloudPi image    NextCloudPi_docker_01-19-21
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /data/nextcloud/data
data in SD           yes
data filesystem      overlayfs
data disk usage      23G/48G
rootfs usage         23G/48G
swapfile             /swap
dbdir                /data/database
Nextcloud check      ok
Nextcloud version    20.0.4.0
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        closed
port check 443       closed
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               11:05

Nextcloud configuration

Cannot load Zend OPcache - it was already loaded
Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "1": "172.17.0.2",
            "6": "192.168.1.65",
            "3": "nextcloudpi"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "18.0.3.0",
        "overwrite.cli.url": "https:\/\/nextcloudpi\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "maintenance": false,
        "loglevel": 2,
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***"
    }
}

HTTPd logs

[Wed Sep 08 02:15:46.874358 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/ncp-logo.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.882244 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /wizard/img/ncp-logo.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.886971 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/toggle.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.889035 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/defaults.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.911974 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/poweroff.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.911974 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/reboot.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.935732 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/view-close.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.936091 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/search.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.936607 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/nc-button.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.938924 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/defaults-white.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.938909 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/dashboard.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.939036 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/settings-white.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.939204 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/wizard.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.939963 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/info-white.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.941196 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /img/files.svg failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.949438 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:46.949941 2021] [authz_host:error] [pid 28812:tid 281472612061584] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /ncp-output.php failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:47.003203 2021] [authz_host:error] [pid 28812:tid 281472595276176] [client 172.17.0.1:65320] AH01753: access check of 'localhost' to /img/favicon.png failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:51.744702 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name
[Wed Sep 08 02:15:51.758102 2021] [authz_host:error] [pid 28812:tid 281472620454288] [client 172.17.0.1:65316] AH01753: access check of 'localhost' to /ncp-launcher.php failed, reason: unable to get the remote host name

Database logs

2021-09-08  6:36:41 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:42 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:43 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:44 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:45 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:46 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:47 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:48 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:49 0 [ERROR] InnoDB: Unable to lock ./ibdata1 error: 11
2021-09-08  6:36:49 0 [ERROR] InnoDB: Operating system error number 11 in a file operation.
2021-09-08  6:36:49 0 [ERROR] InnoDB: Error number 11 means 'Resource temporarily unavailable'
2021-09-08  6:36:49 0 [ERROR] InnoDB: Cannot open datafile './ibdata1'
2021-09-08  6:36:49 0 [ERROR] InnoDB: Could not open or create the system tablespace. If you tried to add new data files to the system tablespace, and it failed here, you should now edit innodb_data_file_path in my.cnf back to what it was, and remove the new ibdata files InnoDB created in this failed attempt. InnoDB only wrote those files full of zeros, but did not yet use them in any way. But be careful: do not remove old data files which contain your precious data!
2021-09-08  6:36:49 0 [ERROR] InnoDB: Plugin initialization aborted with error Cannot open a file
2021-09-08  6:36:50 0 [ERROR] Plugin 'InnoDB' init function returned error.
2021-09-08  6:36:50 0 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
2021-09-08  6:36:50 0 [ERROR] Unknown/unsupported storage engine: InnoDB
2021-09-08  6:36:50 0 [ERROR] Aborting

Warning: Memory not freed: 520

Nextcloud logs

{"reqId":"oZYOhg8z9ayeVQSoZwL7","level":2,"time":"2021-09-08T14:40:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"oZYOhg8z9ayeVQSoZwL7","level":2,"time":"2021-09-08T14:40:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"GUJsTvT8WpU6y02GccZe","level":2,"time":"2021-09-08T14:42:46+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"GUJsTvT8WpU6y02GccZe","level":2,"time":"2021-09-08T14:42:46+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"pD2bz91qBA6qRlJxD4X4","level":2,"time":"2021-09-08T14:42:46+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"pD2bz91qBA6qRlJxD4X4","level":2,"time":"2021-09-08T14:42:46+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"bXP47VIekKs8xk4wrpET","level":2,"time":"2021-09-08T14:43:19+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"bXP47VIekKs8xk4wrpET","level":2,"time":"2021-09-08T14:43:19+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"ctdJRV8O6xuEpSd2v552","level":2,"time":"2021-09-08T14:43:20+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"ctdJRV8O6xuEpSd2v552","level":2,"time":"2021-09-08T14:43:20+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"gcIhCGqyTxzPpFMYF0GI","level":2,"time":"2021-09-08T14:43:24+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"gcIhCGqyTxzPpFMYF0GI","level":2,"time":"2021-09-08T14:43:24+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"nKoJxP6zYQE8htEScgWW","level":2,"time":"2021-09-08T14:43:25+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"nKoJxP6zYQE8htEScgWW","level":2,"time":"2021-09-08T14:43:25+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"m7cudvmHOTnoUW0aOdLo","level":2,"time":"2021-09-08T14:43:25+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"m7cudvmHOTnoUW0aOdLo","level":2,"time":"2021-09-08T14:43:25+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"d304npqvqlErv5JPmY5W","level":2,"time":"2021-09-08T14:44:55+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"d304npqvqlErv5JPmY5W","level":2,"time":"2021-09-08T14:44:55+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"8oTw82MYH3T3MowzVAj6","level":2,"time":"2021-09-08T14:45:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}
{"reqId":"8oTw82MYH3T3MowzVAj6","level":2,"time":"2021-09-08T14:45:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"18.0.3.0"}

@nachoparker
Copy link
Member

thanks @WeiChihChern let's just run these commands

sudo sed -i  '1aset -x' /usr/local/bin/ncp-backup
sudo ncp-config
# start a backup from the menu

thanks

@nachoparker
Copy link
Member

nachoparker commented Sep 9, 2021

Can you run this command for me please

curl -v https://pi.emcontacto.eu/push/test/cookie

I want to see if I can automate this, or maybe the ncc config:system:set trusted_proxies 15 --value=pi.emcontacto.eu will be required, we'll see

@vcbranco
Copy link
Author

vcbranco commented Sep 9, 2021

Here's what I've come to understand about this issue.
The upgrade is always successful when the two conditions below are met.

1 - The router's IP is added to the trusted proxy
2 - The router's DNS server knows the LAN IP for the NextCloudPi domain

Adding the domain to the trusted proxy does not solve the issue

curl -v https://pi2.emcontacto.eu/push/test/cookie

  • Expire in 0 ms for 6 (transfer 0x5585b55c30)
  • Expire in 1 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 1 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 2 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 2 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 2 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 2 ms for 1 (transfer 0x5585b55c30)
  • Expire in 0 ms for 1 (transfer 0x5585b55c30)
  • Expire in 1 ms for 1 (transfer 0x5585b55c30)
  • Expire in 4 ms for 1 (transfer 0x5585b55c30)
  • Expire in 1 ms for 1 (transfer 0x5585b55c30)
  • Expire in 1 ms for 1 (transfer 0x5585b55c30)
  • Expire in 4 ms for 1 (transfer 0x5585b55c30)
  • Expire in 2 ms for 1 (transfer 0x5585b55c30)
  • Expire in 2 ms for 1 (transfer 0x5585b55c30)
  • Expire in 2 ms for 1 (transfer 0x5585b55c30)
  • Trying 10.8.6.2...
  • TCP_NODELAY set
  • Expire in 200 ms for 4 (transfer 0x5585b55c30)
  • Connected to pi2.emcontacto.eu (10.8.6.2) port 443 (#0)
  • ALPN, offering h2
  • ALPN, offering http/1.1
  • successfully set certificate verify locations:
  • CAfile: none
    CApath: /etc/ssl/certs
  • TLSv1.3 (OUT), TLS handshake, Client hello (1):
  • TLSv1.3 (IN), TLS handshake, Server hello (2):
  • TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
  • TLSv1.3 (IN), TLS handshake, Certificate (11):
  • TLSv1.3 (IN), TLS handshake, CERT verify (15):
  • TLSv1.3 (IN), TLS handshake, Finished (20):
  • TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
  • TLSv1.3 (OUT), TLS handshake, Finished (20):
  • SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
  • ALPN, server accepted to use h2
  • Server certificate:
  • subject: CN=pi2.emcontacto.eu
  • start date: Sep 9 12:47:55 2021 GMT
  • expire date: Dec 8 12:47:54 2021 GMT
  • subjectAltName: host "pi2.emcontacto.eu" matched cert's "pi2.emcontacto.eu"
  • issuer: C=US; O=Let's Encrypt; CN=R3
  • SSL certificate verify ok.
  • Using HTTP2, server supports multi-use
  • Connection state changed (HTTP/2 confirmed)
  • Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
  • Using Stream ID: 1 (easy handle 0x5585b55c30)

GET /push/test/cookie HTTP/2
Host: pi2.emcontacto.eu
User-Agent: curl/7.64.0
Accept: /

  • TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
  • TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
  • old SSL session ID is stale, removing
  • Connection state changed (MAX_CONCURRENT_STREAMS == 100)!
    < HTTP/2 200
    < date: Thu, 09 Sep 2021 13:56:42 GMT
    < server: Apache
    < strict-transport-security: max-age=15768000; includeSubDomains
    < content-type: text/plain; charset=utf-8
    < content-length: 9
    <
  • Connection #0 to host pi2.emcontacto.eu left intact
    972681697

@JimmyKater
Copy link

@vcbranco

ummm... Nacho wrote "https://pi.emcontacto.eu/push/test/cookie" with you trying to connect to "https://pi2.emcontacto.eu/push/test/cookie"

could that be the problem in your last posting?

@vcbranco
Copy link
Author

vcbranco commented Sep 9, 2021

Letsencrypt only issues 5 certificates per week for each address.
As I was testing I was forced to change the address.
All tests were carried out under the same conditions.
This address refers to an instance configured with the same address.

@PascalHeynmoeller
Copy link

PascalHeynmoeller commented Sep 10, 2021

In my case: Upgrade rolled back, notify_push self test failed with http 503, maybe because notify_push service is only enabled and not started?

@nachoparker
Copy link
Member

nachoparker commented Sep 11, 2021

@PascalHeynmoeller did you run ncp-update nc-21-vcbranco?

I think you are on devel which is only the first preliminary version

maybe because notify_push service is only enabled and not started?

exactly correct

@vcbranco
Copy link
Author

vcbranco commented Sep 11, 2021

Tested the devel repository and everything was OK.
But was necessary to set the nextcloudpi as a trusted proxy, not the router

@vcbranco
Copy link
Author

I tried to test ncp-update nc-21-vcbranco but the installation was downgraded to 1.38.6

@PascalHeynmoeller
Copy link

PascalHeynmoeller commented Sep 11, 2021

@nachoparker I I've now made a test run with nc-21-vcbranco.
this downgraded NCPi after that I started the nextcloud upgrade from ncp-webui with 0. This upgraded to 21.0.4.
HPB is not running
systemctl status didn't fond notify_push caused by an malformed path to the bin
/var/www/nextcloud/apps/notify_push/bin/armv7/notify_push
should be /var/www/nextcloud/apps/notify_push/bin/armv7l/notify_push
with an l after the ...armv7 like reported from uname -m.

uname -m

armv7l

but App uses armv7 as directory
Also Nextcloud says in Administration ->Overview

There are some warnings regarding your setup.

The reverse proxy header configuration is incorrect, or you are accessing Nextcloud from a trusted proxy. If not, this is a security issue and can allow an attacker to spoof their IP address as visible to the Nextcloud. Further information can be found in the documentation.

Your installation has no default phone region set. This is required to validate phone numbers in the profile settings without a country code. To allow numbers without a country code, please add "default_phone_region" with the respective ISO 3166-1 code ↗ of the region to your config file.

Module php-imagick in this instance has no SVG support. For better compatibility it is recommended to install it.

After changing the wrong path to the bin in /etc/systemd/system/notify_push.service

sudo systemctl daemon-reload
sudo systemctl start notify_push
sudo systemctl status notify_push

..... active ....

ncc notify_push:self-test

🗴 no push server configured

Do you want me to execute:
ncc notify_push:setup
???

ncc push_notify:setup
... ENTER

Push binary seems to be running already
✓ push server seems to be functioning correctly.
Reverse proxy seems to be configured already
✓ reverse proxy seems to be setup correctly.
configuration saved

ncc notify_push:self-test

✓ redis is configured
✓ push server is receiving redis messages
✓ push server can load mount info from database
✓ push server can connect to the Nextcloud server
✓ push server is a trusted proxy
✓ push server is running the same version as the app

So I'm now on NC 21.0.4 with running notify_push. Also asked the notify people to change dir name, as you can see below. NCPi System Info still reports:

HPB service | down

@nachoparker
Copy link
Member

@PascalHeynmoeller good catch and amazing feedback. I pushed a fix for the armv7 path

@nachoparker
Copy link
Member

removed nc-21-vcbranco branch, and merged fixes to devel, let's continue testing on that one

@nachoparker
Copy link
Member

@ovpc I was able to reproduce the "http2 error: protocol error" on the VM. Zero info on the internet on how to solve this, so I was able to work around it with an ugly sleep. I think we are good to go!

@ovpc
Copy link
Collaborator

ovpc commented Sep 13, 2021

@ovpc I was able to reproduce the "http2 error: protocol error" on the VM. Zero info on the internet on how to solve this, so I was able to work around it with an ugly sleep. I think we are good to go!

v1.39.1
NC asked for 'default_phone_region' to be added to config.php and as mentioned before install libmagickcore-6.q16-6-extra
But looks good to go now ;-)
image

Thanks @nachoparker and everyone helping out .

@vcbranco
Copy link
Author

NextCloudPi diagnostics

NextCloudPi version  v1.39.1
NextCloudPi image    NextCloudPi_11-27-20
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /var/www/nextcloud/data
data in SD           yes
data filesystem      ext2/ext3
data disk usage      2.8G/29G
rootfs usage         2.8G/29G
swapfile             /var/swap
dbdir                /var/lib/mysql
Nextcloud check      ok
Nextcloud version    21.0.4.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
HPB service          down
Postfix service      up
internet check       ok
port check 80        open
port check 443       open
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               7min

Nextcloud configuration

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "11": "85.247.188.188",
            "1": "10.8.6.53",
            "3": "nextcloudpi"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "21.0.4.1",
        "overwrite.cli.url": "https:\/\/nextcloudpi\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "maintenance": false,
        "loglevel": 2
    }
}

HTTPd logs

[Tue Sep 14 02:05:05.936401 2021] [mpm_event:notice] [pid 786:tid 548395124096] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 14 02:05:05.936440 2021] [core:notice] [pid 786:tid 548395124096] AH00094: Command line: '/usr/sbin/apache2'
[Tue Sep 14 02:10:13.222169 2021] [mpm_event:notice] [pid 786:tid 548395124096] AH00491: caught SIGTERM, shutting down
[Tue Sep 14 02:10:13.325004 2021] [ssl:warn] [pid 28436:tid 548096050560] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 14 02:10:13.325295 2021] [ssl:error] [pid 28436:tid 548096050560] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Tue Sep 14 02:10:13.325315 2021] [ssl:error] [pid 28436:tid 548096050560] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Tue Sep 14 02:10:13.342729 2021] [ssl:warn] [pid 28437:tid 548096050560] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 14 02:10:13.343255 2021] [ssl:error] [pid 28437:tid 548096050560] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Tue Sep 14 02:10:13.343417 2021] [ssl:error] [pid 28437:tid 548096050560] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Tue Sep 14 02:10:13.347130 2021] [mpm_event:notice] [pid 28437:tid 548096050560] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 14 02:10:13.347255 2021] [core:notice] [pid 28437:tid 548096050560] AH00094: Command line: '/usr/sbin/apache2'
[Tue Sep 14 02:10:52.483228 2021] [mpm_event:notice] [pid 28437:tid 548096050560] AH00491: caught SIGTERM, shutting down
[Tue Sep 14 02:11:08.871801 2021] [ssl:warn] [pid 632:tid 547608737152] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 14 02:11:08.877035 2021] [ssl:error] [pid 632:tid 547608737152] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Tue Sep 14 02:11:08.877090 2021] [ssl:error] [pid 632:tid 547608737152] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Tue Sep 14 02:11:08.919949 2021] [ssl:warn] [pid 817:tid 547608737152] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 14 02:11:08.920252 2021] [ssl:error] [pid 817:tid 547608737152] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Tue Sep 14 02:11:08.920297 2021] [ssl:error] [pid 817:tid 547608737152] AH02604: Unable to configure certificate localhost:443:0 for stapling
[Tue Sep 14 02:11:08.924242 2021] [mpm_event:notice] [pid 817:tid 547608737152] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 14 02:11:08.924434 2021] [core:notice] [pid 817:tid 547608737152] AH00094: Command line: '/usr/sbin/apache2'

Database logs

2021-09-14  2:11:09 0 [Note] InnoDB: Uses event mutexes
2021-09-14  2:11:09 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-09-14  2:11:09 0 [Note] InnoDB: Number of pools: 1
2021-09-14  2:11:09 0 [Note] InnoDB: Using generic crc32 instructions
2021-09-14  2:11:09 0 [Note] InnoDB: Initializing buffer pool, total size = 1G, instances = 1, chunk size = 128M
2021-09-14  2:11:09 0 [Note] InnoDB: Completed initialization of buffer pool
2021-09-14  2:11:09 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-09-14  2:11:09 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2021-09-14  2:11:09 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2021-09-14  2:11:09 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2021-09-14  2:11:09 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2021-09-14  2:11:09 0 [Note] InnoDB: 10.3.25 started; log sequence number 7241936; transaction id 17075
2021-09-14  2:11:09 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2021-09-14  2:11:09 0 [Note] Plugin 'FEEDBACK' is disabled.
2021-09-14  2:11:09 0 [Note] Server socket created on IP: '127.0.0.1'.
2021-09-14  2:11:09 0 [Note] Reading of all Master_info entries succeeded
2021-09-14  2:11:09 0 [Note] Added new Master_info '' to hash table
2021-09-14  2:11:09 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.3.25-MariaDB-0+deb10u1'  socket: '/run/mysqld/mysqld.sock'  port: 3306  Debian 10
2021-09-14  2:11:10 0 [Note] InnoDB: Buffer pool(s) load completed at 210914  2:11:10

Nextcloud logs

{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Keep legacy encryption enabled","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Check encryption key format","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Remove old dashboard app config data","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add job to cleanup the bruteforce entries","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Queue a one-time job to check for user uploaded certificates","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Repair DAV shares","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::info: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::info: Repair info: Repaired DAV group shares","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add background job to set the lookup server share state for users","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:34+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::startCheckCodeIntegrity: Starting code integrity check...","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:41+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::finishedCheckCodeIntegrity: Finished code integrity check","userAgent":"--","version":"20.0.2.2"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:41+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::updateEnd: Update successful","userAgent":"--","version":"21.0.4.1"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:41+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::maintenanceDisabled: Turned off maintenance mode","userAgent":"--","version":"21.0.4.1"}
{"reqId":"YfpZBy6Szn0LO8l3IZ5B","level":1,"time":"2021-09-14T01:04:41+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::resetLogLevel: Reset log level to Warning(2)","userAgent":"--","version":"21.0.4.1"}

@nachoparker
Copy link
Member

@vcbranco can you run ncc notify_push:self-test

@vcbranco
Copy link
Author

🗴 no push server configured

@nachoparker
Copy link
Member

what happens if you set it up

source /usr/local/etc/library.sh
set -x
nc_domain="$(ncc config:system:get overwrite.cli.url)"
set-nc-domain "${nc_domain}"

@vcbranco
Copy link
Author

vcbranco commented Sep 14, 2021

Sorry, the instance was not activated.
I will test again

@vcbranco
Copy link
Author

HPB service down

notify_push 0.2.3 installed
notify_push enabled
notify_push already enabled
Module proxy already enabled
Considering dependency proxy for proxy_http:
Module proxy already enabled
Module proxy_http already enabled
Considering dependency proxy for proxy_wstunnel:
Module proxy already enabled
Enabling module proxy_wstunnel.
To activate the new configuration, you need to run:
systemctl restart apache2
Created symlink /etc/systemd/system/multi-user.target.wants/notify_push.service → /etc/systemd/system/notify_push.service.
warning: No domain found. Defaulting to 'nextcloudpi'
System config value trusted_domains => 3 set to string nextcloudpi
System config value overwrite.cli.url set to string https://nextcloudpi/
System config value trusted_proxies => 11 set to string 127.0.0.1
System config value trusted_proxies => 12 set to string ::1
System config value trusted_proxies => 13 set to string nextcloudpi
System config value trusted_proxies => 14 set to string 10.8.6.53
✓ redis is configured
✓ push server is receiving redis messages
✓ push server can load mount info from database
🗴 push server can't connect to the Nextcloud server
error sending request for url (https://10.8.6.53/index.php/apps/notify_push/test/cookie): error trying to connect: invalid dnsname: error trying to connect: invalid dnsname: invalid dnsname
notify_push setup failed. You are probably behind a proxy
Run 'ncc config:system:set trusted_proxies 15 --value=<proxy_IP>' and then 'ncc notify_push:setup https:///push to enable
Check https://help.nextcloud.com/tags/ncp for support
Backup stored at /var/www/nextcloud/data/ncp-update-backups/nextcloud-bkp_20210914_1631585679-20.0.2.2.tar.gz
Clean up...
Done. Press any key...

pi@nextcloudpi:~ $ sudo ncc config:system:set trusted_proxies 15 --value=10.8.6.1
System config value trusted_proxies => 15 set to string 10.8.6.1
pi@nextcloudpi:~ $ ncc notify_push:setup https://nextcloudpi/push
✓ redis is configured
✓ push server is receiving redis messages
✓ push server can load mount info from database
🗴 push server can't connect to the Nextcloud server
error sending request for url (https://10.8.6.53/index.php/apps/notify_push/test/cookie): error trying to connect: invalid dnsname: error trying to connect: invalid dnsname: invalid dnsname

ncp-report

NextCloudPi diagnostics

NextCloudPi version  v1.39.1
NextCloudPi image    NextCloudPi_11-27-20
distribution         Debian GNU/Linux 10 \n \l
automount            no
USB devices          none
datadir              /var/www/nextcloud/data
data in SD           no
data filesystem      ext2/ext3
data disk usage      2.8G/29G
rootfs usage         2.8G/29G
swapfile             /var/swap
dbdir                /var/lib/mysql
Nextcloud check      ok
Nextcloud version    21.0.4.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
HPB service          down
Postfix service      up
internet check       ok
port check 80        open
port check 443       open
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               15min

Nextcloud configuration

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "11": "85.247.188.188",
            "1": "10.8.6.53",
            "3": "nextcloudpi"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "21.0.4.1",
        "overwrite.cli.url": "https:\/\/nextcloudpi\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "maintenance": false,
        "loglevel": 2,
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***"
    }
}

HTTPd logs

[Tue Sep 14 03:11:04.936105 2021] [mpm_event:notice] [pid 795:tid 548565693808] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 14 03:11:04.936162 2021] [core:notice] [pid 795:tid 548565693808] AH00094: Command line: '/usr/sbin/apache2'
[Tue Sep 14 03:13:31.551538 2021] [mpm_event:notice] [pid 795:tid 548565693808] AH00493: SIGUSR1 received.  Doing graceful restart
[Tue Sep 14 03:13:31.588221 2021] [ssl:warn] [pid 795:tid 548565693808] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 14 03:13:31.588693 2021] [ssl:error] [pid 795:tid 548565693808] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Tue Sep 14 03:13:31.588731 2021] [ssl:error] [pid 795:tid 548565693808] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Tue Sep 14 03:13:31.590007 2021] [mpm_event:notice] [pid 795:tid 548565693808] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 14 03:13:31.590039 2021] [core:notice] [pid 795:tid 548565693808] AH00094: Command line: '/usr/sbin/apache2'
[Tue Sep 14 03:13:32.887265 2021] [mpm_event:notice] [pid 795:tid 548565693808] AH00493: SIGUSR1 received.  Doing graceful restart
[Tue Sep 14 03:13:32.910815 2021] [ssl:warn] [pid 795:tid 548565693808] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 14 03:13:32.910985 2021] [ssl:error] [pid 795:tid 548565693808] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Tue Sep 14 03:13:32.911004 2021] [ssl:error] [pid 795:tid 548565693808] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Tue Sep 14 03:13:32.911908 2021] [mpm_event:notice] [pid 795:tid 548565693808] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 14 03:13:32.911929 2021] [core:notice] [pid 795:tid 548565693808] AH00094: Command line: '/usr/sbin/apache2'
[Tue Sep 14 03:18:38.301109 2021] [mpm_event:notice] [pid 795:tid 548565693808] AH00493: SIGUSR1 received.  Doing graceful restart
[Tue Sep 14 03:18:38.323495 2021] [ssl:warn] [pid 795:tid 548565693808] AH01909: localhost:4443:0 server certificate does NOT include an ID which matches the server name
[Tue Sep 14 03:18:38.323722 2021] [ssl:error] [pid 795:tid 548565693808] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=archlinux / issuer: CN=archlinux / serial: 0112307086B5A933D74576F54C8FD74C8207A8AF / notbefore: Nov 27 22:55:31 2020 GMT / notafter: Nov 25 22:55:31 2030 GMT]
[Tue Sep 14 03:18:38.323744 2021] [ssl:error] [pid 795:tid 548565693808] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Tue Sep 14 03:18:38.324772 2021] [mpm_event:notice] [pid 795:tid 548565693808] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Tue Sep 14 03:18:38.324818 2021] [core:notice] [pid 795:tid 548565693808] AH00094: Command line: '/usr/sbin/apache2'

Database logs

2021-09-14  3:09:55 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-09-14  3:09:55 0 [Note] InnoDB: Number of pools: 1
2021-09-14  3:09:55 0 [Note] InnoDB: Using generic crc32 instructions
2021-09-14  3:09:55 0 [Note] InnoDB: Initializing buffer pool, total size = 1G, instances = 1, chunk size = 128M
2021-09-14  3:09:55 0 [Note] InnoDB: Completed initialization of buffer pool
2021-09-14  3:09:55 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-09-14  3:09:55 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2021-09-14  3:09:55 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2021-09-14  3:09:55 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2021-09-14  3:09:55 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2021-09-14  3:09:55 0 [Note] InnoDB: Waiting for purge to start
2021-09-14  3:09:55 0 [Note] InnoDB: 10.3.25 started; log sequence number 4564603; transaction id 2868
2021-09-14  3:09:55 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2021-09-14  3:09:55 0 [Note] Plugin 'FEEDBACK' is disabled.
2021-09-14  3:09:55 0 [Note] Server socket created on IP: '127.0.0.1'.
2021-09-14  3:09:55 0 [Note] Reading of all Master_info entries succeeded
2021-09-14  3:09:55 0 [Note] Added new Master_info '' to hash table
2021-09-14  3:09:55 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.3.25-MariaDB-0+deb10u1'  socket: '/run/mysqld/mysqld.sock'  port: 3306  Debian 10
2021-09-14  3:09:56 0 [Note] InnoDB: Buffer pool(s) load completed at 210914  3:09:56

Nextcloud logs

{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Keep legacy encryption enabled","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Check encryption key format","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Remove old dashboard app config data","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add job to cleanup the bruteforce entries","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Queue a one-time job to check for user uploaded certificates","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Repair DAV shares","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::info: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::info: Repair info: Repaired DAV group shares","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Deprecated event type for \\OC\\Repair::step: Symfony\\Component\\EventDispatcher\\GenericEvent is used","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Repair::step: Repair step: Add background job to set the lookup server share state for users","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:05+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::startCheckCodeIntegrity: Starting code integrity check...","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:12+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::finishedCheckCodeIntegrity: Finished code integrity check","userAgent":"--","version":"20.0.2.2"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:12+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::updateEnd: Update successful","userAgent":"--","version":"21.0.4.1"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:12+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::maintenanceDisabled: Turned off maintenance mode","userAgent":"--","version":"21.0.4.1"}
{"reqId":"yFPZ8WUP3JNNhbA2xUD9","level":1,"time":"2021-09-14T02:18:12+00:00","remoteAddr":"","user":"--","app":"updater","method":"","url":"--","message":"\\OC\\Updater::resetLogLevel: Reset log level to Warning(2)","userAgent":"--","version":"21.0.4.1"}

@vcbranco
Copy link
Author

Now is UP

ncc notify_push:self-test

✓ redis is configured
✓ push server is receiving redis messages
✓ push server can load mount info from database
✓ push server can connect to the Nextcloud server
✓ push server is a trusted proxy
✓ push server is running the same version as the app

@nachoparker
Copy link
Member

ah right, the static IP thing. I have to tweak that again

Now is UP

after the commands I pasted? after a reboot? what made it work?

@nachoparker
Copy link
Member

actually I see no way of making it work with an IP, since you don't have a domain set up yet and HPB just doesn't support that. It should get activated though when letsencrypt or dnsmasq are enabled

@vcbranco
Copy link
Author

vcbranco commented Sep 14, 2021

The HPB service started after a reboot

In my case my production box as a domain configured, is not a problem.
I can setup an test instance and try later, today, with a domain configured.

@vcbranco
Copy link
Author

Tested ok. The HPB service is up.

ncp-update devel
nc-static-ip
ncc config:system:set trusted_proxies 15 --value=10.8.6.1
Letsencrypt
nc-update-nextcloud

If I do not set the proxy before the update I will need to set after the nc-update-nextcloud.
I think this issue happens only with my router (acting like a proxy) and this is not a problem for me.

It would be better if someone could test with a different router

@nachoparker
Copy link
Member

great testing, thank you so much

@ovpc
Copy link
Collaborator

ovpc commented Sep 15, 2021

Maybe just another quirck again, all testing servers upgraded fine, but my production server did not:

It gives me an: Error code: SSL_ERROR_RX_RECORD_TOO_LONG
I 'm using an alternate ssl port, which could be cause, but it never did before, and local IP does not respond either.
When running nc-info I notice HPB is down, what is HPB?
Also some proxy settings in config where added, could they be at the root of the error?

sudo ncp-config
cat: /var/run/.ncp-latest-version: No such file or directory
Running nc-info
Gathering information...
NextCloudPi version v1.39.1
distribution Debian GNU/Linux 10 \n \l
automount no
USB devices sde
datadir /home/btrfs/ncdata
data in SD yes
data filesystem btrfs
data disk usage 1,5T/4,6T
rootfs usage 9,1G/28G
swapfile /media/swap/swap
dbdir /var/lib/mysql
Nextcloud check ok
Nextcloud version 21.0.4.1
HTTPD service up
PHP service up
MariaDB service up
Redis service up
HPB service down
Postfix service up
internet check ok
port check 80 open
port check 443 open
IP 192.168.2.41
gateway 192.168.2.254
interface eno1
certificates none
NAT loopback no
uptime 1min

Please ignore, was instance on (very) old hardware, so moved/restored to a VM on Proxmox now ;-)

@nachoparker
Copy link
Member

I've seen that SSL error before, I think it's trying to use https on a non https port. HPB is the same thing as notify_push. It's the new high performance backend written in rust to offload user notifications to improve performance.

@ovpc
Copy link
Collaborator

ovpc commented Sep 15, 2021

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants