fixing the 2GB upload size limit #158
Comments
nachoparker
changed the title
|
Well, don't panic! Even for 32bit systems, there's a workaround to the PHP limitation. It is scheduled to land in NC13, but if you can patch it yourself today nextcloud/server#1707 (comment) Also, you can use NFS, SSH or SAMBA to upload the big files. See the related posts in own your bits. https://ownyourbits.com/2017/04/18/different-ways-to-access-your-nextcloud-files/ In any case, NCP will probably end up being ported to 64bit, but it's a bit lower priority |
|
Do I just edit according to that thread? Am I suppose to recompile it or something? Is it as simple as edit,save, and reboot? Cause it isn't working for me :( EDIT: Some basic sanity checks: Am I editing the correct sapi.php file? |
|
No, no need to recompile, it should be instantaneous That's the file. I don't remember if you have to make other server config changes. |
|
Is the edit suppose to fix the upload/download sizes ? EDIT: I keep getting
The edit made according to that thread (comment out |
|
Hi, Thanks for the help on this. The problem is only with uploads I think. that looks about right Maybe there's some server configuration that you want to review, but I think everything is correct so it surprises me that still doesn't work for you. I assume you have rebooted, just in case? I was waiting for NC13, because applying the patch as part of the build process is possible but messy, and there's more guarantee that it's going to work after upstream has released it, but if there's people interested in making it work it would be nice, to be ready for when it lands, or maybe implement it as a I'll paste here some resources. Maybe somebody else can help review this. I need to address some bugs that came with Stretch first https://devsidestory.com/build-a-64-bit-kernel-for-your-raspberry-pi-3/ |
nachoparker
changed the title
|
Yes I rebooted, and I guess I'll just have to wait for NC 13 to patch this |
|
Ok, I'll leave the help wanted tag if anybody want to try this. In that case we can reopen |
|
In case anyone else finds this looking for a workaround, installing the Nextcloud 13 beta (beta 3 was published a few days ago) resolves the upload issues. I was able to upload 8-9GB files using the web UI with that beta installed. |
|
@gboudreau awesome, thanks for letting us know |
|
Sorry to reopen this: When I upload a 5.0GB MOV file through the web interface while normally logged in everything seems to go smooth(ish).* I used microsoft FC /B (binary file compare) command to check the original and uploaded-and-synced-back-to-client versions were identical bit-to-bit. However: when I create a share link for a folder for someone to upload their files to, say for a friend with GoPro footage of my snowboard crashes, then the file gets uploaded "successfully", but truncated at 2.0GB. My guess: the share-link page uses different code than the normal web UI and does not have the updated code in it that handles >2GB files correctly? *Sometimes it keeps saying "a few seconds" for a looooong time when uploading is done (no data upload according to Windows Task Manager). Then after a while desktop client starts syncing the file while the web environment still says "a few seconds". When pressing F5, file appears in the list without errors, but otherwise "a few seconds" won't disappear. This problem does not occur when the files are truncated, then the upload bar disappears when both are uploaded and truncated. |
Your guess sounds correct to me. Better report this in the main NC repo, or in the forums Thanks for the feedback |
|
No problem, I have created the thread also in the main Nextcloud repo, #9053. At first I thought my friend was completely retarded; I could upload big files and he couldn't. Guess I owe him a beer now ;) |
|
lol I guess you are right xD keep us posted |
|
shouldn't this be reopened? |
|
mmm, if anything I would create a new issue, and close it as a external bug, so let's just leave the issue you created linked here for people investigating this in the wrong place I am also now tracking the issue |
|
This was fixed with the update to NC13 |
|
I found that this fix - with 32bits OS like raspbian - unfortunatly breaks video streaming playback on Apple iOS Safari or Nextcloud iOS App (>v2.22) , as the 32bit workaround ignores the Content-Length header, which is not supported in iOS. |
|
The problem is tmpfs size for PHP-FPM. Since user is anonymus over shared link, temporary upload file isn't written to Nextcloud user directory (over PHP session), but is written to system tmpfs (/tmp) instead, which is 2Gb by default, thus upload file over shared link is being truncated: [root@nextcloud ~]# df -h|grep tmp Our soution is to change PHP-FPM tmpdir settings: [root@nextcloud ~]# cat /etc/php-fpm.d/custom.conf [root@nextcloud ~]# systemctl restart php-fpm Another possible solution would be tmpfs resize, but actually this is not a good idea, since tmpfs is really RAM allocation/consumption. |
|
Fixed by docker-library/php#901 |
|
I tried to upload a video file >5GB via Desktop client to my cloud, but it seems not to work. It says it has uploaded the file, but only 1,3GB got uploaded. I have the Pi4 model on NextCloudPi 19.0.2 and I have set the maximum file size to 1000GBs. |
|
You will have to migrate to the 64bit version. This week we'll have raspberry pi NCP image that supports 64bits |
Thats wonderful, because yesterday I found that I have the same problem. I have a Raspberry Pi 4 with NCP and I could't upload a mp4-File with 2,3GB. If I understand you correctly, I can download the image and then I have a 64 bit NCP system on a Raspberry Pi 4, which actually only has 32 bit, without the 2GB limitation? That would be great! :-) Where do we find out when the new version is ready and where can we download it? Is there a manual for people who are not so familiar with Linux? Many greetings |
|
Raspberry Pi 4 is 64 bits, but Raspbian is 32bits. We are moving to a different OS that is 64 bits. you can join the Telegram group to get a notification, also check out docs.nextcloudpi.com |
|
You can use the RaspiOS 64. It works perfectly |
|
the latest image uses RaspiOS 64 bits. It's already downloadable |
|
Is also the Nextcloud Installation included in this Image? Or must I manually install nextcloud pi?
Regards David
…-------- Ursprüngliche Nachricht --------
Von: nachoparker <notifications@github.com>
Datum: 30.11.20 16:43 (GMT+01:00)
An: nextcloud/nextcloudpi <nextcloudpi@noreply.github.com>
Cc: Vergossen <david.vergossen@gmx.de>, Comment <comment@noreply.github.com>
Betreff: Re: [nextcloud/nextcloudpi] fixing the 2GB upload size limit (#158)
the latest image uses RaspiOS 64 bits. It's already downloadable
—You are receiving this because you commented.Reply to this email directly, view it on GitHub, or unsubscribe.
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "#158 (comment)",
"url": "#158 (comment)",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]
|
|
I hope that I find a tutorial how to transfer the actual Database to the new OS and the New NCP-installation without loss of Data.
…-------- Ursprüngliche Nachricht --------
Von: nachoparker <notifications@github.com>
Datum: 30.11.20 16:43 (GMT+01:00)
An: nextcloud/nextcloudpi <nextcloudpi@noreply.github.com>
Cc: Vergossen <david.vergossen@gmx.de>, Comment <comment@noreply.github.com>
Betreff: Re: [nextcloud/nextcloudpi] fixing the 2GB upload size limit (#158)
the latest image uses RaspiOS 64 bits. It's already downloadable
—You are receiving this because you commented.Reply to this email directly, view it on GitHub, or unsubscribe.
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "#158 (comment)",
"url": "#158 (comment)",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]
|
|
https://docs.nextcloudpi.com/en/how-to-backup-and-restore-a-nextcloudpi-instance-using-ncp-config/
does not boot on my rpi2B armv7, is that to be expected? |
|
@nachoparker Thank you very much! Installed the new update and everything worked fine! |
|
https://ownyourbits.com/downloads/NextCloudPi_RPi_11-27-20/ |
yes. rpi2B cards are not ARM64. |
duckduckgoing around, the first result that comes up is nextcloudpi, doesn't show anything else
I'm sure there's something out on the internet that is similar to nextcloudpi but is 64-bit?
If there exist such thing, it means I could use that and get unlimited upload sizes to nextcloud without the 32-bit php and 32-bit raspbian limiting me
@nachoparker I'm pretty sure you know of such thing?
The text was updated successfully, but these errors were encountered: