Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[stable30] Improve (slow) move on same object #48221

Merged
merged 2 commits into from
Sep 20, 2024

Conversation

icewind1991
Copy link
Member

Backport of #47986 with fixes from #48145

Christoph Fiehe and others added 2 commits September 19, 2024 18:53
This commit fixes the issue #47856. When you upload a file into a group folder and when you use a single S3 bucket as primary storage, the final move operation hangs for a long time. In the background, Nextcloud initiates a copy-delete sequence from the bucket into the bucket, with causes a lot unnecessary overhead. Nextcloud thinks that the file must be imported to another storage and does not recognize that everything is done on the same object bucket. In that case, the import step can be completely skipped, which saves time, network bandwidth and reduces the load on the object storage.

The behavior improves a lot with #46013. However, there are still some put messages that are being sent to the object storage when you use an object storage as primary storage and upload files into a group folder.

Co-authored-by: Kate <26026535+provokateurin@users.noreply.github.com>
Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de>
Some are still failing

Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>
@icewind1991 icewind1991 changed the title Backport/30/fix move on same bucket [stable30] Improve (slow) move on same object Sep 19, 2024
@icewind1991 icewind1991 marked this pull request as ready for review September 19, 2024 17:36
@icewind1991 icewind1991 requested review from a team, Altahrim, nfebe and sorbaugh and removed request for a team September 19, 2024 17:37
@icewind1991 icewind1991 added the 3. to review Waiting for reviews label Sep 19, 2024
@icewind1991 icewind1991 added this to the Nextcloud 30.0.1 milestone Sep 19, 2024
@icewind1991 icewind1991 requested a review from come-nc September 19, 2024 19:04
@provokateurin provokateurin merged commit ae7241f into stable30 Sep 20, 2024
176 checks passed
@provokateurin provokateurin deleted the backport/30/fix_move_on_same_bucket branch September 20, 2024 08:06
@Altahrim Altahrim mentioned this pull request Oct 1, 2024
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3. to review Waiting for reviews
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants