aws s3 sync - syncing too many files when running recursively Windows #459
Labels
Comments
|
I believe this is related to the issue fixed by merged pull request #865. Closing for now, please reopen if it is still an issue on the latest version. |
thoward-godaddy
pushed a commit
to thoward-godaddy/aws-cli
that referenced
this issue
Feb 12, 2022
Functional tests for the local APIGW we intermittently failing due to connection issues. This is due to the variable time periods the local APIGW needs to get setup. Adding a sleep statement to the setup methods, allows time for the setup to finish. Pervisouly, this was only in one tests setup method.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Using windows I am trying to sync a folder with 500000+ files (about 2TB). The files are organised in a two layers of folders d:\server\folder\1\file1.log, d:\server\folder\1\file2.log
After completing a sync:
aws s3 sync d:\server\folder s3:\bucketname\server\folder
Running this command again will start uploading files from d:\server\folder\3 - even though these file haven't changed since 2006:
aws s3 sync d:\server\folder s3:\bucketname\server\folder
What is strange is that if I specify the folder name I get expected behavior:
aws s3 sync d:\server\folder\3 s3:\bucketname\server\folder\3
I tried to create a smaller test case for this, but cannot reproduce the error. I solved my case by creating a for loop in a .bat file.
Version: aws-cli/1.2.3 Python/2.7.5 Windows/2008ServerR2
The text was updated successfully, but these errors were encountered: