Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Emulate multipart upload with single-part uploads #26

Merged
merged 1 commit into from
Mar 2, 2015

Conversation

gaul
Copy link
Owner

@gaul gaul commented Jan 3, 2015

This approach requires three times as many operations as the optimal
approach. Implementing this correctly requires exposing the
underlying multipart operations in jclouds. Most s3-tests pass but
two still fail:

test_multipart_upload_size_too_small
test_list_multipart_upload

References #2.

@gaul
Copy link
Owner Author

gaul commented Jan 3, 2015

This implements the multipart API at a ruinous cost -- writing, reading, and re-writing every part. I am not sure if it is worth merging but it demonstrates all the required functionality that we need to migrate into jclouds.

@gaul gaul force-pushed the emulated-multipart branch from e7c81e4 to 21b6d8f Compare January 3, 2015 07:09
@buildhive
Copy link

Andrew Gaul » s3proxy #44 SUCCESS
This pull request looks good
(what's this?)

@gaul gaul force-pushed the emulated-multipart branch 2 times, most recently from b3fbfb6 to c82825a Compare January 14, 2015 22:13
@gaul gaul force-pushed the emulated-multipart branch from c82825a to 44841bb Compare January 21, 2015 02:31
@gaul gaul force-pushed the emulated-multipart branch from 44841bb to 3363687 Compare February 21, 2015 02:42
@gaul gaul force-pushed the emulated-multipart branch 2 times, most recently from 5d2ab56 to e38fb02 Compare March 1, 2015 04:03
This approach requires three times as many operations as the optimal
approach.  Implementing this correctly requires exposing the
underlying multipart operations in jclouds.  Most s3-tests pass but
test_list_multipart_upload still fails:

References #2.
@gaul gaul force-pushed the emulated-multipart branch from e38fb02 to b0b1f4e Compare March 2, 2015 23:00
@gaul gaul merged commit b0b1f4e into master Mar 2, 2015
@gaul gaul deleted the emulated-multipart branch March 2, 2015 23:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants