Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

S3Client to use Boto3 #2149

Merged
merged 78 commits into from
May 1, 2018
Merged

S3Client to use Boto3 #2149

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
ef68352
AWS_SESSION_Token read from ENV
ouanixi May 20, 2017
053b22a
add s3client
Oct 16, 2017
bddd365
s3client using boto3
Oct 16, 2017
0cb9222
removed AWS creds from travis and tox env vars
Oct 16, 2017
4556886
removed AWS creds from travis and tox env vars
Oct 16, 2017
78b4ea9
importing form contrib.s3 instead of s3 directly
Oct 16, 2017
c61e14f
AWS credentials passed as env vars
Oct 16, 2017
a03d254
fixed wrong s3 import
Oct 16, 2017
a07493b
redshift tests passing locally
Oct 16, 2017
6e7fd65
test_ecs mocked
Oct 16, 2017
15abbc4
changed all byte instances to strings
Oct 16, 2017
f6459fe
writing to file as bytes
Oct 16, 2017
98cf93e
decoding bytes to strings for python3 tests
Oct 16, 2017
e0259ea
contrib/redshift test reading creds from env vars
Oct 16, 2017
979dc5f
travis build on master
Oct 16, 2017
65bd126
flake8 redshift_test
Oct 16, 2017
4907f6d
reverted to master redshift_test
Oct 17, 2017
d24ad4a
skipping test/redshift_test.py on travis
Oct 17, 2017
d5647d2
flake8 test/redshift_test.py
Oct 17, 2017
f06a533
flake8 test/redshift_test.py
Oct 17, 2017
74f44c2
skipping test/redshift_test.py on travis
Oct 17, 2017
8586461
moved test/redshift_test.py to test/contrib/
Oct 17, 2017
a6e150d
redshift_test using mocked S3Target open
Oct 17, 2017
407ccb8
redshift_test using mocked S3Target open
Oct 17, 2017
c1495ec
redshift_test using mocked S3Target open
Oct 17, 2017
e00335b
moved redshift_test to contrib folder and refactored redshiftmanifest…
Oct 17, 2017
407839c
fixed flake8 errors
Oct 17, 2017
09f2029
added multipart s3 tests
Oct 18, 2017
55e1db1
added multipart s3 tests
Oct 18, 2017
dc283e0
added multipart s3 tests
Oct 18, 2017
92074f5
AWS_SESSION_Token read from ENV
ouanixi May 20, 2017
421959f
add s3client
Oct 16, 2017
64f1f99
removed AWS creds from travis and tox env vars
Oct 16, 2017
9744d92
removed AWS creds from travis and tox env vars
Oct 16, 2017
07579e9
importing form contrib.s3 instead of s3 directly
Oct 16, 2017
2134d2a
AWS credentials passed as env vars
Oct 16, 2017
ef22aba
fixed wrong s3 import
Oct 16, 2017
1c8ec1b
redshift tests passing locally
Oct 16, 2017
d140533
test_ecs mocked
Oct 16, 2017
e112943
changed all byte instances to strings
Oct 16, 2017
1f02c68
writing to file as bytes
Oct 16, 2017
ae4209b
decoding bytes to strings for python3 tests
Oct 16, 2017
a8a9e13
contrib/redshift test reading creds from env vars
Oct 16, 2017
26ab71e
travis build on master
Oct 16, 2017
5b85396
flake8 redshift_test
Oct 16, 2017
59d1bd7
reverted to master redshift_test
Oct 17, 2017
f50c73e
skipping test/redshift_test.py on travis
Oct 17, 2017
fde8143
flake8 test/redshift_test.py
Oct 17, 2017
28456ff
flake8 test/redshift_test.py
Oct 17, 2017
cde1277
skipping test/redshift_test.py on travis
Oct 17, 2017
04a3580
moved test/redshift_test.py to test/contrib/
Oct 17, 2017
9c06a65
redshift_test using mocked S3Target open
Oct 17, 2017
1a08f97
redshift_test using mocked S3Target open
Oct 17, 2017
d8889e9
redshift_test using mocked S3Target open
Oct 17, 2017
640e65d
moved redshift_test to contrib folder and refactored redshiftmanifest…
Oct 17, 2017
7cb1ed2
fixed flake8 errors
Oct 17, 2017
42fabe8
fixed flake8 errors
Oct 17, 2017
5f4b7f6
added multipart s3 tests
Oct 18, 2017
ee7817a
added multipart s3 tests
Oct 18, 2017
e57cf51
added multipart s3 tests
Oct 18, 2017
32ab31a
travis to trigger builds on master
Oct 18, 2017
8b2d1e2
skip on travis message made clearer
ouanixi Nov 22, 2017
7524f4e
add s3client with rebase
ouanixi Nov 22, 2017
29a24f2
removed arn resolution
Nov 23, 2017
aae7417
s3client resolving auth alone
Nov 23, 2017
938c57d
logging boto3 resource call
ouanixi Nov 23, 2017
1059926
fixed as per PR's comments
Jan 5, 2018
59efe32
fix as per PR comments
Jan 5, 2018
1a66ca2
removed blank line for flake8
Jan 5, 2018
20f7738
removed unused OptionParameter
Feb 2, 2018
2438180
add deprecated error to s3.resource
ouanixi Feb 8, 2018
0975957
fixed flake8
ouanixi Feb 8, 2018
098e19b
batch tests skip on travis
ouanixi Apr 30, 2018
334b580
fix flake8 errors
ouanixi Apr 30, 2018
2237c6c
rebase with master
ouanixi Apr 30, 2018
01866ef
update listdir docstring
ouanixi Apr 30, 2018
adf4796
skip multipart test on travis
ouanixi Apr 30, 2018
45714d6
further multipart tests to skip on travis
ouanixi Apr 30, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .travis.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,9 @@ env:
- BQ_TEST_PROJECT_ID=luigi-travistestenvironment
- BQ_TEST_INPUT_BUCKET=luigi-bigquery-test
- GOOGLE_APPLICATION_CREDENTIALS=test/gcloud-credentials.json
- AWS_DEFAULT_REGION=us-east-1
- AWS_ACCESS_KEY_ID=accesskey
- AWS_SECRET_ACCESS_KEY=secretkey
matrix:
- TOXENV=flake8
- TOXENV=docs
Expand Down
Loading