Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support of a different AWS connection for DynamoDB #29452

Merged
merged 8 commits into from
Mar 9, 2023
Merged

Add support of a different AWS connection for DynamoDB #29452

merged 8 commits into from
Mar 9, 2023

Commits on Mar 9, 2023

  1. Add support of a different AWS connection for DynamoDB 

    In cases when DynamoDBToS3Operator operator is used with a DynamoDB
table and an S3 bucket in different accounts, a separate AWS
connection is needed (i.e. if you need to assume an IAM role from a
different account).

Use source_aws_conn_id to specify AWS connection for accessing DynamoDB
and optionally dest_aws_conn_id for S3 Bucket access with a fallback to
source_aws_conn_id.

Deprecates aws_conn_id in favour of source_aws_conn_id.
    @dym-ok
    dym-ok committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    a16cb77 View commit details
    Browse the repository at this point in the history

  2. Update airflow/providers/amazon/aws/transfers/dynamodb_to_s3.py 

    Co-authored-by: Andrey Anshin <Andrey.Anshin@taragol.is>
    @dym-ok @Taragolis
    dym-ok and Taragolis authored Mar 9, 2023
    Configuration menu
    Copy the full SHA
    a34476e View commit details
    Browse the repository at this point in the history

  3. Update airflow/providers/amazon/aws/transfers/dynamodb_to_s3.py 

    Co-authored-by: Andrey Anshin <Andrey.Anshin@taragol.is>
    @dym-ok @Taragolis
    dym-ok and Taragolis authored Mar 9, 2023
    Configuration menu
    Copy the full SHA
    d8dcf4f View commit details
    Browse the repository at this point in the history

  4. Update airflow/providers/amazon/aws/transfers/dynamodb_to_s3.py 

    Co-authored-by: Andrey Anshin <Andrey.Anshin@taragol.is>
    @dym-ok @Taragolis
    dym-ok and Taragolis authored Mar 9, 2023
    Configuration menu
    Copy the full SHA
    e505564 View commit details
    Browse the repository at this point in the history

  5. Update airflow/providers/amazon/aws/transfers/dynamodb_to_s3.py 

    Co-authored-by: Andrey Anshin <Andrey.Anshin@taragol.is>
    @dym-ok @Taragolis
    dym-ok and Taragolis authored Mar 9, 2023
    Configuration menu
    Copy the full SHA
    9727da1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into fead/dynamodb_conn_id

    @dym-ok
    dym-ok authored Mar 9, 2023
    Configuration menu
    Copy the full SHA
    71a95cd View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into fead/dynamodb_conn_id

    @Taragolis
    Taragolis authored Mar 9, 2023
    Configuration menu
    Copy the full SHA
    4899a7d View commit details
    Browse the repository at this point in the history

  8. Apply suggestions from code review 

    Co-authored-by: D. Ferruzzi <ferruzzi@amazon.com>
    @Taragolis @ferruzzi
    Taragolis and ferruzzi authored Mar 9, 2023
    Configuration menu
    Copy the full SHA
    6dadd08 View commit details
    Browse the repository at this point in the history