v0.17.1

extra_tags argument in create_dag allows users to specify additional tags to append to any existing DAG tags.

v0.17.0

Removes unneeded airflow imports. Should be compatible as far back as 1.10.10.

Thank you to @josh-fell for the contribution! 🎉

v0.16.0

extra_callables

extra_callables now available for .py files, allowing multiple callables to be passed to an underlying operator, for instance:

# ---
# operator: my.custom.operator
# python_callable: main
# extra_callables:
#    my_extra_operator_callable: my_other_func
# ---

def main():
    return 'hello'

def my_other_func():
    return 'world'

Where my_extra_operator_callable is the name of the argument in the operator and my_other_func is the name of the function in the task definition file.

Consider parent class __init__ arguments

apache-airflow-providers-common-sql 1.3.0 allows for SQL-focused operators to no longer have a direct sql argument, which can break existing task definition files. The __init__ method of parent class of SQL operators (e.g. SqliteOperator), now contains the sql argument.

gusty now considers parent class's __init__ arguments.

v0.15.1

Allows for the "magic loop" to be enabled in create_dags, where users can optionally pass through a current_dag_id string.

Breaking Change - The globals argument of create_dags has been renamed to caller_env.

v0.14.0

Uses external_dag_id in wait_for external task name.

v0.12.3

Bug fixes:

• nested_update ensures copies of dictionaries

• METADATA.yml is parsed used the default YAML parser

v0.12.2

Adds a leaf_tasks_from_dict option to create_dag and create_dags. Useful if users want to have a uniform leaf task at the end of all DAGs.

Example:

create_dags(
    ...,
    leaf_tasks_from_dict={
            "my_dag_is_done": {"operator": "airflow.operators.empty.EmptyOperator"}
        }
)

v0.12.1

• multi_task_spec can now update its base spec collections. This means top-level dictionaries in a spec can be partially or completely updated with their equivalent dictionaries in multi_task_spec.

• Updated README to include instructions on how to use create_dags

• Updated dev-requirements.txt

v0.12.0

• Moves create_dags to a top level import (and out of gusty.experimental)
• Adds logo

v0.11.3

Bug fix ensures that dag_constructors take precedence over ABSQL default functions when there are naming collisions.

Removed empty collections as default arguments where applicable.