v0.8.0

external_dependencies blocks now accept dicts, where the keys are the external DAG names and the values are either:

• tasks: A list of tasks out of which ExternalTaskSensors should be created
• ExternalTaskSensor parameters, such as retries or execution_delta, so that users can override any wait_for_defaults set on the DAG-level.

external_dependencies dicts are available at the task, task group, and DAG level.

Additionally, a bug was fixed, so now multiple tasks from one external DAG can be listed in external_dependencies blocks. Note that list-style external_dependencies are permissible.

v0.7.2

Custom dag_constructors now supported on all file types.

v0.7.1

Supports passing a list of functions to the dag_constructors argument of create_dag.

v0.7.0

Adds support for custom YAML constructors in create_dag by passing a dict of constructor tags and functions (e.g. {"!custom_func": custom_func}) to the dag_constructors argument of create_dag.

Replaces GustyYAMLLoader class with generate_loader function.

v0.6.2

Updated the GustyYAMLLoader

• Uses SafeLoader
• Updated and tested to work with all constructor functions (!days_ago, !timedelta, and !datetime)

v0.6.1

Added NonexistentDagDirError to give a clear error message when creating a DAG from a directory that does not exist.

sql and parse_hooks

gusty 0.6.0 brings two neat features to users:

• .sql files are now supported by default, operating similarly to other file types supported by gusty.
• A parse_hooks parameter is now available in create_dag which allows users to share their own file parsing functions for any file type.

See a .sql file in action at the gusty demo and take a look at gusty's default parsers to learn more about how to make your own.

parse_hooks accepts a dictionary similar to the one gusty uses for its default parsers, and accepts the overriding of these default parsers (e.g. .yml, .py).

Happy pipelining!

v0.5.5

• python_callable available much more freely across any customer operator.
• _gusty_parameters is available to override the inspecting of the __init__ signature of custom operators.

0.5.4

Fixed the nearly esoteric bug of - when a task group is generated as a task (e.g. a customer operator inherits the TaskGroup object, which creates a series of tasks, and is invoked in a .yml) - ensuring that root dependencies are set correctly in the event that the task group tasks only depends on other task group tasks / task groups.

0.5.3

Small bug fix - when considering tasks/task groups for setting root task dependencies, gusty now correctly omits task groups whose upstream dependencies are solely other task groups.