Skip to content

Releases: DataBiosphere/dsub

Release v0.2.2

02 Nov 22:42
1126dc1
Compare
Choose a tag to compare

This release includes:

  • Support for Requester Pays buckets via the new --user-project option (google-v2 and local providers)
  • Fixes dstat ... --limit off-by-one bug

Release v0.2.1

04 Oct 22:18
c968683
Compare
Choose a tag to compare

This release includes:

  • Documentation updates noting the deprecation of the google provider.
  • google-v2 provider updates:
    • --log-interval flag to configure the amount of time to sleep between copying log files from the pipeline to the logging path.
    • Adding google-v2 specific elements to dstat output.
    • --ssh flag to start an SSH container in the background, allowing you to inspect the runtime
      environment of your job's container in real time.
    • Experimental support for gcsfuse through the --mount flag.
  • local provider updates:
    • Add support for Docker images with entrypoints

Release v0.2.0

20 Sep 23:31
4bac0ae
Compare
Choose a tag to compare

This release includes:

  • Experimental Python 3 support.
  • Improvements to retry logic on transient HTTP errors.
  • google-v2 provider:
    • dstat fixes:
      • Fix for "ok" event in the wrong order.
      • Decreased operations.list page size to work around quota exception.
      • Fix for 'pulling-image' event discovery.
    • dsub fixes:
      • Fix pipeline hang in localization/delocalization on error on multi-core VMs

Release v0.1.10

27 Aug 20:32
3046eef
Compare
Choose a tag to compare

This release includes:

  • google-v2 provider:

    • Support for --network, --cpu-platform, --timeout parameters
    • Add events to dstat.list for google V2 provider
    • Using --min-cores or --min-ram now directs users to --machine-type
  • Add Finland and Los Angeles regions and new Singapore zone.

  • Various test suite improvements

Note that this release includes an important change to the way that log file names are formatted for dsub jobs that use --retries. The task-attempt is now automatically included in the log file name such that logs for each attempt do not overwrite the previous attempt.

Release v0.1.9

28 Jun 16:34
@eap eap
898f6d1
Compare
Choose a tag to compare

All unit and integration tests now pass for the google-v2 provider.
Users interested in Google's Pipelines v2 are encouraged to give it a try.

This release includes:

  • google-v2 provider:

    • dstat fields such as envs, inputs, outputs, and logging now supported.
    • ddel supported
  • General

    • dsub returns task-id even if failure is detected when using --wait.
    • events included in dstat output (local and google providers)

Release v0.1.8

05 Jun 18:06
dbd4d70
Compare
Choose a tag to compare

This release includes:

  • Initial support of dsub automatic retries
  • dstat support for the --summary flag, providing a more compact output for --tasks jobs
  • Provider improvements
    • Local provider
      • Use parallel copy for localizing and de-localizing files
      • Deterministic dstat response ordering
    • Google-v2 provider (still in progress)
      • File localization/delocalization
      • v2alpha1 timestamp format support
  • Various test suite fixes

Release v0.1.7

19 Apr 17:53
@eap eap
c72b922
Compare
Choose a tag to compare

This release includes incremental progress on the Google Genomics Pipelines v2 provider and general refactoring to enable this upcoming feature.

Other user visible changes include:

  • Support for empty --inputs and --outputs from the command line and task files.
  • dstat now includes provider attributes, such as compute zone and machine type.

Release v0.1.6

12 Mar 23:19
@eap eap
1f36dd4
Compare
Choose a tag to compare

This release includes new documentation, bug fixes, and test optimizations. A highlight of the release is the Split and Process demo contributed by JP. In addition the following new features and bug fixes are present.

  • Support for europe-west4 and northamerica-northeast1 regions
  • Add support for empty environmental variables
  • Require Python 2 during install
  • Multiple test optimizations.

Release v0.1.5

16 Jan 19:25
43cd7c5
Compare
Choose a tag to compare

Release v0.1.5 Fixes:

  • Allow use of --skip and --tasks flags
  • Fix rare edge case causing incorrect ordering of jobs returned from dstat
  • Allow specification of upper-bound for job create-time
  • A number of small updates to the (still experimental) Python API

Release v0.1.4

17 Nov 22:29
b57b088
Compare
Choose a tag to compare

This release includes several improvements:

  • Fix dstat job/task ordering for GoogleJobProvider and LocalJobProvider
  • Fix duplication of dstat output if duplicate parameters are passed in
  • Added new GCE zones for asia-south1 region