Releases: DataBiosphere/dsub
Release v0.2.2
This release includes:
- Support for Requester Pays buckets via the new
--user-project
option (google-v2
andlocal
providers) - Fixes
dstat ... --limit
off-by-one bug
Release v0.2.1
This release includes:
- Documentation updates noting the deprecation of the google provider.
google-v2
provider updates:--log-interval
flag to configure the amount of time to sleep between copying log files from the pipeline to the logging path.- Adding
google-v2
specific elements todstat
output. --ssh
flag to start an SSH container in the background, allowing you to inspect the runtime
environment of your job's container in real time.- Experimental support for gcsfuse through the
--mount
flag.
local
provider updates:- Add support for Docker images with entrypoints
Release v0.2.0
This release includes:
- Experimental Python 3 support.
- Improvements to retry logic on transient HTTP errors.
google-v2
provider:dstat
fixes:- Fix for "ok" event in the wrong order.
- Decreased operations.list page size to work around quota exception.
- Fix for 'pulling-image' event discovery.
dsub
fixes:- Fix pipeline hang in localization/delocalization on error on multi-core VMs
Release v0.1.10
This release includes:
-
google-v2
provider:- Support for
--network
,--cpu-platform
,--timeout
parameters - Add events to dstat.list for google V2 provider
- Using
--min-cores
or--min-ram
now directs users to--machine-type
- Support for
-
Add Finland and Los Angeles regions and new Singapore zone.
-
Various test suite improvements
Note that this release includes an important change to the way that log file names are formatted for dsub
jobs that use --retries
. The task-attempt
is now automatically included in the log file name such that logs for each attempt do not overwrite the previous attempt.
Release v0.1.9
All unit and integration tests now pass for the google-v2
provider.
Users interested in Google's Pipelines v2 are encouraged to give it a try.
This release includes:
-
google-v2
provider:dstat
fields such asenvs
,inputs
,outputs
, andlogging
now supported.ddel
supported
-
General
dsub
returns task-id even if failure is detected when using--wait
.events
included indstat
output (local
andgoogle
providers)
Release v0.1.8
This release includes:
- Initial support of
dsub
automatic retries dstat
support for the--summary
flag, providing a more compact output for--tasks
jobs- Provider improvements
- Local provider
- Use parallel copy for localizing and de-localizing files
- Deterministic
dstat
response ordering
- Google-v2 provider (still in progress)
- File localization/delocalization
- v2alpha1 timestamp format support
- Local provider
- Various test suite fixes
Release v0.1.7
This release includes incremental progress on the Google Genomics Pipelines v2 provider and general refactoring to enable this upcoming feature.
Other user visible changes include:
- Support for empty
--inputs
and--outputs
from the command line and task files. dstat
now includes provider attributes, such as compute zone and machine type.
Release v0.1.6
This release includes new documentation, bug fixes, and test optimizations. A highlight of the release is the Split and Process demo contributed by JP. In addition the following new features and bug fixes are present.
- Support for europe-west4 and northamerica-northeast1 regions
- Add support for empty environmental variables
- Require Python 2 during install
- Multiple test optimizations.
Release v0.1.5
Release v0.1.5 Fixes:
- Allow use of
--skip
and--tasks
flags - Fix rare edge case causing incorrect ordering of jobs returned from dstat
- Allow specification of upper-bound for job create-time
- A number of small updates to the (still experimental) Python API
Release v0.1.4
This release includes several improvements:
- Fix
dstat
job/task ordering forGoogleJobProvider
andLocalJobProvider
- Fix duplication of
dstat
output if duplicate parameters are passed in - Added new GCE zones for
asia-south1
region