- Support for users to create cluster asynchronously using makeCluster with wait = TRUE parameter and use getCluster to check cluster creation progress
- Support for users to use programmatically generated credentials and cluster config
- Support for users to delete job and terminate job
- [BREAKING CHANGE] when wait = TRUE, both job and job results are deleted at the end of the run, set jobAutoComplete to FALSE to keep them
- Add retry to get job result
- Add errorHandling and wait option to job metadata
- Save job metadata to job result storage blob
- Support for users to run custom versions of R via Docker containers
- GitHub and BioConductor support as parameters in the foreach
- [BREAKING CHANGE] Host OS distribution is now Debian instead of CentOS
- [BREAKING CHANGE] Command line no longer updates the environment of R
- [BREAKING CHANGE] Default version of R changed from MRO 3.3.2 to latest version of CRAN R
- Packages installed in foreach are only present and visible to a single foreach loop and then deleted from the cluster
- Linux clients would get stuck waiting for the job to finish when using the .packages() option in the foreach loop
- Support for users to get job and job results for long running job
- [BREAKING CHANGE] Update get job list to take state filter and return job status in a data frame
- Allow merge task to run on task failures
- Support for users to get files from nodes and tasks
- Documentation on debugging and troubleshooting
- Show the job preparation status
- Fix pool creation when a deleting pool has the same name
- Fail faster when a broken installation happens
- Change github authentication token type in cluster configuration file
- Custom Scripts: Allows users to run commands on the command prompt when nodes boots up
- Output Files: Able to persistently upload files to Azure Storage after task completion
- Added cluster configuration validation at runtime
- Enable/Disable merge task from collecting all the tasks into one list
- Enable reduce function based on chunk size
- Support backwards compatibility for older versions of the cluster configuration
- Improve R package installation using scripts instead of creating R package installation command lines on the fly
- Automatically load libraries defined in the foreach loop
- Paging through all tasks in
waitForTasksToComplete
function allow jobs to not fail early - Added
::
import operators to fix NAMESPACE problems
- [BREAKING CHANGE] Two configuration files for easier debugging - credentials and cluster settings
- [BREAKING CHANGE] Added low priority virtual machine support for additional cost saving
- Added external method for setting chunk size (SetChunkSize)
- Added getJobList function to check the status of user's jobs
- Added resizeCluster function to allow users to change their autoscale formulas on the fly