Incompatibility with clustermq version 0.8.8

[wlandau]

Prework

• Read and abide by drake's code of conduct.
• Search for duplicates among the existing issues, both open and closed.
• Advanced users: verify that the bug still persists in the current development version (i.e. remotes::install_github("ropensci/drake")) and mention the SHA-1 hash of the Git commit you install.

Description

clustermq just updated to version 0.8.8 on CRAN, and the worker API is no longer compatible with drake. Version 0.8.7 appears to work fine. cc @mschubert.

drake's clustermq tests are skipped on CRAN because the CRAN maintainers had asked me to reduce check time. I will reactivate them so revdep checks catch this sort of thing next time.

Reproducible example

> library(drake)
> load_mtcars_example()
> options(clustermq.scheduler = "multicore")
> make(my_plan, jobs = 2, parallelism = "clustermq", console_log_file = "log.txt")
Error in config$workers$receive_data() : 
WORKER_ERROR: wrong field names for DO_SETUP: 
Warning in config$workers$finalize() :
  Unclean shutdown for PIDs: 17629, 17630
> traceback()
7: stop("\nWORKER_ERROR: ", msg$msg)
6: config$workers$receive_data()
5: cmq_master(config)
4: get(paste0("backend_", parallelism), envir = getNamespace("drake"))(config)
3: run_native_backend(config)
2: process_targets(config)
1: make(my_plan, jobs = 2, parallelism = "clustermq", console_log_file = "log.txt")
> cat(readLines("log.txt"), sep = "\n")
haggunenon | 17443 | 2019-06-06 00:27:05.178372 | begin make()
haggunenon | 17443 | 2019-06-06 00:27:05.178656 | begin drake_config()
haggunenon | 17443 | 2019-06-06 00:27:05.183082 | cache /home/landau/.drake
haggunenon | 17443 | 2019-06-06 00:27:05.184677 | analyze environment
haggunenon | 17443 | 2019-06-06 00:27:05.185929 | get knitr hash
haggunenon | 17443 | 2019-06-06 00:27:05.187464 | set knitr files
haggunenon | 17443 | 2019-06-06 00:27:05.189454 | end drake_config()
haggunenon | 17443 | 2019-06-06 00:27:05.203066 | import random_rows
haggunenon | 17443 | 2019-06-06 00:27:05.204261 | import datasets::mtcars
haggunenon | 17443 | 2019-06-06 00:27:05.205186 | import reg1
haggunenon | 17443 | 2019-06-06 00:27:05.206123 | import reg2
haggunenon | 17443 | 2019-06-06 00:27:05.207104 | import file report.Rmd
haggunenon | 17443 | 2019-06-06 00:27:05.208937 | import simulate
haggunenon | 17443 | 2019-06-06 00:27:05.209779 | begin outdated()
haggunenon | 17443 | 2019-06-06 00:27:05.210284 | find more outdated targets
haggunenon | 17443 | 2019-06-06 00:27:05.211330 | find downstream outdated targets
haggunenon | 17443 | 2019-06-06 00:27:05.213107 | end outdated()
haggunenon | 17443 | 2019-06-06 00:27:05.213244 | isolate oudated targets
haggunenon | 17443 | 2019-06-06 00:27:05.213945 | construct priority queue
haggunenon | 17443 | 2019-06-06 00:27:05.278097 | setting common data
haggunenon | 17443 | 2019-06-06 00:27:05.282533 | begin scheduling targets
haggunenon | 17443 | 2019-06-06 00:27:05.283264 | sending common data
haggunenon | 17443 | 2019-06-06 00:27:05.283634 | sending common data
haggunenon | 17443 | 2019-06-06 00:27:20.032864 | begin make()
haggunenon | 17443 | 2019-06-06 00:27:20.033169 | begin drake_config()
haggunenon | 17443 | 2019-06-06 00:27:20.034501 | cache /home/landau/.drake
haggunenon | 17443 | 2019-06-06 00:27:20.036283 | analyze environment
haggunenon | 17443 | 2019-06-06 00:27:20.037612 | get knitr hash
haggunenon | 17443 | 2019-06-06 00:27:20.039344 | set knitr files
haggunenon | 17443 | 2019-06-06 00:27:20.041534 | end drake_config()
haggunenon | 17443 | 2019-06-06 00:27:20.054824 | import random_rows
haggunenon | 17443 | 2019-06-06 00:27:20.056489 | import datasets::mtcars
haggunenon | 17443 | 2019-06-06 00:27:20.057559 | import reg1
haggunenon | 17443 | 2019-06-06 00:27:20.058557 | import reg2
haggunenon | 17443 | 2019-06-06 00:27:20.059601 | import file report.Rmd
haggunenon | 17443 | 2019-06-06 00:27:20.061866 | import simulate
haggunenon | 17443 | 2019-06-06 00:27:20.063073 | begin outdated()
haggunenon | 17443 | 2019-06-06 00:27:20.063699 | find more outdated targets
haggunenon | 17443 | 2019-06-06 00:27:20.064476 | find downstream outdated targets
haggunenon | 17443 | 2019-06-06 00:27:20.066544 | end outdated()
haggunenon | 17443 | 2019-06-06 00:27:20.066711 | isolate oudated targets
haggunenon | 17443 | 2019-06-06 00:27:20.067494 | construct priority queue
haggunenon | 17443 | 2019-06-06 00:27:20.130378 | setting common data
haggunenon | 17443 | 2019-06-06 00:27:20.134904 | begin scheduling targets
haggunenon | 17443 | 2019-06-06 00:27:20.135594 | sending common data
haggunenon | 17443 | 2019-06-06 00:27:20.135978 | sending common data