Revert "Keep only one Directory.SHARED_SCRATCH"

[dachengx]

Reverts #222

So my statement in the previous PR is incorrect: #222 (comment).

Otherwise, we will see errors when job submission like:

Pegasus.client._client.PegasusClientError: Pegasus command: ['/usr/bin/pegasus-plan', '-Dpegasus.metrics.app=XENON', '-Dpegasus.data.configuration=nonsharedfs', '-Ddagman.retry=0', '-Ddagman.maxidle=100000', '-Ddagman.maxjobs=100000', '-Dpegasus.transfer.threads=4', '-Dpegasus.monitord.encoding=json', '-Dpegasus.catalog.workflow.amqp.url=amqp://friend:donatedata@msgs.pegasus.isi.edu:5672/prod/workflows', '--cluster', 'horizontal', '--sites', 'condorpool', '--output-sites', 'local', '--staging-site', 'condorpool=staging-davs', '--dir', '/scratch/xudc/workflows/wimp_ac_optimization-discovery_power-202410021020', '--relative-dir', 'runs', '--cleanup', 'none', '--submit', '/scratch/xudc/workflows/wimp_ac_optimization-discovery_power-202410021020/generated/workflow.yml', '--json'] FAILED

[coveralls]

Pull Request Test Coverage Report for Build 11148290885

Details

• 0 of 0 changed or added relevant lines in 0 files are covered.
• No unchanged relevant lines lost coverage.
• Overall coverage decreased (-0.05%) to 89.51%

---

Totals
Change from base Build 11132341269:	-0.05%
Covered Lines:	1681
Relevant Lines:	1878

---

💛 - Coveralls

[FaroutYLq]

I actually don't understand why failure happens in #222. Does it mean that a scratch is required to be formally there, even though not necessarily used?

[dachengx]

I guess that is because we submit the job of "separation". I checked the local scratch folder of the old workflow that was successfully finished, and found there are tarballs of outputs in it.

So this means the local job needs a local scratch.

[dachengx]

It also needs a local output folder otherwise error shows, maybe because pegasus anticipates that we have to output something.