Update document delivery services

[thorwolpert]

Description

The document delivery service for print jobs needs to be changed to be batch job style instead of even style.

The following sequence outlines the suggested solution.

sequenceDiagram
PPR API->>PubSub: Send msg that doc should be generated
loop GenerateDocument
    PubSub->>DocumentGeneration: CreateDocument
    DocumentGeneration->>Cloud Secrets: Get DailStorage Folder Name
    Note right of Cloud Secrets: Folder Format CCYYMMDD
    DocumentGeneration->>DeadLetterSub: Error in Creating Documents
    DocumentGeneration->>DailyStorage: Save Documents
end
Note right of Cloud Scheduler: Agreed Delivery Time: 21:00
Cloud Scheduler->>Storage: Create new DailyStorage
Cloud Scheduler->>Cloud Secrets: Update to new DailyStorage
Cloud Scheduler->>DocumentDelivery: Start Job
DocumentDelivery->>DailyStorage: Create Zip Folder & Audit File
DocumentDelivery->>BCMail: sftp zip & txt

Loading

[kialj876]

This looks good to me! Nice diagram 👍

Where you have the cloud scheduler 'update to new dailyStorage' in client secrets -- thats the same 'dailyStorage folder name' that the document generation uses correct?

And I guess if the sftp fails after a certain amount of retries we just save the zip/txt to a backup db or something?

[doug-lovett]

Nice diagram. Very helpful.

[thorwolpert]

Good point, I wasn't going to save the zip/txt as it is easily recreated and to save storage costs.
But we should figure out how to notify people that user manual action is required.