Warehouse: legacy CPRD DB replication

[thorwolpert]

Replicate valid CPRD schemas to the Warehouse

To perform analytics, search bulk loads, and as a historical copy, a set of valid schemas and tables will be replicated as an operational data store to the internal warehouse project.

Determine schemas and relevant tables

• Create list of valid full schemas and individual tables to sync to the ODS #17625
• Determine best path to incremental loading of schemas and tables

Create the ODS

• Determine if ODS is HA or recoverable from backups
• Create ODS

Add schemas and relevant tables to the existing replication

• Create schema and tables in CloudSQL postgres for the identified schemas and tables
• Create bulk loading scripts
• Create incremental loading scripts

Load extracts to target systems as needed

• Determine if any systems need copies of the data
• Load to a max of 2 of those (another DB, BigQuery, etc)

Service accounts for accessing the ODS

• Create procedure to create service accounts for systems to access ODS
  • Analytics
  • Business Search
  • Person Search