12-20-24 production deploy

What's Changed

• Production deploy 8/29/23 by @stvnrlly in #447
• Production deploy 9/18/23 by @stvnrlly in #475
• Production deploy 9/18/23, part 2 by @stvnrlly in #478
• Production deploy 9/18/23, part 3 by @stvnrlly in #480
• Production deploy 9/22/23 by @stvnrlly in #496
• Production deploy 9/25/23 by @stvnrlly in #503
• Production deploy 9/26/23 by @stvnrlly in #508
• Production deploy 10/2/2023 by @ccostino in #526
• Production deploy 10/31/23 by @stvnrlly in #552
• Production deploy 11/29/23 by @stvnrlly in #635
• Prod deploy 11/30/2023 by @ccostino in #643
• Production deploy 12/13/23 by @stvnrlly in #677
• Production deploy 1/29/24 by @stvnrlly in #766
• Production deploy 1/30/24 by @ccostino in #772
• CSV debug prod deploy by @ccostino in #775
• CSV error handling prod deploy by @ccostino in #777
• One-off API Production Deploy to fix CSV parsing issue - 02-02-2024 by @ccostino in #786
• Production deploy 2/8/24 by @ccostino in #795
• Production Deploy 2/20/2024 by @ccostino in #807
• 2/27/2024 Production Deployment by @ccostino in #821
• Production Deploy 3/6/2024 by @ccostino in #834
• API Production Deploy 3/14/2023 by @ccostino in #846
• API Production Deploy - 3/19/2024 by @ccostino in #859
• API Production Deploy - 3/28/2024 by @ccostino in #877
• Prod deploy - 4/3/24 by @stvnrlly in #892
• Production deploy for 4/9/24 by @stvnrlly in #908
• 04/17/2024 Production Deploy by @ccostino in #929
• 04/18/2024 Production Deploy by @ccostino in #935
• 4/26/2024 Production Deploy by @ccostino in #949
• Production deploy 5/10/2024 by @stvnrlly in #980
• 05/30/2024 Production Deploy by @ccostino in #1036
• 06/26/2024 Production Deploy by @ccostino in #1120
• 06/26/2024 Production Deploy #2 by @ccostino in #1124
• 06/26/2024 Production Deploy #3 by @ccostino in #1126
• 06/26/2024 Production Release #4 by @ccostino in #1128
• 06/27/2024 Production Deploy by @ccostino in #1138
• 07/02/2024 Production Release by @ccostino in #1156
• 07/03/2024 Production Release by @ccostino in #1163
• 07/05/2024 Production Deploy by @ccostino in #1171
• 07/16/2024 Production Deploy by @ccostino in #1186
• 7/24/2024 Production Deploy by @ccostino in #1211
• 7/25/2024 Follow-up production release by @ccostino in #1214
• 7/29/2024 Production Deploy for logging improvements by @ccostino in #1220
• 8/15/2024 Production Deploy by @ccostino in #1273
• 8/16/2024 Production Deploy by @ccostino in #1275
• Production Deploy 8/19/2024 by @ccostino in #1278
• 8/30/2024 Production Deploy by @ccostino in #1308
• 9/18/24 production deploy by @stvnrlly in #1335
• 10/16/24 production deploy by @xlorepdarkhelm in #1366
• 10-16-2024 Production Deploy #2 by @ccostino in #1368
• 10-16-2024 Production Hot Fix by @ccostino in #1370
• 10-16-2024 Production Deploy Hot Fix #2 by @ccostino in #1373
• 11/04/2024 Production Deploy by @ccostino in #1388
• 11/05/2024 Production Hot Fix Deploy by @ccostino in #1398
• 11/6/24 Production deploy by @stvnrlly in #1401
• 11/6/24 Production deploy #2 by @stvnrlly in #1403
• 11/14/2024 Production Deploy by @ccostino in #1416
• 11/14/2024 Production Deploy Update - Celery Worker config by @ccostino in #1418
• 11/15/2024 Celery Worker config adjustment by @ccostino in #1420
• 11/26/2024 Production Deploy by @A-Shumway42 in #1438
• increase db size from micro to small on staging by @terrazoon in #1439
• upgrade demo and production dbs by @terrazoon in #1440
• 11/26/24 Production and Demo DB upgrades by @ccostino in #1441
• fix notification insert retry logic by @terrazoon in #1450
• fix broken go live email notification by @terrazoon in #1443
• 12/2/24 - 12/3/24 Production Deploy - DB insert retry and go live email fixes by @ccostino in #1451
• change create notification to only insert once by @terrazoon in #1455
• Update restage workflow to use latest cg-cli-tools by @ccostino in #1456
• Bump production Redis plan to 5node-large by @ccostino in #1458
• 12/4/2024 Production Deploy - large batch hotfixes by @ccostino in #1460
• Revert Redis plan back by @ccostino in #1461
• add expire times for redis objects by @terrazoon in #1463
• 12/4/2024 Production Deploy Hotfix 2 by @ccostino in #1462
• change retry schedule by @terrazoon in #1470
• change worker_max_tasks_per_child to 2000 by @terrazoon in #1472
• 12/11/2024 Production Deployment API hotfixes by @ccostino in #1475
• add message_id column to notifications by @terrazoon in #1474
• Revert previous hotfixes by @ccostino in #1477
• change retries by @terrazoon in #1482
• start writing message ids to the notifications table by @terrazoon in #1485
• fix census BOM error by @terrazoon in #1489
• stop workers from propagating logs by @terrazoon in #1491
• remove tasks from redis after they complete by @terrazoon in #1492

Full Changelog: 11-26-2024...12-20-24

11-26-2024 Production Deploy

What's Changed

• kill workers after 20 tasks by @terrazoon in #1410
• adjust worker lifetime by @terrazoon in #1419
• Add redis ID to ignore vulnerability list in pip-audit by @ccostino in #1429
• remove excess log lines from s3 by @terrazoon in #1434
• Change max tasks per celery worker to 500 by @terrazoon in #1435

Full Changelog: 11-14-2024...11-26-2024

11-14-2024 Production Release

What's Changed

• set max_pool_connections to 7 by @stvnrlly in #1397
• Moving the Job Cache to the flask app's config by @xlorepdarkhelm in #1399
• Bump production app memory to 3 GB by @ccostino in #1400
• Adjust Celery worker memory by @ccostino in #1402
• No attribute day bug by @A-Shumway42 in #1405
• Verify state for login.gov by @xlorepdarkhelm in #1386
• Added section about feature flagging by @alexjanousekGSA in #1407
• put max connections back to 10 by @terrazoon in #1412
• add debugging for sender numbers by @terrazoon in #1414
• Make sandbox deployments easier by @ccostino in #1383
• upgrade test queries to sqlalchemy 2.0 by @terrazoon in #1382

Full Changelog: 11-04-2024...11-14-2024

11-04-2024 Production Release

What's Changed

• Fix reference to prod space by @ccostino in #1369
• fix partitioning by @terrazoon in #1371
• increase code coverage to 93 percent by @terrazoon in #1355
• US-NOTIFY-COMPLY 50: Verify Nonce For Invite by @xlorepdarkhelm in #1365
• Upgrade Queries: 7. Refactor Migration Scripts by @terrazoon in #1375
• Bump werkzeug from 3.0.3 to 3.0.6 by @dependabot in #1380
• upgrade core daos to sqlalchemy 2.0 by @terrazoon in #1362
• upgrade org and template dao to sqlalchemy 2.0 by @terrazoon in #1363
• upgrade service daos to sqlalchemy 2.0 by @terrazoon in #1360
• update billing dao by @terrazoon in #1364
• increase code coverage to 94% by @terrazoon in #1376
• API-1328 - Using a custom formatter to scrub PII from all log records. by @xlorepdarkhelm in #1379
• refactor miscellaneous daos and utilities by @terrazoon in #1374
• reduce number of pool connections by @terrazoon in #1384
• Increase Celery resources by @ccostino in #1387

Full Changelog: 10-16-2024-2...11-04-2024

10-16-2024-2 Production Deploy

What's Changed

• Fix egress proxy space references by @ccostino in #1367

Full Changelog: 10-16-2024...10-16-2024-2

10-16-2024 Production Deploy

What's Changed

• fix load test by @terrazoon in #1338
• Change 18f deprecated deploy tool to CG deploy tool by @A-Shumway42 in #1334
• actually start deleting old s3 objects by @terrazoon in #1330
• fix phone number lookup by @terrazoon in #1336
• use shared memory instead of expiring dict for jobs cache by @terrazoon in #1341
• Modify input to accepted argument by @A-Shumway42 in #1340
• Fix syntax on cf command by @A-Shumway42 in #1344
• Go back to brackets with secrets. in command by @A-Shumway42 in #1345
• Adjust LOGIN_DOT_GOV_REGISTRATION_URL env var in staging deploy by @ccostino in #1346
• Refer to GitHub Action container environment variable by @ccostino in #1347
• improve report performance by @terrazoon in #1339
• One more attempt at fixing the Login.gov registration URL by @ccostino in #1350
• Attempt quoting the Login.gov URL by @ccostino in #1352
• fix personalization_bug for one-offs by @terrazoon in #1349
• Attempt quoting the Login.gov URL with var-name by @ccostino in #1353
• optimize S3 partitioning by @terrazoon in #1343
• debug s3 partitioning by @terrazoon in #1356
• Bug: Invites expiring immediately by @terrazoon in #1354
• add documentation for how to rotate DANGEROUS_SALT by @terrazoon in #1348
• Switch out deprecated deploy script tools in demo/prod yml files. by @A-Shumway42 in #1357
• Update egress proxy deployment steps by @ccostino in #1358
• Finalize updates for cg-cli-tools by @ccostino in #1361

Full Changelog: 09-18-24...10-16-2024

09-18-24 Production Deploy

What's Changed

• add more debug to get e2e tests working by @terrazoon in #1312
• Added new ADR for BackstopJS by @alexjanousekGSA in #1297
• more debug for e2e tests by @terrazoon in #1313
• Change BackstopJS ADR (0009) to accepted and add more details by @ccostino in #1314
• E2E Test Improvement: leverage the live staging API instead of deploying a local instance in CI/C by @terrazoon in #1316
• delete old s3 objects by @terrazoon in #1318
• bring test coverage back to 95% by @terrazoon in #1329
• Read over Python 3.12's Logging Guide and see if there's anything else we could be leveraging/configuring to improve how logging is structured throughout our applications by @terrazoon in #1272
• Add production deployment steps to documentation by @ccostino in #1327
• add initial phone validation ability by @terrazoon in #1331
• further work on phone number validation by @terrazoon in #1332

New Contributors

• @alexjanousekGSA made their first contribution in #1297

Full Changelog: 08-30-2024...09-18-24

08-30-2024 Production Deploy

What's Changed

• Bump aiohttp from 3.9.5 to 3.10.2 by @dependabot in #1260
• Bump flake8 from 7.1.0 to 7.1.1 by @dependabot in #1262
• Change phone number in Notify.gov w/o entering password by @terrazoon in #1279
• update page_size to 20 from 50 by @heyitsmebev in #1281
• Fix job.created_at time if necessary by @terrazoon in #1284
• API: Consider forking remaining Gov UK dependencies by @terrazoon in #1250
• fix log formatting by @terrazoon in #1289
• change data retention to 7 days, 23 hours by @terrazoon in #1288
• Use custom salt when using encryption library from notification_utils by @terrazoon in #1290
• try Bearer instead of token by @terrazoon in #1291
• make it possible to write secrets by @terrazoon in #1292
• remove secrets by @terrazoon in #1293
• Bump marshmallow from 3.21.3 to 3.22.0 by @dependabot in #1285
• make generate-salt command by @terrazoon in #1294
• limit cache download by time by @terrazoon in #1300
• debug messages for e2e test story by @terrazoon in #1305
• Api 1265 adding fields for template stats by @xlorepdarkhelm in #1304

Full Changelog: 08-19-2024...08-30-2024

08-19-2024 Production Release

What's Changed

• fix job retrieval by @terrazoon in #1274
• Need to remove priority logic by @terrazoon in #1248
• improve exponential backoff while job hunting by @terrazoon in #1277

Full Changelog: 08-15-2024...08-19-2024

08-15-2024 Production Release

What's Changed

• Bump botocore from 1.34.144 to 1.34.148 by @dependabot in #1212
• Adjust production manifest settings by @ccostino in #1213
• API-1130 Logging set-up by @xlorepdarkhelm in #1219
• Troubleshooting section: network policy by @jskinne3 in #1217
• remove dead code by @terrazoon in #1101
• Bump cryptography from 42.0.8 to 43.0.0 by @dependabot in #1207
• Cleanup: remove comment unused local var by @jskinne3 in #1221
• Bump boto3 from 1.34.144 to 1.34.148 by @dependabot in #1216
• Bump notifications-python-client from 9.1.0 to 10.0.0 by @dependabot in #1208
• Bump regex from 2024.5.15 to 2024.7.24 by @dependabot in #1222
• Update Python dependencies - 7/30/24 by @ccostino in #1225
• new command to look at sms senders by @terrazoon in #1227
• raise exception if phone number doesn't match by @terrazoon in #1228
• Jskinne3 maintenance checklist by @jskinne3 in #1232
• Exception Investigation: app.authentication.auth:AuthError by @terrazoon in #1233
• write command to download csv file by @terrazoon in #1196
• Bump botocore from 1.34.150 to 1.34.154 by @dependabot in #1237
• Bump redis from 5.0.7 to 5.0.8 by @dependabot in #1231
• Bump phonenumbers from 8.13.40 to 8.13.42 by @dependabot in #1229
• add MethodNotAllowed to exception handling by @terrazoon in #1244
• make user command by @terrazoon in #1206
• Bump pyyaml from 6.0.1 to 6.0.2 by @dependabot in #1240
• Bump black from 24.4.2 to 24.8.0 by @dependabot in #1241
• Bump botocore from 1.34.154 to 1.34.159 by @dependabot in #1261
• Adjust data format for download all users by @terrazoon in #1239
• add retry with backoff by @terrazoon in #1267
• Update all.md by @ecayer in #1266
• fix sort on download all users by @terrazoon in #1269
• Adjust staging and demo worker instance settings by @ccostino in #1270

New Contributors

• @ecayer made their first contribution in #1266

Full Changelog: 07-24-2024...08-15-2024