Subscription worker lambda fails with Runtime.ImportModuleError

[asjohnston-asf]

Runtime.ImportModuleError: Unable to import module 'subscription_worker': cannot import name 'DEFAULT_CIPHERS' from 'urllib3.util.ssl_' (/var/task/urllib3/util/ssl_.py)

Likely introduced with requests v2.30.0 released May 4. We saw a similar error for the HyP3 API lambda when upgrading from requests==2.29.0 to 2.31.0 : #1654 . More details about the conflict between requests and botocore at psf/requests#6438

[asjohnston-asf]

Here's count of production subscription worker lambda failures per 5 minutes for the last three months, suggesting the issue was introduced in production with https://github.com/ASFHyP3/hyp3/releases/tag/v3.5.0 on May 5, the first production release following the requests 2.30.0 release on May 4.

[asjohnston-asf]

This error is due to incompatibility between requests>=2.30.0 and botocore<1.29.123. Troubleshooting revealed an invalid install_requires block in lib/dynamo/setup.py. This resulted in the latest-and-greatest boto3/botocore not being included in the subscription worker lambda deployment package, so the deployed code was pulling in the default botocore=1.29.90 in the Python 3.9 lamba runtime.