Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Daac sender + receiver logic #402

Merged
merged 55 commits into from
Aug 12, 2024
Merged

feat: Daac sender + receiver logic #402

merged 55 commits into from
Aug 12, 2024

Conversation

wphyojpl
Copy link
Collaborator

@wphyojpl wphyojpl commented Jul 23, 2024

Closes #380
Closes #378
Closes #377

wphyojpl added 30 commits July 8, 2024 11:42
@wphyojpl
Copy link
Collaborator Author

DAAC SNS is published twice. Need to check.

@wphyojpl
Copy link
Collaborator Author

cnm response only has collection name w/o version. Need to use only collection name.

@wphyojpl
Copy link
Collaborator Author

wphyojpl commented Aug 2, 2024

Testing failure:

            "archive_status": "cnm_r_failed",
            "archive_error_message": "[{\"uri\": \"https://uds-distribution-placeholder/uds-sbx-cumulus-staging/URN:NASA:UNITY:UDS_LOCAL_ARCHIVE_TEST:DEV:UDS_UNIT_COLLECTION___2407291400/URN:NASA:UNITY:UDS_LOCAL_ARCHIVE_TEST:DEV:UDS_UNIT_COLLECTION___2407291400:abcd.1234.efgh.test_file05/abcd.1234.efgh.test_file05.data.stac.json\", \"error\": \"unknown error: An error occurred (403) when calling the HeadObject operation: Forbidden\"}, {\"uri\": \"https://uds-distribution-placeholder/uds-sbx-cumulus-staging/URN:NASA:UNITY:UDS_LOCAL_ARCHIVE_TEST:DEV:UDS_UNIT_COLLECTION___2407291400/URN:NASA:UNITY:UDS_LOCAL_ARCHIVE_TEST:DEV:UDS_UNIT_COLLECTION___2407291400:abcd.1234.efgh.test_file05/abcd.1234.efgh.test_file05.cmr.xml\", \"error\": \"unknown error: An error occurred (403) when calling the HeadObject operation: Forbidden\"}]",
            "archive_error_code": "VALIDATION_ERROR"

Who will take care of S3 bucket's IAM role updates for the real DAAC to pull data?

@wphyojpl
Copy link
Collaborator Author

wphyojpl commented Aug 6, 2024

Testing with Unity-Venue-Dev customer created bucket.
Looks like need to add arn:aws:s3:::*unity* to lambda-processing-role.

Probably need to do similar thing on mock-daac lambda as well to that custom bucket

@wphyojpl
Copy link
Collaborator Author

wphyojpl commented Aug 8, 2024

Should we store the success / failure history of DAAC?
Currently, when a status is updated, the old failure messages will be deleted. Should they be stored?

@wphyojpl
Copy link
Collaborator Author

Keep Granules stac compliant.
Move archival to "properties"

@wphyojpl wphyojpl merged commit 8ccc5a7 into develop Aug 12, 2024
1 check passed
@wphyojpl wphyojpl deleted the daac-receiver-logic branch August 12, 2024 18:45
@ngachung ngachung mentioned this pull request Oct 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant