Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(project_id): ensure project_id exists #131

Merged
merged 6 commits into from
Jul 30, 2020

Conversation

thanh-nguyen-dang
Copy link
Contributor

@thanh-nguyen-dang thanh-nguyen-dang commented Jul 29, 2020

Fix issue when project_id does not exist in project node in aggregation index.

Features

  • We can have one original fields being mapped to multiple properties

Bug Fixes

  • project_id is not in project node

Deployment Changes

  • Requires pelican-export >= 0.5.x
  • Breaking change adding underscore to all {subject,case,file}_id fields. Requires migrating gitops.json and etlMapping.yaml following these instructions: 1. Make a list of all the doc_type fields in etlMapping.yaml. 2. Change any instance of {doc_type}_id to _{doc_type}_id in gitops.json and etlMapping.yaml. (E.g. if doc_type is subject, replace all instances of subject_id in etlMapping.yaml and gitops.json with _subject_id). 3. If there is no change to the etlMapping in the PR, manually add a comment to the etlMapping or change the order of two props in order to force gitops-sync to run the ETL.

tube/etl/indexers/aggregation/parser.py Outdated Show resolved Hide resolved
@lgtm-com
Copy link

lgtm-com bot commented Jul 29, 2020

This pull request fixes 1 alert when merging 9fbb696 into 3619fa3 - view on LGTM.com

fixed alerts:

  • 1 for Unused import

Copy link
Contributor

@paulineribeyre paulineribeyre left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for fixing

tube/etl/indexers/aggregation/parser.py Show resolved Hide resolved
tube/etl/indexers/aggregation/parser.py Outdated Show resolved Hide resolved
tube/etl/indexers/aggregation/parser.py Show resolved Hide resolved
tube/etl/indexers/base/translator.py Show resolved Hide resolved
tube/etl/indexers/base/translator.py Outdated Show resolved Hide resolved
tube/etl/indexers/aggregation/parser.py Show resolved Hide resolved
@thanh-nguyen-dang thanh-nguyen-dang force-pushed the fix/project_id_not_exist branch 2 times, most recently from 4c5d202 to ae15886 Compare July 29, 2020 23:55
@lgtm-com
Copy link

lgtm-com bot commented Jul 30, 2020

This pull request fixes 1 alert when merging e384448 into 3619fa3 - view on LGTM.com

fixed alerts:

  • 1 for Unused import

@lgtm-com
Copy link

lgtm-com bot commented Jul 30, 2020

This pull request fixes 1 alert when merging 34c37ff into 3619fa3 - view on LGTM.com

fixed alerts:

  • 1 for Unused import

@lgtm-com
Copy link

lgtm-com bot commented Jul 30, 2020

This pull request fixes 1 alert when merging 83d2306 into 3619fa3 - view on LGTM.com

fixed alerts:

  • 1 for Unused import

@lgtm-com
Copy link

lgtm-com bot commented Jul 30, 2020

This pull request fixes 4 alerts when merging 1071126 into 3619fa3 - view on LGTM.com

fixed alerts:

  • 2 for Unused import
  • 1 for Inconsistent equality and inequality
  • 1 for Inconsistent equality and hashing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants