Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

modify registry.db s3 object initialization to work in S3 subdirectory with Java Feast Server #2259

Merged
merged 1 commit into from
Jan 30, 2022

Conversation

NalinGHub
Copy link
Contributor

…y with Java Feast Server

Signed-off-by: NalinGHub nalinm01@gmail.com

What this PR does / why we need it:
modify registry.db s3 object initialization to work in S3 subdirectories with Java Feast Server

Which issue(s) this PR fixes:

Fixes #2239

Does this PR introduce a user-facing change?:

NONE

…y with Java Feast Server

Signed-off-by: NalinGHub <nalinm01@gmail.com>
@codecov-commenter
Copy link

codecov-commenter commented Jan 30, 2022

Codecov Report

Merging #2259 (e125ced) into master (f6cc618) will decrease coverage by 2.28%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #2259      +/-   ##
==========================================
- Coverage   85.31%   83.02%   -2.29%     
==========================================
  Files         108      110       +2     
  Lines        9127     9734     +607     
==========================================
+ Hits         7787     8082     +295     
- Misses       1340     1652     +312     
Flag Coverage Δ
integrationtests 73.24% <ø> (-0.12%) ⬇️
unittests 59.75% <ø> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
sdk/python/tests/integration/e2e/test_usage_e2e.py 80.51% <0.00%> (-19.49%) ⬇️
sdk/python/feast/diff/infra_diff.py 59.43% <0.00%> (-18.78%) ⬇️
sdk/python/feast/feature_store.py 81.37% <0.00%> (-8.16%) ⬇️
sdk/python/feast/inference.py 80.61% <0.00%> (-6.89%) ⬇️
sdk/python/feast/repo_operations.py 48.17% <0.00%> (-6.42%) ⬇️
sdk/python/tests/unit/diff/test_registry_diff.py 14.70% <0.00%> (ø)
sdk/python/feast/diff/registry_diff.py 29.91% <0.00%> (ø)
sdk/python/feast/type_map.py 69.86% <0.00%> (+0.63%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f6cc618...e125ced. Read the comment docs.

Copy link
Collaborator

@felixwang9817 felixwang9817 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: felixwang9817, NalinGHub

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@feast-ci-bot feast-ci-bot merged commit 2e4f3e5 into feast-dev:master Jan 30, 2022
feast-ci-bot pushed a commit that referenced this pull request Jan 31, 2022
* Add backticks to left_table_query_string (#2250)

Signed-off-by: david <davidmiller252@gmail.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Delete entity key from Redis only when all attached feature views are gone (#2240)

* Delete entity from redis when the last attached feature view is deleted

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>

* Delete entity key from Redis only when all attached feature views are gone

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>

* make lint happy

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>

* make lint happy

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>

* one more try with mypy

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* historical_field_mappings2 merge for one sign off commit (#2252)

Signed-off-by: Michelle Rascati <michelle.rascati@sailpoint.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Correct inconsistent dependency (#2255)

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Add snowflake environment variables to allow testing on snowflake infra (#2258)

* add snowflake environment vars to test framework

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* add snowflake environment vars to test framework

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Return `UNIX_TIMESTAMP` as Python `datetime` (#2244)

* Refactor `UNIX_TIMESTAMP` conversion

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>

* Return `UNIX_TIMESTAMP` types as `datetime` to user

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>

* Fix linting errors

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>

* Rename variable to something more sensible

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Feast plan clean up (#2256)

* Run validation and inference on views and entities during plan

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Do not log objects that are unchanged

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Rename Fco to FeastObject

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Remove useless method

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Lint

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Always initialize registry during feature store initialization

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Fix usage test

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Remove print statements

Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Squash commits

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Add error type and refactor query execution to have retries

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Handle more snowflake errors

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Fix lint errors

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Fix lint errors

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Fix lint errors

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Fix wrong import

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* modify registry.db s3 object initialization to work in S3 subdirectory with Java Feast Server (#2259)

Signed-off-by: NalinGHub <nalinm01@gmail.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* clean up docs

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* lint-python

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* fixed historical test

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* fixed historical test

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

Co-authored-by: David Miller <david@patagona.ca>
Co-authored-by: Oleksii Moskalenko <moskalenko.alexey@gmail.com>
Co-authored-by: Michelle Rascati <44408275+michelle-rascati-sp@users.noreply.github.com>
Co-authored-by: Judah Rand <17158624+judahrand@users.noreply.github.com>
Co-authored-by: Felix Wang <wangfelix98@gmail.com>
Co-authored-by: Danny Chiao <danny@tecton.ai>
Co-authored-by: Nalin Mehra <37969183+NalinGHub@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

registry.db doesn't work in S3 subdirectory with Java Feature Server
5 participants