Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Array/list feature materialization in BQ crashes in type conversion #1839

Closed
adchia opened this issue Sep 5, 2021 · 0 comments · Fixed by #1889
Closed

Array/list feature materialization in BQ crashes in type conversion #1839

adchia opened this issue Sep 5, 2021 · 0 comments · Fixed by #1889
Labels

Comments

@adchia
Copy link
Collaborator

adchia commented Sep 5, 2021

Currently, if you try to use BQ and materialize a feature that is a list (of numbers, strings, etc), Feast will crash because in BQ, the value type of the feature is a dictionary, such as

{'list': [{'item': 3}, {'item': 3}]}
In materialize, we convert the latest values retrieval job to a pyarrow table and then converts to ValueProtos to write. This calls

python_type_to_feast_value_type, which doesn't support dict types.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant