Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration tests #10

Merged
merged 2 commits into from
Jun 24, 2023
Merged

Integration tests #10

merged 2 commits into from
Jun 24, 2023

Conversation

cpard
Copy link
Collaborator

@cpard cpard commented Jun 24, 2023

Basic tests for fetching tables and columns. At least for the basic types it seems to work fine. I'll be adding more tests to cover all the different types but it should be ok to start playing around with converting the types into Recap. Btw, there's a failing assertion in the tests right now but check my commit comments and the source code for that.

fixing the below issue.
@pytest.mark.xfail(reason="'owner_name' is None for some reason. Investigate.")
The assertion was false because the database didn't have an owner set, setting an owner during data preparation fixed the issues. The code is behaving as expected.
There's an assertion that fails, I leave it here on purpose. My current assumption is that the metastore overrides some of the passed options with defaults. "MANAGED_TABLE" is the default value for tableType

See here for the defaults: https://github.com/apache/hive/blob/14a1f70607db5ae6cf71b6d4343f308a5167581c/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/client/builder/TableBuilder.java#L69C43-L69C43

Something similar happens also when you choose a "VIRTUAL_VIEW" table type, where the metastore overrides the storage descriptor removing in the location the file:: prefix.

These are some very basic integration tests, more to come.
@cpard cpard requested a review from criccomini June 24, 2023 00:28
@criccomini criccomini merged commit ea5ccc0 into main Jun 24, 2023
@criccomini criccomini deleted the integration_testing branch June 24, 2023 16:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants