Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metastore client #7

Merged
merged 12 commits into from
Jun 23, 2023
Merged

Metastore client #7

merged 12 commits into from
Jun 23, 2023

Conversation

cpard
Copy link
Collaborator

@cpard cpard commented Jun 22, 2023

now we have Table, Column, Buckets and Partition objects defined plus the interactions with the server to get the basic information about these objects. Next step here is to write integration tests to make sure everything works with the thrift server and then move on the statistics.

just added a diagram for someone to quickly see the types we define and work with.
first attempt on the get_table with proper schema returned
first complete version of get_table() with schemas returned including bucket, partitions and sorting information.
classes for representing partitions
added basic support for partitions. Now it's possible to fetch the names of partitions for a table and also fetch a specific partition by name.
added function to return all the partitions of a table serialized as List[HPartition]
@criccomini criccomini merged commit cc093a3 into main Jun 23, 2023
@criccomini criccomini deleted the metastore_client branch June 23, 2023 15:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants