-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add add_files
procedure in Iceberg connector
#11744
Comments
+1 |
add_files
add_files
procedure in Iceberg connector
One of the use cases I had in mind for this was that the files I want to add are sitting on some s3 bucket. So in this use case,there needs to be a way to supply |
Similarly to the Hive connector's |
Any updates on this? It will be great to have this procedure for importing a bunch of data directly avoiding any insert command. |
+1 |
@martint Could you review the syntax of this procedure? The procedure name in Spark is The arguments should follow Trino conventions (e.g. |
Awesome works. Can't wait to try it out in 461! |
like so:
https://github.com/RussellSpitzer/iceberg/blob/a4279fc5842046043f2afdc90f2428243958574d/spark3-extensions/src/test/java/org/apache/iceberg/spark/extensions/TestAddFilesProcedure.java#L80
The text was updated successfully, but these errors were encountered: