Support for apache Hudi

[rubenssoto]

Hello,

Now dbt spark has support to delta lake, but would be good to support apache hudi too.

https://hudi.apache.org/

Apache Hudi is our default data format in all areas of our datalake.

Thank you so much!

[vingov]

Thanks for creating this support issue @rubenssoto!

I'm one of the Apache Hudi committers, I'm already working on creating a PR for this codebase or create a new dbt hudi package to support apache hudi format. I can volunteer to take up this task.

cc @vinothchandar

[rubenssoto]

thank you so much @vingov we use apache hudi in all our datalake, so support apache hudi is mandatory for us

thank you so much

[jtcohen6]

Very cool to see this issue, and the PR to go along with it :)

I don't have experience using Hudi, so I'd like to find someone who does. In the meantime, I'll take a look and help however I can

[set92]

Maybe a file_format is missing in the documentation? Or somewhere that explains how to use it. I thought it could be as easy as specifying file_format = 'hudi', but I can't find a mention to Hudi in the documentation, so not sure.

And in case is because I didn't see it, I wanted to avoid opening an issue.