Add REST Catalog and generate some test data

[Fokko]

No description provided.

[Fokko]

It looks like the CI is failing on main? https://github.com/duckdb/duckdb_iceberg/actions/runs/6800435295/job/18523077842?pr=27

[samansmink]

Hey @Fokko thanks for the PR! Yea this is a known issue, check out #28, this should fix it.

Could you update it as well in your workflow?

[Fokko]

@samansmink ah nice one, thanks!

[samansmink]

Hey @Fokko! I think CI is failing because docker compose is not available in the manylinux image.
However for these tests I think it suffices to have this run only on the ubuntu:18.04 job.
The arm job can be stripped as well because as it is cross compiled, we can not test with it anyway

So could you strip both the linux_arm64 and the linux_amd64_gcc4 from the REST.yml?

[Fokko]

Hey @samansmink thanks for pinging me. Let me check right away!

[Fokko]

@samansmink It should pass now. It was a bit of a hassle with the docker-in-docker problem, but let me know what you think!

[samansmink]

@Fokko Thanks a lot for all the work on this. Having a proper iceberg setup to test against is super useful! I've started CI for the PR

After this gets merged I'll look into using this for more of the tests and implementing the REST Catalog against this

[Fokko]

Hey @samansmink Cool stuff

The spec can be found here: https://github.com/apache/iceberg/blob/main/open-api/rest-catalog-open-api.yaml

Personally, I like to check the Python objects here to see what the requests/responses are. I think it is easier to read than the yaml. Let me know if you need any help!

[samansmink]

LGTM, thanks again!