Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update readme #2397

Merged
merged 19 commits into from
Jan 12, 2024
Merged

update readme #2397

merged 19 commits into from
Jan 12, 2024

Conversation

universalmind303
Copy link
Contributor

@universalmind303 universalmind303 commented Jan 10, 2024

closes #2394
I think this is a pretty comprehensive list.

I'd suggest reviewers to doublecheck just in case I accidentally marked some of them as supported that are not (or vice-versa).

Copy link
Member

@scsmithr scsmithr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ship!

README.md Outdated Show resolved Hide resolved
@scsmithr scsmithr requested a review from talagluck January 11, 2024 02:04
Copy link
Contributor

@tychoish tychoish left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I love this.

README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
Copy link
Contributor

@vrongmeal vrongmeal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don’t support writes for:

  1. Snowflake
  2. BigQuery
  3. Clickhouse

AND

Any of the file formats (in form of INSERT queries)

We do however support COPY TO for:

  1. CSV
  2. Newline Delimited JSON
  3. Parquet
  4. BSON

@universalmind303 universalmind303 force-pushed the universalmind303/readme-datasources branch from 4205a9c to ea85b8c Compare January 11, 2024 16:50
@universalmind303
Copy link
Contributor Author

universalmind303 commented Jan 11, 2024

We do however support COPY TO for:
CSV
Newline Delimited JSON
Parquet
BSON

@vrongmeal

do you think we should add separate columns for insert/copy? I wanted to keep the table from getting too cluttered

@scsmithr
Copy link
Member

We do however support COPY TO for:
CSV
Newline Delimited JSON
Parquet
BSON

@vrongmeal

do you think we should add separate columns for insert/copy? I wanted to keep the table from getting too cluttered

We could do asterisk, then have a "* COPY TO only" or something

@universalmind303
Copy link
Contributor Author

@vrongmeal @scsmithr I made a change that addresses the copy/insert that i think is a bit cleaner.

README.md Outdated Show resolved Hide resolved
Copy link
Contributor

@tychoish tychoish left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm surprised that we support inserts for persisted data in the apache arrow format, which seems worth double checking.

Because (I believe) all of the COPY TO - only supported formats also support globbing, you can get append-only modifications to existing tables by just adding new files that match the glob. I don't think this is expressible on this page, but it's not nothing.

@universalmind303 universalmind303 merged commit 388a597 into main Jan 12, 2024
19 checks passed
@universalmind303 universalmind303 deleted the universalmind303/readme-datasources branch January 12, 2024 19:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

add all supported datasources + fileformats to README.md
4 participants