Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload csv to existing clickhouse is not supported #19247

Closed
LuPan2015 opened this issue Mar 18, 2022 · 5 comments
Closed

Upload csv to existing clickhouse is not supported #19247

LuPan2015 opened this issue Mar 18, 2022 · 5 comments
Labels
data:connect:clickhouse Related to Clickhouse data:csv Related to import/export of CSVs nice-to-have Nice to have features or enhancements

Comments

@LuPan2015
Copy link

superset does not support uploading csv to a table that does not exist in clickhouse because clickhouse must specify the engine when creating the table.
But why doesn't it support upload csv to a table that already exists in clickhouse?

@LuPan2015 LuPan2015 added the #bug Bug report label Mar 18, 2022
@zhaoyongjie
Copy link
Member

zhaoyongjie commented Mar 18, 2022

This is due to the Superset using Pandas to upload CSV instead of using an external table(like Hive or other DB). refer to link.

Some Dataframe to SQL can be made here.

@zhaoyongjie zhaoyongjie added data:csv Related to import/export of CSVs nice-to-have Nice to have features or enhancements and removed #bug Bug report labels Mar 18, 2022
@LuPan2015
Copy link
Author

Is there a list of DBs that support upload csv now?

@srinify srinify added the data:connect:clickhouse Related to Clickhouse label Mar 18, 2022
@srinify
Copy link
Contributor

srinify commented Mar 18, 2022

@LuPan2015 that list doesn't exist unfortunately but I'm hoping the community will create one soon!

@rusackas
Copy link
Member

@shreesham pining you here since you're both a resident clickhouse SME, and also perhaps capable of helping to build some documentation around database/CSV upload compatibility.

@rusackas
Copy link
Member

I think this was resolved, so I'll close it. We also have a table of database driver compatibilities... not sure if CSV upload support can easily be made into a new row there (cc @betodealmeida)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data:connect:clickhouse Related to Clickhouse data:csv Related to import/export of CSVs nice-to-have Nice to have features or enhancements
Projects
None yet
Development

No branches or pull requests

4 participants