Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: allow arrow response for query #672

Closed
nitisht opened this issue Feb 22, 2024 · 5 comments
Closed

feat: allow arrow response for query #672

nitisht opened this issue Feb 22, 2024 · 5 comments
Labels
enhancement New feature or request server

Comments

@nitisht
Copy link
Member

nitisht commented Feb 22, 2024

We should allow for an arrow response in a streaming fashion when a query is run. This will make time to first byte much faster and also allow integration with existing arrow ecosystem tools.

Console can leverage the arrow response.

We can still keep the json response for query as the default response but add a flag in query body, looking at the flag server can respond in arrow format.

@nitisht nitisht added the enhancement New feature or request label Feb 22, 2024
@mrchypark
Copy link

It would be fantastic if it could be integrated with https://perspective.finos.org/ or https://uwdata.github.io/mosaic/ for even better use.

@nitisht
Copy link
Member Author

nitisht commented Apr 19, 2024

Implementation at #769

@nitisht nitisht added the server label Apr 23, 2024 — with Linear
@thinkORo
Copy link

Hi @nitisht is there any plan for a specific version with this feature? I would be very interested in testing it.

For your information: I am currently working on a kind of open-source (meta) data catalog. And I use Parseable together with Vector for my logs.

I'm not sure if I will ever publish it, but as there is no other place, currently: I want to say thank you for your work on this project. Very inspiring.

@nitisht
Copy link
Member Author

nitisht commented May 16, 2024

fixed by #769

@nitisht
Copy link
Member Author

nitisht commented May 16, 2024

Hi @nitisht is there any plan for a specific version with this feature? I would be very interested in testing it.

For your information: I am currently working on a kind of open-source (meta) data catalog. And I use Parseable together with Vector for my logs.

I'm not sure if I will ever publish it, but as there is no other place, currently: I want to say thank you for your work on this project. Very inspiring.

Thanks for the interest @thinkORo this will be available in the next release 1.1.1 on the server. We still might need more time to utilise this in the console.

Happy to discuss further as needed.

@nitisht nitisht closed this as completed May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request server
Projects
None yet
Development

No branches or pull requests

3 participants