Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix issues with queries that are bigger than 2GB #266

Merged
merged 29 commits into from
Sep 13, 2024

Conversation

nck-mlcnv
Copy link
Contributor

No description provided.

@nck-mlcnv nck-mlcnv linked an issue Aug 7, 2024 that may be closed by this pull request
@nck-mlcnv nck-mlcnv requested a review from bigerl August 19, 2024 14:09
@nck-mlcnv
Copy link
Contributor Author

There are changes done to the BigByteArrayInputStream, that might not be necessary anymore. Should I revert them?

@nck-mlcnv nck-mlcnv marked this pull request as ready for review August 19, 2024 14:23
@nck-mlcnv nck-mlcnv self-assigned this Aug 19, 2024
Copy link
Member

@bigerl bigerl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thx for the PR. Looks good to me. I just commented some minor issues below.
Please also provide benchmarks comparing this with develop as a baseline to make sure we don't introduce a performance regression here. Please use the GraalVM binaries.

docs/configuration/big_queries.md Outdated Show resolved Hide resolved
Comment on lines 1 to 3
# Reading Large Queries

When working with large queries (Queries that are larger than 2^31 Bytes or ~2GB),
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# Reading Large Queries
When working with large queries (Queries that are larger than 2^31 Bytes or ~2GB),
# Huge Query Strings
When working with large query strings (longer than 2³² Bytes or ~2GB),

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I moved the section to the file queries.md.

@nck-mlcnv nck-mlcnv merged commit f1761cf into main Sep 13, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

IGUANA cannot handle queries larger than ~2GB
2 participants