-
Notifications
You must be signed in to change notification settings - Fork 5.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Introduce SelectiveStreamReader #12991
Merged
Merged
Commits on Jun 26, 2019
-
Configuration menu - View commit details
-
Copy full SHA for f5ffcfa - Browse repository at this point
Copy the full SHA f5ffcfaView commit details
Commits on Jun 27, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 603cf54 - Browse repository at this point
Copy the full SHA 603cf54View commit details -
Configuration menu - View commit details
-
Copy full SHA for a1029d6 - Browse repository at this point
Copy the full SHA a1029d6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 137ee50 - Browse repository at this point
Copy the full SHA 137ee50View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5e436ea - Browse repository at this point
Copy the full SHA 5e436eaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 29b5131 - Browse repository at this point
Copy the full SHA 29b5131View commit details -
Configuration menu - View commit details
-
Copy full SHA for a9714f5 - Browse repository at this point
Copy the full SHA a9714f5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9eb640c - Browse repository at this point
Copy the full SHA 9eb640cView commit details -
Configuration menu - View commit details
-
Copy full SHA for aa90c8a - Browse repository at this point
Copy the full SHA aa90c8aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 33cad09 - Browse repository at this point
Copy the full SHA 33cad09View commit details -
Configuration menu - View commit details
-
Copy full SHA for 29d2319 - Browse repository at this point
Copy the full SHA 29d2319View commit details -
Configuration menu - View commit details
-
Copy full SHA for b5aff54 - Browse repository at this point
Copy the full SHA b5aff54View commit details -
Configuration menu - View commit details
-
Copy full SHA for b9dbde6 - Browse repository at this point
Copy the full SHA b9dbde6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4910e70 - Browse repository at this point
Copy the full SHA 4910e70View commit details -
Fold BenchmarkOrcDecimalReader into BenchmarkBatchStreamReaders
``` Benchmark Mode Cnt Score Error Units BenchmarkBatchStreamReaders.readLongDecimalNoNull avgt 60 0.829 ± 0.032 s/op BenchmarkBatchStreamReaders.readLongDecimalWithNull avgt 60 0.566 ± 0.015 s/op BenchmarkBatchStreamReaders.readShortDecimalNoNull avgt 60 0.544 ± 0.026 s/op BenchmarkBatchStreamReaders.readShortDecimalWithNull avgt 60 0.364 ± 0.006 s/op ```
Configuration menu - View commit details
-
Copy full SHA for b4da3ea - Browse repository at this point
Copy the full SHA b4da3eaView commit details
Commits on Jun 29, 2019
-
Introduce SelectiveStreamReader
SelectiveStreamReader enables more efficient scan by applying a filter while extracting values only from the specified rows. This commit includes an implementation of the new SelectiveStreamReader for the boolean type. The new benchmark BenchmarkSelectiveStreamReaders is similar to BenchmarkBatchStreamReaders, but uses SelectiveStreamReader. The performance of a single column no filter case is the same for batch and selective readers. BenchmarkSelectiveStreamReaders.readAllNull boolean avgt 20 0.003 ± 0.001 s/op BenchmarkSelectiveStreamReaders.readBooleanNoNull N/A avgt 20 0.029 ± 0.001 s/op BenchmarkSelectiveStreamReaders.readBooleanNoNullWithFilter N/A avgt 20 0.098 ± 0.006 s/op BenchmarkSelectiveStreamReaders.readBooleanWithNull N/A avgt 20 0.098 ± 0.004 s/op BenchmarkSelectiveStreamReaders.readBooleanWithNullWithFilter N/A avgt 20 0.134 ± 0.006 s/op BenchmarkBatchStreamReaders.readAllNull boolean avgt 20 0.003 ± 0.001 s/op BenchmarkBatchStreamReaders.readBooleanNoNull N/A avgt 20 0.030 ± 0.001 s/op BenchmarkBatchStreamReaders.readBooleanWithNull N/A avgt 20 0.106 ± 0.002 s/op
Configuration menu - View commit details
-
Copy full SHA for d89159d - Browse repository at this point
Copy the full SHA d89159dView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.