Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL] Daily Update Velox Version (2024_03_13) #4944

Merged
merged 1 commit into from
Mar 13, 2024

Conversation

GlutenPerfBot
Copy link
Contributor

Velox Upstream New Commits:

85f39732b by hengjiang.ly, Add prefix-sort with support for fixed width sorting keys (8146)
de54d1e18 by Ma, Rong, Allow binding fixed precision or scale for decimal type (9044)
86f559c38 by xiaoxmeng, Fix a task early termination with group execution (9047)
451db90f0 by Christian Zentgraf, Fix equality check for simple floating types in RowContainer (7780)
17de646b6 by Patrick Sullivan, Fix overflow in FloatingPointColumnReader::skip (9046)
a108c70cc by Jake Jung, Remove `InputStream` access (9032)
b49f90954 by Jake Jung, Curly initializer and member initialize. (9031)
9c54819f8 by Jake Jung, More C++: Remove virtual for destructor (9030)
814a86d51 by zhli1142015, Add monotonically_increasing_id Spark function (9007)
18deebee6 by Jialiang Tan, Add force path to MemoryManager::shrinkPools (9020)
829132ad6 by Kevin Wilfong, Fix potential SIGSEGV in RowContainer cleanup after OOM (9034)
c80cb01ef by Kevin Wilfong, Speed up MemoryPool in debug mode (9040)
5847d125d by Kevin Wilfong, Fix memory leak in Spill (9039)
49d1224fa by Daniel Munoz, Add non-blocking support for DwrfReader (8884)
21242cb87 by Sandino Flores, Update dependencies of GCS (8960)

Copy link

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

Copy link
Contributor

@PHILO-HE PHILO-HE left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@PHILO-HE
Copy link
Contributor

/Benchmark Velox

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_4944_time.csv log/native_master_03_12_2024_7481c8c78_time.csv difference percentage
q1 36.53 36.68 0.149 100.41%
q2 23.75 24.17 0.423 101.78%
q3 38.15 38.29 0.143 100.38%
q4 37.76 37.21 -0.545 98.56%
q5 69.50 72.10 2.600 103.74%
q6 7.60 8.06 0.464 106.10%
q7 83.92 83.58 -0.343 99.59%
q8 86.67 83.85 -2.820 96.75%
q9 121.45 123.44 1.988 101.64%
q10 45.74 46.48 0.735 101.61%
q11 20.03 20.10 0.069 100.34%
q12 30.50 26.96 -3.533 88.41%
q13 48.08 49.00 0.923 101.92%
q14 19.00 19.51 0.506 102.67%
q15 29.45 29.23 -0.220 99.25%
q16 14.15 14.86 0.707 104.99%
q17 100.10 98.75 -1.352 98.65%
q18 143.69 142.45 -1.239 99.14%
q19 14.76 15.03 0.269 101.83%
q20 26.59 26.64 0.046 100.17%
q21 224.90 224.54 -0.354 99.84%
q22 13.90 14.13 0.227 101.63%
total 1236.20 1235.04 -1.156 99.91%

@JkSelf JkSelf merged commit d7ed084 into apache:main Mar 13, 2024
15 checks passed
@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_4944_time.csv log/native_master_03_12_2024_7481c8c78_time.csv difference percentage
q1 35.33 36.68 1.352 103.83%
q2 23.66 24.17 0.505 102.13%
q3 36.49 38.29 1.795 104.92%
q4 37.80 37.21 -0.586 98.45%
q5 70.02 72.10 2.076 102.97%
q6 7.33 8.06 0.728 109.93%
q7 83.56 83.58 0.011 100.01%
q8 86.44 83.85 -2.591 97.00%
q9 122.71 123.44 0.728 100.59%
q10 42.72 46.48 3.761 108.81%
q11 19.57 20.10 0.533 102.72%
q12 28.38 26.96 -1.417 95.01%
q13 45.87 49.00 3.133 106.83%
q14 18.79 19.51 0.713 103.79%
q15 28.88 29.23 0.347 101.20%
q16 15.31 14.86 -0.454 97.04%
q17 102.96 98.75 -4.206 95.91%
q18 144.01 142.45 -1.558 98.92%
q19 13.63 15.03 1.397 110.25%
q20 26.49 26.64 0.150 100.57%
q21 230.05 224.54 -5.508 97.61%
q22 13.80 14.13 0.325 102.36%
total 1233.81 1235.04 1.232 100.10%

Signed-off-by: glutenperfbot <glutenperfbot@intel-internal.com>
@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_03_13_2024_time.csv log/native_master_03_12_2024_7481c8c78_time.csv difference percentage
q1 38.81 36.68 -2.135 94.50%
q2 24.06 24.17 0.105 100.44%
q3 38.18 38.29 0.106 100.28%
q4 38.49 37.21 -1.274 96.69%
q5 69.71 72.10 2.391 103.43%
q6 7.45 8.06 0.608 108.15%
q7 82.46 83.58 1.118 101.36%
q8 83.21 83.85 0.637 100.77%
q9 121.83 123.44 1.604 101.32%
q10 44.36 46.48 2.116 104.77%
q11 20.90 20.10 -0.797 96.18%
q12 28.06 26.96 -1.100 96.08%
q13 46.88 49.00 2.124 104.53%
q14 21.98 19.51 -2.471 88.76%
q15 33.08 29.23 -3.851 88.36%
q16 13.84 14.86 1.022 107.38%
q17 101.80 98.75 -3.048 97.01%
q18 141.05 142.45 1.401 100.99%
q19 15.07 15.03 -0.039 99.74%
q20 27.03 26.64 -0.387 98.57%
q21 229.52 224.54 -4.983 97.83%
q22 13.86 14.13 0.268 101.93%
total 1241.63 1235.04 -6.586 99.47%

taiyang-li pushed a commit to bigo-sg/gluten that referenced this pull request Mar 25, 2024
85f3973 by hengjiang.ly, Add prefix-sort with support for fixed width sorting keys (8146)
de54d1e by Ma, Rong, Allow binding fixed precision or scale for decimal type (9044)
86f559c by xiaoxmeng, Fix a task early termination with group execution (9047)
451db90 by Christian Zentgraf, Fix equality check for simple floating types in RowContainer (7780)
17de646 by Patrick Sullivan, Fix overflow in FloatingPointColumnReader::skip (9046)
a108c70 by Jake Jung, Remove `InputStream` access (9032)
b49f909 by Jake Jung, Curly initializer and member initialize. (9031)
9c54819 by Jake Jung, More C++: Remove virtual for destructor (9030)
814a86d by zhli1142015, Add monotonically_increasing_id Spark function (9007)
18deebe by Jialiang Tan, Add force path to MemoryManager::shrinkPools (9020)
829132a by Kevin Wilfong, Fix potential SIGSEGV in RowContainer cleanup after OOM (9034)
c80cb01 by Kevin Wilfong, Speed up MemoryPool in debug mode (9040)
5847d12 by Kevin Wilfong, Fix memory leak in Spill (9039)
49d1224 by Daniel Munoz, Add non-blocking support for DwrfReader (8884)
21242cb by Sandino Flores, Update dependencies of GCS (8960)
taiyang-li pushed a commit to bigo-sg/gluten that referenced this pull request Oct 8, 2024
85f3973 by hengjiang.ly, Add prefix-sort with support for fixed width sorting keys (8146)
de54d1e by Ma, Rong, Allow binding fixed precision or scale for decimal type (9044)
86f559c by xiaoxmeng, Fix a task early termination with group execution (9047)
451db90 by Christian Zentgraf, Fix equality check for simple floating types in RowContainer (7780)
17de646 by Patrick Sullivan, Fix overflow in FloatingPointColumnReader::skip (9046)
a108c70 by Jake Jung, Remove `InputStream` access (9032)
b49f909 by Jake Jung, Curly initializer and member initialize. (9031)
9c54819 by Jake Jung, More C++: Remove virtual for destructor (9030)
814a86d by zhli1142015, Add monotonically_increasing_id Spark function (9007)
18deebe by Jialiang Tan, Add force path to MemoryManager::shrinkPools (9020)
829132a by Kevin Wilfong, Fix potential SIGSEGV in RowContainer cleanup after OOM (9034)
c80cb01 by Kevin Wilfong, Speed up MemoryPool in debug mode (9040)
5847d12 by Kevin Wilfong, Fix memory leak in Spill (9039)
49d1224 by Daniel Munoz, Add non-blocking support for DwrfReader (8884)
21242cb by Sandino Flores, Update dependencies of GCS (8960)
taiyang-li pushed a commit to bigo-sg/gluten that referenced this pull request Oct 9, 2024
85f3973 by hengjiang.ly, Add prefix-sort with support for fixed width sorting keys (8146)
de54d1e by Ma, Rong, Allow binding fixed precision or scale for decimal type (9044)
86f559c by xiaoxmeng, Fix a task early termination with group execution (9047)
451db90 by Christian Zentgraf, Fix equality check for simple floating types in RowContainer (7780)
17de646 by Patrick Sullivan, Fix overflow in FloatingPointColumnReader::skip (9046)
a108c70 by Jake Jung, Remove `InputStream` access (9032)
b49f909 by Jake Jung, Curly initializer and member initialize. (9031)
9c54819 by Jake Jung, More C++: Remove virtual for destructor (9030)
814a86d by zhli1142015, Add monotonically_increasing_id Spark function (9007)
18deebe by Jialiang Tan, Add force path to MemoryManager::shrinkPools (9020)
829132a by Kevin Wilfong, Fix potential SIGSEGV in RowContainer cleanup after OOM (9034)
c80cb01 by Kevin Wilfong, Speed up MemoryPool in debug mode (9040)
5847d12 by Kevin Wilfong, Fix memory leak in Spill (9039)
49d1224 by Daniel Munoz, Add non-blocking support for DwrfReader (8884)
21242cb by Sandino Flores, Update dependencies of GCS (8960)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants