Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Gluten-4706] [CH][CORE] Add a mode to execute count distinct directly instead o… #4708

Merged
merged 1 commit into from
Mar 12, 2024

Conversation

binmahone
Copy link
Contributor

…f Expand+Count

What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

(Fixes: #4706)

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

Copy link

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

Copy link

Run Gluten Clickhouse CI

@FelixYBW FelixYBW changed the title [Gluten-4706] Add a mode to execute count distinct directly instead o… [Gluten-4706] [CK] Add a mode to execute count distinct directly instead o… Feb 19, 2024
@binmahone binmahone changed the title [Gluten-4706] [CK] Add a mode to execute count distinct directly instead o… [Gluten-4706] [CH][CORE] Add a mode to execute count distinct directly instead o… Feb 19, 2024
@binmahone binmahone force-pushed the check_wenzheng_CD_formain branch from 308c7a2 to dd255f4 Compare March 11, 2024 07:36
Copy link

Run Gluten Clickhouse CI

@binmahone binmahone force-pushed the check_wenzheng_CD_formain branch from dd255f4 to 32300b5 Compare March 11, 2024 11:30
@binmahone
Copy link
Contributor Author

Run Gluten Clickhouse CI

1 similar comment
Copy link

Run Gluten Clickhouse CI

@binmahone binmahone force-pushed the check_wenzheng_CD_formain branch from 32300b5 to 7e7a0ec Compare March 11, 2024 14:41
Copy link

Run Gluten Clickhouse CI

}
}

{
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

missing else ?

.getAttrsIndexForExtensionAggregateExpr(
aggregateFunc,
exp.mode,
exp,
aggregateAttributeList,
aggregateAttr,
index)
} else {
if (option.nonEmpty) {
return option.get
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why it needs return directly?

@binmahone binmahone force-pushed the check_wenzheng_CD_formain branch from 7e7a0ec to 43204a5 Compare March 12, 2024 02:40
Copy link

Run Gluten Clickhouse CI

1 similar comment
@binmahone
Copy link
Contributor Author

Run Gluten Clickhouse CI

@binmahone binmahone force-pushed the check_wenzheng_CD_formain branch from 43204a5 to 226cc0b Compare March 12, 2024 05:43
@binmahone
Copy link
Contributor Author

Run Gluten Clickhouse CI

1 similar comment
Copy link

Run Gluten Clickhouse CI

Copy link
Contributor

@zzcclp zzcclp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@binmahone binmahone merged commit b07b369 into apache:main Mar 12, 2024
17 checks passed
@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_4708_time.csv log/native_master_03_11_2024_5d923bf29_time.csv difference percentage
q1 35.50 36.18 0.678 101.91%
q2 23.78 24.37 0.587 102.47%
q3 36.69 36.99 0.306 100.83%
q4 37.56 37.92 0.354 100.94%
q5 69.28 69.79 0.512 100.74%
q6 7.41 7.17 -0.236 96.82%
q7 85.52 81.73 -3.793 95.57%
q8 84.41 86.64 2.225 102.64%
q9 120.91 123.40 2.481 102.05%
q10 43.21 44.98 1.776 104.11%
q11 20.13 20.66 0.528 102.62%
q12 27.82 24.91 -2.912 89.54%
q13 46.64 46.43 -0.210 99.55%
q14 18.06 19.75 1.687 109.34%
q15 32.00 31.88 -0.119 99.63%
q16 14.43 12.73 -1.705 88.18%
q17 100.36 101.43 1.069 101.07%
q18 143.07 143.66 0.588 100.41%
q19 13.58 13.67 0.091 100.67%
q20 28.24 30.65 2.411 108.54%
q21 227.50 231.81 4.306 101.89%
q22 13.79 13.84 0.050 100.36%
total 1229.91 1240.59 10.673 100.87%

taiyang-li pushed a commit to bigo-sg/gluten that referenced this pull request Mar 25, 2024
taiyang-li pushed a commit to bigo-sg/gluten that referenced this pull request Oct 8, 2024
taiyang-li pushed a commit to bigo-sg/gluten that referenced this pull request Oct 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add a mode to execute count distinct directly instead of Expand+Count
3 participants