Code

Implement percentile aggregation#9296

Code

Merged

revans2 merged 90 commits intoNVIDIA:branch-23.12NVIDIA/spark-rapids:branch-23.12from ttnghia:percentilettnghia/spark-rapids:percentileCopy head branch name to clipboardOct 20, 2023

+752-56

Commits

Commits on Sep 25, 2023

• Implementing GpuPercentile

  Show description for e01233e
  ttnghia

  committed
  e01233e

• WIP

  Show description for 3a17c02
  ttnghia

  committed
  3a17c02

• Cleanup

  Show description for ff5acf5
  ttnghia

  committed
  ff5acf5

• Fix class serialization

  Show description for 12280d1
  ttnghia

  committed
  12280d1

Commits on Sep 26, 2023

• Checking if in reduction context

  Show description for f366a60
  ttnghia

  committed
  f366a60

• Fix conversion of output

  Show description for 00d775f
  ttnghia

  committed
  00d775f

• Working

  Show description for 36c301d
  ttnghia

  committed
  36c301d

• Implement GpuPercentileEvaluation

  Show description for 37b2f74
  ttnghia

  committed
  37b2f74

• Add isReduction parameter

  Show description for ddbbace
  ttnghia

  committed
  ddbbace

• Single percentage value is working

  Show description for e4b926c
  ttnghia

  committed
  e4b926c

• Working for both literal and array percentages

  Show description for 91fe05c
  ttnghia

  committed
  91fe05c

Commits on Sep 27, 2023

• Fix conversion

  Show description for e19777f
  ttnghia

  committed
  e19777f

• Debugging

  Show description for 17066f7
  ttnghia

  committed
  17066f7

Commits on Sep 28, 2023

• Fix running issues

  Show description for b03790d
  ttnghia

  committed
  b03790d

• Add initial test for reduction

  Show description for df412ab
  ttnghia

  committed
  df412ab

• Fix memory leak

  Show description for 49034e3
  ttnghia

  committed
  49034e3

• Move CudfHistogram and CudfMergeHistogram classes

  Show description for b1ddc78
  ttnghia

  committed
  b1ddc78

• Cleanup

  Show description for 22f85c0
  ttnghia

  committed
  22f85c0

• Fix initialization

  Show description for 709c2a6
  ttnghia

  committed
  709c2a6

Commits on Sep 29, 2023

• Cleanup

  Show description for a3ee56d
  ttnghia

  committed
  a3ee56d

• Testing

  Show description for d6de152
  ttnghia

  committed
  d6de152

• Integration test passed

  Show description for cffad08
  ttnghia

  committed
  cffad08

• Fix data type

  Show description for afdc340
  ttnghia

  committed
  afdc340

• Fix type

  Show description for 2b6b6f7
  ttnghia

  committed
  2b6b6f7

Commits on Oct 1, 2023

• Add groupby test

  Show description for bae641c
  ttnghia

  committed
  bae641c

Commits on Oct 2, 2023

• Add tests

  Show description for b04fe3e
  ttnghia

  committed
  b04fe3e

• Cleanup

  Show description for 1f60285
  ttnghia

  committed
  1f60285

• Add more tests

  Show description for 25247d1
  ttnghia

  committed
  25247d1

• Add more tests with frequencies

  Show description for b0e33a9
  ttnghia

  committed
  b0e33a9

• WIP

  Show description for e93a7e8
  ttnghia

  committed
  e93a7e8

Commits on Oct 3, 2023

• Implement input projection for values with frequencies

  Show description for c42f6f1
  ttnghia

  committed
  c42f6f1

• Add tests

  Show description for ecdeeaa
  ttnghia

  committed
  ecdeeaa

• All tests passed!!!

  Show description for f2716b1
  ttnghia

  committed
  f2716b1

• Cleanup tests

  Show description for a02205c
  ttnghia

  committed
  a02205c

• Add more tests (not pass yet)

  Show description for 41b8991
  ttnghia

  committed
  41b8991

• Fix tests

  Show description for 77d9242
  ttnghia

  committed
  77d9242

• Adding fallback test

  Show description for 3781e61
  ttnghia

  committed
  3781e61

Commits on Oct 4, 2023

• Add error check for percentage input

  Show description for 9a21cd0
  ttnghia

  committed
  9a21cd0

• Declare incompat

  Show description for 0fc2f1f
  ttnghia

  committed
  0fc2f1f

• Implement buffer conversion

  Show description for 33137bb
  ttnghia

  committed
  33137bb

• Fix compile issue

  Show description for dc9ac69
  ttnghia

  committed
  dc9ac69

• Change test

  Show description for c7c2f6b
  ttnghia

  committed
  c7c2f6b

Commits on Oct 5, 2023

• Update code

  Show description for 80aec1f
  ttnghia

  committed
  80aec1f

• WIP for buffer conversion

  Show description for 1b41ddb
  ttnghia

  committed
  1b41ddb

Commits on Oct 6, 2023

• Debugging

  Show description for 89bb7c2
  ttnghia

  committed
  89bb7c2

• Change class name, and testing...

  ttnghia

  committed
  082b74a

Commits on Oct 10, 2023

• Fix CPU-to-GPU deserialization

  ttnghia

  committed
  eb004a8

• Fix empty input projection issue

  ttnghia

  committed
  f255020

Commits on Oct 11, 2023

• Rename function and change test

  ttnghia

  committed
  89edc6f

• Fix null handling

  ttnghia

  committed
  8815911

• Cleanup

  ttnghia

  committed
  7c47a35

• Change type check

  ttnghia

  committed
  e2b238b

• Add comment

  ttnghia

  committed
  96710ab

• Change comment

  ttnghia

  committed
  70aa9a0

Commits on Oct 12, 2023

• WIP

  ttnghia

  committed
  1f0c813

• Merge branch 'branch-23.10' into percentile

  ttnghia

  committed
  524ab1c

Commits on Oct 13, 2023

• Complete tests

  ttnghia

  committed
  c2c2950

• Fix all bugs

  ttnghia

  committed
  3e71019

• Merge branch 'branch-23.12' into percentile

  ttnghia

  committed
  1d7dbd2

• Move file and cleanup

  ttnghia

  committed
  6e81087

• Further cleanup

  ttnghia

  committed
  85cd162

• Finish cleaning up

  ttnghia

  committed
  8233d6e

• Add comments

  ttnghia

  committed
  a5eb50f

• Revert test

  ttnghia

  committed
  48f5292

• Simplify code

  ttnghia

  committed
  741cdf0

• Add generated docs

  ttnghia

  committed
  73db187

Commits on Oct 14, 2023

• Some more cleaning up

  ttnghia

  committed
  1df7a94

Commits on Oct 16, 2023

• Cleanup test

  ttnghia

  committed
  f1117ba

• Add comment

  ttnghia

  committed
  e7043ac

Commits on Oct 17, 2023

• Use extractLit

  ttnghia

  committed
  22c7959

• Revert "Use extractLit"

  Show description for 53c433d
  ttnghia

  committed
  53c433d

• Merge branch 'branch-23.12' into percentile

  ttnghia

  committed
  9e30443

• Use extractLit

  ttnghia

  committed
  55da2fb

• Merge branch 'branch-23.12' into percentile

  ttnghia

  committed
  7db16a9

• Fix tests

  ttnghia

  committed
  32040ce

Commits on Oct 18, 2023

• Merge branch 'branch-23.12' into percentile

  ttnghia

  committed
  3729da0

• Remove incompat

  ttnghia

  committed
  c188955

• Merge branch 'branch-23.12' into percentile

  ttnghia

  committed
  f46f94b

• Updated docs

  ttnghia

  committed
  24c227f

• Remove @incompat and approximate_float

  ttnghia

  committed
  0963303

• Temporarily run only new tests

  ttnghia

  committed
  1ccdcdc

• Testing fallback

  ttnghia

  committed
  d78e7f2

• Revert "Testing fallback"

  Show description for 7836bdb
  ttnghia

  committed
  7836bdb

• Revert "Temporarily run only new tests"

  Show description for 2b019bd
  ttnghia

  committed
  2b019bd

• Revert "Revert "Testing fallback""

  Show description for 2afab91
  ttnghia

  committed
  2afab91

• Cleanup test

  ttnghia

  committed
  6b93243

• Merge branch 'branch-23.12' into percentile

  ttnghia

  committed
  3533ee9

Commits on Oct 19, 2023

• Revert "Testing fallback"

  Show description for e1136bc
  ttnghia

  committed
  e1136bc

• xfail tests on databricks

  ttnghia

  committed
  3757b60

• Merge branch 'branch-23.12' into percentile

  ttnghia

  committed
  141c19d