Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run CI on pre #739

Merged
merged 1 commit into from
Jun 28, 2024
Merged

Run CI on pre #739

merged 1 commit into from
Jun 28, 2024

Conversation

avik-pal
Copy link
Member

No description provided.

Copy link

codecov bot commented Jun 28, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 82.62%. Comparing base (2e0aeb6) to head (52d2b86).

Additional details and impacted files
@@             Coverage Diff             @@
##             main     #739       +/-   ##
===========================================
- Coverage   95.63%   82.62%   -13.02%     
===========================================
  Files          54       54               
  Lines        2726     2728        +2     
===========================================
- Hits         2607     2254      -353     
- Misses        119      474      +355     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@avik-pal
Copy link
Member Author

@avik-pal avik-pal merged commit 855935a into main Jun 28, 2024
52 of 68 checks passed
@avik-pal avik-pal deleted the ap/test_pre branch June 28, 2024 01:16
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Results

Benchmark suite Current: 52d2b86 Previous: 7453ca9 Ratio
Dense(2 => 2)/cpu/reverse/ReverseDiff (compiled)/(2, 128) 3643 ns 3609.25 ns 1.01
Dense(2 => 2)/cpu/reverse/Zygote/(2, 128) 7185.2 ns 7159.4 ns 1.00
Dense(2 => 2)/cpu/reverse/Tracker/(2, 128) 20979 ns 20979 ns 1
Dense(2 => 2)/cpu/reverse/ReverseDiff/(2, 128) 9744 ns 9662 ns 1.01
Dense(2 => 2)/cpu/reverse/Flux/(2, 128) 8988.8 ns 8897.875 ns 1.01
Dense(2 => 2)/cpu/reverse/SimpleChains/(2, 128) 4462.125 ns 4440.875 ns 1.00
Dense(2 => 2)/cpu/reverse/Enzyme/(2, 128) 1157.3642857142856 ns 1161.2888888888888 ns 1.00
Dense(2 => 2)/cpu/forward/NamedTuple/(2, 128) 1110.0430463576158 ns 1167.801652892562 ns 0.95
Dense(2 => 2)/cpu/forward/ComponentArray/(2, 128) 1183.144927536232 ns 1161.3426573426573 ns 1.02
Dense(2 => 2)/cpu/forward/Flux/(2, 128) 1804.921568627451 ns 1787.017543859649 ns 1.01
Dense(2 => 2)/cpu/forward/SimpleChains/(2, 128) 179.61904761904762 ns 180.16946778711485 ns 1.00
Dense(20 => 20)/cpu/reverse/ReverseDiff (compiled)/(20, 128) 17392 ns 17483 ns 0.99
Dense(20 => 20)/cpu/reverse/Zygote/(20, 128) 17102 ns 17082 ns 1.00
Dense(20 => 20)/cpu/reverse/Tracker/(20, 128) 37730 ns 39434 ns 0.96
Dense(20 => 20)/cpu/reverse/ReverseDiff/(20, 128) 29414 ns 29425 ns 1.00
Dense(20 => 20)/cpu/reverse/Flux/(20, 128) 21510 ns 21340 ns 1.01
Dense(20 => 20)/cpu/reverse/SimpleChains/(20, 128) 17292 ns 17423 ns 0.99
Dense(20 => 20)/cpu/reverse/Enzyme/(20, 128) 4338 ns 4356.714285714285 ns 1.00
Dense(20 => 20)/cpu/forward/NamedTuple/(20, 128) 3883.5 ns 3891.125 ns 1.00
Dense(20 => 20)/cpu/forward/ComponentArray/(20, 128) 3956.125 ns 3953.625 ns 1.00
Dense(20 => 20)/cpu/forward/Flux/(20, 128) 4870.428571428572 ns 4959.285714285715 ns 0.98
Dense(20 => 20)/cpu/forward/SimpleChains/(20, 128) 1653.1 ns 1662.1 ns 0.99
Conv((3, 3), 3 => 3)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 3, 128) 39187764 ns 38888215 ns 1.01
Conv((3, 3), 3 => 3)/cpu/reverse/Zygote/(64, 64, 3, 128) 58072499 ns 57605568.5 ns 1.01
Conv((3, 3), 3 => 3)/cpu/reverse/Tracker/(64, 64, 3, 128) 69540188 ns 76110500 ns 0.91
Conv((3, 3), 3 => 3)/cpu/reverse/ReverseDiff/(64, 64, 3, 128) 80951535.5 ns 88832752.5 ns 0.91
Conv((3, 3), 3 => 3)/cpu/reverse/Flux/(64, 64, 3, 128) 72371594 ns 72396661 ns 1.00
Conv((3, 3), 3 => 3)/cpu/reverse/SimpleChains/(64, 64, 3, 128) 12039265 ns 11959905 ns 1.01
Conv((3, 3), 3 => 3)/cpu/reverse/Enzyme/(64, 64, 3, 128) 17862841 ns 8440292 ns 2.12
Conv((3, 3), 3 => 3)/cpu/forward/NamedTuple/(64, 64, 3, 128) 7060722 ns 6984372.5 ns 1.01
Conv((3, 3), 3 => 3)/cpu/forward/ComponentArray/(64, 64, 3, 128) 7013804 ns 6969189 ns 1.01
Conv((3, 3), 3 => 3)/cpu/forward/Flux/(64, 64, 3, 128) 9977701 ns 10028737.5 ns 0.99
Conv((3, 3), 3 => 3)/cpu/forward/SimpleChains/(64, 64, 3, 128) 6394913 ns 6388121.5 ns 1.00
vgg16/cpu/reverse/Zygote/(32, 32, 3, 16) 760587414 ns 747089927 ns 1.02
vgg16/cpu/reverse/Zygote/(32, 32, 3, 64) 2577913279 ns 2571398611 ns 1.00
vgg16/cpu/reverse/Zygote/(32, 32, 3, 2) 145542924 ns 135189197.5 ns 1.08
vgg16/cpu/reverse/Tracker/(32, 32, 3, 16) 768746928 ns 795044361 ns 0.97
vgg16/cpu/reverse/Tracker/(32, 32, 3, 64) 2930427590 ns 2974976527 ns 0.99
vgg16/cpu/reverse/Tracker/(32, 32, 3, 2) 198466646.5 ns 197924414 ns 1.00
vgg16/cpu/reverse/Flux/(32, 32, 3, 16) 678651434 ns 676218931 ns 1.00
vgg16/cpu/reverse/Flux/(32, 32, 3, 64) 2645979889 ns 2614128502 ns 1.01
vgg16/cpu/reverse/Flux/(32, 32, 3, 2) 122486292 ns 122097223 ns 1.00
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 16) 174841194 ns 175936526 ns 0.99
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 64) 651748619 ns 676766451.5 ns 0.96
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 2) 45606254 ns 34662294 ns 1.32
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 16) 165166276 ns 166860963 ns 0.99
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 64) 647141722 ns 643674531 ns 1.01
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 2) 30108687 ns 30820168 ns 0.98
vgg16/cpu/forward/Flux/(32, 32, 3, 16) 187684927 ns 189842778 ns 0.99
vgg16/cpu/forward/Flux/(32, 32, 3, 64) 710956900.5 ns 715544549.5 ns 0.99
vgg16/cpu/forward/Flux/(32, 32, 3, 2) 37590140 ns 37965190 ns 0.99
Conv((3, 3), 64 => 64)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 64, 128) 1205515278.5 ns 1268173647.5 ns 0.95
Conv((3, 3), 64 => 64)/cpu/reverse/Zygote/(64, 64, 64, 128) 1887731195.5 ns 1863507518.5 ns 1.01
Conv((3, 3), 64 => 64)/cpu/reverse/Tracker/(64, 64, 64, 128) 2372684250 ns 2370054887 ns 1.00
Conv((3, 3), 64 => 64)/cpu/reverse/ReverseDiff/(64, 64, 64, 128) 2531976850 ns 2520547922 ns 1.00
Conv((3, 3), 64 => 64)/cpu/reverse/Flux/(64, 64, 64, 128) 1827041771.5 ns 1857510292 ns 0.98
Conv((3, 3), 64 => 64)/cpu/reverse/Enzyme/(64, 64, 64, 128) 559129456 ns 354818747 ns 1.58
Conv((3, 3), 64 => 64)/cpu/forward/NamedTuple/(64, 64, 64, 128) 323461020 ns 324634549 ns 1.00
Conv((3, 3), 64 => 64)/cpu/forward/ComponentArray/(64, 64, 64, 128) 324962874 ns 323578160 ns 1.00
Conv((3, 3), 64 => 64)/cpu/forward/Flux/(64, 64, 64, 128) 353832535.5 ns 358697801.5 ns 0.99
Conv((3, 3), 1 => 1)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 1, 128) 11886131 ns 11908179 ns 1.00
Conv((3, 3), 1 => 1)/cpu/reverse/Zygote/(64, 64, 1, 128) 17998825 ns 17897810 ns 1.01
Conv((3, 3), 1 => 1)/cpu/reverse/Tracker/(64, 64, 1, 128) 19347894 ns 19241672 ns 1.01
Conv((3, 3), 1 => 1)/cpu/reverse/ReverseDiff/(64, 64, 1, 128) 24040203 ns 23890653 ns 1.01
Conv((3, 3), 1 => 1)/cpu/reverse/Flux/(64, 64, 1, 128) 18041013 ns 18002442 ns 1.00
Conv((3, 3), 1 => 1)/cpu/reverse/SimpleChains/(64, 64, 1, 128) 1178391 ns 1175569 ns 1.00
Conv((3, 3), 1 => 1)/cpu/reverse/Enzyme/(64, 64, 1, 128) 5839355 ns 2533812 ns 2.30
Conv((3, 3), 1 => 1)/cpu/forward/NamedTuple/(64, 64, 1, 128) 2063498 ns 2059884 ns 1.00
Conv((3, 3), 1 => 1)/cpu/forward/ComponentArray/(64, 64, 1, 128) 2043560.5 ns 2034923 ns 1.00
Conv((3, 3), 1 => 1)/cpu/forward/Flux/(64, 64, 1, 128) 2081777 ns 2083660 ns 1.00
Conv((3, 3), 1 => 1)/cpu/forward/SimpleChains/(64, 64, 1, 128) 203268.5 ns 201897.5 ns 1.01
Dense(200 => 200)/cpu/reverse/ReverseDiff (compiled)/(200, 128) 294096.5 ns 298047.5 ns 0.99
Dense(200 => 200)/cpu/reverse/Zygote/(200, 128) 267782.5 ns 268132 ns 1.00
Dense(200 => 200)/cpu/reverse/Tracker/(200, 128) 371185.5 ns 371825 ns 1.00
Dense(200 => 200)/cpu/reverse/ReverseDiff/(200, 128) 413299 ns 413544 ns 1.00
Dense(200 => 200)/cpu/reverse/Flux/(200, 128) 275477.5 ns 276592.5 ns 1.00
Dense(200 => 200)/cpu/reverse/SimpleChains/(200, 128) 412478 ns 410609 ns 1.00
Dense(200 => 200)/cpu/reverse/Enzyme/(200, 128) 83515 ns 83897 ns 1.00
Dense(200 => 200)/cpu/forward/NamedTuple/(200, 128) 81572 ns 82545 ns 0.99
Dense(200 => 200)/cpu/forward/ComponentArray/(200, 128) 84587 ns 83175 ns 1.02
Dense(200 => 200)/cpu/forward/Flux/(200, 128) 87202 ns 87343 ns 1.00
Dense(200 => 200)/cpu/forward/SimpleChains/(200, 128) 104435 ns 104725 ns 1.00
Conv((3, 3), 16 => 16)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 16, 128) 189634116 ns 194861098.5 ns 0.97
Conv((3, 3), 16 => 16)/cpu/reverse/Zygote/(64, 64, 16, 128) 327511973.5 ns 324081202.5 ns 1.01
Conv((3, 3), 16 => 16)/cpu/reverse/Tracker/(64, 64, 16, 128) 393033134 ns 389990696 ns 1.01
Conv((3, 3), 16 => 16)/cpu/reverse/ReverseDiff/(64, 64, 16, 128) 459381274.5 ns 456575304 ns 1.01
Conv((3, 3), 16 => 16)/cpu/reverse/Flux/(64, 64, 16, 128) 372746396 ns 373959015 ns 1.00
Conv((3, 3), 16 => 16)/cpu/reverse/SimpleChains/(64, 64, 16, 128) 339026014 ns 327240819 ns 1.04
Conv((3, 3), 16 => 16)/cpu/reverse/Enzyme/(64, 64, 16, 128) 101599587 ns 51445418 ns 1.97
Conv((3, 3), 16 => 16)/cpu/forward/NamedTuple/(64, 64, 16, 128) 44071402 ns 43855933 ns 1.00
Conv((3, 3), 16 => 16)/cpu/forward/ComponentArray/(64, 64, 16, 128) 43916065 ns 43754675.5 ns 1.00
Conv((3, 3), 16 => 16)/cpu/forward/Flux/(64, 64, 16, 128) 49981635 ns 49660295 ns 1.01
Conv((3, 3), 16 => 16)/cpu/forward/SimpleChains/(64, 64, 16, 128) 28450422 ns 28671480.5 ns 0.99
Dense(2000 => 2000)/cpu/reverse/ReverseDiff (compiled)/(2000, 128) 19140893 ns 19490250 ns 0.98
Dense(2000 => 2000)/cpu/reverse/Zygote/(2000, 128) 19684269 ns 19632651.5 ns 1.00
Dense(2000 => 2000)/cpu/reverse/Tracker/(2000, 128) 23758626 ns 23428130 ns 1.01
Dense(2000 => 2000)/cpu/reverse/ReverseDiff/(2000, 128) 24329808.5 ns 24161134 ns 1.01
Dense(2000 => 2000)/cpu/reverse/Flux/(2000, 128) 19767984 ns 19690863 ns 1.00
Dense(2000 => 2000)/cpu/reverse/Enzyme/(2000, 128) 6562636 ns 6542624 ns 1.00
Dense(2000 => 2000)/cpu/forward/NamedTuple/(2000, 128) 6590938 ns 6560769 ns 1.00
Dense(2000 => 2000)/cpu/forward/ComponentArray/(2000, 128) 6569890 ns 6508024.5 ns 1.01
Dense(2000 => 2000)/cpu/forward/Flux/(2000, 128) 6528597 ns 6522495 ns 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant