-
Notifications
You must be signed in to change notification settings - Fork 58
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Run CI on pre #739
Run CI on pre #739
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #739 +/- ##
===========================================
- Coverage 95.63% 82.62% -13.02%
===========================================
Files 54 54
Lines 2726 2728 +2
===========================================
- Hits 2607 2254 -353
- Misses 119 474 +355 ☔ View full report in Codecov by Sentry. |
@wsmoses is Enzyme currently not functional on 1.11-rc1? https://github.com/LuxDL/Lux.jl/actions/runs/9705757902/job/26788368870?pr=739#step:6:583 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark Results
Benchmark suite | Current: 52d2b86 | Previous: 7453ca9 | Ratio |
---|---|---|---|
Dense(2 => 2)/cpu/reverse/ReverseDiff (compiled)/(2, 128) |
3643 ns |
3609.25 ns |
1.01 |
Dense(2 => 2)/cpu/reverse/Zygote/(2, 128) |
7185.2 ns |
7159.4 ns |
1.00 |
Dense(2 => 2)/cpu/reverse/Tracker/(2, 128) |
20979 ns |
20979 ns |
1 |
Dense(2 => 2)/cpu/reverse/ReverseDiff/(2, 128) |
9744 ns |
9662 ns |
1.01 |
Dense(2 => 2)/cpu/reverse/Flux/(2, 128) |
8988.8 ns |
8897.875 ns |
1.01 |
Dense(2 => 2)/cpu/reverse/SimpleChains/(2, 128) |
4462.125 ns |
4440.875 ns |
1.00 |
Dense(2 => 2)/cpu/reverse/Enzyme/(2, 128) |
1157.3642857142856 ns |
1161.2888888888888 ns |
1.00 |
Dense(2 => 2)/cpu/forward/NamedTuple/(2, 128) |
1110.0430463576158 ns |
1167.801652892562 ns |
0.95 |
Dense(2 => 2)/cpu/forward/ComponentArray/(2, 128) |
1183.144927536232 ns |
1161.3426573426573 ns |
1.02 |
Dense(2 => 2)/cpu/forward/Flux/(2, 128) |
1804.921568627451 ns |
1787.017543859649 ns |
1.01 |
Dense(2 => 2)/cpu/forward/SimpleChains/(2, 128) |
179.61904761904762 ns |
180.16946778711485 ns |
1.00 |
Dense(20 => 20)/cpu/reverse/ReverseDiff (compiled)/(20, 128) |
17392 ns |
17483 ns |
0.99 |
Dense(20 => 20)/cpu/reverse/Zygote/(20, 128) |
17102 ns |
17082 ns |
1.00 |
Dense(20 => 20)/cpu/reverse/Tracker/(20, 128) |
37730 ns |
39434 ns |
0.96 |
Dense(20 => 20)/cpu/reverse/ReverseDiff/(20, 128) |
29414 ns |
29425 ns |
1.00 |
Dense(20 => 20)/cpu/reverse/Flux/(20, 128) |
21510 ns |
21340 ns |
1.01 |
Dense(20 => 20)/cpu/reverse/SimpleChains/(20, 128) |
17292 ns |
17423 ns |
0.99 |
Dense(20 => 20)/cpu/reverse/Enzyme/(20, 128) |
4338 ns |
4356.714285714285 ns |
1.00 |
Dense(20 => 20)/cpu/forward/NamedTuple/(20, 128) |
3883.5 ns |
3891.125 ns |
1.00 |
Dense(20 => 20)/cpu/forward/ComponentArray/(20, 128) |
3956.125 ns |
3953.625 ns |
1.00 |
Dense(20 => 20)/cpu/forward/Flux/(20, 128) |
4870.428571428572 ns |
4959.285714285715 ns |
0.98 |
Dense(20 => 20)/cpu/forward/SimpleChains/(20, 128) |
1653.1 ns |
1662.1 ns |
0.99 |
Conv((3, 3), 3 => 3)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 3, 128) |
39187764 ns |
38888215 ns |
1.01 |
Conv((3, 3), 3 => 3)/cpu/reverse/Zygote/(64, 64, 3, 128) |
58072499 ns |
57605568.5 ns |
1.01 |
Conv((3, 3), 3 => 3)/cpu/reverse/Tracker/(64, 64, 3, 128) |
69540188 ns |
76110500 ns |
0.91 |
Conv((3, 3), 3 => 3)/cpu/reverse/ReverseDiff/(64, 64, 3, 128) |
80951535.5 ns |
88832752.5 ns |
0.91 |
Conv((3, 3), 3 => 3)/cpu/reverse/Flux/(64, 64, 3, 128) |
72371594 ns |
72396661 ns |
1.00 |
Conv((3, 3), 3 => 3)/cpu/reverse/SimpleChains/(64, 64, 3, 128) |
12039265 ns |
11959905 ns |
1.01 |
Conv((3, 3), 3 => 3)/cpu/reverse/Enzyme/(64, 64, 3, 128) |
17862841 ns |
8440292 ns |
2.12 |
Conv((3, 3), 3 => 3)/cpu/forward/NamedTuple/(64, 64, 3, 128) |
7060722 ns |
6984372.5 ns |
1.01 |
Conv((3, 3), 3 => 3)/cpu/forward/ComponentArray/(64, 64, 3, 128) |
7013804 ns |
6969189 ns |
1.01 |
Conv((3, 3), 3 => 3)/cpu/forward/Flux/(64, 64, 3, 128) |
9977701 ns |
10028737.5 ns |
0.99 |
Conv((3, 3), 3 => 3)/cpu/forward/SimpleChains/(64, 64, 3, 128) |
6394913 ns |
6388121.5 ns |
1.00 |
vgg16/cpu/reverse/Zygote/(32, 32, 3, 16) |
760587414 ns |
747089927 ns |
1.02 |
vgg16/cpu/reverse/Zygote/(32, 32, 3, 64) |
2577913279 ns |
2571398611 ns |
1.00 |
vgg16/cpu/reverse/Zygote/(32, 32, 3, 2) |
145542924 ns |
135189197.5 ns |
1.08 |
vgg16/cpu/reverse/Tracker/(32, 32, 3, 16) |
768746928 ns |
795044361 ns |
0.97 |
vgg16/cpu/reverse/Tracker/(32, 32, 3, 64) |
2930427590 ns |
2974976527 ns |
0.99 |
vgg16/cpu/reverse/Tracker/(32, 32, 3, 2) |
198466646.5 ns |
197924414 ns |
1.00 |
vgg16/cpu/reverse/Flux/(32, 32, 3, 16) |
678651434 ns |
676218931 ns |
1.00 |
vgg16/cpu/reverse/Flux/(32, 32, 3, 64) |
2645979889 ns |
2614128502 ns |
1.01 |
vgg16/cpu/reverse/Flux/(32, 32, 3, 2) |
122486292 ns |
122097223 ns |
1.00 |
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 16) |
174841194 ns |
175936526 ns |
0.99 |
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 64) |
651748619 ns |
676766451.5 ns |
0.96 |
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 2) |
45606254 ns |
34662294 ns |
1.32 |
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 16) |
165166276 ns |
166860963 ns |
0.99 |
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 64) |
647141722 ns |
643674531 ns |
1.01 |
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 2) |
30108687 ns |
30820168 ns |
0.98 |
vgg16/cpu/forward/Flux/(32, 32, 3, 16) |
187684927 ns |
189842778 ns |
0.99 |
vgg16/cpu/forward/Flux/(32, 32, 3, 64) |
710956900.5 ns |
715544549.5 ns |
0.99 |
vgg16/cpu/forward/Flux/(32, 32, 3, 2) |
37590140 ns |
37965190 ns |
0.99 |
Conv((3, 3), 64 => 64)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 64, 128) |
1205515278.5 ns |
1268173647.5 ns |
0.95 |
Conv((3, 3), 64 => 64)/cpu/reverse/Zygote/(64, 64, 64, 128) |
1887731195.5 ns |
1863507518.5 ns |
1.01 |
Conv((3, 3), 64 => 64)/cpu/reverse/Tracker/(64, 64, 64, 128) |
2372684250 ns |
2370054887 ns |
1.00 |
Conv((3, 3), 64 => 64)/cpu/reverse/ReverseDiff/(64, 64, 64, 128) |
2531976850 ns |
2520547922 ns |
1.00 |
Conv((3, 3), 64 => 64)/cpu/reverse/Flux/(64, 64, 64, 128) |
1827041771.5 ns |
1857510292 ns |
0.98 |
Conv((3, 3), 64 => 64)/cpu/reverse/Enzyme/(64, 64, 64, 128) |
559129456 ns |
354818747 ns |
1.58 |
Conv((3, 3), 64 => 64)/cpu/forward/NamedTuple/(64, 64, 64, 128) |
323461020 ns |
324634549 ns |
1.00 |
Conv((3, 3), 64 => 64)/cpu/forward/ComponentArray/(64, 64, 64, 128) |
324962874 ns |
323578160 ns |
1.00 |
Conv((3, 3), 64 => 64)/cpu/forward/Flux/(64, 64, 64, 128) |
353832535.5 ns |
358697801.5 ns |
0.99 |
Conv((3, 3), 1 => 1)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 1, 128) |
11886131 ns |
11908179 ns |
1.00 |
Conv((3, 3), 1 => 1)/cpu/reverse/Zygote/(64, 64, 1, 128) |
17998825 ns |
17897810 ns |
1.01 |
Conv((3, 3), 1 => 1)/cpu/reverse/Tracker/(64, 64, 1, 128) |
19347894 ns |
19241672 ns |
1.01 |
Conv((3, 3), 1 => 1)/cpu/reverse/ReverseDiff/(64, 64, 1, 128) |
24040203 ns |
23890653 ns |
1.01 |
Conv((3, 3), 1 => 1)/cpu/reverse/Flux/(64, 64, 1, 128) |
18041013 ns |
18002442 ns |
1.00 |
Conv((3, 3), 1 => 1)/cpu/reverse/SimpleChains/(64, 64, 1, 128) |
1178391 ns |
1175569 ns |
1.00 |
Conv((3, 3), 1 => 1)/cpu/reverse/Enzyme/(64, 64, 1, 128) |
5839355 ns |
2533812 ns |
2.30 |
Conv((3, 3), 1 => 1)/cpu/forward/NamedTuple/(64, 64, 1, 128) |
2063498 ns |
2059884 ns |
1.00 |
Conv((3, 3), 1 => 1)/cpu/forward/ComponentArray/(64, 64, 1, 128) |
2043560.5 ns |
2034923 ns |
1.00 |
Conv((3, 3), 1 => 1)/cpu/forward/Flux/(64, 64, 1, 128) |
2081777 ns |
2083660 ns |
1.00 |
Conv((3, 3), 1 => 1)/cpu/forward/SimpleChains/(64, 64, 1, 128) |
203268.5 ns |
201897.5 ns |
1.01 |
Dense(200 => 200)/cpu/reverse/ReverseDiff (compiled)/(200, 128) |
294096.5 ns |
298047.5 ns |
0.99 |
Dense(200 => 200)/cpu/reverse/Zygote/(200, 128) |
267782.5 ns |
268132 ns |
1.00 |
Dense(200 => 200)/cpu/reverse/Tracker/(200, 128) |
371185.5 ns |
371825 ns |
1.00 |
Dense(200 => 200)/cpu/reverse/ReverseDiff/(200, 128) |
413299 ns |
413544 ns |
1.00 |
Dense(200 => 200)/cpu/reverse/Flux/(200, 128) |
275477.5 ns |
276592.5 ns |
1.00 |
Dense(200 => 200)/cpu/reverse/SimpleChains/(200, 128) |
412478 ns |
410609 ns |
1.00 |
Dense(200 => 200)/cpu/reverse/Enzyme/(200, 128) |
83515 ns |
83897 ns |
1.00 |
Dense(200 => 200)/cpu/forward/NamedTuple/(200, 128) |
81572 ns |
82545 ns |
0.99 |
Dense(200 => 200)/cpu/forward/ComponentArray/(200, 128) |
84587 ns |
83175 ns |
1.02 |
Dense(200 => 200)/cpu/forward/Flux/(200, 128) |
87202 ns |
87343 ns |
1.00 |
Dense(200 => 200)/cpu/forward/SimpleChains/(200, 128) |
104435 ns |
104725 ns |
1.00 |
Conv((3, 3), 16 => 16)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 16, 128) |
189634116 ns |
194861098.5 ns |
0.97 |
Conv((3, 3), 16 => 16)/cpu/reverse/Zygote/(64, 64, 16, 128) |
327511973.5 ns |
324081202.5 ns |
1.01 |
Conv((3, 3), 16 => 16)/cpu/reverse/Tracker/(64, 64, 16, 128) |
393033134 ns |
389990696 ns |
1.01 |
Conv((3, 3), 16 => 16)/cpu/reverse/ReverseDiff/(64, 64, 16, 128) |
459381274.5 ns |
456575304 ns |
1.01 |
Conv((3, 3), 16 => 16)/cpu/reverse/Flux/(64, 64, 16, 128) |
372746396 ns |
373959015 ns |
1.00 |
Conv((3, 3), 16 => 16)/cpu/reverse/SimpleChains/(64, 64, 16, 128) |
339026014 ns |
327240819 ns |
1.04 |
Conv((3, 3), 16 => 16)/cpu/reverse/Enzyme/(64, 64, 16, 128) |
101599587 ns |
51445418 ns |
1.97 |
Conv((3, 3), 16 => 16)/cpu/forward/NamedTuple/(64, 64, 16, 128) |
44071402 ns |
43855933 ns |
1.00 |
Conv((3, 3), 16 => 16)/cpu/forward/ComponentArray/(64, 64, 16, 128) |
43916065 ns |
43754675.5 ns |
1.00 |
Conv((3, 3), 16 => 16)/cpu/forward/Flux/(64, 64, 16, 128) |
49981635 ns |
49660295 ns |
1.01 |
Conv((3, 3), 16 => 16)/cpu/forward/SimpleChains/(64, 64, 16, 128) |
28450422 ns |
28671480.5 ns |
0.99 |
Dense(2000 => 2000)/cpu/reverse/ReverseDiff (compiled)/(2000, 128) |
19140893 ns |
19490250 ns |
0.98 |
Dense(2000 => 2000)/cpu/reverse/Zygote/(2000, 128) |
19684269 ns |
19632651.5 ns |
1.00 |
Dense(2000 => 2000)/cpu/reverse/Tracker/(2000, 128) |
23758626 ns |
23428130 ns |
1.01 |
Dense(2000 => 2000)/cpu/reverse/ReverseDiff/(2000, 128) |
24329808.5 ns |
24161134 ns |
1.01 |
Dense(2000 => 2000)/cpu/reverse/Flux/(2000, 128) |
19767984 ns |
19690863 ns |
1.00 |
Dense(2000 => 2000)/cpu/reverse/Enzyme/(2000, 128) |
6562636 ns |
6542624 ns |
1.00 |
Dense(2000 => 2000)/cpu/forward/NamedTuple/(2000, 128) |
6590938 ns |
6560769 ns |
1.00 |
Dense(2000 => 2000)/cpu/forward/ComponentArray/(2000, 128) |
6569890 ns |
6508024.5 ns |
1.01 |
Dense(2000 => 2000)/cpu/forward/Flux/(2000, 128) |
6528597 ns |
6522495 ns |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
No description provided.