Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: Test with large default #620

Closed
wants to merge 1 commit into from

Conversation

SSoelvsten
Copy link
Owner

No description provided.

@SSoelvsten SSoelvsten self-assigned this Feb 27, 2024
Repository owner deleted a comment from codecov bot Feb 27, 2024
Copy link

🔴 Regression Test (QBF 'breakthrough/3x4_19_bwnib')

'origin/internal/exec_policy/default-large' is a change in performance of -44.32% (stdev: 0.28%).

... origin/main origin/internal/exec_policy/default-large
Mean 24679.00 35617.50
Standard Deviation 68.93 73.56

Number of samples: 4

Repository owner deleted a comment from github-actions bot Feb 27, 2024
Copy link

🔴 Regression Test (QBF 'breakthrough/3x5_11_bwnib')

'origin/internal/exec_policy/default-large' is a change in performance of -16.76% (stdev: 1.75%).

... origin/main origin/internal/exec_policy/default-large
Mean 7532.20 8794.60
Standard Deviation 131.59 60.40

Number of samples: 5

Copy link

🔴 Regression Test (QBF 'domineering/5x5_13_bwnib')

'origin/internal/exec_policy/default-large' is a change in performance of -8.49% (stdev: 4.94%).

... origin/main origin/internal/exec_policy/default-large
Mean 22489.80 24398.40
Standard Deviation 1110.03 88.00

Number of samples: 5

Copy link

🟡 Regression Test (Picotrav 'adder')

'origin/internal/exec_policy/default-large' is a change in performance of -3.00% (stdev: 8.42%).

... origin/main origin/internal/exec_policy/default-large
Mean 9130.00 9403.60
Standard Deviation 52.32 791.44

Number of samples: 10

Copy link

🟢 Regression Test (QBF 'ep/8x8_7_e-8-1_p-3-4_bwnib')

'origin/internal/exec_policy/default-large' is a change in performance of 59.52% (stdev: 9.01%).

... origin/main origin/internal/exec_policy/default-large
Mean 28214.10 11419.90
Standard Deviation 2543.33 45.13

Number of samples: 10

Repository owner deleted a comment from github-actions bot Feb 27, 2024
@SSoelvsten SSoelvsten closed this Feb 27, 2024
@SSoelvsten SSoelvsten deleted the internal/exec_policy/default-large branch March 7, 2024 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant