Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UCF101 scenario epsilons are too large #862

Closed
dxoigmn opened this issue Oct 28, 2020 · 1 comment · Fixed by #865
Closed

UCF101 scenario epsilons are too large #862

dxoigmn opened this issue Oct 28, 2020 · 1 comment · Fixed by #865
Labels
bug Something isn't working scenarios

Comments

@dxoigmn
Copy link

dxoigmn commented Oct 28, 2020

Given the c14n of datasets in Armory 0.12, the attack eps value in the UCF101 scenarios is too large now (51), which means the attacker is always successful. These values should be normalized to [0, 1] range. I imagine a similar analysis should be done for the other scenarios to make sure the eps values are in the correct range.

@davidslater davidslater added scenarios bug Something isn't working labels Oct 28, 2020
@davidslater
Copy link
Contributor

Thanks for noting this. I made a fix. Checking the other scenarios, they appear to be properly scaled. Audio is a bit weird, as the scale can vary quite a bit more than images/video, but linf is not a great metric in that space.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working scenarios
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants