Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate test segfaults with the Testset scaffolding #19377

Merged
merged 1 commit into from
Nov 24, 2016

Conversation

staticfloat
Copy link
Sponsor Member

Fixes #19376

Also add utility tests segfault and throw_error_exception that do exactly
what they sound like.

I am most likely abusing the testset framework here, specifically this line is particularly bad, I think, where I'm co-opting the Base.Test.Error type and doing things like passing in an empty list instead of a backtrace, the testset name instead of the original expression, etc...

I would have marked the test as Broken instead of Error and set o_ts.anynonpass to true, but this gets clobbered by Base.Test.print_test_results() because that recalculates o_ts.anynonpass. This makes me think that we shouldn't be setting o_ts.anynonpass anywhere inside test/runtests.jl.

Pinging @kshyatt as you're the last person to touch this stuff and you probably know the "right" way to fix this. To test, run something like ./julia test/runtests.jl keywordargs inference dates/arithmetic util/segfault

Fixes #19376

Also add utility tests `segfault` and `throw_error_exception` that do
exactly what they sound like.
@kshyatt kshyatt added the testsystem The unit testing framework and Test stdlib label Nov 24, 2016
@kshyatt
Copy link
Contributor

kshyatt commented Nov 24, 2016

Sorry, I've been hella busy and not able to review. Will try to get to this tonight.

@kshyatt kshyatt merged commit 03c2464 into master Nov 24, 2016
@kshyatt kshyatt deleted the sf/not_quite_so_resilient branch November 24, 2016 20:28
@tkelman
Copy link
Contributor

tkelman commented Nov 24, 2016

Also add utility tests segfault and throw_error_exception that do exactly
what they sound like.

Were these supposed to do anything or add tests somewhere that would actually run normally? Right now they're just orphan unused files.

@staticfloat
Copy link
Sponsor Member Author

staticfloat commented Nov 24, 2016 via email

@tkelman
Copy link
Contributor

tkelman commented Nov 25, 2016

I don't think these should be checked in unless the test suite is going to use them

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
testsystem The unit testing framework and Test stdlib
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Segfault in tests being ignored
3 participants