Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can't Ignore More Than One Test #753

Closed
ChrisAlphabet opened this issue Aug 19, 2016 · 7 comments
Closed

Can't Ignore More Than One Test #753

ChrisAlphabet opened this issue Aug 19, 2016 · 7 comments
Assignees
@ivankravets
Labels
enhancement
Milestone
3.0.0

Comments

@ChrisAlphabet
Copy link

Windows 10, version 3.0.0a5
Can't ignore multiple tests at one time.

For example

[env:mybaseenv]
test_ignore = test_a, test_b, test_c

doesn't ignore any tests

and

[env:mybaseenv]
test_ignore = test_a
test_ignore = test_b

only ignore test_b

It would be great to just run a single test rather than the whole test suite.

Thanks in advance!
@ivankravets
Copy link
Member

See docs http://docs.platformio.org/en/latest/projectconf.html#test-ignore

Should I change separator to , to avoid the same issue?

@ChrisAlphabet
Copy link
Author

Ahh, I thought I checked the docs but I must've skimmed. My Bad! :)

I think a comma separator is a bit more intuitive, and it's consistent with

lib_extra_dirs = path/to/lib1, path/to/lib2

Cheers!

@ivankravets
Copy link
Member

Thanks, I'll change :)

@ivankravets ivankravets added this to the 3.0.0 milestone Aug 19, 2016
@ivankravets ivankravets self-assigned this Aug 19, 2016
@ivankravets
Copy link
Member

I see that you use pio test. Could you share some feedback? What we should improve? Thanks.

@ChrisAlphabet
Copy link
Author

Sure thing. I'm a pretty big fan of pio test!

One of the things that could be improved is how much text is dumped into the console. If you run a bunch of tests the console fills up pretty quickly and you can't scroll back up to see which test failed.

At the moment I'm putting all the console data in a .txt file so I can get everything using pio test -e myenv -v > test_results.txt which works ok cause i can ctrl+f failed and find what failed.

Maybe a default test logging feature would be handy? What do you think?

Another thing is that running an entire test suite takes a pretty long time. I'm using the nodemcu board so it might just be a slow platform but getting the whole process down to a few seconds would be great.

Also, I am having trouble getting native tests running. (see #752 ) Maybe a bit more documentation on getting native tests running would be helpful.

Other than that, it works great! I've been using Unity for the test framework but will be looking at getting Ceedling going probs next week-ish so I'll post any more feedback either in the community forum.

Love your work! Anything I can do to help out with PIO? Would love to contribute, where can I get started?

Cheers :)

ivankravets added a commit that referenced this issue Aug 21, 2016
@ivankravets
Improve unit testing output; fix issue with non-ascii output from emb…
0f7f301 
…edded device // Issue #753
@ivankravets
Copy link
Member

Thanks! 👍

Please test new PlatformIO 3.0.0a6. Is it better?

@ChrisAlphabet
Copy link
Author

That is much better!

For anyone curious

pio test will just print building, uploading, testing and test results

pio test -v will print everything to the console

Thanks!

ivankravets added a commit that referenced this issue Sep 7, 2016
@ivankravets
Version bump to 3.0.0 (issues #770, #766, #747, #730, #765, #640, #659,
f78c943 
#742, #459, #542, #763, #759, #753, #757, #749, #748, #745, #519, #709, #743, #413, #498, #410, #740, #361, #414, #554, #732, #588, #475, #461, #101, #719, #721, #537, #415, #522, #289, #556, #570, #456, #617, #432, #408, #479, #667, #510)
ivankravets added a commit that referenced this issue Sep 9, 2016
@ivankravets
Merge branch 'develop' into feature/unicode-issue-771
e6e75e1 
* develop:
  Fix incorrect line order when converting from INO to CPP and pointer is used
  Fix unit test
  Notify about `version` field when creating library
  Add support for SparkFun Blynk Board
  Return valid exit code from ``plaformio test`` command
  Disable SSL Server-Name-Indication for Python < 2.7.9
  Version bump to 3.0.1 (issue #772)
  Disable temporary SSL for PlatformIO services // Resolve #772
  Version bump to 3.0.0 (issues #770, #766, #747, #730, #765, #640, #659, #742, #459, #542, #763, #759, #753, #757, #749, #748, #745, #519, #709, #743, #413, #498, #410, #740, #361, #414, #554, #732, #588, #475, #461, #101, #719, #721, #537, #415, #522, #289, #556, #570, #456, #617, #432, #408, #479, #667, #510)
  Fix menu height for  docs
  Fix issue with multiple archives when linking firmware
  Add migration guide for PIO2 to PIO3
  Search libraries by headers/includes with ``platformio lib search --header`` option
  Update pio run command examples
  Add Unit Testing Demo
  Update PIO Plus badge title and link
  Add PlatformIO Plus badge
  Add links to PlatformIO Plus
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ivankravets ivankravets

Labels
enhancement
Projects
None yet
Milestone
3.0.0
Development

No branches or pull requests
2 participants
@ivankravets @ChrisAlphabet