Skip to content
This repository has been archived by the owner on Aug 8, 2023. It is now read-only.

Integration test: improve render-test output #12062

Closed
tobrun opened this issue Jun 5, 2018 · 3 comments
Closed

Integration test: improve render-test output #12062

tobrun opened this issue Jun 5, 2018 · 3 comments
Labels
Android Mapbox Maps SDK for Android archived Archived because of inactivity tests

Comments

@tobrun
Copy link
Member

tobrun commented Jun 5, 2018

In #12041 we added integration for running the node render-test suite on Android. Atm we will run the full test suite on a device, pull resulting images from device and run pixelmatch to compare expected.png with actual.png resulting in a diff.png and error percentage:

image 1

It will produce a folder structure with the images as follows:

image

Above setup is not ideal to look into render test faillures, some ideas to improve this:

  • generate a web page conform to what node produces
  • show clickable file links in the terminal output
  • show percentage of tests failed, amount of tests executed at end of run
  • create a separate folder with all failed tests
  • ...

cc @LukasPaczos

@tobrun tobrun added Android Mapbox Maps SDK for Android tests labels Jun 5, 2018
@stale stale bot added the archived Archived because of inactivity label Dec 2, 2018
@stale
Copy link

stale bot commented Dec 2, 2018

This issue has been automatically detected as stale because it has not had recent activity and will be archived. Thank you for your contributions.

@stale stale bot closed this as completed Dec 2, 2018
@tobrun tobrun reopened this Dec 2, 2018
@stale stale bot removed the archived Archived because of inactivity label Dec 2, 2018
@stale stale bot added the archived Archived because of inactivity label May 31, 2019
@stale
Copy link

stale bot commented May 31, 2019

This issue has been automatically detected as stale because it has not had recent activity and will be archived. Thank you for your contributions.

@stale stale bot closed this as completed May 31, 2019
@stale
Copy link

stale bot commented May 31, 2019

This issue has been automatically detected as stale because it has not had recent activity and will be archived. Thank you for your contributions.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Android Mapbox Maps SDK for Android archived Archived because of inactivity tests
Projects
None yet
Development

No branches or pull requests

1 participant