Fully automated UI testing

[hiddentao]

WIP

• Automated production app UI testing using spectron.

[hiddentao]

Made some headway in terms of getting the app started up. But spectron is unable to detect the window properly. Am going to upgrade Electron to the latest version (so that I can use latest spectron with all recent bugfixes too).

[hiddentao]

Made some more progress, but now am getting a Meteor is not defined error when the window loads up. This only happens when I run the app from spectron (the test framework), not when I run it directly. I haven't yet figured out what the problem is.

[frozeman]

It might be a path issue, that can't load the meteor javascript files properly?
Meteor is only undefined if its either not at all loaded, or some errors happened during executions.

[hiddentao]

Unable to get this working decently in Travis CI - it takes forever to build the wallet distributable. Presumably because it has to download all the meteor package dependencies and then build the meteor app. Build is already running at 12 minutes and it's still building the Meteor package -> https://travis-ci.org/ethereum/mist/builds/140727836

There is no way of telling Travis to extend the timeouts (https://docs.travis-ci.com/user/customizing-the-build/#Build-Timeouts). This is rightly so too, as the build shouldn't really take more than a few minutes in my opinion. If it does then we have a build process.

We could see if we can modify the meteor build process to produce some logging output to avoid Travis timing out, though no obvious way of enabling this comes to mind.

[alexvandesande]

Was testing today, got this error:

  basic.test.js
    1) "before all" hook


  0 passing (26ms)
  1 failing

  1) basic.test.js "before all" hook:
     Error: Unable to find "geth" executable in PATH
      at new Geth (node_modules/geth-private/index.js:36:15)
      at module.exports (node_modules/geth-private/index.js:362:10)
      at Context._module.exports.(anonymous function).before (test/_base.js:36:19)
      at next (native)
      at onFulfilled (node_modules/co/index.js:65:19)
      at node_modules/co/index.js:54:5
      at Context.co (node_modules/co/index.js:50:10)
      at Context.createPromise (node_modules/co/index.js:30:15)
      at Hook.Runnable.run (node_modules/co-mocha/lib/co-mocha.js:43:16)



[18:02:21] 'test-wallet' errored after 1.55 s
[18:02:21] Error in plugin 'gulp-spawn-mocha'
Mocha exited with code 1

What's the geth-private node module? What about the Spawn Mocha?

[hiddentao]

It can't find the geth executable in PATH. I'll change it so that it uses the one we download via gulp.

[hiddentao]

geth-private is my geth wrapper which makes it easy to do private chains - https://github.com/hiddentao/geth-private

gulp-spawn-mocha runs Mocha tests in a separate process.

[hiddentao]

Should find geth executable in mist folder now.

[alexvandesande]

It works! Awesome, Ram, thanks. Will merge

(node:33410) fs: re-evaluating native module sources is not supported. If you are using the graceful-fs module, please update it to a more recent version.
You can select a platform like: --platform (all or darwin or win32 or linux)
Mist version: 0.7.6
Electron version: 1.2.5
[10:50:59] Using gulpfile ~/dev/mist/gulpfile.js
[10:50:59] Starting 'test-wallet'...


  basic.test.js
    tests
      ✓ title
      ✓ account balances
      ✓ deposit into account (37186ms)


  3 passing (2m)

[10:53:02] Finished 'test-wallet' after 2.05 mim

[lock]

This thread has been automatically locked because it has not had recent activity. Please open a new issue for related bugs and link to relevant comments in this thread.