Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a/b test for full screen transaction confirmations #7162

Merged
merged 9 commits into from
Sep 24, 2019

Conversation

danjm
Copy link
Contributor

@danjm danjm commented Sep 12, 2019

Resolves #7022

This PR adds an a/b test as per #7022. All users are placed in one of two groups. The control group sees confirmations of transactions from dapps via the current/normal notification window. The test group sees the confirmations in a full screen browser tab.

Here is a demo video of creating a transaction while in the test group: https://streamable.com/zwcjf

Meanwhile, create a tx while in the control group works as expected: https://streamable.com/xldp3

Here are the sorts of results we can see on matomo:

Screenshot from 2019-09-12 14-38-36

cc @bdresser @omnat

app/scripts/background.js Outdated Show resolved Hide resolved
@metamaskbot
Copy link
Collaborator

Builds ready [5fcc83b]

@metamaskbot
Copy link
Collaborator

Builds ready [983e04b]

@metamaskbot
Copy link
Collaborator

Builds ready [07e03c9]

Gudahtt
Gudahtt previously approved these changes Sep 21, 2019
Copy link
Member

@Gudahtt Gudahtt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Though migration 37 is added both here and in #7205, so one of them will need to be renamed.

@metamaskbot
Copy link
Collaborator

Builds ready [299979c]

@danjm danjm merged commit 1bd22b5 into develop Sep 24, 2019
Gudahtt added a commit to Gudahtt/metamask-extension that referenced this pull request Sep 27, 2019
* origin/develop: (56 commits)
  Add advanced setting to enable editing nonce on confirmation screens (MetaMask#7089)
  Add migration on 3box imports and remove feature flag (MetaMask#7209)
  ci - install deps - limit install scripts to whitelist (MetaMask#7208)
  Add a/b test for full screen transaction confirmations (MetaMask#7162)
  Update minimum Firefox verison to 56.0 (MetaMask#7213)
  mesh-testing - submit infura rpc requests to mesh-testing container (MetaMask#7031)
  obs-store/local-store should upgrade webextension error to real error (MetaMask#7207)
  sesify-viz - bump dep for visualization enhancement (MetaMask#7175)
  address book entries by chainId (MetaMask#7205)
  Optimize images only during production build (MetaMask#7194)
  Use common test build during CI (MetaMask#7196)
  Report missing `en` locale messages to Sentry (MetaMask#7197)
  Verify locales on CI (MetaMask#7199)
  updated ganache and addons-linter (MetaMask#7204)
  fixup! add user rejected errors
  add user rejected errors
  update json-rpc-engine
  use eth-json-rpc-errors
  Remove unused locale messages (MetaMask#7190)
  Remove unused components (MetaMask#7191)
  ...
@whymarrh whymarrh deleted the abtest-fullscreenvpopup branch October 2, 2019 15:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fullscreen v/s Pop-up
3 participants