Signup: Add alternative theme selection AB test #3284
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The current default theme selection (Boardwalk, Cubic, etc.) is way overdue for a update. We need more recent themes for it and start to iterate on it and improve it. This is a first step of the effort and I'd like to test with the following new themes.
Currently, Headstart test is going on (#3233), and to avoid to break the test, this alternative theme test will only be conducted with the user who are not in the Headtstart test, and who are coming from the two button WordPress.com homepage. This might make the sample size smaller but will avoid variations that could disturb analysing the data we get.
Testing Instraction:
active-tests.js
L77 and L86 and set it to a high number, to force the assignments./start/website/en/?ref=homepage
and verify that you see the survey./start/blog/en/?ref=homepage
.