Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Synthesize A/B testing of details panel and data landing page #4978

Closed
2 tasks done
Tracked by #203
JonellaCulmer opened this issue Dec 2, 2021 · 3 comments
Closed
2 tasks done
Tracked by #203

Synthesize A/B testing of details panel and data landing page #4978

JonellaCulmer opened this issue Dec 2, 2021 · 3 comments

Comments

@JonellaCulmer
Copy link
Contributor

JonellaCulmer commented Dec 2, 2021

What we're after:
Synthesize the data following the GTM tracking for the following features:

  • Details panels
  • Data landing homepage

Related issues

Completion criteria

  • Analytics are compiled and documented
  • Recommendation for implementation is made
  • [ ] Deactivate experiments
@JonellaCulmer
Copy link
Contributor Author

Details panel icon A/B/C test

  • Early results show that user prefer the blue icons over the gray. There has been a ~10% increase in clicks for blue icons over the gray icon, with the blue plus icon having a slight edge.

Screen Shot 2021-12-08 at 3 51 20 PM

Next steps:

  • Modify the GTM events to remove the default gray option and continue to test with the blue options for an additional month.

@JonellaCulmer
Copy link
Contributor Author

Data landing page switcharoo A/B test

Results are inconclusive at this time. The data isn't showing anything significant that would suggest one direction over another. Neither solution suggests which content should remain at the top of the page. However, we do see good numbers for clicks to browse data pages. Again, nothing significant enough to warrant a change.

Next steps:

  • Keep running the experiment for another month to see if something magical happens with the data and points to a new direction.
  • If we don't see significant data points that point to a solution, we will stop the experiment and run it again closer to the election.

@JonellaCulmer
Copy link
Contributor Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants