Statistical Significance Calculation

Question:

What is Taplytics' methodology for calculating statistical significance for experiments?

Answer:

Taplytics uses two different methodologies when measuring the effectiveness of a test, these are Z-Score and Two-Tailed T-Tests.

These different testing methods are chosen dynamically in the background based on the type of goal you set up. The Z-Score Test is used for goals that are binary conversions while the Two-Tailed T-Test is used for value optimization goals that test how significantly different two average values are.

No matter which methodology is being used, they both test for a 95% confidence level.

Z-Score:

Two-Tailed T-Test: