Best Reading of the Day - Entry 0170 A/B Testing Science

The folks over at eConsultancy have just wrapped a very good 3 part series on split testing, or A/B testing.

What is A/B testing?  How about WikiPedia to help?

http://en.wikipedia.org/wiki/A/B_testing

Here is the definition listed there:

As the name implies, two versions (A and B) are compared, which are identical except for one variation that might affect a user's behavior. Version A might be the currently used version (control), while Version B is modified in some respect (treatment). For instance, on an e-commerce website the purchase funnel is typically a good candidate for A/B testing, as even marginal improvements in drop-off rates can represent a significant gain in sales. Significant improvements can sometimes be seen through testing elements like copy text, layouts, images and colors,[1] but not always.

First up is the introductory article:

https://econsultancy.com/blog/65672-using-data-science-with-a-b-tests-sample-sizing

Secondly is Chi-Squared testing:

https://econsultancy.com/blog/65711-using-data-science-with-a-b-tests-chi-squared-testing

The third and final wraps up the set:

https://econsultancy.com/blog/65755-using-data-science-with-a-b-tests-bayesian-analysis

Very good reading over all, especially if your understanding of statistics could be improved.

Happy Reading

J.W. Gant