A great write-up on determining sample sizes for, and avoiding common traps in, split testing. Yet another good testing post from the folks at 37 signals. R code and discussion of power calcs included. http://37signals.com/svn/posts/3004-ab-testing-tech-note-determining-sample-size
Updates from January, 2010 Toggle Comment Threads | Keyboard Shortcuts
-
Ben
-
Ben
Data mining to improve learning: http://cacm.acm.org/blogs/blog-cacm/101489-massive-scale-data-mining-for-education/fulltext
-
Ben
Just keeping for later: http://blog.minethatdata.com/2010/11/ab-testing-persecution.html
-
Ben
Stumbled on this intriguing story about a bright statistics postgrad. He solved two famous problems in the field whilst mistakenly thinking they were simply routine homework questions.
Tales of statisticians: George B Dantzig
We’ll never know if he might have solved them even if he knew what they were, but the moral of the story resonated with me:
If Dantzig had known the problems were unsolved, he might not have made any serious attempt to solve them, whereas the “positive” assumption that they were not only solvable, but routinely solvable, focused his attention simply on finding the solution. Ignorance can thus be a help to the discoverer.
-
Ben