Experimental design

Alex Reinhart – Updated September 29, 2018 notebooks · refsmmat.com

See also Causality, Observational studies.

Many experimental design textbooks, written for practicing scientists, don’t explain why we’re going to all of this trouble to design elaborate treatment allocations. Why, exactly, do I want to use a Latin square over some other allocation of treatments? In most cases, the purpose behind designs is control of estimation variance: by choosing treatment allocation carefully, we can obtain a treatment effect estimate that has the lowest possible variance, given our sample size constraints. This involves clever tricks like making treatment effects orthogonal to other effects by design.


Online experiments

By which I mean “experiments performed on websites”, not “online” as in “online learning”.

Adaptive experiments