Do typical RCTs of Education Interventions Have sufficient Statistical Power for Linking Impacts on Teacher Practice and Student Achievement Outcomes?
Peter Z. Schochet
If you need to determine sample size for your survey when a variable of interest is a binary outcome, you can use power analysis and decide how many subjects you need to reach out for survey participation. You should also adjust the sample size by expected response missing rate. I wrote an Excel file for sample size calculation:
Thanks: Mr. George Ohashi for showing me the function that adjusts sample sizes by expected missing rate.
Hedges and Hedberg (2007) paper:
I'm trying to find a textbook reference for the following procedure written explicitly in the context of power analysis. Please let me know if you know (k u e k a w a AT gmail com).
When there are more than two conditions in the experiment design, the alpha level, one of the parameters that go into power analysis, can be divided by the number of contrasts. If there are three groups (control, treatment 1, treatment 2), there are three contrast points:
C vs T1, C vs T2, and T1 vs T2.
The typical alpha level is 0.5, so you can do:
0.5 / 3 = 0.16
and use that in the power analysis software.
If only two contrasts are important for your purpose:
0.5 / 2 = 0.25
page 24 of