## RCT, power analysis, and mediation factor

Do typical RCTs of Education Interventions Have sufficient Statistical Power for Linking Impacts on Teacher Practice and Student Achievement Outcomes?

October 2009

Peter Z. Schochet

http://ies.ed.gov/ncee/pdf/20094065.pdf

## How to determine sample size for a binary variable

If you need to determine sample size for your survey when a variable of interest is a binary outcome, you can use power analysis and decide how many subjects you need to reach out for survey participation.  You should also adjust the sample size by expected response missing rate.  I wrote an Excel file for sample size calculation:

Reference:

http://www.surveysystem.com/sscalc.htm

Thanks: Mr. George Ohashi for showing me the function that adjusts sample sizes by expected missing rate.

## Variance Almanac of Academic Achievement

Variance Almanac

Hedges and Hedberg (2007) paper:

## Bonferroni correction for power analysis with more than two groups

I'm trying to find a textbook reference for the following procedure written explicitly in the context of power analysis.  Please let me know if you know (k u e k a w a AT gmail com).

When there are more than two conditions in the experiment design, the alpha level, one of the parameters that go into power analysis, can be divided by the number of contrasts.  If there are three groups (control, treatment 1, treatment 2), there are three contrast points:

C vs T1, C vs T2, and T1 vs T2.

The typical alpha level is 0.5, so you can do:

0.5 / 3 = 0.16

and use that in the power analysis software.

If only two contrasts are important for your purpose:

0.5 / 2 = 0.25

Reference:

page 24 of

https://medschool.vanderbilt.edu/cqs/files/cqs/media/2010Ayumi.pdf

Bonferroni correction:

https://en.wikipedia.org/wiki/Bonferroni_correction