Field experiments that involve nested structures may assign treatment conditions either to entire groups (such as classrooms or schools), or individuals within groups (such as students). Even though typically the interest in field experiments is in determining the significance of the overall treatment effect, it is equally important to examine the inconsistency of the treatment effect in different contexts, and understand how they vary. This study provides methods for computing power of tests for the variability of treatment effects in different clusters in three-level designs, where for example, students are nested within classrooms and classrooms are nested within schools. The power computations take into account clustering effects at the classroom and at the school level, and sample size effects (e.g., number of students, classrooms). The methods can also be applied to quasi-experimental studies that examine the significance of the variation of group differences in an outcome, or associations between predictors and outcomes across different clusters.
Spyros Konstantopoulos, Department
of Human Development, Social Policy, and Learning Sciences, Northwestern University
Click on
the working paper title at the top of this
page to download a free pdf of the paper.*
If You Need to Order a Hard Copy: Hard copies
of IPR working papers cost $5.00 each (international orders are $10 each). We only accept checks drawn on U.S. bank and payable in U.S. funds. Checks or money orders should be made
payable to Northwestern University and sent to the following address:
Publications Department - WP Orders
Institute for Policy Research
2040 Sheridan Rd., Evanston, IL 60208-4100.
For information, call 847-491-8712 or email ipr@northwestern.edu.
Please note that we do not accept credit cards.
*Adobe Acrobat Reader 5.0 (or higher) is needed to read the Acrobat pdf.
If you need to install Acrobat Reader, click the button below. Once the file
has downloaded onto your desktop, run it to install the reader on your hard
drive.