The multisite trial, widely used in mental health research and education, enables experimenters t... more The multisite trial, widely used in mental health research and education, enables experimenters to assess the average impact of a treatment across sites, the variance of treatment impact across sites, and the moderating effect of site characteristics on treatment efficacy. Key design decisions include the sample size per site and the number of sites. To consider power implications, this article proposes a standardized hierarchical linear model and uses rules of thumb similar to those proposed by J. Cohen (1988) for small, medium, and large effect sizes and for small, medium, and large treatment-by-site variance. Optimal allocation of resources within and between sites as a function of variance components and costs at each level are also considered. The approach generalizes to quasiexperiments with a similar structure. These ideas are illustrated with newly developed software.
Consider a study in which 2 groups are followed over time to assess group differences in the aver... more Consider a study in which 2 groups are followed over time to assess group differences in the average rate of change, rate of acceleration, or higher degree polynomial effect. In designing such a study, one must decide on the duration of the study, frequency of observation, and number of participants. The authors consider how these choices affect statistical power and show that power depends on a standardized effect size, the sample size, and a person-specific reliability coefficient. This reliability, in turn, depends on study duration and frequency. These relations enable researchers to weigh alternative designs with respect to feasibility and power. The authors illustrate the approach using data from published studies of antisocial thinking during adolescence and vocabulary growth during infancy.
Journal of Educational and Behavioral Statistics, 1985
As interest in quantitative research synthesis grows, investigators increasingly seek to use info... more As interest in quantitative research synthesis grows, investigators increasingly seek to use information about study features-study contexts, designs, treatments, and subjects-to account for variation in study outcomes. To facilitate analysis of diverse study findings, a mixed linear model with fixed and random effects is presented and illustrated with data from teacher expectancy experiments. This strategy enables the analyst to (a)
This study reports on the development of a structured interview, My Exposure to Violence (My ETV)... more This study reports on the development of a structured interview, My Exposure to Violence (My ETV), that was designed to assess child and youth exposure to violence. Eighty participants between the ages of 9 and 24 were assessed. Data from My ETV were fit to a Rasch model for rating scales, a technique that generates interval level measures and allows the characterization of both chronic and acute exposure. Results indicated that the fit statistics for six scales, covering both lifetime and past year victimization, witnessing of violence, and total exposure, were all good. These scales were found to have high internal consistency (r = .68 to .93) and test-retest reliability (r = .75 to .94). Evidence of construct validity was provided by the item analysis, which revealed a theoretically sensible ordering of item extremity, and also by analysis of bivariate associations. As expected, younger subjects generally reported less exposure to violence than did older subjects, males reported more exposure than did females, African-American subjects reported higher levels of exposure than did White subjects, violent offenders reported more exposure than did non-offenders, and those living in high crime areas reported more exposure than did those residing in low crime areas. Future areas of investigation and the potential contribution to studies of antisocial behavior and post-traumatic stress disorder are discussed.
Abstract Interest has rapidly increased in studies that randomly assign classrooms or schools to ... more Abstract Interest has rapidly increased in studies that randomly assign classrooms or schools to interventions. When well implemented, such studies eliminate selection bias, providing strong evidence about the impact of the interventions. However, unless ...
... were randomly assigned to the treatment condition and an intervention targeted toward childre... more ... were randomly assigned to the treatment condition and an intervention targeted toward children ... increase the funding for individual studies, NCER might consider funding fewer studies ... greater precision might be more valuable to identify effective educational interventions than ...
Hierarchical Linear Models Applications and Data Analysis Methods Second Edition Stephen W. Raude... more Hierarchical Linear Models Applications and Data Analysis Methods Second Edition Stephen W. Raudenbush Anthony S. Bryk Advanced Quantitative Techniques in the Social Sciences Series ... Hierarchic^ Lima Model Second Editio This One BB78-EWB-FOOH
Passing Muster: Evaluating Teacher Evaluation Systems 1 E X E C U T I V E S U M M A R Y .S. publi... more Passing Muster: Evaluating Teacher Evaluation Systems 1 E X E C U T I V E S U M M A R Y .S. public schools are in the early stages of a revolution in how they go about evaluating teachers. In years past there was little more than intuition and anecdote to support the view that teachers vary in their quality. The little data that was available came from ratings of teachers carried out by school principals, a process that typically resulted in nearly all teachers receiving uniformly high ratings. It is nearly impossible to discover and act on performance differences among teachers when documented records show them all to be the same.
We analyzed key individual, family, and neighborhood factors to assess competing hypotheses regar... more We analyzed key individual, family, and neighborhood factors to assess competing hypotheses regarding racial/ethnic gaps in perpetrating violence. From 1995 to 2002, we collected 3 waves of data on 2974 participants aged 8 [corrected] to 25 years living in 180 Chicago neighborhoods, augmented by a separate community survey of 8782 Chicago residents. The odds of perpetrating violence were 85% higher for Blacks compared with Whites, whereas Latino-perpetrated violence was 10% lower. Yet the majority of the Black-White gap (over 60%) and the entire Latino-White gap were explained primarily by the marital status of parents, immigrant generation, and dimensions of neighborhood social context. The results imply that generic interventions to improve neighborhood conditions and support families may reduce racial gaps in violence.
... for studying effects on student learning since learning is a process of individual change inv... more ... for studying effects on student learning since learning is a process of individual change involving the acquisition of knowledge and skill over time (Sorenson and Hallinan 1977). In principle, research on learning requires multi-time point data and a statistical model that permits ...
The multisite trial, widely used in mental health research and education, enables experimenters t... more The multisite trial, widely used in mental health research and education, enables experimenters to assess the average impact of a treatment across sites, the variance of treatment impact across sites, and the moderating effect of site characteristics on treatment efficacy. Key design decisions include the sample size per site and the number of sites. To consider power implications, this article proposes a standardized hierarchical linear model and uses rules of thumb similar to those proposed by J. Cohen (1988) for small, medium, and large effect sizes and for small, medium, and large treatment-by-site variance. Optimal allocation of resources within and between sites as a function of variance components and costs at each level are also considered. The approach generalizes to quasiexperiments with a similar structure. These ideas are illustrated with newly developed software.
Consider a study in which 2 groups are followed over time to assess group differences in the aver... more Consider a study in which 2 groups are followed over time to assess group differences in the average rate of change, rate of acceleration, or higher degree polynomial effect. In designing such a study, one must decide on the duration of the study, frequency of observation, and number of participants. The authors consider how these choices affect statistical power and show that power depends on a standardized effect size, the sample size, and a person-specific reliability coefficient. This reliability, in turn, depends on study duration and frequency. These relations enable researchers to weigh alternative designs with respect to feasibility and power. The authors illustrate the approach using data from published studies of antisocial thinking during adolescence and vocabulary growth during infancy.
Journal of Educational and Behavioral Statistics, 1985
As interest in quantitative research synthesis grows, investigators increasingly seek to use info... more As interest in quantitative research synthesis grows, investigators increasingly seek to use information about study features-study contexts, designs, treatments, and subjects-to account for variation in study outcomes. To facilitate analysis of diverse study findings, a mixed linear model with fixed and random effects is presented and illustrated with data from teacher expectancy experiments. This strategy enables the analyst to (a)
This study reports on the development of a structured interview, My Exposure to Violence (My ETV)... more This study reports on the development of a structured interview, My Exposure to Violence (My ETV), that was designed to assess child and youth exposure to violence. Eighty participants between the ages of 9 and 24 were assessed. Data from My ETV were fit to a Rasch model for rating scales, a technique that generates interval level measures and allows the characterization of both chronic and acute exposure. Results indicated that the fit statistics for six scales, covering both lifetime and past year victimization, witnessing of violence, and total exposure, were all good. These scales were found to have high internal consistency (r = .68 to .93) and test-retest reliability (r = .75 to .94). Evidence of construct validity was provided by the item analysis, which revealed a theoretically sensible ordering of item extremity, and also by analysis of bivariate associations. As expected, younger subjects generally reported less exposure to violence than did older subjects, males reported more exposure than did females, African-American subjects reported higher levels of exposure than did White subjects, violent offenders reported more exposure than did non-offenders, and those living in high crime areas reported more exposure than did those residing in low crime areas. Future areas of investigation and the potential contribution to studies of antisocial behavior and post-traumatic stress disorder are discussed.
Abstract Interest has rapidly increased in studies that randomly assign classrooms or schools to ... more Abstract Interest has rapidly increased in studies that randomly assign classrooms or schools to interventions. When well implemented, such studies eliminate selection bias, providing strong evidence about the impact of the interventions. However, unless ...
... were randomly assigned to the treatment condition and an intervention targeted toward childre... more ... were randomly assigned to the treatment condition and an intervention targeted toward children ... increase the funding for individual studies, NCER might consider funding fewer studies ... greater precision might be more valuable to identify effective educational interventions than ...
Hierarchical Linear Models Applications and Data Analysis Methods Second Edition Stephen W. Raude... more Hierarchical Linear Models Applications and Data Analysis Methods Second Edition Stephen W. Raudenbush Anthony S. Bryk Advanced Quantitative Techniques in the Social Sciences Series ... Hierarchic^ Lima Model Second Editio This One BB78-EWB-FOOH
Passing Muster: Evaluating Teacher Evaluation Systems 1 E X E C U T I V E S U M M A R Y .S. publi... more Passing Muster: Evaluating Teacher Evaluation Systems 1 E X E C U T I V E S U M M A R Y .S. public schools are in the early stages of a revolution in how they go about evaluating teachers. In years past there was little more than intuition and anecdote to support the view that teachers vary in their quality. The little data that was available came from ratings of teachers carried out by school principals, a process that typically resulted in nearly all teachers receiving uniformly high ratings. It is nearly impossible to discover and act on performance differences among teachers when documented records show them all to be the same.
We analyzed key individual, family, and neighborhood factors to assess competing hypotheses regar... more We analyzed key individual, family, and neighborhood factors to assess competing hypotheses regarding racial/ethnic gaps in perpetrating violence. From 1995 to 2002, we collected 3 waves of data on 2974 participants aged 8 [corrected] to 25 years living in 180 Chicago neighborhoods, augmented by a separate community survey of 8782 Chicago residents. The odds of perpetrating violence were 85% higher for Blacks compared with Whites, whereas Latino-perpetrated violence was 10% lower. Yet the majority of the Black-White gap (over 60%) and the entire Latino-White gap were explained primarily by the marital status of parents, immigrant generation, and dimensions of neighborhood social context. The results imply that generic interventions to improve neighborhood conditions and support families may reduce racial gaps in violence.
... for studying effects on student learning since learning is a process of individual change inv... more ... for studying effects on student learning since learning is a process of individual change involving the acquisition of knowledge and skill over time (Sorenson and Hallinan 1977). In principle, research on learning requires multi-time point data and a statistical model that permits ...
Uploads
Papers by S. Raudenbush