Concurrent validity of the Kaufman Brief Intelligence Test (K-BIT) with a sample of elementary- a... more Concurrent validity of the Kaufman Brief Intelligence Test (K-BIT) with a sample of elementary- and middle-school students referred for multidisciplinary evaluations in a public school setting is presented. All correlations between the K-BIT and the Wechsler Intelligence Scale for Children–Third Edition (WISC-III) were significant. Correlations ranged from .36 (r2 = .10) to .87 (r2 = .75), Mr = .71 (Mr2
The core syndrome factor structure of the Adjustment Scales for Children and Adolescents (ASCA) w... more The core syndrome factor structure of the Adjustment Scales for Children and Adolescents (ASCA) was examined with a sample of 375 randomly selected Canadian youths in a large western city. The 6 ASCA core syndrome raw scores produced an identical two-factor solution as observed in samples of American youths. Principal axis exploratory factor analysis with varimax and promax rotations produced
This study used both exploratory (EFA) and confiiatory factor analyses (CFA) to examine the facto... more This study used both exploratory (EFA) and confiiatory factor analyses (CFA) to examine the factor structure of the WISC-III among White and Black students from the WISC-III standardization sample and a sample of 348 Black students referred for psychological evaluation. Results of the EFA provided evidence of a large first principal factor as well as the expected Verbal and Performance components across all three groups. Empirical support for the Freedom from Distractibility dimension was provided only from the confirmatory factor analyses. Although the four factor confirmatory model exhibited the best overall statistical fit, inspection of specific factor loadings revealed anomalies with the third and fourth factors, especially for the Referred Black sample. Implications for school psychologists are presented and recommendations for future research are provided. The issue of nondiscriminatory assessity is perhaps the most fundamental of all types ment is a concept of considerable legal and of measurement validity (Messick, 1989), and ethical importance to all psychologists often derives from correlational studies and (CNPAAEMI, 2000). The selection of test in-factor analytic research. Empirical support for struments that are free of test bias is paramount comparable factor structures across ethnic for school psychologists who work with eth-groups suggests that similar constructs or lanically diverse populations. Construct valid-tent traits are being assessed and provides pre
The Wechsler Intelligence Scale for Children (WISC) is the most widely used intelligence test in ... more The Wechsler Intelligence Scale for Children (WISC) is the most widely used intelligence test in the world. Now in its fifth edition, the WISC-V has been translated and adapted for use in nearly a dozen countries. Despite its popularity, numerous concerns have been raised about some of the procedures used to develop and validate translated and adapted versions of the test around the world. The purpose of this article is to survey the most salient of those methodological and statistical limitations. In particular, empirical data are presented that call into question the equating procedures used to validate the WISC-V Spanish, suggesting cautious use of that instrument. It is believed that the issues raised in the present article will be instructive for school psychologists engaged in the clinical assessment of intelligence with the WISC-V Spanish and with other translated and adapted versions around the world.
Independent exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) research wit... more Independent exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) research with the Wechsler Intelligence Scale for Children–Fifth Edition (WISC-V) standardization sample has failed to provide support for the five group factors proposed by the publisher, but there have been no independent examinations of the WISC-V structure among clinical samples. The present study examined the latent structure of the 10 WISC-V primary subtests with a large ( N = 2,512), bifurcated clinical sample (EFA, n = 1,256; CFA, n = 1,256). EFA did not support five factors as there were no salient subtest factor pattern coefficients on the fifth extracted factor. EFA indicated a four-factor model resembling the WISC-IV with a dominant general factor. A bifactor model with four group factors was supported by CFA as suggested by EFA. Variance estimates from both EFA and CFA found that the general intelligence factor dominated subtest variance and omega-hierarchical coefficients supported int...
Irish educational psychologists frequently use the Wechsler Intelligence Scale for Children - Fou... more Irish educational psychologists frequently use the Wechsler Intelligence Scale for Children - Fourth UK Edition (WISC-IV(UK) ; Wechsler, 2004, Wechsler Intelligence Scale for Children-Fourth UK Edition, London, UK, Harcourt Assessment) in clinical assessments of children with learning difficulties. Unfortunately, reliability and validity studies of the WISC-IV(UK) standardization sample have not yet been reported. Watkins et al. (2013, International Journal of School and Educational Psychology, 1, 102) found support for a bifactor structure with a large sample (N = 794) of Irish children who were administered the 10 WISC-IV(UK) core subtests in clinical assessments of learning difficulties and dominance of general intelligence. Because only 10 subtests were available, Cattell-Horn-Carroll (CHC; McGrew, 1997, 2005, Contemporary intellectual assessment: Theories, tests, and issues, New York, NY: Guilford; Schneider & McGrew, 2012, Contemporary intellectual assessment: Theories, tests, and issues, New York, NY, Guilford Press) models could not be tested and compared. The present study utilized confirmatory factor analyses to test the latent factor structure of the WISC-IV(UK) with a sample of 245 Irish children administered all 15 WISC-IV(UK) subtests in evaluations assessing learning difficulties in order to examine CHC- and Wechsler-based models. One through five, oblique first-order factor models and higher order versus bifactor models were examined and compared using CFA. Meaningful differences in fit statistics were not observed between the Wechsler and CHC representations of higher-order or bifactor models. In all four structures, general intelligence accounted for the largest portions of explained common variance, whereas group factors accounted for small to miniscule portions of explained common variance. Omega-hierarchical subscale coefficients indicated that unit-weighted composites that would be generated by WISC-IV(UK) group factors (Wechsler or CHC) would contain little unique variance and thus be of little value. These results were similar to those from other investigations, further demonstrating the replication of the WISC-IV factor structure across cultures and the importance of focusing primary interpretation on the FSIQ.
As recommended by Carroll, the present study examined the factor structure of the Wechsler Intell... more As recommended by Carroll, the present study examined the factor structure of the Wechsler Intelligence Scale for Children-Fourth Edition Spanish (WISC-IV Spanish) normative sample using higher order exploratory factor analytic techniques not included in the WISC-IV Spanish Technical Manual. Results indicated that the WISC-IV Spanish subtests were properly aligned with theoretically proposed factors; however, application of the Schmid and Leiman procedure found that the g factor accounted for large portions of total and common variance, whereas the four first-order factors accounted for small portions of total and common variance. Implications for clinical interpretation of the measurement instrument are discussed.
The British journal of educational psychology, Jan 3, 2017
Irish educational psychologists frequently use the Wechsler Intelligence Scale for Children - Fou... more Irish educational psychologists frequently use the Wechsler Intelligence Scale for Children - Fourth UK Edition (WISC-IV(UK) ; Wechsler, 2004, Wechsler Intelligence Scale for Children-Fourth UK Edition, London, UK, Harcourt Assessment) in clinical assessments of children with learning difficulties. Unfortunately, reliability and validity studies of the WISC-IV(UK) standardization sample have not yet been reported. Watkins et al. (2013, International Journal of School and Educational Psychology, 1, 102) found support for a bifactor structure with a large sample (N = 794) of Irish children who were administered the 10 WISC-IV(UK) core subtests in clinical assessments of learning difficulties and dominance of general intelligence. Because only 10 subtests were available, Cattell-Horn-Carroll (CHC; McGrew, 1997, 2005, Contemporary intellectual assessment: Theories, tests, and issues, New York, NY: Guilford; Schneider & McGrew, 2012, Contemporary intellectual assessment: Theories, tests,...
The factor structure of the Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V; Wechs... more The factor structure of the Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V; Wechsler, 2014a) standardization sample (N = 2,200) was examined using confirmatory factor analyses (CFA) with maximum likelihood estimation for all reported models from the WISC-V Technical and Interpretation Manual (Wechsler, 2014b). Additionally, alternative bifactor models were examined and variance estimates and model-based reliability estimates (ω coefficients) were provided. Results from analyses of the 16 primary and secondary WISC-V subtests found that all higher-order CFA models with 5 group factors (VC, VS, FR, WM, and PS) produced model specification errors where the Fluid Reasoning factor produced negative variance and were thus judged inadequate. Of the 16 models tested, the bifactor model containing 4 group factors (VC, PR, WM, and PS) produced the best fit. Results from analyses of the 10 primary WISC-V subtests also found the bifactor model with 4 group factors (VC, PR, WM, a...
The present study examined the factor structure of the Differential Ability Scales-Second Edition... more The present study examined the factor structure of the Differential Ability Scales-Second Edition (DAS-II; Elliott, 2007a) standardization sample using exploratory factor analyses, multiple factor extraction criteria, and hierarchical exploratory factor analyses (Schmid & Leiman, 1957) not included in the DAS-II Introductory and Technical Handbook (Elliott, 2007b). Exploratory factor analyses with multiple factor extraction criteria and hierarchical analyses with the Schmid and Leiman (1957) procedure were conducted with the 3 DAS-II standardization samples (Lower Early Years [Ages 2:6-3:5], Upper Early Years [Ages 3:6-6:11], School-Age [Ages 7:0-17:11]). All factor extraction criteria suggested 1 factor despite the author and publisher recommended and promoted 2 (Ages 2:6-3:5) or 3 (Ages 3:6-6:11, Ages 7:0-17:11) factors. Results indicated that most DAS-II subtests were properly associated with the theoretically proposed first-order factors. Hierarchical exploratory analyses with t...
Concurrent validity of the Kaufman Brief Intelligence Test (K-BIT) with a sample of elementary- a... more Concurrent validity of the Kaufman Brief Intelligence Test (K-BIT) with a sample of elementary- and middle-school students referred for multidisciplinary evaluations in a public school setting is presented. All correlations between the K-BIT and the Wechsler Intelligence Scale for Children–Third Edition (WISC-III) were significant. Correlations ranged from .36 (r2 = .10) to .87 (r2 = .75), Mr = .71 (Mr2
The core syndrome factor structure of the Adjustment Scales for Children and Adolescents (ASCA) w... more The core syndrome factor structure of the Adjustment Scales for Children and Adolescents (ASCA) was examined with a sample of 375 randomly selected Canadian youths in a large western city. The 6 ASCA core syndrome raw scores produced an identical two-factor solution as observed in samples of American youths. Principal axis exploratory factor analysis with varimax and promax rotations produced
This study used both exploratory (EFA) and confiiatory factor analyses (CFA) to examine the facto... more This study used both exploratory (EFA) and confiiatory factor analyses (CFA) to examine the factor structure of the WISC-III among White and Black students from the WISC-III standardization sample and a sample of 348 Black students referred for psychological evaluation. Results of the EFA provided evidence of a large first principal factor as well as the expected Verbal and Performance components across all three groups. Empirical support for the Freedom from Distractibility dimension was provided only from the confirmatory factor analyses. Although the four factor confirmatory model exhibited the best overall statistical fit, inspection of specific factor loadings revealed anomalies with the third and fourth factors, especially for the Referred Black sample. Implications for school psychologists are presented and recommendations for future research are provided. The issue of nondiscriminatory assessity is perhaps the most fundamental of all types ment is a concept of considerable legal and of measurement validity (Messick, 1989), and ethical importance to all psychologists often derives from correlational studies and (CNPAAEMI, 2000). The selection of test in-factor analytic research. Empirical support for struments that are free of test bias is paramount comparable factor structures across ethnic for school psychologists who work with eth-groups suggests that similar constructs or lanically diverse populations. Construct valid-tent traits are being assessed and provides pre
The Wechsler Intelligence Scale for Children (WISC) is the most widely used intelligence test in ... more The Wechsler Intelligence Scale for Children (WISC) is the most widely used intelligence test in the world. Now in its fifth edition, the WISC-V has been translated and adapted for use in nearly a dozen countries. Despite its popularity, numerous concerns have been raised about some of the procedures used to develop and validate translated and adapted versions of the test around the world. The purpose of this article is to survey the most salient of those methodological and statistical limitations. In particular, empirical data are presented that call into question the equating procedures used to validate the WISC-V Spanish, suggesting cautious use of that instrument. It is believed that the issues raised in the present article will be instructive for school psychologists engaged in the clinical assessment of intelligence with the WISC-V Spanish and with other translated and adapted versions around the world.
Independent exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) research wit... more Independent exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) research with the Wechsler Intelligence Scale for Children–Fifth Edition (WISC-V) standardization sample has failed to provide support for the five group factors proposed by the publisher, but there have been no independent examinations of the WISC-V structure among clinical samples. The present study examined the latent structure of the 10 WISC-V primary subtests with a large ( N = 2,512), bifurcated clinical sample (EFA, n = 1,256; CFA, n = 1,256). EFA did not support five factors as there were no salient subtest factor pattern coefficients on the fifth extracted factor. EFA indicated a four-factor model resembling the WISC-IV with a dominant general factor. A bifactor model with four group factors was supported by CFA as suggested by EFA. Variance estimates from both EFA and CFA found that the general intelligence factor dominated subtest variance and omega-hierarchical coefficients supported int...
Irish educational psychologists frequently use the Wechsler Intelligence Scale for Children - Fou... more Irish educational psychologists frequently use the Wechsler Intelligence Scale for Children - Fourth UK Edition (WISC-IV(UK) ; Wechsler, 2004, Wechsler Intelligence Scale for Children-Fourth UK Edition, London, UK, Harcourt Assessment) in clinical assessments of children with learning difficulties. Unfortunately, reliability and validity studies of the WISC-IV(UK) standardization sample have not yet been reported. Watkins et al. (2013, International Journal of School and Educational Psychology, 1, 102) found support for a bifactor structure with a large sample (N = 794) of Irish children who were administered the 10 WISC-IV(UK) core subtests in clinical assessments of learning difficulties and dominance of general intelligence. Because only 10 subtests were available, Cattell-Horn-Carroll (CHC; McGrew, 1997, 2005, Contemporary intellectual assessment: Theories, tests, and issues, New York, NY: Guilford; Schneider & McGrew, 2012, Contemporary intellectual assessment: Theories, tests, and issues, New York, NY, Guilford Press) models could not be tested and compared. The present study utilized confirmatory factor analyses to test the latent factor structure of the WISC-IV(UK) with a sample of 245 Irish children administered all 15 WISC-IV(UK) subtests in evaluations assessing learning difficulties in order to examine CHC- and Wechsler-based models. One through five, oblique first-order factor models and higher order versus bifactor models were examined and compared using CFA. Meaningful differences in fit statistics were not observed between the Wechsler and CHC representations of higher-order or bifactor models. In all four structures, general intelligence accounted for the largest portions of explained common variance, whereas group factors accounted for small to miniscule portions of explained common variance. Omega-hierarchical subscale coefficients indicated that unit-weighted composites that would be generated by WISC-IV(UK) group factors (Wechsler or CHC) would contain little unique variance and thus be of little value. These results were similar to those from other investigations, further demonstrating the replication of the WISC-IV factor structure across cultures and the importance of focusing primary interpretation on the FSIQ.
As recommended by Carroll, the present study examined the factor structure of the Wechsler Intell... more As recommended by Carroll, the present study examined the factor structure of the Wechsler Intelligence Scale for Children-Fourth Edition Spanish (WISC-IV Spanish) normative sample using higher order exploratory factor analytic techniques not included in the WISC-IV Spanish Technical Manual. Results indicated that the WISC-IV Spanish subtests were properly aligned with theoretically proposed factors; however, application of the Schmid and Leiman procedure found that the g factor accounted for large portions of total and common variance, whereas the four first-order factors accounted for small portions of total and common variance. Implications for clinical interpretation of the measurement instrument are discussed.
The British journal of educational psychology, Jan 3, 2017
Irish educational psychologists frequently use the Wechsler Intelligence Scale for Children - Fou... more Irish educational psychologists frequently use the Wechsler Intelligence Scale for Children - Fourth UK Edition (WISC-IV(UK) ; Wechsler, 2004, Wechsler Intelligence Scale for Children-Fourth UK Edition, London, UK, Harcourt Assessment) in clinical assessments of children with learning difficulties. Unfortunately, reliability and validity studies of the WISC-IV(UK) standardization sample have not yet been reported. Watkins et al. (2013, International Journal of School and Educational Psychology, 1, 102) found support for a bifactor structure with a large sample (N = 794) of Irish children who were administered the 10 WISC-IV(UK) core subtests in clinical assessments of learning difficulties and dominance of general intelligence. Because only 10 subtests were available, Cattell-Horn-Carroll (CHC; McGrew, 1997, 2005, Contemporary intellectual assessment: Theories, tests, and issues, New York, NY: Guilford; Schneider & McGrew, 2012, Contemporary intellectual assessment: Theories, tests,...
The factor structure of the Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V; Wechs... more The factor structure of the Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V; Wechsler, 2014a) standardization sample (N = 2,200) was examined using confirmatory factor analyses (CFA) with maximum likelihood estimation for all reported models from the WISC-V Technical and Interpretation Manual (Wechsler, 2014b). Additionally, alternative bifactor models were examined and variance estimates and model-based reliability estimates (ω coefficients) were provided. Results from analyses of the 16 primary and secondary WISC-V subtests found that all higher-order CFA models with 5 group factors (VC, VS, FR, WM, and PS) produced model specification errors where the Fluid Reasoning factor produced negative variance and were thus judged inadequate. Of the 16 models tested, the bifactor model containing 4 group factors (VC, PR, WM, and PS) produced the best fit. Results from analyses of the 10 primary WISC-V subtests also found the bifactor model with 4 group factors (VC, PR, WM, a...
The present study examined the factor structure of the Differential Ability Scales-Second Edition... more The present study examined the factor structure of the Differential Ability Scales-Second Edition (DAS-II; Elliott, 2007a) standardization sample using exploratory factor analyses, multiple factor extraction criteria, and hierarchical exploratory factor analyses (Schmid & Leiman, 1957) not included in the DAS-II Introductory and Technical Handbook (Elliott, 2007b). Exploratory factor analyses with multiple factor extraction criteria and hierarchical analyses with the Schmid and Leiman (1957) procedure were conducted with the 3 DAS-II standardization samples (Lower Early Years [Ages 2:6-3:5], Upper Early Years [Ages 3:6-6:11], School-Age [Ages 7:0-17:11]). All factor extraction criteria suggested 1 factor despite the author and publisher recommended and promoted 2 (Ages 2:6-3:5) or 3 (Ages 3:6-6:11, Ages 7:0-17:11) factors. Results indicated that most DAS-II subtests were properly associated with the theoretically proposed first-order factors. Hierarchical exploratory analyses with t...
Uploads
Papers by Gary Canivez