The Social Responsiveness Scale in Relation To DSM IV and DSM5 ASD in Korean Children
The Social Responsiveness Scale in Relation To DSM IV and DSM5 ASD in Korean Children
The Social Responsiveness Scale (SRS) is an autism rating scales in widespread use, with over 20 official foreign language
translations. It has proven highly feasible for quantitative ascertainment of autistic social impairment in public health
settings, however, little is known about the validity of the reinforcement in Asia populations or in references to DSM5.
The current study aims to evaluate psychometric properties and cross-cultural aspects of the SRS-Korean version (K-
SRS).The study subjects were ascertained from three samples: a general sample from 3 regular education elementary
schools (n=790), a clinical sample (n=154) of 6–12-year-olds from four psychiatric clinics, and an epidemiological sam-
ple of children with ASD, diagnosed using both DSM IV PDD, DSM5 ASD and SCD criteria (n=151). Their parents com-
pleted the K-SRS and the Autism Spectrum Screening Questionnaire(ASSQ). Descriptive statistics, correlation analyses
and principal components analysis (PCA) were performed on the total population. Mean total scores on the K-SRS dif-
fered significantly between the three samples. ASSQ scores were significantly correlated with the K-SRS T-scores. PCA
suggested a one-factor solution for the total population.Our results indicate that the K-SRS exhibits adequate reliability
and validity for measuring ASD symptoms in Korean children with DSM IV PDD and DSM5 ASD. Our findings further
suggest that it is difficult to distinguish SCD from other child psychiatric conditions using the K-SRS.This is the first
study to examine the relationship between the SRS subscales and DSM5-based clinical diagnoses. This study provides
cross-cultural confirmation of the factor structure for ASD symptoms and traits measured by the SRS. Autism Res
2016, 00: 000–000. V C 2016 International Society for Autism Research, Wiley Periodicals, Inc.
Keywords: Korean social responsiveness scale; validity; reliability; DSM IV PDD; DSM5 ASD
From the Division of Child and Adolescent Psychiatry, Department of Psychiatry & Institute of Behavioral Science in Medicine, Yonsei University
College of Medicine, Seoul, Korea (K.A.C., J.I.P.,); The Korea Institute for Children’s Social Development and Rudolph Child Research Center, Seoul,
South Korea (Y.-J.K., E.-C.L.,); Department of Psychiatry, Ilsan Hospital, National Health Insurance Corporation, Goyang, South Korea (J.S.,); Depart-
ment of Psychiatry & Suicide and School Mental Health Institute, Hallym University College of Medicine, Sacred Heart Hospital, Anyang, Korea (H.-J.H.,);
Yonsei Bom Private Psychiatric Clinic (Y.-K.K.,); Department of Preventive Medicine, Environmental Health Center (Neurodevelopment), Dankook
University College of Medicine, Cheonan, South Korea (H.K., M.H.,); Department of Psychiatry, Environmental Health Center (Neurodevelopment),
Dankook University College of Medicine, Cheonan, South Korea (M.-H.L., K.-C.P.,); Department of Psychiatry, Washington University School of
Medicine, St. Louis, Washington (J.N.C.,); Department of Psychiatry, School of Medicine, University of California, San Francisco, California (B.L.,
Y.S.K.,); Department of Psychiatry, Yonsei University College of Medicine, Seoul, South Korean (B.L., Y.S.K.)
Received May 22, 2015; accepted for publication June 20, 2016
Address for correspondence and reprints: Young Shin Kim, Department of Psychiatry, School of Medicine, University of California, San Francisco,
Langley Porter Psychiatric Institute, LP-377, 401 Parnassus Avenue, Box 0984, San Francisco, CA, 94143-0984. E-mail: [email protected]
Published online 00 Month 2016 in Wiley Online Library (wileyonlinelibrary.com)
DOI: 10.1002/aur.1671
C 2016 International Society for Autism Research, Wiley Periodicals, Inc.
V
General sample Clinical Sample DSMIV PDD DSM5 ASD DSM5 SCD
(n 5 790) (n 5 154) (n 5 151) (n 5 133)c (n 5 20)c
M F M F M F M F M F
Sex (n 5 412) (n 5 378) (n 5 118) (n 5 36) (n 5 119) (n 5 32) (n 5 107) (n 5 26) (n 5 11) (n 5 9)
Age /mean 9.08(1.70) 9.13(1.74) 9.42(2.50)b 10.76(3.03)b 10.31(1.74) 10.20(1.92) 10.19(1.70) 10.77(1.90) 10.27(1.70) 10.89(1.76)
(S.D)
K-SRS raw score [K-SRS T-score] /Mean (S.D.)
AWAa 6.89(2.84) 6.26(3.09) 7.53(3.30) 7.17(3.01) 9.63(3.93) 8.69(3.05) 9.91(3.84) 8.92(3.30) 7.91(3.59) 6.78(1.72)
[51.02(9.55)]b [48.89(10.37)]b [53.15(11.09)] [51.94(9.55)] [60.21(13.21)] [57.05(10.25)] [61.14(12.90)] [57.84(11.07)] [54.43(12.05)] [50.64(5.76)]
COGa 8.03(4.39) 7.48(4.34) 9.19(6.10) 10.64(6.87) 15.69(6.98) 13.81(4.90) 16.40(6.77) 14.27(4.86) 9.36(4.97) 8.56(6.29)
[50.60(10.04)] [49.35(9.92)] [53.25(13.94)] [53.25(13.94)] [68.14(15.97)] [63.84(11.20)] [69.77(15.49)] [64.89(11.13)] [53.66(11.36)] [51.81(14.40)]
COMMa 10.81(6.35) 9.46(6.22) 15.18(9.28) 17.28(12.42) 25.66(12.47) 25.00(10.77) 26.82(12.00) 26.62(10.82) 15.18(10.93) 14.00(8.62)
[51.02(10.05)]b [48.89(9.84)]b [57.93(14.67)] [61.25(19.64)] [74.51(19.72)] [73.47(17.04)] [76.36(18.99)] [76.03(17.12)] [57.94(17.30)] [56.07(13.63)]
MOTa 5.98(3.30) 6.05(3.21) 7.31(5.03) 9.25(5.56) 12.25(5.51) 13.60(5.55) 12.51(5.60) 14.12(4.64) 9.36(4.46) 8.22(8.30)
[49.89(10.13)] [50.12(9.87)] [53.97(15.44)]b [59.94(17.07)]b [69.16(16.94)] [73.28(17.03)] [69.97(17.19)] [74.88(14.26)] [60.29(13.68)] [56.79(25.50)]
MANN (RRBI)a 3.08(3.38) 2.44(2.83) 6.56(5.66) 8.47(6.98) 11.92(6.97) 11.47(5.68) 12.54(6.93) 12.65(5.49) 5.82(3.54) 4.56(3.58)
[50.97(10.76)]b [48.95(9.00)]b [62.04(18.02)] [68.12(22.21)] [79.08(22.16)] [77.66(18.07)] [81.07(22.05)] [81.43(17.47)] [59.68(11.28)] [55.66(11.70)]
SCIa 31.71(14.82) 29.25(14.66) 39.19(21.31) 44.33(25.52) 63.23(25.80) 61.09(21.05) 65.64(24.85) 63.92(20.41) 41.82(22.48) 37.56(23.72)
[50.63(8.55)]b [49.31(8.55)]b [54.58 (12.17)] [57.43(14.05)] [68.00(14.31)] [66.91(11.72)] [69.31(13.81)] [68.41(11.23)] [56.58(12.63)] [53.82(14.02)]
K-SRS total scorea 34.79(17.21) 31.69(16.44) 55.16(22.88) 63.32(28.49) 75.14(31.81) 72.56(25.93) 78.19(30.78) 76.58(25.23) 50.80(24.52) 55.17(23.20)
[50.88(10.18)]b [49.05(9.72)]b [62.93(13.53)] [67.76(16.85)] [74.75(18.82)] [73.22(15.34)] [76.55(18.21)] [75.60(14.92)] [60.35(14.50)] [62.93(13.72])
INSAR
to complete the questionnaire), the Korean version of were performed using IBM SPSS version 20 (IBM Korea
SRS (K-SRS) was administered to a sample of parents Inc., Seoul, Korea) for Windows.
who visited the clinics (N 5 5). Once this process was
completed and reviewed for adequate performance, the
Results
instrument was released for use in this study. Demographic Characteristics and the K-SRS Scores in Study
ASSQ [Ehlers, Gillberg, & Wing, 1999]: The ASSQ, Samples
composed of 27 items, measures social interaction,
communication problems, restricted and RRB, motor While there were no significant differences in mean age
clumsiness, and associated features. The ability of the among the three study samples, children with ASD were
ASSQ to distinguish autism from other diagnoses is slightly older. Sex distribution in the general sample was
well-established with cutoff scores of 13 for parent rat- even, whereas more males were present in both the clinical
ings and 11 for teacher ratings in European children sample and the epidemiological sample of ASD (Table 1).
[Ehlers et al., 1999].The ASSQ was translated and back- The mean scores for the verbal IQ, the performance IQ and
translated by the investigators, and adequate psycho- the full scale IQ (FSIQ) for the clinical sample and epidemi-
metric properties were demonstrated in Korean children ological ASD sample were 94.4 6 17.4, 93.5 6 17.5, and
from the Korean epidemiological study (n 5 22,660) 92.6 6 17.1, respectively, and 101.1 6 23.8, 95.1 6 22.1,
[Yim, 2012]. Parents from all three study samples com- and 98.2 6 24.4, respectively.
pleted the ASSQ. Mean total raw and T- scores for the K-SRS differed
Cognitive tests: To assess cognitive levels, the significantly in the three study samples. The total scores
Korean-Wechsler Intelligence Scale for Children-III along with all five subscales and two DSM5 subscales
(K-WISC-III) was used for verbal children and Leiter (SCI and RRBI) were highest in the epidemiological ASD
International Performance Scale-Revised was used for sample, followed by the clinical sample; they were low-
those children with difficulty understanding verbal est in the general sample (Table 1). Figure 1 depicts the
instructions. The K-WISC-III and Leiter were used to distributions the T-scores of the K-SRS for each of the
measure cognitive function of the subjects in both the three samples. It shows that the K-SRS scores are nor-
clinical and ASD samples. mally distributed, both in males and females, in the
general sample. The age of the subjects did not influ-
ence the K-SRS scores in the three study samples. Gen-
Statistical Analyses
der affected the scores for social awareness, the
Means and standard deviation (SD) of the K-SRS raw communication subscale, the autistic mannerism
scores and T-scores of five subscales, SCI
(AWA 1 COG 1 COMM 1 MOT) and total scores were
compared among the three study samples using Multi-
variate Analysis of Variance (MANOVA). Internal con-
sistency for the K-SRS total scores was examined by the
item reliability statistics, and Cronbach’s a was calculat-
ed for the three study samples. We also performed cor-
relation analyses between the scores of the K-SRS,
performance IQ, and the ASSQ completed by the
parents in our study samples. After K-SRS norm data
were established in Korean children using the general
population sample (n 5 790), T-score (a standardized Z
score scaled to have a mean of 50 and a standard devia-
tion of 10) [Larsen & Marx, 2011] was computed for the
clinical sample and the epidemiological samples of
ASD. We compared the T-scores from the K-SRS and the
ASSQ (completed by the parents) total scores for chil-
dren with several clinical disorders in the clinical sam-
ple, using one-way Analysis of Variance (ANOVA).
Principal components analysis (PCA) was performed to
examine the factor structure of the autistic trait data.
T-scores and cutoff scores for ASD diagnoses were Figure 1. Distribution of the T-scores of the K-SRS for each of
compared between those from the K-SRS and the SRS to three samples (n 5 1,095) Kernel Density: the local relative fre-
examine cross-cultural comparability. Statistical analyses quency or density of points along the number line of a plot.
AWA GEN 1
CLI 1
EPI 1
COG GEN 0.62 1
CLI 0.64 1
EPI 0.58 1
COMM GEN 0.64 0.78 1
CLI 0.71 0.83 1
EPI 0.58 0.76 1
MOT GEN 0.48 0.66 0.70 1
CLI 0.41 0.57 0.70 1
EPI 0.31 0.51 0.65 1
MANN (RRBI) GEN 0.30 0.57 0.63 0.54 1
CLI 0.61 0.78 0.80 0.61 1
EPI 0.44 0.68 0.79 0.60 1
SCI GEN 0.76 0.90 0.94 0.81 0.62 1
CLI 0.76 0.89 0.97 0.78 0.83 1
EPI 0.69 0.87 0.95 0.75 0.79 1
K-SRS total GEN 0.72 0.89 0.94 0.81 0.73 0.99 1
CLI 0.75 0.90 0.96 0.76 0.89 0.99 1
EPI 0.65 0.86 0.95 0.74 0.87 0.99 1
Cronba-ch’s Alpha GEN 0.80 0.76 0.72 0.78 0.79 0.79 0.81
CLI 0.81 0.77 0.71 0.80 0.77 0.80 0.88
EPI 0.81 0.77 0.70 0.79 0.76 0.79 0.86
subscale and the total score of the K-SRS, in the general the T-scores of the K-SRS in three samples was shown in
sample. In the clinical sample, the social motivation Figure 2. The K-SRS T-score was not correlated with the IQ
subscale of the K-SRS differed significantly by gender. score, except for a minimal negative correlation with the
However, gender did not significantly affect the scores performance IQ (PIQ) score. When the subjects were
of five subscales and the total scores of the K-SRS in the divided into two groups, according to the presence/
epidemiological ASD sample (Table 1). absence of intellectual disability (ID: cutoff IQ 70), mod-
est but significant correlations were detected between
Internal Consistency of the K-SRS
communication, motivation and total scores on the K-SRS
The item reliability ranged from 0.30 to 0.99 in three and PIQ, only in the subjects with ID (Table 3).
samples. Except the MANN-AWA subscales in general
sample, and the MOT-AWA subscales in epidemiologi-
Comparisons of Means for K-SRS T Scores Across Diagnostic
cal ASD sample (0.30 and 0.31), the reliability test
Categories in the Clinical Sample
scored fair to excellent among majority of the K-SRS
items (Table 2). Additionally, Cronbach’s Alphas for the Means of the K-SRS T-scores did not differ significantly by
total items for general, clinical and epidemiological diagnostic categories (ADHD, depressive disorder, anxiety
ASD sample, based on standardized items, were 0.81, disorder and tic disorder) in the clinical sample (n 5 154),
0.88 and 0.86, respectively: those for the subscales of while there were significant differences between the clini-
the K-SRS were demonstrated in Table 2. cal sample, the epidemiological sample of children with
ASD, and the general sample. The mean scores of the K-
Correlation Between the Scores of the K-SRS, IQ and ASSQ
SRS total T-scores in ADHD (n 5 72), depressive disorder
The total score of the ASSQ, completed by the parents, (n 5 10), anxiety disorder (n 5 13), and tic disorder (n 5 14)
was significantly associated with the total T-scores of the were 64.5, 67.2, 64.6, and 57.4, respectively. The K-SRS
K-SRS in the entire study sample. The correlation scatter mean scores for each clinical diagnosis were significantly
plot between the ASSQ scores assessed by the parents and different from the mean score in the epidemiological
sample of children with ASD (74.5, n 5 151) (P < 0.01, SRS total raw scores were 52 and 48 at T-score of 60 (indi-
comparison by one-way ANOVA). cating clinically significant deficiencies in reciprocal social
behaviors). The K-SRS total raw scores in males and
The Proportion of Confirmed ASD Cases Exceeding Specific
K-SRS T-Score Cutoff in the Epidemiologic ASD Sample females were 79 and 75 at T-score of 76 (strongly associat-
ed with a clinical diagnosis of ASD) (See Supporting Infor-
Among the children who were ASSQ screen positive, mation Appendix 1 & 2). The raw scores in the Korean
the proportion of the confirmed ASD cases (DSM IV population were similar to those for the SRS in the US
PDD and DSM5 ASD) exceeding K-SRS total T-Score population at T-score less than 60; differences appeared in
thresholds at different cut-off points of 55, 60, 65, 70, males at higher T-scores. For example, raw scores in Kore-
75, 80, and 85, by sex, in the epidemiologic sample is an and US males at a T-score of 76 were 79 and 88, respec-
displayed in Table 4. They were 84, 77, 66, 56, 48, 37, tively. Percentages of confirmed ASD diagnoses at a given
and 30%, respectively for males, and 88, 81, 66, 50, 44, raw score cutoff scores were higher for the K-SRS when
28, and 22%, respectively, for females. compared to those in SRS: 92.3 versus 87.9%, respectively
Factor Structure of the K-SRS Data at raw score 55, and 92.3 versus 80.4% at raw score 60.
When K-SRS raw scores in males and females were com-
PCA suggested a one-factor solution for the 1,095 children pared to those from the SRS (70 for males and 65 for
in the general sample, the clinical sample and epidemio- females) they were 64 and 66, respectively. K-SRS raw
logical sample of children with ASD (Table 5.) When 20 scores of 52 in males and 51 in females achieved sensitivi-
items with the factor loadings <0.400 were excluded, the ty and specificity of 0.80 and 0.76, respectively, and 0.92
first component explained 78.1% of variance in the SRS and 0.87, respectively.
scores for the Korean sample, which is consistent with the
original US data, German data for child psychiatric
patients and Japanese data for school children. Discussion
Comparisons of Norm and Cutoff Scores for ASD Diagnoses
This study examined the psychometric properties of the
Between K-SRS and SRS
K-SRS in relation to DSM IV and DSM-5 ASD in a study
K-SRS total raw scores for males and females were 35 and population comprised of three informative samples. We
31, respectively, at K-SRS T-scores of 50 and 52, while K- also examined the relationship between DSM-5 subscales,
a
Correlation is significant at the 0.01 level by Pearson correlation analysis; AWA, Social Awareness; COG, Social Cognition; COMM, Social Communi-
cation; MOT, Social Motivation; MANN, Autistic Mannerism; RRBI, Restricted interests & Repetitive Behaviors Index; SCI, Social Communication Index
(AWA1COG1COMM1MOT); FSIQ, Full-scale IQ; VIQ, Verbal IQ; PIQ, Performance IQ.
Table 4. The Proportion of Confirmed ASD Cases Exceeding epidemiologically-ascertained ASD sample, including the
Specific K-SRS T-Score Cutoff in the Epidemiologic Sample individuals with DSM IV PDD and DSM-5 ASD, followed
by the clinical sample, and then the general sample.
DSM IV PDD DSM5 ASD
(n 5 151) (n 5 133) These findings are consistent with the initial reports on
SRS psychometric properties by the developers [Constan-
K-SRS T-score % of total % of total tino, Przybeck, Friesen, & Todd, 2000]. The validity of K-
Subjects cutoff subjects subjects
SRS was further supported by the significant correlations
Male 55 84.0 87.9 with the total score of the ASSQ, an established ASD
60 76.5 80.4 screening instrument that is used in community and
65 66.4 70.1
70 55.5 58.9
clinical settings in Korea [Yim, 2012] and Europe [Ehlers
75 47.9 51.4 et al., 1999] and the fact that K-SRS means differed across
80 37.0 39.3 children with ASD and children with other forms of
85 30.3 32.7 developmental psychopathology, such as ADHD, depres-
Female 55 87.5 92.3
sive disorder and anxiety disorder. There was a nominally
60 81.3 92.3
65 65.6 73.1 negative correlation between performance IQ (PIQ) and
70 50.0 53.8 the K-SRS among individuals with intellectual disability
75 43.8 46.2 (ID), whereas no correlation was observed among those
80 28.1 30.8
without ID. This supports the notion that the ASD
85 21.9 26.9
Total 55 84.8 88.7 screening capacity for the K-SRS is not likely to be affect-
60 77.5 82.7 ed by the subjects’ intellectual function, especially in
65 66.2 70.7 cognitively intact children with ASD. However, for the K-
70 54.3 57.9
SRS to be recommended as a screener in either clinical
75 47.0 50.4
80 35.1 37.6 practice or research, further work needs to be done to
85 28.5 31.6 develop and test appropriate cutpoints.
Along with the reports from Taiwanese and Japanese
DSM IV PDD, Subjects with Pervasive Developmental Disorder diag-
populations, our findings in Korean children provide
nosed by DSM IV criteria; DSM5 ASD, Subjects with Autism Spectrum
Disorder by DSM 5 criteria. further cross-cultural validation of ASD symptoms.
There have been suggestions in both the lay and scien-
including two subscales, for example, Social Communica- tific communities that the accurate diagnosis and iden-
tion Index (SCI) and Restrictive and Repetitive Behaviors tification of ASD symptoms can be jeopardized by
Index (RRBI), derived from the SRS and clinical diagnosis. cultural biases with respect to the diagnosis of ASD,
The study confirmed the one-factor structure of autistic especially for Asian children, [Kamio et al., 2013; Wang
symptoms and traits as measured by the K-SRS in these et al., 2012]. These conclusions are apparently based on
Korean samples. However, internal consistency and the the untested and unproven assumptions that the pur-
item reliability of the K-SRS were only poor to good in ported deferential attitude of Asian children, such as
the three samples. K-SRS scores were most elevated in the poor eye contact or directed facial expression, cannot
b)
Total combined sample
(n 5 1,095)
Component Total % of variance Cumulative %
be distinguished from symptoms of ASD [Kim, in sub- Surveillance Year 2010 Principal Investigators, 2014;
mission].Therefore, this cross-cultural validation of ASD Kim et al., 2011; Zablotsky, Black, Maenner, Schieve, &
symptoms and ASD assessment tools bears particular Blumberg, 2015], observed discrepancies in the SRS raw
pertinence to the interpretation of increasing preva- scores between Korean and US children may reflect cul-
lence of ASD and integration of the research findings in tural differences in US and Korean parental reporting of
ASD, across various ethnics/racial groups and cultures. their children’s behaviors [Crijnen, Achenbach, & Ver-
The K-SRS norm scores established in this study pro- hulst, 1999]; that is, Korean parents may underreport
vide two interesting findings: (1) A K-SRS raw score at their children’s social problems compared to the
mean T-score (50) was similar to that in SRS in the US parents in the US. It has been hypothesized that Korean
population for both males and females; and (2), K-SRS parents are reluctant to report their children’s behavior
raw scores at higher T-score (79) was lower than that problems due to especially negative societal stigma
(88) on the SRS for males, but not in females [Constan- related to having behavior and emotional problems
tino & Gruber, 2012]. Similar findings have been [Chung et al., 2013]. In addition, such cultural differ-
reported in cross-cultural comparison studies that ences in the parental reports were more prominent in
included the assessment of children’s behavior prob- boys than in girls in our study: such gender differences
lems. In a study using the ADHD Rating Scale (ARS) in have been reported in other Asian cultures [Chao &
Korean children, the raw scores from the Korean Teach- Tseng, 2002]. In order to minimize such sex-based cul-
er reports on the ARS, in a general sample, were lower tural bias in identifying behavioral/social difficulties in
than those reported for American children [Kim et al., children, use of sex-based standardized cut-off scores
2003]. In a multi-cultural comparison study of the (such as sex-based T score), rather than raw cut-off
CBCL in preschool children, mean Total Problem Scores scores is recommended across different cultures.
for Korean children ranked 4th from the bottom among The K-SRS data indicate rather low specificity to dis-
24 countries and lowest for DSM-IV Oppositional Defi- tinguish individuals with SCD from those with other
ant Disorder [Rescorla et al., 2011]. Other studies have child psychiatric conditions, whereas it is useful to dis-
reported that Korean parents report fewer problems in tinguish them from typically developing children. This
their offspring on the CBCL-internalizing and external- may partially result from the way SCD diagnoses were
izing behavior scales than do parents from the US made for the clinical sample; they were based on clini-
[Chung et al., 2013]or Australia [Oh, Shin, Moon, Hud- cal diagnoses rather than using semistructured or struc-
son, & Rapee, 2002]. Since there is no evidence of prev- tured diagnostic interviews. The usefulness of the SRS
alence differences between US and South Korea [Autism for differentiating SCD from other child psychiatric dis-
and Developmental Disabilities Monitoring Network orders warrants further investigation.