Skip Navigation
Skip to contents

JMD : Journal of Movement Disorders

OPEN ACCESS
SEARCH
Search

Articles

Page Path
HOME > J Mov Disord > Volume 16(1); 2023 > Article
Brief communication
Validity and Reliability of the Korean-Translated Version of the International Cooperative Ataxia Rating Scale in Cerebellar Ataxia
Jinse Park1orcid, Jin Whan Cho2,3orcid, Jinyoung Youn2,3orcid, Engseok Oh4orcid, Wooyoung Jang5orcid, Joong-Seok Kim6orcid, Yoon-Sang Oh6orcid, Hyungyoung Hwang1orcid, Chang-Hwan Ryu7orcid, Jin-Young Ahn8orcid, Jee-Young Lee9orcid, Seong-Beom Koh10orcid, Jae H. Park11, Hee-Tae Kim12corresp_iconorcid
Journal of Movement Disorders 2023;16(1):86-90.
DOI: https://doi.org/10.14802/jmd.22137
Published online: December 20, 2022

1Department of Neurology, Inje University Haeundae Paik Hospital, Busan, Korea

2Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea

3Neuroscience Center, Samsung Medical Center, Seoul, Korea

4Department of Neurology, Chungnam National University Hospital, Chungnam National University College of Medicine, Daejeon, Korea

5Department of Neurology, Gangneung Asan Hospital, University of Ulsan College of Medicine, Gangneung, Korea

6Department of Neurology, College of Medicine, The Catholic University of Korea, Seoul, Korea

7Department of Neurology, H+ Yangji Hospital, Seoul, Korea

8Department of Neurology, Seoul Medical Center, Seoul, Korea

9Department of Neurology, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul National University College of Medicine, Seoul, Korea

10Department of Neurology, Korea University Guro Hospital, Korea University College of Medicine, Seoul, Korea

11KoAm Education Alliance, Seoul, Korea

12Department of Neurology, Hanyang University College of Medicine, Seoul, Korea

Corresponding author: Hee-Tae Kim, MD Department of Neurology, Hanyang University College of Medicine, 222-1 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea / Tel: +82-2-2290-8371 / Fax: +82-2-2296-8370 / E-mail: kimht@hanyang.ac.kr
• Received: August 16, 2022   • Revised: September 25, 2022   • Accepted: October 4, 2022

Copyright © 2023 The Korean Movement Disorder Society

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

  • 1,568 Views
  • 92 Download
  • Objective
    The International Cooperative Ataxia Rating Scale (ICARS) is a semiquantitative clinical scale for ataxia that is widely used in numerous countries. The purpose of this study was to investigate the validity and reliability of the Korean-translated version of the ICARS.
  • Methods
    Eighty-eight patients who presented with cerebellar ataxia were enrolled. We investigated the construct validity using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). We also investigated the internal consistency using Cronbach’s α and intrarater and interrater reliability using intraclass correlation coefficients.
  • Results
    The Korean-translated ICARS showed satisfactory construct validity using EFA and CFA. It also revealed good interrater and intrarater reliability and showed acceptable internal consistency. However, subscale 4 for assessing oculomotor disorder showed moderate internal consistency.
  • Conclusion
    This is the first report to investigate the validity and reliability of the Korean-translated ICARS. Our results showed excellent construct and convergent validity. The reliability is also acceptable.
Ataxia is a term for impairment in the coordination of movement and presents as a disorder involving complex multiple functional movements. Due to various clinical presentations, it is difficult to objectively measure the severity of ataxia. The International Cooperative Ataxia Rating Scale (ICARS) was first developed in 1996 and has been widely used for semiquantitative measurement of ataxia [1]. The ICARS is composed of 19 items and 4 subscales for assessing gait and ability to stand, motor function, speech, and eye movements. The ICARS was originally written in English and required translation and validation for use in countries where other languages are spoken [2]. However, there has been no report on the validity and reliability of the Koreantranslated version of the ICARS. As the prevalence of patients with ataxia in Korea has been increasing, it is necessary to validate the Korean-translated version of ICARS.
Translation process
The translation and back translation methods were applied for translation to Korean [3]. The group of translators was composed of two Korean neurologists, one of whom had lived in an English-speaking country for 3 years. The group of back translators was composed of a Korean neurologist and a nonmedical native speaker of English. After backtranslation, all translators reviewed and compared the translated piece to the original version, and any errors were corrected with consideration of Korean cultural differences. The final translated version was supervised by the Korea–US education and cultural exchange association called KoAm Education Alliance (Supplementary Material in the online-only Data Supplement).
Participants
This study was a multicenter cross-sectional study. The inclusion criteria were patients aged 20–80 years who presented with cerebellar ataxia. Exclusion criteria included the presence of 1) other neurological and orthopedic symptoms that affect movement and gait.; 2) severe fall risk, deeming patients unable to undergo ICARS; and 3) fluctuating symptoms within one month.
All participants performed the Korean translated version of the ICARS, Timed Up and Go (TUG) test and the Korean Tinetti mobility test (TMT) [4,5]. Informed consent was obtained from all participants, and this study was approved by the Institutional Review Board (IRB number: HP2021-05-04).
Statistical methods

Validity

For construct and convergent validity, exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were performed. Before performing EFA, the Kaiser–Mayer–Olkin and Bartlett’s tests were used for sampling adequacy. To assist in interpreting the factors, varimax orthogonal rotation was used. Before constructing a common factor model, initial eigenvalues from a screen plot were used as guidelines for deciding the number of factors. Item loading was used with absolute values greater than 0.4 to describe the factors.
For CFA, five model fit indices and their criteria were used to examine the goodness-of-fit. We evaluated the minimum chisquare/degrees of freedom (CMIN/DF), Tucker–Lewis index (TLI), comparative fit index (CFI), standardized root mean square (SRMR), and root mean square error of approximation (RMSEA) as model fit indices. CMIN/DF values below 3, SRMR values below 1.0, RMSEA values below 0.8, and CFI and TLI values above 0.9 were considered to indicate acceptable model adjustment [6]. For concurrent validity, Spearman’s rank correlation coefficient with the TMT, TUG and disease duration was calculated.

Reliability

Cronbach’s alpha coefficient was used to calculate internal consistency. A value above 0.7 was considered good, and above 0.6 was considered moderate [7]. The intraclass correlation coefficient (ICC) was used for intrarater and interrater reliability, and above 0.75 was considered good [8]. For interrater reliability, the test–retest method was used. The two raters facilitated the ICARS at the same time, and one of them performed the ICARS again in the same set of patients within 4 weeks.
Participants
We enrolled 88 patients in 6 different movement clinics in tertiary hospitals in this study. All subjects were Korean, and the mean age was 61.25 years; 56.8% of the participants were men. Causative diseases included multiple system atrophy (53.4%), spinocerebellar ataxia (18.2%), idiopathic cerebellar ataxia (17%), postinfectious cerebellar ataxia (2.3%), and others (15.7%).
Construct and convergent validity
Table 1 shows the factor loading of each item derived from EFA. Subscale 2 has three factors, and a total of six factors were extracted in the ICARS from EFA. The factor loading of each item showed a high correlation with other items that belonged to the same subscale. However, Item 14 under subscale 2 showed a relatively low correlation with other items in the same subscale (0.5), but it showed a high correlation with items in subscale 3. For CFA, all the fit indices were satisfactory: CMIN/DF = 1.519, TLI = 0.908, CFI = 0.924, SRMR = 0.694, and RMSEA = 0.77.
Criterion validity
Concurrent validity was used for the criterion validity. The total score of the ICARS was significantly correlated with the scores of TMT (r = -0.695, p < 0.01) and TUG (r = -0.308, p < 0.01), indicating high concurrent validity of the total score of ICARS. Subscales 1, 2, and 3 were significantly correlated with TMT (r = -0.820, p < 0.01; r = -0.428, p < 0.01; r = -0.361, p < 0.01, respectively). However, only subscale 1 had a significant positive correlation with TUG (r = 0.621, p < 0.01). The total ICARS score showed a significant correlation with disease duration (r = 0.251, p = 0.02). Subscale 3 was significantly correlated with disease duration (r = 0.280, p < 0.01).
Reliability
Table 2 shows the results of the evaluation of the reliability. Cronbach’s alpha coefficient for the total ICARS score was 0.907, indicating sufficient reliability. Cronbach’s alpha coefficients of subscales 1, 2, and 3 were acceptable (0.916, 0.837, 0.838, respectively); however, that of subscale 4 showed a relatively lower value (0.654). The interrater ICC of the total ICARS score was 0.96, and the intrarater ICC of the total ICARS score was 0.98. Subscale 1 had the highest reliability, while subscale 4 showed the lowest reliability despite an acceptable range.
In our results, the Korean-translated version of the ICARS showed acceptable validity and reliability. There have been two commonly used scales for patients with ataxia, including the Scale for the Assessment and Rating of Ataxia (SARA) and ICARS. Only one report on SARA has been translated into the Korean language and has been validated in stroke patients [9]. There are still no clinical scales applicable for Korean-speaking individuals for cerebellar ataxia except in cases of stroke.
After applying EFA to investigate the factorial structure, the number of factors was 6, with eigenvalues greater than 1 even if the ICARS was composed of 4 subscales. The validation study of English ICARS in SCA revealed that 4 factors had eigenvalues greater than 1 [10]. However, some previous studies have often reported more than 4 factors in factor analysis. The validation study of ICARS in focal cerebellar lesions revealed 5 extracted factors with eigenvalues greater than 1 [11]. In another study, the Turkish version of the ICARS in multiple sclerosis also extracted 5 factors in principal component analyses [12]. Subscale 2 is an assessment of kinetic function that measures movement of the upper and lower extremities. Therefore, factor loadings are grouped according to the movement of body parts, including the lower extremities, arm, and fingers.
Previous studies on the convergent validity of the ICARS have shown inconsistent results [13,14]. In our study, Item 14, which measures the drawing skill of the Archimedes loop, showed relatively low association with other items under subscale 2 in EFA. Similar results regarding Item 14 as a hindrance factor for validity have been reported in previous studies [11]. We postulate several limitations of Item 14 that might cause this result. First, the size of the Archimedes loop can affect the drawing performance; however, there are no exact descriptions of the size of the Archimedes loop in ICARS. Second, a Korean word for “hypermetric swerve” was not often used; therefore, this may be unfamiliar to Korean-speaking individuals.
The English version of the ICARS has been proven to have excellent reliability [15]. Cronbach’s alpha coefficient and ICC for assessing the reliability of total ICARS scores revealed acceptable internal reliability in our results. However, Cronbach’s alpha coefficient and the ICC score of subscale 4 were lower than those of the other subscales despite a moderate range of internal consistency. These findings are also often reported in other reports, suggesting an inherent limitation of ICARS itself and not the translation process [10,13]. It is difficult to quantitatively estimate eye movement by observation because subtle differences in ocular dysfunction can be influenced by the subjective judgment of the observer.
This study has several limitations. First, we only analyzed correlations with scales of gait for concurrent validity. Overall assessment of daily function, such as the modified Barthel index, could not be measured for concurrent validity. Additionally, we could not evaluate other ataxia scales, such as SARA, because there are no validated Korean-translated versions of these scales. Second, our data collection was limited to the clinical symptoms of cerebellar ataxia in patients and not specific diseases.
In conclusion, the Korean-translated version of the ICARS showed excellent validity and reliability for cerebellar ataxia. Although some hindrance factors were identified, these results have often been reported as limitations of the ICARS itself. Our study makes it possible to apply the ICARS to Korean-speaking patients with ataxia in clinical and research settings.
The online-only Data Supplement is available with this article at https:// doi.org/10.14802/jmd.22137.
We would like to show our gratitude to Dr. Ji Min Choi and Soo Hyun Lim for their comments that greatly improved our manuscript.

Conflicts of Interest

The authors have no financial conflicts of interest.

Funding Statement

This study was supported by Corestem Inc.

Author contributions

Conceptualization: Hee-Tae Kim, Joong-Seok Kim. Data curation: Chang- Whan Ryu, Jinse Park, Yoon-Sang Oh. Formal analysis: Wooyoung Jang, Engseok Oh. Funding acquisition: Seong-Beom Koh, Hee-Tae Kim. Investigation: Jee-Young Lee. Methodology: Jinse Park, Hyungyoung Hwang. Project administration: Jin-Young Ahn, Jinse Park. Resources: Jin Whan Cho. Supervision: Jae H. Park. Validation: Jinyoung Youn. Writing—original draft: Jinse Park. Writing—review & editing: Hee-Tae Kim.

Table 1.
Factor lording in all items in exploratory factor analysis
Factors Variables Factor loading
I. Posture and gait disturbances II. Kinetic functions II. Kinetic functions III. Speech disorders IV. Oculomotor disorders II. Kinetic functions
I. Posture and gait disturbances 1. Walking capacities 0.83 0.14 0.27 0.07 -0.06 0.17
2. Gait speed 0.82 0.20 0.06 -0.05 -0.16 0.16
3. Standing capacities, eyes open 0.82 0.21 0.12 0.22 -0.01 0.04
4. Spread of feet in natural position without support, eyes open 0.72 0.31 0.16 0.17 0.17 0.16
5. Body sway with feet together, eyes open 0.89 0.10 0.08 0.15 0.09 0.03
6. Body sway with feet together, eyes closed 0.84 0.04 0.07 0.15 0.10 0.06
7. Quality of sitting position 0.57 0.11 0.33 0.30 0.12 -0.26
II. Kinetic functions 8. Knee-tibia test: decomposition of movement and intention tremor (Right) 0.19 0.16 0.84 0.22 0.09 0.13
8. Knee-tibia test: decomposition of movement and intention tremor (Left) 0.24 0.16 0.85 0.18 0.03 0.15
9. Action tremor in the heel-to-knee test (Right) 0.12 0.30 0.84 -0.01 0.23 0.09
9. Action tremor in the heel-to-knee test (Left) 0.15 0.30 0.81 0.06 0.19 -0.03
10. Finger-to-nose test: decomposition and dysmetria (Right) 0.22 0.77 0.25 0.30 0.30 -0.07
10. Finger-to-nose test: decomposition and dysmetria (Left) 0.15 0.78 0.19 0.31 0.29 -0.04
11. Finger-to-nose test: intention tremor of the finger (Right) 0.17 0.87 0.21 0.02 -0.01 0.20
11. Finger-to-nose test: intention tremor of the finger (Left) 0.18 0.87 0.19 0.06 0.04 0.15
12. Finger-finger test: action tremor and/or instability (Right) 0.17 0.65 0.12 0.16 0.08 0.23
12. Finger-finger test: action tremor and/or instability (Left) 0.14 0.67 0.19 0.13 0.15 0.28
13. Pronation-supination alternating movements (Right) 0.17 0.29 0.18 0.19 0.12 0.85
13. Pronation-supination alternating movements (Left) 0.18 0.31 0.10 0.30 0.12 0.81
14. Drawing of the Archimedes’ spiral on a predrawn pattern 0.17 0.18 0.22 0.50 -0.21 0.12
III. Speech disorders 15. Dysarthria: fluency of speech 0.28 0.15 0.07 0.83 0.13 0.15
16. Dysarthria: clarity of speech 0.16 0.24 0.11 0.80 0.02 0.19
IV. Oculomotor disorders 17. Gaze-evoked nystagmus 0.06 0.07 0.02 -0.06 0.79 -0.08
18. Abnormalities of the ocular pursuit 0.02 0.20 0.17 0.10 0.75 0.15
19. Dysmetria of the saccade 0.00 0.18 0.29 -0.01 0.61 0.24
Eigen value 9.92 3.02 1.99 1.52 1.36 1.19
Variance Explanatory power (%) 39.69 12.09 7.95 6.07 5.44 4.75
Cumulative variance (%) 39.69 51.78 59.73 65.80 71.25 76.00
KMO: 0.824, Barlett’s test of sphericity test χ2 = 1,964.525, p < 0.001

KMO, Kaiser‒Mayer‒Olkin.

Table 2.
Crohnbach’s α coefficient for internal consistency and ICC for reliability
Classification Internal consistency
Inter-rater reliability (n = 83)
Intra-rater reliability (n = 39)
Cronbach’s α ICC (95% CI) p ICC (95% CI) p
I. Posture and gait disturbances 0.916 0.982 (0.972–0.988) < 0.001 0.976 (0.955–0.987) < 0.001
II. Kinetic functions 0.837 0.943 (0.906–0.964) < 0.001 0.940 (0.889–0.968) < 0.001
III. Speech disorders 0.838 0.849 (0.765–0.903) < 0.001 0.967 (0.938–0.982) < 0.001
IV. Oculomotor disorders 0.654 0.765 (0.587–0.859) < 0.001 0.938 (0.886–0.967) < 0.001
Total International Cooperative Ataxia Rating Scale 0.907 0.962 (0.941–0.976) < 0.001 0.979 (0.960–0.989) < 0.001

ICC, intraclass correlation coefficient; CI, confidence interval.

  • 1. Trouillas P, Takayanagi T, Hallett M, Currier RD, Subramony SH, Wessel K, et al. International Cooperative Ataxia Rating Scale for pharmacological assessment of the cerebellar syndrome. The Ataxia Neuropharmacology Committee of the World Federation of Neurology. J Neurol Sci 1997;145:205–211.PubMed
  • 2. Maggi FA, Braga-Neto P, Chien HF, Gama MTD, Rezende Filho FM, Saraiva-Pereira ML, et al. Cross-cultural adaptation and validation of the International Cooperative Ataxia Rating Scale (ICARS) to Brazilian Portuguese. Arq Neuropsiquiatr 2018;76:674–684.ArticlePubMed
  • 3. Ozolins U, Hale S, Cheng X, Hyatt A, Schofield P. Translation and backtranslation methodology in health research - a critique. Expert Rev Pharmacoecon Outcomes Res 2020;20:69–77.ArticlePubMed
  • 4. Beauchet O, Fantino B, Allali G, Muir SW, Montero-Odasso M, Annweiler C. Timed up and go test and risk of falls in older adults: a systematic review. J Nutr Health Aging 2011;15:933–938.ArticlePubMedPDF
  • 5. Park J, Koh SB, Kim HJ, Oh E, Kim JS, Yun JY, et al. Validity and reliability study of the Korean Tinetti mobility test for Parkinson’s disease. J Mov Disord 2018;11:24–29.ArticlePubMedPMCPDF
  • 6. Shi D, Lee T, Maydeu-Olivares A. Understanding the model size effect on SEM fit indices. Educ Psychol Meas 2018;79:310–334.ArticlePubMedPMCPDF
  • 7. Taber KS. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ 2018;48:1273–1296.ArticlePDF
  • 8. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016;15:155–163.ArticlePubMedPMC
  • 9. Kim BR, Lee JY, Kim MJ, Jung H, Lee J. Korean version of the scale for the assessment and rating of ataxia in ataxic stroke patients. Ann Rehabil Med 2014;38:742–751.ArticlePubMedPMC
  • 10. Schmitz-Hübsch T, Tezenas du Montcel S, Baliko L, Boesch S, Bonato S, Fancellu R, et al. Reliability and validity of the International Cooperative Ataxia Rating Scale: a study in 156 spinocerebellar ataxia patients. Mov Disord 2006;21:699–704.ArticlePubMed
  • 11. Schoch B, Regel JP, Frings M, Gerwig M, Maschke M, Neuhäuser M, et al. Reliability and validity of ICARS in focal cerebellar lesions. Mov Disord 2007;22:2162–2169.ArticlePubMed
  • 12. Salcı Y, Fil A, Keklicek H, Çetin B, Armutlu K, Dolgun A, et al. Validity and reliability of the International Cooperative Ataxia Rating Scale (ICARS) and the Scale for the Assessment and Rating of Ataxia (SARA) in multiple sclerosis patients with ataxia. Mult Scler Relat Disord 2017;18:135–140.ArticlePubMed
  • 13. Cano SJ, Hobart JC, Hart PE, Korlipara LV, Schapira AH, Cooper JM. International Cooperative Ataxia Rating Scale (ICARS): appropriate for studies of Friedreich’s ataxia? Mov Disord 2005;20:1585–1591.ArticlePubMedPDF
  • 14. Perez-Lloret S, van de Warrenburg B, Rossi M, Rodríguez-Blázquez C, Zesiewicz T, Saute JAM, et al. Assessment of ataxia rating scales and cerebellar functional tests: critique and recommendations. Mov Disord 2021;36:283–297.ArticlePubMedPDF
  • 15. Storey E, Tuck K, Hester R, Hughes A, Churchyard A. Inter-rater reliability of the International Cooperative Ataxia Rating Scale (ICARS). Mov Disord 2004;19:190–192.ArticlePubMed

Figure & Data

References

    Citations

    Citations to this article as recorded by  

      Comments on this article

      Add a comment

      JMD : Journal of Movement Disorders Twitter