MATERIALS & METHODS

This is a cross-sectional observational study. The primary goal was to evaluate the reliability and validity of the Korean version of the TMT in patients with PD. The secondary goal was to identify the most accurate TMT cutoff value for predicting falls in patients with PD. This study was approved by Interstitial Review Board in Haeundae Paik Hospital (IRB No. 2016-04-024).

Subjects

Twenty-four patients diagnosed with PD according to the Queen Square Brain Bank criteria [10] at three different hospitals were enrolled in this study. The inclusion criteria were as follows: 1) PD patients who complained of gait disturbance and postural instability, 2) patients with PD aged 50 to 80 years, 3) H&Y stage 2 to 4. All participants were given informed consent.

The exclusion criteria were as follows: 1) patients who were diagnosed with dementia, 2) patients who had an evident risk of falling while performing the test, 3) patients who had other diseases affecting gait such as neuromuscular or cardiopulmonary dysfunction, and 4) patients who were diagnosed with atypical parkinsonism.

Basic demographic factors including age, sex, disease duration, and falling history were obtained. We used the UPDRS motor scale (part III), the balance subscale (item 30), and the H&Y stage to evaluate disease severity. We obtained each patient’s falling history from an interview at baseline screening. A fall was defined as an unexpected falling event that ended with the subject coming to rest on the ground and was not due to an extrinsic event. A “faller” was defined as a person who had fallen more than once within six months [11]. We categorized the patients into faller and non-faller groups on the basis of their falling history.

Korean version of the TMT

Although a Korean TMT has been published for stroke patients, this published Korean TMT has several limitations: 1) the paper introducing the Korean TMT is written in Korean, which makes it difficult to find through online searches in PubMed or Embase; 2) the published Korean TMT includes unfamiliar term such as stance phase that are difficult to understand by the public. 3) only two examiners were used to estimate interrater reliability. Therefore, we constructed a new version of the Korean TMT according to the following method.

The TMT as tested in this study is composed of two distinct components, including a balance subscale (9 items, 16 points) and a gait subscale (8 items, 12 points). Therefore, there are 17 items, each of which is rated on a scale of 0 to 1 or 2, and the maximum possible score is 28 points. The total time taken to perform the TMT is approximately 10 minutes per participant. The translation process of the TMT is accurate and reflects Korean culture.

For the translation of the TMT into its Korean version, one movement specialist and one non-medical-expert translator participated in the translation. Subsequently, another non-medical-expert translator retranslated the Korean TMT into the English version and compared it with the original version of the TMT. Each non-medical-expert translator was a person not associated with healthcare who had lived in an English-speaking country for at least 10 years. The three people who participated in the translation collaborated to adapt it to Korean culture (Supplementary Table 1 in the online-only Data Supplement).

Checking the reliability and validity of the TMT

Three movement specialists from different hospitals discussed how to perform the TMT. All TMTs were recorded with a video camcorder with anteroposterior and mediolateral views.

For the intrarater reliability test, we used the test-retest method. We performed the TMT twice with a 30-minute interval between tests. For interrater reliability, thirteen clinicians who worked at different hospitals gathered together and scored the TMT while watching the video clips.

For concurrent validation, clinical tests for gait and balance and three-dimensional motion captures were performed. Clinical tests for gait included the Timed-up and go (TUG) test, 10-m walk test, and UPDRS part III. Clinical scales for balance and the Berg balance test were performed. For objective quantification of gait, we checked spatiotemporal parameters from the three-dimensional motion analysis.

Gait analysis by three-dimensional motion capture

To evaluate gait objectively, we used three-dimensional motion capture VICON (Oxford, UK) at a sample rate of 100 Hz for quantification of spatiotemporal parameters. The participants were asked to walk along a 6-m track under 12 infrared cameras for motion capture. Stride length, walking speed, cadence, step time, stride time, step length, single support, double support and proportion of the gait cycle spent in the stance phase were measured.

Statistics

All results were calculated using SPSS version 21 (IBM Corp., Armonk, NY, USA) and R version 3.1.2. For intra- and interrater reliability, an Interclass Correlation Coefficient (ICC) derived from a two-way random-effects model was used. For internal consistency, we calculated Cronbach’s alpha in each subscale (“irr”, “psy”, “boot” packages).

The concurrent validity of the TMT was obtained by calculating the correlation with the Berg balance test, the UPDRS balance and gait subscores, the H&Y stage, the TUG, and the 10-m walk test. Gait parameters from three-dimensional motion analyses were also compared with TMT results. Spearman correlation analysis was used to evaluate the correlation between TMT and other parameters. The level of significance was set at p < 0.05.

Receiver Operating Characteristic (ROC) analysis was performed to assess the sensitivity and specificity of the TMT score in predicting falls. An ROC curve analysis and an estimate of the area under the ROC curve (AUC) were used to assess the cutoff points for TMT in PD.

RESULTS

The demographics of the participants are shown in Table 1. Their mean age was 72.33 ± 6.95 years, and fourteen of the participants were men. The mean H&Y stage was 2.39 ± 7.37, and the mean UPDRS part III score was 15 ± 3.20. Among the 24 participants, 8 patients had a history of falling.

Reliability of the TMT

The results of the reliability tests for the TMT are shown in Table 2. The interrater reliability of the balance subscales ranged from 0.94 to 0.98 with an ICC of 0.97. The interrater reliability of the gait scale ranged from 0.90 to 0.97 with an ICC of 0.94. Test-retest reliability, used as a measure of intrarater reliability, was ICC = 0.97 for the balance scale and 0.96 for the gait scale. Cronbach’s alpha coefficients for the internal consistency of the Korean version of the Tinetti balance and gait scale were 0.74 and 0.72, respectively, with a confidence interval from 0.69 to 0.77 and from 0.67 to 0.76.

Concurrent validity of Korean TMT

Concurrent validity compared with each clinical test is shown in Table 3. The Tinetti gait scale showed a negative correlation with the 10-m walking test (r = -0.56) and the TUG (r = -0.64). Regarding three-dimensional gait analysis, the Tinetti gate scale showed a positive correlation with stride length (r = 0.77), walking speed (r = 0.71), step length (r = 0.81) and single support (r = 0.45), and a negative correlation with stance phase and double support. The Tinetti balance scale showed a positive correlation with the Berg balance scale (r = 0.73) and a negative correlation with the TUG (r = -0.64).

ROC analysis to predict falling

Table 4 shows the outcomes of the ROC analysis. The Tinetti gait scale shows high sensitivity (88%) and specificity (63%) when 10 is selected as the cutoff value. The Tinetti balance scale score of 14 was selected as the cutoff with the highest sensitivity (81%) and specificity (75%) (Figure 1). The value of the AUC for predicting falls was 0.773 for the balance scale and 0.766 for the gait scale.

DISCUSSION

Our study is the first report of the reliability and validity of the TMT for evaluating patients with PD in Korea. Furthermore, we used a number of tests, including objective estimation via three-dimensional motion capture, for concurrent validation. We found that the Korean version of the TMT showed excellent reliability and validity for patients with PD. Our results are in accordance with previous reports of its high reliability and validity for patients with PD [8]. A kappa coefficient from 0.61 to 0.80 is regarded as “substantial” reliability, and a value above 0.8 is regarded as “good” reliability [12]. In our results, the Korean version of the TMT showed excellent interrater and intrarater reliability. Our results showed higher inter- and intra-reliability and internal consistency than previously reported for the original TMT. Previous reports investigated its reliability for use by students and therapists, but our study targeted movement experts [13].

The Tinetti balance scale showed a positive correlation with clinical and laboratory balance scales. Previous studies have supported a correlation between the TMT and the Berg balance test, TUG, 10-m walking test, and H&Y stage, consistent with our results [8,14]. The Tinetti balance scale is most highly correlated with the Berg balance test and TUG. The Berg balance test is the most accurate scale for estimating balance [11]. Interestingly, the Tinetti balance scale score did not correlate with the UPDRS balance subscore (item 30) but was significantly correlated with the Tinetti gait scale score (item 29). One possible explanation is that postural imbalance in PD is episodic and inconsistent and is therefore difficult to evaluate in one trial. However, gait performance is a constant process, and balance is needed for gaiting. As shown in Table 3, gait and postural instability are closely related to each other. The measurement of balance using the UPDRS score has limitations for evaluating balance because it was checked only by the pull test.

The Tinetti gait scale also showed a strong correlation with the Berg balance test, TUG, 10-m walk test stride length, and walking speed. Objective gait parameters including stride length and walking speed showed the strongest correlation with the Tinetti gait and balance scale. A previous study demonstrated that the Tinetti gait scale was also significantly correlated with the measurements of the GAITRite (CIR system Inc., Franklin, NJ, USA) electronic system [15]. Our results demonstrated that the Korean version of the TMT was more strongly associated with gait speed and stride length than was previously reported. The 10-m walk test showed a significant but relatively weak correlation with the Korean version of the TMT.

The Tinetti balance scale was associated with H&Y stage, but the Tinetti gait scale was not. We assumed that this was because the H&Y stage is graded via laterality and postural imbalance and therefore cannot reflect gait status.

The TMT has been widely used to predict falls in the elderly [7]. We found that cutoff values of 14 points on the Tinetti balance scale and 10 points on the gait scale showed the most accurate sensitivity and specificity for predicting falls among patients with PD. Previous reports also suggested that the optimal cutoff value of the Tinetti balance scale for predicting falling was 10 points among the elderly [16,17], but for patients with PD, the cutoff total score for the original TMT was 20 points, which is lower than our result [8]. The Tinetti gait scale and balance scale showed acceptable accuracy for predicting falling in patients with PD in this study.

Our study has several limitations. First, the sample size was not large; therefore, the estimated power was low (55–62%). Further research will be needed to confirm the effect size of our study finding. Second, we did not enroll patients in an advanced stage of PD owing to their falling risk; therefore, interreliability for each item was low. Third, our study targeted only movement experts, not therapists or nurses.

In conclusion, our study demonstrated that the Korean version of the TMT has acceptable reliability and validity as an assessment tool for gait and balance among patients with PD. It is also useful for predicting falling among patients with PD using cut-off values of 14 on the balance scale and 10 on the gait scale.

Supplementary Materials

Notes

Conflicts of Interest

The authors have no financial conflicts of interest.

Acknowledgments

This research was funded by the Korean Movement Disorder Society (KMDS) as part of the “2016 Academic Research Funding” project.

Figure 1.

Receiver Operating Characteristic curve of Tinetti gait and balance scale for predicting falling in Parkinson’s disease.

REFERENCES

• 1. Horak FB, Mancini M. Objective biomarkers of balance and gait for Parkinson’s disease using body-worn sensors. Mov Disord 2013;28:1544–1551.ArticlePubMedPMC
• 2. Zhao YJ, Wee HL, Chan YH, Seah SH, Au WL, Lau PN, et al. Progression of Parkinson’s disease as evaluated by Hoehn and Yahr stage transition times. Mov Disord 2010;25:710–716.ArticlePubMed
• 3. Movement Disorder Society Task Force on Rating Scales for Parkinson’s Disease. The Unified Parkinson’s Disease Rating Scale (UPDRS): status and recommendations. Mov Disord 2003;18:738–750.ArticlePubMed
• 4. Perlmutter JS. Assessment of Parkinson disease manifestations. Curr Protoc Neurosci 2009;Chapter 10:Unit10.1. Article
• 5. Qutubuddin AA, Pegg PO, Cifu DX, Brown R, McNamee S, Carne W. Validating the Berg Balance Scale for patients with Parkinson’s disease: a key to rehabilitation evaluation. Arch Phys Med Rehabil 2005;86:789–792.ArticlePubMed
• 6. Tinetti ME, Williams TF, Mayewski R. Fall risk index for elderly patients based on number of chronic disabilities. Am J Med 1986;80:429–434.ArticlePubMed
• 7. Panzer VP, Wakefield DB, Hall CB, Wolfson LI. Mobility assessment: sensitivity and specificity of measurement sets in older adults. Arch Phys Med Rehabil 2011;92:905–912.ArticlePubMedPMC
• 8. Kegelmeyer DA, Kloos AD, Thomas KM, Kostyk SK. Reliability and validity of the Tinetti Mobility Test for individuals with Parkinson disease. Phys Ther 2007;87:1369–1378.ArticlePubMedPDF
• 9. An SH, Lee DG, Lee YB, Lee GC. Inter-rater? Absolute reliability and concurrent validity of Tinetti-gait scale (Korean version) in stroke patients. J Korean Soc Phys Med 2014;9:201–211.Article
• 10. Hughes AJ, Daniel SE, Blankson S, Lees AJ. A clinicopathologic study of 100 cases of Parkinson’s disease. Arch Neurol 1993;50:140–148.ArticlePubMed
• 11. Chiu AY, Au-Yeung SS, Lo SK. A comparison of four functional tests in discriminating fallers from non-fallers in older people. Disabil Rehabil 2003;25:45–50.ArticlePubMed
• 12. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 2012;22:276–282.ArticlePubMedPMC
• 13. Cipriany-Dacko LM, Innerst D, Johannsen J, Rude V. Interrater reliability of the Tinetti Balance Scores in novice and experienced physical therapy clinicians. Arch Phys Med Rehabil 1997;78:1160–1164.ArticlePubMed
• 14. Yücel SD, Şahin F, Doğu B, Şahin T, Kuran B, Gürsakal S. Reliability and validity of the Turkish version of the Performance- Oriented Mobility Assessment I. European Review of Aging and Physical Activity 2012;9:149–159.Article
• 15. Shore WS, deLateur BJ, Kuhlemeier KV, Imteyaz H, Rose G, Williams MA. A comparison of gait assessment methods: Tinetti and GAITRite electronic walkway. J Am Geriatr Soc 2005;53:2044–2045.ArticlePubMed
• 16. Faber MJ, Bosscher RJ, van Wieringen PC. Clinimetric properties of the performance-oriented mobility assessment. Phys Ther 2006;86:944–954.ArticlePubMed
• 17. Sterke CS, Huisman SL, van Beeck EF, Looman CW, van der Cammen TJ. Is the Tinetti Performance Oriented Mobility Assessment (POMA) a feasible and valid predictor of short-term fall risk in nursing home residents with dementia? Int Psychogeriatr 2010;22:254–263.ArticlePubMed

Figure & Data

References

Citations

Citations to this article as recorded by  

• Validity and Reliability of the Korean-Translated Version of the International Cooperative Ataxia Rating Scale in Cerebellar Ataxia
  Jinse Park, Jin Whan Cho, Jinyoung Youn, Engseok Oh, Wooyoung Jang, Joong-Seok Kim, Yoon-Sang Oh, Hyungyoung Hwang, Chang-Hwan Ryu, Jin-Young Ahn, Jee-Young Lee, Seong-Beom Koh, Jae H. Park, Hee-Tae Kim
  Journal of Movement Disorders.2023; 16(1): 86.     CrossRef
• Reliability and validity of the Tinetti performance oriented mobility assessment in Chinese community-dwelling older adults
  Chen Yang, Yihan Mo, Xi Cao, Song Zhu, Xiuhua Wang, Xiaoqing Wang
  Geriatric Nursing.2023; 53: 85.     CrossRef
• Validation of the Performance Oriented Mobility Assessment (Tinetti Test) Scale in Russia for Stroke Patients
  Elena V. Kostenko, Liudmila V. Petrova, Irena V. Pogonchenkova
  Bulletin of Rehabilitation Medicine.2023; 22(3): 29.     CrossRef
• Dance Intervention Using the Feldenkrais Method Improves Motor, and Non-Motor Symptoms and Gait in Parkinson’s Disease: A 12-Month Study
  Sung Hoon Kang, Jinhee Kim, Ilsoo Kim, Young Ae Moon, Sojung Park, Seong-Beom Koh
  Journal of Movement Disorders.2022; 15(1): 53.     CrossRef
• Evaluation of Anticipatory Postural Adjustment before Quantified Weight Shifting—System Development and Reliability Test
  Jiunn-Woei Liaw, Rou-Shayn Chen, Vincent Chiun-Fan Chen, Yan-Ru Wang, Hsiao-Lung Chan, Ya-Ju Chang
  Applied Sciences.2021; 11(2): 758.     CrossRef
• Use of Standardized and Non-Standardized Tools for Measuring the Risk of Falls and Independence in Clinical Practice
  Jan Neugebauer, Valérie Tóthová, Jitka Doležalová
  International Journal of Environmental Research and Public Health.2021; 18(6): 3226.     CrossRef
• Decreased foot height may be a subclinical shuffling gait in early stage of Parkinson’s disease: A study of three-dimensional motion analysis
  Kyong Jin Shin, Jinse Park, Samyeol Ha, Kang Min Park, Sung Eun Kim, Byung In Lee, Dong Ah Lee, Hee-Tae Kim, Ji-Yeon Yoon
  Gait & Posture.2020; 76: 64.     CrossRef
• Design of a Machine Learning-Assisted Wearable Accelerometer-Based Automated System for Studying the Effect of Dopaminergic Medicine on Gait Characteristics of Parkinson’s Patients
  Satyabrata Aich, Pyari Mohan Pradhan, Sabyasachi Chakraborty, Hee-Cheol Kim, Hee-Tae Kim, Hae-Gu Lee, Il Hwan Kim, Moon-il Joo, Sim Jong Seong, Jinse Park
  Journal of Healthcare Engineering.2020; 2020: 1.     CrossRef
• Psychometric properties and domains of postural control tests for individuals with knee osteoarthritis: a systematic review
  Helen P. French, Charlotte K. Hager, Anne Venience, Ryan Fagan, Dara Meldrum
  International Journal of Rehabilitation Research.2020; 43(2): 102.     CrossRef
• Measures of balance and falls risk prediction in people with Parkinson’s disease: a systematic review of psychometric properties
  Stanley J Winser, Priya Kannan, Umar Muhhamad Bello, Susan L Whitney
  Clinical Rehabilitation.2019; 33(12): 1949.     CrossRef
• Allelic variant in SLC6A3 rs393795 affects cerebral regional homogeneity and gait dysfunction in patients with Parkinson’s disease
  Lina Wang, Yongsheng Yuan, Jianwei Wang, Yuting Shen, Yan Zhi, Junyi Li, Min Wang, Kezhong Zhang
  PeerJ.2019; 7: e7957.     CrossRef
• Evaluation of Balance Disorders in Parkinson's Disease Using Simple Diagnostic Tests—Not So Simple to Choose
  Karolina Krzysztoń, Jakub Stolarski, Jan Kochanowski
  Frontiers in Neurology.2018;[Epub]     CrossRef
• Rasch Analysis of the Clinimetric Properties of the Korean Dizziness Handicap Inventory in Patients with Parkinson Disease
  Da-Young Lee, Hui-Jun Yang, Dong-Seok Yang, Jin-Hyuk Choi, Byoung-Soo Park, Ji-Yun Park
  Research in Vestibular Science.2018; 17(4): 152.     CrossRef

Comments on this article