Skip Navigation
Skip to contents

JMD : Journal of Movement Disorders

OPEN ACCESS
SEARCH
Search

Articles

Page Path
HOME > J Mov Disord > Volume 18(4); 2025 > Article
Viewpoint
Variability in Pull Test Performance Within a Tertiary Movement Disorders Center
Carla Silva-Batista1*orcid, Lee E. Neilson1,4*corresp_iconorcid, Hanna Whang1,2orcid, Jacqueline Ellison1orcid, Delaram Safarpour1orcid, Lauren S. Talman1orcid, Fay B. Horak1,3orcid, John Nutt1orcid, Marian L. Dale1,4orcid
Journal of Movement Disorders 2025;18(4):304-307.
DOI: https://doi.org/10.14802/jmd.25140
Published online: June 20, 2025

1Department of Neurology, Balance Disorders Laboratory, Oregon Health & Science University, Portland, OR, USA

2Department of Chemistry, University of Alaska Anchorage, Anchorage, AK, USA

3APDM Wearable Technologies—A Clario Company, Portland, OR, USA

4Neurology Section Parkinson’s Disease Research, Education, and Clinical Center, VA Portland Health Care System, Veterans Health Administration, Portland, OR, USA

Corresponding author: Lee E. Neilson, MD Department of Neurology, Oregon Health & Science University, 3181 SW Sam Jackson Rd, Portland, OR 97239, USA / Tel: +1-503-481-3197 / Email: neilsole@ohsu.edu
*These authors contributed equally to this work.
• Received: May 22, 2025   • Revised: June 18, 2025   • Accepted: June 20, 2025

Copyright © 2025 The Korean Movement Disorder Society

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

prev next
  • 1,205 Views
  • 52 Download
Postural instability is a cardinal feature of idiopathic Parkinson’s disease (PD) that often develops with disease progression. Postural instability is debilitating as it limits independent participation in community and family interactions and increases the prevalence of falls [1]. Falls that occur early in the disease course are suggestive of atypical parkinsonism (e.g., progressive supranuclear palsy [PSP]) [2]. Although there is no instrumented gold standard for assessing postural instability, the Pull Test is a validated clinical test that is often used to evaluate postural instability in response to external perturbations [3].
The Pull Test does not require any equipment and is performed by giving a sudden backward shoulder pull to the individual. Postural responses are scored from normal (the patient recovers with 1–2 steps) to severe (the patient loses balance spontaneously or with a gentle pull on the shoulders) [3]. Individuals who take three or more steps are classified as having postural instability [3]. The Pull Test is an integral component of the Movement Disorder Society Unified Parkinson’s Disease Rating Scale part III (MDS-UPDRS-III) because it is responsible for marking the transition from stage II to stage III in the Hoehn and Yahr stages [3], influences clinical trial candidacy, documents the responsiveness to treatments, and tracks changes in the disease over time [3]. Thus, reproducible and precise execution of the Pull Test is necessary.
Despite detailed instructions in the MDS-UPDSRS-III, there is some debate in the literature about how this test should be executed (e.g., whether the shoulder pull should be unexpected, whether the test should be performed repeatedly to assess habituation effects, etc.) [4-7]. The existence of multiple versions of the Pull Test, each with slight variations in execution and scoring, has led to confusion and inconsistency in its application for assessing patients with neurological disorders [6,7]. This variability creates challenges in obtaining reliable and comparable results in both clinical and research settings. This variability observed among trainees and faculty within our tertiary Movement Disorders Center at Oregon Health & Science University is the rationale for the current study. Herein, we objectively investigated the variability of Pull Test administration, and we propose a more consistent administration of the Pull Test that should improve the consistency of the results.
Pull Test administration
We held an educational workshop during our normally scheduled video rounds, during which faculty clinicians (n=7) and fellows (n=3) were filmed individually administering the Pull Test to the same research assistant volunteer. All the participants were certified raters for the MDS-UPDRS, and all provided informed consent. The clinicians had no advanced knowledge of the task and were not allowed to confer with those waiting to participate. The only verbal instructions upon entering the room were “please perform a Pull Test on this volunteer consistent with the MDS-UPDRS as you would in clinic.” Two researchers (C.S-B. and H.W.) reviewed the videos to identify errors during the Pull Test application, on the basis of instructions of item 3.12 Postural Stability (MDS-UPDRS-III): the examiner “should stand sufficiently far back,” with a “wall” 1–2 meters behind them, “instruct” the examinee on what is about to happen, “demonstrate” the technique, “prevent abnormal forward flexion” in anticipation of the pull, and finally deliver a quick and “forceful” backward “pull” on the “shoulders.” The actions placed in quotation marks and terms indicate potential sources of error. Interrater reliability in reviewing the videos to identify errors during the Pull Test was analyzed using the weighted kappa statistic. The average kappa coefficient was 0.89, which demonstrated almost perfect agreement between the two raters. After all the faculty and fellows completed their tests, Dr. John Nutt demonstrated the correct administration of the Pull Test on Dr. Fay B. Horak (Supplementary Video 1 in the online-only Data Supplement).
Pull Test errors and variability in administration
A total of 17 errors (8 errors for fellows and 9 errors for faculty) were identified among the 10 Pull Tests recorded. Figure 1 shows that counting before pulling (“1, 2, 3” and then administering the pull), pulling without force, not using a wall behind the administrator, and not performing a preliminary Pull Test demonstration were common errors. There was no difference in the number of errors committed by trainees or faculty (1.75 vs. 1.57).
We found considerable variability in the administration of the Pull Test among movement disorder clinicians within our tertiary care center. Clinicians’ interest, expertise, varied instructions, or safety considerations for the Pull Test in different syndromes (e.g., Huntington’s disease [HD], PSP) may influence this variability. For example, our HD-focused clinician counted before pulling, likely for safety given chorea and impulsivity in the HD population and was accustomed to this procedure. Additionally, one author (J.N.) performs a few small lateral shoulder taps before pulling the patient backward for two reasons (Supplementary Videos 2 and 3 in the online-only Data Supplement): 1) this indicates to the patient that the clinician is behind them in space, reducing patient anxiety, and 2) it likely prevents abnormal anticipatory forward flexion. This is important, as the patient must take a step back and/or fall backward to be considered a valid test. Finally, three clinicians did not perform a demonstration. While not performing a demonstration is considered an error, it has previously been shown that an unexpected pull using a moving support surface has greater discriminative ability between PD and control participants [8] and is more likely to produce an abnormal score [1]. In fact, Visser and collaborators [6] compared variants of the Pull Test and concluded that the most valid test was an unexpected shoulder pull, executed once. However, as a standalone test, it does not predict future falls in PD patients [1].
Thus, expert centers should not assume that the Pull Test is being administered uniformly or correctly. Our small study represents an improvement compared with previous studies. Munhoz et al. [9] reported in 2004 that only 9% of videotaped Pull Tests in a clinical trial setting were performed without error. In fact, 72% of examiners made more than one error, which led to raters indicating that 78% of tests could not be used to adequately assess the severity of postural instability. The most common single error—pulling with too little force—was observed in 77% of the examiners. In contrast, using too little force represented only 3 of the 17 total recorded errors. While it is possible that performing this maneuver on a healthy volunteer does not entirely recapitulate a real-world encounter with a live patient, one may expect the differences to be minimized, as there is less concern for participant safety, and one might expect greater accuracy when performed as part of a clinical trial. The protocol used herein also minimizes the potential for fatigue or learning if it is performed serially on a live patient.
One point not addressed in this study is the consistency of examiners’ scoring. While the scoring rubric is anchored by obvious observable phenomena, more subtle findings can be missed. For example, further information can be gleaned by observing the second stepping foot; if it steps too far back (beyond the other foot), it may reflect instability even if it is scored as normal. Direct observation of this foot motion is essential, and a dedicated Pull Test workshop during regularly scheduled didactic time or video rounds could be beneficial for highlighting group variability in administration and teaching alternatives such as the Push and Release Test.
We have previously shown that the Push and Release Test (Supplementary Video 4 in the online-only Data Supplement) can be used to assess postural stability accurately [5]. This test is not only more sensitive and more consistent than the Pull Test across trials and raters but also more accurate than the Pull Test in the “ON” state of medication, which is more applicable in clinical practice [10]. In contrast to the sudden, forceful pull of the Pull Test, the Push and Release Test rates postural stepping responses to a sudden release of a subject leaning backward into the examiner’s hands. The scores range from 0 for a normal, single backward step to 4 for a fall into the examiner’s hands. It decreases the variability of the perturbation due to the stimulus originating from gravity upon release of the weight of the patient [5] and is perhaps best used when safety is considered (e.g., a mismatch between a small examiner and a large patient). However, the Push and Release Test is not without limitations: patients’ hesitation to lean backward into the examiner’s hands, the need for the examiner to determine whether the patient takes steps to reorient the feet side by side or to maintain balance, and the requirement of more patient trust [5]. Furthermore, the Push and Release Test may not be compatible with all movement disorders. For example, in our experience, people with PSP often cannot participate in the Push and Release Test due to fear of falling and the resulting unwillingness to shift enough weight to the examiner’s hands or because of their well-practiced strategy of making a compensatory forward bend at the pelvis [11]. These advantages and disadvantages for both tests are delineated in Supplementary Table 1 (in the online-only Data Supplement).
Regardless of the choice, it is unlikely that a single test can capture the complex interplay of gait, balance, cognitive decline and environmental factors underlying falls. A robust set of complementary tests is likely necessary. To that end, an MDS-commissioned task force has assessed the clinimetric properties of existing rating scales, questionnaires, and timed tests that assess posture, gait, and balance in PD [12]. Although various tests and rating scales have been developed to assess these features in PD patients, none of them has been suitable for all clinical purposes [12]. Thus, the MDS-commissioned task force recommended the development of a PD-specific, easily administered, comprehensive posture, gait, and balance scale that separately assesses all relevant constructs because of the potential heterogeneity in underlying PD pathophysiology. It was recommended that standing posture, gait, and several different balance domains be assessed simultaneously but that separate scores be obtained for each of the three constructs [12]. To this point, Dr. Jorik Nonnekes and collaborators (unpublished, 2025) from different centers (USA, Australia, UK, Italy, Netherlands) are currently developing a new MDS Rating Scale: Postural Stability and Gait Difficulties, which includes separate sections for posture (e.g., trunk), gait (e.g., quality of gait, dynamic gait, dual-task gait, and turning), and balance (e.g., sensory orientation, anticipatory, reactive postural control) and specifically addresses freezing of gait and fear of falling.
Until this is resolved at the society level, we submit that professional experience acquired through cumulative hands-on practice is critically important. As many tips and tricks are only handed down through the oral tradition and not always formally published in traditional venues, this seemingly simple examination maneuver must be consciously taught to trainees in both formal and informal settings. It is important to watch them perform the Pull Test rather than relying only on their report. Finally, while adherence to the current rubric can be achieved with education, documentation in plain language describing all the elements of the procedure performed should be encouraged to capture the many nuances missed in a numeric score.
The online-only Data Supplement is available with this article at https://doi.org/10.14802/jmd.25140.
Video 1.
Proper examination of a normal Pull Test was performed. In this video, the examiner announces that they will perform a test of balance and provides a demonstration of what to expect. After resetting, the examiner performs a graded test of balance with a forceful backward pull of the shoulders without warning.
Video 2.
In this video, the examiner explains the potential added value of lateral taps on the shoulders. It is intended to 1) reinforce that the examiner is behind the patient and prepared to catch them and 2) prevent the patient from unintentionally flexing forward at the trunk in anticipation of a backward pull.
Video 3.
In this video, the examiner demonstrates the Pull Test maneuver on a volunteer while incorporating the lateral taps into the instructions.
Video 4.
In this video, the examiner first explains the Push and Release Test. The examiner explains that the volunteer needs to lean backward “beyond their limits” while the examiner supports them with both hands placed on the scapulae. They are then warned that the support will be suddenly removed and will be required to catch their own balance, potentially requiring a full step. In the second half, the examiner demonstrates a full trial of the Push and Release Test.
Supplementary Table 1.
Review of the previous reported cases of dopamine transporter deficiency syndrome in literature
jmd-25140-Supplementary-Table-1.pdf

Ethics Statement

Written informed consent has been obtained from the examiners.

Conflicts of Interest

The authors have no financial conflicts of interest.

Funding Statement

None

Acknowledgments

The authors wish to thank all Oregon Health & Science University fellows and faculty within the division of Movement Disorders and all members of the Balance Disorder Laboratory.

Author Contributions

Data curation: Carla Silva-Batista, Hanna Whang, Lee E. Neilson. Formal analysis: Carla Silva-Batista, Hanna Whang. Investigation: Carla Silva-Batista, Lee E. Neilson. Methodology: Carla Silva-Batista, Marian L. Dale. Resources: Marian L. Dale. Software: Carla Silva-Batista. Supervision: Marian L. Dale. Validation: Marian L. Dale. Visualization: Carla Silva-Batista. Writing—original draft: Carla Silva-Batista. Writing—review & editing: Lee E. Neilson, Hanna Whang, Jacqueline Ellison, Delaram Safarpour, Lauren S. Talman, Fay B. Horak, John Nutt, Marian L. Dale.

Figure 1.
Common errors during the Pull Test by examiners.
jmd-25140f1.jpg
  • 1. Bloem BR, Grimbergen YA, Cramer M, Willemsen M, Zwinderman AH. Prospective assessment of falls in Parkinson’s disease. J Neurol 2001;248:950–958.ArticlePubMedPDF
  • 2. McFarland NR. Diagnostic approach to atypical Parkinsonian syndromes. Continuum (Minneap Minn) 2016;22:1117–1142.ArticlePubMedPMC
  • 3. Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, et al. Movement Disorder Society-sponsored revision of the Unified Parkinson’s Disease Rating Scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord 2008;23:2129–2170.PubMed
  • 4. Bloem BR, Beckley DJ, van Hilten BJ, Roos RA. Clinimetrics of postural instability in Parkinson’s disease. J Neurol 1998;245:669–673.ArticlePubMedPDF
  • 5. Jacobs JV, Horak FB, Van Tran K, Nutt JG. An alternative clinical postural stability test for patients with Parkinson’s disease. J Neurol 2006;253:1404–1413.ArticlePubMedPDF
  • 6. Visser M, Marinus J, Bloem BR, Kisjes H, van den Berg BM, van Hilten JJ. Clinical tests for the evaluation of postural instability in patients with parkinson’s disease. Arch Phys Med Rehabil 2003;84:1669–1674.PubMed
  • 7. Nonnekes J, Goselink R, Weerdesteyn V, Bloem BR. The retropulsion test: a good evaluation of postural instability in Parkinson’s disease? J Parkinsons Dis 2015;5:43–47.ArticlePubMedPDF
  • 8. Nanhoe-Mahabier W, Allum JH, Overeem S, Borm GF, Oude Nijhuis LB, Bloem BR. First trial reactions and habituation rates over successive balance perturbations in Parkinson’s disease. Neuroscience 2012;217:123–129.ArticlePubMed
  • 9. Munhoz RP, Li JY, Kurtinecz M, Piboolnurak P, Constantino A, Fahn S, et al. Evaluation of the pull test technique in assessing postural instability in Parkinson’s disease. Neurology 2004;62:125–127.ArticlePubMed
  • 10. Valkovic P, Brozová H, Bötzel K, Růzicka E, Benetin J. Push-and-release test predicts Parkinson fallers and nonfallers better than the pull test: comparison in OFF and ON medication states. Mov Disord 2008;23:1453–1457.PubMed
  • 11. Dale ML, Prewitt AL, Harker GR, McBarron GE, Mancini M. Perspective: balance assessments in progressive supranuclear palsy: lessons learned. Front Neurol 2022;13:801291.ArticlePubMedPMC
  • 12. Bloem BR, Marinus J, Almeida Q, Dibble L, Nieuwboer A, Post B, et al. Measurement instruments to assess posture, gait, and balance in Parkinson’s disease: critique and recommendations. Mov Disord 2016;31:1342–1355.ArticlePubMedPDF

Figure & Data

References

    Citations

    Citations to this article as recorded by  

      Comments on this article

      Add a comment
      Figure
      • 0
      Variability in Pull Test Performance Within a Tertiary Movement Disorders Center
      Image
      Figure 1. Common errors during the Pull Test by examiners.
      Variability in Pull Test Performance Within a Tertiary Movement Disorders Center

      JMD : Journal of Movement Disorders Twitter
      Close layer
      TOP