Skip to content

Research at St Andrews

Achieving valid patient-reported outcomes measurement: a lesson from fatigue in multiple sclerosis

Research output: Contribution to journalArticle



Jeremy Hobart, Stefan Cano, Rachel Baron, Alan Thompson, Steven Schwid, John Zajicek, David Andrich

School/Research organisations


BACKGROUND: The increasing influence of patient-reported outcome (PRO) measurement instruments indicates their scrutiny has never been more crucial. Above all, PRO instruments should be valid: shown to assess what they purport to assess.

OBJECTIVES: To evaluate a widely used fatigue PRO instrument, highlight key issues in understanding PRO instrument validity, demonstrate limitations of those approaches and justify notable changes in the validation process.

METHODS: A two-phase evaluation of the 40-item Fatigue Impact scale (FIS): a qualitative evaluation of content and face validity using expert opinion (n=30) and a modified Delphi technique; a quantitative psychometric evaluation of internal and external construct validity of data from 333 people with multiple sclerosis using traditional and modern methods.

RESULTS: Qualitative evaluation did not support content or face validity of the FIS. Expert opinion agreed with the subscale placement of 23 items (58%), and classified all 40 items as being non-specific to fatigue impact. Nevertheless, standard quantitative psychometric evaluations implied, largely, FIS subscales were reliable and valid.

CONCLUSIONS: Standard quantitative 'psychometric' evaluations of PRO instrument validity can be misleading. Evaluation of existing PRO instruments requires both qualitative and statistical methods. Development of new PRO instruments requires stronger conceptual underpinning, clearer definitions of the substantive variables for measurement and hypothesis-testing experimental designs.



Original languageEnglish
Pages (from-to)1773-83
Number of pages11
JournalMultiple Sclerosis Journal
Issue number13
Publication statusPublished - Nov 2013

    Research areas

  • Adult, Aged, Aged, 80 and over, Cognition, Disability Evaluation, Fatigue, Female, Humans, Male, Middle Aged, Multiple Sclerosis, Neurologic Examination, Patient Outcome Assessment, Patient Satisfaction, Physical Endurance, Psychometrics, Reproducibility of Results, Self Report, Social Behavior, Treatment Outcome, Young Adult

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Simvastatin as a neuroprotective treatment for Parkinson's disease (PD STAT): protocol for a double-blind, randomised, placebo-controlled futility study

    Carroll, C. B., Webb, D., Stevens, K. N., Vickery, J., Eyre, V., Ball, S., Wyse, R., Webber, M., Foggo, A., Zajicek, J., Whone, A. & Creanor, S., 7 Oct 2019, In : BMJ Open. 9, 10, 11 p., e029740.

    Research output: Contribution to journalArticle

  2. Assessment of a home-based standing frame programme in people with progressive multiple sclerosis (SUMS): a pragmatic, multi-centre, randomised, controlled trial and cost-effectiveness analysis

    Freeman, J. A., Hendrie, W., Jarrett, L., Hawton, A., Barton, A., Dennett, R., Jones, B., Zajicek, J. P. & Creanor, S., 1 Aug 2019, In : Lancet Neurology. 18, 8, p. 736-747

    Research output: Contribution to journalArticle

  3. Machine-learning based identification of undiagnosed dementia in primary care: a feasibility study

    Jammeh, E. A., Carroll, C. B., Pearson, S. W., Escudero, J., Anastasiou, A., Zhao, P., Chenore, T., Zajicek, J. & Ifeachor, E., 12 Jun 2018, In : BJGP Open. 2, 2, 13 p., bjgpopen18X101589.

    Research output: Contribution to journalArticle

  4. Improving the quality of cognitive screening assessments: ACEmobile, an iPad-based version of the Addenbrooke's Cognitive Examination-III

    Newman, C. G. J., Bevins, A. D., Zajicek, J. P., Hodges, J. R., Vuillermoz, E., Dickenson, J. M., Kelly, D. S., Brown, S. & Noad, R. F., 2018, In : Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring. 10, p. 182-187 6 p.

    Research output: Contribution to journalArticle

  5. Balance Right in Multiple Sclerosis (BRiMS): a guided self-management programme to reduce falls and improve quality of life, balance and mobility in people with secondary progressive multiple sclerosis: a protocol for a feasibility randomised controlled trial

    Gunn, H., Andrade, J., Paul, L., Miller, L., Creanor, S., Green, C., Marsden, J., Ewings, P., Berrow, M., Vickery, J., Barton, A., Marshall, B., Zajicek, J. & Freeman, J. A., 27 Jul 2017, In : Pilot and Feasibility Studies. 4, 12 p., 26.

    Research output: Contribution to journalArticle

Related by journal

  1. Lending a hand: can DASH items help ABILHAND improve manual ability measurement in multiple sclerosis?

    Barrett, L., Cano, S., Zajicek, J. & Hobart, J., Apr 2015, In : Multiple Sclerosis Journal. 21, 5, p. 612-621 10 p.

    Research output: Contribution to journalArticle

  2. Evaluating change in mobility in people with multiple sclerosis: relative responsiveness of four clinical measures

    Freeman, J., Walters, R., Ingram, W., Slade, A., Hobart, J. & Zajicek, J., Oct 2013, In : Multiple Sclerosis Journal. 19, 12, p. 1632-9 8 p.

    Research output: Contribution to journalArticle

  3. The use of multiple sclerosis condition-specific measures to inform health policy decision-making: Mapping from the MSWS-12 to the EQ-5D

    Hawton, A., Green, C., Telford, C. J., Wright, D. E. & Zajicek, J. P., 2012, In : Multiple Sclerosis Journal. 18, 6, p. 853-861 9 p.

    Research output: Contribution to journalArticle

ID: 242656335