Skip to content

Research at St Andrews

Pre-validation methods for developing a patient reported outcome instrument

Research output: Contribution to journalArticlepeer-review


Maria E. Prior, Jemaima Che Hamzah, Jillian J. Francis, Craig R. Ramsay, Mayret M. Castillo, Susan E. Campbell, Augusto Azuara-Blanco, Jennifer M. Burr

School/Research organisations


Background: Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting) should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items) that can be utilised to develop new instruments. Such 'top down' approaches are common, but the explicit pre-validation methods are often poorly reported. This paper presents a systematic and generalisable 5-step pre-validation PRO instrument methodology.

Methods: The method is illustrated using the example of the Aberdeen Glaucoma Questionnaire (AGQ). The five steps are: 1) Generation of a pool of items; 2) Item de-duplication (three phases); 3) Item reduction (two phases); 4) Assessment of the remaining items' content coverage against a pre-existing theoretical framework appropriate to the objectives of the instrument and the target population (e. g. ICF); and 5) qualitative exploration of the target populations' views of the new instrument and the items it contains.

Results: The AGQ 'item pool' contained 725 items. Three de-duplication phases resulted in reduction of 91, 225 and 48 items respectively. The item reduction phases discarded 70 items and 208 items respectively. The draft AGQ contained 83 items with good content coverage. The qualitative exploration ('think aloud' study) resulted in removal of a further 15 items and refinement to the wording of others. The resultant draft AGQ contained 68 items.

Conclusions: This study presents a novel methodology for developing a PRO instrument, based on three sources: literature reporting what is important to patient; theoretically coherent framework; and patients' experience of completing the instrument. By systematically accounting for all items dropped after the item generation phase, our method ensures that the AGQ is developed in a transparent, replicable manner and is fit for validation. We recommend this method to enhance the likelihood that new PRO instruments will be appropriate to the research context in which they are used, acceptable to research participants and likely to generate valid data.



Original languageEnglish
Article number112
Number of pages9
JournalBMC Medical Research Methodology
Publication statusPublished - 9 Aug 2011

    Research areas

  • Quality-of-life, Visual function questionnaire, Vision impairment, Self-assessment, Glaucoma, Impact, Index, Tolerability, Disability, Timolol

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Interpretation of change scores for the National Eye Institute Visual Function Questionnaire-25: the minimally important difference

    Burr, J. M., Cooper, D., Ramsay, C. R., Che Hamzah, J. & Azuara-Blanco, A., 18 May 2021, In: British Journal of Ophthalmology.

    Research output: Contribution to journalArticlepeer-review

  2. Primary trabeculectomy for advanced glaucoma: pragmatic multicentre randomised controlled trial (TAGS)

    TAGS Study Group, King, A. J., Hudson, J., Fernie, G., Kernohan, A., Azuara-Blanco, A., Burr, J., Homer, T., Shabaninejad, H., Sparrow, J. M., Garway-Heath, D., Barton, K., Norrie, J., McDonald, A., Vale, L., MacLennan, G. & Kousha, O., 12 May 2021, In: BMJ. 373, 11 p., n1014.

    Research output: Contribution to journalArticlepeer-review

  3. Effect of corneal cross-linking vs standard care on keratoconus progression in young patients: the keralink randomized controlled trial

    Keralink Trial Study Group, Larkin, D. F. P., Chowdhury, K., Burr, J. M., Raynor, M., Edwards, M., Tuft, S. J., Bunce, C., Caverly, E. & Doré, C., 20 Apr 2021, In: Ophthalmology. In Press, 11 p.

    Research output: Contribution to journalArticlepeer-review

  4. Trends in diabetic retinopathy screening attendance and associations with vision impairment attributable to diabetes in a large nationwide cohort

    Lawrenson, J. G., Bourmpaki, E., Bunce, C., Stratton, I. M., Gardner, P., Anderson, J. & EROS Study Group, Apr 2021, In: Diabetic Medicine. 38, 4, 11 p., e14425.

    Research output: Contribution to journalArticlepeer-review

  5. Femtosecond laser-assisted cataract surgery compared with phacoemulsification: the FACT non-inferiority RCT

    Day, A. C., Burr, J. M., Bennett, K., Hunter, R., Bunce, C., Doré, C. J., Nanavaty, M. A., Balaggan, K. S. & Wilkins, M. R., 1 Jan 2021, In: Health Technology Assessment. 25, 6, p. 1-68 68 p.

    Research output: Contribution to journalArticlepeer-review

Related by journal

  1. Modelling reassurances of clinicians with Hidden Markov models

    Popov, V., Ellis-Robinson, A. & Humphris, G., 9 Jan 2019, In: BMC Medical Research Methodology. 19, 10 p., 11.

    Research output: Contribution to journalArticlepeer-review

  2. Sexual Health questions included in the Health Behaviour in School-aged Children (HBSC) Study: an international methodological pilot investigation

    Young, H., Költő, A., Reis, M., Saewyc, E. M., Moreau, N., Burke, L., Cosma, A., Windlin, B., Gabhainn, S. N. & Godeau, E., 5 Dec 2016, In: BMC Medical Research Methodology. 16, 12 p., 169.

    Research output: Contribution to journalArticlepeer-review

  3. A method for estimating wage, using standardised occupational classifications, for use in medical research in the place of self-reported income

    Clemens, T. & Dibben, C., 28 Apr 2014, In: BMC Medical Research Methodology. 8 p., 59.

    Research output: Contribution to journalArticlepeer-review

  4. Developing the clinical components of a complex intervention for a glaucoma screening trial: a mixed methods study

    Burr, J. M., Campbell, M. K., Campbell, S. E., Francis, J. J., Greene, A., Hernandez, R., Hopkins, D., McCann, S. K., Vale, L. D. & Glaucoma Screening Platform Study, 21 Apr 2011, In: BMC Medical Research Methodology. 11, 10 p., 54.

    Research output: Contribution to journalArticlepeer-review

ID: 16572620