Skip to content

Research at St Andrews

Paying per-label attention for multi-label extraction from radiology reports

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Author(s)

Patrick Schrempf, Hannah Watson, Shadia Mikhael, Maciej Pajak, Matúš Falis, Aneta Lisowska, Keith W. Muir, David Harris-Birtill, Alison Q. O'Neil

School/Research organisations

Abstract

Training medical image analysis models requires large amounts of expertly annotated data which is time-consuming and expensive to obtain. Images are often accompanied by free-text radiology reports which are a rich source of information. In this paper, we tackle the automated extraction of structured labels from head CT reports for imaging of suspected stroke patients, using deep learning. Firstly, we propose a set of 31 labels which correspond to radiographic findings (e.g. hyperdensity) and clinical impressions (e.g. haemorrhage) related to neurological abnormalities. Secondly, inspired by previous work, we extend existing state-of-the-art neural network models with a label-dependent attention mechanism. Using this mechanism and simple synthetic data augmentation, we are able to robustly extract many labels with a single model, classified according to the radiologist's reporting (positive, uncertain, negative). This approach can be used in further research to effectively extract many labels from medical text.
Close

Details

Original languageEnglish
Title of host publicationInterpretable and Annotation-Efficient Learning for Medical Image Computing
Subtitle of host publicationThird International Workshop, iMIMIC 2020, Second International Workshop, MIL3iD 2020, and 5th International Workshop, LABELS 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 4–8, 2020, Proceedings
EditorsJaime Cardoso, Hien Van Nguyen, Nicholas Heller, Pedro Henriques Abreu, Ivana Isgum, Wilson Silva, Ricardo Cruz, Jose Pereira Amorim, Vishal Patel, Badri Roysam, Kevin Zhou, Steve Jiang, Ngan Le, Khoa Luu, Raphael Sznitman, Veronika Cheplygina, Diana Mateus, Emanuele Trucco, Samaneh Abbasi
Place of PublicationCham
PublisherSpringer
Pages277-289
Number of pages13
ISBN (Electronic)9783030611668
ISBN (Print)9783030611651
DOIs
Publication statusPublished - 2020
EventMICCAI Workshop on Large-scale Annotation of Biomedical data and Expert Label Synthesis 2020 - Lima (virtual), Peru
Duration: 8 Oct 20208 Oct 2020
https://labels.tue-image.nl/

Publication series

NameLecture Notes in Computer Science (including subseries Image Processing, Computer Vision, Pattern Recognition, and Graphics)
PublisherSpringer
Volume12446 LNCS
ISSN (Print)0302-9743

Workshop

WorkshopMICCAI Workshop on Large-scale Annotation of Biomedical data and Expert Label Synthesis 2020
Abbreviated titleLABELS 2020
CountryPeru
Period8/10/208/10/20
Internet address

    Research areas

  • NLP, Radiology report labelling, BERT

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Templated text synthesis for expert-guided multi-label extraction from radiology reports

    Schrempf, P., Watson, H., Park, E., Pajak, M., MacKinnon, H., Muir, K. W., Harris-Birtill, D. & O’Neil, A. Q., 24 Mar 2021, In: Machine Learning and Knowledge Extraction. 3, 2, p. 299-317 19 p.

    Research output: Contribution to journalArticlepeer-review

  2. RadarCat : Radar Categorization for input & interaction

    Yeo, H. S., Flamich, G., Schrempf, P. M., Harris-Birtill, D. C. C. & Quigley, A. J., 16 Oct 2016, Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, p. 833-841 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  3. Ethics and acceptance of smart homes for older adults

    Pirzada, P., Wilde, A., Doherty, G. H. & Harris-Birtill, D., 9 Jul 2021, (E-pub ahead of print) In: Informatics for Health and Social Care. Latest Articles, 28 p.

    Research output: Contribution to journalReview articlepeer-review

  4. Generative deep learning in digital pathology workflows

    Morrison, D., Harris-Birtill, D. & Caie, P. D., 8 Apr 2021, (E-pub ahead of print) In: The American Journal of Pathology.

    Research output: Contribution to journalReview articlepeer-review

  5. Understanding computation time: a critical discussion of time as a computational performance metric

    Harris-Birtill, D. & Harris-Birtill, R., 3 Aug 2020, (Accepted/In press) Time in variance: the study of time. Parker, J., Harris, P. & Misztal, A. (eds.). Brill, Vol. 17. (The Study of Time).

    Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)peer-review

ID: 270621167

Top