Permanent URI for this collection
Browse
Recent Submissions
Publication The Relationship between Mammography Readers' Real-Life Performance and Performance in a Test Set-based Assessment Scheme in a National Breast Screening Program(Radiological Society of North America, 2020-09-25) Chen, Yan; James, Jonathan; cornford, eleanor; Jenkins, Jacquie; Cornford, Eleanor; Medical and DentalPurpose: To compare an individual's Personal Performance in Mammographic Screening (PERFORMS) score with their Breast Screening Information System (BSIS) real-life performance data and determine which parameters in the PERFORMS scheme offer the best reflection of BSIS real-life performance metrics. Materials and methods: In this retrospective study, the BSIS real-life performance metrics of individual readers (n = 452) in the National Health Service Breast Screening Program (NHSBSP) in England were compared with performance in the test set-based assessment scheme over a 3-year period from 2013 to 2016. Cancer detection rate (CDR), recall rate, and positive predictive value (PPV) were calculated for each reader, for both real-life screening and the PERFORMS test. For each metric, real-life and test set versions were compared using a Pearson correlation. The real-life CDR, recall rate, and PPV of outliers were compared against other readers (nonoutliers) using analysis of variance. Results: BSIS real-life CDRs, recall rates, and PPVs showed positive correlations with the equivalent PERFORMS measures (P < .001, P = .002, and P < .001, respectively). The mean real-life CDR of PERFORMS outliers was 7.2 per 1000 women screened and was significantly lower than other readers (nonoutliers) where the real-life CDR was 7.9 (P = .002). The mean real-life screening PPV of PERFORMS outliers was 0.14% and was significantly lower than the nonoutlier group who had a mean PPV of 0.17% (P = .006). Conclusion: The use of test set-based assessment schemes in a breast screening program has the potential to predict and identify poor performance in real life.© RSNA, 2020Keywords: Breast, ScreeningSee also the commentary by Thigpen and Rapelyea in this issue.Publication FAST MRI: DYAMOND trial protocol (can an abbreviated MRI scan detect breast cancers missed by mammography for screening clients with average mammographic density attending their first screening mammogram?)—a diagnostic yield study within the NHS population-risk breast screening programme(BMJ Publishing Group, 2025-09-25) Jones, Lyn; Geach, Rebecca; Loose, Abi; McKeown-Keegan, Sadie; Marshall, Andrea; Halling-Brown, Mark; Curtis, Sian; Harding, Sam; Rose, Jan; Matthews, Helen; Vinnicombe, Sarah; Shaaban, Abeer; Taylor-Phillips, Sian; Dunn, Janet; Vinnicombe, Sarah; Medical and DentalIntroduction First post-contrAst SubtracTed (FAST) MRI, an abbreviated breast MRI scan, has high sensitivity for sub-centimetre aggressive breast cancer and short acquisition and interpretation times. These attributes promise effective supplemental screening. Until now, FAST MRI research has focused on women above population-risk of breast cancer (high mammographic density or personal history). DYAMOND aims to define the population within the population-risk NHS Breast Screening Programme (NHSBSP) likely to benefit from FAST MRI. The study population is the 40% of screening clients aged 50–52 who have average mammographic density (BI-RADS (Breast Imaging Reporting and Data System) B) on their first screening mammogram. DYAMOND will answer whether sufficient numbers of breast cancers, missed by mammography, can be detected by FAST MRI to justify the inclusion of this group in a future randomised controlled trial. Methods and analysis Prospective, multicentre, diagnostic yield, single-arm study with an embedded qualitative sub-study: all recruited participants undergo a FAST MRI. An internal pilot will assess the willingness of sites and screening clients to participate in the study. Screening clients aged 50–52, with a clear first NHSBSP mammogram and BI-RADS B mammographic density (by automated measurement) will be invited to participate (recruitment target: 1000). The primary outcome is the number of additional cancers detected by FAST MRI (missed by screening mammography). A Fleming’s two-stage design will be used as this allows for early stopping after stage 1, to save participants, funding costs and time continuing to the end of the study if the question can be answered earlier. Ethics and dissemination The NHSBSP Research and Innovation Development Advisory Committee and the Yorkshire and Humber–Sheffield Research Ethics Committee (23/YH/0268, study ID (IRAS): 330059) approved this research protocol. Participation involves a two-stage informed consent process, enabling screening for eligibility through automated mammographic density measurement. Patients with breast cancer helped shape the study design and co-produced participant-facing documents. They will disseminate the results to the public in a clear and meaningful way. Results will be published with open access in international peer-reviewed scientific journals. Trial registration number ISRCTN74193022Publication Optimum screening mammography reading volumes: evidence from the NHS Breast Screening Programme(Springer, 2021-02-25) cornford, eleanor; Cheung, Shan; Press, Mike; Kearins, Olive; Taylor-Phillips, Sian; Cornford, Eleanor; Medical and DentalObjectives: Minimum caseload standards for professionals examining breast screening mammograms vary from 480 (US) to 5000 (Europe). We measured the relationship between the number of women's mammograms examined per year and reader performance. Methods: We extracted routine records from the English NHS Breast Screening Programme for readers examining between 1000 and 45,000 mammograms between April 2014 and March 2017. We measured the relationship between the volume of cases read and screening performance (cancer detection rate, recall rate, positive predictive value of recall (PPV) and discrepant cancers) using linear logistic regression. We also examined the effect of reader occupational group on performance. Results: In total, 759 eligible mammography readers (445 consultant radiologists, 235 radiography advanced practitioners, 79 consultant radiographers) examined 6.1 million women's mammograms during the study period. PPV increased from 12.9 to 14.4 to 17.0% for readers examining 2000, 5000 and 10000 cases per year respectively. This was driven by decreases in recall rates from 5.8 to 5.3 to 4.5 with increasing volume read, and no change in cancer detection rate (from 7.6 to 7.6 to 7.7). There was no difference in cancer detection rate with reader occupational group. Consultant radiographers had higher recall rate and lower PPV compared to radiologists (OR 1.105, p = 0.012; OR 0.874, p = 0.002, unadjusted). Conclusion: Positive predictive value of screening increases with the total volume of cases examined per reader, through decreases in numbers of cases recalled with no concurrent change in numbers of cancers detected. Key points: • In the English Breast Screening Programme, readers who examined a larger number of cases per year had a higher positive predictive value, because they recalled fewer women for further tests but detected the same number of cancers. • Reader type did not affect cancer detection rate, but consultant radiographers had a higher recall rate and lower positive predictive value than consultant radiologists, although this was not adjusted for length of experience.Publication Optimising the diagnostic accuracy of First post-contrAst SubtracTed breast MRI (FAST MRI) through interpretation-training: a multicentre e-learning study, mapping the learning curve of NHS Breast Screening Programme (NHSBSP) mammogram readers using an enriched dataset(BioMed Central, 2024-05-28) Jones, Lyn; Marshall, Andrea; Geach, Rebecca; Elangovan, Premkumar; O'Flynn, Elizabeth; Timlin, Tony; Mckeown-Keegan, Sadie; Rose, Janice; Vinnicombe, Sarah; Taylor-Phillips, Sian; Halling-Brown, Mark; Dunn, Janet; Vinnicombe, Sarah; Medical and DentalBackground Abbreviated breast MRI (FAST MRI) is being introduced into clinical practice to screen women with mammographically dense breasts or with a personal history of breast cancer. This study aimed to optimise diagnostic accuracy through the adaptation of interpretation-training. Methods A FAST MRI interpretation-training programme (short presentations and guided hands-on workstation teaching) was adapted to provide additional training during the assessment task (interpretation of an enriched dataset of 125 FAST MRI scans) by giving readers feedback about the true outcome of each scan immediately after each scan was interpreted (formative assessment). Reader interaction with the FAST MRI scans used developed software (RiViewer) that recorded reader opinions and reading times for each scan. The training programme was additionally adapted for remote e-learning delivery. Study design Prospective, blinded interpretation of an enriched dataset by multiple readers. Results 43 mammogram readers completed the training, 22 who interpreted breast MRI in their clinical role (Group 1) and 21 who did not (Group 2). Overall sensitivity was 83% (95%CI 81–84%; 1994/2408), specificity 94% (95%CI 93–94%; 7806/8338), readers’ agreement with the true outcome kappa = 0.75 (95%CI 0.74–0.77) and diagnostic odds ratio = 70.67 (95%CI 61.59–81.09). Group 1 readers showed similar sensitivity (84%) to Group 2 (82% p = 0.14), but slightly higher specificity (94% v. 93%, p = 0.001). Concordance with the ground truth increased significantly with the number of FAST MRI scans read through the formative assessment task (p = 0.002) but by differing amounts depending on whether or not a reader had previously attended FAST MRI training (interaction p = 0.02). Concordance with the ground truth was significantly associated with reading batch size (p = 0.02), tending to worsen when more than 50 scans were read per batch. Group 1 took a median of 56 seconds (range 8–47,466) to interpret each FAST MRI scan compared with 78 (14–22,830, p < 0.0001) for Group 2. Conclusions Provision of immediate feedback to mammogram readers during the assessment test set reading task increased specificity for FAST MRI interpretation and achieved high diagnostic accuracy. Optimal reading-batch size for FAST MRI was 50 reads per batch. Trial registration (25/09/2019): ISRCTN16624917.
