Evaluating the impact of the Radiomics Quality Score: a systematic review and meta-analysis

Nathaniel Barry, Jake Kendrick, Kaylee Molin, Suning Li, Pejman Rowshanfarzad, Ghulam M Hassan, Jason Dowling, Paul M Parizel, Michael S Hofman, Martin A Ebert

Research output: Contribution to journalArticlepeer-review

Abstract

OBJECTIVES: Conduct a systematic review and meta-analysis on the application of the Radiomics Quality Score (RQS).

MATERIALS AND METHODS: A search was conducted from January 1, 2022, to December 31, 2023, for systematic reviews which implemented the RQS. Identification of articles prior to 2022 was via a previously published review. Quality scores of individual radiomics papers, their associated criteria scores, and these scores from all readers were extracted. Errors in the application of RQS criteria were noted and corrected. The RQS of radiomics papers were matched with the publication date, imaging modality, and country, where available.

RESULTS: A total of 130 systematic reviews were included, and individual quality scores 117/130 (90.0%), criteria scores 98/130 (75.4%), and multiple reader data 24/130 (18.5%) were extracted. 3258 quality scores were correlated with the radiomics study date of publication. Criteria scoring errors were discovered in 39/98 (39.8%) of articles. Overall mean RQS was 9.4 ± 6.4 (95% CI, 9.1-9.6) (26.1% ± 17.8% (25.3%-26.7%)). Quality scores were positively correlated with publication year (Pearson R = 0.32, p < 0.01) and significantly higher after publication of the RQS (year < 2018, 5.6 ± 6.1 (5.1-6.1); year ≥ 2018, 10.1 ± 6.1 (9.9-10.4); p < 0.01). Only 233/3258 (7.2%) scores were ≥ 50% of the maximum RQS. Quality scores were significantly different across imaging modalities (p < 0.01). Ten criteria were positively correlated with publication year, and one was negatively correlated.

CONCLUSION: Radiomics study adherence to the RQS is increasing with time, although a vast majority of studies are developmental and rarely provide a high level of evidence to justify the clinical translation of proposed models.

KEY POINTS: Question What level of adherence to the Radiomics Quality Score have radiomics studies achieved to date, has it increased with time, and is it sufficient? Findings A meta-analysis of 3258 quality scores extracted from 130 review articles resulted in a mean score of 9.4 ± 6.4. Quality scores were positively correlated with time. Clinical relevance Although quality scores of radiomics studies have increased with time, many studies have not demonstrated sufficient evidence for clinical translation. As new appraisal tools emerge, the current role of the Radiomics Quality Score may change.

Original languageEnglish
Pages (from-to)1-13
Number of pages13
JournalEuropean Radiology
DOIs
Publication statusE-pub ahead of print - 10 Jan 2025

Fingerprint

Dive into the research topics of 'Evaluating the impact of the Radiomics Quality Score: a systematic review and meta-analysis'. Together they form a unique fingerprint.

Cite this