Riley, RD and Ahmed, I and Debray, TP and Willis, BH and Noordzij, JP and Higgins, JP and Deeks, JJ (2015) Summarising and validating test accuracy results across multiple studies for use in clinical practice. Stat Med, 34 (13). 2081 - 2103. ISSN 0277-6715

[img]
Preview
Text
R Riley - Summarising and validating test accuracy results across multiple studies for use in clinical practice.pdf - Published Version
Available under License Creative Commons Attribution.

Download (716kB) | Preview

Abstract

Following a meta-analysis of test accuracy studies, the translation of summary results into clinical practice is potentially problematic. The sensitivity, specificity and positive (PPV) and negative (NPV) predictive values of a test may differ substantially from the average meta-analysis findings, because of heterogeneity. Clinicians thus need more guidance: given the meta-analysis, is a test likely to be useful in new populations, and if so, how should test results inform the probability of existing disease (for a diagnostic test) or future adverse outcome (for a prognostic test)? We propose ways to address this. Firstly, following a meta-analysis, we suggest deriving prediction intervals and probability statements about the potential accuracy of a test in a new population. Secondly, we suggest strategies on how clinicians should derive post-test probabilities (PPV and NPV) in a new population based on existing meta-analysis results and propose a cross-validation approach for examining and comparing their calibration performance. Application is made to two clinical examples. In the first example, the joint probability that both sensitivity and specificity will be >80% in a new population is just 0.19, because of a low sensitivity. However, the summary PPV of 0.97 is high and calibrates well in new populations, with a probability of 0.78 that the true PPV will be at least 0.95. In the second example, post-test probabilities calibrate better when tailored to the prevalence in the new population, with cross-validation revealing a probability of 0.97 that the observed NPV will be within 10% of the predicted NPV.

Item Type: Article
Subjects: R Medicine > RA Public aspects of medicine
Divisions: Faculty of Medicine and Health Sciences > Primary Care Health Sciences
Related URLs:
Depositing User: Symplectic
Date Deposited: 17 Dec 2015 11:16
Last Modified: 17 Dec 2015 11:16
URI: http://eprints.keele.ac.uk/id/eprint/1316

Actions (login required)

View Item View Item