Please use this identifier to cite or link to this item:
Title: Variable performance of models for predicting methicillin-resistant Staphylococcus aureus carriage in European surgical wards
Author: Lee, Andie S.
Pan, Angelo
Harbarth, Stephan
Patroni, Andrea
Chalfine, Annie
Daikos, George L.
Garilli, Silvia
Martínez, José Antonio (Martínez Martínez)
Cooper, Ben S.
MOSAR-04 Study Team
Keywords: Cribratge
Staphylococcus aureus
Resistència als medicaments
Medical screening
Staphylococcus aureus
Drug resistance
Issue Date: 27-Feb-2015
Publisher: BioMed Central
Abstract: BACKGROUND: Predictive models to identify unknown methicillin-resistant Staphylococcus aureus (MRSA) carriage on admission may optimise targeted MRSA screening and efficient use of resources. However, common approaches to model selection can result in overconfident estimates and poor predictive performance. We aimed to compare the performance of various models to predict previously unknown MRSA carriage on admission to surgical wards. METHODS: The study analysed data collected during a prospective cohort study which enrolled consecutive adult patients admitted to 13 surgical wards in 4 European hospitals. The participating hospitals were located in Athens (Greece), Barcelona (Spain), Cremona (Italy) and Paris (France). Universal admission MRSA screening was performed in the surgical wards. Data regarding demographic characteristics and potential risk factors for MRSA carriage were prospectively collected during the study period. Four logistic regression models were used to predict probabilities of unknown MRSA carriage using risk factor data: 'Stepwise' (variables selected by backward elimination); 'Best BMA' (model with highest posterior probability using Bayesian model averaging which accounts for uncertainty in model choice); 'BMA' (average of all models selected with BMA); and 'Simple' (model including variables selected >50% of the time by both Stepwise and BMA approaches applied to repeated random sub-samples of 50% of the data). To assess model performance, cross-validation against data not used for model fitting was conducted and net reclassification improvement (NRI) was calculated. RESULTS: Of 2,901 patients enrolled, 111 (3.8%) were newly identified MRSA carriers. Recent hospitalisation and presence of a wound/ulcer were significantly associated with MRSA carriage in all models. While all models demonstrated limited predictive ability (mean c-statistics <0.7) the Simple model consistently detected more MRSA-positive individuals despite screening fewer patients than the Stepwise model. Moreover, the Simple model improved reclassification of patients into appropriate risk strata compared with the Stepwise model (NRI 6.6%, P = .07). CONCLUSIONS: Though commonly used, models developed using stepwise variable selection can have relatively poor predictive value. When developing MRSA risk indices, simpler models, which account for uncertainty in model selection, may better stratify patients' risk of unknown MRSA carriage.
Note: Reproducció del document publicat a:
It is part of: Bmc Infectious Diseases, 2015, vol. 15, num. 105
Related resource:
ISSN: 1471-2334
Appears in Collections:Articles publicats en revistes (Medicina)

Files in This Item:
File Description SizeFormat 
657526.pdf772.25 kBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons