RoB-SPEO: A tool for assessing risk of bias in studies estimating the prevalence of exposure to occupational risk factors from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury - Université d'Angers Accéder directement au contenu
Article Dans Une Revue Environment International Année : 2020

RoB-SPEO: A tool for assessing risk of bias in studies estimating the prevalence of exposure to occupational risk factors from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury

Susan Norris
  • Fonction : Auteur
Claudine Backes
  • Fonction : Auteur
Lisa Bero
  • Fonction : Auteur
Diana Gagliardi
  • Fonction : Auteur
Lode Godderis
  • Fonction : Auteur
Tom Loney
  • Fonction : Auteur
Alberto Modenese
  • Fonction : Auteur
Rebecca Morgan
Daniela Pachito
  • Fonction : Auteur
Marilia B.S. Paulo
  • Fonction : Auteur
Paul T.J. Scheepers
  • Fonction : Auteur
Daria Sgargi
  • Fonction : Auteur
Kathrine Sørensen
  • Fonction : Auteur
Patrice Sutton
  • Fonction : Auteur
Thomas Tenkate
  • Fonction : Auteur
Yuka Ujita
  • Fonction : Auteur
Emilie van Deventer
  • Fonction : Auteur
Daniele Mandrioli
  • Fonction : Auteur

Résumé

Background The World Health Organization (WHO) and the International Labour Organization (ILO) are developing joint estimates of the work-related burden of disease and injury (WHO/ILO Joint Estimates). For this, systematic reviews of studies estimating the prevalence of exposure to selected occupational risk factors will be conducted to provide input data for estimations of the number of exposed workers. A critical part of systematic review methods is to assess risk of bias (RoB) of individual studies. In this article, we present and describe the development of such a tool, called the Risk of Bias in Studies estimating Prevalence of Exposure to Occupational risk factors (RoB-SPEO) tool; report results from RoB-SPEO's pilot testing; note RoB-SPEO's limitations; and suggest how the tool might be tested and developed further. Methods Selected existing RoB tools used in environmental and occupational health systematic reviews were reviewed and analysed. From existing tools, we identified domains for the new tool and, if necessary, added new domains. For each domain, we then identified and integrated components from the existing tools (i.e. instructions, domains, guiding questions, considerations, ratings and rating criteria), and, if necessary, we developed new components. Finally, we elicited feedback from other systematic review methodologists and exposure scientists and agreed upon RoB-SPEO. Nine experts pilot tested RoB-SPEO, and we calculated a raw measure of inter-rater agreement (Pi) for each of its domain, rating Pi < 0.4 as poor, 0.4 ≤ Pi ≥ 0.8 as substantial and Pi > 0.80 as almost perfect agreement. Results Our review found no standard tool for assessing RoB in prevalence studies of exposure to occupational risk factors. We identified six existing tools for environmental and occupational health systematic reviews and found that their components for assessing RoB differ considerably. With the new RoB-SPEO tool, assessors judge RoB for each of eight domains: (1) bias in selection of participants into the study; (2) bias due to a lack of blinding of study personnel; (3) bias due to exposure misclassification; (4) bias due to incomplete exposure data; (5) bias due to conflict of interest; (6) bias due to selective reporting of exposures; (7) bias due to difference in numerator and denominator; and (8) other bias. The RoB-SPEO's ratings are low, probably low, probably high, high or no information. Pilot testing of the RoB-SPEO tool found substantial inter-rater agreement for six domains (range of Pi for these domains: 0.51–0.80), but poor agreement for two domains (i.e. Pi of 0.31 and 0.33 for biases due to incomplete exposure data and in selection of participants into the study, respectively). Limitations of RoB-SPEO include that it has not yet been fully performance-tested. Conclusions We developed the RoB-SPEO tool for assessing RoB in prevalence studies of exposure to occupational risk factors. The tool will be applied and its performance tested in the ongoing systematic reviews for the WHO/ILO Joint Estimates.
Fichier principal
Vignette du fichier
Pega-2020-EnvironIntern.pdf (760.37 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02446083 , version 1 (04-03-2020)

Licence

Paternité

Identifiants

Citer

Frank Pega, Susan Norris, Claudine Backes, Lisa Bero, Alexis Descatha, et al.. RoB-SPEO: A tool for assessing risk of bias in studies estimating the prevalence of exposure to occupational risk factors from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury. Environment International, 2020, 135, pp.105039. ⟨10.1016/j.envint.2019.105039⟩. ⟨hal-02446083⟩
103 Consultations
238 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More