A novel study evaluation strategy in the systematic review of animal toxicology studies for human health assessments of environmental chemicals. (August 2020)

• Record Type: Journal Article
• Authors: Dishaw, Laura; Yost, Erin; Arzuaga, Xabier; Luke, April; Kraft, Andrew; Walker, Teneille; Thayer, Kris
• Is Part Of: Environment international. Volume 141(2020)
• Publication Date: 2020-08
• Subjects: Systematic review -- Study evaluation -- Phthalates; DEP Diethyl Phthalate -- DIBP Diisobutyl Phthalate -- EPA Environmental Protection Agency -- GD Gestational Day -- HAWC Health Assessment Workspace Collaborative -- IRIS Integrated Risk Information Systems -- MOA Mode of Action -- NAS National Academy of Sciences; Environmental protection -- Periodicals; Environmental health -- Periodicals; Environmental monitoring -- Periodicals; Environmental Monitoring -- Periodicals; Environnement -- Protection -- Périodiques; Hygiène du milieu -- Périodiques; Environnement -- Surveillance -- Périodiques; Environmental health; Environmental monitoring; Environmental protection; Periodicals; 333.705
• DOI: 10.1016/j.envint.2020.105736
• Languages: English
• ISSNs: 0160-4120

Abstract

Highlights: This paper presents a novel animal study evaluation method for systematic reviews. The method incorporates concepts of reporting quality, risk of bias and sensitivity. Subject matter expertise of the reviewers inform specific considerations. Domain and confidence ratings are generally made at the outcome level vs study. Examples from DIBP and DEP reviews are presented. Abstract: A key aspect of the systematic review process is study evaluation to understand the strengths and weaknesses of individual studies included in the review. The present manuscript describes the process currently being used by the Environmental Protection Agency's (EPA) Integrated Risk Information System (IRIS) Program to evaluate animal toxicity studies, illustrated by application to the recent systematic reviews of two phthalates: diisobutyl phthalate (DIBP) and diethyl phthalate (DEP). The IRIS Program uses a domain-based approach that was developed after careful consideration of tools used by others to evaluate experimental animal studies in toxicology and pre-clinical research. Standard practice is to have studies evaluated by at least two independent reviewers for aspects related to reporting quality, risk of bias/internal validity (e.g., randomization, blinding at outcome assessment, methods used to expose animals and assess outcomes, etc.), and sensitivity to identify factors that may limit the ability of a study to detect a true effect. To promote consistency across raters, prompting considerations and example responses are provided to reviewers, and a pilot phase is conducted. The evaluation process is performed separately for each outcome reported in a study, as the utility of a study may vary for different outcomes. Input from subject matter experts is used to identify chemical- and outcome-specific considerations (e.g., lifestage of exposure and outcome assessment when considering reproductive effects) to guide judgments within particular evaluation domains. For each evaluation domain, reviewers reach a consensus on a rating of Good, Adequate, Deficient, or Critically Deficient . These individual domain ratings are then used to determine the overall confidence in the study ( High Confidence, Medium Confidence, Low Confidence, or Deficient ). Study evaluation results, including the justifications for reviewer judgements, are documented and made publicly available in EPA's version of Health Assessment Workspace Collaborative (HAWC), a free and open source web-based software application. ( The views expressed are those of the authors and do not necessarily represent the views or policies of the US EPA).