6 Putting it all together: from net effect estimate to the certainty of net benefit. Issue Volume 23:Issue Supplement 1(2018) (June 2018)

• Record Type: Journal Article
• Authors: Alper, Brian; Ehrlich, Alan; Oettgen, Peter
• Is Part Of: BMJ evidence-based medicine. Volume 23:Issue Supplement 1(2018)
• Page Start: A3
• Page End: A4
• Publication Date: 2018-06
• Subjects: Evidence-based medicine -- Periodicals; 616.005
• DOI: 10.1136/bmjebm-2018-111024.6
• Languages: English
• ISSNs: 2515-446X

Abstract

Abstract : Objectives: An evidence-based approach to clinical practice guidelines includes expressing the confidence that the desirable consequences outweigh the undesirable consequences for a particular recommendation. This is often done by expressing the strength of recommendation and the quality of evidence. The overall quality of evidence rating however is not the same thing as the confidence in the evidence that the summation of beneficial effects outweighs the summation of harmful effects. The objective of this year's workshop is to extend the concepts of last year's well-received workshop on determination of the net effect estimate and review how one can rate the certainty of net benefit. Method: Members of the GRADE Working Group struggling with how to convey the concept of Overall Certainty of Evidence for a concept when fully contextualised in the guideline development process came to realise that directly expressing Certainty of Net Benefit would be clearer and more useful for guideline users. The workshop facilitators have actively developed a protocol for determining the Certainty of Net Benefit and applied it to numerous examples. The concept is currently in development within the GRADE Working Group and is not current GRADE guidance. Results: The 7-step process to determine the Certainty of Net Benefit is: determine the outcomes to be combined for a net effect estimate; determine the relative importance for each outcome to be combined; determine the importance–adjusted effect estimate for each outcome to be combined; determine the net effect estimate upon combining the importance–adjusted effect estimates; consider the precision of the net effect estimate and its influence on the certainty of net benefit or harm; consider which outcomes are potential differentiators for the likelihood of net benefit and the certainty of effect estimates for potentially differentiating outcomes; and consider the range of relative importance for outcomes and if the net effect estimate across the range of relative importance changes the Certainty of Net Benefit rating. Conclusions: The Certainty of Net Benefit is a clearer way of expressing the overall confidence that the benefits outweigh harms for a particular decision or recommendation. The 7-step process allows guideline developers to explicitly determine and rate the certainty of net benefit. Workshop participants will determine the Certainty of Net Benefit for a sample recommendation.