The Surveillance Error Grid. (July 2014)

• Record Type: Journal Article
• Authors: Klonoff, David C.; Lias, Courtney; Vigersky, Robert; Clarke, William; Parkes, Joan Lee; Sacks, David B.; Kirkman, M. Sue; Kovatchev, Boris
• Other Names: Aurand Lisa non-byline-author.; Benson Carol non-byline-author.; Bernhardt Patricia non-byline-author.; Blonde Lawrence non-byline-author.; Breton Mark non-byline-author.; Buckingham Bruce non-byline-author.; Cariski Alan non-byline-author.; Colburn Scott non-byline-author.; Flacke Frank non-byline-author.; Harrison Bern non-byline-author.; Herman Carol non-byline-author.; Hinzmann Rolf non-byline-author.; Johnson-Lyles Denise non-byline-author.; Karinka Shridhara Alva non-byline-author.; Landree Leslie non-byline-author.; Lebinger Tessa non-byline-author.; Lee Scott non-byline-author.; Mastrototaro John non-byline-author.; Peyser Tom non-byline-author.; Phillips Stephen non-byline-author.; Pinkos Arleen non-byline-author.; Price David non-byline-author.; Scott Steve non-byline-author.; Serrano Katherine non-byline-author.; Simmons David non-byline-author.
• Is Part Of: Journal of diabetes science and technology. Volume 8:Number 4(2014:Jul.)
• Page Start: 658
• Page End: 672
• Publication Date: 2014-07
• Subjects: error grid -- blood glucose -- monitor -- surveillance -- accuracy; Diabetes -- Periodicals; Medical technology -- Periodicals; Diabetes Mellitus -- Periodicals; 616.462005
• DOI: 10.1177/1932296814539589
• Languages: English
• ISSNs: 1932-2968

Abstract

Currently used error grids for assessing clinical accuracy of blood glucose monitors are based on out-of-date medical practices. Error grids have not been widely embraced by regulatory agencies for clearance of monitors, but this type of tool could be useful for surveillance of the performance of cleared products. Diabetes Technology Society together with representatives from the Food and Drug Administration, the American Diabetes Association, the Endocrine Society, and the Association for the Advancement of Medical Instrumentation, and representatives of academia, industry, and government, have developed a new error grid, called the surveillance error grid (SEG) as a tool to assess the degree of clinical risk from inaccurate blood glucose (BG) monitors. A total of 206 diabetes clinicians were surveyed about the clinical risk of errors of measured BG levels by a monitor. The impact of such errors on 4 patient scenarios was surveyed. Each monitor/reference data pair was scored and color-coded on a graph per its average risk rating. Using modeled data representative of the accuracy of contemporary meters, the relationships between clinical risk and monitor error were calculated for the Clarke error grid (CEG), Parkes error grid (PEG), and SEG. SEG action boundaries were consistent across scenarios, regardless of whether the patient was type 1 or type 2 or using insulin or not. No significant differences were noted between responses of adult/pediatric or 4 types of clinicians. Although small specific differences in risk boundaries between US and non-US clinicians were noted, the panel felt they did not justify separate grids for these 2 types of clinicians. The data points of the SEG were classified in 15 zones according to their assigned level of risk, which allowed for comparisons with the classic CEG and PEG. Modeled glucose monitor data with realistic self-monitoring of blood glucose errors derived from meter testing experiments plotted on the SEG when compared to the data plotted on the CEG and PEG produced risk estimates that were more granular and reflective of a continuously increasing risk scale. The SEG is a modern metric for clinical risk assessments of BG monitor errors that assigns a unique risk score to each monitor data point when compared to a reference value. The SEG allows the clinical accuracy of a BG monitor to be portrayed in many ways, including as the percentages of data points falling into custom-defined risk zones. For modeled data the SEG, compared with the CEG and PEG, allows greater precision for quantifying risk, especially when the risks are low. This tool will be useful to allow regulators and manufacturers to monitor and evaluate glucose monitor performance in their surveillance programs.