Inter-rater agreement in defining chemical incidents at the National Poisons Information Service, London. Issue 8 (13th July 2004)

• Record Type: Journal Article
• Authors: Abubakar, I; Leonardi, G S; Edwards, N; Herriott, N
• Is Part Of: Journal of epidemiology and community health. Volume 58:Issue 8(2004)
• Page Start: 718
• Page End: 722
• Publication Date: 2004-07-13
• Subjects: Inter-rater agreement -- chemical incidents -- surveillance -- toxicology; Public health -- Periodicals; Epidemiology -- Periodicals; 614.4
• DOI: 10.1136/jech.2002.006650
• Languages: English
• ISSNs: 0143-005X

Abstract

Abstract : Background: National surveillance for chemical incidents is being developed in the UK. It is important to improve the quality of information collected, standardise techniques, and train personnel. Objective: To define the extent to which eight National Poison Information Service specialists in poison information agree on the classification of calls received as "chemical incidents" based on the national definition. Design: Blinded, inter-rater reliability measured using the κ statistic for multiple raters. Setting: National Poison Information Service and Chemical Incident Response Service, Guy's and St Thomas's NHS Trust, London. Participants: Eight specialists in poison information who are trained and experienced in handling poisons information calls and have been involved in extracting information for surveillance. Results: The overall level of agreement observed was at least 69% greater than expected by chance (κ statistic). Fire and incidents where chemicals were released within a property had a very good level of agreement with κ statistic of 83% and 80% respectively. The lowest level of agreement was observed when no one or only one person was exposed to a chemical (33%) and when the chemical was released into the air (48%). Conclusion: High levels of agreement were observed. There is a need for more training and improvement in consistency of the data collected by all organisations.