What are we optimizing for in autism screening? Examination of algorithmic changes in the M‐CHAT. Issue 2 (26th November 2021)

• Record Type: Journal Article
• Authors: Schjølberg, Synnve; Shic, Frederick; Volkmar, Fred R.; Nordahl‐Hansen, Anders; Stenberg, Nina; Torske, Tonje; Larsen, Kenneth; Riley, Katherine; Sukhodolsky, Denis G.; Leckman, James F.; Chawarska, Katarzyna; Øien, Roald A.
• Is Part Of: Autism research. Volume 15:Issue 2(2022)
• Page Start: 296
• Page End: 304
• Publication Date: 2021-11-26
• Subjects: children -- early detection -- psychometrics; Autism -- Periodicals; Autism -- Research -- Periodicals; 616.85882005
• DOI: 10.1002/aur.2643
• Languages: English
• ISSNs: 1939-3792

Abstract

Abstract: The present study objectives were to examine the performance of the new M‐CHAT‐R algorithm to the original M‐CHAT algorithm. The main purpose was to examine if the algorithmic changes increase identification of children later diagnosed with ASD, and to examine if there is a trade‐off when changing algorithms. We included 54, 463 screened cases from the Norwegian Mother and Child Cohort Study. Children were screened using the 23 items of the M‐CHAT at 18 months. Further, the performance of the M‐CHAT‐R algorithm was compared to the M‐CHAT algorithm on the 23‐items. In total, 337 individuals were later diagnosed with ASD. Using M‐CHAT‐R algorithm decreased the number of correctly identified ASD children by 12 compared to M‐CHAT, with no children with ASD screening negative on the M‐CHAT criteria subsequently screening positive utilizing the M‐CHAT‐R algorithm. A nonparametric McNemar's test determined a statistically significant difference in identifying ASD utilizing the M‐CHAT‐R algorithm. The present study examined the application of 20‐item MCHAT‐R scoring criterion to the 23‐item MCHAT. We found that this resulted in decreased sensitivity and increased specificity for identifying children with ASD, which is a trade‐off that needs further investigation in terms of cost‐effectiveness. However, further research is needed to optimize screening for ASD in the early developmental period to increase identification of false negatives. Lay Summary: No study to this date has examined how the change in algorithm between the M‐CHAT and the M‐CHAT‐R affects the identification of ASD. The items and the instrument are very similar, but it has not been examined if the algorithm increases the identification rate of ASD. In this study, we utilized the Norwegian Mother, Father and Child study to examine how well the algorithm of the M‐CHAT performed in identifying children with ASD compared to the algorithm of the M‐CHAT‐R. Our study sample included 54, 463 children, whereas 337 later received an ASD diagnosis. This present study shows that a change in algorithm is not necessarily improving the measure, as it did not increase the identification of children with ASD. However, the algorithmic change effectively decreased the number of children falsely identified at risk.