Increasing Reliability of Direct Observation Measurement Approaches in Emotional and/or Behavioral Disorders Research Using Generalizability Theory. (August 2014)

• Record Type: Journal Article
• Authors: Gage, Nicholas A.; Prykanowski, Debra; Hirn, Regina
• Is Part Of: Behavioral disorders. Volume 39:Number 4(2014)
• Page Start: 228
• Page End: 244
• Publication Date: 2014-08
• Subjects: Behavior disorders in children -- Periodicals; Child Behavior Disorders; Comportement, Troubles du, chez l'enfant -- Périodiques; Behavior disorders in children; Trouble du comportement; Trouble affectif; Jeune; Periodicals; Periodicals; 618.9289005
• DOI: 10.1177/019874291303900407
• Languages: English
• ISSNs: 0198-7429

Abstract

Reliability of direct observation outcomes ensures the results are consistent, dependable, and trustworthy. Typically, reliability of direct observation measurement approaches is assessed using interobserver agreement (IOA) and the calculation of observer agreement (e.g., percentage of agreement). However, IOA does not address intraobserver agreement, or the withinrater agreement, analogues to internal consistency. One approach to assess both IOA and intraobserver agreement is generalizability theory. This paper describes generalizability theory and provides a case study example of using generalizability theory with direct observation measures in emotional and/or behavioral disorders research.