"Is, or is not, the two great ends of Fate": Errors in Agronomic Research. (1st March 2015)

• Record Type: Journal Article
• Authors: Campbell, Kimberly Garland; Thompson, Yvonne M.; Guy, Stephen O.; McIntosh, Marla; Glaz, Barry
• Is Part Of: Agronomy Journal. Volume 107:Number 2(2015)
• Page Start: 718
• Page End: 729
• Publication Date: 2015-03-01
• Subjects: Agronomy -- Periodicals; 630
• DOI: 10.2134/agronj14.0167
• Languages: English
• ISSNs: 0002-1962

Abstract

Abstract : Agronomic research results include Type 1 (α) and Type 2 (β) errors. Results are often reported using α ≤ 0.05 while β is ignored. Our objective was to discuss whether a false positive was more serious than a false negative in agronomic research. For comparison, current statistical methods used in Agronomy Journal were tabulated. Most papers used null hypothesis tests with α ≤ 0.05, reporting results based on the LSD among all treatment pairs. Current practices do not account for the relative costs of false positive vs. false negative errors. A case study from the Washington State Wheat Extension trials was analyzed using mixed models with specific contrasts. While the overall effect for cultivar was significant, the β error rate for the contrast was 40% and additional replications were needed to increase the power of this contrast. A second case study analyzed trials evaluating wheat ( Triticum aestivum L.) resistance to Fusarium crown rot. Optimal α and β error rates were estimated for two to eight replications with the Type1/Type2 error cost ratio set at 1:1 and 1:5. An average error rate (α and β) ≤ 0.05 could be achieved with four replications when a reduction in the β error was critical and α errors could be corrected in future experiments. Effective experimental design requires estimation of the acceptable magnitude and cost ratio of false positive and false negative errors and critical effect sizes. To be truly informative, reports of results should include this information plus observed effect sizes and variances.