Generalizability is not optional: insights from a cross-cultural study of social discounting. Issue 2 (27th February 2019)

• Record Type: Journal Article
• Authors: Tiokhin, Leonid; Hackman, Joseph; Munira, Shirajum; Jesmin, Khaleda; Hruschka, Daniel
• Is Part Of: Royal Society open science. Volume 6:Issue 2(2019)
• Publication Date: 2019-02-27
• Subjects: social discounting -- cross-cultural differences -- replication -- generalizability -- sample diversity; Science -- Periodicals; 500
• DOI: 10.1098/rsos.181386
• Languages: English
• ISSNs: 2054-5703

Abstract

Abstract : Current scientific reforms focus more on solutions to the problem of reliability (e.g. direct replications) than generalizability. Here, we use a cross-cultural study of social discounting to illustrate the utility of a complementary focus on generalizability across diverse human populations. Social discounting is the tendency to sacrifice more for socially close individuals—a phenomenon replicated across countries and laboratories. Yet, when adapting a typical protocol to low-literacy, resource-scarce settings in Bangladesh and Indonesia, we find no independent effect of social distance on generosity, despite still documenting this effect among US participants. Several reliability and validity checks suggest that methodological issues alone cannot explain this finding. These results illustrate why we must complement replication efforts with investment in strong checks on generalizability. By failing to do so, we risk developing theories of human nature that reliably explain behaviour among only a thin slice of humanity.