Assessing Raters: What Factors Predict Discernment in Novice Creativity Raters?. (18th July 2021)
- Record Type:
- Journal Article
- Title:
- Assessing Raters: What Factors Predict Discernment in Novice Creativity Raters?. (18th July 2021)
- Main Title:
- Assessing Raters: What Factors Predict Discernment in Novice Creativity Raters?
- Authors:
- Ceh, Simon Majed
Edelmann, Carina
Hofer, Gabriela
Benedek, Mathias - Abstract:
- Abstract: Creativity research crucially relies on creativity evaluations by external raters, but it is not clear what properties characterize good raters. In the present study, we investigated whether rater personality and rater creativity are related to discernment (i.e., the ability to distinguish creative from uncreative responses) when evaluating others' responses. To this end, 166 novice raters evaluated a pre‐selected set of responses from the alternate uses task for creativity. We further assessed the rater's creativity and personality and explored the role of task factors such as rating motivation and rating time. We found that creativity in terms of creative potential and creative achievement independently predicted rater discernment. At the level of personality, openness to experience was related to higher discernment, but not any other Big‐Five factors or dark triad traits. Rater discernment also increased with rating time, rating motivation, and rater leniency (i.e., the tendency to appreciate creative responses). Finally, we seized the large rater sample to estimate to what extent inter‐rater reliability depends on rater number and how dependable ratings are across the rating scale. Together, these findings highlight relevant factors at person, task, and method level predicting individual discernment, which should be considered to ensure good inter‐rater reliability in creativity ratings.
- Is Part Of:
- Journal of creative behavior. Volume 56:Number 1(2022)
- Journal:
- Journal of creative behavior
- Issue:
- Volume 56:Number 1(2022)
- Issue Display:
- Volume 56, Issue 1 (2022)
- Year:
- 2022
- Volume:
- 56
- Issue:
- 1
- Issue Sort Value:
- 2022-0056-0001-0000
- Page Start:
- 41
- Page End:
- 54
- Publication Date:
- 2021-07-18
- Subjects:
- assessment -- cognition -- creativity -- evaluation -- personality
Creative ability -- Periodicals
Creativeness -- Abstracts
Creativeness -- Periodicals
Education -- Abstracts
Education -- Periodicals
Créativité -- Périodiques
153.35 - Journal URLs:
- http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)2162-6057 ↗
http://search.ebscohost.com/direct.asp?db=ehh&jid=3U7&scope=site ↗
http://onlinelibrary.wiley.com/ ↗ - DOI:
- 10.1002/jocb.515 ↗
- Languages:
- English
- ISSNs:
- 0022-0175
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 4965.500000
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 21178.xml