Inside the Black Box of Organizational Life: The Gendered Language of Performance Assessment

Organizations implement formalized procedures to eliminate the biasing effects of gender and other characteristics on evaluations. Prior work shows managers play a key role, but researchers have been unable to observe the thought processes guiding managers’ evaluations. This article takes a first step in examining managers’ sense-making as they interpret and evaluate employee behaviors. Our data include managers’ written performance reviews and numeric ratings of employees at a Fortune 500 technology company. Our theoretical model — the Viewing and Valuing Social Cognitive Processing Model — explains how and when gender beliefs frame managers’ evaluations, affecting what behaviors managers notice (i.e., view) and rate highly (i.e., value). After conducting a detailed coding of the language in reviews, we assess whether there are gender differences in (1) the language used to describe performance (i.e., viewing differences) and (2) the correlations between that language and numeric ratings (i.e., valuing differences). Our analysis of 88 language attributes reveals where gender frames managers’ evaluations and where the process instead operates gender-neutrally. For example, men and women are equally likely to be described as having technical ability, while women are viewed as too aggressive and men as too soft. Furthermore, some behaviors, such as “taking charge,” are more valued for men than for women: “taking charge” is associated with the highest performance ratings for men but not for women. Overall, our analysis identifies novel ways that gender biases emerge in a process intended to be meritocratic.