Leveraging deep learning for the detection of socially desirable tendencies in personnel selection: A proof-of-concept

TL;DR

This paper introduces a deep learning method to detect when job applicants give favorable answers in questionnaires, using video data and machine learning.

Contribution

A novel deep learning model, Entrans, is proposed to detect socially desirable responding using nonverbal visual cues from job interviews.

Findings

Entrans achieved promising performance in predicting SDR tendency with MSE = .07 and RMSE = .27.

Classification results showed an AUC of .71, indicating potential for detecting SDR.

Grad-CAM analysis revealed that Entrans focused on the middle and lower parts of the face for classification.

Abstract

We propose a deep learning-based method for detecting Socially Desirable Responding (SDR)—the tendency for individuals to distort questionnaire responses to present themselves in a favorable light. Our objective is to showcase that such novel methods can be leveraged to design instruments that have the potential to measure this construct in an effective way. Participants’ tendency to engage in SDR was initially modelled by specifying a latent variable model from Big Five personality scores, using data from 91 participants in a job application simulation (Big Five questionnaire and video introduction). Nonverbal visual cues (5,460 data points following data augmentation) were extracted from the participants’ video presentations in form of sequences of images for training a transfer learning model designated as Entrans. The objective of Entrans is to discern patterns within these cues in order to detect whether sample participants manifest higher or lower SDR tendency. We conducted a regression-based prediction task to train and evaluate Entrans, resulting in a promising performance (MSE = .07, RMSE = .27, ρ = .27). A further analysis was conducted using a classification-based prediction task, which corroborated the potential of Entrans as a tool for detecting SDR (AUC = .71). These results were further analyzed by a Grad-CAM method to elucidate the underlying model behaviors. Findings suggest that the middle and lower parts of the face were the regions relied upon by Entrans to identify individuals with higher tendency of SDR in the classification task. These tentative interpretations give rise to the suggestion that socially desirable responding in a questionnaire and impression management in a job interview might share a common underlying cause. While the detection of SDR during personnel selection presents a significant challenge for organizations, our proof-of-concept demonstrates how machine learning might be leveraged to develop practical solutions as well as addressing theoretical questions.

Figures