This case study aims to provide real-life data and statistics to highlight the accuracy in which Talent Vibes applies artificial intelligence when shortlisting candidates applying for a job based on the video responses received to a video interview.

A recruitment case study

Context of the study


In order to gather the real-life data to validate the accuracy and ability of Talent Vibes to profile and shortlist candidates who applies for jobs 35 candidates were interviewed using the following method / approach was used:

a standard manual interview process where the candidate meets with a recruiter and a set of questions are asked and answered.
Talent Vibes intelligence to draw up a profile on the candidate from a video interview.

The candidates were interviewed for a junior software development position.

Manual interview process

The manual interview process covered the following 3 interviews:

Work environment / cultural fit, 13 questions
Personality inquiry, 8 questions
Technical questions, 10 questions

Each interview has a set of predefined questions which the interviewer asks and notes are recorded per interview. 3 different people conducted an interview with each candidate.

Talent Vibes interview process

The recruiter defines an interview survey by adding a list of questions to be answered by potential candidates to the survey. This is then published.

The recruiter then defines a personal persona that is attached to the interview survey and job role the candidates are being interviewed for on the Talent Vibes administration portal. The recruiter selects a set of personal attributes from Talent Vibes to define what qualities a person must have in order to be shortlisted for the position.

Each of the candidates then completed a video survey interview via Talent Vibes answering 7 questions. The candidate is required to submit a video response to each question. The videos for each question are uploaded to the back-end system where the responses are run through our analytics engine to draw up a scoring of the candidate against the personal persona attached the job role the candidate is interviewed for.

Traits Talent Vibes measured for this case study

Personality Traits

Artistic interest

we use this trait to measure creativity in the people we are interviewing. This indicates to us if they are creative and if they are able to tap into this creativity. Candidates had to score high on this.

Cautiousness

Someone that is careful. This might result in the person not speaking up about problems they have in the workspace or take too long to solve problems. Candidates had to score low on this.

Liberalism

equality and freedom from restrictions are important. Candidates had to score high on this.

Achievement striving

speaks for itself. Candidates had to score high on this.
Manual Interview Talent Vibes Interview
This candidate scored the 2nd highest overall score on the manual interview process. Overall score was 85%. This candidate scored the highest overall score on the Talent Vibes personal profile. Overall score was 75.39%.

Values

Needs

Openness

Being open, transparent and free. Have a collaborative nature. Candidates had to score high on this.

Conscientiousness

Do not get influenced by preconceived ideas, but uses their own inner capability to judge what is right. Candidates had to score high on this.

Social Traits

Curiosity

Open to explore and learn. Candidates had to score high on this.

Liberty

Being free from oppressive restrictive environments and situations. Candidates had to score high on this.

Ideal

Striving for what is ideal and most suitable for a situation. Candidates had to score high on this.

Challenge

People that needs to be stimulated and require an environment that is challenging. This is also people that go the extra mile on their own, without being asked. Candidates had to score high on this.

Type of person

Tentative

Reserved and lack of confidence. Candidates had to score low on this

Analytical

Good at using analytical and logical reasoning. Would troubleshoot well. Solve problems well as they can reason through the problem statement to find a suitable solution. Candidates had to score high on this.

Measuring the outcome

We compared the overall score achieved from the candidate during the manual interview process with the score assigned to the individual across the different traits we measured using Talent Vibes.
The personal details of the candidate are kept anonymous due to the responsibility we have towards the confidentially of the individuals and their information.

Here are the results.

Summary of results for 4 candidates

Consistently candidates that performed well in the manual interview score in the higher quadrant for the Talent Vibes interview and vice versa.
Scores of candidates between the manual interview and Talent Vibes interview is also in close range.

Manual Interview Talent Vibes Interview
Candidate 1, top 2 85%, second highest 75.39%, highest
Candidate 2, top 2 88%, highest 66.47%, second highest
Candidate 3, bottom 2 50%, second lowest 40.47, lowest
Candidate 4, bottom 2 63%, 9th lowest 66.5, 2nd lowest

Personality Traits

personalityresults

Values

values

Needs

needs

Social Traits

socialresults

Type of Person

typeofperson

Detailed results of 4 candidates

Candidate 1

Manual Interview Talent Vibes Interview
This candidate scored the 2nd highest overall score on the manual interview process. Overall score was 85%. This candidate scored the highest overall score on the Talent Vibes personal profile. Overall score was 75.39%.

Overall score per insight measured

Best Good Average Poor
11 3 0 4


Personality Traits

72%

Overall

59.08

Artistic Interest

50.07

Cautiousness

88.35

Liberalism

81.16

Achievement striving

82.85

Morality


Values

86%

Overall %

85.99

Openness to change


Needs

96.76%

Overall

97.96

Curiosity

94.52

Liberty

95.16

Ideal

99.40

Challenge


Social Traits

73.85%

Overall

21

Openness

31.30

Conscientiousness


Type of Person

48.35%

Overall

5.10

Tentative

1.80

Analytical

Candidate 2

Manual Interview Talent Vibes Interview
This candidate scored the highest overall score on the manual interview process. Overall score was 88%. This candidate scored the 2nd highest overall score on the Talent Vibes personal profile. Overall score was 66.47%.

Overall score per insight measured

Best Good Average Poor
10 4 1 2


Personality Traits

72.53%

Overall

62.54

Artistic Interest

70.57

Cautiousness

83.93

Liberalism

83.51

Achievement striving

62.08

Morality


Values

75.18%

Overall %

75.18

Openness to change


Needs

73.73%

Overall

94.91

Curiosity

67.16

Liberty

52.97

Ideal

79.89

Curiosity


Social Traits

46.05%

Overall

24.20

Openness

32.10

Conscientiousness


Type of Person

64.85%

Overall

5.10

Tentative

34.80

Analytical

Candidate 3

Manual Interview Talent Vibes Interview
This candidate scored the 2nd lowest overall score on the manual interview process. Overall score was 63%. Technical coding assessment and interview was very high: 92% (23/25). But personal interviews were only scored at 50% (5/10). This candidate scored the lowest overall score on the Talent Vibes personal profile. Overall score was 44.47%.

Overall score per insight measured

Best Good Average Poor
3 5 7 4


Personality Traits

39.68%

Overall

6.44

Artistic Interest

29.77

Cautiousness

68.27

Liberalism

40.56

Achievement striving

53.36

Morality


Values

12.41%

Overall %

12.41

Openness to change


Needs

46.50%

Overall

38.38

Curiosity

27.57

Liberty

37.29

Ideal

66.77

Curiosity


Social Traits

40.4%

Overall

36.90

Openness

43.90

Conscientiousness


Type of Person

67.35%

Overall

0

Tentative

34.70

Analytical

Candidate 4

Manual Interview Talent Vibes Interview
This candidate scored the 9th lowest overall score on the manual interview process. Overall score was 63%. This candidate scored the 4th lowest overall score on the Talent Vibes personal profile. Overall score was 66.5%.

Overall score per insight measured

Best Good Average Poor
8 0 5 6


Personality Traits

58.73%

Overall

90.81

Artistic Interest

20.87

Cautiousness

99.67

Liberalism

38.80

Achievement striving

43.49

Morality


Values

92.55%

Overall %

92.55

Openness to change


Needs

76.32%

Overall

99.29

Curiosity

82.09

Liberty

91.28

Ideal

39.61

Challenge


Social Traits

51.3%

Overall

17.80

Openness

15.20

Conscientiousness


Type of Person

53.6%

Overall

7.50

Tentative

14.70

Analytical