Strategic Staffing Third Edition
Chapter 9
Assessing
External
Candidates
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Learning Objectives
After studying this chapter, you should be able to:
• Identify different external assessment goals.
• Describe what is meant by an assessment plan.
• Describe different assessment methods and how each
is best used.
• Discuss how to evaluate external assessment methods.
• Identify ways to reduce the adverse impact of an
assessment method.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
External Assessment Goals
• Maximize fit
• Accurate assessment
• Maximize return on investment
• Generate positive stakeholder reactions
• Support talent philosophy and HR strategy
• Establish and reinforce employer image
• Identify new hires’ development needs
• Assess ethically
• Ensure legal compliance
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Complementary and Supplementary
Fit (1 of 2) Table 9-1 Dimensions of Fit
Type of Fit Possible Dimensions of Fit
Person-Job Fit: the potential of
an individual to meet the needs of a particular
job and the potential of the job to meet the
needs of the individual
Intelligence
Job-related skills and competencies
Job knowledge
Previous experience
Personality related to performing job tasks
Person-Group Fit: the match between
individuals and their work groups, including
their supervisors
Teamwork skills
Expertise relative to other team members
Conflict management style
Preference for team-based work
Communication skills
Personality related to working well with others
Person-Organization Fit: the fit
between an individual’s values, beliefs, and
personality and the values, norms, and
culture of the organization
Alignment between one’s personal
motivations and the organization’s purpose
Values
Goals
Person-Vocation Fit: the fit between an
individual’s interests, abilities, values, and
personality and his or her occupation
Aptitudes
Interests
Personal values
Long-term goals
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Complementary and Supplementary
Fit (2 of 2)
• Complementary fit: when a person adds something
that is missing in the organization or work group by
being different from the others
• Supplementary fit: when a person has characteristics
that are similar to those that already exist in the
organization
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Possible Assessment Outcomes
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Dollar Return on Investment Table 9-2 Return on Investment Formulas
Economic value of improved performance = (Nh × T × rxy × Zy) – (Na × Ca × SR)
Savings from avoiding bad hires = (Nh × HA × CBH) – (Na × Ca)
ROI = Economic value of improved performance + Savings from avoiding bad hires
Where:
Nh = Number of people hired
T = Average number of years employees stay in the position
rxy = Correlation between assessment method and job performance (the amount of
improvement in job performance from using the assessment method)
Zy = Dollar value of improved job performance using the new assessment method
(default value = 40 percent of average base salary)
Na = Number of job candidates assessed
Ca = Cost per assessment
SR = Selection ratio (the number of candidates assessed before making a hiring decision)
HA = Percentage of bad hires avoided (default value 5 percent)
CBH = Average cost of a bad hire (default value $7,500)
ROI = Dollar return on the assessment method investment
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Return on Investment
• The savings from avoiding bad hires reflect the fact that
bad hires can actually cost the organization money.
• The return on investment from a new assessment method
is the sum of the economic value of improved performance
and the savings from avoiding bad hires.
• Although staffing should be seen as an investment rather
than a cost, cost is still important for many companies that
simply don’t have the money to invest in more expensive
systems even if they are more accurate at identifying the
best new hires.
• The formula provides a way to estimate the return on
investment of any new assessment method.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Identify Development Needs
Assessment tests can also identify new hires’
developmental needs.
• If a top candidate’s assessment scores show that his or her
organization and time management skills are good but their
customer service skills need further development, post-hire
training can improve these skills.
Some assessment methods even identify applicants’
preferred learning styles, which can decrease training time,
improve training effectiveness, and increase retention.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Legal Compliance (from the UGESP) A test of knowledge and abilities must measure a representative sample of
knowledge, skills, or abilities necessary to perform the job and be operationally
defined.
Knowledge
• Must be defined in terms of behavior.
• Each knowledge must be part of a body of learned information that is used in and
necessary for required and observable job behaviors.
Abilities
• Must be defined in terms of observable aspects of job behavior.
• Each ability should be necessary for the performance of important work behaviors.
• Any selection procedure measuring an ability should closely approximate an
observable work behavior.
To the extent that the setting and manner of the administration of the selection
procedure fail to resemble the work situation, it is less likely that the selection
procedure is content valid, and the need for other validity evidence is greater.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Hiring Stages When people first apply for a job, they are considered job
applicants and are evaluated against the minimum acceptable
criteria for the job, such as relevant education and skills.
Those applicants passing the initial screen are considered job
candidates and are assessed in more depth to evaluate their
characteristics and qualifications as defined by the job specification
as well as on dimensions relevant to person-organization and even
person-group and person-supervisor fit.
• A series of evaluative assessments are often performed, with the lowest
performing candidates being screened out after each phase.
The organization then makes its hiring decision from the group of
finalists that remains after all assessment methods have been
completed.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Some External Assessment
Methods (1 of 2)
Screening Methods
• Resumes and cover letters
• Job applications and weighted application blanks
• Biographical information
• Telephone screens
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Some External Assessment
Methods (2 of 2)
Evaluative Methods • Cognitive and noncognitive ability tests
• Values assessments
• Personality assessments
• Integrity tests
• Polygraph tests
• Job knowledge tests
• Behavioral, situational, and case interviews
• Situational judgment tests
• Graphology
• Job simulations
• Work samples
• Reference checks
Contingent Methods • Medical and drug tests, and background checks
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Comparison of Commonly Used
Assessment Methods Table 9-3 A Comparison of Some Commonly Used External Assessment Methods
Assessment Method Average
Validity
Applicant
Reactions
Relative Costs
(Development/Administration)
Adverse
Impact
Usability
Assessment centers .37 Good High/High Low Difficult
Cognitive ability tests .51 Good Low/Low High Easy
Integrity tests .41 Low Low/Low Low Easy
Job knowledge tests .48 Good High/Low Low Easy
Reference checks .26 Good Low/Low Low Easy
Situational judgment tests .34 Good High/Low Low Moderate
Structured interviews .51–.63 Good High/High Mixed Moderate
Unstructured interviews .20–.38 OK Low/High Mixed Easy
Personality testing –.13–.33 Good High/Low Low Easy
Biodata .35 Good High/Low Low Easy
Graphology .02 Low High/High Low Low
Weighted application forms .50 Good High/Low Low Easy
Simulations .54 Good High/High Low Difficult
Work samples .54 Good High/High Low Difficult
*Validity values range from –1 to 1, with numbers closer to –1 or +1 reflecting better prediction of job performance.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Weighted Application Blank
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Biodata Table 9-5 Sample Biodata Items
Choose the best response to each question.
1. How many different paying jobs have you held for more than two weeks in the
past year?
a. 5–6
b. 3–4
c. 1–2
d. None
2. In my leisure time, the activities I most enjoy doing are:
b. Team sports
c. Individual sports
d. Reading
e. Social activities
f. None of the above
3. Have any of your family ever worked in this industry?_____ Yes_____ No
4. Have you ever repaired small motors at home?_____ Yes_____ No
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Cognitive Ability Tests Table 9-6 Cognitive Ability Test Items
The following questions are like those found on the Wonderlic Personnel Test
measuring cognitive ability. The answers are at the bottom of the table. 1. Assume the first two statements are true. Is the final one (1) True, (2) False, (3) Not
certain? • The girl plays basketball.
• All basketball players wear hats.
• The girl wears a hat.
2. Pencils sell for $0.17 each. What will four pencils cost?
3. How many of the five pairs of items listed below are exact duplicates? Smith, T. J. Smith, J. T.
Liao, G. K. Liao, G. K.
Barry, P. P. Barry, J. P.
Kovich, L. E. Kovich, E. E.
Garcia, T. S. Garcia, T. S.
4. DEMAND DEFILE—Do these words 1. Have similar meanings?
2. Have contradictory meanings?
3. Mean neither the same nor opposite?
Answers: (1) True, (2) 68 cents, (3) 2, (4) 3
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Steps in Crafting a Structured
Interview Table 9-7 Steps to Crafting a Structured Interview
1. For the job requirements to be measured by a structured interview, identify the
actions and behaviors that illustrate each qualification. For example, what does
leadership skills mean in the context of the job being filled? What do people with
good and bad leadership skills do? What is the impact of different leadership
strategies? Are different leadership approaches equally effective?
2. Write questions that will generate relevant information about the degree to which
candidates possess each job requirement.
3. Create an answer key with benchmark responses for at least the high, middle, and
low scores on the scale.
4. Weight the benchmark responses based on the importance of each question relative
to the others. Give more important questions greater weight relative to the other
questions.
5. Select and train interviewers to increase the interview’s standardization, reliability,
and validity.
6. Evaluate the effectiveness of the structured interview in terms of its validity and the
reactions of stakeholders, including how fair and job related they perceive it to be.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Types of Structured Interviews
• Behavioral interviews: using information about what the
applicant has done in the past to predict future behaviors
• Situational interviews: asking people how they might
react to hypothetical situations
• Case interviews: give the candidate a situation,
problem, or challenge and ask him or her to address and
resolve it.
• All three outperform unstructured interviews and result in
scores that can be used to compare candidates
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Behavioral Interview Question Table 9-8 A Behavioral Interview Question Assessing a
Candidate’s Persistence
Question: Tell me about a time when you were working on a project that
you felt was important but that others thought was a waste of time. What
did you do, and what was the result?
5—Excellent: I pursued the project despite the obstacles because I
really believed in it. I wanted the project to succeed and I tried to find
ways around problems.
4
3—Marginal: I continued working on the project but shifted my focus to
other projects that had higher probabilities of success.
2
1—Poor: Once I felt that the project had low support, I stopped working
on it.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Situational Interview Question Table 9-9 A Situational Interview Question Assessing a
Candidate’s Communication Skills
Question: Imagine that you are currently very busy working on several
important projects with firm deadlines, but your supervisor brings you a
stack of unrelated paperwork to complete that you feel is unrelated to any of
your projects. In addition, you are certain that attending to this new
paperwork will cause you to miss several project deadlines. What would you
do?
5—Excellent: Explain the conflict to my supervisor and try to identify and
discuss alternatives. It would be important to me to ensure that any changes
were acceptable to both my manager and myself.
4
3—Marginal: Tell my supervisor about the conflict.
2
1—Poor: Accept the conflict as part of the job and do the best I can.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
STAR Technique
• A technique for answering behavioral interview questions:
• Situation or Task: describe in enough detail for the
interviewer to understand the situation and what you
needed to accomplish
• Action that you took
• Results that you achieved
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Evaluating an Assessment Method’s
Effectiveness (1 of 2)
Validity—whether the assessment method predicts
relevant components of job performance
Return on investment—whether the assessment method
generates a financial return that exceeds the cost
associated with using it
Applicant reactions—including the perceived job
relatedness and fairness of the assessment method;
perceiving sufficient opportunity to perform, or believing
that one had an adequate opportunity to demonstrate
one’s ability to do the job, influences perceptions of the
fairness of the selection process, particularly if the person
is rejected for the job
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Evaluating an Assessment Method’s
Effectiveness (2 of 2)
Selection ratio—having a low selection ratio means hiring
only a few applicants, which allows an assessment method
to have maximum impact in improving the performance of
the people hired
Usability—people in the organization must be willing and
able to use the method consistently and correctly
Adverse impact—an assessment method is more effective
if it predicts job performance and other important hiring
outcomes without discriminating against members of a
protected class
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Reducing Adverse Impact (1 of 2) • Using targeted recruitment to increase the numbers of qualified
minority applicants
• Expanding the definition of job performance to include areas of
contextual performance such as commitment and reliability in
addition to task performance
• Combining predictors can reduce adverse impact – if a cognitive
ability test predicts job performance but discriminates against
women, using it in conjunction with another valid assessment
method that either does not have any adverse impact based on
sex or that discriminates against men, can reduce or eliminate
the adverse impact of the cognitive ability test
• Using well-developed simulations rather than cognitive ability
tests
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Reducing Adverse Impact (2 of 2) If only a few applicants are ultimately hired (low selection ratio),
using assessment methods with less adverse impact early in the
selection process and those with greater adverse impact later in
the process
Using banding and assigning the same score to applicants who
score in a range on the assessment
• Think of grades – students scoring from 93 to 100% are placed in the
“A” band, from 85 to 95% are placed into the “B” band, etc.
• Only the banded score (A, B, C, etc.) is used to compare applicants
• This technique can reduce an assessment’s adverse impact but will
also reduce the validity of the test
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Assessment Plan (1 of 2) After creating a job requirements matrix, the next step is to identify
the best way of assessing each important job qualification.
The assessment plan describes:
• Which assessment method(s) will be used to assess each of the
characteristics on which applicants will be evaluated
• In what sequence the assessments will take place
• What weight each assessment will receive in determining an overall
score for that characteristic based on the importance of each
characteristic to job performance.
Characteristics that will be trained after hire are not assigned to
any assessment method, but any existing qualifications required
to qualify for the training program should be listed.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Assessment Plan (2 of 2) Table 9-10 An Example of an Assessment Plan for an Accountant
Assessment Method and Its Sequence in the Assessment Process
Characteristic
Importance of
Characteristic
to Job
Performance
(1 = most
important)
Select (S)
Train (T) Résumé
Phone
Screen
Accounting
and
Budgeting
Test
Recruiter
Interview Simulation
Hiring
Manager
Interview
Customer focus 1 S 1 (.15) 2 (.15) blank 3 (.20) 4 (.25) 5 (.25)
Accounting skills 1 S 1 (.15) 2 (.15) 3 (.40) blank 4 (.30) blank
Budgeting skills 1 S 1 (.20) 2 (.20) 3 (.25) blank 4 (.35) blank
Time management
skills
2 S blank blank blank 1 (.30) 2 (.40) 3 (.30)
Delegating skills 2 S blank 1 (.20) blank 2 (.40) 3 (.40) blank
Ability to use
company’s
accounting software
3 T blank blank blank blank blank blank
Attention to detail 3 S blank 1 (.25) blank 2 (.25) 3 (.50) blank
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Choosing Assessment Methods • The choice should be based on which methods best assess the
applicant characteristics or competencies identified as important
during the job analysis as well as the ability of the assessment
method to meet other important goals of the external
assessment process.
• Because different methods are good at assessing different
things, and differ in their cost, validity, applicant reactions, and
adverse impact, it is often necessary to use more than one
assessment method.
• Just because an assessment method results in adverse impact,
if it does a good job predicting job performance it may be
worthwhile to investigate the usefulness of various strategies to
reduce its adverse impact so that it can continue to be used.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Discussion Questions (1 of 2)
1. When should employers reassess the assessment
methods they use in hiring?
2. Discuss the advantages and disadvantages of both
structured and unstructured interviews. Which would
you prefer to use? Why?
3. Why go to all the trouble of sometimes costly and time-
consuming assessments when there are no guarantees
they will result in a successful hire?
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Discussion Questions (2 of 2)
4. What do you feel are the least effective external
assessment methods? Why?
5. Do you think that it is appropriate for employers to
research applicants’ backgrounds? What about credit
histories? Why or why not?
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Opening Vignette Exercise To execute its innovation strategy, Facebook seeks technical talent with strong
skills, previous accomplishments, and both curiosity and motivation. A good fit
with the company’s culture, good understanding of online social media, and
the ability to work well with others are also important. This chapter’s opening
vignette provided some information about how the company currently
assesses job candidates on these dimensions. Reread the opening vignette
and its conclusion, and answer the following questions in a group of three to
five students. Be prepared to share your answers.
1) Do you think it’s appropriate for Facebook to require candidates to write code on
a whiteboard during its assessment process? Why or why not?
2) What are the advantages and disadvantages to Facebook of asking software
engineering applicants to do so much coding during the initial assessment
process?
3) Identify two other assessment methods you think Facebook could use to assess
applicants’ fit with the company’s culture of innovation and smart risk taking.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Develop Your Skills Exercise Develop a scoring key for each structured interview question below and create
a formula to combine the scores into an overall structured interview score for a
retail sales position at a high-end retailer focused on customer service.
1. A disgruntled customer is returning a damaged suit jacket he bought the
previous week that he needed for an event that night. He is extremely upset.
What do you do?
2. A person walks into your store and mentions that she has just moved into the
area and that this is the first time she has visited your store. What would you do
to make her a customer now and a loyal customer in the future?
3. You’re working alone because two people called in sick. Suddenly, five
customers walk into your department at once. What do you do?
Then view the structured interviews available on the book’s companion Web
site for Parvathi, Chris, and Julia. Use your structured interview scoring key to
evaluate each candidate. Then combine each candidate’s interview scores
and choose one to whom to extend a job offer.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Chern’s Case Assignment
a) Develop an assessment and selection plan that does not
exceed the remaining $4,000 budget.
b) Justify your proposed selection system in your report.
c) Submit your assessment plan to your instructor. Receive
scores from your instructor.
d) Use the scoring key you developed for the structured
interviews to view and score the eight structured
interviews. Also view the eight unstructured interviews and
score them if you included them in your assessment plan.
Copyright © 2015, 2012, 2009 Pearson Education, Inc. All Rights Reserved
Copyright
All rights reserved. No part of this publication may be reproduced, stored in a
retrieval system, or transmitted, in any form or by any means, electronic,
mechanical, photocopying, recording, or otherwise, without the prior written
permission of the publisher. Printed in the United States of America.