WPS HW P2

profileNickiS
Chapter6.pptx

CHAPTER 6

Human Resource Measurement in Selection

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Learning Objectives

Understand the role of measurement in human resource (HR) selection.

Explain four different scales of measurement and the conclusions that can be legitimately drawn from data produced by each scale.

Understand why standardized measures are important to use in HR selection.

Know how to research a published test being considered for use in HR selection.

Understand the fundamentals in developing and implementing a selection procedure.

Interpret the meaning of percentile norms.

3

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Fundamentals of Measurement: An Overview

An assumption in selection decision making is that information is available for making these decisions. But

What types of information can be used?

Where does this information come from?

What characteristics should this information have to be most useful?

This chapter specifically focuses on:

the basics of psychological measurement as they apply to HR selection

locating, developing, and interpreting measures commonly used in HR selection

4

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

The Nature of Measurement

From the perspective of HR selection:

HR measurement involves the systematic application of rules for assigning numbers to objects – usually people – to represent the quantities of a person’s attributes or traits

Rules suggest that the basis for assigning numbers is clearly specified and consistently applied – it is important that different users who use a test administer it under the same conditions and score it in the same manner as all other users

Physical attributes – gender – can be assessed through direct observation

Psychological attributes (constructs) – conscientiousness, intelligence – are not directly observable and must be inferred from a score – numbers or units of measurement

5

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

The Nature of Measurement

Criteria and predictors in selection research:

Identification of two types of variables is critical:

Criterion – measure of what represents successful performance on a job (supervisory ratings of work performance)

Predictor – a measure (of employee WRCs) used to forecast or predict the likelihood of job candidates’ success on a job

6

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

The Nature of Measurement

Measurement and individual differences:

Measuring individual differences helps identify those individuals who should be hired for a job

Figure 6.1 shows a hypothetical distribution of quantity of output per worker for a large number of workers:

Individual employees differ in their levels of productivity

Relatively few produce a very large or very small number of baskets

We need a selection procedure that will predict productivity

7

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

8

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

Scales of Measurement

A means by which individuals are distinguishable from one another on a variable such as a predictor or criterion

Predictor or criterion variables can differ dramatically in their precision – e.g. trainability

Figure 6.2 shows hypothetical distributions of trainees’ scores for two methods of measuring trainability

9

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

10

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

Scales of Measurement

Four types of scales or levels of measurement exist:

Nominal – composed of two or more mutually exclusive categories (e.g., male or female)

Ordinal – rank-orders objects (individuals) from “high” to “low” (e.g., test scores as percentiles) (Figure 6.3)

Interval – uses constant units of measurement – differences between numbers take on meaning (Figure 6.4)

Ratio – has an absolute zero point – differences between numbers also have meaning (e.g., most scales involving physical measurements)

The degree of precision increases as we move from nominal to ratio scales (Figure 6.5)

11

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

12

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

13

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

The Role of Measurement in HR Selection

14

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

The systematic application of pre-established rules or standards for assigning scores to the attributes or traits of an individual

A selection measure may provide information to be used as either a predictor or a criterion – differences in scores must be attributable to ability, and not to other factors

A predictor or criterion measure is standardized if it possesses:

Content – all people assessed are measure by the same information or content

Administration – information is collected the same way in all locations and across all administrations

Scoring – rules for scoring are specified before administering the measure and applied the same way with each scoring

15

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Measures Used in HR Selection

Criteria are employed as part of a research study designed to determine which selection procedures are related to job success and should be used in selection decision making – a validation study

Criterion measures help serve as a standard for evaluating how well predictors do the job they were intended to do

Predictors have a direct impact on decisions – a manager reviews an applicant’s scores

Criteria play an indirect role – which selection procedures should be used in making selection decisions

16

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Measures Used in HR Selection

Predictors or selection procedures:

Numerous types but in general the major types fall into three broad categories:

Background information – application forms, training and experience evaluations, reference checks, biographical data used to collect information

Interviews – employment interviews used to collect additional information

Tests – hundreds of tests have been used for selection purposes – aptitude, ability, achievement, personality

17

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Measures Used in HR Selection

Criteria or measures of job success:

Measurement methods used to collect data include the following:

Objective production data – physical measures of work

Personnel data – personnel records and files can serve as criterion measures

Judgmental data – performance appraisals or ratings

Job or work sample data – obtained from a measure of specific aspects of the work process or outcomes

Training proficiency data – how quickly and how well employees learn during job training activities

18

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Standards for Evaluating Selection Measures

Table 6.1 lists some of the factors to be considered when choosing or developing a selection measure

If a measure doesn’t meet these standards:

Determine whether you can adjust your data or the way you calculate the score itself so it will meet each measurement evaluation criterion

If this option is not viable, find or develop another, more suitable measure

The factors listed in Table 6.1 are not of equal importance

19

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

20

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

21

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

22

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Finding and Constructing Selection Measures

Once we know the criteria selection measures for successful work performance, the process of identifying and implementing the selection procedures may begin:

A consultant – industrial–organizational psychologist – is needed

Two choices:

We can locate and choose from existing selection measures

Construct our own

We might need to consider both options

23

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Locating Existing Selection Measures

Advantages of using existing measures:

Use of existing measures usually less expensive and less time-consuming than developing new ones

If previous research was conducted on these measures, we will have some idea about the reliability, validity, and other characteristics of the measure

Well-developed, existing measures often superior to what could be developed in-house

24

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Locating Existing Selection Measures

Information sources for existing measures:

Sources in print and on the Internet (Tables 6.2 and 6.3)

Text and reference sources – provide excellent reviews of predictors and other measures that have been used

Buros’ Mental Measurements Yearbooks – the most important source for information on tests for personnel selection

Other reference sources – journals, test publishers (levels A, B, C), professional associations

25

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

26

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

27

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Locating Existing Selection Measures

Suggestions for choosing an existing selection measure:

Be sure you clearly and completely understand the attribute or construct you want to measure – decide on the best means for assessing the attribute

Search for and read critical reviews and evaluations of the measure – Buros’ Mental Measurements Yearbook an excellent source

If a specimen set of the measuring is available, order and study it

Once steps 1-3 are completed, ask “are there more compelling arguments for using this measure? Or, are there compelling arguments against using it?”

28

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Constructing New Selection Measures

Developing of measures is a complex, resource-consuming process that usually requires expert advice

Consultants likely will be needed

Knowledge of the basic issues involved in selection measure development, validation, and application can help bridge any possible communications gap between the organization and the consultant

29

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

Constructing New Selection Measures

Steps in developing selection measures:

Analyze the job for which a measure is being developed

Select the method of measurement to be used (Figure 6.6)

Plan and develop the measure (Figures 6.7 and 6.8)

Administer, analyze, and revise the preliminary measure

Determine the reliability and validity of the revised measure for the jobs studies

Implement and monitor the measure in the HR selection system

30

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

31

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

32

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Standardization of Selection Measurement

33

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Interpreting Scores on Selection Measures

Using Norms

To interpret the results of measurement, we need two pieces of information:

How others scored on the selection procedure

Validity of the selection procedure

Predictor scores of relevant others in groups are called norms

Keep the following in mind when using norms to interpret scores:

The norm group selected should be relevant

Accumulate and use local norms when appropriate

Norms are transitory – specific to the point in time when they are collected

34

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Interpreting Scores on Selection Measures

Using Percentiles

Percentile scores show the percentage of a persons in a norm group who fall below a given score on a measure – a percental score is not a percentage score

The higher the percentile score, the better a person’s performance relative to others (Figure 6.9)

Percentile scores are useful in interpreting test scores, but are subject to misuse

35

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Interpreting Scores on Selection Measures

36

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Interpreting Scores on Selection Measures

Using Standard Scores

Standard scores represent adjustments to raw scores so it is possible to determine the proportion of individuals who fall at various standard score levels – these scales indicate how far above or below the mean score any raw score is

Some of the more common are z, T, and stanine scores

z score the most common – can be obtained for all individuals for whom test score data are available

T scores – similar to z scores but adjusted so that all T scores are positive

Stanine scores – computed by rank-ordering scores from lowest to highest

37

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick

Interpreting Scores on Selection Measures

38

© 2019 Wessex Press • Human Resource Selection 9e • Gatewood, Feild, Barrick