Johnson, C.M., Mawhinney, T. C., & Redmon, W.K. (2001). Handbook of organizational performance: Behavior analysis and management. New York, NY: Sage The Hawthorn Press, Inc
There are several excellent literature reviews and other discussions on personnel training in organizations in the industrial and organizational (I/O) psychology literature (Campbell, 1971; Eden, 1987; Goldstein, 1980, 1991; Latham, 1988, 1989; Tannenbaum and Yukl, 1992; Wexley, 1984). These works have had an impact on the field of training and have contributed to the development and quality of training research. With few exceptions, however, these reviews have ignored organizational behavior management (OBM) training research. The present chapter attempts to fill that gap and extend earlier treatments of OBM training (Reid, Parsons, and Green, 1989; Ross, 1982). The chapter begins with a review of the OBM training literature followed by a critique and suggestions for future research.
Space constraints preclude treatment of the entire training literature from a behavior analytic perspective. Thus, I focus primarily on research investigating the process of instruction and skill acquisition of people employed in organizations. Research investigating transfer of training strategies is not emphasized because several excellent papers on generalization and maintenance already exist in the I/O (Baldwin and Ford, 1988), education (Royer, 1979), and behavior analysis (Stokes and Baer, 1977; Stokes and Osnes, 1989) literatures. Research where training was peripheral to other organizational interventions (e.g., Fox and Sulzer-Azaroff, 1989; Komaki, Blood, and Holder, 1980; Rowe, 1981; Streff, Kalsher, and Geller, 1993) is also excluded. Finally, research focusing primarily on trainee reactions to programs is not discussed (Reid and Parsons, 1995, 1996).
The author would like to express appreciation to Thomas S. Critchfield, Richard K. Fleming, and the editors for their comments on an earlier version of this chapter.
Some suggest that training does not play as important a role in behavior change as consequences. In a discussion of organizational change, Murphy and Remnyi (1979) state that antecedent stimulus control techniques are not likely to yield long-term changes in behavior unless consequent stimuli are controlled. Similarly, Geller (1990) notes that workshops and training programs cannot maintain safe behavior or reduce work injuries because natural contingencies are not in place to support safe behavior. He stresses the importance of using operant conditioning principles to maintain safe behavior.
TRAINING RESEARCH
The purpose of studies described in this section was to evaluate effectiveness of training in terms of behavior change. This was generally accomplished by measuring behavior and evaluating performance before and after training.
Fawcett and Miller (1975) conducted a training study designed to improve public speaking. Topics included how to structure a talk (e.g., acknowledging the introduction, statement of appreciation to introducer, greeting the audience, topic introduction) and body movements such as hand movement and eye sweeps. The program included written instructions, role-playing, and performance feedback. Results showed the program effectively increased the frequency of target behavior and the speaker's performance ratings by members of the audience.
Maher (1981a) described a training project within which special educators were taught how to develop individualized educational programs (IEPs) for special education students. The program concentrated on discussing the essential roles of IEP components and skill development in developing educational goals and objectives. Training in group conflict management also was provided. Results indicated productivity with respect to developing IEPs improved among educators involved in the training project.
Hall and Hursch (1981/82) found that reading the training manual and holding meetings with a consultant increased the amount of time four university faculty spent on important tasks. Self-reports of efficiency and satisfaction also improved. One notable contribution of this study is that the authors presented information on ways to obtain accurate, reliable, nonreactive measures of time use. Some of the problems associated with those methods complemented other work on reactivity in behavioral observation (Haynes and Horn, 1982).
Maher (1982) also successfully implemented a time management program to increase the amount of time nine classroom teachers devoted to instructional behavior such as lecturing and holding discussions. Program components included diagnosing time management skills, analyzing time management problems, developing and implementing a plan for more productive use of time, and an evaluation phase in which trainees learned how to evaluate their progress in the use of time management. The program also included monthly social support meetings designed to facilitate generalization and maintenance.
Maher (1984) described and evaluated a training program designed to teach administrators OBM skills. Topics covered included problem identification, program design, implementation, behavior consequences, program evaluation, and staff involvement in the intervention. Results suggested the trainees were able to apply OBM techniques to improve organizational performance.
Bruwelheide and Duncan (1985) described a means by which an organization's labor relations course was evaluated. Supervisors received training and then scored a videotape on the degree to which the videotaped models adhered to the program principles. Results showed that subjects did better on the posttest than the pretest and that the trained group performed better on the test than a group that did not receive training. While scoring the participants’ performance in role-playing sessions would have enhanced the meaningfulness of the learning measure, what was noteworthy in this study is that the authors attempted to assess the opportunities to engage in these behaviors both before and after training. This is important because practitioners can determine the percentage of opportunities on which responses were emitted and adjust absolute frequency accordingly.
Welsh et al. (1989) extended work on improving meeting effectiveness (Briscoe, Hoffman, and Bailey, 1975; Seekins, Mathews, and Fawcett, 1984) by developing a manual designed to improve the performance of meeting chairs. The manual required little facilitator time and resulted in improved performance on a skills generalization test.
Nordstrom, Lorenzi, and Hall (1990) instructed managers in city government on OBM techniques. Results from skill acquisition and performance measures showed that the managers learned the material and employee performance improved. Managers also were satisfied with the program.
Hopkins and colleagues (1986) conducted an intervention designed to reduce employee exposure to toxic chemicals. Training consisted of a description of behaviors that would reduce exposure, along with a rationale of why those behaviors would work. Modeling, answering trainee questions, daily feedback, and reinforcement were other intervention components. Results showed that the program worked.
Johnson and Fawcett (1994) trained three receptionists of a human service agency to increase their frequency of courteous behavior. They provided trainees with written instructions, practice, and feedback on performance. The authors also implemented a lottery system to enhance maintenance. While some of the target behaviors appear to be outside the boundaries of courteous service (e.g., asking closed-ended questions when requesting factual information), the research is interesting and results documented program effectiveness.
Wilson, Boni, and Hogg (1997) describe an intervention designed to enhance courteous behavior of two police officers and five public servants. The authors identified the target behaviors through on-the-job observation, a literature review, and a survey. Target behaviors included failing to smile or having a sullen expression, failing to give an appropriate greeting, keeping the customer waiting without acknowledgment, talking to a colleague while attending to the customer, having an abrupt or unfriendly tone of voice, failing to give the customer full attention, and ending the exchange abruptly. The training program included videos, discussions, and handouts describing the target behaviors. One video illustrated a discourteous interaction. The trainer played the video again while stopping the tape at various times to discuss the model's behavior. Trainees also viewed a modeling display of appropriate behavior. The trainees’ supervisors also participated in a training session designed to teach them how to reinforce courteous behavior in subordinates and to correct instances of discourteous acts. Results showed that the frequency of courteous behavior increased and that there was greater uniformity among the public servants’ percentages of courteous behavior following the workshop. However, performance decreased after a period of time.
Summary
A reasonable conclusion based on the ongoing research is that training is a useful technique for changing a variety of behaviors. What researchers need to ask and to investigate further is the question of why training is effective in changing behavior. Understanding why training works is important because it enables researchers to develop better programs for the target behaviors. For example, Maher (1982) described and evaluated a time management program that appeared to have been logically developed. Although we can conclude that the program was effective, we do not know whether the methods used were the most effective means by which people acquired skills such as analyzing time management problems. Incorporating the findings of the basic literature on learning theory into program development and validating those findings is one strategy that would increase our understanding of training and skill acquisition of employees.
COMPARISON RESEARCH
Comparison research typically involves determining which of two or more interventions is the most effective or efficient in changing behavior. Studies reviewed here compared different training techniques or compared training to other interventions.
Adams, Tallon, and Rimell (1980) compared the performance of trainees who received either a lecture on how to use positive reinforcement, or role-playing exercises supplemented with feedback. The performance of people who received the lecture improved initially after training, but declined thereafter. On the other hand, the performance of those who were involved in role-playing improved over time.
Brown and colleagues (1980) examined the effectiveness of training and feedback on customer service behaviors such as approaching customers, greeting them, and demonstrating courtesy. The four-hour program covered the company's courtesy standards, the relationship between customer service and performance appraisals, and listening skills and complaint handling. Training activities included viewing models, completing worksheets, and role-playing. Results showed that training had little effect on performance, but feedback improved performance dramatically. One feature of the investigation was the demonstration that the trained behaviors were associated with an important organizational outcome (customer satisfaction). One salesperson was told to perform alternately all of the target customer responses and then none of the behaviors for customer transactions. On average, customers who were recipients of the trained behaviors reported they were more satisfied than customers who were not exposed to the trained behaviors.
Maher (1981b) examined the differential effects of an active learning program (ALP) and an instructional learning program (ILP) in the development of educational programs. The author used social learning theory principles (Bandura, 1969) to develop the ALP. The ALP emphasized discussion, rehearsal, feedback, and social reinforcement. The ILP emphasized lectures, discussion, and formal didactic presentations. Trainee performance was evaluated in terms of quality and quantity of educational programs developed after training. Results showed that the active learning program was more effective than the ILP. However, we do not know what aspects of the ALP resulted in the program's superiority over the ILP. That is, we do not know the differential contributing effects of ALP components such as rehearsal or feedback. Moreover, the ALP program included homework assignments whereas the ILP did not. The impact of homework assignments on productivity, that is, above and beyond the ALP, remains undetermined.
Hanel, Martin, and Koop (1982) prepared a self-study time management guide and compared the effectiveness of that manual in developing and maintaining time management to that of a bestselling time management book. Participants in the self-instructional group were asked to work on the manual for one hour each day for eight days. People who used the popular-press book were asked to read it, which the researchers said could be accomplished within eight hours. Subjects in the self-study time management guide group also were given guidelines on how to use the manual; people in the bestseller group did not receive guidelines. The manual contained exercises, thereby enabling the participants to take a more active role in the learning process than subjects in the bestseller group. Results showed that the self-instructional group performed better than the bestseller group, although no rationale was offered as to why performance differences were expected. Moreover, although not assessed directly, guidelines on how to use the manual and supplemental exercises provided to the manual group may have enhanced subsequent performance.
Ford (1984) examined training in a health care facility. Specifically, he compared the relative effectiveness of a traditional training approach with a personalized system of instruction (PSI) approach. The traditional training methods included lectures, videotapes, films, and demonstrations. The personalized system of instruction in this study included features such as self-paced instruction, subject mastery before moving to new material, being able to work on multiple units simultaneously, and allowances for repeating performance evaluations. People trained with the PSI approach performed better on the training learning measures and received higher supervisory on-the-job performance ratings than those using the traditional approach. Training efficiency indices also were compared in this study. The percentage of people participating in the PSI approach who completed the program was greater than the percentage of people completing the alternative method (100 percent versus 73 percent). In addition, it took less time for the PSI participants to complete the program (47.32 hours versus 165 hours). Clearly, the PSI approach was more effective and efficient than the traditional learning approach.
Born, Gledhill, and Davis (1972) compared learning by subjects exposed to different instructional methods. One group received instruction via lectures; two other groups each received one of two types of PSI instruction; and a fourth group rotated among the three methods. Students in the PSI sessions performed better on tests than students who received lectures, especially on essay and fill-in-the-blank tests. Poor and average students appeared to obtain the most benefit from PSI.
Born and Davis (1974) also found that students scored slightly higher on knowledge tests after using the PSI approach than after the lecture method. The PSI approach also appears to have been the most costeffective method, as the preparation time for the two instructional methods were equivalent.
Neef and colleagues (1991) conducted two studies that essentially examined the effectiveness of modeling and role-playing. Respite care providers viewed videotapes of models providing respite care alone, with one other person, or as part of a group. Overall training appeared effective as skills acquired during instruction generalized to the job and in many instances were maintained up to six months. The authors also reported that presentation format had no effect on performance. The experiment was replicated with subject participants from human service agencies. Results indicated that training improved performance, but presentation format (alone, dyad, and group) had no effect on behavior.
Karlsson and Chase (1996) examined effects of prompting procedures on college student acquisition of a computer spreadsheet program. Continuous prompting involves telling the learner what keys to punch during the entire learning process. Fading is a strategy involving a gradual transfer of stimulus control from the instructions to the computer interface (e.g., keyboard or mouse). One type of fading had students guess at which keys to punch. The time interval before being told the correct response increased on successive trials (i.e., prompt delay). The second fading strategy involved discrimination (i.e., additional choices). Students had to identify which keys to punch where the number of incorrect alternatives increased over successive trials. Results showed that the college students who had received continuous prompting made approximately twice as many errors on a posttest than students receiving either of the two fading strategies. Their theoretically-based research clearly documents the advantages of having trainees take an active role in the learning process.
Summary
The research reviewed here shows that training methods are differentially effective, although the quality and quantity of training such as the use of homework was not always controlled. What OBM researchers need to discover is why certain training techniques are better suited for developing target behavior than other methods. For example, Ford (1984) demonstrated the superiority of the PSI approach over the lecture method; however, we cannot determine from the research why the program was best suited for the target behaviors trained. An extension of the research reported here would (a) clearly specify the target behavior to be trained, and (b) identify the training methods best suited for development of the behavior through application of basic research on instructional design. A systematic program of research of this nature should lead to the development of guidelines that would enable trainers to match training methods with different classes of target behaviors.
TRAINING AND MOTIVATION
Training is best suited for developing skills; it is not a very efficient tool for resolving motivational problems unless the instructional experiences target self-management behavior (e.g., Frayne and Latham, 1987; Latham and Frayne, 1989). The OBM research reviewed in this section illustrates that training is not a panacea for all organizational problems.
Quilitch (1975) compared the effects of memos, a workshop, and publicly posted feedback on employee attendance. Results indicated that neither the attendance memos nor training were effective in improving attendance. Feedback was the only intervention that improved attendance. In this situation training was not warranted. The root of the problem was motivational. Trainees did not exhibit a skill deficit; they demonstrated the ability to come to work but did not do so on a consistent basis.
Geller and colleagues (1980) examined the relative effectiveness of a memo stressing the importance of practicing sanitation principles (hand washing), training, and feedback for improving cafeteria employees’ sanitation behavior. After collecting baseline data, some employees received a one-paragraph memo about videotaping them as part of a project focusing on hand washing. Some of the employees received training a few days later. Training consisted of a thirty-minute lecture and slide presentation on the importance of sanitation, defining conditions that should be followed by hand washing, and proper hand washing procedures. Performance feedback commenced ten days following training. Results found the memo to be initially effective in increasing hand washing frequency, especially for conditions that should be followed by hand washing, such as after touching hair. Training effects also were weak. Feedback had the most pronounced effects on sanitation behavior for both the trained and untrained employees.
The Geller and colleagues (1980) study is another illustration of a motivational issue, not a training problem. Training did not appear necessary as the data showed that the no-training group performed as well as the subjects in the training group when both groups received performance feedback. While it is possible that the feedback checklist sheets that subjects received taught nontrainees when to wash their hands, no supporting evidence was presented.
Conrin (1982) compared the relative effects of training programs designed to improve the completion of projects versus setting a target date for completing projects. The investigation included four phases. The first part was a training phase in which trainees were given written instructions on how to complete behavioral data sheets and weekly behavioral reports on clients of a developmental center. The trainer (the employees’ supervisor) stressed the importance of correctly completing the data sheets, explained the data system, reviewed sample reports, and answered questions during training. A psychologist gave the trainees blank data report forms requesting that they be completed by a predetermined date in the study's second phase. The psychologist gave the trainees blank data sheets with no completion deadline during the third phase of the investigation. The fourth phase was identical to the second phase in that a target date was assigned. Results indicated that trainees performed worst under the training-alone phase. Reports were on average twenty days late. Trainees performed best when given a deadline, where reports were on average two days late. Reports were submitted an average of nine days late during the third phase. The author concluded that the target date procedure was more effective than training in improving performance.
LaFleur and Hyten (1995) illustrate the importance of specifying work procedures and organizing the various job functions among hotel banquet staff. Hotel staff exhibited problems setting out all necessary equipment for banquet functions (e.g., napkins). Problems completing work as a unit also occurred because supervisors would assign staff identical tasks while leaving other tasks unassigned. The authors also noted that they could not identify deficiencies in the staff that precluded successful job performance. The treatment package included goal setting, feedback, a training manual, and a task checklist that were reviewed with the trainees as part of a training workshop. Results showed that the total intervention succeeded in changing staff behavior. However, it appears that training may have had little impact on performance. Employees who received the training prior to a second baseline data collection period did not have markedly different setup completion rates than the rates of recently hired employees who did not participate in training prior to the second baseline data collection period.
Summary
Successful training depends on several factors. As mentioned in the previous section, specifying the target behavior is critical. An analysis of whether the current behavior is a function of motivation or a skill deficit is equally important because, as each of the studies in this section show, training is not an effective tool for improving inadequate performance due to lack of effort. For example, the central issue in Conrin's (1982) research involved motivation, not skill deficits. Skills training is not appropriate in situations where people already possess skills needed to execute desired behavior. Self-management training (Kanfer, 1980; Marx, 1982) or the use of motivational strategies such as goal setting (Locke and Latham, 1990) and contingent reinforcement (Kazdin, 1994; Komaki, 1981/82) are more appropriate.
PROGRAM DEVELOPMENT
Several OBM papers have focused on, or have implications for, program development. Maher (1983) described a way to implement programs that included a framework from which implementation procedures can be derived. The implementation procedure was called DURABLE. The first step in this seven-step procedure, D (durable), is to meet with important people and/or groups in the organization to discuss the proposed intervention. U (understanding) refers to determining whether the organization is ready for program implementation (cf. Davis and Salasin, 1975). R (reinforcing) requires that management reinforce the behavior of those responsible for implementing the intervention. A (acquiring preconditions of successful implementation) includes ensuring that the goals of the program are clearly communicated and obtaining the budget necessary for successful implementation. B (building) reflects the importance of management exhibiting positive expectations about the program to the organization's staff. L (learning) includes providing activities to the implementors that enhance their ability to perform their assignments. Finally, E (evaluating) refers to assessing the extent to which the program was implemented, and the degree to which the program succeeded.
This article is important for two main reasons. First, it emphasized identification of organizational contextual factors to consider before implementing training (cf. Goldstein, 1991). The sample questions Maher provides are also noteworthy and should help practitioners gauge the likelihood of an intervention's success.
Behavior taught in training should have support in terms of whether emitting those behaviors actually leads to improved performance. Surprisingly, there has been little systematic OBM research on the identification of the most important behavior to train prior to program implementation. Clark and colleagues (1985) conducted research that is one notable exception. They surveyed subordinates regarding the type of supervisory skills they believed to be important in improving their satisfaction and productivity. Other individuals observed videotapes of supervisors and identified those behaviors likely to improve productivity and job satisfaction. The authors also conducted a literature search to identify good supervisory behavior. Clark et al. developed vignettes containing interactions based on the facilitative behaviors identified as well as interactions and behaviors that were believed to have negative and no effect on performance. Judges observed the vignettes and identified behaviors they felt would improve, maintain, or decrease performance. The authors developed a training program based on the principles identified as important in improving job performance. The program was found to be an effective means of improving supervisor behavior.
Alavosius and Sulzer-Azaroff (1986) studied the effects of feedback on safe lifting behavior. Although not a training study per se, the study is included here because it illustrates how to conduct a thorough task analysis. The authors based their analysis of the steps involved in safe lifting by reviewing training materials, consulting with a physical therapist, and reviewing the lifting literature.
Jones, Fremouw, and Carples (1977) conducted an interesting study examining the behavior of former trainees who became trainers. Three teachers were trained in classroom management. These three trainees then became trainers who instructed other teachers in classroom management. Results showed that the training worked. The frequency of student disruptive behavior decreased in the trainee-trainers’ classrooms as well as in the other teachers’ classrooms. One noteworthy feature of the project is the effects of becoming a trainer on classroom management performance. The two trainee-trainers who profited least from their original training improved their classroom management performance after training other teachers.
Van den Pol, Reid, and Fuqua (1983) extended our knowledge of peer training. They trained directcare staff of a residential facility how to respond to fires, manage aggressive resident behavior, and aid residents experiencing convulsive seizures. Peer training was successful. What makes this study noteworthy is that the authors monitored the trainers’ behavior after they provided instruction to others. The process of training others resulted in further development of the trainers’ own skills in the topics they taught. Trainer performance in topics not taught declined over time. The van den Pol, Reid, and Fuqua (1983) and Jones, Fremouw, and Carples (1977) studies demonstrate the importance of spaced practice in learning. Using former trainees as trainers is one way of providing them with the opportunity to recall and practice previously acquired skills, which is important for generalization and maintenance of their own learned skills.
Summary
The research described here showed that the way programs are developed impacts training. Researchers should extend this body of literature by specifying the linkages among learning theory, instructional design, and target behavior. Knowledge of the linkages could be used to develop efficient and effective training programs. For example, incorporating spaced practice in the design of the program is one way to increase maintenance of the behaviors Jones, Fremouw, and Carples (1977) and van den Pol, Reid, and Fuqua (1983) investigated.
CRITIQUE AND FUTURE RESEARCH DIRECTIONS
Training and development of individuals in organizations has received a great deal of attention from OBM researchers. To date, investigations focusing on skill acquisition are in the minority relative to the number of studies examining the efficacy of reinforcement (Komaki, Blood, and Holder, 1980; Runion, Watson, and McWhorter, 1978). This is not surprising given radical behaviorism's emphasis on consequences in behavior repertoire development.
We can conclude from the OBM training research that training is an effective intervention. Organizational behavior management researchers and practitioners also know how to ensure generalization and maintenance of skills acquired in training. Illustrations in the OBM literature also describe how training fits into a broad range of techniques designed to bring about behavior change. On the other hand, we have not learned much about the generalizability of learning theory concepts in employment settings. There is a gap in the OBM training literature regarding knowledge of which instructional methods or combinations thereof are maximally effective in facilitating learning for classes of target behavior. Finally, we cannot conclude confidently that many of the programs were costeffec-tive.
Learning Principles
Little has been mentioned in the OBM training literature concerning how laboratory-based learning principles (see Bower and Hilgard, 1981; Catania, 1992; Honig and Staddon, 1977; Mazur, 1990) are incorporated into instructional techniques. It is almost as if readers have to accept at face value that developers designed training programs to facilitate and maximize acquisition and retention. One consequence is that little of the research reviewed here advanced our knowledge about the generalizability of basic learning principles to normal adults functioning in work settings. Although this assertion should not be construed as a criticism of OBM for overemphasizing technology (cf. Geller, 1991), more research needs to be done to increase understanding of human behavior in the laboratory and in applied settings.
Studying learning theory concepts is necessary to increase Understanding of how people acquire skills. For example, induction, shaping, and fading are all important concepts in understanding how learning occurs; however, I could not find one OBM study that specifically addressed how these concepts can be used to train employees more efficiently.
Investigations are needed that improve our understanding of how strategies based on learning concepts such as induction, fading, and shaping enhance and/or detract from the acquisition of taxonomies of target work behaviors. Karlsson and Chase's (1996) work with college students’ acquisition of a spreadsheet program is one excellent illustration of needed research. Another avenue of applied organizational research that is tied to basic learning theory is to conduct experiments that lead to development of a theoretically based set of rules indicating how to best shape the skills necessary to troubleshoot malfunctions in machinery.
Program Structure
In most of the articles reviewed here, researchers merely described the training without explaining why they chose the instructional methods. In some studies, authors described the training program in only one or two sentences (see Johnson and Fawcett, 1994, for an exception). Organizational behavior management researchers need to focus more attention on program design. Describing program design and why it is suited for development of the target behavior serves two purposes. It allows for empirical evaluation of instructional techniques and enables readers to judge the degree to which the training method adheres to sound instructional principles.
Organizational behavior management researchers and practitioners need to consider why certain training techniques are thought to be more effective and under what conditions they should be maximally effective (e.g., course content, purpose of training, etc.). Gagne's framework (Gag-ne, 1985; Gagne, Briggs, and Wager, 1988) is relevant here. He described different learning outcomes and the conditions needed to facilitate the learning of those outcomes. Applying Gagne's framework to training involves specifying the target behavior, classifying the target behavior in type of learning outcomes, and arranging instruction so that the relevant conditions for learning are present (see Resnick, Wang, and Kaplan [1973] for an illustration). Research of this kind is needed in OBM.
One method that has been used to evaluate different training strategies is comparative research. Researchers who wish to conduct comparative studies should review Van Houten (1987) and Johnston (1988). Van Houten (1987) claimed that one cannot indiscriminately compare training programs without ensuring that each program is optimally effective. To compare two programs (e.g., Programs A and B) where Program B is not optimally developed, and then conclude that Program A is superior to Program B is misleading because we do not know whether differences would have existed had Program B been developed adequately. While it is difficult to discern whether most interventions in the comparison research section of this chapter were optimally developed, Van Houten's article deserves attention because some comparative intervention research described previously did not appear to make fair comparisons.
Johnston (1988) questioned the value of comparison research for a variety of reasons, one of which being that the primary focus of comparison research is on understanding procedures rather than understanding behavior. He believes, like Van Houten (1987), that a full understanding of the behavior and the intervention is required before comparison studies are conducted. Doing otherwise leads to results that have poor generality. Johnston (1988) also adds that achieving full understanding is a highly unlikely event. In the event that complete understanding is achieved, it may be obvious which procedure is better, thereby obviating the need to conduct comparison research.
Van Houten (1987) and Johnston's (1988) papers have somewhat different implications for organizational behavior management researchers. While Van Houten (1987) suggests that comparison research is important provided that the programs compared are optimally developed, Johnston (1988) implies that comparison research may not be necessary in most instances.
One tactic that bridges the views of both authors is component analysis. Component analysis is used to understand the relative and/or additive contributions of a part, or several parts, of a strategy designed to predict and control a target behavior. It is accomplished by manipulating the exposure of trainees to features of the training program (e.g., role-playing exercises), and assessing the impact of the manipulation on behavior. In and of itself, a component analysis is not a research design. Rather, it is a tactic that can be employed in a variety of within- and between-subject research designs. Proper component analysis research requires specification of the task, identification of the desired learning outcome, and an explanation of the rationale behind the application of basic research on instructional methods to training program development. Describing the rationale behind the intervention involves some discussion of why we would expect the component alteration/inclusion to modify behavior. Research incorporating component analysis tactics integrates Van Houten's (1987) and Johnston's (1988) comments because it provides a justification for the intervention or any program alteration, thereby (a) avoiding the appearance of indiscriminately comparing methods, and (b) focusing attention where it should be, on the target behavior. When done properly, component analysis research results enable investigators to ascertain what comDonents make the training intervention effective, and is useful in developing optimal training programs. Such research also increases under-standing of how to change behavior efficiently.
Utility
The reporting of cost-benefit analysis is the exception rather than the norm. Although the demonstration of utility poses unique challenges and may have unanticipated effects (Latham and Whyte, 1994), organizational decision-maker requests to justify training necessitates the documentation of training value (Morrow, Jarrett, and Rupinski, 1997). Some approaches to cost-benefit analysis in the OBM literature include comparing the cost-benefit ratios of two programs (Brown et al., 1980) and logic (Alavosius and Sulzer-Azaroff, 1986). An alternative means by which the value of a program is determined is through a utility analysis, in which the cost of a program is examined relative to the gain in productivity. Excellent references on how to estimate training/intervention costs are found in the industrial and organizational psychology literature (Cascio, 1982; Gold-stein, 1991).
More utility estimates should be reported in the OBM literature while concurrently being sensitive to the organization's need to remain competitive by keeping findings confidential (Balcazer et al., 1989). The recommendation to justify the costs of training is not new (Johnston et al., 1978; Mawhinney, 1975). Unfortunately, the call has not been heeded.
Perhaps one reason why there are few reports of utility in the OBM literature is that much of the training research occurred in mental retardation facilities. Programs designed to increase the effectiveness of people employed at mental retardation facilities are not likely to demonstrate economic utility. That is, the gain in dollars of improved client behavior as a result of staff training is not likely to outweigh the cost of the intervention. Evaluating these training programs in economic terms is inappropriate because decision makers may be tempted to conclude that such programs are not worthwhile.
Interventions aimed at helping directcare workers better manage the behavior of developmentally disabled clients of residential facilities should be evaluated on other criteria. For example, Fleming, Oliver, and Bolton (1996) collected data on trainee subordinates to assess, in part, the effectiveness of a supervisory training program. Methot and colleagues (1996) examined the effects of their training intervention on two levels of supervision, frontline staff, and client behavior. Another alternative to computing utility estimates on a single training intervention is to evaluate the utility of different training programs. Allison, Silverstein, and Galante (1992) illustrate the approach in their work on monetary incentive systems.
CONCLUSION
Organizational behavior management research has focused on evaluating the efficacy of training in a variety of settings. The studies reviewed in this chapter indicate that while not a cure-all, training can be an effective technique for changing behavior. Training is essential to certain behavior changes. That is, against a context of high instrumentality and great reinforcement value for performing well, absence of knowledge or skill needed to produce reinforcers will preclude both performance and receipt of reinforcers contingent on it.
Much remains to be learned about how to train employees in the job-related knowledge and skills they need to perform effectively. Understanding how to best structure instructional sequences to maximize learning and behavior change for complex jobs is just one of the challenges facing researchers and practitioners. I look forward to reading original research addressing this and other substantive issues.
REFERENCES
Adams, G. L., Tallon, R. J., and Rimell, R (1980). A comparison of lecture versus role-playing in training of the use of positive reinforcement. Journal of Organizational Behavior Management, 2(3), 205-212.
Alavosius, M. R and Sulzer-Azaroff, B. (1986). The effects of performance feed-back on the safety of client lifting and transfer. Journal of Applied Behavior Analysis, 19 (3) , 261-267.
Allison, D. B., Silverstein, J. M., and Galante, V. (1992). Relative effectiveness and costeffectiveness of cooperative, competitive, and independent monetary incentive systems. Journal of Applied Behavior Management, 13 (1) , 85-112.
Balcazer, R E., Shupert, M. K., Daniels, A. C, Mawhinney, T. C., and Hopkins, B. L. (1989). An objective review and analysis of ten years of publication in the Journal of Organizational Behavior Management. Journal of Organizational Behavior Management, 10(1), 7-37.
Baldwin, T. T. and Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41, 63-105.
Bandura, A. (1969). Principles of behavior modification. New York: Holt, Rinehart and Winston.
Born, D. G. and Davis, M. L. (1974). Amount and distribution of study in a personalized instruction course and in a lecture course. Journal of Applied Behavior Analysis, 7(3), 365-375.
Born, D. G., Gledhill, S., and Davis, M. (1972). Examination performance in lecture-discussion and personalized instruction courses. Journal of Applied Behavior Analysis, 5, 33-43.
Bower, G. H. and Hilgard, E. R. (1981). Theories of learning (Fifth edition). Englewood Cliffs, NJ: Prentice-Hall.
Briscoe, R. V., Hoffman, D. B., and Bailey, J. S. (1975). Behavioral community psychology: Training a community board to problem solve. Journal of Applied Behavior Analysis, 8 (2) , 157-168.
Brown, M. G., Malott, R. W., Dillon, M. J., and Keeps, E. J. (1980). Improving customer service in a large department store through the use of training and feedback. Journal of Organizational Behavior Management, 2(4), 251-264.
Bruwelheide, L. R. and Duncan, P. K. (1985). A method for evaluating corporation training seminars. Journal of Organizational Behavior Management, 7(1/2), 65-94.
Campbell, J. P. (1971). Personnel training and development. Annual Review of Psychology, 22, 565-602.
Cascio, W. F. (1982). Costing human resources: The financial impact of behavior in organizations. Belmont, CA: Wadsworth.
Catania, A. C. (1992). Learning (Third edition). Englewood Cliffs, NJ: Prentice-Hall.
Clark, H. B., Wood, R., Kuehnel, T, Flanagan, S., Mosk, M., and Northrup, J. T. (1985). Preliminary validation and training of supervisory interaction skills. Journal of Organizational Behavior Management, 7(1/2), 95-115.
Conrin, J. (1982). A comparison of two types of antecedent controls over supervisory behavior. Journal of Organizational Behavior Management, 4 (3/4) , 37-47.
Davis, H. R. and Salasin, S. E. (1975). The utilization of evaluation. In E. L. Struening and M. Guttentag (Eds.), Handbook of evaluation research (Vol. 1, pp. 621-666). Beverly Hills, CA: Sage.
Eden, D. (1987). Training. In B. M. Bass and P. J. D. Drenth (Eds.), Advances in organizational behavior: An international review (pp. 99-113). Newbury Park, CA: Sage.
Fawcett, S. B. and Miller, L. K. (1975). Training public-speaking behavior: An experimental analysis and social validation. Journal of Applied Behavior Analysis, 8 (2) , 125-135.
Fleming, R. K., Oliver, J. R., and Bolton, D. N. (1996). Training supervisors to train staff: A case study in a human service organization. Journal of Organizational Behavior Management, 16 (1) , 3-25.
Ford, J. E. (1984). Application of a personalized system of instruction to a large, personnel training program. Journal of Organizational Behavior Management, 5(3/4), 57-65.
Fox, C. J. and Sulzer-Azaroff, B. (1989). The effectiveness of two different sources of feedback on staff teaching of fire evacuation skills. Journal of Organizational Behavior Management, 10 (2) , 19-35.
Frayne, C. A. and Latham, G. P. (1987). The application of social learning theory to employee self-management of attendance. Journal of Applied Psychology, 72, 387-392.
Gagne, R. M. (1985). The conditions of learning (Fourth edition). New York: Holt, Rinehart, and Winston.
Gagne, R. M., Briggs, L. J., and Wager, W. W. (1988). Principles of instructional design (Third edition). New York: Holt, Rinehart, and Winston.
Geller, E. S. (1990). Performance management and occupational safety: Start with a safety belt program. Journal of Organizational Behavior Management, 11 (1) , 149-174.
Geller, E. S. (Ed.). (1991). Science, theory, and technology: Varied perspectives. Journal of Applied Behavior Analysis, 24 (3).
Geller, E. S., Eason, S. L., Phillips, J. A., and Pierson, M. D. (1980). Interventions to improve sanitation during food preparation. Journal of Organizational Behavior Management, 2(3), 229-240.
Goldstein, I. L. (1980). Training in work organizations. Annual Review of Psychology, 31, 229-272.
Goldstein, I. L. (1991). Training in work organizations. In M. D. Dunnette and L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 2, pp. 507-619). Palo Alto, CA: Consulting Psychologists Press.
Hall, B. L. and Hursch, D. E. (1981/82). An evaluation of the effects of a time management training program on work efficiency. Journal of Organizational Behavior Management, 3 (4) , 73-96.
Hanel, R, Martin, G., and Koop, S. (1982). Field testing of a self-instructional time management manual with managerial staff in an institutional setting. Journal of Organizational Behavior Management, 4 (3/4) , 81-96.
Haynes, S. N. and Horn, W. F. (1982). Reactivity in behavioral observation: A review. Behavioral Assessment, 4, 369-385.
Honig, W. K. and Staddon, J. E. R. (1977). Handbook of operant behavior. Englewood Cliffs, NJ: Prentice-Hall.
Hopkins, B. L., Conard, R. J., Dangel, R. F, Fitch, H. G., Smith, M. J., and Anger, W. K. (1986). Behavioral technology for reducing occupational exposures to styrene. Journal of Applied Behavior Analysis, 19, 3-11.
Howell, W. C. and Cooke, N. J. (1989). Training the human information processor: A review of cognitive models. In I. L. Goldstein (Ed.), Training and development in organizations (pp. 121-182). San Francisco: Jossey-Bass.
Johnson, M. D. and Fawcett, S. B. (1994). Courteous service: Its assessment and modification in a human service organization. Journal of Applied Behavior Analysis, 27, 145-152.
Johnston, J. M. (1988). Strategic and tactical limits of comparison studies. The Behavior Analyst, 11, 1-9.
Johnston, J. M., Duncan, P. K., Monroe, C, Stephenson, H., and Stoerzinger, A. (1978). Tactics and benefits of behavioral measurement in business. Journal of Organizational Behavior Management, 1 (3) , 164-178.
Jones, F. H., Fremouw, W., and Carples, S. (1977). Pyramid training of elementary school teachers to use a classroom management “skill package.” Journal of Applied Behavior Analysis, 10 (2) , 239-253.
Kanfer, F. (1980). Self-management methods. In F. H. Kanfer and A. P. Goldstein (Eds.), Helping people change: A textbook of methods (Second edition, pp. 334-389). New York: Pergamon.
Karlsson, T. and Chase, P. N. (1996). A comparison of three prompting methods for training software use. Journal of Organizational Behavior Management, 16 (1) , 27-44.
Kazdin, A. E. (1994). Behavior modification in applied settings (Fifth edition). Pacific Grove, CA: Brooks/Cole.
Komaki, J. L. (1981/82). Managerial effectiveness: Potential contributions of the behavioral approach. Journal of Organizational Behavior Management, 3 (3) , 71-83.
Komaki, J. L., Blood, M., and Holder, D. (1980). Fostering friendliness in a fast food franchise. Journal of Organizational Behavior Management, 2 (3) , 151-164.
LaFleur, T. and Hyten, C. (1995). Improving the quality of hotel banquet staff performance. Journal of Organizational Behavior Management, 15 (1/2) , 69-93.
Latham, G. P. (1988). Human resource training and development. Annual Review of Psychology, 38, 545-582.
Latham, G. P. (1989). Behavioral approaches to the training and learning process. In I. L. Goldstein (Ed.), Training development in organizations (pp. 256-295). San Francisco: Jossey-Bass.
Latham, G. P. and Frayne, C. A. (1989). Increasing job attendance through training in self-management: A review of two studies. Journal of Applied Psychology, 74, 411-416.
Latham, G. P. and Whyte, G. (1994). The futility of utility analysis. Personnel Psychology, 47, 31-46.
Locke, E. A. and Latham, G. P. (1990). A theory of goal setting and task performance. Englewood Cliffs, NJ: Prentice-Hall.
Maher, C. A. (1981a). Improving the delivery of special education related services in public schools. Journal of Organizational Behavior Management, 3 (1) , 29-44.
Maher, C. A. (1981b). Training of managers in program planning and evaluation: Comparison of 2 approaches. Journal of Organizational Behavior Management, 3 (1) , 45-68.
Maher, C. A. (1982). Improving teacher instructional behavior: Evaluation of a time management training program. Journal of Organizational Behavior Management, 4 (3/4) , 27-36.
Maher, C. A. (1983). Description and evaluation of an approach to implementing programs in organizational settings. Journal of Organizational Behavior Management, 5(3/4), 69-98.
Maher, C. A. (1984). Training educational administrators in organizational behavior management: Program description and evaluation. Journal of Organizational Behavior Management, 6(1), 79-97.
Marx, R. D. (1982). Relapse prevention for managerial training: A model for maintenance of behavior change. Academy of Management Review, 7, 433-441.
Mawhinney, T. C. (1975). Operant terms and description of individual work behavior: Some problems of interpretation, application, and evaluation. Journal of Applied Psychology, 60, 704-712.
Mazur, J. E. (1990). Learning and behavior (Second edition). Englewood Cliffs, NJ: Prentice-Hall.
Methot, L. L., Williams, W. L., Cummings, A., and Bradshaw, B. (1996). Measuring the effects of a manager-supervisor training program through the generalized performance of managers, supervisors, front-line staff and clients in a human service setting. Journal of Organizational Behavior Management, 16 (2) , 3-25.
Morrow, C. C, Jarrett, M. Q., and Rupinski, M. T. (1997). An investigation of the effect and economic utility of corporate-wide training. Personnel Psychology, 50, 91-109.
Murphy, G. C. and Remnyi, A. G. (1979). Behavior analysis and organizational reality: The need for a technology of program implementation. Journal of Organizational Behavior Management, 2(2), 121-131.
Neef, N. A., Trachtenberg, S., Loeb, J., and Sterner, K. (1991). Video-based training of respite care providers: An interactional analysis of presentation format. Journal of Applied Behavior Analysis, 24, 473-486.
Nordstrom, R. R., Lorenzi, P., and Hall, R. V. (1990). A behavioral training program for managers in city government. Journal of Organizational Behavior Management, 11 (2) , 189-211.
Quilitch, H. R. (1975). A comparison of three staff-management procedures. Journal of Applied Behavior Analysis, 8, 59-66.
Reid, D. H. and Parsons, M. B. (1995). Comparing choice and questionnaire measures of the acceptability of a staff training procedure. Journal of Applied Behavior Analysis, 28, 317-322.
Reid, D. H. and Parsons, M. B. (1996). A comparison of staff acceptability of immediate versus delayed verbal feedback in staff training. Journal of Organizational Behavior Management, 16 (2) , 35-47.
Reid, D. H., Parsons, M. B., and Green, C. W. (1989). Staff management in human services: Behavioral research and applications. Springfield, IL: Thomas.
Resnick, L., Wang, M., and Kaplan, J. (1973). Task analysis in curriculum design: A hierarchically sequenced introductory mathematics curriculum. Journal of Applied Behavior Analysis, 6, 679-710.
Ross, P. C. (1982). Training: Behavior change and the improvement of business performance. In L. W. Frederiksen (Ed.), Handbook of organizational behavior management (pp. 181-217). New York: Wiley.
Rowe, B. J. (1981). The use of feedback and reinforcement to increase the telephone reporting of independent automobile appraisers. Journal of Organizational Behavior Management, 3 (2) , 35-40.
Royer, J. M. (1979). Theories of the transfer of learning. American Psychologist, 34, 53-69.
Runion, A., Watson, J. O., and McWhorter, J. (1978). Energy savings in interstate transportation through feedback and reinforcement. Journal of Organizational Behavior Management, 7(3), 180-191.
Seekins, T., Mathews, M., and Fawcett, S. B. (1984). Enhancing leadership skills for community self-help organizations through behavioral instructions. Journal of Community Psychology, 12, 155-163.
Stokes, T. F. and Baer, D. M. (1977). An implicit technology of generalization. Journal of Applied Behavior Analysis, 10, 349-367.
Stokes, T. F. and Osnes, P. G. (1989). An operant pursuit of generalization. Behavior Therapy, 20, 337-355.
Streff, F. M., Kalsher, M. J., and Geller, E. S. (1993). Developing workplace safety programs: Observations of response covariation. Journal of Organizational Behavior Management, 13 (2) , 3-14.
Tannenbaum, S. E. and Yukl, G. (1992). Training and development in organizations. Annual Review of Psychology, 43, 399-441.
van den Pol, R. A., Reid, D. H., and Fuqua, R. W. (1983). Peer training of safety-related skills to institutional staff: Benefits for trainers and trainees. Journal of Applied Behavior Analysis, 16 (2) , 139-156.
Van Houten, R. V. (1987). Comparing treatment techniques: A cautionary note. Journal of Applied Behavior Analysis, 20 (1) , 109-110.
Welsh, T. M., Johnson, S. P., Miller, L. K., Merrill, M. H., and Altus, D. E. (1989). A practical procedure for training meeting chairpersons. Journal of Organizational Behavior Management, 10 (1) , 151-166.
Wexley, K. W. (1984). Personnel training. Annual Review of Psychology, 35, 519-551.
Wilson, C, Boni, N., and Hogg, A. (1997). The effectiveness of task clarification, positive reinforcement, and corrective feedback in changing courtesy among police staff. Journal of Organizational Behavior Management, 17 (1) , 65-99.
(Redmon)
Redmon, William K. Handbook of Organizational Performance. Routledge, 20130403. VitalBook file.
The citation provided is a guideline. Please check each citation for accuracy before use.