Table of Contents

List of Contributors x

Preface xii

Acknowledgments xiii

Part I Foundations 1

1 History of Research Methods in Industrial and Organizational Psychology: Measurement, Design, Analysis 3
James T. Austin, Charles A. Scherbaum, and Robert A. Mahlman

2 Ethics in Research 34
Herman Aguinis and Christine A. Henle

3 Validity and Reliability 57
Robert M. Guion

4 The Relative Validity and Usefulness of Various Empirical Research Designs 77
Eugene F. Stone-Romero

5 An Introduction to Qualitative Research: Its Potential for Industrial and Organizational Psychology 99
Karen Locke and Karen Golden-Biddle

6 Using Power Analysis to Evaluate and Improve Research 119
Kevin Murphy

Part II Data Collection Procedures and Approaches 139

7 Organizational Survey Research 141
Steven G. Rogelberg, Allan H. Church, Janine Waclawski, and Jeffrey M. Stanton

8 Qualitative Data Collection and Analysis 161
Peter D. Bachiochi and Sara P. Weiner

9 Computational Modeling 184
Michael J. Zickar and Jerel E. Slaughter

10 Research Perspectives on Meta-Analysis 198
Allen I. Huffcutt

11 Methodological Issues In Cross-Cultural Organizational Research 216
Michele J. Gelfand, Jana L. Raver, and Karen Holcombe Ehrhart

12 Issues in Multilevel Research: Theory Development, Measurement, and Analysis 247
David A. Hofmann

13 Beyond Online Surveys: Internet Research Opportunities for Industrial-Organizational Psychology 275
Jeffrey M. Stanton and Steven G. Rogelberg

Part III Data Investigation 295

14 Outliers and Influential Cases: Handling those Discordant Contaminated Maverick Rogues 297
Philip L. Roth and Fred S. Switzer III

15 Coping With Missing Data 310
Fred S. Switzer III and Philip L. Roth

16 Item Analysis: Theory and Practice Using Classical and Modern Test Theory 324
Barbara B. Ellis and Alan D. Mead

17 Method Variance and Method Bias in Industrial and Organizational Psychology 344
James M. Conway

18 Basic and Advanced Measurement Models for Confirmatory Factor Analysis 366
Larry J. Williams, Lucy R. Ford, and Nhung Nguyen

19 Modeling Complex Data Structures: The General Linear Model and Beyond 390
Richard P. DeShon and Scott B. Morris

20 Longitudinal Modeling 412
David Chan

21 Modeling Nonlinear Relationships: Neural Networks and Catastrophe Analysis 431
Paul J. Hanges, Robert G. Lord, Ellen G. Godfrey, and Jana L. Raver

Part IV Concluding Thoughts 457

22 Writing Research Articles: Update on the Article Review Checklist 459
Erica I. Desrosiers, Kathryn Sherony, Eduardo Barros, Gary A. Ballinger, Sinem Senol, and Michael A. Campion

23 Securing our Collective Future: Challenges Facing Those Designing and Doing Research in Industrial and Organizational Psychology 479
Steven G. Rogelberg and Margaret E. Brooks-Laber

Name Index 486

Subject Index 506

About the Author

Dr. Steven G. Rogelberg (Associate Professor, Psychology and Adjunct Associate Professor, Business Administration) is Director of the Industrial and Organizational Psychology Program at UNC Charlotte. He has over 45 publications and 25 invited addresses/colloquiums addressing issues such as organizational research methods, team effectiveness, health and employee well-being, meetings at work, and organizational development. He is the Editor-in-Chief of the two-volume Encyclopedia of Industrial and Organizational Psychology (in progress). Recent honors include being named Chair of Education and Training for the Society of Industrial and Organizational Psychology (SIOP), serving as a SIOP Executive Board Member, serving as Guest Editor for Organizational Research Methods, receiving the 2001 Bowling Green State University (BGSU) Psi Chi Professor of the Year Award, and receiving the BGSU Master Teacher Award. Prior to his recent tenure at UNCC, Rogelberg was an Associate Professor of Psychology in the Industrial and Organizational Psychology area at BGSU. Before completing his Ph.D. in Industrial/Organizational Psychology at the University of Connecticut in 1994, he received his undergraduate B.Sc. degree from Tufts University in 1989.

Reviews

"This one volume covers both traditional design and measurement issues as well as a host of cutting-edge topics. At last a readable and comprehensive review of research methodology for the organizational scientist!" Robert L. Dipboye, Rice University

"This handbook is 'must-reading' for all graduate students in I/O psychology as well as for the more experienced I/O researcher and practitioner who will benefit from a review, an update, and the opportunity to learn new approaches." Sheldon Zedeck, University of California at Berkeley

"Rogelberg's handbook is a Rosetta Stone for researchers." Milton D. Hakel, Bowling Green State University

"A handbook that brings together the best researchers and thinkers in the areas of social science methodology and data analysis. This informative collection is a 'must-read' for all those interested in method-related issues." Wally Borman, University of South Florida
"This volume provides a comprehensive and cutting-edge examination of research and statistical methods that are used in the field. It will be an invaluable resource for faculty and students. I have no doubt that the book will easily meet its goal of helping to improve research quality." James L. Farr, Pennsylvania State University

"Excellent coverage of key issues and packed with useful ideas." Peter Warr, University of Sheffield

"The topics are well chosen and the chapters are written in an accessible style. The handbook is an indispensable reference for those interested in this important area." Nik Chmiel, Queen's University, Belfast