|
Identification and Assessment of Meta-Analysis Stages and Practices
(based on Figure 1, p. 307, Kirca & Yaprak, 2010)
|
|
|
Practice
|
|
|
|
1. Formulate problem
|
Identify and read relevant theoretical and empirical articles
|
|
|
|
|
Identify important, common variables, study, and measurement characteristics to assess
|
|
|
|
|
Identify contradictory findings
|
|
|
|
|
Decide on meta-analysis objectives
|
|
|
|
|
Develop preliminary theoretical framework
|
|
|
|
2. Collect Data
|
Conduct key-word database searches
|
|
|
|
|
Search references of key studies
|
|
|
|
|
Manually search relevant publications
|
|
|
|
|
Solicit studies from key researchers
|
|
|
|
|
Post requests for articles and working papers on academic list-serves
|
|
|
|
|
Develop elimination criteria
|
|
|
|
|
Screen studies according to elimination criteria
|
|
|
|
|
Decide whether data is sufficient to proceed with meta-analysis
|
|
|
|
3. Evaluate Data
|
Identify common metrics across studies (e.g. correlation coefficient)
|
|
|
|
|
Identify key substantial and methodological study characteristics
|
|
|
|
|
Prepare coding form and manual
|
|
|
|
|
Code each study
|
|
|
|
|
Prepare database and check for errors
|
|
|
|
4. Analyze Data
|
Conduct univariate analysis of mean effect sizes
|
|
|
|
|
Search for moderators using bivariate analysis of effect sizes
|
|
|
|
|
Search for moderators using multivariate analysis of effect sizes
|
|
|
|
|
Construct and analyze the meta-analytical correlation matrix to test theory
|
|
|
|
5. Interpret and discuss
|
Report univariate and bivariate findings using tables and figures
|
|
|
|
|
Make detailed recommendations for future research based on the findings
|
|
|