Meta-Analysis and Post-Modernism

The paradigms that characterize particular academic disciplines often orient research towards a style of design (Creswell, 2009). While all research contains both quantitative and qualitative elements, most studies emphasize one approach more than the other (Creswell, 2009). These research designs are not dichotomous opposites (Creswell, 2009). Rather, quantitative and qualitative designs represent the extremes of a continuum of possibilities (Creswell, 2009). For example, in mixed methods research, qualitative and quantitative forms are combined in tandem to strengthen any conclusions beyond the capability of a limited design (Creswell, 2009). By embracing a variety of assessment types, a mixed methodology transcends the limitations of a single research paradigm. However, a research design must be valid in the context of the specific problem. Researchers must justify the design of their study by demonstrating the functionality of selected means (Creswell, 2009).

Qualitative research is consistent with orientations are more concerned the exploration of meanings or the generation of change (Creswell, 2009). Constructivism is one such type of paradigm that focuses on the subjective interpretation of meaning (Creswell, 2009). Rather than test the validity of a perception, constructivist research explores the variety of subjective concepts and often attempts to describe the diverse interpretations of individuals. Other orientations toward advocacy emphasize collaborative participation to generate positive change (Creswell, 2009). This type of research attempts to understand a problem and identify the most appropriate means with which the conditions may be improved for individuals. Because of these exploratory functions, qualitative research tends to examine open ended questions (Creswell, 2009). Rather than adhere to a specific research design, qualitative studies must continuously develop in the context of the situation (Creswell, 2009). This ensures that the methods and interpretations are appropriate for the situation (Creswell, 2009). In qualitative research, themes are inductively interpreted from data gathered in an emerging design (Creswell, 2009). However, although this type of study may produce information that accurately represents a particular situation, the validity of any generalizations is limited because of the specificity of collected data.

In contrast, quantitative studies typically attempt to evaluate objective theories through deductive tests of specific hypotheses (Creswell, 2009). This type of research is often scientifically oriented. Postpositivism is one such type of orientation that emphasizes the empirical examination of relationships between variables (Creswell, 2009). From the postpositivist perspective, validity is defined as the degree to which perceptions are consistent with objectivity. Valid theories accurately represent the nature of a relationship between variables. Similarly, pragmatism is another paradigm that often emphasizes quantitative research (Creswell, 2009). Pragmatist research derives conclusions from functional applications of a theory (Creswell, 2009). Functional theories are the foundation for hypotheses that accurately predict the consequences of specific events. In quantitative research, the resulting measurements are interpreted through statistical analysis to enable conclusions regarding the hypothesis (Creswell, 2009). While this research design may generate conclusions regarding the validity of a theory in a particular case, it does little to explore the diverse possibilities of meanings and perceptions regarding a situation.

Meta-analysis is one type of quantitative design that integrates information from multiple sources (Whiston & Li, 2011). In this type of research, empirical information is interpreted through the statistical analysis of existing studies (Whiston & Li, 2011). The meta-analytic research of Cheng, Cheung, Chio and Chan (2013) collected data regarding psychological symptoms from a variety of prior studies. This study examined the relationship between locus of control and symptoms of depression and anxiety in order to quantify the effect of cultural orientations (Cheng et al., 2013). Their conclusions represent a quantitative interpretation of 152 studies including 33,224 individuals total (Cheng et al., 2013). While meta-analysis is an appropriate means with which to assess the validity of a theory across a large sample of the population, the degree to which particular cases are accurately represented in the study is reduced by the lack of depth in this type of data collection.

Specific operational definitions are established to select relevant information that is then coded into a system of calculations to generate a numeric value (Whiston & Li, 2011). These definitions are directly related to the variables that constitute a hypothesis of a relationship. Locus of control refers to a subjective perception regarding the causal origin of occurrences (Cheng et al., 2013). Rotter (1966) explained that the cultural norms in individualist societies emphasize independence and self reliance. In contrast, Bond and Smith (1996) describe the values of interdependence and harmony that are prioritized in collectivist societies. Because individuals in collectivist cultures are socialized to accommodate changes rather than resist them, as described by Morling, Kitayama, and Miyamoto (2002), Cheng et al (2013) predict that these societies will exhibit symptoms of depression and anxiety at a reduced frequency compared to individualist cultures.

Cheng et al. (2013) noted that individuals within collectivist cultures may be more prepared to endorse an external locus of control. Their hypothesis proposes that the relationship between locus of control and negative psychological symptoms is stronger in individualist societies. Their data analysis indicated that perceptions of an external locus of control are moderately related to symptoms of depression and anxiety (Cheng et al., 2013). This relationship was stronger in societies that are oriented toward individualism (Cheng et al., 2013). The results of their meta-analysis are consistent with the hypothetical relationship between cultural orientations and psychological symptoms (Cheng et al., 2013).

References

Bond, M. H., & Smith, P. B. (1996). Cross-cultural social and organizational psychology. Annual Review of Psychology, 47, 205–235. doi: 10.1146/annurev.psych.47.1.205

Cheng, C., Cheung, S., Chio, J. H., & Chan, M. S. (2013). Cultural meaning of perceived control: A meta-analysis of locus of control and psychological symptoms across 18 cultural regions. Psychological Bulletin, 39(1), 152-188. doi: 10.1037/a0028596

Creswell, J. W. (2009). Research Design (3rd Ed.). Los Angeles, CA: SAGE Publications.

Morling, B., Kitayama, S., & Miyamoto, Y. (2002). Cultural practices emphasize influence in the United States and adjustment in Japan. Personality and Social Psychology Bulletin, 28, 311–323. doi:10.1177/ 0146167202286003

Rotter, J. B. (1966). Generalized expectancies for internal versus external control of reinforcement. Psychological Monographs: General and Applied, 80, 1–28. doi:10.1037/h0092976

Whiston, S. C., & Li P. (2011). Meta-analysis: A systemic model for synthesizing counseling research. Journal of Counseling & Development. 89(3), 273-281.