Submitted:
22 January 2024
Posted:
23 January 2024
You are already at the latest version
Abstract
Keywords:
History of methodological debates in public health
Methodological approaches in research
Definition of mixed methods research (MMR)
Differences between the MM and multiple methods research
Philosophical position of MMR
Key assumptions and benefits of MMR
- The phenomenon under investigation's complexity;
- When the study goal necessitates both depth and breadth of comprehension; when both qualitative illuminations and quantitative generalizations are necessary;
- When the necessity for method mixing develops from experiencing conditions (seen gaps) after a research has already begun;
- When the necessary set of skills, knowledge, and funds are made accessible for the research's effective and proper execution.
- Problems appropriate for mixed methods research.
- When the reasons for employing mixed approaches are clear.
Models for MMR
Major MMR designs based on timing
- 1.
- Concurrent or parallel or convergent design
- 2.
- Sequential design
- 3.
- Transformative design
- 4.
- Nested or embedded design: In the health sciences, a common design is to utilize qualitative and quantitative approaches in tandem, embedding one in the other to generate fresh insights or more refined thinking. These are known as nested or embedded designs. They could be sequential or convergent design variations. To comprehend how experimental members feel about the treatment, a prototype would be to perform intervention research and include qualitative data in the intervention methods. Prior to the intervention, qualitative data may be used to inform strategies for best recruiting individuals or developing the intervention, throughout the experiment to study the procedure being experienced by members, or after the experiment to follow-up and well comprehend the quantitative results.
- 5.
- Multiphase design: A multiphase design comes from a series of projects that are connected by a shared goal. These are known as multiphase projects, and they are commonly employed in the health sciences. They frequently contain convergent and sequential parts. The ultimate goal, for example, could be to test, evaluate, implement, and develop a health preventive program for teenagers. Multiple projects, one quantitative, one qualitative, one mixed, and so on, must be carried out throughout the period with contacts in place; hence, one phase builds on another with the shared end goal of establishing and testing a health prevention program.
Major MMR designs based on weight
- 1.
- Qualitative dominant MMR
- 2.
- Quantitative dominant MMR
- 3.
- Equal status MMR
How should the methods be balanced?
Is MMR often better?
Sampling methods and sample size issues in MMR
Data combing methods in MMR
- 1.
- Merging data: This integration entails merging qualitative data in the kind of images or texts with quantitative data in the form of numerical data. This combination can be attained by reporting findings in a study's discussion section together, for example, reporting quantitative statistical data first, followed by qualitative statements or themes that support or dispute the quantitative results. This integration can also take place by using tables or figures that display both quantitative and qualitative findings.
- 2.
- Connecting data: This integration entails assessing one dataset, which is a quantitative survey, and then using the results to inform further data gathering (e.g., interview questions, participant identification). The integration occurs in this manner by combining the analysis of outcomes from the first phase with data gathering from the subsequent phase of the study.
- 3.
- Embedding data: In this type of integration, a secondary dataset is integrated within a superior, primary design. A collection of extra-qualitative data regarding how members experience an intervention during an experimental study is one example. Alternatively, qualitative data collection may go before an experimental test to inform method development or follow an experimental trial to help explain trial results.
Why mixed methods or strengths of MMR?
Limitations of MMR
- Resources: Because different types of data are collected and evaluated, mixed methods research necessitates a significant amount of time and resources to complete the many phases involved in MMR, comprising the time needed for data collection and analysis.
- Teamwork: Diverse methods for a study, as well as diverse writing styles, may emerge in interdisciplinary, multidisciplinary, and transdisciplinary cooperation. The challenges and rewards of a team approach to mixed methods research must be anticipated by team leaders.
- Word and pages limitations: Regardless of existing NIH page limits, scientists must defend their approaches in a high-quality MMR. Space can be saved by organizing information into a table or showing a figure of the mixed-methods techniques. Page and word limits also have an impact on the publication of MMR in scholarly journals, since word limits necessitate inventive ways of presenting material.
- Sampling issues: As discussed above in this seminar.
- Analytic and interpretive issues: When employing specific designs, problems arise during data processing and interpretation. The findings may clash or be inconsistent when the investigator integrates the data throughout a parallel design. A method for resolving disagreements, such as acquiring more data or reviewing the databases, must be considered. The primary challenges for designs utilizing a sequential design with one phase succeeding the other revolve around the "point of interface," in which the investigator must pick what findings from the first stage will be the focus of emphasis for the follow-up data collection. Making an interpretation based on integrated results may be difficult due to the investigator's or teams unequal attention to each dataset, the validity or accuracy of each dataset, and whether philosophies are related.
Practical applications of MMR approach in public health
Method of integration of quantitative and qualitative data
Conclusions
Author Contributions
Funding
Ethics approval and consent to participate
Availability of data and materials
Acknowledgments
Consent for publication
Competing interests
References
- Winslow, C.-E. The untilled fields of public health. Science 1920, 51, 23–33. [Google Scholar] [CrossRef] [PubMed]
- Comte, A.; Bridges, J.H. Republic of the West, Order and Progress: A General View of Positivism, Or, Summary Exposition of the System of Thought and Life; G. Routledge: 1848.
- Sidel, V.W. What Is Social Medicine? Monthly Review 1979, 56. [Google Scholar]
- Inhorn, M.C.; Whittle, K.L. Feminism meets the “new” epidemiologies: Toward an appraisal of antifeminist biases in epidemiological research on women's health. Social science & medicine 2001, 53, 553–567. [Google Scholar]
- Kaur, M. Application of mixed method approach in public health research. Indian journal of community medicine: Official publication of Indian Association of Preventive & Social Medicine 2016, 41, 93. [Google Scholar]
- Freudenberg, N.; Klitzman, S.; Saegert, S. Urban health and society: Interdisciplinary approaches to research and practice; John Wiley & Sons: 2009.
- Odin, S. Process metaphysics and Hua-Yen Buddhism: A critical study of cumulative penetration vs. interpretation; State University of New York Press: 1982.
- Sewall, J.; Wilkie, D.; Lin, M.C. Interactive hybrid simulation of large-scale traffic. In Proceedings of Proceedings of the 2011 SIGGRAPH Asia Conference; pp. 1–12.
- Hussein, A. The use of triangulation in social sciences research: Can qualitative and quantitative methods be combined? Journal of comparative social work 2009, 4, 106–117. [Google Scholar] [CrossRef]
- Gruskin, S.; Dickens, B. Human rights and ethics in public health. American Public Health Association: 2006; Vol. 96, pp 1903-1905.
- Castiel, L.D. The next millennium and epidemiology: Searching for information. Cadernos de Saúde Pública 1998, 14, 765–778. [Google Scholar] [CrossRef] [PubMed]
- Andrew, S.; Halcomb, E.J. Mixed methods research is an effective method of enquiry for community health research. Contemporary nurse 2007, 23, 145–153. [Google Scholar] [CrossRef]
- Andrew, S.; Salamonson, Y.; Everett, B.; Halcomb, E.J.; Davidson, P.M. Beyond the ceiling effect: Using a mixed methods approach to measure patient satisfaction. International Journal of Multiple Research Approaches 2011, 5, 52–63. [Google Scholar] [CrossRef]
- Soh, K.L.; Davidson, P.M.; Leslie, G.; DiGiacomo, M.; Rolley, J.X.; Soh, K.G.; Rahman, A.B.A. Factors to drive clinical practice improvement in a Malaysian intensive care unit: Assessment of organisational readiness using a mixed method approach. International Journal of Multiple Research Approaches 2011, 5, 104–121. [Google Scholar] [CrossRef]
- Jick, T.D. Mixing qualitative and quantitative methods: Triangulation in action. Administrative science quarterly 1979, 24, 602–611. [Google Scholar] [CrossRef]
- Rocco, T.; Bliss, L.; Gallagher, S.G.S.; Pérez, A.P.A.; Prado, P. Taking the next step: Mixed methods taking the next step: Mixed methods research in organizational systems research in organizational systems. Information technology, learning, and performance journal 2003, 21, 19. [Google Scholar]
- Johnson, R.B.; Onwuegbuzie, A.J.; Turner, L.A. Toward a definition of mixed methods research. Journal of mixed methods research 2007, 1, 112–133. [Google Scholar] [CrossRef]
- Fidel, R. Are we there yet?: Mixed methods research in library and information science. Library & information science research 2008, 30, 265–272. [Google Scholar]
- Molina-Azorin, J.F. Mixed methods research: An opportunity to improve our studies and our research skills. 2016.
- McFarlane, D.A. Understanding the challenges of science education in the 21st century: New opportunities for scientific literacy. International letters of social and humanistic sciences 2013, 35–44. [Google Scholar] [CrossRef]
- Pienaar-Marais, M.; Moolman, G. Research Methodological Trends in Business and Management Studies in South Africa: An Exploratory Bibliometric Survey. In Proceedings of ECRM2013-Proceedings of the 12th European Conference on Research Methods: ECRM 2013; p. 317.
- Johansson, I. Pluralism and Rationality in the Social Sciences. Studies of Higher Education and Research. Studies of Higher Education and Research 1990, 2. [Google Scholar]
- Struthers, J. The case for mixed methodologies in researching the teacher’s use of humour in adult education. Journal of Further and Higher Education 2011, 35, 439–459. [Google Scholar] [CrossRef]
- Wasti, S.P.; Simkhada, P.; van Teijlingen, E.R.; Sathian, B.; Banerjee, I. The Growing Importance of Mixed-Methods Research in Health. Nepal journal of epidemiology 2022, 12, 1175–1178. [Google Scholar] [CrossRef] [PubMed]
- Anguera, M.T.; Blanco-Villasenor, A.; Losada, J.L.; Sánchez-Algarra, P.; Onwuegbuzie, A.J. Revisiting the difference between mixed methods and multimethods: Is it all in the name? Quality & Quantity 2018, 52, 2757–2770. [Google Scholar]
- Creamer, E.G. Striving for methodological integrity in mixed methods research: The difference between mixed methods and mixed-up methods. John Wiley & Sons, Inc. Hoboken, USA: 2018; Vol. 107, pp 526-530.
- Greene, J.C. Mixed methods in social inquiry; John Wiley & Sons: 2007; Vol. 9.
- Morgan, D.L. Paradigms lost and pragmatism regained: Methodological implications of combining qualitative and quantitative methods. Journal of mixed methods research 2007, 1, 48–76. [Google Scholar] [CrossRef]
- Mertens, D.M. Transformative research and evaluation; Guilford press: 2008.
- Creswell, J.W.; Klassen, A.C.; Plano Clark, V.L.; Smith, K.C. Best practices for mixed methods research in the health sciences. Bethesda (Maryland): National Institutes of Health 2011, 2013, 541–545. [Google Scholar]
- Tariq, S.; Woodman, J. Using mixed methods in health research. JRSM short reports 2013, 4, 2042533313479197. [Google Scholar] [CrossRef] [PubMed]
- Strudsholm, T.; Meadows, L.M.; Robinson Vollman, A.; Thurston, W.E.; Henderson, R. Using mixed methods to facilitate complex, multiphased health research. International Journal of Qualitative Methods 2016, 15, 1609406915624579. [Google Scholar] [CrossRef]
- Creswell, J.W.; Clark, V.L.P. Designing and conducting mixed methods research; Sage publications: 2017.
- Paudel, D. Mixed Methods in Public Health Research. Health Prospect 2011, 10, 39–40. [Google Scholar] [CrossRef]
- Onwuegbuzie, A.J.; Collins, K.M. A typology of mixed methods sampling designs in social science research. Qualitative report 2007, 12, 281–316. [Google Scholar] [CrossRef]
- Teddlie, C.; Yu, F. Mixed methods sampling: A typology with examples. Journal of mixed methods research 2007, 1, 77–100. [Google Scholar] [CrossRef]
- Morgan, D.L. Practical strategies for combining qualitative and quantitative methods: Applications to health research. Qualitative health research 1998, 8, 362–376. [Google Scholar] [CrossRef]
- Vukojević, B. Creswell JW: Research design: Qualitative, quantitative, and mixed methods approaches, London: Sage publications, 2009. Politeia 2016, 6, 191–194. [Google Scholar]
- Plano Clark, V.L. The adoption and practice of mixed methods: US trends in federally funded health-related research. Qualitative Inquiry 2010, 16, 428–440. [Google Scholar] [CrossRef]
- Tashakkori, A.; Johnson, R.B.; Teddlie, C. Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences; Sage publications: 2020.
| Analysis of qualitative data | Analysis of quantitative data |
|---|---|
| Data import: texts, PDFs, tables, videos, webpages, social media… |
Descriptive statistics: Frequency tables Charts: bar charts, boxplots, histograms |
| Data exploration: search for words and word combinations, memos, comments, paraphrases, | Crosstabs and correlation |
| Data analysis: coding, memoing, writing summaries, visual tools… | Inferential statistics: Analysis of variance, chi-square test, correlation |
| Reporting: visual tools, exports |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).