Understanding validity and reliability from qualitative and quantitative research traditions

Vu Thi Thanh Nha1,
1 University of Languages and International Studies, Vietnam National University, Hanoi

Main Article Content

Abstract

Educational constructs change over time to reflect developments in research and educational approaches. To illustrate the process, this article aims to examine validity and reliability, which are important concepts to justify research quality. Originally, validity and reliability were applied to quantitative research. However, these criteria can not be equally applied to qualitative research studies which differ in terms of their theoretical foundations and research aims. The unclear use of these concepts might lead to inappropriate research design or evaluation. This paper, therefore, first examines two different theoretical foundations underlying these two research traditions. It then analyses the subtle variations to clarify the notions of reliability and validity. Some implications are made for researchers to flexibly employ these criteria to enhance their research rigor.

Article Details

References

Aguinis, H., & Solarino, A. M. (2019). Transparency and replicability in qualitative research: The case of interviews with elite informants. Strategic Management Journal, 40(8), 1291-1315. https://doi.org/10.1002/smj.3015
Bradbury, H., & Reason, P. (2001). Conclusion: Broadening the bandwidth of validity: Issues and choice-point for improving quality of action research. In H. Bradbury & P. Reason (Eds.), The handbook of action research (pp. 447-455). Sage.
Burns, A. (2010). Action research. In B. Paltridge & A. Phakiti (Eds.), Continuum companion to research methods in applied linguistics (pp. 80-97). Continuum.
Chalhoub-Deville, M., Chapelle, C. A., & Duff, P. A. (Eds.). (2006). Inference and generalizability in applied linguistics: Multiple perspectives (Vol. 12). John Benjamins Publishing.
Dörnyei, Z. (2007). Research methods in applied linguistics: Quantitative, qualitative, and mixed methodologies. Oxford University Press.
Duff, P. A. (2008). Case study research in applied linguistics. Lawrence Erlbaum Associates.
Gass, S. (2010). Experimental research. In B. Paltridge & A. Phakiti (Eds.), Continuum companion to research methods in applied linguistics (pp. 7-21). Continuum.
Guba, E. G., & Lincoln, Y. S. (1989). Fourth generation evaluation. Sage.
Hammersley, M. (1992). What's wrong with ethnography: Methodological explorations. Routledge.
Kamberelis, G., & Dimitriadis, G. (2005). On qualitative inquiry: Approaches to language and literacy research. Teachers College Press.
Kuhn, T. (1970). The structure of scientific revolutions. University of Chicago Press.
Kvale, S. (2002). The social construction of validity. In N. Denzin & Y. Lincoln (Eds.), The qualitative inquiry reader (pp. 299-328). Sage.
Lincoln, Y., & Guba, E. (1985). Naturalistic inquiry. Sage.
Maxwell, J. A. (2005). Qualitative research design: An interactive approach. Sage.
Merriam, S. B. (2009). Qualitative research: A guide to design and implementation (2nd ed.). Jossey-Bass.
Nunan, D., & Bailey, K. M. (2009). Exploring second language classroom research: A comprehensive guide. Heinle, Cengage Learning.
Onwuegbuzie, A. J., & Leech, N. G. (2005). On becoming a pragmatic researcher: The importance of combining quantitative and qualitative research methodologies. International Journal of Social Research Methodology, 8(5), 375-387.
Qureshi, M. A. (2020). Grammaticality judgment task: Reliability and scope. The Journal of Asia TEFL, 17(2), 349-362.
Riazi, A. M., & Candlin, C. N. (2014). Mixed-methods research in language teaching and learning: Opportunities, issues and challenges. Language Teaching, 47(02), 135-173.
Schwandt, T. (2001). Dictionary of qualitative inquiry (2nd ed.). Sage.
Silverman, D. (2001). Interpreting qualitative data: Methods for analysing talk, text, and interaction (2nd ed.). Sage.
Silverman, D. (2005). Doing qualitative research (2nd ed.). Sage.
Silverman, D. (2006). Interpreting qualitative data: Methods for analyzing talk, text, and interaction (3rd ed.). Sage.
Świątkowski, W., & Dompnier, B. (2017). Replicability crisis in social psychology: Looking at the past to find new pathways for the future. International Review of Social Psychology, 30(1), 111-124.
Wolcott, H. F. (2005). The art of fieldwork. Alta Mira Press.
Yin, R. K. (2014). Case study research: Design and methods. Sage.