VALIDATION OF A TOOL TO MEASURE THE LEVEL OF SCHOOL-UNIVERSITY PARTNERSHIP
Main Article Content
Abstract
This study aims at developing and validating an audit tool that could be used to assess school-university partnerships. Specifically, the study followed four steps of (i) evaluating and modifying contents and items of the original tool, (ii) qualitatively assessing content validity of the revised scale basing on expert ratings, and revising the scale accordingly, (iii) conducting cognitive interviews with potential participants, and making further revision, and (iv) quantitatively evaluating the validity and reliability of the audit tool based on data collected from 463 participants, and finalizing the tool. In the end, an audit tool consisting of 36 questions that fit into two scales (i.e., “Shared goals and values” and “Partnership operations and management”) was confirmed. The study also discussed potential uses of the tool for both currently working partnerships and newly formed partnerships; and at different levels.
Article Details
Keywords
school university partnership, level of partnership, validation
References
Adams, A., Miller-Korth, N., & Brown, D. (2004). Learning to work together: Developing academic and community research partnerships. Wmj-Madison, 103(2), 15-20. https://www.researchgate.net/profile/Alexandra-Adams-2/publication/8565566_Learning_to_Work_Together_Developing_Academic_and_Community_Research_Partnerships/links/00b4951dc32cb91bf0000000/Learning-to-Work-Together-Developing-Academic-and-Community-Research-Partnerships.pdf
Afsana, K., Habte, D., Hatfield, J., Murphy, J., & Neufeld, V. (2009). Partnership assessment toolkit. Canadian Coalition for Global Health Research. https://www.elrha.org/wp-content/uploads/2014/08/PAT_Interactive_e-1.pdf
Allen, J. M., Howells, K., & Radford, R. (2013). A ‘partnership in teaching excellence’: Ways in which one school-university partnership has fostered teacher development. Asia-Pacific Journal of Teacher Education, 41, 99-110. https://doi.org/10.1080/1359866X.2012.753988
Arhar, J., Niesz, T., Brossmann, J., Koebley, S., O’Brien, K., Loe, D., & Black, F. (2013). Creating a ‘third space’ in the context of a university-school partnership: Supporting teacher action research and the research preparation of doctoral students. Educational Action Research, 21(2), 218-236.
Armstrong, T. S., Cohen, M. Z., Eriksen, L., & Cleeland, C. (2005, May). Content validity of self-report measurement instruments: An illustration from the development of the brain tumor module of the MD Anderson symptom inventory. Oncology Nursing Forum, 32, 669. http://dx.doi.org/10.1188/05.ONF.669-676
Bailey, F., & Dolan, A. (2011) The meaning of partnership in development: Lessons in development education. Policy & Practice: A Development Education Review, 13, 30-48. https://www.developmenteducationreview.com/issue/issue-13/meaning-partnership-development-lessons-development-education
Beatty, P. C., & Willis, G. B. (2007). Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly, 71, 287-311. https://doi.org/10.1093/poq/nfm006
Behringer, B., Southerland, J. L., & Plummer, R. M. (2018). Case studies of community-academic partnerships established using the give-get grid model. Health Promotion Practice, 19, 654-663. http://doi.org/10.1177/1524839917740118
Bickel, W. E., & Hattrup, R. A. (1995). Teachers and researchers in collaboration: Reflections on the process. American Educational Research Journal, 32, 35-62. https://doi.org/10.3102/00028312032001035
Brandstetter, R., Bruijn, H., Byrne, M., Deslauriers, H., Förschner, M., & Machačová, J. (2006). Successful partnership: A guide. OECD LEED Forum on Partnerships and Local Governance. https://www.oecd.org/cfe/leed/36279186.pdf
Burroughs, G., Lewis, A., Battey, D., Curran, M., Hyland, N. E., & Ryan, S. (2020). From mediated fieldwork to co-constructed partnerships: A framework for guiding and reflecting on P-12 school–university partnerships. Journal of Teacher Education, 71, 122-134. https://doi.org/10.1177/0022487119858992
Carnwell, R., & Carson, A. (2005). Understanding partnerships and collaboration. In R. Carnwell & J. Buchanan (Eds.), Effective practice in health and social care (pp. 4-20). McGraw-Hill.
Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research, 12, 229-238. https://doi.org/10.1023/A:1023254226592
Crawford, G. (2003). Partnership or power? Deconstructing the “partnership for governance reform” in Indonesia. Third World Quarterly, 24, 139-159. https://doi.org/10.1080/713701365
Day, C. (1998). Re-thinking school–university partnerships: A Swedish case study. Teaching and Teacher Education, 14, 807-819. https://doi.org/10.1016/S0742-051X(98)00026-2
Green, C. A., Tindall-Ford, S. K., & Eady, M. J. (2020). School-university partnerships in Australia: A systematic literature review. Asia-Pacific Journal of Teacher Education, 48(4), 403-435.
Güvendir, M. A., & Özkan, Y. Ö. (2022). Item removal strategies conducted in exploratory factor analysis: A comparative study. International Journal of Assessment Tools in Education, 9, 165-180. https://doi.org/10.21449/ijate.827950
Hardy, B., Hudson, B., & Waddington, E. (2003). Assessing strategic partnership: The partnership assessment tool. Office of the Deputy Prime Minister of the UK. https://www.researchgate.net/profile/Bob-Hudson-3/publication/265039661_Assessing_Strategic_Partnership_The_Partnership_Assessment_Tool/links/54aa89e30cf2ce2df668995d/Assessing-Strategic-Partnership-The-Partnership-Assessment-Tool.pdf
Henrick, E. C., Cobb, P., Penuel, W. R., Jackson, K., & Clark, T. (2017). Assessing research-practice partnerships: Five dimensions of effectiveness. William T. Grant Foundation.
Magee, M. (2003). Qualities of enduring cross-sector partnerships in public health. The American Journal of Surgery, 185, 26-29. https://doi.org/10.1016/S0002-9610(02)01143-1
Maheady, L. J., Patti, A. L., Rafferty, L. A., & del Prado Hill, P. (2019). School–university partnerships: One institution’s efforts to integrate and support teacher use of high-leverage practices. Remedial and Special Education, 40, 356-364. https://doi.org/10.1177/0741932518812689
McLaughlin, C., & Black-Hawkins, K. (2004). A schools-university research partnership: Understandings, models and complexities. Professional Development in Education, 30(2), 265–284. https://www.tandfonline.com/doi/abs/10.1080/13674580400200245
Ministry of Education and Training of Vietnam. (2020a). Official dispatch no. 1201/BGDĐT-GDTrH on professional development for teachers and educational managers for the new school curriculum. https://thuvienphapluat.vn/cong-van/Giao-duc/Cong-van-1201-BGDDT-GDTrH-2020-boi-duong-giao-vien-trien-khai-Chuong-trinh-giao-duc-pho-thong-441960.aspx
Ministry of Education and Training of Vietnam. (2020b). Official dispatch no. 3089/BGDĐT-GDTrH on implementing STEM education in schools. https://moet.gov.vn/van-ban/vbdh/Pages/chi-tiet-van-ban.aspx?ItemID=2784
Moss, J. (2008). Leading professional learning in an Australian secondary school through school‐university partnerships. Asia‐Pacific Journal of Teacher Education, 36, 345-357. https://doi.org/10.1080/13598660802375941
Ng, S., & Chan, E. Y. (2012). School-University Partnership: Challenges and visions in the new decade. Global Studies of Childhood, 2, 38-56. https://doi.org/10.2304/gsch.2012.2.1.38
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459-467. https://doi.org/10.1002/nur.20199
Ryan, K., Gannon-Slater, N., & Culbertson, M. J. (2012). Improving survey methods with cognitive interviews in small-and medium-scale evaluations. American Journal of Evaluation, 33(3), 414-430. https://journals.sagepub.com/doi/pdf/10.1177/1098214012441499
Saw, S. M., & Ng, T. P. (2001). The design and assessment of questionnaires in clinical research. Singapore Medical Journal, 42(3), 131-135. http://www.smj.org.sg/article/design-and-assessment-questionnaires-clinical-research
Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. Sage Open, 9, Article 6. https://doi.org/10.1177/21582440188217
Smedley, L. (2001). Impediments to partnership: A literature review of school‐university links. Teachers and Teaching, 7, 189-209. https://doi.org/10.1080/13540600120054973
Smith, S., Akhyani, K., Axson, D., Arnautu, A., & Stanimirova, I. (2021). Learning together: A case study of a partnership to co-create assessment criteria. International Journal for Students as Partners, 5, 123-133. https://doi.org/10.15173/ijsap.v5i2.4647
Stein, K. F., Sargent, J. T., & Rafaels, N. (2007). Intervention research: Establishing fidelity of the independent variable in nursing clinical trials. Nursing Research, 56, 54-62. https://journals.lww.com/nursingresearchonline/Abstract/2007/01000/Intervention_Research__Establishing_Fidelity_of.7.aspx
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53. https://doi.org/10.5116%2Fijme.4dfb.8dfd
Vestergaard, A., Langevang, T., Morsing, M., & Murphy, L. (2021). Partnerships for development. Assessing the impact potential of cross-sector partnerships. World Development, 143, 105447.
Walker, R., Morrison, C., & Hay, I. (2019). Evaluating quality in professional experience partnerships for graduate teacher employability. Journal of Teaching and Learning for Graduate Employability, 10(1), 118-137.
Wanni, N., Hinz, S., & Day, R. (2010). Good practices in educational partnerships guide: UK-Africa higher and further education partnerships. Africa Unit; Association of Commonwealth Universities. http://hdl.voced.edu.au/10707/343913
Wasonga, C. O., & Wanzare, Z. O. (2011). Re-thinking school-university collaboration: Agenda for the 21st century. Educational Research and Reviews, 6(22), 1036-1045.
Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Australasian Journal of Paramedicine, 8(3), Article 2. https://doi.org/10.33151/ajp.8.3.93
Willis, L. D., Grimmett, H., & Heck, D. (2018). Exploring cogenerativity in initial teacher education school-university partnerships using the methodology of metalogue. In J. Kriewaldt, A. Ambrosetti, D. Rorrison & R. Capeness (Eds.), Educating future teachers: Innovative perspectives in professional experience (pp. 49-69). Springer.
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A. R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4, 165. https://doi.org/10.15171/jcs.2015.017
Afsana, K., Habte, D., Hatfield, J., Murphy, J., & Neufeld, V. (2009). Partnership assessment toolkit. Canadian Coalition for Global Health Research. https://www.elrha.org/wp-content/uploads/2014/08/PAT_Interactive_e-1.pdf
Allen, J. M., Howells, K., & Radford, R. (2013). A ‘partnership in teaching excellence’: Ways in which one school-university partnership has fostered teacher development. Asia-Pacific Journal of Teacher Education, 41, 99-110. https://doi.org/10.1080/1359866X.2012.753988
Arhar, J., Niesz, T., Brossmann, J., Koebley, S., O’Brien, K., Loe, D., & Black, F. (2013). Creating a ‘third space’ in the context of a university-school partnership: Supporting teacher action research and the research preparation of doctoral students. Educational Action Research, 21(2), 218-236.
Armstrong, T. S., Cohen, M. Z., Eriksen, L., & Cleeland, C. (2005, May). Content validity of self-report measurement instruments: An illustration from the development of the brain tumor module of the MD Anderson symptom inventory. Oncology Nursing Forum, 32, 669. http://dx.doi.org/10.1188/05.ONF.669-676
Bailey, F., & Dolan, A. (2011) The meaning of partnership in development: Lessons in development education. Policy & Practice: A Development Education Review, 13, 30-48. https://www.developmenteducationreview.com/issue/issue-13/meaning-partnership-development-lessons-development-education
Beatty, P. C., & Willis, G. B. (2007). Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly, 71, 287-311. https://doi.org/10.1093/poq/nfm006
Behringer, B., Southerland, J. L., & Plummer, R. M. (2018). Case studies of community-academic partnerships established using the give-get grid model. Health Promotion Practice, 19, 654-663. http://doi.org/10.1177/1524839917740118
Bickel, W. E., & Hattrup, R. A. (1995). Teachers and researchers in collaboration: Reflections on the process. American Educational Research Journal, 32, 35-62. https://doi.org/10.3102/00028312032001035
Brandstetter, R., Bruijn, H., Byrne, M., Deslauriers, H., Förschner, M., & Machačová, J. (2006). Successful partnership: A guide. OECD LEED Forum on Partnerships and Local Governance. https://www.oecd.org/cfe/leed/36279186.pdf
Burroughs, G., Lewis, A., Battey, D., Curran, M., Hyland, N. E., & Ryan, S. (2020). From mediated fieldwork to co-constructed partnerships: A framework for guiding and reflecting on P-12 school–university partnerships. Journal of Teacher Education, 71, 122-134. https://doi.org/10.1177/0022487119858992
Carnwell, R., & Carson, A. (2005). Understanding partnerships and collaboration. In R. Carnwell & J. Buchanan (Eds.), Effective practice in health and social care (pp. 4-20). McGraw-Hill.
Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research, 12, 229-238. https://doi.org/10.1023/A:1023254226592
Crawford, G. (2003). Partnership or power? Deconstructing the “partnership for governance reform” in Indonesia. Third World Quarterly, 24, 139-159. https://doi.org/10.1080/713701365
Day, C. (1998). Re-thinking school–university partnerships: A Swedish case study. Teaching and Teacher Education, 14, 807-819. https://doi.org/10.1016/S0742-051X(98)00026-2
Green, C. A., Tindall-Ford, S. K., & Eady, M. J. (2020). School-university partnerships in Australia: A systematic literature review. Asia-Pacific Journal of Teacher Education, 48(4), 403-435.
Güvendir, M. A., & Özkan, Y. Ö. (2022). Item removal strategies conducted in exploratory factor analysis: A comparative study. International Journal of Assessment Tools in Education, 9, 165-180. https://doi.org/10.21449/ijate.827950
Hardy, B., Hudson, B., & Waddington, E. (2003). Assessing strategic partnership: The partnership assessment tool. Office of the Deputy Prime Minister of the UK. https://www.researchgate.net/profile/Bob-Hudson-3/publication/265039661_Assessing_Strategic_Partnership_The_Partnership_Assessment_Tool/links/54aa89e30cf2ce2df668995d/Assessing-Strategic-Partnership-The-Partnership-Assessment-Tool.pdf
Henrick, E. C., Cobb, P., Penuel, W. R., Jackson, K., & Clark, T. (2017). Assessing research-practice partnerships: Five dimensions of effectiveness. William T. Grant Foundation.
Magee, M. (2003). Qualities of enduring cross-sector partnerships in public health. The American Journal of Surgery, 185, 26-29. https://doi.org/10.1016/S0002-9610(02)01143-1
Maheady, L. J., Patti, A. L., Rafferty, L. A., & del Prado Hill, P. (2019). School–university partnerships: One institution’s efforts to integrate and support teacher use of high-leverage practices. Remedial and Special Education, 40, 356-364. https://doi.org/10.1177/0741932518812689
McLaughlin, C., & Black-Hawkins, K. (2004). A schools-university research partnership: Understandings, models and complexities. Professional Development in Education, 30(2), 265–284. https://www.tandfonline.com/doi/abs/10.1080/13674580400200245
Ministry of Education and Training of Vietnam. (2020a). Official dispatch no. 1201/BGDĐT-GDTrH on professional development for teachers and educational managers for the new school curriculum. https://thuvienphapluat.vn/cong-van/Giao-duc/Cong-van-1201-BGDDT-GDTrH-2020-boi-duong-giao-vien-trien-khai-Chuong-trinh-giao-duc-pho-thong-441960.aspx
Ministry of Education and Training of Vietnam. (2020b). Official dispatch no. 3089/BGDĐT-GDTrH on implementing STEM education in schools. https://moet.gov.vn/van-ban/vbdh/Pages/chi-tiet-van-ban.aspx?ItemID=2784
Moss, J. (2008). Leading professional learning in an Australian secondary school through school‐university partnerships. Asia‐Pacific Journal of Teacher Education, 36, 345-357. https://doi.org/10.1080/13598660802375941
Ng, S., & Chan, E. Y. (2012). School-University Partnership: Challenges and visions in the new decade. Global Studies of Childhood, 2, 38-56. https://doi.org/10.2304/gsch.2012.2.1.38
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459-467. https://doi.org/10.1002/nur.20199
Ryan, K., Gannon-Slater, N., & Culbertson, M. J. (2012). Improving survey methods with cognitive interviews in small-and medium-scale evaluations. American Journal of Evaluation, 33(3), 414-430. https://journals.sagepub.com/doi/pdf/10.1177/1098214012441499
Saw, S. M., & Ng, T. P. (2001). The design and assessment of questionnaires in clinical research. Singapore Medical Journal, 42(3), 131-135. http://www.smj.org.sg/article/design-and-assessment-questionnaires-clinical-research
Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. Sage Open, 9, Article 6. https://doi.org/10.1177/21582440188217
Smedley, L. (2001). Impediments to partnership: A literature review of school‐university links. Teachers and Teaching, 7, 189-209. https://doi.org/10.1080/13540600120054973
Smith, S., Akhyani, K., Axson, D., Arnautu, A., & Stanimirova, I. (2021). Learning together: A case study of a partnership to co-create assessment criteria. International Journal for Students as Partners, 5, 123-133. https://doi.org/10.15173/ijsap.v5i2.4647
Stein, K. F., Sargent, J. T., & Rafaels, N. (2007). Intervention research: Establishing fidelity of the independent variable in nursing clinical trials. Nursing Research, 56, 54-62. https://journals.lww.com/nursingresearchonline/Abstract/2007/01000/Intervention_Research__Establishing_Fidelity_of.7.aspx
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53. https://doi.org/10.5116%2Fijme.4dfb.8dfd
Vestergaard, A., Langevang, T., Morsing, M., & Murphy, L. (2021). Partnerships for development. Assessing the impact potential of cross-sector partnerships. World Development, 143, 105447.
Walker, R., Morrison, C., & Hay, I. (2019). Evaluating quality in professional experience partnerships for graduate teacher employability. Journal of Teaching and Learning for Graduate Employability, 10(1), 118-137.
Wanni, N., Hinz, S., & Day, R. (2010). Good practices in educational partnerships guide: UK-Africa higher and further education partnerships. Africa Unit; Association of Commonwealth Universities. http://hdl.voced.edu.au/10707/343913
Wasonga, C. O., & Wanzare, Z. O. (2011). Re-thinking school-university collaboration: Agenda for the 21st century. Educational Research and Reviews, 6(22), 1036-1045.
Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Australasian Journal of Paramedicine, 8(3), Article 2. https://doi.org/10.33151/ajp.8.3.93
Willis, L. D., Grimmett, H., & Heck, D. (2018). Exploring cogenerativity in initial teacher education school-university partnerships using the methodology of metalogue. In J. Kriewaldt, A. Ambrosetti, D. Rorrison & R. Capeness (Eds.), Educating future teachers: Innovative perspectives in professional experience (pp. 49-69). Springer.
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A. R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4, 165. https://doi.org/10.15171/jcs.2015.017