How Does Washback of Different Formats of Assessment Work Within Classroom in Physical Sciences- A Holistic Study
Abstract
Washback has been defined as an effect of assessment on teaching and learning which may be negative or positive. This study investigated the washback effect of multiple choice question (MCQ) format of assessment on learning of concepts in physical sciences (chemistry) as compared to constructed response tests (CRTs). This study collected perceptions of students through open-ended questionnaires about these two different formats of assessment in the subject of chemistry at the postgraduate level. Perceptions were validated through diagnostic analysis of midterm assessment consisting of CRT and MCQ format revealing their comparative washback. Post-test data were used to compare the performance of students for two sets of comparable chapters. This study revealed that students chose MCQ format to avoid narration and organization of responses, ultimately avoiding creativity, which lead to the proposal of a washback model. This study refutes the perception that MCQ format results in higher marking, is quicker, and is a more objective way of assessment. MCQs produced an equal level of comprehension of concepts as that produced by CRTs as washback applying paired sample t-test. MCQs did elicit higher order thinking but should be used along with other formats to design a comprehensive assessment.References
Alderson, J. C., & Wall, D. (1993). Examining washback: The Sri Lankan impact study.
Language Testing, 10(1), 41-69.
Ana, P. M., & Marta, E. A. (2010). Washback of an oral assessment system in EFL classroom. Language Testing, 27(1), 33-49.
Baily, K. M. (1996). Working for Washback: A Review of the Washback Concept in Language Testing. Language Testing, 13, 257.
Baker, J. B. (1989). Can we fairly measure the quality of education. Los Angeles, CA: Centre for Study of Evaluation (CSE).
Bedford, J. (2002). Washback – the Effect of Assessment on ESOL Teaching and Learning. In M. Portal (Ed.), Innovations in language testing. London, 9(1), 21-34.
Burrows, C. (1998). Searching for washback: An investigation into the impact on teachers of the implementation into the adult migrant English program of the certificate in spoken and written English. (Unpublished doctoral dissertation, Macquarie University, Sydney, Australia). Retrieved 10 September 2018 from …
Cheng, L. (1997a). How Does Washback Influence Teaching? Implications for Hong Kong.
Language and Education, 11(1), 38-54.
Davis, K. A. (1995). Qualitative theory and methods in applied linguistics. TESOL Quarterly, 29, 427-453.
Dina, T. (2009). The complexity of test washback: An empirical study. Frankfurt, Germany: Centre for Technical Studies.
Glaser, R., & Bassok, M. (1989). Learning theory and the study of instruction. Annual Review of Psychology, 40, 631-666.
Glaser, R. & Silver, E. (1994). Assessment, testing, and instruction: Retrospect and prospect (CSE Technical Report 379). University of Pittsburgh: CRESST/Learning Research and Development Centre.
Green, A. (2007). Washback to learning outcomes: a comparative study of IELTS preparation and university pre-sessional language courses. Assessment in Education, 14(1), 75-97.
Hughes, A. (1994). Backwash and TOEFL 2000. Reading, UK: University of Reading, Educational Testing Service (ETS).
McCurry, D. (2006). A High Degree of Difficulty: Assessing Higher-order Thinking. In. ... Higher Order Thinking Skills (pp. 45-59). Victoria: Adventure Works Press.
Melita, Djuric. (2008). Dealing with Situations of Positive and Negative Washback.
M.Djuric/Scripta Manent, 4(1), 14-27.
Melor, M. Y., & Hadi, S. (2011). The washback effect of entrance exam of the universities on the Iranian pre-university student's English learning. 18th International conference on learning (pp. 18-22). Mauritius: University of Mauritius.
Messick, S. (1996). Validity and washback in language testing. Language Testing, 13, 241.
Morrow, K. (1986). The Evaluation of Tests of Communicative Performance. In M. Portal (Ed.), Innovations in Language Testing: Proceedings of the IUS/NFER Conference (pp. 1-13). London: NFER/Nelson.
Newfields, T. (2005). Book Review of L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing: Research contexts and Methods. Retrieved 10 September 2018 from http://hosted.jalt.org/test/PDF/Newfields4.pdf
Pearson, I. (1998). Test as levers for change. In D. Chamberlain & R. J. Baumgardner (Eds.)
ESP in the classroom: Practice and evaluation (pp. 89-107). Retrieved 10 September 2018 from https://academic.oup.com/eltj/article-abstract/45/3/273/3113725 .
Qi, L. (2004). Has a high-stakes test produced the intended changes?. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. 56-71). Mahwah: NJ: Lawrence Erlbaum Associates.
Salehi, H., & Yunus, M. M. (2012). The Washback Effect of The Iranian Universities Entrance Exam: Teachers’ Insights. GEMA Online™ Journal of Language Studies, 12(2), 609-628.
Shepard, L. (1993). The place of testing reform in educational reform: A reply to Cizek.
Educational Researcher, 2(4), 10-14.
Shohamy, E. (1992). Beyond proficiency testing: A diagnostic feedback testing model for assessing foreign language learning. Modern Language Journal, 76, 513-521.
Swain, M. (1984). Large-scale communicative language testing: A case study. In S. J. Savignon & M. Berns (Eds.), Initiatives in communicative language teaching (pp. 185-201). Reading, MA: Addison-Wesley.
Tsagri, D. (2007, July 27). Review of washback in language testing: How has been done? What more needs doing? Lancaster, UK. Retrieved 10 September 2018 from https://files.eric.ed.gov/fulltext/ED497709.pdf
Wall, D. (1997). Impact and Washback in Language Testing. In C. Clapham & D. Corson (Eds.), Encyclopaedia of Language and Education. Vol. 7. Language Testing and Assessment (pp. 291-302). Dordrecht: Kluwer Academic.
Watanabe, Y. (1996). Does grammar translation come from the entrance examination? Preliminary findings from classroom-based research. Language Testing, 13(3), 318-333.
Watanabe, Y. (1997). Washback effects of the Japanese university entrance examination:
Classroom-based research.
Watanabe, Y. (2004). Teacher factors mediating washback. In L. Cheng, Y. Watanabe, & A.
Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. 129-146). Mahawa: NJ: Lawrence Erlbaum Associates.
