TEACHERS BEHALF ON LANGUAGE TEST CONSTRUCTION

Nyak Mutia Ismail; Marisa Yoestara

doi:10.24071/llt.v20i2.734

TEACHERS BEHALF ON LANGUAGE TEST CONSTRUCTION

Nyak Mutia Ismail^(1*), Marisa Yoestara⁽²⁾,

(1) Syiah Kuala University
(2) Serambi Mekkah University, Aceh
(*) Corresponding Author

Abstract

There are four steps necessarily to be conducted when designing multiple-choice test items, namely setting the objective, building both concise stems and options, determining one correct answer, employing item indices to accept or discarding items (Brown, 2004). As a matter of fact, most teachers in Aceh are not very well-informed about the fourth step and they accept all items as they are. This study focuses on high school teachers who undergo all of the steps offered in the framework when constructing multiple-choice items for English summative test(s). The qualitative method using framework analysis was used in obtaining the data. A questionnaire was distributed to 15 teachers. The analysis process was carried out through three-step analysis (Miles, Huberman, & Saldana, 2013). The results depict that the teachers hardly conduct the index determining step or try-outs when constructing a test. This implies that there is no empirical warrant that all items are worth tested and can be the fundamentals for decision-making when assessing and evaluating students test results.

Keywords

test construction, language testing, multiple-choice items, summative test, and assessment and evaluation.

Full Text:

PDF

References

Brown, H. D. (2004). Language assessment: Principles and classroom practices. White Plains, NY: Longman.

Burton, S. J., Sudweeks, R. R., Merrill, P. F. & Wood, B. (1991). How to prepare better multiple-choice test items: Guidelines for university faculty. Utah, Brigham Young University Testing Service.

Chiedu, R. E. & Omenogor, H. D. (2014). The concept of reliability in language testing: issues and solutions. Journal of Resourcefulness and Distinction, 8 (1).

Cohen, A. S. & Wollack, J. A. (2015). Handbook on test development: Helpful tips for creating reliable and valid classroom tests. Retrieved from: https://testing.wisc.edu

Cuningham, S. A., Callaham, S. M. & Feld, J. K. (2013). Item development and test construction guidelines. Tucson, AZ: Assessment Technology, Inc.

Cyril, W. J. (2005). Language testings and validations. Hampshire, UK: McMillan Publishers.

Fulcher, G. & F. Davidson. (2007). Language testing and assessment. Boston: Routledge.

Haladyna, T. M. (2004). Developing and validating multiple-choice items. Mahwah, N.J.: Lawrence Erlbaum Associates.

Hughes, A. (2003). Testing for language teachers. Cambridge, UK: Cambridge University Press.

Jabbarifar, T. (2009). The importance of classroom assessment and Evaluation in educational system. In The Proceedings of the 2nd International Conference of Teaching and Learning, INTI University College, Negeri Sembilan, Malaysia.

Khairunnisak. (2016). The item analysis of English summative tests (Unpublished master thesis). Syiah Kuala University.

Nunally, J. C. (1982). Reliability of measurement. Encyclopedia of Educational Research, 4, 15-16.

Qu, W. & C. Zhang. (2013). The analysis of summative assessment and formative assessment and their roles in college English assessment systems. Journal of Language Teaching and Research, 4(2), 78-92.

Rahman, B., Abdurrahman, A., Kadaryanto, B. & Rusminto, N. E. (2015). Teacher-based scaffolding as a teacher professional development program in Indonesia. Australian Journal of Teacher Education, 40 (11).

Setiyana, R. (2016). Analysis of summative tests for English. English Education Journal, 7(4), 433-447.

Syahputri, V. N. & Ismail, N. M. (2017). English summative test and national curriculum: The compatibility. In The Proceeding of the 6th Aceh Development International Conference, Kuala Lumpur, Malaysia.

Zimmaro, D. M. (2010). Writing good multiple-choice exams. Retrieved from: https://facultyinnovate.utexas.edu/sites/default/files/documents/Writing-Good-Multiple-Choice-Exams-04-28-10.pdf

DOI: https://doi.org/10.24071/llt.v20i2.734