An a Priori Analysis of Validity Evidence on The Speaking Section of TPELT, a Developed English Proficiency Test for Primary English Teachers

Agus Syahiddin, Ika Lestari Damayanti, Della N. Kartika Sari

Abstract


This article introduces a new English proficiency test, TPELT (The Test for Primary English Language Teachers), which has been developed for primary English teachers in non-native English speaking countries, with a focus on Indonesia. The study examines the a priori validity analysis of TPELT's speaking test, with the goal of demonstrating its usefulness in assessing English proficiency. The article also discusses the concept of validity and its significance in test development, as well as the two methods for establishing validity. The researchers used a descriptive qualitative approach to gather and analyze data for the study, including documents, checklists, and interviews with the TPELT developers. To assess the a priori validity of the test, the researchers employed Wier's framework and analyzed TPELT's blueprint alongside frameworks for each English skill assessed in the test. The a priori validity analysis findings indicate that TPELT is a valid test for measuring English proficiency and competence among teachers. The evidence supports the test's theory-based and context validity, and its convenience and comprehensiveness make it an ideal choice for assessment purposes.

Full Text:

PDF

References


Anastasi, A. (1988) Psychological Testing (6th edition). New York: Macmillan.

Bogdan, R. C., & Biklen, S. K. (1982). Qualitative research for education: An introduction to theory and methods. Boston: Allyn and Bacon.

Bradford, A. (2016). Toward a typology of implementation challenges facing English-medium instruction in higher education: evidence from Japan. J. Stud. Int. Educ. 20, 339–356. doi: 10.1177/1028315316647165

Cunningsworth, A. (1995). Choosing Your Coursebook. Oxford: McMillan (Publishers Limited)

Freeman, D., Katz, A., Gomez, P. G., and Burns, A. (2015). English-for-teaching: rethinking teacher proficiency in the classroom. ELT J. 69, 129–139. doi: 10.1093/elt/ccu074

Green, A. (2013). Exploring Language Assessment and Testing.

Gultom, S. (2013). Materi Pelatihan Guru: Implementasi Kurikulum 2013 (Teacher Training Materials: 2013 Curriculum Implementation). Paper presented on National Education Quality Conference, Ambon, Maluku, Indonesia

Jones, R.G. (2013). Communication in the Real World: An Introduction to Communication. Studies.Flat World Knowledge

Khalifa, H. & Weir, C. J. (2009). Examining Reading. Research and Practice in assessing second language reading, Studies in Language Testing. Cambridge: UCLESCambridge University press.

Lado, R. (1961). Language testing: The construction and use of foreign language tests: A teacher’s book. Bristol, Inglaterra: Longmans, Green and Company.

Lincoln, Y. S. & Guba, E. G. (1985). Naturalistic Inquiry. California: Sage.

Macaro, E. (2020). Exploring the role of language in English medium instruction. Int. J. Biling. Educ. Bilingual. 23, 263–276. doi: 10.1080/13670050.2019.1620678

Messick S. 1989. Validity. In Linn, R.L. (ed.). 1989. Educational measurement. Third edition. New York: American Council on Education/Collier Macmillan, pp 13-103.

Mukundan, J., Nimehchisalem, V., and Hajimohammadi (2011). Developing an English Language Textbook Evaluation Checklist: A Focus Group Study. International Journal of Humanities and Social Science

Norris, J. M. (2012). Purposeful Language Assessment: Selecting the Right Alternative Test. English Teaching Forum, 50(3), 41–45.

Nunan, D. (1999). Second language teaching & learning. Boston. MA: Heinle & Heinle.

O'Dowd, R. (2018). The training and accreditation of teachers for English medium instruction: an overview of practice in European universities. Int. J. Biling. Educ. Bilingual. 21, 553–563. doi: 10.1080/13670050.2018.1491945

Pun, J. K., and Thomas, N. (2020). English medium instruction: Teachers' challenges and coping strategies. ELT J. 74, 247–257. doi: 10.1093/elt/ccaa024

Rose, H., Curle, S., Aizawa, I., and Thompson, G. (2019). What drives success in English medium taught courses? The interplay between language proficiency, academic skills, and motivation. Stud. High. Educ. 45, 2149–2161. doi: 10.1080/03075079.2019.1590690

Septiana, F.I. (2013). A Priori Validity of Summative Test Items Developed by EFL Teachers: A research paper. Universitas Pendidikan Indonesia.

Sikki, E. A. A., Rahman, A., Hamra, A., and Noni, N. (2013). The Competence of Primary School English Teachers in Indonesia. Journal of Education and Practice (JEP). 4, 11. ISSN (Paper)2222-1735 ISSN (Online)2222-288X.

Urquhart, S., & Weir, C. (1998). Reading in a second language: Process, product and practice. London and New York: Longman.

Weir, Cyril Jj (2005). Language testing and validation:an evidence based approach. Basingstoke: Palgrave MacMillan.

Xudong, X. (2008). An investigation into the extent of theory-based validity of the essay in TEM8. Celea Journal.




DOI: http://dx.doi.org/10.30870/jels.v8i1.18941

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Journal of English Language Studies

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Creative Commons License
Journal of English Language Studies is licensed under a Creative Commons Attribution 4.0 International License.

Copyright @ 2024 Journal of English Language Studies.