.png)
.png)
A Comparative Study of Using Analytic and Holistic Methods of Scoring in Measuring Speaking Skill Among Iranian Second-grade University EFL Students
Abstract
Evaluating the speaking skill is in fact complicated and rigid. Two methods of assessing the speaking completion are analytic and holistic scoring. The methods of investigating the oral skill were investigated deeply. Spoken skills of English belonging 70 individuals, those were Iranian second-grade university EFL students, were evaluated by speaking addressee and examiner. The speaking addressee performs the holistic scoring though the examiner directed the analytic scoring. Context and construction, vocabulary, grammar and pronunciation are the classes of analytic scoring. The analytic mean of four scales was 3.396, although the mean of holistic scoring was 3.628. The results showed a statistically considerable diversity between analytic and holistic methods of evaluation considering that p-value was estimated at 0.002 (P < 0.05). Therefore, it is recommended that employing these two scoring techniques in the procedure of evaluation may be considered proper seeing that one augment the other and lead to more inclusive evaluation.
Full Text:
PDFReferences
Abedi, P., Keshmirshekan, M. H., & Namaziandost, E. (2019). The comparative effect of flipped classroom instruction versus traditional instruction on Iranian intermediate EFL learners' English composition writing. Journal of Applied Linguistics and Language Research, 6(4), 43-56.
Al-Amri, M. (2010). Direct spoken English testing is still a real challenge to be worth bothering about. English Language Teaching, 3 (1), 113-117.
Aleksandrzak, M. (2011). Problems and challenges in teaching and learning speaking at advanced level. Glottodidactica, 37, 37-48.
Allen, D. & Tanner, K. (2006). Rubrics: Tools for making learning goals and evaluation criteria explicit for both teachers and learners. Life Sciences Education, 5 (3), 197–203.
Anderson, J. (2015). A guide to the practice of English language teaching for teachers and trainee teachers. Nairobi: East African Educational Publishers Ltd.
Azadi, G., Biria, R., & Nasri, M. (2018). Operationalising the Concept of Mediation in L2 Teacher Education. Journal of Language Teaching and Research, 9(1), 132-140.
Baryla, E., Shelley, G., & Trainor, W. (2012). Transforming rubrics using factor analysis: Practical assessment. Practical Assessment Research & Evaluation, 17 (4).
Bilá, M. (2010). Perception and production of a second language and the concept of a foreign accent. In S. Pokrivčáková et al. (Eds.) Modernization of teaching foreign languages: CLIL, inclusive and intercultural education, pp. 123-143. Brno: Masaryk University.
Cambridge English: Understanding Results Guide. (2014). http://www.gml.cz/prof/zajickova/Cambridge%20exams_information/Understanding%20results%20guide.pdf
Chen, G. (2016). Developing a Model of analytic rating scales to assess college students‟ l2 Chinese oral performance. International Journal of Language Testing, 6 (2), 50-71.
Chuang, Y. (2009). Foreign language speaking assessment: Taiwanese college English teachers‟ scoring performance in the holistic and analytic rating methods. The Asian EFL Journal, 11 (1), 150-173.
Council of Europe. (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge: Press Syndicate of the University of Cambridge.
Davies, A. (1999). Dictionary of language testing. Cambridge: Cambridge University Press.
Dogan, C. & Uluman. M. (2017). A comparison of rubrics and graded category rating scales with various methods regarding raters’ reliability. Educational Sciences: Theory & Practice, 17 (2), 631-651. doi:10.12738/ estp.2017.2.0321.
Finson, K., Ormsbee, C., & Jensen, M. (2011). Differentiating science instruction and assessment for learners with special needs, k-8. Thousand Oaks: Corwin, A SAGE Company.
Goh, C. & Burns, A. (2012). Teaching speaking: A holistic approach. New York: Cambridge University Press.
Göktürk, N. (2016). Examining the Effectiveness of Digital Video recordings on Oral Performance of EFL Learners. Teaching English with Technology, 16 (2), 71-96.
Gondová, D. (2014). Taking first steps in teaching English: Assessing learners. Žilina: EDIS.
Green, A. (2014). Exploring language assessment and testing: Language in action. New York: Routledge.
Griffith, W. & Lim, H. (2012). Performance-based assessment: rubrics, web 2.0 tools and language competencies. Mextesol Journal, 36 (1).
Hashemifardnia, A., Namaziandost, E., & Rahimi Esfahani, F. (2018a). The Effect of Teaching Picture-books on Elementary EFL Learners’ Vocabulary Learning. JELTL (Journal of English Language Teaching and Linguistics), 3(3), 247-258.
Hashemifardnia, A., Namaziandost, E., & Sepehri, M. (2018). The effectiveness of giving grade, corrective feedback, and corrective feedback-plus-giving grade on grammatical accuracy. International Journal of Research Studies in Language Learning, 8 (1), 15-27.
Hashemifardnia, A., Namaziandost, E., Shafiee, S. (2018). The Effect of Implementing Flipped Classrooms on Iranian Junior High School Students' Reading Comprehension. Theory and Practice in Language Studies, 8(6), 665-673.
Helvoort, J. (2010). A scoring rubric for performance assessment of information literacy in Dutch higher education. Journal of Information Literacy, 4 (1), 22-39.
Hosseini, E. Z., Nasri, M., & Afghari, A. (2017). Looking beyond teachers’ classroom behavior: novice and experienced EFL teachers’ practice of pedagogical Knowledge to Improve Learners’ Motivational Strategies. Journal of Applied Linguistics and Language Research, 4(8), 183-200.
Jankowska, A. & Zielińska, U. (2015). Designing a self-assessment instrument for developing the speaking skill at the advanced level. In M. Pawlak and E. WaniekKlimczak (Eds.) Issues in teaching, learning and testing speaking in a second language. Heidelberg: Springer.
Jonnson, A. & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2 (2), 130-144.
Kaba, Y. & Sengül, S. (2016). Developing the rubric for evaluation problem posing (REPP). International Online Journal of Educational Sciences, 8 (1), 8-25.
Khamkhien, A. (2010). Teaching English speaking and English-speaking tests in the Thai context: a reflection from Thai perspective. English Language Teaching, 3 (1), 184-190.
Kondo-Brown, K. (2002). A FACETS analysis of rater bias in measuring Japanese second language writing performance. Language Testing, 19 (1), 3-31.
Llach, M. (2011). Lexical errors and accuracy in foreign language writing. New York: Multilingual Matters.
Luoma, S. (2004). Assessing speaking. Cambridge: Cambridge University Press.
Metruk, R. (2017). Pronunciation of English dental fricatives by Slovak University EFL Students. International Journal of English Linguistics, 7 (3), 11-16.
Mirshekaran, R., Namaziandost, E., & Nazari, M. (2018). The Effects of Topic Interest and L2 Proficiency on Writing Skill among Iranian EFL Learners. Journal of Language Teaching and Research, 9(6), 1270-1276.
Murugaiah, P. (2016). Pecha Kucha style PowerPoint presentation: An innovative CALL approach to developing oral presentation skills of tertiary students. Teaching English with Technology, 16 (1), 88-104.
Myford, C. & Wolfe, E. (2003). Detecting and measuring rater effects using many facet Rasch measurement: Part I. Journal of Applied Measurement, 4 (4), 386-422.
Namaziandost E., & Nasri, M. (2019a). A meticulous look at Long’s (1981) interaction hypothesis: does it have any effect on speaking skill? Journal of Applied Linguistics and Language Research, 6(2), 218-230.
Namaziandost E., & Nasri, M. (2019b). The impact of social media on EFL learners’ speaking skill: A survey study involving EFL teachers and students. Journal of Applied Linguistics and Language Research, 6(3), 199-215.
Namaziandost E., & Nasri, M. (2019c). Innovative practices in L2 writing materials in the EFL classroom: Effect on writing enhancement and attitude to English course. Asian Journal of Research in Social Sciences and Humanities, 9(9), 1-12.
Namaziandost, E., & Nasri, M., Rahimi Esfahani, F., & Keshmirshekan M. H. (2019). The impacts of spaced and massed distribution instruction on EFL learners’ vocabulary learning. Cogent Education, 6: 1661131. https://doi.org/10.1080/2331186X.2019.1661131
Namaziandost, E., Shatalebi, V., & Nasri, M. (2019). The impact of cooperative learning on developing speaking ability and motivation toward learning English. Journal of Language and Education, 5(3), 83-101. https://doi.org/10.17323/jle.2019.9809.
Namaziandost, E., Nasri, M., & Keshmirshekan, M. H. (2019). Cohesive conjunctions in applied linguistics research articles among Iranian and non-Iranian researchers: A comparative corpus-based study. Journal of English Language Studies, 4(2), 101 – 119.
Namaziandost, E., Neisi, L., Kheryadi, & Nasri, M. (2019). Enhancing oral proficiency through cooperative learning among intermediate EFL learners: English learning motivation in focus. Cogent Education, 6(1), 1-15. https://doi.org/10.1080/2331186X.2019.1683933
Namaziandost, E., Sabzevari, A., & Hashemifardnia, A. (2018). The effect of cultural materials on listening comprehension among Iranian upper-intermediate EFL learners: In reference to gender. Cogent Education,5(1), 1-27. https://doi.org/10.1080/2331186X.2018.1560601.
Namaziandost, E., Rahimi Esfahani, F., & Ahmadi, S. (2019). Varying levels of difficulty in L2 reading materials in the EFL classroom: Impact on comprehension and motivation. Cogent Education, 6(1), 1-9. https://doi.org/10.1080/2331186X.2019.1615740.
Namaziandost, E., Hosseini, E., & Utomo, D. W. (2020). A comparative effect of high involvement load versus lack of involvement load on vocabulary learning among Iranian sophomore EFL learners. Cogent Arts & Humanities, 7(1), 1715525. https://doi.org/10.1080/23311983.2020.1715525
Nasri, M. & Biria, R. (2017). Integrating multiple and focused strategies for improving reading comprehension and l2 lexical development of Iranian intermediate EFL learners. International Journal of Applied Linguistics & English Literature, 6(1), 311-321.
Nasri, M., Biria, R., & Karimi, M. (2018). Projecting Gender Identity in Argumentative Written Discourse. International Journal of Applied Linguistics & English Literature, 7(3), 201-205.
Nasri, M., Namaziandost, E., & Akbari, S. (2019). Impact of pictorial cues on speaking fluency and accuracy among Iranian pre-intermediate EF learners. International Journal of English Language and Literature Studies, 8(3), 99-109
O’ Sullivan, B. (2012). Assessing speaking. In C. Coombe, P. Davidson, B. O’ Sullivan, and S. Stoynoff (Eds.) the Cambridge guide to second language assessment, pp. 234- 246. New York: Cambridge University Press.
Pan, M. (2016). Nonverbal delivery in speaking assessment. from an argument to a rating scale formulation and validation. Singapore: Springer.
Pokrivčáková, S. (2010). Modern teacher of English. Nitra: ASPA. Razali, K. & Isra, M. (2016). Male and female teachers’ roles in assessment of speaking skill: Gender equality: International Journal of Child and Gender Studies, 2 (1), 1-10.
Richards, J. & Schmidt, R. (2013). Longman dictionary of language teaching and applied linguistics (4th ed.). New York: Routledge.
Ruammai, P. (2014). Constructing scoring instrument for writing assessment and fostering critical thinking. In H. Lee (Ed.) The international conference on language and communication innovative inquiries and emerging paradigms in language, media and communication, pp. 127-137.
Saritha, K. (2016). Rubric for English language teaching research. Research Journal of English Language and Literature, 4 (2), 725-731.
Sarwar, M., Alam, M., Hussain, S., Shah, A., & Jabeen, M. (2014). Assessing English speaking skills of prospective teachers at entry and graduation level in teacher education program. Language Testing in Asia, 4 (5).
Schunn, C., Godley, A., & DeMartino, S. (2016). The reliability and validity of peer review of writing in high school English classes. Journal of Adolescent & Adult Literacy, 60 (1), 13-23. doi:10.1002/jaal.525
Shatrova, Z., Mullings, R., Blažejová, S., & Üstünel, E. (2017). English speaking assessment: developing a speaking test for students in a preparatory school. International Journal of English Language Teaching, 5 (3), 27-40.
Taylor, L. & Galaczi, E. (2011). Scoring validity. In L. Taylor (Ed.), M. Milanovic & C. Weir (Series Eds.) Studies in language testing 30. examining speaking. research and practice in assessing second language speaking, pp. 171-233. Cambridge: Cambridge University Press.
Thornbury, S. (2005). How to teach speaking. Harlow: Pearson Education Limited.
Topkaraoğlu, M. & Dilman, H. (2014). Effects of studying vocabulary enhancement activities on students”vocabulary production levels. Procedia - Social and Behavioral Sciences, 152, 931-936. https://doi.org/10.1016/j.sbspro.2014.09.345
Tuan, L. (2012). Teaching and assessing speaking performance through analytic scoring approach. Theory and Practice in Language Studies, 2 (4), 673-679. doi:10.4304/tpls.2.4.673-679. https://doi.org/10.4304/tpls.2.4.673-679
Ur, P. (2012). A course in English language teaching. Cambridge: Cambridge University Press.
Vafee, P. & Yaghmaeyan, B. (2015). Providing evidence for the generalizability of a speaking placement test scores. Iranian Journal of Language Testing, 5 (2), 78-95.
Ziafar M., & Namaziandost, E. (2019). Linguistics, SLA and lexicon as the unit of language. International Journal of Linguistics, Literature and Translation (IJLLT), 2(5), 245-250
DOI: http://dx.doi.org/10.30870/jels.v5i1.6397
Refbacks
- There are currently no refbacks.
Copyright (c) 2020 Journal of English Language Studies
Journal of English Language Studies is licensed under a Creative Commons Attribution 4.0 International License.
Copyright @ 2024 Journal of English Language Studies.