Examining the Readability Level of Reading Texts in English Textbook for Indonesian Senior High School

Adib Aminul Hakim, Endang Setyaningsih, Dewi Cahyaningrum


Assuming that textbooks authors have conducted the readability measure, many of its users often take this key feature of a good textbook for granted. Nonetheless, considering the unique context of each classroom and the generic nature of textbooks written for the public, teachers should double-check the appropriateness of the book they use, including its readability. Although tech-assisted readability measurement is developing in many parts of the world, in Indonesia, this area is still under-researched. For this reason, the present study attempts to examine the readability level of an English textbook using Coh-Metrix. Content analysis is employed since the object being analyzed is a textbook. This study also expands previous studies on readability measures by building dialogue between the result of Coh-Metrix measurement and the students’ perceived readability. To obtain the data, an automated Coh-Metrix readability measurement was conducted via cohmetrix.com. Also, to get more profound analysis, a questionnaire on students’ perceived readability was distributed to 35 tenth graders. Then the collected data were analyzed by using interactive model of Miles and Huberman. The finding of this study revealed that regardless of the slight difference between the perceived readability level and the Coh-Metrix-generated readability level, most of the texts in the book are mostly below the students’ level. Arguably, the textbook is relatively potential for language acquisition because it provides comprehensible input.

Full Text:



Amalia, I. (2016). Authentic texts for critical reading activities. Journal of English Language Studies, 1(1).

Ary, D., Jacobs, L. C., & Sorensen, C. (2010). Introduction to Research in Education (Eight Edit). Wadsworth Cengage Learning.

Beglar, D., & Hunt, A. (2014). Pleasure reading and reading rate gains. Reading in a Foreign Language, 26(1), 29–48.

Brown, H. D. (2000). Principles of language learning and teaching (Vol. 4). New York: Longman.

Brown, J. D. (1997). An EFL readability index. University of Hawai'i Working Papers in English as a Second Language 15 (2).

Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98.

Crossley, S. A., Greenfield, J., & Mcnamara, D. S. (2008). Text Readability Using Assessing Based Indices. TESOL Quarterly, 42(3), 475–493. https://doi.org/10.1002/j.1545-7249.2008.tb00142.x

Crossley, S. A., Allen, D. B., & McNamara, D. S. (2011). Text readability and intuitive simplification: A comparison of readability formulas. Reading in a foreign language, 23(1), 84-101.

Cunningsworth, A. (1995). Choosing Your Coursebook (Handbooks for the English Classroom). Macmillan Education.

Cunningsworth, A., & Tomlinson, B. (1984). Evaluating and selecting EFL teaching materials. Heinemann Educational.

Dale, E., & Chall, J. S. (1949). Readability. National Conference on Research in English.; National Council of Teachers of English, Champaign, Ill. 49.

Day, R. R. (1994). Selecting a passage for the EFL reading class. English Teaching Forum, 32(1), 20–23.

Dubay, W. H. (2004). The Principles of Readability. Impact Information.

Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32(3), 221–233. https://doi.org/10.1037/h0057532

Flesch, R. F. (1949). The Art of Readable Writing (A. J. Gould (ed.)). Harper & Row.

Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, and Computers, 36(2), 193–202. https://doi.org/10.3758/BF03195564

Gupta, R. (2014). Expectations vs. Reality: The Readability of Texts in the Primary Grades in India. Procedia - Social and Behavioral Sciences, 116, 3916–3920. https://doi.org/10.1016/j.sbspro.2014.01.866

Gyasi, W. K., & Slippe, D. P. (2019). Readability of English language textbooks for diploma students of the University of Cape Coast. International Journal of Research, 8(1), 107–115.

Hidayat, R. (2016). The Readability of Reading Texts on The English Textbook. Proceedings of International Conference: Role of International Languages toward Global Education System, 120.

Hutchinson, T., & Torres, E. (1994). The textbook as agent of change. ELT Journal, 48(4), 315–328.

Kincaid, J. P., Fishburne Jr, R. P., Rogers, R. L., & Chissom, B. S. (1975). Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. Naval Technical Training Command Millington TN Research Branch.

Krashen, S. D. (1995). The Natural Approach: Language Acquisition in the Classroom. TESOL Quaterly, 19(3), 591–603. http://www.jstor.org/stable/3586280 . Accessed: 22/06/2014

Masuhara, H., & Tomlinson, B. (2008). Materials for general English. English Language Learning Materials: A Critical Review, 17–37.

Miftaahurrahmi, Fitrawati, & Syarif, H. (2017). The Readability of Reading Texts in English Textbook Used by Senior High School Students in West Sumatera. 110(Iselt), 199–203. https://doi.org/10.2991/iselt-17.2017.35

Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook. sage.

Nation, P., & Coady, J. (1988). Vocabulary and reading. Vocabulary and Language Teaching, 97, 110.

Owu-Ewie, C. (2015). Readability of comprehension passages in Junior High School (JHS) English textbooks in Ghana. Ghana Journal of Linguistics, 3(2), 35. https://doi.org/10.4314/gjl.v3i2.3

Pitler, E., & Nenkova, A. (2008, October). Revisiting readability: A unified framework for predicting text quality. In Proceedings of the 2008 conference on empirical methods in natural language processing (pp. 186-195).

Sheldon, L. E. (1988). Evaluating ELT textbooks and materials. ELT Journal, 42(4), 237–246.

Sidek, H. M., & Rahim, H. A. (2015). The role of vocabulary knowledge in reading comprehension: A cross-linguistic study. Procedia-Social and Behavioral Sciences, 197, 50–56.

Tasaufy, F. S. (2017). The readability level of the reading texts in english textbook entitled ‘bahasa inggris x’. Edulitics (Education, Literature, and Linguistics) Journal, 2(2), 62-69.

Tomlinson, B. (1998). Materials Development in Language Teaching (B. Tomlinson (ed.); Second Edi). Cambridge University Press.

Tomlinson, B. (2008). English language learning materials: A critical review. Bloomsbury Publishing.

Wong, P. W. L. (2011). Textbook evaluation: A framework for evaluating the fitness of the Hong Kong New Secondary School (NSS) curriculum. In MA dissertation, Hong Kong: City University of Hong Kong.

DOI: http://dx.doi.org/10.30870/jels.v6i1.8898


  • There are currently no refbacks.

Creative Commons License
Journal of English Language Studies [JELS] is licensed under a Creative Commons Attribution 4.0 International License. Copyright @ Universitas Sultan Ageng Tirtayasa [Untirta]. All rights reserved.  p-ISSN: 2527-7022 |  e-ISSN: 2541-5131

View My Stats