A double blind peer reviewed online publication with in-print supplement since 2010    ISSN: 1949-260X

JTCLT Abstract

Volume 11 Number 1, 2020
Full issue PDF

Hong, J., Peng, C., Tseng, H., & Sung, Y. (2020). Linguistic Feature Analysis of CEFR Labeling Reliability and Validity in Language Textbooks. Journal of Technology and Chinese Language Teaching, 11(1), 57-83.
[洪嘉馡, 彭駿逸, 曾厚強, & 宋曜廷. (2020). 以語言特徵為本的教材分級難度及有效性之驗證. 科技与中文教学 (Journal of Technology and Chinese Language Teaching), 11(1), 57-83.]

Full paper


Despite the importance of grading language textbooks for teaching and learning, few studies have addressed the issues of reliability, validity, and efficiency of grading texts. This study adopted an automated textbook grading system to examine the grading consistency of five L2 Chinese textbook series labeled with CEFR difficulty levels. Twelve linguistic features were selected to represent the most crucial aspects of text readability: lexicon, semantics, syntax, and cohesion. Both the validity and reliability of grade assignments were tested between and within textbook series. The results suggested that 4 out of the selected 5 textbook series did not assign grade levels accurately reflective of actual text difficulty.


This website is supported by
Department of World Languages, Literatrues, and Cultures, Middle Tennessee State University
Page last updated: 2020-12-31