Visualizing Linguistic Complexity and Proficiency in Learner English Writings - Université Rennes 2
Article Dans Une Revue Calico Journal Année : 2023

Visualizing Linguistic Complexity and Proficiency in Learner English Writings

Résumé

In this article, we focus on the design of a second language (L2) formative feedback system that provides linguistic complexity graph reports on the writings of English for special purposes students at the university level. The system is evaluated in light of formative instruction features pointed out in the literature. The significance of complexity metrics is also evaluated. A learner corpus of English classified according to the Common European Framework of References for Languages (CEFR) was processed using a pipeline that computes 83 complexity metrics. By way of analysis of variance (ANOVA) testing, multinomial logistic regression, and clustering methods, we identified and validated a set of nine significant metrics in terms of proficiency levels. Validation with classification gave 67.51% (A level), 60.16% (B level), and 60.47% (C level) balanced accuracy. Clustering showed between 53.10% and 67.37% homogeneity, depending on the level. As a result, these metrics were used to create graphical reports about the linguistic complexity of learner writing. These reports are designed to help language teachers diagnose their students’ writings in comparison with prerecorded cohorts of different proficiencies.
Fichier principal
Vignette du fichier
CALICO paper-public (1).pdf (791.84 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04127926 , version 1 (14-06-2023)

Licence

Identifiants

Citer

Thomas Gaillat, Antoine Lafontaine, Anas Knefati. Visualizing Linguistic Complexity and Proficiency in Learner English Writings. Calico Journal, 2023, 40 (2), pp.178-197. ⟨10.1558/cj.19487⟩. ⟨hal-04127926⟩
96 Consultations
157 Téléchargements

Altmetric

Partager

More