The Investigation of the predictive validity in four evaluation criteria to the written expression
Published:
Sep 16, 2024
Keywords:
written expression, primary school pupils, evaluation criteria, predictive validity
Abstract
This study explores the predictive validity of four evaluation criteria in the written expression to the last three grades of primary school in a writing text with unfinished and muddled phrases and a writing text with the technique of images. We examined the correlation between the two guidance techniques, the effect of the age and gender of pupils, and the validity of the evaluation criteria in the general performance of each test. In the literature, the evaluation dimensions in the written texts vary with age and population, and they include evaluation criteria related to quality, productivity, complexity, and text organization. This study aimed to contribute new data in the pupils’ written expression evaluation to the last three grades of primary school and highlight the evaluation criteria of the written with the great power in these ages. For this purpose, 93 pupils of the latest three grades of the primary school wrote two narrative texts, one with a technique of unfinished phrases and one with images. The results show an average statistically significant correlation between pupils' performance in the two tests. The effect of the age was statistical significantly, and the performances of the fourth-class pupils were lower in most criteria of the tests. The pupils’ gender effect was not statistically significant, but the girls achieved better scores in most evaluation criteria of the tests. The spelling criterion seems to have great power in tests of three age groups. In the writing text with the unfinished and muddled phrases, the structure criterion has high power, while the productivity criterion presented the law power to the three age groups. We discuss the results of the study about the limited research findings on the validity of the dimensions that evaluate in the written texts to the children of the last three grades of primary school, and we propose ideas for future research.
Article Details
- How to Cite
-
ΞΑΝΘΗ Σ. (2024). The Investigation of the predictive validity in four evaluation criteria to the written expression. Journal of Research in Education and Training, 17(2), 1–41. https://doi.org/10.12681/jret.35230
- Issue
- Vol. 17 No. 2 (2024): -
- Section
- Articles
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution Non-Commercial License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g. post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (preferably in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Downloads
Download data is not yet available.
References
Adams, A., Simmons, F., & Willis, C. (2015). Exploring relationships between working memory and writing: Individual differences associated with gender. Learning and Individual Differences, 40, 101–107. https://doi.org/10.1016/j.lindif.2015.04.011
Amato, J. W., & Watkins, M. W. (2011). The predictive validity of CBM writing indices for eighth-grade students. Journal of Special Education, 44, 195-204.
Andreou, E., Vlachos, F., & Andreou, G. (2006). Approaches to studying among Greek university students: the impact of gender, age, academic discipline and handedness. Educational Research, 48(3), 301-311.
Beard, R., & Burrell, A. (2010). Writing attainment in 9- to 11-year-olds: Some differences between girls and boys in two genres. Language and Education, 24(6), 495–515. https://doi.org/10.1080/09500782.2010.502968
Beers, S. F., & Nagy, W. E. (2011). Writing development in four genres from grades three to seven: syntactic complexity and genre differentiation. Reading and Writing, 24, 183-202.
Berninger, V. W., Nielsen, K. H., Abbott, R. D., Wijsman, E., & Raskind, W. (2008). Writing problems in developmental dyslexia: Under-recognized and under-treated. Journal of School Psychology, 46(1). doi: 10.1016/j.jsp.2006.11.008
Berninger, V. W., Nielsen, K. H., Abbott, R. D., Wijsman, E., & Raskind, W. (2008). Gender differences in severity of writing and reading disabilities. Journal of School Psychology, 46(2), 151–172. doi:10.1016/j.jsp.2007.02.007
Costa, L. J. C., Hooper, S. R., McBee, M., Anderson, K. L., & Yerby, D. C. (2012). The Use of Curriculum-Based Measures in Young At-Risk Writers: Measuring Change Over Time and Potential Moderators of Change. Exceptionality, 20(4), 199-217. doi: 10.1080/09362835.2012.724623
Διακογιώργη, Κ., Φιλιππάτου, Δ., Ράλλη, Α., Χρυσοχόου, Ε., Ρούσσος, Π., & Δημητροπούλου, Π. (2021). Writing skills of children with and without dyslexia: similarities and differences. Psychology: the Journal of the Hellenic Psychological Society, 26(1), 102-120. doi:https://doi.org/10.12681/psy_hps.26251
Dávalos, A., & Alvarado, M. (2010). Elementary school children’s decisions about paragraph organization. Written Language and Literacy, 13(2), 260−273. https://doi.org/10.1075/wll.13.2.04dav
Dockrell, J. E., Connelly, V., Walter, K., & Critten, S. (2015). Assessing children’s writing products: The role of curriculum based measures. British Educational Research Journal, 41(4), 575−595. https://doi.org/10.1002/berj.3162
Ε.Π.Ε., & Δ.Β.Μ. (2011). Πρόγραμμα Σπουδών για τη Διδασκαλία της Νεοελληνικής Γλώσσας στην Υποχρεωτική Εκπαίδευση (Δημοτικό & Γυμνάσιο) – Οδηγός για τον εκπαιδευτικό. Αθήνα: ΕΣΠΑ 2007-13 / Επιχειρησιακό Πρόγραμμα Εκπαίδευση και Δια Βίου Μάθηση/ Αναλυτικά Προγράμματα 1-2-3 «ΝΕΟ ΣΧΟΛΕΙΟ (Σχολείο 21ου αιώνα) - Νέο Πρόγραμμα Σπουδών, Οριζόντια Πράξη». Ανακτήθηκε Ιανουάριος 2012, από: http://www.moec.gov.cy/dde/diapolitismiki/ilektroniko_yliko/odigos_glossas_gia_dimotiko_gymnasio.pdf
Espin, C., Shin, J., Deno, S. L., Skare, S., Robinson, S., & Benner, B. (2000). Identifying indicators of written expression proficiency for middle school students. The Journal of Special Education, 34, 140-153. https://doi.10.1177/002246690003400303
Gansle, K. A., Noell, G. H., VanDerHeyden, A. M., Naquin, G. M., & Slider, N. J. (2002). Moving beyond total words written: the reliability, criterion validity, and time cost of alternate measures for curriculum-based measurement in writing. School Psychology Review, 31(4), 477–497. https://scholar.google.com/citations?user=hQ21cDoAAAAJ&hl=en
Gansle, K. A., VanDerHeyden, A. M., Noell, G. H., Resetar, J. L., & Williams, K. L. (2006). The technical adequacy of curriculum-based and rating-based measures of written expression for elementary school students. School Psychology Review, 35(3), 435-450.
Graham, S., Harris, K., & Hebert, M. A. (2011). Informing writing: The benefits of formative assessment. A Carnegie Corporation Time to Act report. Alliance for Excellent Education. www.carnegie.org/literacy
Jones, S., & Myhill, D. (2007). Discourses of difference? Questioning gender difference in linguistic characteristics of writing. Canadian Journal of Education, 30, 456-482.
Justice, L. M., Bowles, R. P., Kaderavek, J. N., Ukrainetz, T. A., Eisenberg, S. L., & Gillam, R. B. (2006). The index of narrative microstructure: A clinical tool for analyzing schoolage children’s narrative performance. American Journal of Speech-Language Pathology, 15, 177–191. doi:10.1044/1058-0360(2006/017)
Kim, Y., Al Otaiba, S., Folsom, J. S., Greulich, L., & Puranik, C. (2014). Evaluating the dimensionality of first-grade written composition. Journal of Speech, Language, and Hearing Research, 57, 199-211.
Koutsoftas, A. D. (2018). Writing-process products of fourth- and sixth-grade children: A descriptive study. Elementary School Journal, 118, 633–653. doi: 10.1086/697510
Mackie, C., & Dockrell, J. E. (2004). The nature of written language deficits in children with SLI. Journal of Speech Language, and Hearing Research, 47 (6), 1469–1483. https://doi.org/10.1044/1092-4388(2004/109)
Malecki, C. (2008). Best practices in written language assessment and intervention. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology-V (pp. 477–488). National Association of School Psychologists. www.t.ly/NMbK
Ματσαγγούρας, Η. Γ. (2004). Κειμενοκεντρική Προσέγγιση του Γραπτού Λόγου. Αθήνα: Γρηγόρη.
Miller, B., & McCardle, P. (2011). Reflections on the need for continued research on writing. Reading and Writing, 24(2), 121-132. doi: 10.1007/s11145-010-9267-6
Miller, D. M., Linn, R. L., & Gronlund, N. E. (2013). Measurement and assessment in teaching (11th ed.). Boston, MA: Pearson.
Μουζάκη, Α., & Πρωτόπαπας, Α. (Επιμ.) (2010). Ορθογραφία: Μάθηση και διαταραχές. Αθήνα: Gutenberg.
Myhill, D., & Jones, S. (2007). More than just error correction - Students' perspectives on their revision processes during writing. Written Communication, 24(4), 323-343. doi: 10.1177/0741088307305976
Myhill, D. (2009). Children's patterns of composition and their reflections on their composing processes. British Educational Research Journal, 35(1), 47-64. doi: 10.1080/01411920802042978
Nelson, D. L., McEvoy, C. L., & Schreiber, T. A. (2004). The University of South Florida free association, rhyme, and word fragment norms. Behavior Research Methods, Instruments, & Computers, 36(3), 402−407. https://doi.org/10.3758/BF03195588
Nippold, M. A., Hesketh, L. J., Duthie, J. K., & Mansfield, T. C. (2005a). Conversational versus expository discourse: A study of syntactic development in children, adolescents, and adults. Journal of Speech, Language, and Hearing Research, 48, 1048-1064.
Nippold, M. A., Ward-Lonergan, J. M., & Fanning, J. L. (2005b). ‘Persuasive writing in children, adolescents, and adults: a study of syntactic, semantic, and pragmatic development.’ Language, Speech, and Hearing Services in Schools, 36, 125–138.
Nippold, M. Α. (2007). Later Language Development: School-Age Children, Adolescents, and Young Adults. Austin, TX: Pro-Ed.
Olinghouse, N. G. (2008). Student- and instruction-level predictors of narrative writing in third-grade students. Reading and Writing, 21(1–2), 3–26. https://doi.org/10.1007/s11145-007-9062-1
Olinghouse, N. G., & Graham, S. (2009). The Relationship Between the Discourse Knowledge and the Writing Performance of Elementary-Grade Students. Journal of Educational Psychology, 101(1), 37-50. doi: 10.1037/a0013248
Παντελιάδου, Σ. (2011). Μαθησιακές δυσκολίες και εκπαιδευτική πράξη. Αθήνα: Πεδίο.
Puranik, C. S., Lombardino, L. J., & Altmann, L. J. (2007). Writing through retellings: An exploratory study of language-impaired and dyslexic populations. Reading and Writing, 20(3), 251−272. https://doi.org/10.1007/s11145-006-9030-1
Puranik, C. S., Lombardino, L. J., & Altmann, L. J. P. (2008). Assessing the microstructure of written language using a retelling paradigm. American Journal of Speech-Language Pathology, 17(2), 107-120.
Ravid, D. (2006). Semantic development in textual contexts during the school years: Noun Scale analyses. Journal of Child Language, 33, 791-821.
Saddler, B., & Asaro-Saddler, K. (2013). Response to Intervention in Writing: A Suggested Framework for Screening, Intervention, and Progress Monitoring. Reading & Writing Quarterly, 29(1), 20-43. doi: 10.1080/10573569.2013.741945
Σπαντιδάκης, Ι. (2011). Προβλήματα παραγωγής γραπτού λόγου παιδιών σχολικής ηλικίας. Αθήνα: Ελληνικά Γράμματα.
Συγγραφείς του άρθρου, (2015). Συγκριτική μελέτη παραγωγής γραπτών αφηγήσεων μέσω τεχνικών υψηλής καθοδήγησης σε μαθητές Δ΄- ΣΤ΄ δημοτικού. Διάλογοι! Θεωρία και Πράξη στις Επιστήμες της Αγωγής και Εκπαίδευσης, 1, 104-124. https://doi.10.12681/dial.1
Scott, C. M., & Windsor, J. (2000). General language performance measures in spoken and written narrative and expository discourse of school-age children with language learning disabilities. Journal of Speech, Language, and Hearing Research, 43(2), 324−339. https://doi.org/10.1044/jslhr.4302.324
Stainthorp, R., & Rauf, N. (2009). An investigation of the influence of the transcription skills of handwriting and spelling on the quality of text writing by girls and boys in Key Stage 2. Handwriting Today, 8, 9-13.
Troia, G. A., Harbaugh, A. G., Shankland, R. K., Wolbers, K. A., & Lawrence, A. M. (2013). Relationships between writing motivation, writing activity, and writing performance: Effects of grade, sex, and ability. Reading and Writing, 26(1), 17–44. https://doi.org/10.1007/s11145-012-9379-2
ΥΠΕΠΘ - ΠΙ. (2003). Διαθεματικό Ενιαίο Πλαίσιο Προγραμμάτων Σπουδών και Αναλυτικά Προγράμματα Σπουδών Υποχρεωτικής Εκπαίδευσης. Αθήνα: Παιδαγωγικό Ινστιτούτο. Ανακτήθηκε Νοέμβριος 2007, από: www.pi-schools.gr.
ΥΠΕΠΘ - ΠΙ. (2007). Νέα Σχολικά εγχειρίδια - Γλώσσα Ε΄ & ΣΤ΄ Δημοτικού. Παιδαγωγικό Ινστιτούτο - Οργανισμός Εκδόσεως Διδακτικών Βιβλίων. Ανακτήθηκε Νοέμβριος 2007, από: www.pi-schools.gr.
Verhoeven, L., & Van Hell, J. G. (2008). From knowledge representation to writing text: A developmental perspective. Discourse Processes, 45(4–5), 387–405. https://doi.org/10.1080/01638530802145734
Voyer, D., & Voyer, S. D. (2014). Gender differences in scholastic achievement: A meta-analysis. Psychological Bulletin, 140(4), 1174–1204. doi:10.1037/a0036620
Wagner, R. K., Puranik, C. S., Foorman, B., Foster, E., Gehron, L., Tschinkel, E., & Kantor, P. T. (2011). writers. Journal of Educational Psychology, 85, 478-508.
Weigle, S. C. (2007). Teaching writing teachers about assessment. Journal of Second Language Writing, 16(3), 194-209.
Westerveld, M. F., & Moranb, C. A. (2011). Expository Language Skills of Young School-Age Children. Language, speech, and hearing services in schools. American speech-language-hearing association, 42, 182–193. Doi: 10.1044/0161-1461(2010/10-0044)
Whitaker, D., Berninger, V., Johnston, J., & Swanson, H. L. (1994). Intraindividual differences in levels of language in intermediate grade writers: Implications for the translating process. Learning and Individual Differences, 6, 107–130. doi: 10.1016/1041-6080(94)90016-7
Williams, G. J., & Larkin, R. C. (2013). Narrative writing, reading and cognitive processes in middle childhood: what are the links? Learning and Individual Differences, 28, 142-150. http://dx.doi.org/10.1016/j.lind.2012.08.003
