Development and Validation of Reading Comprehension Assessments by Using GDINA Model
Abstract
This research is about developing and validating reading comprehension assessments using the GDINA model. Reading comprehension assessment has stayed relatively unaltered over the years, despite changes recommended by legislators or trends in the education industry. As a result, assessments are still used to evaluate students' performance, whether norm- or criterion-referenced; to inform instruction; to find out if students may acquire access to the right programmes; and even to evaluate the programme, which is still employed. The current reading comprehension assessment in Malaysia does not provide instructors with adequate information to make educated decisions. There was not enough data or information provided by the reading comprehension examinations to support the students individually, as a class, or even as a whole school, despite the teachers' sincere attempts to assist their students in performing and succeeding and becoming strong readers. We need better assessments to help instructors who are desperate for effective tools to help them fulfill individual needs. Reading comprehension is a mental process that occurs when a reader engages with the material. It's a problem for people who have trouble reading. Thus, the discussion is about developing and validating reading comprehension, which can be improvised using the GDINA model.
Downloads
References
Ahlam, A. S. H., Harvinjitt, Kaur a/p D. S., Ibrahim, M. S., & Zazali, M. (2017). Teachers' perception towards the use of classroom-based assessment in English reading. International Journal of Education and Research, 5(11), 153-168.
Alderson, J. C. (1990a). Testing reading comprehension skills (part one). Reading in a Foreign Language, 6, 425–438.
Alderson, J. C. (1990b). Testing reading comprehension skills (part two). Reading in a Foreign Language, 7, 465–503
Alderson, J.C. & Lukmani, Y. (1989). Cognition and reading: cognitive levels as emodied in test questions. Reading in a Foreign Language, 5 (2), 253-70.
Ankrum J. W., & Bean, R. M. (2008). Differentiating reading instruction: What and how. Reading Horizons, 48(2), 133-146.
Bejar, I. I., & Yocom, P. (1986). A generative approach to the development of hidden‐figure items. ETS Research Report Series, 1986(1), i-38.
Bloom, B. (1956). Taxonomy of educational objectives, handbook I: The cognitive domain. New York, NY: David McKay.
Boud, D., & Falchikov, N. (2006). Aligning assessment with long‐term learning. Assessment & evaluation in higher education, 31(4), 399-413.
Briggs, D. (2007). Assessing what students know, how they know it, or both?. Measurement: Interdisciplinary Research and Perspectives, 5(1), 62-65.
Brown, H. D. (2004). Language assessment: Principles and classroom practices. New York: Pearson Education. Caldwell, J. S. (2014). Reading Assessment: A Primer for Teachers in the Common Core Era (3rd ed.). New York: The Guilford Press.
Butterfield, E.C., Nielsen, D., Tangen, K.L., & Richardson, M.B. (1985). Theoretically based psychometric measures of inductive reasoning. In S.E. Embretson (Ed.), Test design: Developments in psychology and psychometrics. New York: Academic.
Charanjit Kaur Swaran Singh, Othman Lebar, Napisah Kepol, Rafiah Abdul Rahman & Kurotol Aini Muhammad Mukhtar (2017). An observation of classroom assessment practices among lecturers in selected Malaysian higher learning institutions. Malaysian Journal of Learning and Instruction, 14(1), 23-61.
Chen, H., & Chen, J. (2016). Retrofitting non-cognitive-diagnostic reading assessment under the generalized DINA model framework. Language Assessment Quarterly, 13(3), 218-230.
Choi, K. M., Lee, Y. S., & Park, Y. S. (2015). What CDM can tell about What students have learned: An Analysis Of TIMSS Eight Grade Mathematics. Eurasia Journal of Mathematics, Science & Technology Education, 11(6), 1563-1577.
Cui, Y., Leighton, J. P., & Zheng, Y. G. (2006). Simulation studies for evaluating the performance of the two classification methods in the AHM. San Francisco, CA: NCME.
Curriculum Development Division. (2011). Standard Document of Primary School Curriculum: Basic Core Module of English Language for national Schools. Putrajaya.
Davis, F. B. (1968). Research in comprehension in reading. Reading Research Quaterly, 3, 499-545.
de la Torre, J. (2009). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34, 115-130.
de la Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76(2), 179-199.
DiBello, L. V., Roussos, L. A., & Stout, W. F. (2007). Review of cognitively diagnotic assessment and a summary of psychmetric models. In C. R. (Eds), Handbook of statistics, vol. 26: psychometric (pp. 979-1030). Amsterdam, Netherlands: Elsevier.
Embretson, S. E. (1991). A multidimensional latent trait model for measuring learning and change. Psychometrika, 495-516.
Eng, L. S., Mohamed, A. R., & Ismail, S. A. M. M. . (2016). Systematic Tracking of Malaysian Primary School Students' ESL Reading Comprehension Performance to Facilitate Instructional Processes. International Journal of Instruction, 9(1), 149-162.
Fuchs, L. S., Fuchs, D., Hosp, M. K., & Hamlett, C. L. (2003). The potential for diagnostic analysis within curriculum-based measurement. Assessment for Effective Intervention, 28(3-4), 13-22.
Gierl, M. J., Leighton, J. P., & Hunka, S. M. (2000). An NCME Instructional Module on Exploring the Logic of Tatsuoka's Rule‐Space Model for Test Development and Analysis. Educational Measurement: Issues and Practice, 19(3), 34-44. doi:10.1111/j.1745-3992.2000.tb00036.x
Gough, P., Juel, C., & Griffith, P. (1992). Reading, speaking and the orthographic cipher. In P. Gough, L. Ehri, & R. Treiman (Eds.), Reading acquisition (pp. 35–48). Hillsdale, NJ: L. Erlbaum.
Hartz, S. (2002). A Bayesian framework for the Unified Model for Assessing Cognitive Abilities: Blending Theory with Practicality (Unpublished doctoral dissertation). University of Illinois at Urbana-Campaign, IL.
Heaton, J. B. (1991). Writing English language test. New York, NY: Longman
Huebner, A. (2010). An overview of recent developments in cognitive diagnostic computer adaptive assessments. Practical Assessment, Research, and Evaluation, 15(1), 3. doi:10.7275/7fdd-6897.
Hughes, A. (1989). Testing for language teachers. Cambridge, UK: Cambridge University Press.
Jang, E. E. (2009). Cognitive diagnostic assessment of L2 reading comprehension ability: Validity arguments for fushio model application to LanguEdge assessment. Language Testing, 26(1), 031-073.
Keeley, P., & Tobey, C. R. (2011). Mathematics Formative Assessment, Volume 1: 75 Practical Strategies for Linking Assessment, Instruction, and Learning. Corwin Press.
Ketterlin-Geller, L., & Yovanoff, P. . (2009). Cognitive diagnostic assessment in mathematics to support instructional decision making. Practical Assessment, Research, & Evaluation, 14(16), 1-11.
Leighton, J. P. (2004). Avoiding misconception, misuse, and missed opportunities: The collection of verbal reports in educational achievement testing. Educational Measurement: Issues and Practice, 4, 6-15. doi:10.1111/j.1745-3992.2004.tb00164.x.
Leighton, J. P., & Gierl, M. J. (2007). Defining and evaluating models of cognition used in educationl measurement to make inferences about examinees' thinking processes. Educational Measurement: Issues and Practice, 26, 3-16.
Li, H. (2011). Evaluating language group differences in the subskills of reading using a cognitive diagnostic modeling and differential skill functioning approach. University State College, Penn State, PA: Unplublised Doctorate.
Li, H., Hunter, C. V., & Lei, P. W. (2015). The selection of cognitive diagnostic models for a reading comprehension test. Language Testing.
Lin, S. E., Abdul, R. M., & Shaik, A. M. M. I. (2016). Systematic tracking system of Malaysian primary school students' ESL reading comprehension performance to facilitate instructional processes. International Journal of Instruction, 9(1), 149-162. https://doi.org/10.12973/iji.2016.9112a
Masters, G. N. (2014). Assessment: Getting to the essence, ACER. Retrieved October 7, 2016,from https://www.acer.org/files/uploads/Assessment_Getting_to_the_essence.pdf
Millman, J., & Greene, J. (1989). The specification and development of tests of achievement and ability. In R. L. Linn (Ed), Educational measurement (3rd ed) (pp. 335-366). New York: Council of Education/Macmillan.
Ministry of Education Malaysia (2013). Malaysia Education Blueprint 2013-2025. Putrajaya: Kementerian Pendidikan Malaysia
Ministry of Education Malaysia. (2017) Dokumen Standard Kurikulum Dan Pentaksiran Bahasa Inggeris SK Tahun 1. Putrajaya: Malaysia
Ministry of Education. (2018). Dokumen Standard Kurikulum Dan Pentaksiran Bahasa Inggeris SK Tahun 4. Putrajaya: Malaysia.
Mohd Sofi Ali (2003). English language teaching in primary schools: Policy and implementation concerns. Retrieved from http://www2.moe.gov.my/~ipba/EJournal/Mohdsofi.pdf/
Munby, J. L. (1978). Communication syllabus design. Cambrigde, UK: Cambridge University Press.
Nicholas, P. D., Chipman, S. F. and Brennan, R. L. (eds). (1995). Cognitive Diagnostic Assessment. Hillsdale, NJ: Lawrence Erlbaum Association, Publishers.
Nichols, P. D. (1994). A framework for developing cognitive diagnostic assessment. Review of Educational Research, 64, 575-603.
Ofsted (Office for Standards in Education) (2008). Mathematics: Understanding the Score. London: Ofsted. Retrieved on October 10, 2021 from http://nmpartnership.co.uk/pdf/Mathematics_understanding_the_score_- _primary[1].pdf
Pearson, P. D., & Hamm, D. N. (2005). The Assessment of Reading Comprehension: A Review of Practices-Past, Present, and Future. In S. G. Paris & S. A. Stahl (Eds.), Children's reading comprehension and assessment (pp. 13–69). Lawrence Erlbaum Associates, Publishers.
Pellegrino, J. W. (2005). The challenge of knowing what students know. Measurement: Interdisciplinary research and perspectives, 1(1).
Pierce, M., Katzir, T., Wolf, M., & Noam, G. (2010). Examining the construct of reading among dysfluent urban children: A factor analysis approach. Journal of Literacy Research, 42, 124–158. doi:http://dx.doi.org/10.1080/10862961003796140
Popham, W. J. (1999). Classroom assessment: What teachers need to know (2nd ed.). Boston: Allyn and Bacon.
Puteri, R. M. A. R., Faridah, Y., & Zuraida, D. (2017). Facilitating reading comprehension among ESL learners using graphic organizers. Malaysian Journal of ELT Research, 13(1), 30-42.
Ravand, H. (2016). Application of a cognitive diagnostic model to a high stakes reading comprehension test. Journal of Psychoeducational Assessment, 34, 782-799. doi:10.1177/0734282915623053
Santhi, G. (2011). Problems of teaching English in mixed ability classrooms at polytechnic level in India.
Song, M. (2008). Do divisible subskills exist in second language (L2) comprehension? A structural equation modeling approach. Language Testing, 25, 435–464. doi:http://dx.doi.org/10.1177/0265532208094272.
Spearitt, D. (1972). Identification of subskills of reading comprehension by maximum likelihood factor analysis. Reading Research Quarterly, 8, 92–111.
Stiggins, R. J. (2002). Assessment crisis: The absence of assessment for learning. Phi Delta Kappan, 83(10), 758-765.
Tatsuoka, K. (1983). Rule Space; An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345-354.
van Steensel, R., Oostdam, R., & van Gelderen, A. (2013). Assessing reading comprehension in adolescent low achievers: Subskills identification and task specificity. Language Testing, 30, 3–21. doi:http://dx.doi.org/10.1177/0265532212440950
Weir, C. J., & Porter, D. (1994). The multi-divisible or unitary nature of reading: The language tester between Scylla and Charybdis. Reading in a Foreign Language, 10, 1–19.
William, D. (2011). What is assessment for learning? Studies in educational evaluation, 37(1), 3-14.
Williams, T. O., Eaves, R. C., & Cox, C. (2001). Factor structure of the woodcock reading mastery tests-revised, forms G and H. Assessment for Effective Intervention, 26, 35–42. doi:http://dx.doi.org/10.1177/073724770102600303
