Field Expert Assessment on the Inventory of Science Teacher Readiness in Implementing Classroom-based Assessment

Mat Rasid Bin Ishak; Hidayah Mohd Fadzil; Harris Shah Abd Hamid

doi:10.47405/mjssh.v8i12.2618

Mat Rasid Bin Ishak Faculty of Education, University of Malaya, Jalan Profesor Diraja Ungku Aziz, 50603 Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.
Hidayah Mohd Fadzil Faculty of Education, University of Malaya, Jalan Profesor Diraja Ungku Aziz, 50603 Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.
Harris Shah Abd Hamid Faculty of Management, Education and Humanities, University College MAIWP International, Kuala Lumpur, Malaysia.

DOI: https://doi.org/10.47405/mjssh.v8i12.2618

Keywords: Classroom-Based Assessment, Science Teacher Readiness, Multi Facet Rasch Model, Inventory validity

Abstract

Teacher readiness is the willingness of a teacher to implement a programmed Classroom-Based Assessment (CBA) successfully, which is crucial to ensure that a program can be implemented at the individual or organizational level. The readiness of science teachers to implement CBA determines the direction and success of primary school assessments in Malaysia. However, there are limitations in measuring science teachers' readiness to implement CBA. Therefore, there is a need to develop an instrument that can measure the ability. This study was conducted to validate the Science Teacher Readiness Inventory in CBA (ISTRI-CBA) using a Multi-Faceted Rasch Measurement Model (MFRM). A sample of five officers from the Ministry of Education, Malaysia, served as a panel of field experts in assessments, science education, psychometrics, psychology, and language. Based on applying the MFRM, 162 items were retained from an initial pool of 185 items. The panel of field experts was good, with all five having a level of leniency and severity not too far when rating the item across the five dimensions. Expert evaluation using four-point rating scale criteria was used for clarity, accuracy, reasonableness, and brevity. The Results show ISTRI-CBA for the constructs of CBA knowledge, CBA skills, Attitudes, and Professionalism Values were considered unidimensional, while the resource support construct was multidimensional. Overall, the item reliability was satisfactory, ranging between 0.70 to 0.87 and the chi-square value (0.00) was significant, thus demonstrating that the items contained in the Science Teacher Readiness Inventory in the Classroom-Based Assessment dimension have good internal consistency.

Downloads

Download data is not yet available.

References

Azizi Alias & Kamisah Osman. (2018). Pentaksiran alternatif pembinaan dan pelaksanaan rubrik dalam pendidikan sains. Penerbit Universiti Kebangsaan Malaysia.

Brookhart, S. M. (2011). Educational assessment knowledge and skills for teachers. Educational Measurement: Issues and Practice, 30(1), 3-12.

Brown, G. (2013). ASTTLE - a national testing system for formative assessment: How the national testing policy ended up helping schools and teachers. A developmental and negotiated approach to school and self-evaluation, 14, 39-56. doi:10.1108/S1474-7863(2013)0000014003.

Bryant, N. C., & Barnes, L. L. B. (1997). Development and validation of the attitude toward educational measurement inventory. Educational and Psychological Measurement, 57(5), 870-875. https://doi.org/10.1177/0013164497057005011.

Curriculum Development Department. (2019). Panduan pelaksanaan pentaksiran bilik darjah (2nd ed.). Kementerian Pendidikan Malaysia.

Dewan Bahasa & Pustaka. (2017). Kamus dewan edisi keempat-PRPM https://prpm.dbp.gov.my/Cari1?keyword=pentaksiran&d=226112LIHATSINI.

Engelhard, G. (2013). Invariant measurement: Using Rasch models in the social, behavioural, and health sciences. New York, NY: Routledge.

Examination Board. (2014). Surat siaran Lembaga Peperiksaan Bil. 1 tahun 2014: Penambahbaikan sistem Pentaksiran Berasaskan Sekolah (PBS) Putrajaya: Kementerian Pendidikan Malaysia.

George, E. J., & Stefanie, A. W. (2018). Invariant measurement with raters and rating scales: Rasch Models for mediated assessments. Routledge.

John, M. L. (1994). Sample size and item calibration (or person measure) stability. Rasch measurement transactions, 7(4), 328. https://www.rasch.org/rmt/rmt74m.htm.

Khairul Azhar Mat Daud, Nik Zulkarnaen Khidzir, Ahmad Rasdan Ismail, & Fadhilahanim Aryani Abdullah. (2018). Validity and reliability of instrument to measure social media skills among small and medium entrepreneurs at Pengkalan Datu River. International Journal of Development and Sustainability, 7(3), 1026-1037.

Khalil Fakhri Abdul, & Awang Mohd Isha. (2016). Isu Kesediaan Guru dalam Amalan Melaksanakan Pentaksiran Berasaskan Sekolah. EDUCATUM Journal of Social Sciences, 2(1), 1-7.

Koloi‐Keaikitse, S. (2016). Assessment training: a precondition for teachers' competencies and use of classroom assessment practices [Article]. International Journal of Training & Development, 20(2), 107-123. https://doi.org/10.1111/ijtd.12072.

Koskimäki, M., Mikkonen, K., Kääriäinen, M., Lähteenmäki, M.-L., Kaunonen, M., Salminen, L., & Koivula, M. (2021). Development and testing of the Educators' Professional Development scale (EduProDe) for the assessment of social and health care educators' continuing professional development [Article]. Nurse Education Today, 98. https://doi.org/10.1016/j.nedt.2020.104657.

Lim, S.M., Rodger, S., & Brown, T. (2009). Using Rasch analysis to establish the construct validity of rehabilitation assessment tools. International Journal of Therapy and Rehabilitation, 16(5), 251–260.

Madsen, S. R., John, C. R., & Miller, D. (2006). Influential factors in individual readiness for change. Journal of Business & Management, 12(2), 93-110. Retrieved from https://ezproxy.um.edu.my/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=heh&AN=27423392&site=eds-live.

Meisels, S. J. (1998). Assessing readiness [Monograph]. Ann Arbor, Mich: [Washington, DC]: Centre for the Improvement of Early Reading Achievement, University of Michigan; U.S. Dept. of Education, Office of Educational Research and Improvement, Educational Resources Information Centre, 1998.https://ezproxy.um.edu.my/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=edsgpr&AN=edsgpr.000516694&site=eds-live http://catalog.gpo.gov/fdlpdir/locate.jsp?ItemNumber=0466-A-03&SYS=000516694.

Ministry of Education Malaysia. (2017a). Dokumen standard kurikulum dan pentaksiran KSSM Sains Tahun 3. WP Putrajaya. Bahagian Pembangunan Kurikulum.

Ministry of Education Malaysia. (2017b). Dokumen standard kurikulum dan pentaksiran KSSR Sains Tahun 3. Bahagian Pembangunan Kurikulum.

Ministry of Education Malaysia. (2018). Pemansuhan amalan peperiksaan pertengahan dan akhir tahun murid tahap 1 (tahun 1, tahun 2 dan tahun 3) sekolah rendah Kementerian Pendidikan Malaysia mulai tahun 2019. WP Putrajaya.

Myint Swe, K. (2020). Rasch Measurement: Applications in Quantitative Educational Research [Book]. Springer.

Opre, D. (2015). Teachers’ Conceptions of Assessment [Article]. Procedia - Social and Behavioral Sciences, 209, 229-233. https://doi.org/10.1016/j.sbspro.2015.11.222.

Rohaya Talib, & Mohd Najib Abd Ghafar. (2008). Pembinaan dan pengesahan instrumen bagi mengukur tahap literasi pentaksiran guru sekolah menengah di Malaysia. Proceeding of Seminar Penyelidikan.

Rasch, G. (1993). Probabilistic models for some intelligence and attainment tests: ERIC.

Suah, S. L., & Ong, S. L. (2012). Investigating assessment practices of in-service teachers. International Online Journal of Educational Sciences, 4(1), 91-106.

Thomas, E. (2015). Introduction to Many-Facet Rasch Measurement (2nd ed.). Peter Lang GmbH.

Villalonga-Olives, E., Kawachi, I., & Rodríguez, A. M. (2021). Rasch model of the bridging social capital questionnaire [Article]. SSM-Population Health, 14. https://doi.org/10.1016/j.ssmph.2021.100791

Wen-Ta, T., Tzi-Ying, S., & John-Michael, L. N. (2018). Validating translation test items via the Many-Facet Rasch Model. Psychological Reports, 1-25. https://doi.org/10.1177/0033294118768664.

Wilson, M. (2005). Constructing measures: An item response modelling approach. Lawrence Erlbaum Associates.

Wright, B.D., & Masters, G.N. (1982). Rating scale analysis. Chicago, IL: MESA Press.

Wright, B.D., & Stone, M.H. (1999). Measurement essentials. Wilmington, DE: Wide Range Inc.

Zahari Suppian, & Jamil Ahmad. (2014). Pembinaan dan pengesahan instrumen untuk mengukur tahap kompetensi guru pelatih dalam pentaksiran bilik darjah [Conference publication Non-fiction]. Seminar Kebangsaan Majlis Dekan-Dekan Pendidikan IPTA, UKM, Bangi.https://ezproxy.um.edu.my/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=cat00467a&AN=malu.1002517&site=eds-live.