Development of a Model for Data-Driven Decision Making: Critical Skills for School Leaders

Faiezah Shamsuddin; Ahmad Zabidi Abdul Razak

doi:10.47405/mjssh.v8i12.2614

Faiezah Shamsuddin Faculty of Education, University of Malaya, 50603 Kuala Lumpur, Malaysia.
Ahmad Zabidi Abdul Razak Faculty of Education, University of Malaya, 50603 Kuala Lumpur, Malaysia.

DOI: https://doi.org/10.47405/mjssh.v8i12.2614

Keywords: Leaders Competency, Data-Driven Decision Making, Experiential Narrative, Nominal Group Technique, Interpretive Structural Modelling

Abstract

Data may equip school leaders with the information they need to make crucial changes that will enhance the education system in the future although the usage of data may not be able to resolve every issue. However, proper data utilization can advise the right conclusion. Therefore, this study aims to design and develop an experiential narrative-based model for school leaders in data-driven decision-making (DDDM). The model has been designed and developed using the Design and Development Research (DDR) approach, which involves three phases: the need analysis phase, the design and development phase, and the usability evaluation phase. However, the researcher only focuses on this paper in the second phase. The design and development process began with a literature study, followed by approval and consensus from a 9-expert panel. The model was designed using the Nominal Group Technique (NGT) technique and developed using the Interpretive Structural Modelling (ISM) method. The design and development phase revealed that 13 DDDM competency components had been generated through the expert panel's opinions and agreement. Overall, based on the experiential narrative of the experts in this study, the model is appropriate for usage and implementation. As a result, the empirically established and verified model has the potential to enhance school leaders' knowledge, skills, and attitudes toward data-driven decision-making.

Downloads

Download data is not yet available.

References

Abdul Muqsith Ahmad Ahmad. (2018). Pembangunan model ENi berasaskan aktiviti inkuiri bagi program latihan kemahiran kejuruteraan Institut Latihan Kemahiran Malaysia. [Unpublished doctoral dissertation]. Universiti Malaya.

Adrian, C., Abdullah, R., Atan, R. & Jusoh, Y. Y. (2018). Expert Review on Big Data Analytics Implementation Model in Data-driven Decision-Making. In Proceedings - 2018 4th International Conference on Information Retrieval and Knowledge Management: Diving into Data Sciences, CAMP 2018. https://doi.org/10.1109/ INFRKM.2018.8464770.

Ahmad M, Tang X-W, Qiu J-N. & Ahmad F. (2019). Interpretive Structural Modeling and MICMAC Analysis for Identifying and Benchmarking Significant Factors of Seismic Soil Liquefaction. Applied Sciences, 9(2), 233. https://doi.org/10.3390/app9020233.

Akal, T. D., Beshah, T., Sackmann, S. & Negash, S. (2019). Challenges of identifying and utilizing big data analytics in a resource-constrained environment: In the case of Ethiopia. IFIP Advances in Information and Communication Technology. https://doi.org/ 10.1007/978-3-030-20671-0_17.

Ashaari, M., Amran, A. & Singh, K.S.D. (2020). Big data analytics capability for improved performance of higher education institutions in the era of IR 4.0: A proposed conceptual framework. International Journal of Innovation, Creativity and Change. 13 (8). https://www.researchgate.net/publication/344334181 _Big_Data_ Analytics_ Capability_for_Improved_Performance_of_Higher_ Education_Institutions_in_ the_Era_of_IR_40_A_Proposed_Conceptual_ Framework.

Athamena, B. & Houhamdi, Z. (2018). Model for decision-making process with big data. Journal of Theoretical and Applied Information Technology, 96(17), 5951-5961.

Bishop, S. (2018). Using data-driven decision-making to enhance performance: A practical guide for organizations. [Unpublished doctoral dissertation]. Retrieved from ProQuest Dissertations & Theses Global.

Bogdan, M. & Lungescu, D. C. (2018). Is strategic management ready for big data? A review of the big data analytics literature in management research. Managerial Challenges of the Contemporary Society, 11(2), 65-73. https://europub.co.uk/articles/-A-444290.

Bughin, J. & Hazan, E. (2018). The power of digital platforms in data-driven decision making. McKinsey & Company. https://www.mckinsey.com/business-functions/mckinsey-analytics/our-insights/the-power-of-digital-platforms-in-data driven-decision-making.

Bulkley, K. E., & McCotter, S. S. (2017). Learning to Lead with Data: From Espoused Theory to Theory-in-Use. Leadership and Policy in Schools, 1(27). https:/doi:10.1080/15700763.2017.1326144.

Cech, T.G., Spaulding, T.J. and Cazier, J.A. (2018). Data competence maturity: developing data-driven decision making. Journal of Research in Innovative Teaching & Learning, 11(2), 139-158. https://doi.org/10.1108/JRIT-03-2018-0007.

Chen, Y. (2020). Data-Driven Decision-Making Literacy among Rural Community College Leaders in Iowa: The Role of Leadership Competencies. Community College Journal of Research and Practice, 44(5), 347-358. https://doi.org/10.1080/ 10668926.2019.1592032.

Chua, Y. P. (2022). Asas Statistik Penyelidikan Buku 2 (ed. ke-4). Kuala Lumpur: McGraw-Hill.

Custer, S., King, Ecech. M., Atinc, T. M., Read, L. & Sethi, T. (2018). Toward Data-Driven Education Systems: Insights into Using Information to Measure Results and Manage Change. Center for Universal Education at The Brookings Institution.

Dahlmann-Noor, A., Bonini, S., Bremond-Gignac, D. (2013). Novel insights in the management of vernal keratoconjunctivitis (VKC): European expert consensus using a modified nominal group technique. Ophthalmol Theraphy, 12(4), 1207–1222. https://doi.org/10.1007/s40123-023-00665-5.

Dang, V. H. (2015). The Use of Nominal Group Technique: Case Study in Vietnam. World Journal of Education, 5(4), 14-25.

Danko, T. (2019). Student perceptions in homeland security and emergency management education: experiential learning survey. Journal of experiential Education, 42(4), 417-427. https://doi.org/ 10.1177/1053825919873678.

Delbecq, A. L., Van de Ven, A. H. & Gustafson, D. H. (1975). Group techniques for program planning: a guide to nominal group and Delphi process. Glenview, IL: Scott, Foresman, and Co.

Delp, P., Thesen, A., Motiwalla, J. & Seshardi, N. (1977). Systems tools for project planning. Bloomington. Indiana: International Development Institute.

Denscombe, M. (1995). Explorations in group interviews: an evaluation of a reflexive and partisan approach. British Educational Research Journal, 21(2), 131-148.

Deslandes, S.F., Corina Helena Figueira Mendes, C.H.F., Pires, T.O. & Campos, D.S. (2010). Use of the Nominal Group Technique and the Delphi Method to draw up evaluation indicators for strategies to deal with violence against children and adolescents in Brazil. Rev. Bras. Saúde Matern. Infant.,10(1), 29-37.

Dingelstad, J., Borst, R. T. & Meijer, A. (2022). Hybrid data competencies for municipal civil servants: An empirical analysis of the required competencies for data-driven decision-making. Public Personnel Management, 51(4), 458–490. https://doi.org/10.1177/00910260221111744 362.

Dingelstad, J.M.V. (2019). Hybrid Data Competencies: Identifying required competencies for data-driven decision making in local governments. [Unpublished doctoral dissertation]. Utrecht University.

Dobbie, A., Rhodes, M., Tysinger, JW. & Freeman, J. (2004). Using a Modified Nominal Group Technique as a Curriculum Evaluation Tool. Family Medicine, 36(6), 402-406.

Georgekopoulus, A. (2009). Teacher effectiveness examinated as a system: Interpretive structural modelling and facilitation session with US and Japanese students. International Education Studies, 2(3), 60.

Ghasemaghaei, M. (2019). Does data analytics use improve firm decision making quality? The role of knowledge sharing and data analytics competency. Decision Support Systems, 120, 14-24. https://doi.org/10.1016/j.dss.2019.03.004.

Hallinger, P. & Heck, R. (2011). Conceptual and methodological issues in studying school leadership effects as a reciprocal process. School Effectiveness and School Improvement, 22(2), 149-173.

Halloy, A., Simon, E., & Hejoaka, F. (2022). Defining patient’s experiential knowledge: who, what and how patients know. a narrative critical review. Sociology of Health & Illness, 45(2), 405-422. https://doi.org/10.1111/1467-9566.13588.

Hamilton, L., Halverson, R., Jackson, S., Mandinach, E., Supovitz, J. & Wayman, J. (2009). Using student achievement data to support instructional decision making (NCEE 2009-4067). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education http://ies.ed.gov/ncee/wwc/publications/practiceguides/.

Hannah, D. S., Dietrich, E. & Chandler, D. (2019). The role of communication in data-driven decision making. Journal of Business and Psychology, 34(2), 197-209.

Hubers, M.D., Schildkamp, K., Poortman, C.L. & Pieters, J.M. (2017). The quest for sustained data use: Developing organizational routines. Teaching and Teacher Education. 67, 509-521.

Ikemoto, G. S. & Marsh, J. A. (2007). Cutting through the “data-driven” mantra: Different conceptions of data-driven decision making. In P. A. Moss (Ed.), Evidence and decision making: Yearbook of the national society for the study of education (Vol. 106, Issue 1, pp. 105-131). Blackwell Publishing.

Institut Aminuddin Baki (IAB). (2020). Standard Kompetensi Pemimpin Sekolah Malaysia 2.0 (Kompas 2.0). Bandar Enstek: Institut Aminuddin Baki.

Institut Pendidikan Guru Kedah Darulaman (IPGKDA). (2023). Buku penyelidikan reka bentuk dan pembangunan. Jitra: IPGKDA.

Jadhav, JR., Rane, S.B. & Mantha, S.S. (2015). Supply risk in JIT implementation. International Journal of Business Perfromance and Supply Chain Modelling, 7(2), 141-170. https://doi/10.1504/IJPBPSCM.2015.069920.

Janes, F.R. (1988). Interpretive structural modelling: A methodology for structuring comple issues. Transactions of The Institute of Measurement & Control, 10(3), 145-154. https://doi 10.177/014233128801000306

Jannah Talib & Fariza Khalid. (2020). Peranan data raya dalam sistem pendidikan: Satu tinjauan. International Social Science and Humanities Journal, 3(3). http://journal.al-qiyam.net/index.php /my1/article/view/78/69.

Johnson, B. L & Kruse, S.D. (2009). Decision making for educational leaders: Underexamined dimensions and issues. New York: State University of New York Press.

Kowalski, T. J, Lasley, T.J.II & Mahoney, J.W. (2008). Data-driven decisions and school leadership: best practices for school improvement. USA: Pearson Education, Inc.

Li, J., Long, Y., Wang, T., Shen, D. & Zhang, Z. (2020). A data-driven method for competency evaluation of personnel. In Proceedings of the 2020 International Conference on Big Data and Artificial Intelligence (pp. 1-6). Association for Computing Machinery. https://doi.org/10.1145/3414274.3414489.

Li, J., Long, Y., Wang, T., Shen, D., & Zhang, Z. (2020). A data-driven method for competency evaluation of personnel. In Proceedings of the 3rd International Conference on Data Science and Information Technology. https://doi:10.1145/3414274.3414489.

Light, D., Wexler, D. & Heinze, J. (2004). How practitioners interpret and link data to instruction: Research findings on New York city schools’ implementation of the grow network. [Paper presentation]. American Educational Research Association Annual Meeting, San Diego, CA, United States.

Luhukay, D., Nizar Hidayanto, A. & Prabowo, H. (2019). The big data usability’s trends in education: A systematic literature review. International Journal of Mechanical Engineering and Technology, 10(3), 1974-1981.

Mandinach, E. B. & Schildkamp, K. (2020). Misconceptions about data-based decision making in education: An exploration of the literature. Studies in Educational Evaluation, 69, 100842. https://doi.org/ 10.1016/j.stueduc.2020.100842.

Mandinach, Ellen B.; Schildkamp, Kim (2020b). The complexity of data-based decision making: An introduction to the special issue. Studies in Educational Evaluation, 69, 100906. https://doi:10.1016/j.stueduc.2020.100906.

Mandinach, E. B. (2012). A perfect time for data use: Using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71–85. https://doi/10.1080/ 00461520. 2012.667064.

Mandinach, E., Honey, M. & Light, D. (2006). A theoretical framework for data-driven decision making. [Paper presentation]. American Educational Research Association Annual Meeting. San Francisco, CA, United States.

Mandinach, E. B., Honey, M., Light, D. & Brunner, C. (2008). A conceptual framework for data-driven decision making. In E. B. Mandinach, & M. Honey (Eds.), Data-driven school improvement: Linking data and learning, 13–31. New York: Teachers College Press.

Marsh, J. A., Pane, J. F. & Hamilton, L. S. (2006). Making sense of data-driven decision making in education: Evidence from recent RAND research. RAND Education.

McAdams, D. P. (2008). The Person: An Introduction to the Science of Personality Psychology. Hoboken, NJ: John Wiley & Sons.

Mohammad Ridhuan Tony Lim Abdullah. (2014). Development of activity-based mlearning implementation model for undergraduate english language learning. [Unpublished doctoral dissertation]. Universiti Malaya.

Mohd Ridhuan Mohd Jamil & Nurulrabihah Mat Noh (2020). Kepelbagaian metodologi dalam kajian reka bentuk dan pembangunan. Shah Alam: Qaisae Prestige Resources.

Mohd Ridhuan Mohd Jamil. (2016). Pembangunan model kurikulum latihan Skives bagi program pengajian kejuruteraan pembelajaran berasaskan kerja. [Unpublished doctoral dissertation]. Universiti Malaya.

Mokhtar, S., Alshboul, J. A. Q. & Shahin, G. O. A. (2019). Towards data-driven education with learning analytics for Educator 4.0. Journal of Physics: Conference Series, 1339(1), 012079. https://doi/10.1088/1742-6596/1339/1/012079.

Monaghan, B. (2017). Leadership Competencies in Data Driven Decision Making. [Unpublished doctoral dissertation]. IOWA State University.

Nor Ayu Meor Ahmad. (2018). Development of a verbal and non-verbal communication model between learning companion humanoids and the elderly. [Unpublished doctoral dissertation]. University of Malaya.

Noraini Idris (2013). Kajian dalam pendidikan (Edisi Kedua). Shah Alam: McGraw-Hill Education (Malaysia) Sdn Bhd.

Olsen, J. (2019). The Nominal Group Technique (NGT) as a tool for facilitating pan-disability focus groups and as a new method for quantifying changes in qualitative Data. International Journal of Qualitative Methods, 18, 1-10. http://doi.org/10.177/1609406919866049.

O'Neil, M.J. & Jackson, L. (1983). Nominal Group Technique: A process for initiating curriculum development in higher education, Studies in Higher Education, 8(2), 129- 138.

Park, K. & Desimone, L. M. (2019). Developing principals’ data-driven decision-making capacity: Lessons from one urban district. Phi Delta Kappan, 100(7), 37-42. https://doi.org/10.1177/0031721719841337.

Pepper, C., & Wildy, H. (2009). Using Narratives as a Research Strategy. Qualitative Research Journal, 9, 18-26. https://doi.org/10.3316/QRJ0902018.

Perry, J., & Linsley, S. (2006). The use of the nominal group technique as an evaluative tool in the teaching and summative assessment of the inter-personal skills of student mental health nurses. Nurse Education Today, 26(4), 346+. https://link.gale.com/apps/doc/A146346670/AONE?u=anon~15ebf04d&sid= googleScholar&xid=d0d4500f.

Przybylski, R. M. (2017). I have the information, now what? A study discovering the factors that make up data literacy/competence. [Unpublished doctoral dissertation]. The University of Alabama. Retrieved from ProQuest Dissertations & Theses Global.

Richey, R. & Klein, J.D. (2014). Design and Development Research. Handbook of Research on Educational Communications and Technology (Fourth Edition). 141-150. New York: Springer.

Saedah Siraj, Muhammad Ridhuan Tony Lim Abdullah & Rozaini Muhamad Rozkee. (2021). Pendekatan Kajian Rekabentuk dan Pembangunan: Aplikasi kepada kajian pendidikan. Tanjung Malim: Penerbit Univerditi Pendidikan Sultan Idris.

Sage, A.P. (1977). Methodology for large-scale systems. New York, USA: McGraw-Hill.

Schildkamp, K. & Lai, M.K. (2013). Data-based decision making: Conclusions and a data use framework. In K. Schildkamp, M. K. Lai & L. Earl (Eds.), Data-based decision making in education: Challenges and opportunities, 177-191.

Seal, D. W., Bogart, L. M., & Ehrhardt, A. A. (1998). Small group dynamics: The utility of focus group discussions as a research method. Group Dynamics: Theory, Research, and Practice, 2(4), 253–266. https://doi:10.1037/1089-2699.2.4.253

Soroko, E. (2021). Self-narrative elicitation in counseling: an exploration of the usefulness of selected interview methods. Narrative Works, 9(2), 88-111. https://doi.org/10.7202/1076527ar.

Tai, M. K., & Omar, A.K. (2018). The relationship between emotional intelligence of school principals in managing change and teacher attitudes towards change. International Journal of Leadership in Education, 1-17. https://doi.10.1080/13603124.2018.1481535.

Van de Ven, A. & Delbecq, A.L. (1971). Nominal versus Interacting Group Processes for Committee Decision-Making Effectiveness. Academy of Management Journal, 14(2), 203 -212

Vroom, V. H. (2000). Leadership and the decision-making process. Organizational Dynamics, 28(4), 82–94. https://doi.org/10.1016/S0090-2616(00)00003-6.

Wang, Y. (2019). Is data-driven decision making at odds with moral decision making? A critical review of school leaders’ decision making in the era of school accountability. Values and Ethics in Educational Administration, 14(2), 1–9.

Warfield, J. N. (1974). Developing interactive structural models to organize knowledge. In IEEE Transactions on Systems, Man and Cybernetics, 4(5), 406-420.

Watts, M., & Ebbutt, D. (1987). More than the sum of the parts: Research methods in group interviewing. British Educational Research Journal, 13(1), 25-34.

Wayman, J. C., Jimerson, J. B. & Cho, V. (2012). Organizational considerations in establishing the data-informed district. School Effectiveness and School Improvement, 23(2), 159–178.

World Economic Forum. (2020). The future of jobs report 2020. World Economic Forum. https://www.weforum.org/reports/the-future-of-jobs-report-2020.

Wu, P. (2009). Do we really understand what we are talking about? A study examining the data literacy capacities and needs of school leaders. [Unpublished doctoral dissertation]. Los Angeles, CA: University of Southern California.

Yang, E. & Bayapu, I. (2019). Big Data analytics and facilities management: A case study. Facilities, 38(3/4), 268–281. https://doi/10.1108/F-01-2019-0007.

Zulkvan Geel, M., Keuning, T., Visscher, A., & Fox, J. P. (2019). Changes in educational leadership during a data-based decision-making intervention. Leadership and Policy in Schools, 18(4), 447–469. https://doi.org.10.1080/1570763.2018.1475574.