Validity and Reliability of Instrument Competencies Framework of Agriculture Educators: The Rasch Measurement Model
This study aims to produce empirical evidence of the validity and reliability of instrument items for the competency framework of agricultural teachin.
- Pub. date: August 15, 2021
- Pages: 411-420
- 319 Downloads
- 558 Views
- 2 Citations
This study aims to produce empirical evidence of the validity and reliability of instrument items for the competency framework of agricultural teaching staff in Malaysian agricultural vocational colleges. The validity and reliability of the framework were analyzed using Rasch Model Measurement assisted by Winsteps 3.72 software. This research instrument contained 116 items, which was distributed to 30 instructors at the Teluk Intan Agricultural Vocational College, Malaysia. The selection of respondents was made by strata random where the researcher makes the strata of the population according to the percentage and then selects randomly based on the desired percentage. Validity analysis of the instrument was done through four functional testings. For reliability and separation of respondents, it was found that the individual reliability value was very good and acceptable. The results of the item polarity analysis detected no negative value (-) in the Point Measure Correlation value. Item matching analysis found that 11 items had to be dropped as they failed to meet the required conditions. From the analysis on local dependence that determines dependent items based on the standardized residual correlation value, it was discovered that the correlation value for the items used was detected; 13 items need attention. The results of the data analysis checking the functionality of the items suggested that some items should be dropped. The omission of these items has provided evidence that the instrument of competence of agricultural instructors is crucial to have a high level of validity and reliability for use in actual studies.
Keywords: Agriculture instructors, pilot study, Rasch measurement model, validity and reliability.
References
Ahmad, M. F. (2017). Mobile learning framework for automotive programme in Malaysia Polythechnics [Unpublished doctoral dissertation]. Universiti Teknologi Malaysia.
Azrilah, A. A., Saidfudin, M., & Zaharim, A. (2017). Asas model pengukuran Rasch [Basis of the Rasch measurement model].UKM Press.
Bond, T., & Fox, C. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). LEA.
Boone, H., & Boone, D. (2009). An assessment of problems faced by high school agricultural education teachers. Journal of Agricultural Education, 50(1), 21–32. https://doi.org/10.5032/jae.2009.01021
Borich, G. D. (1980). A needs assessment model for conducting follow-up studies. Journal of Teacher Education, 31(3), 39-42. https://doi.org/10.1177/002248718003100310
Camp, W. G., Broyles, T., & Skelton, N. S. (2002). A national study of the supply and demand for teachers of agricultural education in 1999-2001. Virginia Polytechnic Institute and State University.
Chua, Y. P. (2014). Kaedah dan statistik penyelidikan buku 1 kaedah penyelidikan [Research methods and statistics book 1 research methods] (2nd ed.). Mc Graw Hill Education.
Cohen, R. J., & Swerdlik, M. E. (2002). Psychological testing and assessment: An introduction to tests and measurement . McGraw-Hill.
Connors, J. J. (1998). A regional delphi study of the perceptionsoOf NVATA, NASAE, and AAAE members on critical issues facing secondary agricultural education programs. Journal of Agricultural Education, 39(1), 37–47. https://doi.org/10.5032/jae.1998.01037
Fisher, W. P. J. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21(1), 1095.
Fox, N., Hunn, A., & Mathers, N. (2009). Sampling and sample size calculation. The NIHR RDS for the East Midlands / Yorkshire & the Humber.
Garton, B. L., & Chung, N. (1996). The inservice needs of beginning teachers of agriculture as perceived by beginning teachers, teacher educators, and state supervisors. Journal of Agricultural Education, 37(3), 52–58. https://doi.org/10.5032/jae.1996.03052
Hopkins, K. D. (1998). Educational and psychological measurement and evaluation (8th ed.). Pearson.
Kulshrestha, A., & Pandey, K. (2013). Teacher Training and Professional Competencies. Professional Competencies Voice of Research, 1(4), 29–33.
Layfield, K. D., & Dobbins, T. R. (2003). Inservice needs and perceived competencies of south carolina agricultural educators. Journal of Agricultural Education, 43(4), 46–55. https://doi.org/10.5032/jae.2002.04046
Lim, S. M., Rodger, S., & Brown, T. (2009). Using Rasch analysis to establish the construct validity of rehabilitation assessment tools. International Journal of Therapy and Rehabilitation, 16(5), http://doi/10.12968/ijtr.2009.16.5.42102
Linacre, J. M. (2002). What do Infit and Outfit, Mean-square and Standardized mean? Rasch Measurement Transactions, 16(2), 878.
Linacre, J. M. (2008). Development and validation of instrument (Electronic Version). Rasch Measurement Transactions, 21.
Mariani, A. (2016). Model pengajaran kreatif berteraskan kompetensi, personaliti dan ransangan kreativiti guru matematik berpendekatan permodelan persamaan struktur[Creative teaching model based on competence, personality and the stimulus of creativity of mathematics teachers approached to structural equation modeling] [Unpublished doctoral dissertation]. Universiti Teknologi Malaysia.
Md Yunos, J., Ibrahim Mukhtar, M., Alias, M., Lee, M. F., Tee, T. K., Rubani, S. N. K., Hamid, H., Yunus, F. A. N., Sulaiman, J., & Sumarwati, S. (2017). Validity of Vocational Pedagogy Constructs Using the Rasch Measurement Model. Journal of Technical Education and Training, 9(2), 35-45.
Mundt, J. P., & Connors, J. J. (1999). Problems and challenges associated with the first years of teaching agriculture: A framework for preservice and inservice education. Journal of Agricultural Education, 40(1), 38–48. https://doi.org/10.5032/jae.1999.01038
Myers, B. E., Dyer, J. E., & Washburn, S. G. (2005). Problems facing beginning agriculture teachers. Journal of Agricultural Education, 46(3), 47–55. https://doi.org/10.5032/jae.2005.03047
Nasir, A. N. (2016). Kerangka pengajaran amali kursus teknologi elektronik di kolej vokaisonal malaysia [Practical teaching framework of electronic technology courses in colleges malaysian vocational] [Unpublished doctoral dissertation]. Universiti Teknologi Malaysia.
Ramjattan, J., Chowdhury, A., & Ganpat, W. (2020). Agricultural extension agents’ use of learning-based extension methods in Trinidad and Tobago. Journal of Learning for Development, 7(2), 142–160.
Ramlan, N. H., Abdullah, Z., & Hussin, S. (2017). Tahap Kompetensi Khusus Pensyarah Teknologi Pembinaan, Kejuruteraan Awam Kolej Vokasional, Kementerian Pendidikan Malaysia Berdasarkan Gred Jawatan Dan Tahun Pengalaman Mengajar [Specific competency level of construction technology lecturers, civil engineering vocational colleges, ministry of education Malaysia based on job grade and years of teaching experience]. Journal of Educational Leadership/ Jurnal Kepimpinan Pendidikan, 4(3), 1–14.
Raof, S. A., Hatib, A., & Atmareni, H. (2020). The challenges faced by the agriculture lectures in improving teaching delivery at Malaysia agriculture vocational colleges : A competency study. Journal of Educational Research & Indigenous Studies, 2(1), 1-12.
Raof, S. A., Musta’amal, A. H., Zamzuri, F. K., & Salleh, M. H. (2021). Validity and Reliability of Students Perceptions on OBE Approach in Malaysian VC Using Rasch Model. Journal of Innovation in Educational and Cultural Research, 2(2), 44–50. https://doi.org/10.46843/jiecr.v2i2.30
Sorensen, T. J., Lambert, M. D., & McKim, A. J. (2014). Examining Oregon agriculture teachers’ professional development needs by career phase. Journal of Agricultural Education, 55(5), 140–154. https://doi.org/10.5032/jae.2014.05140
Suhairom, N. (2016). Competencies Framework For Culinary Profession In Malaysian Hotel Sector [Unpublished doctoral dissertation]. Universiti Teknologi Malaysia.
Wright, B. D., & Masters, G. N. (2002). Number of person or item strata. Rasch Measurement Transactions, 16(3), 888.
Yusof, H. M., Mustapha, R., Mohamad, S. A. M. S., & Bunian, M. S. (2012). Measurement model of employability skills using confirmatory factor analysis. Procedia - Social and Behavioral Sciences, 56, 348–356. https://doi.org/10.1016/j.sbspro.2012.09.663