'validity and reliability' Search Results
Factor Structure and Dimensionality of an Instrument designed to Measure the Metacognitive Orientation of Thai Science Classroom Learning Environments
classroom learning environments metacognition science education...
The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) in the Thai context. The metacognitive orientation of a science classroom learning environment is defined as the extent to which psychosocial conditions that are known to enhance students’ metacognition are evident in a specific science classroom. This study builds on earlier work in the research areas of science education, metacognition, and learning environments. A sample of 5418 Thai science students in grades 10 to 12, from 40 schools across Thailand, completed the MOLES-S that had been translated into Thai. Exploratory factor analysis was undertaken and Rasch analysis was used to calibrate the scale and explore its dimensionality. The results suggest that the MOLES-S(T), where (T) represents Thailand, has the same factor structure as the original MOLES-S, is reliable, and can be used with confidence in research into metacognition in Thai high school science classrooms.
Graded Response Models on the Curiosity Measurement of Elementary School Students
curiosity measurement elementary school graded response models...
Curiosity is one of the most important characters for elementary school students. However, the facts in the field show that the measurement model used by the teacher to identify the student's curiosity is not yet available in a standardized manner. This study aims to develop a model for measuring the curiosity of elementary school students using the graded response model (GRM) approach. This research uses quantitative method with descriptive type. The research sample used was 236 elementary school students who were randomly selected. Data were collected using a questionnaire of 16 statement items using a Likert scale approach. The data were analyzed using the response item theory approach with the GRM. The results showed that the model for measuring student curiosity in elementary schools had good location parameters, a good discriminant index, a fairly good information function with a small estimation error. The curiosity measurement model in this study can be used as an alternative for teachers to identify students' curiosity in elementary schools.
Involvement of Stakeholders in the Transformation of Educational Services via Taking Advantage of Extra-Curriculum Educational Activities in the Settings of Education Reform
education extra-curriculum educational services involvement of stakeholders investments in education transformation of educational services...
The purpose of the study is to explore the ways of involving university stakeholders specifically in updating educational services. It combined exploratory and observational research methods which relied on qualitative or quantitative data gathered through the researcher-designed and validated tools which were the empirical and methodological contributions to the previous research. The five most frequent choices that might encourage the stakeholders to donate or invest in an educational institution were as follows: a portfolio of the use of donations, investments, or grants, having a stake in the educational services of more than 7%, having access to budgeting and cost reporting, having a share in the institutions’ profit and being one of the decision-makers. The factors that discouraged investors from investing in education were as follows: distrust of the activity of the educational institutions in terms of addressing the stakeholders’ needs or interests, lack of engagement or cooperation, institutional and government-imposed barriers between them and the institutions, uncertainty concerning the efficiency of the institutions and inefficient use of the resources by the institutions. The initiative was complimentarily perceived by stakeholders in terms of collaboration and investment opportunities. It was also found beneficial by the sampled students.
Evaluation of the 9th-grade 2018 Physics Curriculum With Multilevel Rasch Analysis
multilevel rasch analysis physics curriculum rater bias...
This study aims to examine the 9th-grade 2018 physics curriculum according to various criteria. A cross-sectional survey model was used. The sample consists of 36 physics teachers working in various high schools in 12 regions of Turkey in the 2022-2023 academic year. The data of the study were collected via the “9th-grade 2018 physics curriculum Evaluation Form”. The data collected via the evaluation form were determined with the multilevel Rasch analysis program. The results of the research revealed that the criteria determined in the evaluation of the 9th-grade physics curriculum differed in terms of strictness and generosity. In addition, the quantitative data analysis revealed that the physics teachers mostly comply with the criteria set in the program while they disapprove of some criteria. The physics teachers reported some deficiencies in the objectives, content, and educational status of the elements included in the program. In this context, it is recommended that the achievements of the 9th-grade 2018 physics curriculum be reviewed in line with the evaluations of the stakeholders related to the subject.
Development of a Digital-Preneurship Measurement Instrument: Alignment Approach Through Project-Based Learning
approach digitalpreneurship instrument development pjbl vocational student...
The purposes of this research are (a) to make an instrument to measure the achievement of project-based digitalpreneurship learning in students; (b) to describe the quality of the project-based digitalpreneurship learning achievement assessment instrument for vocational high school students; (c) to measure the competence and skills. This study employed to research and development as its methodology, using a combination procedure between Oriondo and Antonio and, Mardapi. The development procedure includes three stages: instrument design, instrument testing, and measurement. A total of 795 students who participated in the study at 5 vocational high schools in Yogyakarta's special region served as responders. Data analysis in this development uses the content validity of the formula Aiken V Index, confirmatory factor analysis establishes the construct's validity, and construct reliability. Measurement instrument development. Research findings that (a) the instrument is ready to be used in the measurement; (b) the quality of the project-based digitalpreneruship learning achievement assessment instrument for vocational high school students is well tested. This is evidenced by the validity test which has a high score >.8; The proof of construct validity in this study using CFA > .5; GOF chi-square value with a critical value of df = 289, X2 = 323, p-value with a critical value of .079, RMSEA with a critical value of RMSEA .019 (≤ .08), SMRM with a critical value of SRMR 0.030 (≤ .05), CFI with a critical value of CFI .990 (> .97), and an NFI with a critical value of NFI .989 ( > .90); (c) the measurement results are identified in the process that needs to be improved again regarding the digitalpreneurship skills of vocational high school students.
The Effect of Gersmehl’s Spatial Learning on Students’ Disaster Spatial Literacy
disaster gersmehl spatial learning spatial literacy...
Learning geography in Indonesia philosophically aims to develop spatial literacy. Students must improve spatial literacy to form reasoning skills and apply spatial concepts in real life. Applying Gersmehl's spatial learning can improve students' spatial literacy through syntax arranged based on spatial aspects. The use of google earth helps students to complete case studies of disaster mitigation materials without the need to go directly to the field. This quasi-experimental research refers to the posttest-only control group design by comparing the posttest of spatial literacy in the experimental and control classes. This study involved students of class XI IPS SMAN 1 Blitar City. The instrument is a five-point description test based on indicators of spatial literacy in disaster mitigation materials standardized with validity and reliability tests. The research data were analyzed using normality, homogeneity, and hypothesis tests. The data tested were in the form of posttest scores for spatial literacy in the experimental and control classes. The results of Gersmehl's spatial learning influence spatial literacy. The use of LKPD bridges the implementation of spatial learning syntax with Google Earth as a geospatial medium. The implementation of syntax in spatial learning is interrelated with spatial literacy indicators, thereby increasing students' spatial literacy based on experience and spatial recognition.
Impact of Chinese College Students’ Professional Identity on Their Academic Achievement: Career Maturity as a Mediator
achievement career maturity mediator professional identity...
This study investigated college students’ career maturity as a mediator of the effect of professional identity on academic achievement. The researchers developed a structural equation model and a research hypothesis using the Chinese college students’ professional identity scale, career maturity scale, and academic achievement scale. After experts’ revision and confirmatory analysis, the 3 scales had sufficient reliability, validity, and fit. The researchers distributed electronic questionnaires to students in 4 universities in Jilin Province, China, and participants responded using 5-point Likert-type scales. The researchers collected 1,104 valid questionnaires. According to the analysis, college students’ professional identity is a positive predictor of their academic achievement, and career maturity partially mediates the influence of professional identity on academic achievement. Therefore, improving Chinese college students’ professional identity may improve their academic achievement, and professional identity can have a positive effect on academic achievement through career maturity. University administrators and teachers should enhance the career maturity of college students and promote their professional development.
The Pedagogical Role of the Primary-School Headteacher: Insights From Greece
headteacher pedagogical leadership school principal school climate school life...
The pedagogical and didactic guidance of teachers has been linked, in the relevant literature, to the school management’s adoption of the model of pedagogical leadership as well as to the assurance of a series of factors that influence it. This study aims at investigating the pedagogical role of the principal in Greek primary schools. Data were collected through an anonymous questionnaire completed by 133 Greek primary school head teachers. Results show that head teachers consider that their pedagogical role has mainly to do with the pedagogical climate, psychosocial and pedagogical guidance of the school unit. Additionally, the research results show that head teachers carry out their pedagogical role cooperating and communicating mainly with the members of the educational community of the school. Another noteworthy finding of the present study is that the factors that support head teachers in their pedagogical leadership role, are hard to exist in hierarchical educational realities such as Greece. The originality of the paper draws attention to the school's socio-economic environment, which significantly influences school leadership. Conclusions on the implications of the study are made and directions for future research are suggested.
Let's Explore! The Factor, Reliability, and Validity Analyses of Readiness for a Knowledge-Based Economy Among Undergraduate Students
economics education exploratory and confirmatory factor higher education knowledge-based economy undergraduate students...
Knowledge-based economy is an economic model students need to be prepared for a future economic model that uses knowledge as its main resource. Therefore, this study developed and validated instruments for constructing knowledge-based economy readiness among undergraduate students. This study used an online questionnaire with 120 respondents of economic education students in educational universities in East Java, Indonesia, for exploratory factor analysis and 417 respondents for confirmatory factor analysis. Then, statistical analysis was conducted using exploratory factor analysis in SPSS and confirmatory factor analysis in AMOS. This study first developed five factors of knowledge of economics, readiness for economic challenges, readiness for education, readiness for infrastructure, and readiness for innovation, consisting of 27 items. However, one item was removed because the loading factor was below .50. Consequently, 26 items were retained because the loading factor was significantly greater than .50. The Cronbach's alpha value for each item of the knowledge-based economy readiness construct was >.60 and met all goodness of fit index criteria, which means that it meets the requirements and can measure the construct of knowledge-based economy readiness. Since this study meets the validity and reliability requirements of the constructs leading to knowledge-based economy readiness, these results will help students prepare for the current and future knowledge-based economy. They can be used in developing economic education curricula in higher education.
Computational Thinking Through the Engineering Design Process in Chemistry Education
computational thinking engineering design process chemistry...
This study investigated the influence of CThink4CS2 Module on computational thinking (CT) skills of form four chemistry students. The CThink4CS2 Module integrated CT with the Engineering Design Process (EDP) in chemistry class. This study utilized quantitative research methods and quasi-experimental design. Quantitative data were collected using the Computational Thinking Skill Test (CTST) which consisted of algorithmic reasoning, abstraction, decomposition, and pattern recognition constructs. A total of 73 students were in the treatment group (n=39) and control group (n=34). Experimental data were described by means of descriptive analysis and inferential analysis employing two-way MANOVA analysis. The results of the analysis indicated significant differences in CT skills between groups; students in the treatment group demonstrated better results compared to those in the control group. The paper provides insight into the integration of CT and EDP as effective pedagogical strategies for inculcating CT skills.
Development and Validation of a Reliable and Valid Assessment Tool for Measuring Innovative Thinking in Vocational Students
innovative thinking measurement tool reliability validity...
The objective of this study was to develop a measure that possesses both reliability and validity in order to evaluate innovative thinking within the realm of education. To achieve this, the instrument's validity and reliability were evaluated through quantitative methods in two distinct phases. A team of educational experts conducted the process of establishing content validity and ensuring that the items on the instrument accurately reflected the intended constructs of creative thinking. Following that, the assessment of concept validity was conducted using confirmatory factor analyses. The aforementioned investigations resulted in the discovery of a five-factor solution consisting of 25 elements, all of which demonstrated scores beyond the crucial threshold. This successful outcome confirmed the presence of distinct factors representing different dimensions of innovative thinking. The study enrolled 1250 students from vocational education institutions as participants. The data obtained from the participants was subjected to principal component analysis and confirmatory factor analysis, leading to the development of a model that exhibited a good match with the empirical data. This indicated the effectiveness of the developed instrument in measuring innovative thinking capacity. In conclusion, the research effectively developed an accurate and dependable tool for evaluating innovative thinking in the realm of education. The gathering of positive data from the participants and meticulous quantitative analyses were responsible for this.
2
A Structural Equation Modeling of Academic Locus of Control, Procrastination, and Their Impact on School Satisfaction: Insights From the Azerbaijani Educational System
academic locus of control academic procrastination school satisfaction structural equation modeling...
Examining the academic locus of control, procrastination, and school satisfaction is crucial for understanding student well-being and educational outcomes. The purpose of this study was to explore the potential mediating role of academic procrastination in the association between academic locus of control and school satisfaction in a sample of adolescents (N = 628; X̄ = 13.30, SD = 1.74) residing in various regions of Azerbaijan. The results revealed that higher levels of internal locus of control were positively related to school satisfaction, while increased levels of external locus of control were negatively associated with school satisfaction. The analysis using structural equation modeling showed that school satisfaction was partially influenced by academic procrastination, which acted as a mediator in the relationship between internal locus of control and school satisfaction. Additionally, academic procrastination fully mediated the relationship between external locus of control and school satisfaction. These findings were further discussed in the context of existing literature, and recommendations were provided for future research in this area.
2
Effectiveness of Project-Based Learning on STEAM-Based Student’s Worksheet Analysis With Ecoprint Technique
motivation steam student creativity worksheet...
The objective of this research was to assess the efficacy of project-based learning in enhancing the analysis of student worksheets in the domains of Science, Technology, Engineering, Arts, and Mathematics (STEAM) with the integration of the ecoprint technique, focusing on its influence on student motivation and creativity. This investigation was conducted as a quasi-experiment involving a sample size of 150 students selected through cluster sampling. Data collection was executed using standardized tests, with instrument validity ascertained through the Aiken index and instrument reliability determined via Cronbach's alpha coefficient. Data analysis was performed using multivariate analysis (MANOVA) and descriptive quantitative methods. The study's findings reveal a significant disparity in the mean scores of both learning motivation and student creativity. In conclusion, the implementation of project-based learning coupled with STEAM-based student worksheet analysis utilizing the ecoprint technique yields a substantial enhancement in learning motivation and student creativity. These findings underscore the success of employing STEAM-based worksheets in conjunction with the ecoprint method to foster students' motivation and creativity, as ecoprint inherently encompasses all STEAM components within the manufacturing process.
0
Validity and Reliability of Child-Friendly School Policy Evaluation Instruments in Primary Schools: Confirmatory Factor Analysis
child-friendly school confirmatory factor analysis primary school...
Evaluation of child-friendly school (CFS) policies is essential to determine the achievements of school efforts in reducing violence cases. This research aims to proving the reliability and validity of CFS policy evaluation instruments in elementary schools with different locations. This investigation uses the Context Input Process Product (CIPP) evaluation model to confirm the factor structure or dimensions of several observed variables (items) to evaluate the reliability and validity of the CFS policy evaluation tool in elementary schools. The validity and reliability of previously created instruments are evaluated quantitatively, but this study utilises different subjects and study sites. There were 320 respondents, with 145 school principals and 175 teachers taken randomly. Confirmatory factors analysis (CFA) results show goodness of fit (GOF), and the model is acceptable. The CFS evaluation instrument can be accepted after eliminating several question items and modifying them. All items of the teal instrument meet the goodness of fit criteria in terms of chi-square and root mean square error of approximation (RMSEA). The instrument for evaluating CFS policies in primary schools using the CIPP model has met a valid and reliable psychometric property test so that it can be applied.
0
Development and Validation of Instruments for Assessing the Impact of Artificial Intelligence on Students in Higher Education
artificial intelligence item measurement reliability test validity test...
The role of artificial intelligence (AI) in education remains incompletely understood, demanding further evaluation and the creation of robust assessment tools. Despite previous attempts to measure AI's impact in education, existing studies have limitations. This research aimed to develop and validate an assessment instrument for gauging AI effects in higher education. Employing various analytical methods, including Exploratory Factor Analysis, Confirmatory Factor Analysis, and Rasch Analysis, the initial 70-item instrument covered seven constructs. Administered to 635 students at Nueva Ecija University of Science and Technology – Gabaldon campus, content validity was assessed using the Lawshe method. After eliminating 19 items through EFA and CFA, Rasch analysis confirmed the construct validity and led to the removal of three more items. The final 48-item instrument, categorized into learning experiences, academic performance, career guidance, motivation, self-reliance, social interactions, and AI dependency, emerged as a valid and reliable tool for assessing AI's impact on higher education, especially among college students.
2
Profiles of Teacher-Student Relationships and Classroom Management Practices: How They Relate to Self-Efficacy, Work Stress, and Classroom Climate
classroom management prosocial classroom model teacher profile teacher-student relationships teacher wellbeing...
Teachers' classroom practice encompasses diverse facets of teacher behavior. Understanding teachers’ classroom practice is important as the literature has been well documented its association with student, teacher, and classroom outcomes. Positive teacher-student relationships and proper classroom management, both are important aspects of teachers’ classroom practices, have been empirically linked to increasing student academic performance and reducing problem behaviors. This study explored patterns of teacher classroom practices across teacher-student relationships and classroom management and validated them using a person-oriented approach, k-means clustering, on three sets of data with over 600 participants. Using indicators of classroom assessment scoring system (CLASS), three distinct teacher profiles were identified: supportive, intermediate, and detached. Supportive teachers demonstrated high levels of teacher-student relationships and classroom management, while detached teachers showed low levels of both. Intermediate teachers fell between these two groups. The study also compared these profiles based on teacher self-efficacy, work stress, and classroom climate. Supportive teachers had the highest classroom climate scores, followed by intermediate and detached. Work stress was comparable for intermediate and supportive teachers, but both were lower than detached. No group differences were found for self-efficacy. This study contributes to the understanding of teacher behaviors with students in the lower grades.
2
Simplification and Empirical Verification of Learning Styles Index for Indonesian Students
engineering learning style index short form verification indonesia...
This article investigates the adoption, simplification, and usage recommendations of the Indonesian Index of Learning Style Short Form (ILS-SF). The aim is to refine the initial Indonesian ILS, compare the suitability between engineering/non-engineering and high school/university, and assess their learning styles. The participants were 678 students (413 females), with an average age of 19.4±1.92 years. The methods used in this study were adopting the existing Indonesian version of ILS, simplifying–reducing the number of items, empirical verification (validity and reliability), and Indonesia data assessment. The results show that the original ILS could be simplified without sacrificing the quality of the model. On the contrary, validity and reliability measures have increased. Confirmatory Factor Analysis (CFA) supports a reduction from 44 to 15 items. It confirms the validity with favorable indices such as CFI (0.972), TLI (0.966), RMSEA (0.021), SRMR (0.049), and GFI (0.999)—Active-Reflective Cronbach's alpha at 0.507, Sensing-Intuitive at 0.590, and Visual-Verbal at 0.553. Indonesian ILS-SF is faster, simpler, more suitable for engineering than non-engineering, and more ideal for undergraduate than high school students. The analysis revealed that sensory (40.2%), active (18%), and visual (10.2%) preferences dominate among Indonesian students. This study highlights assessment tools tailored to diverse educational contexts.
0
University Faculty Research Competence: A Systematic Literature Review of Core Components, Distinctions, and Measures
faculty higher education measures research competence systematic review...
Recent studies identified that faculty research productivity increased when they felt competent in conducting research. Faculty level of research competency varies due to academic training, context, country, discipline, and experiences; however, what is faculty research competency? The core competencies of faculty research are unclear; thus, the current study systematically reviewed the literature. Researchers used Boolean searches of four popular databases to identify 553 articles for first-level screening. These yielded 46 peer-reviewed journal articles for full-text analysis, six of which focused on faculty populations (40 on non-faculty). Six core components of faculty research proficiency were identified: finding and reviewing literature, planning a study, collecting and analyzing data, writing research, disseminating research findings, and managing research projects. Compared to non-faculty populations, faculty are uniquely more engaged in research project management. Researchers also identified 18 sub-competencies that will help to measure faculty research competency more reliably in the future. Finally, as the identified studies relied on self-reported measurements that may carry self-representation bias, an aspirational implication is to develop a competency-based diagnostic test for measuring faculty research competence.
0