logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK

'reliability test' Search Results

Validation of the Adolescent Social Identity Measure: Adolescents’ Perception of Themselves in a Social Context

adolescents confirmatory factor analysis social identity validation

Annemaree Carroll , Julie M. Bower , Jenny Povey , Sandy Muspratt , Holly Chen


...

Social identity is an important social determinant of student outcomes such as mental health and well-being. Currently, no validated social identity measures exist for adolescents in secondary school settings. A new ‘Adolescent Social Identity’ measure was developed by adapting two social identity dimensions from a validated reputation enhancement scale. The Social Identity Measure comprises two scales of 10 items each to measure how adolescents think their peers view them (e.g., reputational status) in terms of their conforming and nonconforming behaviour (Self-perception of Public Self) and how adolescents would ideally like to be viewed (Ideal Public Self) by peers. Exploratory and confirmatory factor analyses were conducted along with assessments of reliability, validity, and measurement invariance. Conforming and Nonconforming subscales for both scales were shown to be reliable, valid, and invariant across age and gender groupings. There were significant but small differences in the latent means for gender.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.3.551
Pages: 551-565
cloud_download 541
visibility 1818
0
Article Metrics
Views
541
Download
1818
Citations
Crossref
0

Scopus
0

...

Active learning (AL) techniques invite students to participate actively, either physically or mentally, in the learning process so that they can change their behavior efficiently to achieve great achievement. Still, there is insufficient knowledge concerning the dimensions of AL techniques for business subjects of secondary school students in Malaysia. Thus, the research’s goal is to assist in the determination of the instruments’ reliability to measure the AL techniques measurement scale for business subjects’ students using exploratory factor analysis (EFA) as well as reliability analysis. Moreover, this research conducted a self-administered survey among secondary school students who have taken business subjects as their elective subjects. From secondary schools in Negeri Sembilan, Malaysia, 123 respondents were randomly chosen for the sample. To measure the AL constructs, the study retained 30 items developed because no items have been omitted since the factor loading turned out higher than the 0.50 cut-off point and was used as a tool for data collection. Essentially, this research empirically validates the dimension which helps lead to AL techniques in business subjects that are improved, and the findings are particularly beneficial to secondary school students in Malaysia.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.4.671
Pages: 671-684
cloud_download 350
visibility 1325
0
Article Metrics
Views
350
Download
1325
Citations
Crossref
0

Scopus
1

...

Based on institutional theory, this study explores the causal relationship between teacher professional identity, perceived institutional norms, and teachers’ conformity behavior in colleges and universities in Hunan Province. A questionnaire survey was conducted on 500 teachers from two universities in Hunan Province. The reliability and validity test results and structural equation modeling analysis show that the professional identity of college teachers positively affects their conformity behavior, and that perceived institutional norms partially mediate the relationship between teacher professional identity and teacher conformity behavior. The research enriches the application of institutional theory in university organization and provides an empirical basis for universities to improve teachers’ conformity behavior.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.4.761
Pages: 761-770
cloud_download 324
visibility 1446
0
Article Metrics
Views
324
Download
1446
Citations
Crossref
0

Scopus
0

Computational Thinking Through the Engineering Design Process in Chemistry Education

computational thinking engineering design process chemistry

Norhaslinda Abdul Samad , Kamisah Osman , Nazrul Anuar Nayan


...

This study investigated the influence of CThink4CS2 Module on computational thinking (CT) skills of form four chemistry students. The CThink4CS2 Module integrated CT with the Engineering Design Process (EDP) in chemistry class. This study utilized quantitative research methods and quasi-experimental design. Quantitative data were collected using the Computational Thinking Skill Test (CTST) which consisted of algorithmic reasoning, abstraction, decomposition, and pattern recognition constructs. A total of 73 students were in the treatment group (n=39) and control group (n=34). Experimental data were described by means of descriptive analysis and inferential analysis employing two-way MANOVA analysis. The results of the analysis indicated significant differences in CT skills between groups; students in the treatment group demonstrated better results compared to those in the control group. The paper provides insight into the integration of CT and EDP as effective pedagogical strategies for inculcating CT skills.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.4.771
Pages: 771-785
cloud_download 430
visibility 2066
2
Article Metrics
Views
430
Download
2066
Citations
Crossref
2

Scopus
1

...

The objective of this study was to develop a measure that possesses both reliability and validity in order to evaluate innovative thinking within the realm of education. To achieve this, the instrument's validity and reliability were evaluated through quantitative methods in two distinct phases. A team of educational experts conducted the process of establishing content validity and ensuring that the items on the instrument accurately reflected the intended constructs of creative thinking. Following that, the assessment of concept validity was conducted using confirmatory factor analyses. The aforementioned investigations resulted in the discovery of a five-factor solution consisting of 25 elements, all of which demonstrated scores beyond the crucial threshold. This successful outcome confirmed the presence of distinct factors representing different dimensions of innovative thinking. The study enrolled 1250 students from vocational education institutions as participants. The data obtained from the participants was subjected to principal component analysis and confirmatory factor analysis, leading to the development of a model that exhibited a good match with the empirical data. This indicated the effectiveness of the developed instrument in measuring innovative thinking capacity. In conclusion, the research effectively developed an accurate and dependable tool for evaluating innovative thinking in the realm of education. The gathering of positive data from the participants and meticulous quantitative analyses were responsible for this.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.1.835
Pages: 35-44
cloud_download 599
visibility 1904
2
Article Metrics
Views
599
Download
1904
Citations
Crossref
2

...

Examining the academic locus of control, procrastination, and school satisfaction is crucial for understanding student well-being and educational outcomes. The purpose of this study was to explore the potential mediating role of academic procrastination in the association between academic locus of control and school satisfaction in a sample of adolescents (N = 628; X̄ = 13.30, SD = 1.74) residing in various regions of Azerbaijan. The results revealed that higher levels of internal locus of control were positively related to school satisfaction, while increased levels of external locus of control were negatively associated with school satisfaction. The analysis using structural equation modeling showed that school satisfaction was partially influenced by academic procrastination, which acted as a mediator in the relationship between internal locus of control and school satisfaction. Additionally, academic procrastination fully mediated the relationship between external locus of control and school satisfaction. These findings were further discussed in the context of existing literature, and recommendations were provided for future research in this area.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.1.893
Pages: 93-101
cloud_download 459
visibility 1429
2
Article Metrics
Views
459
Download
1429
Citations
Crossref
2

Validity and Reliability of Child-Friendly School Policy Evaluation Instruments in Primary Schools: Confirmatory Factor Analysis

child-friendly school confirmatory factor analysis primary school

Riana Nurhayati , Suranto Aw , Siti Irene Astuti Dwiningrum , Mami Hajaroh , Herwin Herwin


...

Evaluation of child-friendly school (CFS) policies is essential to determine the achievements of school efforts in reducing violence cases. This research aims to proving the reliability and validity of CFS policy evaluation instruments in elementary schools with different locations. This investigation uses the Context Input Process Product (CIPP) evaluation model to confirm the factor structure or dimensions of several observed variables (items) to evaluate the reliability and validity of the CFS policy evaluation tool in elementary schools. The validity and reliability of previously created instruments are evaluated quantitatively, but this study utilises different subjects and study sites. There were 320 respondents, with 145 school principals and 175 teachers taken randomly. Confirmatory factors analysis (CFA) results show goodness of fit (GOF), and the model is acceptable. The CFS evaluation instrument can be accepted after eliminating several question items and modifying them. All items of the teal instrument meet the goodness of fit criteria in terms of chi-square and root mean square error of approximation (RMSEA). The instrument for evaluating CFS policies in primary schools using the CIPP model has met a valid and reliable psychometric property test so that it can be applied.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.1.965
Pages: 165-177
cloud_download 464
visibility 1253
0
Article Metrics
Views
464
Download
1253
Citations
Crossref
0

...

The role of artificial intelligence (AI) in education remains incompletely understood, demanding further evaluation and the creation of robust assessment tools. Despite previous attempts to measure AI's impact in education, existing studies have limitations. This research aimed to develop and validate an assessment instrument for gauging AI effects in higher education. Employing various analytical methods, including Exploratory Factor Analysis, Confirmatory Factor Analysis, and Rasch Analysis, the initial 70-item instrument covered seven constructs. Administered to 635 students at Nueva Ecija University of Science and Technology – Gabaldon campus, content validity was assessed using the Lawshe method. After eliminating 19 items through EFA and CFA, Rasch analysis confirmed the construct validity and led to the removal of three more items. The final 48-item instrument, categorized into learning experiences, academic performance, career guidance, motivation, self-reliance, social interactions, and AI dependency, emerged as a valid and reliable tool for assessing AI's impact on higher education, especially among college students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.2.997
Pages: 197-211
cloud_download 1093
visibility 5300
2
Article Metrics
Views
1093
Download
5300
Citations
Crossref
2

Simplification and Empirical Verification of Learning Styles Index for Indonesian Students

engineering learning style index short form verification indonesia

Niko Siameva Uletika , Budi Hartono , Titis Wijayanto


...

This article investigates the adoption, simplification, and usage recommendations of the Indonesian Index of Learning Style Short Form (ILS-SF). The aim is to refine the initial Indonesian ILS, compare the suitability between engineering/non-engineering and high school/university, and assess their learning styles. The participants were 678 students (413 females), with an average age of 19.4±1.92 years. The methods used in this study were adopting the existing Indonesian version of ILS, simplifying–reducing the number of items, empirical verification (validity and reliability), and Indonesia data assessment. The results show that the original ILS could be simplified without sacrificing the quality of the model. On the contrary, validity and reliability measures have increased. Confirmatory Factor Analysis (CFA) supports a reduction from 44 to 15 items. It confirms the validity with favorable indices such as CFI (0.972), TLI (0.966), RMSEA (0.021), SRMR (0.049), and GFI (0.999)—Active-Reflective Cronbach's alpha at 0.507, Sensing-Intuitive at 0.590, and Visual-Verbal at 0.553. Indonesian ILS-SF is faster, simpler, more suitable for engineering than non-engineering, and more ideal for undergraduate than high school students. The analysis revealed that sensory (40.2%), active (18%), and visual (10.2%) preferences dominate among Indonesian students. This study highlights assessment tools tailored to diverse educational contexts.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.1.43
Pages: 43-61
cloud_download 175
visibility 679
0
Article Metrics
Views
175
Download
679
Citations
Crossref
0

...

Recent studies identified that faculty research productivity increased when they felt competent in conducting research. Faculty level of research competency varies due to academic training, context, country, discipline, and experiences; however, what is faculty research competency? The core competencies of faculty research are unclear; thus, the current study systematically reviewed the literature. Researchers used Boolean searches of four popular databases to identify 553 articles for first-level screening. These yielded 46 peer-reviewed journal articles for full-text analysis, six of which focused on faculty populations (40 on non-faculty). Six core components of faculty research proficiency were identified: finding and reviewing literature, planning a study, collecting and analyzing data, writing research, disseminating research findings, and managing research projects. Compared to non-faculty populations, faculty are uniquely more engaged in research project management. Researchers also identified 18 sub-competencies that will help to measure faculty research competency more reliably in the future. Finally, as the identified studies relied on self-reported measurements that may carry self-representation bias, an aspirational implication is to develop a competency-based diagnostic test for measuring faculty research competence.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.1.81
Pages: 81-95
cloud_download 136
visibility 814
0
Article Metrics
Views
136
Download
814
Citations
Crossref
0

...

Developing efficient and reliable tools for assessing early mathematical skills remains a critical priority in educational research. This study aimed to develop and validate a brief version of the Prueba Uruguaya de Matemática (Uruguayan Mathematics Test, PUMa), a digital tool to assess mathematical abilities in children aged 5 to 6. The original test included 144 items covering both symbolic (66%) and non-symbolic (34%) tasks, such as approximate number system, counting, numerical ordering (forward and backward), math fluency, composition and decomposition of numbers, and transcoding auditory-verbal stimuli into Arabic-visual symbols. Unlike most existing tools that require individual administration by trained professionals and lack cultural adaptation for Latin American contexts, PUMa is self-administered, culturally grounded, and suitable for large-scale assessments using tablets. Using a sample of 443 participants and applying parametric and non-parametric models within the framework of Item Response Theory (IRT), along with correlations with TEMA-3, preliminary evidence was generated showing that the brief version retained precision and validity. The resulting shortened tests included 69 and 73 items for the parametric and non-parametric versions, yielding a balanced representation of symbolic (56%) and non-symbolic (44%) tasks. Despite item reduction, ability scores remained highly correlated between original and brief versions (r > .90), and both brief versions demonstrated strong internal consistency (α = .94). PUMa improves upon existing assessments by combining cultural relevance, group-based digital administration, and real-time data collection, offering a scalable solution for early identification and intervention. These features support personalized educational strategies that foster cognitive and academic development from the earliest stages.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.2.245
Pages: 245-266
cloud_download 62
visibility 439
0
Article Metrics
Views
62
Download
439
Citations
Crossref
0

...