logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK

' student evaluation' Search Results

...

The personalization of learning and teaching processes represents an advanced approach to education that adapts content, pace, and teaching methods to the individual needs and preferences of students. This approach relies on analyzing diverse student characteristics, such as their knowledge level, progress, learning style, and interests. Achieving these goals is significantly supported by the use of information and communication technology, which facilitates and enhances the implementation of personalization in technology-enhanced learning (TEL). The primary objective of personalization is to increase student engagement, motivation, and support in achieving learning outcomes through individualized learning paths, real-time progress tracking, and feedback. This systematic literature review examines existing personalization approaches in secondary and higher education, supported by technology. The study investigates their effectiveness and provides recommendations for future research. Results reveal that personalized teaching methods—primarily through recommender systems, adaptive learning platforms, and algorithm-driven models—are effective in tailoring educational experiences by leveraging diverse student data, such as demographics, prior achievements, learning styles, and digital engagement. The review shows a predominant focus on higher education, particularly in subjects related to computer science and digital technologies. Quantitative evaluations complemented by qualitative insights, consistently indicate that personalization enhances content mastery, motivation, and overall satisfaction, with no significant negative effects identified.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.359
Pages: 359-375
cloud_download 464
visibility 5939
2
Article Metrics
Views
464
Download
5939
Citations
Crossref
2

...

This study aimed to develop and validate a comprehensive core competency assessment instrument specifically designed for undergraduate students at a research-focused university. Despite growing emphasis on competency-based education (CBE), there are limited psychometrically sound tools tailored to evaluate students’ level of core competencies in research-intensive universities. The current study proceeded in three phases: (a) development of a conceptual framework comprising six core competencies: Integrated Thinking, Knowledge Inquiry, Creative Integration, Global Citizenship, Communication & Collaboration, and Self-Management; (b) item generation and expert validation; and (c) validation through exploratory and confirmatory factor analyses. The final instrument included 77 items across the six competencies. CFA confirmed adequate model fit (CFI = .934–.957; RMSEA = .057–.088). The results showed that the validated instrument can provide a reliable and comprehensive assessment for students' core competencies in research-oriented university settings. This instrument can provide guidelines for developing competency-based education (CBE) curricula in higher education, as well as criteria for evaluating and refining existing CBE programs. This instrument functions as both a psychometrically robust assessment tool and a practical guide for institutional enhancement. It enables precise measurement of students’ core competencies, offering evidence that can inform curriculum design, academic advising, and policy development. In addition, the validated framework lays a strong groundwork for future research to investigate the long-term effects of competency-based education on student achievement, career readiness, and personal development across various higher education settings.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.391
Pages: 391-401
cloud_download 391
visibility 2298
0
Article Metrics
Views
391
Download
2298
Citations
Crossref
0

...

Educational researchers, as well as researchers in other disciplines, often work with ordinal data, such as Likert item responses and test item scores. Critical questions arise when researchers attempt to implement statistical models to analyse ordinal data, given that many statistical techniques assume the data analysed to be continuous. Could ordinal data be treated as continuous data, that is, assuming the ordinal data to be continuous and then applying statistical techniques as if analysing continuous data? Why and why not? Focusing on structural equation models (SEMs), particularly confirmatory factor analysis (CFA), this article discusses an ongoing debate on the treatment of ordinal data and reports a short review on the practices of conducting and reporting SEMs, in the context of mathematics education research. The author reviewed 70 publications in mathematics education research that reported a study involving SEMs to analyse ordinal data, but less than half discussed how data were treated or guided readers through the analysis; it is therefore harder to repeat such an analysis and evaluate the results. This article invites methodological discussions on SEMs with ordinal variables in the practices of educational research. Subsequently, a standard for reporting SEMs with ordinal data is proposed, followed by an example. This standard contributes to educational research by enabling researchers (self and others) to evaluate SEMs reported. The example demonstrates, using real-life research data, how two different approaches for analysing ordinal data (as continuous or as a product of discretisation from some continuous distributions) can lead to results that disagree.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.423
Pages: 423-442
cloud_download 845
visibility 4183
0
Article Metrics
Views
845
Download
4183
Citations
Crossref
0

A Descriptive Study on the Effects of Modality and Covid-19 on Academic Performance by Demographic Groups

covid-19 grades hybrid online teaching modalities

Douglas R. Moodie , Alison Keefe , Robin A. Cheramie


...

Analysis of student grades and demographic data to understand the effects of modality and Covid-19 on academic performance is important for universities to understand the impact these factors may have on course grades. This study analyzes all the 615,964 complete undergraduate student-course records from Kennesaw State University (KSU) spanning from 2015 to 2024 to examine the impact of course modality and the Covid-19 pandemic on academic performance. The population dataset includes student demographics (e.g., sex, age, ethnicity), prior GPA, and course characteristics (e.g., department, modality). Descriptive statistics and trend analyses were employed to evaluate grade outcomes across in-person, online, and hybrid modalities over the 9-year period. Results indicate a temporary increase in mean course grades during the Covid-19 period, followed by a return to the pre-pandemic upward trend. Hybrid courses consistently exhibited the highest mean grades throughout the study period. However, consistent patterns across modalities, demographics, and academic units suggest that these factors have limited influence on grade outcomes. These findings raise questions about the reliability of GPA and course grades as indicators of learning success across different instructional contexts and student populations.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.443
Pages: 443-465
cloud_download 333
visibility 1520
0
Article Metrics
Views
333
Download
1520
Citations
Crossref
0

...

Despite progress made in recent years, women continue to be underrepresented in academic publishing. We aim to share insights from academic women researchers who participated in the Training Needs Assessment for developing their writing for publication skills in an Open Distance Learning institution in South Africa. The research questions that guided the study were: a) What specific challenges do academic women researchers face in developing research and publishing skills? b) What motivated academic women researchers to participate in a writing project? c) What type of support do academic women researchers identify as essential for advancing their research and publishing skills? The data were collected through an initial face-to-face meeting, followed by a Training Needs Assessment from eight purposively chosen participants in a case study design. The findings indicate participants’ challenges of time constraints, lack of confidence, and knowledge as obstacles that hindered their publishing. Despite their challenges, women researchers reported their motivation to participate in the writing project for career advancement, personal development, academic recognition, and their inspiration to publish their research work. The study found that women researchers required writing support, peer collaboration, mentorship, and institutional support to improve their writing for publishing skills. Supporting academic women researchers with focused training, engaging them in collaborative networks, and developing gender-sensitive policies is crucial for promoting equity, breaking down barriers, and ensuring their academic and professional success.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.467
Pages: 467-477
cloud_download 409
visibility 1500
0
Article Metrics
Views
409
Download
1500
Citations
Crossref
0

The Charismatic Lecturer’s Voice: Explainable Machine Learning Models

machine learning model charisma lecturer's voice

Tal Katz-Navon , Vered Aharonson , Aviad Malachi


...

This study applies explainable machine learning to identify which vocal attributes in a lecturer’s speech influence students’ views of a lecturer’s charisma, a key contributor to teaching quality. It further explores whether vocal qualities differ between male and female lecturers and how students of different genders respond to these differences, offering insights into voice-related factors that influence the impact of educators. Speech segments from YouTube videos featuring 200 native-English lecturers were evaluated by 900 students using charisma rating scales. A set of attributes related to three primary prosodic dimensions of voice - pitch, rhythm, and loudness - was computed. A random forest classifier was employed to predict the charisma level based on the speech attributes and to list and rank the attributes that contributed most to the prediction. The findings revealed prominent vocal attributes that achieved higher charisma scores in the students' ratings. Same-gender evaluations of charisma were mainly based on pitch, while cross-gender evaluations rely mostly on loudness or rhythm. The automated, interpretable method provides a reliable and efficient way to measure vocal charisma in academic lecturers. It can be adapted to examine additional individual factors that influence the perception of a lecturer’s charismatic presence. It may also be integrated into practice-based tools, designed to support instructors in improving their presentation skills. Our research bridges the fields of applied psychology and computer science to contribute to the development of educational technology.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.479
Pages: 479-493
cloud_download 545
visibility 5194
0
Article Metrics
Views
545
Download
5194
Citations
Crossref
0

...

Within the context of investigating belief systems, this work exemplifies a mixed-method approach. Two approaches are utilized to explore the philosophical, ontological, and epistemological assumptions that university students foster regarding the relationships between knowledge and reality. In the first step, written materials that elaborated on the matter at hand were subjected to content analysis with the assistance of Leximancer, a software that recognizes themes and concepts and turns textual data into concept maps that express networks of meaning. The second step involved conducting a cluster analysis on the data obtained from the questionnaire to identify distinct groups of participants who shared consistent epistemological viewpoints. The results obtained from the two approaches are in agreement and shed light on the prevalent epistemic inclination that favors a constructivist viewpoint. Discussion on the ramifications of the findings, as well as the methodological issues that are pertinent to the present illustration, is provided.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.495
Pages: 495-512
cloud_download 348
visibility 2173
0
Article Metrics
Views
348
Download
2173
Citations
Crossref
0

Pedagogical Influence of AI-Chatbots on Learning Outcomes: A Systematic Review

ai chatbots learning outcomes pedagogical influence systematic review

Mohamed Ali Elkot , Abdalilah Alhalangy , Mohammed AbdAlgane , Rabea Ali


...

In recent years, significant developments have occurred in AI-based chatbots that have been effectively deployed in the educational field. However, given the novelty of this technology, descriptive analyses remain scarce. Although many review studies have focused on the effectiveness of chatbots, they generally present broad results, and only a few have addressed the impact of this technology on learning outcomes. The present study examines the educational implications of AI chatbots on various learning outcomes through a post hoc analysis conducted in accordance with PRISMA principles. It aims to aggregate and analyze findings from studies that examined the use of chatbots and their impact on specific learning outcomes. A total of 26 studies were selected from a pool of 6,721 published between 2021 and 2024 and indexed in the Scopus and Web of Science databases. Data analysis was conducted using the Newcastle-Ottawa Scale (NOS) for Education. The results revealed that AI-chatbot technology has a positive influence on several learning outcomes, including academic achievement, motivation, self-assessment, engagement in learning, self-efficacy, and language learning, among others. The studies also detailed the methodologies and tools employed in these investigations. The study also offers insights into how intelligent chatbots can be leveraged to enhance various learning outcomes.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.527
Pages: 527-540
cloud_download 587
visibility 14386
0
Article Metrics
Views
587
Download
14386
Citations
Crossref
0

...

Vocational education plays a pivotal role in nurturing talent and supporting national development. However, challenges such as outdated talent development concepts, insufficient teacher training, and a lack of attention to soft skills cultivation from both schools and students have hindered the comprehensive development of secondary vocational students. This study aims to explore the direct effect of perceived teachers’ transformational leadership on the soft skills of 324 secondary vocational students in China and to examine the mediating role of students’ self-efficacy in this relationship. Using Structural Equation Modeling (SEM), the results show that teachers’ transformational leadership has a significant positive effect on students’ soft skills (β = 0.33, p < .01). Moreover, self-efficacy partially mediates this relationship (indirect effect β = 0.07, p < .05), accounting for 22.6% of the total effect. These findings suggest that teachers’ inspirational motivation, individualized consideration, and intellectual stimulation directly foster students’ communication, teamwork, and problem-solving skills, while also indirectly strengthening them by enhancing students’ confidence. Practically, the study underscores the need for teacher training in transformational leadership and for policy initiatives that integrate soft skills into vocational curricula.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.553
Pages: 553-568
cloud_download 528
visibility 2703
0
Article Metrics
Views
528
Download
2703
Citations
Crossref
0

...

Academic studies are an important stage in the development of professional identity and perceptions regarding a person’s future occupation. This study examined the relationships between experiences during college studies and professional identity and motivation to work in the studied field among female undergraduates from the Ultra-Orthodox sector. The study employed a cross-sectional survey design with a sample of 93 participants, who were all studying for B.A. degrees on an Ultra-Orthodox college campus. At the end of the 2023 academic year, participants completed anonymous, self-report questionnaires about their attitudes toward academic studies, professional identity, and motivation to work. The data from the questionnaires were analyzed using t-tests, ANOVA, correlation analyses, and multiple regression. The findings revealed significant, positive relationships between satisfaction with one’s studies and professional identity and between professional identity and motivation to work in one’s field of study. Contrary to what had been hypothesized, no relationship was found between the students’ satisfaction with their studies and their motivation to work in their field of study. In addition, the professional identity of students in the later years of their programs was no stronger than that of first-year students. This indicates that perceptions of one’s college studies are not directly related to occupation or motivation for work. The findings show that the year in one’s study program did not affect work motivation, suggesting that the link between academic experience and occupation is weak. In addition, the fact that professional identity did not act as a mediating factor in the examined model suggests that professional identity may develop before individuals begin their college studies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.1.19
Pages: 19-35
cloud_download 160
visibility 637
0
Article Metrics
Views
160
Download
637
Citations
Crossref
0

...

The introduction of evolution in post-apartheid South Africa in 2008 presented significant challenges for teachers, due to both their own and their students' faith-based biases. This study investigates South African teachers' attitudes and understanding of evolution, utilizing Lemkian sociocultural theory and Vygotskian ZPD scaffolding. A mixed-methods approach was employed, including a Likert-scale questionnaire from 91 life science teachers and qualitative insights from open-ended questions. Results reveal a lack of enthusiasm for teaching evolution, influenced by personal religious beliefs and doubts about its scientific validity. Teachers often call for equal representation of evolution and creationism in classrooms. The preparation of teachers must address the stagnant discussion of evolution, while the life sciences curriculum emphasizes the Nature of Science, scientific literacy, and connections between science and society is compromised.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.1.67
Pages: 67-80
cloud_download 156
visibility 878
0
Article Metrics
Views
156
Download
878
Citations
Crossref
0

...

This study aims to address students' low mathematical problem-solving skills and self-regulated learning by developing website-based mathematics learning media using the problem-based learning model. Learning that integrates website-based media allows for more independent learning activities in solving mathematical problems. This study uses the ADDIE model to test the validity, practicality, and effectiveness of the product. Website-based media met the validity criteria based on expert assessments with an average score of 137 from subject matter experts and 78.5 from media experts, and the research instruments were declared valid with an Aiken index ranging from 0.9 to 0.99. Website-based media meet the criteria for practicality based on an average teacher assessment of 90.5, an average student assessment of 50.1, and a learning implementation rate of 93%. Website-based media are proven to be effective through four indicators: (1) students who pass exceed the threshold of 80%. (2) One sample t-test results p-value <.05 and t-value >1.69, so that H_0 is rejected. This proves that website-based mathematics learning media are effective in improving students' mathematical problem-solving skills and self-regulated learning. (3) The results of the paired sample t-test show p-value <.05 and t-value >1.69, so that H_0 is rejected. This proves that there is a significant improvement in students' mathematical problem-solving and self-regulated learning abilities after using website-based mathematical learning media. This study is able to facilitate students' problem-solving and self-regulated learning abilities simultaneously in mathematics education.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.2.81
Pages: 81-98
cloud_download 36
visibility 133
0
Article Metrics
Views
36
Download
133
Citations
Crossref
0

...

Team-based learning (TBL) is a popular form of collaborative learning designed to increase student engagement and motivate students to learn. A growing body of research, particularly in the health sciences, has demonstrated that TBL has positive impacts on student performance and classroom dynamics. However, much less is known about the student outcomes associated with TBL courses in undergraduate science, technology, engineering, and mathematics (STEM) education, fields in which active learning is especially important for student success and retention. To address this gap, we conducted a systematic review of the student outcomes associated with TBL in undergraduate STEM education. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method, we identified 55 empirical and qualitative research articles published between 2005 and 2024 that reported on TBL implementation practices and student outcomes. Importantly, we found that most studies described increased student performance and improved measures of classroom dynamics when TBL was compared to lecture-based teaching approaches. These findings provide further evidence that TBL is an effective instructional method and suggest that TBL can be implemented successfully across a wide range of student populations and undergraduate STEM disciplines.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.2.99
Pages: 99-117
cloud_download 31
visibility 184
0
Article Metrics
Views
31
Download
184
Citations
Crossref
0

...

This study investigates how learning-oriented school cultures, conceptualized through the Schools as Learning Organizations (SLO) framework, relate to teacher self-efficacy, job satisfaction, and work effectiveness in primary schools within a centralized education system. While these constructs have received considerable attention in the literature, they have rarely been examined together within a unified organizational learning perspective, particularly in contexts marked by limited school autonomy. Using a cross-sectional survey design, data were collected from 94 teachers in nine public primary schools, alongside aggregated student ratings of instructional effectiveness from 364 pupils. The findings showed that learning-oriented school cultures were positively associated with teacher self-efficacy, job satisfaction, and work effectiveness. Teacher self-efficacy also partially mediated the relationship between SLO conditions and both job satisfaction and work effectiveness. These findings indicate that learning-oriented school cultures may strengthen teacher outcomes directly and indirectly by reinforcing teachers’ sense of efficacy. Thus, the role of school leadership in cultivating collaborative and inquiry-oriented professional environments is particularly important  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.2.119
Pages: 119-132
cloud_download 34
visibility 115
0
Article Metrics
Views
34
Download
115
Citations
Crossref
0

...

Teacher-targeted victimization remains an under-integrated dimension of school violence research. This systematic review follows PRISMA 2020 guidelines and synthesizes 56 empirical studies (2015–2026) examining how teacher-targeted victimization is conceptualized and analyzed. The review maps patterns in geographic distribution, methodology, behavioral aggression forms, perpetrator framing, and the integration of institutional variables. Findings reveal the predominance of quantitative cross-sectional designs (75.9%). Physical (n = 28) and verbal aggression (n = 26) are the most frequently examined forms, with over half of the studies conceptualizing aggression as exclusively student-perpetrated. Institutional and governance variables remain limited: 84.8% of studies include no institutional variables beyond exposure or rely solely on general school climate indicators, while governance-level constructs appear in only one study. Drawing on Organizational Justice Theory and Institutional Theory, the review advances a Multilevel Institutional Accountability Model that conceptualizes teacher-directed aggression across behavioral exposure, institutional processing, and governance architecture. The findings highlight the need for greater integration of institutional and governance variables in future research.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.2.133
Pages: 133-148
cloud_download 54
visibility 143
0
Article Metrics
Views
54
Download
143
Citations
Crossref
0

...