logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK

'Assessment' Search Results

The Charismatic Lecturer’s Voice: Explainable Machine Learning Models

machine learning model charisma lecturer's voice

Tal Katz-Navon , Vered Aharonson , Aviad Malachi


...

This study applies explainable machine learning to identify which vocal attributes in a lecturer’s speech influence students’ views of a lecturer’s charisma, a key contributor to teaching quality. It further explores whether vocal qualities differ between male and female lecturers and how students of different genders respond to these differences, offering insights into voice-related factors that influence the impact of educators. Speech segments from YouTube videos featuring 200 native-English lecturers were evaluated by 900 students using charisma rating scales. A set of attributes related to three primary prosodic dimensions of voice - pitch, rhythm, and loudness - was computed. A random forest classifier was employed to predict the charisma level based on the speech attributes and to list and rank the attributes that contributed most to the prediction. The findings revealed prominent vocal attributes that achieved higher charisma scores in the students' ratings. Same-gender evaluations of charisma were mainly based on pitch, while cross-gender evaluations rely mostly on loudness or rhythm. The automated, interpretable method provides a reliable and efficient way to measure vocal charisma in academic lecturers. It can be adapted to examine additional individual factors that influence the perception of a lecturer’s charismatic presence. It may also be integrated into practice-based tools, designed to support instructors in improving their presentation skills. Our research bridges the fields of applied psychology and computer science to contribute to the development of educational technology.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.479
Pages: 479-493
cloud_download 633
visibility 9004
0
Article Metrics
Views
633
Download
9004
Citations
Crossref
0

...

Within the context of investigating belief systems, this work exemplifies a mixed-method approach. Two approaches are utilized to explore the philosophical, ontological, and epistemological assumptions that university students foster regarding the relationships between knowledge and reality. In the first step, written materials that elaborated on the matter at hand were subjected to content analysis with the assistance of Leximancer, a software that recognizes themes and concepts and turns textual data into concept maps that express networks of meaning. The second step involved conducting a cluster analysis on the data obtained from the questionnaire to identify distinct groups of participants who shared consistent epistemological viewpoints. The results obtained from the two approaches are in agreement and shed light on the prevalent epistemic inclination that favors a constructivist viewpoint. Discussion on the ramifications of the findings, as well as the methodological issues that are pertinent to the present illustration, is provided.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.495
Pages: 495-512
cloud_download 474
visibility 4205
0
Article Metrics
Views
474
Download
4205
Citations
Crossref
0

...

These days, many schools are reviewing their curricula, and Science, Technology, Engineering, Arts, and Mathematics (STEAM) education is one area where these changes are being applied. Because STEAM education integrates five subjects, it requires an approach in which teachers from these subjects work collaboratively. However, applying traditional assessment methods in STEAM education is challenging, as it requires teachers to jointly decide on appropriate assessment strategies. At present, no clear framework exists to support this process. This study examined the potential of the ordinal priority approach (OPA), a recently introduced method for multi-criteria decision-making, to facilitate teachers’ collaborative selection of assessment methods for STEAM education. It further explored the extent to which subject differences affect collaboration by comparing the decision-making of two groups: a homogeneous group (teachers of the same subject) and a heterogeneous group (teachers of different subjects). Pre- and post-questionnaires were administered to both groups to determine how the OPA can assist teachers in jointly developing a STEAM assessment method. Analyses of the responses identified differences in each group’s consensus-building process. The study revealed three key contributions of OPA to teacher collaboration in STEAM education: 1) it ensures that teachers from diverse subjects have their opinions considered; 2) its transparent decision-making process helps mitigate distrust during discussions; and 3) it promotes fair decision-making, unaffected by social power differences within the group. Based on these findings, OPA appears effective in converging diverse expert opinions through a clear decision-making process.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.513
Pages: 513-525
cloud_download 402
visibility 3794
0
Article Metrics
Views
402
Download
3794
Citations
Crossref
0

Pedagogical Influence of AI-Chatbots on Learning Outcomes: A Systematic Review

ai chatbots learning outcomes pedagogical influence systematic review

Mohamed Ali Elkot , Abdalilah Alhalangy , Mohammed AbdAlgane , Rabea Ali


...

In recent years, significant developments have occurred in AI-based chatbots that have been effectively deployed in the educational field. However, given the novelty of this technology, descriptive analyses remain scarce. Although many review studies have focused on the effectiveness of chatbots, they generally present broad results, and only a few have addressed the impact of this technology on learning outcomes. The present study examines the educational implications of AI chatbots on various learning outcomes through a post hoc analysis conducted in accordance with PRISMA principles. It aims to aggregate and analyze findings from studies that examined the use of chatbots and their impact on specific learning outcomes. A total of 26 studies were selected from a pool of 6,721 published between 2021 and 2024 and indexed in the Scopus and Web of Science databases. Data analysis was conducted using the Newcastle-Ottawa Scale (NOS) for Education. The results revealed that AI-chatbot technology has a positive influence on several learning outcomes, including academic achievement, motivation, self-assessment, engagement in learning, self-efficacy, and language learning, among others. The studies also detailed the methodologies and tools employed in these investigations. The study also offers insights into how intelligent chatbots can be leveraged to enhance various learning outcomes.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.527
Pages: 527-540
cloud_download 741
visibility 21552
2
Article Metrics
Views
741
Download
21552
Citations
Crossref
2

...

Vocational education plays a pivotal role in nurturing talent and supporting national development. However, challenges such as outdated talent development concepts, insufficient teacher training, and a lack of attention to soft skills cultivation from both schools and students have hindered the comprehensive development of secondary vocational students. This study aims to explore the direct effect of perceived teachers’ transformational leadership on the soft skills of 324 secondary vocational students in China and to examine the mediating role of students’ self-efficacy in this relationship. Using Structural Equation Modeling (SEM), the results show that teachers’ transformational leadership has a significant positive effect on students’ soft skills (β = 0.33, p < .01). Moreover, self-efficacy partially mediates this relationship (indirect effect β = 0.07, p < .05), accounting for 22.6% of the total effect. These findings suggest that teachers’ inspirational motivation, individualized consideration, and intellectual stimulation directly foster students’ communication, teamwork, and problem-solving skills, while also indirectly strengthening them by enhancing students’ confidence. Practically, the study underscores the need for teacher training in transformational leadership and for policy initiatives that integrate soft skills into vocational curricula.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.553
Pages: 553-568
cloud_download 645
visibility 5503
0
Article Metrics
Views
645
Download
5503
Citations
Crossref
0

...

This quasi-experimental study compares the differences in psychological well-being impact factors of school-based yoga interventions and mindfulness practices for at-risk Hispanic adolescent high school students with similar students enrolled in traditional physical education classes in a face-to-face setting. Convenience sampling was applied to freshmen students enrolled in a Physical Education 1-hour course at a designated high school in South Texas. A hypothesis model was utilized: mind-body awareness, self-regulation, and physical postures. To assess psychological wellbeing constructs of mood and affect, measurement instruments employed were two commonly utilized questionnaires, the Brunel Mood Scale (BRUMS) and Positive and Negative Affect Schedule (PANAS-C). Statistical analyses included Friedman’s Test for nonparametric data, comparisons of pre-post change scores between yoga and physical education classes, and longitudinal data trends for each measurement instrument’s subscales from inception to conclusion.  Overall, longitudinal trends in participant responses from Week 1 to Week 10 comparisons demonstrate a practical significance of gradual increases in improved student well-being in comparison to traditional physical education classes. Overall positive impacts continue to support overall improvement for students participating in Yoga as a form of physical fitness.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.1.1
Pages: 1-18
cloud_download 364
visibility 1629
0
Article Metrics
Views
364
Download
1629
Citations
Crossref
0

...

This study aimed to examine the impact of self-organization and self-efficacy in predicting attitudes toward cheating in online exams among undergraduate students. Drawing on the self-regulated learning framework, a cross-sectional survey design was employed to collect data from 153 students at a Saudi university using three validated scales. The findings revealed that self-organization and self-efficacy were significant negative predictors of attitudes toward cheating, with higher levels of these attributes associated with less favorable attitudes toward cheating. Furthermore, moderation analysis showed that self-efficacy significantly moderated the relationship between self-organization and cheating attitudes, suggesting a complex interplay between the two constructs. The findings highlight the importance of fostering self-regulated learning skills to enhance academic integrity in online assessment contexts.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.1.37
Pages: 37-49
cloud_download 300
visibility 3056
0
Article Metrics
Views
300
Download
3056
Citations
Crossref
0

...

The introduction of evolution in post-apartheid South Africa in 2008 presented significant challenges for teachers, due to both their own and their students' faith-based biases. This study investigates South African teachers' attitudes and understanding of evolution, utilizing Lemkian sociocultural theory and Vygotskian ZPD scaffolding. A mixed-methods approach was employed, including a Likert-scale questionnaire from 91 life science teachers and qualitative insights from open-ended questions. Results reveal a lack of enthusiasm for teaching evolution, influenced by personal religious beliefs and doubts about its scientific validity. Teachers often call for equal representation of evolution and creationism in classrooms. The preparation of teachers must address the stagnant discussion of evolution, while the life sciences curriculum emphasizes the Nature of Science, scientific literacy, and connections between science and society is compromised.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.1.67
Pages: 67-80
cloud_download 293
visibility 2716
0
Article Metrics
Views
293
Download
2716
Citations
Crossref
0

...

This study aims to address students' low mathematical problem-solving skills and self-regulated learning by developing website-based mathematics learning media using the problem-based learning model. Learning that integrates website-based media allows for more independent learning activities in solving mathematical problems. This study uses the ADDIE model to test the validity, practicality, and effectiveness of the product. Website-based media met the validity criteria based on expert assessments with an average score of 137 from subject matter experts and 78.5 from media experts, and the research instruments were declared valid with an Aiken index ranging from 0.9 to 0.99. Website-based media meet the criteria for practicality based on an average teacher assessment of 90.5, an average student assessment of 50.1, and a learning implementation rate of 93%. Website-based media are proven to be effective through four indicators: (1) students who pass exceed the threshold of 80%. (2) One sample t-test results p-value <.05 and t-value >1.69, so that H_0 is rejected. This proves that website-based mathematics learning media are effective in improving students' mathematical problem-solving skills and self-regulated learning. (3) The results of the paired sample t-test show p-value <.05 and t-value >1.69, so that H_0 is rejected. This proves that there is a significant improvement in students' mathematical problem-solving and self-regulated learning abilities after using website-based mathematical learning media. This study is able to facilitate students' problem-solving and self-regulated learning abilities simultaneously in mathematics education.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.2.81
Pages: 81-98
cloud_download 235
visibility 3005
0
Article Metrics
Views
235
Download
3005
Citations
Crossref
0

...

Team-based learning (TBL) is a popular form of collaborative learning designed to increase student engagement and motivate students to learn. A growing body of research, particularly in the health sciences, has demonstrated that TBL has positive impacts on student performance and classroom dynamics. However, much less is known about the student outcomes associated with TBL courses in undergraduate science, technology, engineering, and mathematics (STEM) education, fields in which active learning is especially important for student success and retention. To address this gap, we conducted a systematic review of the student outcomes associated with TBL in undergraduate STEM education. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method, we identified 55 empirical and qualitative research articles published between 2005 and 2024 that reported on TBL implementation practices and student outcomes. Importantly, we found that most studies described increased student performance and improved measures of classroom dynamics when TBL was compared to lecture-based teaching approaches. These findings provide further evidence that TBL is an effective instructional method and suggest that TBL can be implemented successfully across a wide range of student populations and undergraduate STEM disciplines.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.2.99
Pages: 99-117
cloud_download 517
visibility 3632
0
Article Metrics
Views
517
Download
3632
Citations
Crossref
0

...

Teacher-targeted victimization remains an under-integrated dimension of school violence research. This systematic review follows PRISMA 2020 guidelines and synthesizes 56 empirical studies (2015–2026) examining how teacher-targeted victimization is conceptualized and analyzed. The review maps patterns in geographic distribution, methodology, behavioral aggression forms, perpetrator framing, and the integration of institutional variables. Findings reveal the predominance of quantitative cross-sectional designs (75.9%). Physical (n = 28) and verbal aggression (n = 26) are the most frequently examined forms, with over half of the studies conceptualizing aggression as exclusively student-perpetrated. Institutional and governance variables remain limited: 84.8% of studies include no institutional variables beyond exposure or rely solely on general school climate indicators, while governance-level constructs appear in only one study. Drawing on Organizational Justice Theory and Institutional Theory, the review advances a Multilevel Institutional Accountability Model that conceptualizes teacher-directed aggression across behavioral exposure, institutional processing, and governance architecture. The findings highlight the need for greater integration of institutional and governance variables in future research.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.2.133
Pages: 133-148
cloud_download 254
visibility 2841
0
Article Metrics
Views
254
Download
2841
Citations
Crossref
0

...

Entrepreneurship education in higher education requires strategies that connect theory with practice. Although Project-Based Learning (PBL) is widely used, less is known about the educational value of interactive guides that support students throughout business-plan development. This study examined a Genially-based instructional guide, supplemented with YouTube multimedia, within a PBL intervention in the Business Innovation and Creativity course at Universidad Veracruzana. A quantitatively driven embedded mixed-methods, one-group pre–post design was used with 28 undergraduate students. Data came from course assessment records and pre- and post-intervention questionnaires. Quantitative analysis compared group-level response patterns across 23 conceptually aligned dichotomous items on self-reported entrepreneurship and business-planning knowledge, while open-ended responses explored students’ perceptions of the learning experience. Descriptive statistics and thematic analysis were conducted, and both strands were integrated during interpretation. Post-intervention affirmative-response percentages were higher for several conceptually aligned topics, although the response patterns varied across items and the anonymous responses could not be matched at the individual level. Students also rated the guide as highly useful (M = 9.81/10) and described it as providing organization, clarity, and step-by-step support. These findings suggest that the guide had potential educational value as a pedagogical scaffold in this course. However, because the study used a small, one-group design without linked responses or a comparison group, the results should be interpreted as context-specific descriptive evidence rather than as proof of causal effects on entrepreneurial competencies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.3.185
Pages: 185-203
cloud_download 80
visibility 302
0
Article Metrics
Views
80
Download
302
Citations
Crossref
0

...

Purpose: This study examined the influence of metacognitive awareness, epistemological beliefs, and mathematical resilience on university students’ perceived mathematical problem-solving ability and explored the cognitive and affective processes students employ when solving mathematical problems. Design/methodology/approach: An explanatory mixed-methods design was employed. Quantitative data were collected from 350 undergraduate Mathematics Education students at a public university in Ghana using a structured questionnaire and analyzed using exploratory factor analysis, confirmatory factor analysis, and structural equation modeling. Qualitative data were obtained from 10 purposively selected students and analysed thematically to provide further insight into students’ problem-solving processes. Findings: Metacognitive awareness (β = .247, p < .001) and epistemological beliefs (β = .273, p < .001) significantly predicted perceived mathematical problem-solving ability, whereas mathematical resilience did not significantly predict perceived mathematical problem-solving ability (β = .105, p = .163). The qualitative findings indicated that students engaged in problem interpretation and strategy planning, monitoring and evaluation, persistence and strategy adjustment, and experienced varied emotional responses during problem solving. Practical implications: Mathematics instruction should incorporate activities that strengthen students’ metacognitive regulation and productive epistemological beliefs while developing resilience alongside mathematical knowledge and problem-solving strategies. Originality/value: The study combines structural evidence on cognitive and epistemological predictors of mathematical problem-solving with qualitative accounts of students’ cognitive and affective experiences, providing a more comprehensive account of problem-solving among university mathematics education students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.3.205
Pages: 205-222
cloud_download 94
visibility 271
0
Article Metrics
Views
94
Download
271
Citations
Crossref
0

...

Binary classifications of teaching as transmission or constructivism obscure how participation, authority, knowledge practices, and conceptual work can vary within one lesson. This article introduces the social, procedural, epistemic, and conceptual (SPEC) framework for episode-level lesson analysis. SPEC was developed through a structured purposive theory synthesis rather than an exhaustive systematic review. A documented corpus of foundational traditions, observation systems, and targeted verification sources was compared using explicit inclusion, boundary, and disposition rules. Candidate constructs were assigned by observable target; three indicators per dimension were retained as a parsimonious authorial proposal; and qualitative descriptors were generated from theoretically warranted adjacent distinctions checked against cross-dimensional counterexamples. The dimensions are analytically distinguishable but potentially related. Their descriptor codes form non-additive, non-normative profiles rather than composite scores or judgments of teaching quality. An instructional episode is the primary unit; a hypothetical transcript illustrates indicator coding, opportunity/evidence flags, and rejection of nearby alternatives. SPEC is an initial conceptual proposal requiring operationalization, reliability examination, and validity testing. Ordering, thresholds, and cross-domain use require study before evaluative application.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.3.223
Pages: 223-240
cloud_download 78
visibility 304
0
Article Metrics
Views
78
Download
304
Citations
Crossref
0

...

School calendar decisions in rural districts are shaped by staffing challenges, financial pressures, and community needs, yet research on the four-day school week (4DSW) has focused primarily on student achievement. This cross-sectional study used parallel surveys of Missouri principals—94 in 4DSW districts and 70 in five-day school week (5DSW) districts, to examine principals’ self-reported perceptions of schedule-related motivations, professional time use, and stakeholder satisfaction. In Missouri, 192 of the state’s 516 public school districts—about 37%, almost all of them rural, operated on a four-day calendar in 2026–2027, up from 34 in 2018–2019. Mann–Whitney U analyses indicated that principals in 4DSW districts more often rated teacher recruitment and retention, operating costs, and family scheduling as important considerations, whereas principals in 5DSW districts placed greater emphasis on student recruitment and academic performance; several of these differences were attenuated after correction for multiple comparisons. Principals in 4DSW districts also reported more weekly time devoted to professional development, planning, and mentoring, with the fifth day frequently used for adult collaboration. No statistically significant differences were detected between groups in the proportion of principals reporting any weekly time for services to English Learners, gifted and talented students, or students receiving special education. Principals in 4DSW districts reported consistently high perceived satisfaction with the schedule. Because the design is cross-sectional and all measures reflect principal reports, the findings describe associations rather than effects of the calendar. The results suggest that rural districts often view the 4DSW through a broader organizational and workforce lens than achievement-focused research typically reflects.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.3.241
Pages: 241-257
cloud_download 69
visibility 230
0
Article Metrics
Views
69
Download
230
Citations
Crossref
0

...