logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK

'co design' Search Results

...

Although regression to the mean is pervasive in data analysis, educational researchers often misconstrue it as evidence of genuine change and mistakenly attribute random changes to treatment effects. A statistical phenomenon where extreme values naturally move closer to the average after repeated treatment, regression to the mean is especially susceptible to misinterpretations in educational studies with pretest-posttest or longitudinal designs. In such studies, observed changes are frequently assumed to be the effects of treatment, even in cases where the changes are statistical artifacts. Using a hypothetical case and two real-world studies, this paper investigates the technical challenges that regression to the mean poses and introduces a hybrid Bayesian model that mitigates its effects more effectively than conventional approaches, such as multiple baseline adjustments and formulaic corrections. In particular, the hybrid Bayesian model relies on multiple baseline measurements to minimize distortions associated with regression to the mean during the pretest phase and leverages prior knowledge—such as standard deviations and population means—to refine post-test data adjustments. It follows that the model provides educational researchers with an innovative tool for accurately evaluating interventions and enhancing the effectiveness of various research-driven educational policies and practices.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.1.17
Pages: 17-25
cloud_download 270
visibility 2107
0
Article Metrics
Views
270
Download
2107
Citations
Crossref
0

Simplification and Empirical Verification of Learning Styles Index for Indonesian Students

engineering learning style index short form verification indonesia

Niko Siameva Uletika , Budi Hartono , Titis Wijayanto


...

This article investigates the adoption, simplification, and usage recommendations of the Indonesian Index of Learning Style Short Form (ILS-SF). The aim is to refine the initial Indonesian ILS, compare the suitability between engineering/non-engineering and high school/university, and assess their learning styles. The participants were 678 students (413 females), with an average age of 19.4±1.92 years. The methods used in this study were adopting the existing Indonesian version of ILS, simplifying–reducing the number of items, empirical verification (validity and reliability), and Indonesia data assessment. The results show that the original ILS could be simplified without sacrificing the quality of the model. On the contrary, validity and reliability measures have increased. Confirmatory Factor Analysis (CFA) supports a reduction from 44 to 15 items. It confirms the validity with favorable indices such as CFI (0.972), TLI (0.966), RMSEA (0.021), SRMR (0.049), and GFI (0.999)—Active-Reflective Cronbach's alpha at 0.507, Sensing-Intuitive at 0.590, and Visual-Verbal at 0.553. Indonesian ILS-SF is faster, simpler, more suitable for engineering than non-engineering, and more ideal for undergraduate than high school students. The analysis revealed that sensory (40.2%), active (18%), and visual (10.2%) preferences dominate among Indonesian students. This study highlights assessment tools tailored to diverse educational contexts.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.1.43
Pages: 43-61
cloud_download 327
visibility 1553
0
Article Metrics
Views
327
Download
1553
Citations
Crossref
0

...

The process e-portfolio is a type of e-portfolio that helps students construct knowledge and familiarise themselves with their learning process through self-and peer assessment. Lecturers and students experienced difficulties when using the e-portfolio because Mahara 2019 was not updated. This qualitative research study proposes how lecturers should design e-portfolios for learning through formative assessment activities. Interpretivism was the researcher's standpoint, aiming to interpret how the study participants used e-portfolios for teaching and learning through formative assessment activities. This exploratory case study used semi-structured interviews and an e-portfolio checklist for data collection. It explored the use of the e-portfolio for formative assessment through the experiences of ten purposefully sampled lecturers. The findings suggest that an e-portfolio facilitates teaching and learning in open distance e-learning because it enables online delivery of the content and administering of assessments that afford students' learning of the module content through completing formative assessment activities. The e-portfolio facilitates co-teaching and co-learning because students become knowledge creators and active users instead of passive learners. This study recommends the use of process e-portfolios to facilitate assessment and learning in open-distance e-learning institutions.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.1.63
Pages: 63-79
cloud_download 282
visibility 3756
0
Article Metrics
Views
282
Download
3756
Citations
Crossref
0

...

Recent studies identified that faculty research productivity increased when they felt competent in conducting research. Faculty level of research competency varies due to academic training, context, country, discipline, and experiences; however, what is faculty research competency? The core competencies of faculty research are unclear; thus, the current study systematically reviewed the literature. Researchers used Boolean searches of four popular databases to identify 553 articles for first-level screening. These yielded 46 peer-reviewed journal articles for full-text analysis, six of which focused on faculty populations (40 on non-faculty). Six core components of faculty research proficiency were identified: finding and reviewing literature, planning a study, collecting and analyzing data, writing research, disseminating research findings, and managing research projects. Compared to non-faculty populations, faculty are uniquely more engaged in research project management. Researchers also identified 18 sub-competencies that will help to measure faculty research competency more reliably in the future. Finally, as the identified studies relied on self-reported measurements that may carry self-representation bias, an aspirational implication is to develop a competency-based diagnostic test for measuring faculty research competence.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.1.81
Pages: 81-95
cloud_download 289
visibility 1779
0
Article Metrics
Views
289
Download
1779
Citations
Crossref
0

...

This scoping review comprehensively explores how artificial intelligence (AI) is being incorporated into accounting education, examining the evolving educational setting and its potentially transformative impact on the development of future accounting professionals. Following the Arksey and O'Malley (2005) methodology and PRISMA-ScR guidelines (Tricco et al., 2018), this review synthesizes systematically a diverse set of academic literature to determine major trends, new opportunities, and long-standing challenges of integrating AI into accounting pedagogical practices. Key findings demonstrate AI's transformative potential in enhancing student engagement, fostering deeper learning, aligning educational curricula with contemporary industry demands, and improving teaching efficiency through innovative tools and techniques. However, substantial challenges persist, including faculty preparedness, the complexity of curriculum redesign, resistance to change, and critical ethical considerations surrounding the use of AI in education. These findings emphasize the multifaceted nature of integrating AI into accounting pedagogy. The review emphasizes the need for cooperation between academia, industry practitioners, and policymakers to develop adaptive, forward-thinking pedagogical strategies and establish robust ethical frameworks. These efforts are essential to improve learners with the skills and competencies required to thrive in a dynamic, technology-driven professional environment.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.1.113
Pages: 113-125
cloud_download 733
visibility 3861
0
Article Metrics
Views
733
Download
3861
Citations
Crossref
0

...

This study examines the impact of digital tools on fraction comprehension among 5th-grade students with learning difficulties in mathematics. It assesses the effectiveness of three teaching methods: educational software, video tutorials, and their combination. The research involved 252 students from 8 state-funded elementary schools, employing a quantitative experimental design with pre- and post-test assessments. Grounded in Constructivist Learning Theory and Technological Pedagogical Content Knowledge (TPACK), this research explored how technology can enhance mathematical understanding. Results indicated that the combined method achieved the highest improvement (58%, p < .001, Cohen’s d = 3.03), significantly outperforming educational software alone (33%, p = .015, Cohen’s d = 2.52) and video tutorials alone (7%, p = .987, Cohen’s d = 0.14). These findings highlight the substantial benefits of integrating diverse digital tools to effectively support mathematics learning among students facing additional educational challenges.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.2.127
Pages: 127-141
cloud_download 269
visibility 1647
0
Article Metrics
Views
269
Download
1647
Citations
Crossref
0

Diversity of Students and Their Needs: What do Teachers Face in Their Professional Development?

educational needs diversity equity inclusive education teacher professional development

Ana Torres-Soto Abraham , Bernárdez-Gómez , Mª Luisa García Hernández , Martína Ares-Ferreirós


...

In recent decades, the work of teachers has been carried out in classrooms characterised by a high degree of diversity, necessitating the provision of pedagogical responses that promote the inclusion of students. This article is derived from the research, development and innovation (R+D+I) project 'Intergenerational Professional Development in Education Implications for the Professional Initiation of Teachers (DePrInED) and aims to analyse how teachers at compulsory education recognise, characterise and conceptualise the diversity and needs of students. A mixed methodological approach was employed, with information collected through focus groups and interviews with a total sample of 147 teachers from different educational levels (young, senior and retired). Thematic analysis, combined with a comparative analysis, was employed to analyse the data using ATLAS.ti software. The main categories analysed dealt with students' needs and their own diversity. The study's primary findings suggest that, in comparison to their retired counterparts, both young and veteran teachers make greater reference to the diversity and needs of students, and emphasise the scarcity of resources and support to effectively address the diversity of students in the classroom. Experienced teachers are found to make more frequent references to diversity and students' needs, while retired teachers make these references less often. This finding assumes particular significance in light of the paucity of studies that adopt a generational perspective to analyse how teachers perceive diversity.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.2.159
Pages: 159-172
cloud_download 264
visibility 1815
2
Article Metrics
Views
264
Download
1815
Citations
Crossref
2

...

There are studies in the learning management literature examining the measure of system usage, but few explore how users apply the software tools to achieve specific work tasks, which in turn leads to perceived benefits. In the context of distance education, this study focuses on how Learning Management Systems (LMS) are fully used by faculty for their instructional needs. It extends existing research on LMS adoption by investigating how faculty members or instructors use the LMS tools for effective class teaching to achieve educational outcomes. Four usage patterns were identified: communication, content management, assessment, and class management. A model is presented to examine how these usage patterns interplay to achieve the perceived benefits. Data were collected from 544 instructors using LMS, such as Blackboard Learn, etc. Structural equation modeling using LISREL was employed to assess the research model. The results suggest that the usage for communication, content, and assessment activities positively impacts the usage for class management. In turn, the usage for class management influences the net benefits perceived by the instructors, and the usage for content also impacts perceived net benefits directly. These results provide practical guidelines for LMS developers’ design improvements and institutions’ policies, such as training instructors to fully utilize LMS features to achieve the maximum benefits of distance education.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.2.217
Pages: 217-231
cloud_download 198
visibility 2085
0
Article Metrics
Views
198
Download
2085
Citations
Crossref
0

...

Ensuring the trustworthiness of qualitative research remains a critical challenge in educational research. However, early career researchers often lack structured guidance on enhancing the credibility of qualitative data analysis. A key issue is the limited discussion on inductive approaches that support systematic theme generation and theory development. To address this gap, this study examines how two early-career researchers employed a three-level inductive methodology during their PhD studies to strengthen the trustworthiness of their findings. Using an autoethnographic approach, the study finds that this methodology deepened their understanding of participants’ experiences, facilitated the emergence of valid themes, and reinforced credibility, transferability, dependability, and confirmability. These findings offer concrete strategies for researchers undertaking similar approaches to ensure trustworthiness in their qualitative inquiry. This study also highlights the importance of equipping PhD researchers in education with strategies to navigate qualitative research rigorously, ultimately enhancing the quality of their studies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.2.233
Pages: 233-244
cloud_download 344
visibility 4738
2
Article Metrics
Views
344
Download
4738
Citations
Crossref
2

Evaluating Picturebook Complexity Through Children’s Eye Movement and Miscue Analysis

eye movements miscue analysis picturebooks primary school

Salma Alruthaya , Jessica Mantei , Sonia L. J. White , Lisa Kervin


...

This paper explores the potential of Eye Movement Miscue Analysis (EMMA) as a method to evaluate the complexity of picturebooks as reading material for primary school children. While EMMA has been applied to examine reading processes and strategies, this paper reports on the first study using EMMA to examine classroom picturebook complexity and its implications for developing readers. This research found EMMA method revealed specific nuances for understanding children’s reading practices in response to the complexity of the text at hand. Drawing together an internationally established reading teaching resource, the text complexity guide (Pinnell & Fountas, 2007) with miscue analysis reading assessment and eye movement technology, this research sought to gain insights into potential areas of complexity or challenge in picturebooks commonly available in Australian school libraries and classrooms. The method shared here examines text complexity ratings, children’s reading performance, and eye movements, as they read in natural classroom settings. Analysis of children’s reading miscues revealed that readers encountered challenges not anticipated through the use of the text complexity guide. Argued in this paper is that EMMA methodologies could extend understandings about text complexity beyond established frameworks and hence guide future assessments.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.297
Pages: 297-316
cloud_download 156
visibility 1202
0
Article Metrics
Views
156
Download
1202
Citations
Crossref
0

...

This study delved into Terry Borton’s reflective model and 7E instructional model to produce comprehensive and guided tools that fit as observation and reflective tools for enhancing learners’ engagement and outcomes in Mathematics lessons. The aim was to gather insights that can inform strategies to adapt Borton’s model to produce tools to be used to observe and analyse 7E model-based Mathematics lessons to contribute to improved student outcomes. Literature information was used to explore, analyse, and synthesise the study’s related existing theories and models to provide a deeper understanding of constraints and prompt question descriptors to produce 21st-century tools to observe and reflect on a Mathematics lesson. After comparing different prompt question descriptors from different literature and Borton’s model, concise descriptors were retained for educational purposes to be analysed, considering the 7E model phases, to produce the guided tools. As a result, two products. “Classroom Observation-Guided Tool”, which includes a guided tool table with a last column for the observer to write comments during class. This column is used to identify gaps in student engagement and learning practices across the 7E phases, which may have been misused. The “Post-Lesson Discussion Guided Tool”, to make a positive post-lesson discussion session, enabling teachers to identify areas for improvement in student engagement to achieve better outcomes next time. Other researchers can study the applicability of 21st-century observation and reflection-guided tools to other subjects, exploring their long-term impact on teacher professional development to improve overall student achievement across all school subjects.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.317
Pages: 317-333
cloud_download 238
visibility 2997
0
Article Metrics
Views
238
Download
2997
Citations
Crossref
0

...

The personalization of learning and teaching processes represents an advanced approach to education that adapts content, pace, and teaching methods to the individual needs and preferences of students. This approach relies on analyzing diverse student characteristics, such as their knowledge level, progress, learning style, and interests. Achieving these goals is significantly supported by the use of information and communication technology, which facilitates and enhances the implementation of personalization in technology-enhanced learning (TEL). The primary objective of personalization is to increase student engagement, motivation, and support in achieving learning outcomes through individualized learning paths, real-time progress tracking, and feedback. This systematic literature review examines existing personalization approaches in secondary and higher education, supported by technology. The study investigates their effectiveness and provides recommendations for future research. Results reveal that personalized teaching methods—primarily through recommender systems, adaptive learning platforms, and algorithm-driven models—are effective in tailoring educational experiences by leveraging diverse student data, such as demographics, prior achievements, learning styles, and digital engagement. The review shows a predominant focus on higher education, particularly in subjects related to computer science and digital technologies. Quantitative evaluations complemented by qualitative insights, consistently indicate that personalization enhances content mastery, motivation, and overall satisfaction, with no significant negative effects identified.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.359
Pages: 359-375
cloud_download 226
visibility 2924
0
Article Metrics
Views
226
Download
2924
Citations
Crossref
0

...

This study aimed to develop and validate a comprehensive core competency assessment instrument specifically designed for undergraduate students at a research-focused university. Despite growing emphasis on competency-based education (CBE), there are limited psychometrically sound tools tailored to evaluate students’ level of core competencies in research-intensive universities. The current study proceeded in three phases: (a) development of a conceptual framework comprising six core competencies: Integrated Thinking, Knowledge Inquiry, Creative Integration, Global Citizenship, Communication & Collaboration, and Self-Management; (b) item generation and expert validation; and (c) validation through exploratory and confirmatory factor analyses. The final instrument included 77 items across the six competencies. CFA confirmed adequate model fit (CFI = .934–.957; RMSEA = .057–.088). The results showed that the validated instrument can provide a reliable and comprehensive assessment for students' core competencies in research-oriented university settings. This instrument can provide guidelines for developing competency-based education (CBE) curricula in higher education, as well as criteria for evaluating and refining existing CBE programs. This instrument functions as both a psychometrically robust assessment tool and a practical guide for institutional enhancement. It enables precise measurement of students’ core competencies, offering evidence that can inform curriculum design, academic advising, and policy development. In addition, the validated framework lays a strong groundwork for future research to investigate the long-term effects of competency-based education on student achievement, career readiness, and personal development across various higher education settings.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.391
Pages: 391-401
cloud_download 196
visibility 930
0
Article Metrics
Views
196
Download
930
Citations
Crossref
0

...

Educational researchers, as well as researchers in other disciplines, often work with ordinal data, such as Likert item responses and test item scores. Critical questions arise when researchers attempt to implement statistical models to analyse ordinal data, given that many statistical techniques assume the data analysed to be continuous. Could ordinal data be treated as continuous data, that is, assuming the ordinal data to be continuous and then applying statistical techniques as if analysing continuous data? Why and why not? Focusing on structural equation models (SEMs), particularly confirmatory factor analysis (CFA), this article discusses an ongoing debate on the treatment of ordinal data and reports a short review on the practices of conducting and reporting SEMs, in the context of mathematics education research. The author reviewed 70 publications in mathematics education research that reported a study involving SEMs to analyse ordinal data, but less than half discussed how data were treated or guided readers through the analysis; it is therefore harder to repeat such an analysis and evaluate the results. This article invites methodological discussions on SEMs with ordinal variables in the practices of educational research. Subsequently, a standard for reporting SEMs with ordinal data is proposed, followed by an example. This standard contributes to educational research by enabling researchers (self and others) to evaluate SEMs reported. The example demonstrates, using real-life research data, how two different approaches for analysing ordinal data (as continuous or as a product of discretisation from some continuous distributions) can lead to results that disagree.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.423
Pages: 423-442
cloud_download 415
visibility 1654
0
Article Metrics
Views
415
Download
1654
Citations
Crossref
0

A Descriptive Study on the Effects of Modality and Covid-19 on Academic Performance by Demographic Groups

covid-19 grades hybrid online teaching modalities

Douglas R. Moodie , Alison Keefe , Robin A. Cheramie


...

Analysis of student grades and demographic data to understand the effects of modality and Covid-19 on academic performance is important for universities to understand the impact these factors may have on course grades. This study analyzes all the 615,964 complete undergraduate student-course records from Kennesaw State University (KSU) spanning from 2015 to 2024 to examine the impact of course modality and the Covid-19 pandemic on academic performance. The population dataset includes student demographics (e.g., sex, age, ethnicity), prior GPA, and course characteristics (e.g., department, modality). Descriptive statistics and trend analyses were employed to evaluate grade outcomes across in-person, online, and hybrid modalities over the 9-year period. Results indicate a temporary increase in mean course grades during the Covid-19 period, followed by a return to the pre-pandemic upward trend. Hybrid courses consistently exhibited the highest mean grades throughout the study period. However, consistent patterns across modalities, demographics, and academic units suggest that these factors have limited influence on grade outcomes. These findings raise questions about the reliability of GPA and course grades as indicators of learning success across different instructional contexts and student populations.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.443
Pages: 443-465
cloud_download 157
visibility 793
0
Article Metrics
Views
157
Download
793
Citations
Crossref
0

...

Despite progress made in recent years, women continue to be underrepresented in academic publishing. We aim to share insights from academic women researchers who participated in the Training Needs Assessment for developing their writing for publication skills in an Open Distance Learning institution in South Africa. The research questions that guided the study were: a) What specific challenges do academic women researchers face in developing research and publishing skills? b) What motivated academic women researchers to participate in a writing project? c) What type of support do academic women researchers identify as essential for advancing their research and publishing skills? The data were collected through an initial face-to-face meeting, followed by a Training Needs Assessment from eight purposively chosen participants in a case study design. The findings indicate participants’ challenges of time constraints, lack of confidence, and knowledge as obstacles that hindered their publishing. Despite their challenges, women researchers reported their motivation to participate in the writing project for career advancement, personal development, academic recognition, and their inspiration to publish their research work. The study found that women researchers required writing support, peer collaboration, mentorship, and institutional support to improve their writing for publishing skills. Supporting academic women researchers with focused training, engaging them in collaborative networks, and developing gender-sensitive policies is crucial for promoting equity, breaking down barriers, and ensuring their academic and professional success.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.467
Pages: 467-477
cloud_download 160
visibility 417
0
Article Metrics
Views
160
Download
417
Citations
Crossref
0

The Charismatic Lecturer’s Voice: Explainable Machine Learning Models

machine learning model charisma lecturer&#039;s voice

Tal Katz-Navon , Vered Aharonson , Aviad Malachi


...

This study applies explainable machine learning to identify which vocal attributes in a lecturer’s speech influence students’ views of a lecturer’s charisma, a key contributor to teaching quality. It further explores whether vocal qualities differ between male and female lecturers and how students of different genders respond to these differences, offering insights into voice-related factors that influence the impact of educators. Speech segments from YouTube videos featuring 200 native-English lecturers were evaluated by 900 students using charisma rating scales. A set of attributes related to three primary prosodic dimensions of voice - pitch, rhythm, and loudness - was computed. A random forest classifier was employed to predict the charisma level based on the speech attributes and to list and rank the attributes that contributed most to the prediction. The findings revealed prominent vocal attributes that achieved higher charisma scores in the students' ratings. Same-gender evaluations of charisma were mainly based on pitch, while cross-gender evaluations rely mostly on loudness or rhythm. The automated, interpretable method provides a reliable and efficient way to measure vocal charisma in academic lecturers. It can be adapted to examine additional individual factors that influence the perception of a lecturer’s charismatic presence. It may also be integrated into practice-based tools, designed to support instructors in improving their presentation skills. Our research bridges the fields of applied psychology and computer science to contribute to the development of educational technology.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.479
Pages: 479-493
cloud_download 134
visibility 1603
0
Article Metrics
Views
134
Download
1603
Citations
Crossref
0

...

Within the context of investigating belief systems, this work exemplifies a mixed-method approach. Two approaches are utilized to explore the philosophical, ontological, and epistemological assumptions that university students foster regarding the relationships between knowledge and reality. In the first step, written materials that elaborated on the matter at hand were subjected to content analysis with the assistance of Leximancer, a software that recognizes themes and concepts and turns textual data into concept maps that express networks of meaning. The second step involved conducting a cluster analysis on the data obtained from the questionnaire to identify distinct groups of participants who shared consistent epistemological viewpoints. The results obtained from the two approaches are in agreement and shed light on the prevalent epistemic inclination that favors a constructivist viewpoint. Discussion on the ramifications of the findings, as well as the methodological issues that are pertinent to the present illustration, is provided.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.495
Pages: 495-512
cloud_download 146
visibility 586
0
Article Metrics
Views
146
Download
586
Citations
Crossref
0

...

These days, many schools are reviewing their curricula, and Science, Technology, Engineering, Arts, and Mathematics (STEAM) education is one area where these changes are being applied. Because STEAM education integrates five subjects, it requires an approach in which teachers from these subjects work collaboratively. However, applying traditional assessment methods in STEAM education is challenging, as it requires teachers to jointly decide on appropriate assessment strategies. At present, no clear framework exists to support this process. This study examined the potential of the ordinal priority approach (OPA), a recently introduced method for multi-criteria decision-making, to facilitate teachers’ collaborative selection of assessment methods for STEAM education. It further explored the extent to which subject differences affect collaboration by comparing the decision-making of two groups: a homogeneous group (teachers of the same subject) and a heterogeneous group (teachers of different subjects). Pre- and post-questionnaires were administered to both groups to determine how the OPA can assist teachers in jointly developing a STEAM assessment method. Analyses of the responses identified differences in each group’s consensus-building process. The study revealed three key contributions of OPA to teacher collaboration in STEAM education: 1) it ensures that teachers from diverse subjects have their opinions considered; 2) its transparent decision-making process helps mitigate distrust during discussions; and 3) it promotes fair decision-making, unaffected by social power differences within the group. Based on these findings, OPA appears effective in converging diverse expert opinions through a clear decision-making process.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.513
Pages: 513-525
cloud_download 128
visibility 532
0
Article Metrics
Views
128
Download
532
Citations
Crossref
0

Pedagogical Influence of AI-Chatbots on Learning Outcomes: A Systematic Review

ai chatbots learning outcomes pedagogical influence systematic review

Mohamed Ali Elkot , Abdalilah Alhalangy , Mohammed AbdAlgane , Rabea Ali


...

In recent years, significant developments have occurred in AI-based chatbots that have been effectively deployed in the educational field. However, given the novelty of this technology, descriptive analyses remain scarce. Although many review studies have focused on the effectiveness of chatbots, they generally present broad results, and only a few have addressed the impact of this technology on learning outcomes. The present study examines the educational implications of AI chatbots on various learning outcomes through a post hoc analysis conducted in accordance with PRISMA principles. It aims to aggregate and analyze findings from studies that examined the use of chatbots and their impact on specific learning outcomes. A total of 26 studies were selected from a pool of 6,721 published between 2021 and 2024 and indexed in the Scopus and Web of Science databases. Data analysis was conducted using the Newcastle-Ottawa Scale (NOS) for Education. The results revealed that AI-chatbot technology has a positive influence on several learning outcomes, including academic achievement, motivation, self-assessment, engagement in learning, self-efficacy, and language learning, among others. The studies also detailed the methodologies and tools employed in these investigations. The study also offers insights into how intelligent chatbots can be leveraged to enhance various learning outcomes.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.527
Pages: 527-540
cloud_download 158
visibility 3494
0
Article Metrics
Views
158
Download
3494
Citations
Crossref
0

...