logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK
RHAPSODE
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, HA4 7AE, UK

'scale development' Search Results

Multidimensional Analysis of Conceptual Understanding of Integer Addition and Subtraction

assessment conceptual understanding integers secondary school spur approach

Adriana Toxtle-Colotl , Eldon Nieto-Ruiz , José Antonio Juárez-López


...

The objective of this study is to analyze secondary school students' conceptual understanding of integer addition and subtraction. To achieve this, a test based on the multidimensional assessment approach Skills, Properties, Uses, and Representations (SPUR) was administered to 34 secondary school students selected through convenience sampling at a secondary school in Puebla, Mexico. The study employs a qualitative research methodology at a descriptive depth level. The analysis of student responses utilized basic descriptive statistics and the qualitative content analysis technique. Significant differences were found in the accuracy levels across the SPUR dimensions: skills (51.8%), properties (41.9%), uses (60.8%), and representations (20.6%). Students with a solid conceptual understanding of integer addition and subtraction demonstrated high accuracy levels in at least three dimensions. The main difficulties identified were the use of the negative sign and challenges in adding two negative integers. The SPUR approach is a viable alternative for multidimensionally analyzing and assessing conceptual understanding of integer addition and subtraction.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.1.97
Pages: 97-112
cloud_download 568
visibility 4489
2
Article Metrics
Views
568
Download
4489
Citations
Crossref
2

...

Developing efficient and reliable tools for assessing early mathematical skills remains a critical priority in educational research. This study aimed to develop and validate a brief version of the Prueba Uruguaya de Matemática (Uruguayan Mathematics Test, PUMa), a digital tool to assess mathematical abilities in children aged 5 to 6. The original test included 144 items covering both symbolic (66%) and non-symbolic (34%) tasks, such as approximate number system, counting, numerical ordering (forward and backward), math fluency, composition and decomposition of numbers, and transcoding auditory-verbal stimuli into Arabic-visual symbols. Unlike most existing tools that require individual administration by trained professionals and lack cultural adaptation for Latin American contexts, PUMa is self-administered, culturally grounded, and suitable for large-scale assessments using tablets. Using a sample of 443 participants and applying parametric and non-parametric models within the framework of Item Response Theory (IRT), along with correlations with TEMA-3, preliminary evidence was generated showing that the brief version retained precision and validity. The resulting shortened tests included 69 and 73 items for the parametric and non-parametric versions, yielding a balanced representation of symbolic (56%) and non-symbolic (44%) tasks. Despite item reduction, ability scores remained highly correlated between original and brief versions (r > .90), and both brief versions demonstrated strong internal consistency (α = .94). PUMa improves upon existing assessments by combining cultural relevance, group-based digital administration, and real-time data collection, offering a scalable solution for early identification and intervention. These features support personalized educational strategies that foster cognitive and academic development from the earliest stages.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.2.245
Pages: 245-266
cloud_download 461
visibility 3297
2
Article Metrics
Views
461
Download
3297
Citations
Crossref
2

...

This study delved into Terry Borton’s reflective model and 7E instructional model to produce comprehensive and guided tools that fit as observation and reflective tools for enhancing learners’ engagement and outcomes in Mathematics lessons. The aim was to gather insights that can inform strategies to adapt Borton’s model to produce tools to be used to observe and analyse 7E model-based Mathematics lessons to contribute to improved student outcomes. Literature information was used to explore, analyse, and synthesise the study’s related existing theories and models to provide a deeper understanding of constraints and prompt question descriptors to produce 21st-century tools to observe and reflect on a Mathematics lesson. After comparing different prompt question descriptors from different literature and Borton’s model, concise descriptors were retained for educational purposes to be analysed, considering the 7E model phases, to produce the guided tools. As a result, two products. “Classroom Observation-Guided Tool”, which includes a guided tool table with a last column for the observer to write comments during class. This column is used to identify gaps in student engagement and learning practices across the 7E phases, which may have been misused. The “Post-Lesson Discussion Guided Tool”, to make a positive post-lesson discussion session, enabling teachers to identify areas for improvement in student engagement to achieve better outcomes next time. Other researchers can study the applicability of 21st-century observation and reflection-guided tools to other subjects, exploring their long-term impact on teacher professional development to improve overall student achievement across all school subjects.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.317
Pages: 317-333
cloud_download 621
visibility 8563
2
Article Metrics
Views
621
Download
8563
Citations
Crossref
2

...

Self-report surveys are extensively utilized in educational research to understand students’ perceptions and experiences. However, younger children, particularly those in elementary school, may exhibit a tendency to provide socially desirable responses, potentially compromising the data quality. This study examined the prevalence and impact of socially desirable responses in self-report surveys administered to elementary school students. A total of 1,024 students from grades 4 and 5 in five elementary schools participated in the study. Socially desirable responses were measured using detection items embedded within questionnaires. The findings indicate that (a) more than 20% of elementary school students demonstrated socially desirable responses; (b) female students and those with higher academic achievement were more likely to provide socially desirable responses; (c) socially desirable responses skewed the sample distribution by inflating mean scores and reducing standard deviations; and (d) while internal correlations within scales remained relatively stable, external validity, as reflected in correlations between self-reports and academic performance metrics, was significantly affected after adjusting for socially desirable responses. These results underscore the importance of addressing socially desirable responses when interpreting self-report data from young students. The study concludes with practical recommendations for improving the validity of self-report surveys in educational research.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.351
Pages: 349-357
cloud_download 559
visibility 8402
7
Article Metrics
Views
559
Download
8402
Citations
Crossref
7

...

The personalization of learning and teaching processes represents an advanced approach to education that adapts content, pace, and teaching methods to the individual needs and preferences of students. This approach relies on analyzing diverse student characteristics, such as their knowledge level, progress, learning style, and interests. Achieving these goals is significantly supported by the use of information and communication technology, which facilitates and enhances the implementation of personalization in technology-enhanced learning (TEL). The primary objective of personalization is to increase student engagement, motivation, and support in achieving learning outcomes through individualized learning paths, real-time progress tracking, and feedback. This systematic literature review examines existing personalization approaches in secondary and higher education, supported by technology. The study investigates their effectiveness and provides recommendations for future research. Results reveal that personalized teaching methods—primarily through recommender systems, adaptive learning platforms, and algorithm-driven models—are effective in tailoring educational experiences by leveraging diverse student data, such as demographics, prior achievements, learning styles, and digital engagement. The review shows a predominant focus on higher education, particularly in subjects related to computer science and digital technologies. Quantitative evaluations complemented by qualitative insights, consistently indicate that personalization enhances content mastery, motivation, and overall satisfaction, with no significant negative effects identified.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.359
Pages: 359-375
cloud_download 583
visibility 9967
2
Article Metrics
Views
583
Download
9967
Citations
Crossref
2

...

This study aimed to develop and validate a comprehensive core competency assessment instrument specifically designed for undergraduate students at a research-focused university. Despite growing emphasis on competency-based education (CBE), there are limited psychometrically sound tools tailored to evaluate students’ level of core competencies in research-intensive universities. The current study proceeded in three phases: (a) development of a conceptual framework comprising six core competencies: Integrated Thinking, Knowledge Inquiry, Creative Integration, Global Citizenship, Communication & Collaboration, and Self-Management; (b) item generation and expert validation; and (c) validation through exploratory and confirmatory factor analyses. The final instrument included 77 items across the six competencies. CFA confirmed adequate model fit (CFI = .934–.957; RMSEA = .057–.088). The results showed that the validated instrument can provide a reliable and comprehensive assessment for students' core competencies in research-oriented university settings. This instrument can provide guidelines for developing competency-based education (CBE) curricula in higher education, as well as criteria for evaluating and refining existing CBE programs. This instrument functions as both a psychometrically robust assessment tool and a practical guide for institutional enhancement. It enables precise measurement of students’ core competencies, offering evidence that can inform curriculum design, academic advising, and policy development. In addition, the validated framework lays a strong groundwork for future research to investigate the long-term effects of competency-based education on student achievement, career readiness, and personal development across various higher education settings.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.3.391
Pages: 391-401
cloud_download 492
visibility 3632
0
Article Metrics
Views
492
Download
3632
Citations
Crossref
0

...

Despite progress made in recent years, women continue to be underrepresented in academic publishing. We aim to share insights from academic women researchers who participated in the Training Needs Assessment for developing their writing for publication skills in an Open Distance Learning institution in South Africa. The research questions that guided the study were: a) What specific challenges do academic women researchers face in developing research and publishing skills? b) What motivated academic women researchers to participate in a writing project? c) What type of support do academic women researchers identify as essential for advancing their research and publishing skills? The data were collected through an initial face-to-face meeting, followed by a Training Needs Assessment from eight purposively chosen participants in a case study design. The findings indicate participants’ challenges of time constraints, lack of confidence, and knowledge as obstacles that hindered their publishing. Despite their challenges, women researchers reported their motivation to participate in the writing project for career advancement, personal development, academic recognition, and their inspiration to publish their research work. The study found that women researchers required writing support, peer collaboration, mentorship, and institutional support to improve their writing for publishing skills. Supporting academic women researchers with focused training, engaging them in collaborative networks, and developing gender-sensitive policies is crucial for promoting equity, breaking down barriers, and ensuring their academic and professional success.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.467
Pages: 467-477
cloud_download 533
visibility 2648
0
Article Metrics
Views
533
Download
2648
Citations
Crossref
0

The Charismatic Lecturer’s Voice: Explainable Machine Learning Models

machine learning model charisma lecturer's voice

Tal Katz-Navon , Vered Aharonson , Aviad Malachi


...

This study applies explainable machine learning to identify which vocal attributes in a lecturer’s speech influence students’ views of a lecturer’s charisma, a key contributor to teaching quality. It further explores whether vocal qualities differ between male and female lecturers and how students of different genders respond to these differences, offering insights into voice-related factors that influence the impact of educators. Speech segments from YouTube videos featuring 200 native-English lecturers were evaluated by 900 students using charisma rating scales. A set of attributes related to three primary prosodic dimensions of voice - pitch, rhythm, and loudness - was computed. A random forest classifier was employed to predict the charisma level based on the speech attributes and to list and rank the attributes that contributed most to the prediction. The findings revealed prominent vocal attributes that achieved higher charisma scores in the students' ratings. Same-gender evaluations of charisma were mainly based on pitch, while cross-gender evaluations rely mostly on loudness or rhythm. The automated, interpretable method provides a reliable and efficient way to measure vocal charisma in academic lecturers. It can be adapted to examine additional individual factors that influence the perception of a lecturer’s charismatic presence. It may also be integrated into practice-based tools, designed to support instructors in improving their presentation skills. Our research bridges the fields of applied psychology and computer science to contribute to the development of educational technology.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.11.4.479
Pages: 479-493
cloud_download 633
visibility 9001
0
Article Metrics
Views
633
Download
9001
Citations
Crossref
0

...

This study aimed to examine the impact of self-organization and self-efficacy in predicting attitudes toward cheating in online exams among undergraduate students. Drawing on the self-regulated learning framework, a cross-sectional survey design was employed to collect data from 153 students at a Saudi university using three validated scales. The findings revealed that self-organization and self-efficacy were significant negative predictors of attitudes toward cheating, with higher levels of these attributes associated with less favorable attitudes toward cheating. Furthermore, moderation analysis showed that self-efficacy significantly moderated the relationship between self-organization and cheating attitudes, suggesting a complex interplay between the two constructs. The findings highlight the importance of fostering self-regulated learning skills to enhance academic integrity in online assessment contexts.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.1.37
Pages: 37-49
cloud_download 299
visibility 3055
0
Article Metrics
Views
299
Download
3055
Citations
Crossref
0

...

The introduction of evolution in post-apartheid South Africa in 2008 presented significant challenges for teachers, due to both their own and their students' faith-based biases. This study investigates South African teachers' attitudes and understanding of evolution, utilizing Lemkian sociocultural theory and Vygotskian ZPD scaffolding. A mixed-methods approach was employed, including a Likert-scale questionnaire from 91 life science teachers and qualitative insights from open-ended questions. Results reveal a lack of enthusiasm for teaching evolution, influenced by personal religious beliefs and doubts about its scientific validity. Teachers often call for equal representation of evolution and creationism in classrooms. The preparation of teachers must address the stagnant discussion of evolution, while the life sciences curriculum emphasizes the Nature of Science, scientific literacy, and connections between science and society is compromised.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.1.67
Pages: 67-80
cloud_download 293
visibility 2714
0
Article Metrics
Views
293
Download
2714
Citations
Crossref
0

...

This qualitative study examines how leadership and organizational dynamics cultivate lecturers’ readiness for change in higher education. Drawing on transformational leadership theory, it explores the interconnected influence of leadership style, organizational culture, and perceived organizational support on 20 English-language lecturers in an Israeli college that has recently faced multiple overlapping changes: the national transition to CEFR-aligned instruction, the shift to online teaching during the COVID-19 pandemic, and the institutional and emotional disruptions caused by wartime conditions. Interview transcripts were analyzed using a thematic content-analysis approach. Findings reveal that lecturers’ openness to reform was strengthened by leadership characterized by competence, emotional intelligence, and accessibility; by a communicative and developmental organizational culture; and by perceived institutional care and support. Together, these dimensions fostered a sense of secure attachment to the organization-an underexplored relational mechanism linking leadership and readiness for change. The study contributes to leadership theory by proposing that Attachment Theory offers a valuable interpretive lens for understanding how relational trust and emotional security may support adaptive capacity in educational institutions. Implications are discussed for leaders seeking to sustain reform during crisis and instability through relational, emotionally attuned leadership practices.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.3.165
Pages: 165-183
cloud_download 96
visibility 620
0
Article Metrics
Views
96
Download
620
Citations
Crossref
0

...

Binary classifications of teaching as transmission or constructivism obscure how participation, authority, knowledge practices, and conceptual work can vary within one lesson. This article introduces the social, procedural, epistemic, and conceptual (SPEC) framework for episode-level lesson analysis. SPEC was developed through a structured purposive theory synthesis rather than an exhaustive systematic review. A documented corpus of foundational traditions, observation systems, and targeted verification sources was compared using explicit inclusion, boundary, and disposition rules. Candidate constructs were assigned by observable target; three indicators per dimension were retained as a parsimonious authorial proposal; and qualitative descriptors were generated from theoretically warranted adjacent distinctions checked against cross-dimensional counterexamples. The dimensions are analytically distinguishable but potentially related. Their descriptor codes form non-additive, non-normative profiles rather than composite scores or judgments of teaching quality. An instructional episode is the primary unit; a hypothetical transcript illustrates indicator coding, opportunity/evidence flags, and rejection of nearby alternatives. SPEC is an initial conceptual proposal requiring operationalization, reliability examination, and validity testing. Ordering, thresholds, and cross-domain use require study before evaluative application.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.12.3.223
Pages: 223-240
cloud_download 78
visibility 301
0
Article Metrics
Views
78
Download
301
Citations
Crossref
0

...