logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE LTD
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE
RHAPSODE LTD
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE

'validation' Search Results

Presenting the Meta-Performance Test, a Metacognitive Battery based on Performance

metacognition assessment content validity performance tests

Marcio Alexander Castillo-Diaz , Cristiano Mauro Assis Gomes


...

The self-report and think-aloud approaches are the two dominant methodologies to measure metacognition. This is problematic, since they generate respondent and confirmation biases, respectively. The Meta-Performance Test is an innovative battery, which evaluates metacognition based on the respondent's performance, mitigating the aforementioned biases. The Meta-Performance Test consists of two tests, the Meta-text, which evaluates metacognition in the domain of reading comprehension, and Meta-number, in the domain of arithmetic expressions solving. The main focus of this article is to present the development of the battery, in terms of its conceptual basis, development strategies and structure. Evidence of its content validity is also presented, through the evaluation of three experts in metacognition, two experts in Spanish language, two experts in mathematics and five students who represent the target population. The results of the judges' evaluations attested to the Meta-Performance Test content validity, and the target population declared that both the battery understanding and taking are adequate. Contributions and future research perspectives of the Meta-Performance Test in the field of metacognition are discussed.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.289
Pages: 289-303
cloud_download 830
visibility 1093
2
Article Metrics
Views
830
Download
1093
Citations
Crossref
2

Scopus
2

Preschool Teachers’ Preparation Programs: The Use of Puppetry for Early Childhood Science Education

early childhood science education puppets teacher education teaching methods

Erdinc Ocal , Abdulhamit Karademir , Ozkan Saatcioglu , Beyza Demirel


...

This paper investigated how puppetry could be used to improve the standards of early childhood science education. This study determined the effect of a puppet-making and puppetry workshop on preservice preschool teachers’ beliefs and attitudes towards science education and looked into their experiences during and after puppet-making. Although participants faced some difficulties during the workshop, they developed numerous socioemotional skills. Puppetry activities can help preservice teachers learn how to deliver child-centered, stimulating, and interactive classes. Using puppets in early childhood science education can help teachers develop positive attitudes towards science and offer students high-quality, engaging, and creative activities.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.305
Pages: 305-318
cloud_download 1133
visibility 1428
3
Article Metrics
Views
1133
Download
1428
Citations
Crossref
3

Scopus

...

The research aims were to examine the relationship among psychological resilience, patience, and happiness levels of physical education teachers employing in İzmir, Afyonkarahisar, and Muğla provinces in the Aegean Region and was to explain whether psychological resilience and patience levels predict happiness. The research was a descriptive study in the relational scanning model. The study participants consisted of 336 PE teachers, 182 (54.2%) were males, and 154 (45.8%) were females.. The data were obtained using the Brief Resilience Scale (BRS), Patience Scale and Oxford Happiness Questionnaire. In the analysis of data were used SPSS 25 statistical program. The analysis of the data descriptive statistics, correlation, and statistical regression methods were used. As a result of the research, it was determined that the psychological resilience, patience, and happiness levels were at medium levels according to the average score the PE teachers got from the scales. It was found that there is a moderate positive relationship between PE teachers' psychological resilience, patience, and happiness levels, and psychological resilience and patience levels are a significant predictor of happiness.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.335
Pages: 335-351
cloud_download 753
visibility 879
4
Article Metrics
Views
753
Download
879
Citations
Crossref
4

Scopus

...

This study aims to produce empirical evidence of the validity and reliability of instrument items for the competency framework of agricultural teaching staff in Malaysian agricultural vocational colleges. The validity and reliability of the framework were analyzed using Rasch Model Measurement assisted by Winsteps 3.72 software. This research instrument contained 116 items, which was distributed to 30 instructors at the Teluk Intan Agricultural Vocational College, Malaysia. The selection of respondents was made by strata random where the researcher makes the strata of the population according to the percentage and then selects randomly based on the desired percentage. Validity analysis of the instrument was done through four functional testings. For reliability and separation of respondents, it was found that the individual reliability value was very good and acceptable. The results of the item polarity analysis detected no negative value (-) in the Point Measure Correlation value. Item matching analysis found that 11 items had to be dropped as they failed to meet the required conditions. From the analysis on local dependence that determines dependent items based on the standardized residual correlation value, it was discovered that the correlation value for the items used was detected; 13 items need attention. The results of the data analysis checking the functionality of the items suggested that some items should be dropped. The omission of these items has provided evidence that the instrument of competence of agricultural instructors is crucial to have a high level of validity and reliability for use in actual studies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.411
Pages: 411-420
cloud_download 323
visibility 570
2
Article Metrics
Views
323
Download
570
Citations
Crossref
2

Scopus
2

...

The early phase is the decisive period for the teachers’ career. Intellectual styles (particularly thinking styles) play a vital role in teachers’ professional development. With the purpose of measuring thinking styles of teachers at the early phase, this study was designed to validate a revised inventory of thinking styles (TSI-R2) for pre-service and early career teachers. A sample of pre-service teachers (n = 248) were invited to join the pilot study and a sample of teachers with one year work experience (n = 252) participated in the main study. Exploratory factor analysis, confirmatory factor analysis and reliability analysis were performed. The results suggested that with slight modification, TSI-R2 was a reliable and valid instrument to measure thinking styles of pre-service teachers and early career teachers, which has some implications to enhancing teacher education and development.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.3.421
Pages: 421-432
cloud_download 356
visibility 642
3
Article Metrics
Views
356
Download
642
Citations
Crossref
3

Scopus
3

Measuring Purpose in Life in College Students: An Assessment of Invariance Properties by College Year and Undergraduate School

college students confirmatory factor analysis measurement invariance purpose in life

Ella Anghel , Larry Ludlow , Olivia Szendey , Christina Matz-Costa , Theresa O’Keefe , Henry Braun


...

Purpose in life is a key construct in the development of young adults, particularly college students. There are many instruments measuring sense of purpose in life, but few studies have examined their measurement properties among college students. The current study compares the measurement invariance properties of the Purpose in Life (PIL) scale and the Claremont Purpose Scale (CPS) across college year and undergraduate school. Using both a unidimensional and a two-dimensional model, we found that the PIL’s interpretability is limited among college students. Using a three-dimensional model, the CPS was invariant with respect to both grouping variables. The study suggests that the CPS can be used to make meaningful comparisons among college students categorized by school year and undergraduate school. The study also has some implications about the construct of purpose in life; namely, scale structures that work well statistically and theoretically among adults might not generalize to young adults.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.4.603
Pages: 603-614
cloud_download 342
visibility 535
2
Article Metrics
Views
342
Download
535
Citations
Crossref
2

Scopus

...

Technical and pedagogical counseling as accompaniment benefits teachers’ development. However, there are information gaps on the specific impact of counseling with a socio-formative approach on both professionalization and the improvement of teaching practice. The objective is to analyze the relationship between these three elements. A cross-sectional study with a quantitative approach was employed. A validated questionnaire was applied to a representative sample of 212 teachers. The information analysis was carried out through statistics: descriptive, correlational, and linear regression, whose level of significance was: <.01-. 05. Teachers consider that technical and pedagogical counseling from socio-formation fosters the development of an ethical life project, promotes problem solving in their educational practice, collaborative work, metacognition, and entrepreneurship (92.78 ± 14.3). The correlational analysis showed a significant relationship between socio-formative pedagogical technical counseling and teaching practice, the latter of which was enhanced by the former. In the linear regression analysis, the best model of pedagogical technical counseling is made from socio-formation, which predicts a 71% improvement of teaching practice. As a result, this form of counseling benefits both professionalization and teaching practice through metacognition.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.1.1
Pages: 1-9
cloud_download 423
visibility 745
0
Article Metrics
Views
423
Download
745
Citations
Crossref
0

Scopus
0

...

South Africa, like other countries in the world, went into lockdown due to the Coronavirus disease (COVID-19) which meant closure of venue-based exam centres, university libraries and academic offices for more than three months. This encounter forced higher institutions of learning to review and reconfigure their assessment practices and conduct alternative assessment practises like timed exams, take home exams, randomised multiple-choice examinations and an online portfolio. Over and above that South Africa experienced load shedding (interruptions to electricity supply) and connectivity challenges which impacted the online examinations. This paper explores the experiences of lecturers whilst administering online examination at a South African Open Distance e-Learning university during COVID-19. Data collected from the lecturers who administered online examination through semi-structured interviews. Thematic analyses were used to analyse the data. Lecturers reported on student challenges related to time allocation, exam security, internet connectivity and data access, digital incompetency and support received from the information communication technology (ICT) department. Academics’ reflection suggests that the system and students were not fully prepared and ready to write the online examination. The researchers propose continued technical and technological education and support for academics and students. Therefore, in line with these experiences, it is important to conduct further the research.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.275
Pages: 275-283
cloud_download 369
visibility 516
11
Article Metrics
Views
369
Download
516
Citations
Crossref
11

Scopus
8

...

Taiwan has been promoting its national health insurance (NHI), which provides people with appropriate medical resources; however, health insurance education is missing from schools, and teachers lack relevant teaching abilities. This study describes the development of the health insurance education empowerment program (HIEEP) to promote effective teaching on educators. A two-group parallel-controlled trial was conducted with health education teachers, in which participants learned to discuss its importance through demonstration and practice. The questionnaire measured their teaching effectiveness in HIEEP using a baseline measurement and a one-week follow-up measurement. Of 196 people that started the trial, 186 completed it. The intervention effects were evaluated using the Johnson-Neyman method. The results showed that in the experimental group, the program raised all teachers’ variable scores, which evaluated health insurance meaning, teaching competence, self-determination, and impact. The empowerment program can provide teachers will allow for more effective health insurance education.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.2.313
Pages: 313-320
cloud_download 260
visibility 463
2
Article Metrics
Views
260
Download
463
Citations
Crossref
2

Scopus
0

...

This work describes the design and validation of a questionnaire to assess the expectations of higher education professors regarding virtual education (CEDVES). The sample included 546 professors, 299 men (54.66%) and 247 women (45.23%), from different scientific disciplines of a university in Chile. The final version consisted of 38 items answered using a five-point Likert scale. Nine factors were identified from the exploratory factor analysis. This configuration accounts for 75% of the variance. The structure of the instrument was studied using confirmatory factor analysis. It was found that nine factors produced a good fit, derived from a hierarchical solution in which all these factors depend on a factor of second general order. Each of the scales, like the general factor, present good indicators of reliability. The analysis indicates that this questionnaire has adequate validation and could be broadly used in higher education.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.3.465
Pages: 465-478
cloud_download 215
visibility 390
2
Article Metrics
Views
215
Download
390
Citations
Crossref
2

Scopus
1

...

This study aims to develop a learning model based on 4C skills to improve high school students’ mathematical critical thinking skills. Research & development is the design used in this research by applying Plomp’s development theory which consists of three phases, namely needs analysis, design and implementation, and evaluation. This research was conducted at Madrasah Aliyah Negeri 2 Parepare, South Sulawesi, Indonesia involving five experts, four teachers, and 20 students. Data collection and analysis were carried out qualitatively and quantitatively. Analysis of interviews’ data and observations qualitatively with the thematic analysis technique. We also analyse data from validation sheets, questionnaires, and mathematical essay tests with the help of SPSS 20.00. The results show that students and lecturers need a learning model to improve mathematical critical thinking skills. In addition, other findings stated that the learning model developed was proven to be valid, practical, and effective to be used in general. Developing your learning model can further improve students' learning outcomes and mathematical critical thinking skills because they are designed based on the actual needs and problems. For this reason, a teacher must be able to design his learning model.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.3.493
Pages: 493-504
cloud_download 546
visibility 848
2
Article Metrics
Views
546
Download
848
Citations
Crossref
2

Scopus
2

The Role of Innovation Leadership in Teacher Commitment: A Study of Organizational Culture

innovation leadership organizational culture teacher commitment

Sukris Sutiyatno , Kartika Imam Santoso , Gatot Susilo


...

This study aimed to investigate the influence of innovation leadership on teacher commitment through organizational culture as a mediating variable. A quantitative approach using the survey method was used, and the sample was selected using proportional random sampling. The respondent consisted of 180 teachers from public vocational schools in Magelang. In addition, data were collected by questionnaire and analyzed by a structural equation model (SEM). The result showed that innovation leadership influenced organizational culture with a t-value of 2.95 > ttable (1.98) at .26. In contrast, organizational culture influenced teacher engagement with .27 and a t-value of 3.10 > ttable (1.98). Innovative leadership directly affected teacher commitment at .31 with a t-value of 3.41 > ttable (1.98) due to organizational culture being a mediating variable at .07. The overall influence on teachers' commitment through the organizational culture is .38. The analysis results explain that organizational culture can successfully mediate the relationship between innovation leadership to teachers' commitment. Therefore, these variables can be developed and implemented in schools to increase student achievement quality.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.3.595
Pages: 595-607
cloud_download 476
visibility 840
0
Article Metrics
Views
476
Download
840
Citations
Crossref
0

Scopus
0

...

This study reviews 60 papers using a Likert scale and published between 2012 – 2021. Screening for literature review uses the PRISMA method. The data analysis technique was carried out through data extraction, then synthesized in a structured manner using the narrative method. To achieve credible research results at the stage of the data collection and data analysis process, a group discussion forum (FGD) was conducted. The findings show that only 10% of studies use a measurement scale with an even answer choice category (4, 6, 8, or 10 choices). In general, (90%) of research uses a measurement instrument that involves a Likert scale with odd response choices (5, 7, 9, or 11) and the most popular researchers use a Likert scale with a total response of 5 points. The use of a rating scale with an odd number of responses of more than five points (especially on a seven-point scale) is the most effective in terms of reliability and validity coefficients, but if the researcher wants to direct respondents to one side, then a scale with an even number of responses (six points) is possible. more suitable. The presence of response bias and central tendency bias can affect the validity and reliability of the use of the Likert scale instrument.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.625
Pages: 625-637
cloud_download 1382
visibility 2389
10
Article Metrics
Views
1382
Download
2389
Citations
Crossref
10

Scopus
4

...

Work environments are pivotal to teachers’ professional development. However, effective instruments assessing teachers’ perceived work context are still lacking. The principal aim of the present study was to validate a Work Environments Inventory for Teachers (WEIT) constructed using the Job Demands-Resources (JD-R) model. Two studies were implemented on two independent samples totaling 696 (232 for Study 1 and 464 for Study 2) schoolteachers in Mainland China. Both exploratory and confirmatory factor analyses were employed to cross-validate the WEIT. The external construct validity of the WEIT was estimated through investigating its connection with the Thinking Styles in Teaching Inventory. Findings indicated that the WEIT is an adequate measure to map the characteristics of work environments for schoolteachers. Limitations are discussed and implications for future studies are suggested.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.647
Pages: 647-654
cloud_download 251
visibility 530
0
Article Metrics
Views
251
Download
530
Citations
Crossref
0

Scopus
0

Rethinking the Components of Regulation of Cognition through the Structural Validity of the Meta-Text Test

metacognition performance-based testing regulation of cognition structural validity

Marcio Alexander Castillo-Diaz , Cristiano Mauro Assis Gomes , Enio Galinkin Jelihovschi


...

The field of studies in metacognition points to some limitations in the way the construct has traditionally been measured and shows a near absence of performance-based tests. The Meta-Text is a performance-based test recently created to assess components of cognition regulation: planning, monitoring, and judgment. This study presents the first evidence on the structural validity of the Meta-Text, by analyzing its dimensionality and reliability in a sample of 655 Honduran university students. Different models were tested, via item confirmatory factor analysis. The results indicated that the specific factors of planning and monitoring do not hold empirically. The bifactor model containing the general cognition regulation factor and the judgment-specific factor was evaluated as the best model (CFI = .992; NFI = .963; TLI = .991; RMSEA = .021). The reliability of the factors in this model proved to be acceptable (Ω = .701 & .699). The judgment items were well loaded only by the judgment factor, suggesting that the judgment construct may actually be another component of the metacognitive knowledge dimension but having little role in cognition regulation. The results show initial evidence on the structural validity of the Meta-Text and give rise to information previously unidentified by the field which has conceptual implications for theorizing metacognitive components.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.687
Pages: 687-698
cloud_download 443
visibility 767
2
Article Metrics
Views
443
Download
767
Citations
Crossref
2

Scopus
1

...

The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) in the Thai context. The metacognitive orientation of a science classroom learning environment is defined as the extent to which psychosocial conditions that are known to enhance students’ metacognition are evident in a specific science classroom. This study builds on earlier work in the research areas of science education, metacognition, and learning environments. A sample of 5418 Thai science students in grades 10 to 12, from 40 schools across Thailand, completed the MOLES-S that had been translated into Thai. Exploratory factor analysis was undertaken and Rasch analysis was used to calibrate the scale and explore its dimensionality. The results suggest that the MOLES-S(T), where (T) represents Thailand, has the same factor structure as the original MOLES-S, is reliable, and can be used with confidence in research into metacognition in Thai high school science classrooms.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.805
Pages: 805-818
cloud_download 196
visibility 404
2
Article Metrics
Views
196
Download
404
Citations
Crossref
2

Scopus
1

Psychometric Properties of Online Adolescent Anger Instrument

adolescent anger expressions exploratory factor analysis online instrument

Nor Shafrin Ahmad , Rozniza Zaharudin , Ahmad Zamri Khairani


...

Anger is a topic that requires intervention from teachers, counsellors, psychologists, parents, and all communities. The expressions of anger are subjective and sometimes hard to identify. Thus, anger should be measured more objectively, while the expressions need to be examined closely. The purpose of this study is to provide valid confirmation for development of an online instrument to measure the types of anger expression among adolescents. Data were collected from 935 adolescents from nine schools in northern Malaysia and the theoretical literature search. The data were analysed to provide evidence of construct validity in terms of item factor analysis, reliability estimates, and correlation between the types of anger expressions. Findings were used to develop an online Adolescent Anger Instrument. It measures five types of anger expressions, namely, physical, verbal, intrinsic, extrinsic, and passive. The results showed that the instrument is internally consistent with high evidence of construct validity. Exploratory factor analysis, with varimax rotation, suggested the existence of five distinct types of anger as conceptualised. Meanwhile, the correlation between types of anger expressions indicates the strength of the relationship between them. Discussions on the findings are provided, while suggestions for future research are also described.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.819
Pages: 819-831
cloud_download 290
visibility 487
0
Article Metrics
Views
290
Download
487
Citations
Crossref
0

Scopus
0

...

Online game addiction and psychological distress are two continuously developing problems in the Philippines, with Filipinos aged 18 to 24 being the second largest age group to overuse interactive online-related games. This sequential explanatory mixed method study aimed to assess the young adults’ gaming addiction and perceived psychological distress during the COVID-19 pandemic and identify the other factors contributing to the respondents’ frequent engagement in online interactive games, which served as a basis for a preventive intervention program. The researcher administered the survey questionnaires of the Gaming Addiction Scale and Depression Anxiety Stress Scale-21 to 399 young adults aged 18–24 and a semi-structured interview guide to 20 addicted and non-addicted gamers. Key results showed that a small percentage of the respondents experienced polythetic and serious monothetic addiction to interactive online games. In contrast, half of the respondents manifested mild to moderate symptoms of depression and anxiety during the COVID-19 pandemic. Major findings also found no significant gender differences in the level of online game addiction and psychological distress during the COVID-19 pandemic, and a moderate level of relationship substantiated the association. Further results revealed that the negative compensatory factors were associated with addicted gamers’ frequent engagement with online games, whereas non-addicted gamers were associated with positive, beneficial factors. This phenomenon has hardly ever been the focus of in-depth research, and the results of this study can be used to further refine the conceptualization of “internet gaming disorder” as a mental disorder and develop a more comprehensive treatment method.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.29
Pages: 29-40
cloud_download 564
visibility 2018
2
Article Metrics
Views
564
Download
2018
Citations
Crossref
2

Scopus
0

...

The purpose of the study is to explore the ways of involving university stakeholders specifically in updating educational services. It combined exploratory and observational research methods which relied on qualitative or quantitative data gathered through the researcher-designed and validated tools which were the empirical and methodological contributions to the previous research. The five most frequent choices that might encourage the stakeholders to donate or invest in an educational institution were as follows: a portfolio of the use of donations, investments, or grants, having a stake in the educational services of more than 7%, having access to budgeting and cost reporting, having a share in the institutions’ profit and being one of the decision-makers. The factors that discouraged investors from investing in education were as follows: distrust of the activity of the educational institutions in terms of addressing the stakeholders’ needs or interests, lack of engagement or cooperation, institutional and government-imposed barriers between them and the institutions, uncertainty concerning the efficiency of the institutions and inefficient use of the resources by the institutions. The initiative was complimentarily perceived by stakeholders in terms of collaboration and investment opportunities. It was also found beneficial by the sampled students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.107
Pages: 107-122
cloud_download 232
visibility 523
4
Article Metrics
Views
232
Download
523
Citations
Crossref
4

Scopus
0

Effects of Worksheets on Problem-Solving Skills: Meta-Analytic Studies

effect meta-analytic problem-solving skill worksheet

Sri Adi Widodo , Astuti Wijayanti , Muhammad Irfan , Widowati Pusporini , Siti Mariah , Siti Rochmiyati


...

The purpose of this study was to compile and statistically analyze the results of research studies that examined students' problem-solving skills in worksheets. The research method used was a meta-analysis. The study search was conducted from 2013 to 2022 in Google Scholar and the Garuda portal databases. The search yielded 40 studies that met the inclusion criteria for extraction from research and development, experimental, and quasi-experimental. From the extracted results, 45 comparisons of data were examined. Microsoft Excel was used to calculate the effect size of the problem-solving worksheet. This study yielded a value of 1.281 for the entire study, indicating that the worksheet had a significant and positive impact on students' problem-solving skills. The results indicate the need to develop worksheets to improve students' problem-solving skills.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.151
Pages: 151-167
cloud_download 588
visibility 608
2
Article Metrics
Views
588
Download
608
Citations
Crossref
2

Scopus
0

...