'test development' Search Results
Developing Competency Evaluation of Pre-service Science Teachers in Industrial Revolution 4.0: Revealing Pedagogic and Professional Competencies
industrial revolution rasch model teacher competence test development...
This study aimed to develop an instrument to assess science teacher candidates’ professional and pedagogical competence in the Industrial revolution 4.0. The instrument consisted of 30 questions and was used in the main study, which was analyzed using the Rasch model to unravel the reliability and empirical validity. The questions were developed based on a predetermined grid including the skills and literacy aspects used in the industrial revolution 4.0. The 30 revised questions were then tested on 60 students of Science Education at two State universities in Indonesia who were in their third year of study times. The Rasch model was employed to test its reliability and empirical validity that included Wright map analysis, item difficulty level, distractor analysis, and item suitability with the Rasch model. The results showed that the reliability value of the professional aspect was .95 and classified as an excellent category. Moreover, the pedagogic aspect obtained .93 and was classified as a very good category. Only one question was the most difficult and did not fit the Rasch model, while the others already fitted. This reliable and valid instrument is suggested to be useful in assessing pre-service science teachers’ competence.
The Development of Life Skill Education Evaluation Model at Life Skill Training Centre
confirmatory factor analysis evaluation model life skill education...
This research aims to develop the product of the life skill education program (LSEP) which is accurate, credible, and effective. This research used the Plomp model. The model covers the input, process, output, outcome and consists of instrument, scoring guidance, and good or bad criteria. The instruments used in the model are the questionnaire, observation sheet and interview guide. The content validity of the questionnaire and observation sheet was proved by expert judgement and continued by using the Aiken Formula, the construct validity of the questionnaire was proved by the construct validity using the exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). The content validity of the questionnaire and observation sheet involved 9 validity experts. The questionnaire construct was done in two steps; the first step involved 65 students analyzed using EFA and the second step involved 199 students analyzed with CFA. The reliability of the observation sheet and questionnaire was estimated by using the Cronbach Alpha technique. The result of the trial model and its analysis shows that all the instruments are good. LSEP model is tested by involving 15 students in the course and training institute. The result of the trial model shows that the model is effective because the users explains that the model is: a) comprehensive, covering many components and sub component programs such as the input, process, output, outcome, b) practical, simple and easy in usage, c) economical, not needing much cost, energy, and time, also d) supported by valid and reliable data collection instrument.
How Critical Thinking Skills Influence Misconception in Electric Field
critical thinking skills electric field misconception physics learning...
This study aimed to determine the influence of critical thinking skills on misconceptions using a five-tier instrument in mixed-method research. The sampling technique used is simple random sampling. The data collection instrument used a critical thinking skills questionnaire, a misconception test of electric field material, and interviews. Data collection begins with quantitative data, providing a misconception test sheet and a critical thinking skills questionnaire. After that, the researcher took qualitative data in the form of interviews to strengthen data that had been obtained previously. Then from the results of the regression coefficients, there is an influence of critical thinking skills on misconceptions. The descriptive results of critical thinking skills data show that the mean of critical thinking skills is 68.50, which means that students' critical thinking skills are in a good category. Then from the results of the regression coefficients, there is an effect of critical thinking skills on a misconception, with the probability number obtained being significant. The limitations of this study are only to identify and see the impact.
Overcoming Vocabulary-Related Anxieties in Students When Communicating in the Media Internationally
communication in the media cross-cultural communication higher education l2 learning vocabulary-related anxieties...
The purpose of the study was to identify how the designed instructional model moderated the vocabulary-related anxieties in students when they communicated in the media internationally. The methodological approach used in the study was aimed at controlling and manipulating variables which were as follows: The level of vocabulary anxiety related to communication in the media, cultural intelligence, and English vocabulary level. The study relied on quantitative and qualitative methods to gather the experimental data and answer the research questions. Insufficient vocabulary was found to be one of the key factors of anxieties in students when they communicated in the media internationally. The major sub-factors of the vocabulary-related anxieties in the students when they communicated in the media internationally (as perceived by the respondents) were spontaneous interaction with the native speakers, guessing the meaning of the words from the context, and paraphrasing ideas using synonyms. The instructional-purpose use of the predesigned vocabulary lists, learning them using the Telegram bot, talking to the foreign speakers in the media, self-analysis, and analysis by peers were proven to be capable to moderate the vocabulary-related anxieties in students when they communicate in the media with the foreign speakers.
Observational Record and Self-Report of Teacher-Student Performance in High School Lessons
didactic interaction direct observation methodology verbal self-reports teacher performance criteria student performance criteria...
There are different strategies to analyze teacher and student performance when they interact with each other in class. The most used strategies are direct observation and verbal reports. Even though what is observed or reported depends on theoretical frameworks regarding didactic interactions, these must be related to teacher functions such as supervision, providing feedback, and evaluation of student performance. In this study, instruments for observational recording and verbal reports were developed and validated considering teacher functions and their student performance counterparts to compare the degree of correspondence or divergence between data gathered from both strategies. 135 students enrolled in a science class and their teachers participated. The class was taught in a public high school located in center/south Mexico. Classes were videotaped and the corresponding observational records were analyzed. Two months later, verbal reports were administered to students and teachers. Coincidences and differences that were found revealed that observer-observe interaction is conditioned by social norms. These results were interpreted considering the notion of silence as a communicative element.
Development of the 4C Teaching Model to Improve Students’ Mathematical Critical Thinking Skills
mathematical critical thinking skill teaching model the 4c skills...
This study aims to develop a learning model based on 4C skills to improve high school students’ mathematical critical thinking skills. Research & development is the design used in this research by applying Plomp’s development theory which consists of three phases, namely needs analysis, design and implementation, and evaluation. This research was conducted at Madrasah Aliyah Negeri 2 Parepare, South Sulawesi, Indonesia involving five experts, four teachers, and 20 students. Data collection and analysis were carried out qualitatively and quantitatively. Analysis of interviews’ data and observations qualitatively with the thematic analysis technique. We also analyse data from validation sheets, questionnaires, and mathematical essay tests with the help of SPSS 20.00. The results show that students and lecturers need a learning model to improve mathematical critical thinking skills. In addition, other findings stated that the learning model developed was proven to be valid, practical, and effective to be used in general. Developing your learning model can further improve students' learning outcomes and mathematical critical thinking skills because they are designed based on the actual needs and problems. For this reason, a teacher must be able to design his learning model.
Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review
likert scale literature review potential bias reliability and validity...
This study reviews 60 papers using a Likert scale and published between 2012 – 2021. Screening for literature review uses the PRISMA method. The data analysis technique was carried out through data extraction, then synthesized in a structured manner using the narrative method. To achieve credible research results at the stage of the data collection and data analysis process, a group discussion forum (FGD) was conducted. The findings show that only 10% of studies use a measurement scale with an even answer choice category (4, 6, 8, or 10 choices). In general, (90%) of research uses a measurement instrument that involves a Likert scale with odd response choices (5, 7, 9, or 11) and the most popular researchers use a Likert scale with a total response of 5 points. The use of a rating scale with an odd number of responses of more than five points (especially on a seven-point scale) is the most effective in terms of reliability and validity coefficients, but if the researcher wants to direct respondents to one side, then a scale with an even number of responses (six points) is possible. more suitable. The presence of response bias and central tendency bias can affect the validity and reliability of the use of the Likert scale instrument.
The Implementation of Dual Language Programme for Mathematics Education in Secondary Schools: A Systematic Literature Review
bilingual dual language programme (dlp) mathematics prisma systematic literature review...
The study discussed in this paper is a systematic literature review related to the role of dual language programme (DLP) in mathematics education which has been published within the last 5 years. This study was conducted to identify the distribution of DLP studies in terms of year of publication, the study context covered in previous studies, the context of study areas used, focus and trends of past studies, research methods used in previous studies and the role of language in school mathematics education. This review study followed the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyzes (PRISMA) to analyze articles from Scopus and Web of Science. The findings of the study indicate that research trends in the implementation of the DLP on mathematics education for secondary school students showed an increase from 2017 to 2019. Most DLP-related articles are widely developed in the United States and Germany. The findings indicate that previous studies are more interested in studying the implementation of DLP in rural areas. Past studies have also preferred to use the design of either a qualitative study or a quantitative study to be implemented. Questionnaires, tests and interviews are among the research instruments that are often used for a study.
Language Tests, Motivation, and Demotivation: A Complex Relationship
demotivation language learning motivation language tests motivation...
Tests are an integral part of most formal language learning processes, exerting far-reaching effects on many aspects of language learning. Among other things, tests affect language learning motivation (LLM), an element that is fundamental to many learning contexts. However, little attention has been paid to how tests affect LLM and what the pedagogical implications may be. Using qualitative semi-structured interviews with 20 adolescent Arab learners, this study attempts to explore how and when tests can motivate or demotivate language learners. It also examines the main strategies learners deploy to cope with the demotivating experiences associated with test taking. The data suggest that tests have the potential to both motivate and demotivate learners before, during, and after taking a test. Additionally, the results reveal several strategies that learners employ to cope with demotivation. This leads to a discussion regarding pedagogical implications on how to effectively employ tests to increase learners’ motivation and decrease their demotivation.
Psychometric Properties of Online Adolescent Anger Instrument
adolescent anger expressions exploratory factor analysis online instrument...
Anger is a topic that requires intervention from teachers, counsellors, psychologists, parents, and all communities. The expressions of anger are subjective and sometimes hard to identify. Thus, anger should be measured more objectively, while the expressions need to be examined closely. The purpose of this study is to provide valid confirmation for development of an online instrument to measure the types of anger expression among adolescents. Data were collected from 935 adolescents from nine schools in northern Malaysia and the theoretical literature search. The data were analysed to provide evidence of construct validity in terms of item factor analysis, reliability estimates, and correlation between the types of anger expressions. Findings were used to develop an online Adolescent Anger Instrument. It measures five types of anger expressions, namely, physical, verbal, intrinsic, extrinsic, and passive. The results showed that the instrument is internally consistent with high evidence of construct validity. Exploratory factor analysis, with varimax rotation, suggested the existence of five distinct types of anger as conceptualised. Meanwhile, the correlation between types of anger expressions indicates the strength of the relationship between them. Discussions on the findings are provided, while suggestions for future research are also described.
The Evaluation of the English Language Teacher Education Program in Turkey
curriculum evaluation efl teacher education program teacher education...
This study aims to evaluate the English language teacher training program which was put into practice in 2006, according to the views of lecturers and English teachers. This study aims to contribute to the studies on foreign language teaching by presenting an evaluation of teacher education, which is an important dimension of English as a foreign language teaching. The qualitative method was used in the study, which was designed in a descriptive survey model. The population of the research consists of 35 lecturers working at the English Language Teaching Department of different Education Faculties in the 2016-2017 academic year and 11 English teachers working in public schools affiliated with the Ministry of National Education and who have not completed 5 years in the profession. NVIVO-11 program was used in the analysis of the data. The results of the study were compared with the 2018 English teacher education program renewed by the Council of Higher Education. English teachers and lecturers think that the content knowledge, pedagogical content knowledge, and general culture courses in the teacher training program are insufficient. According to English teachers and lecturers the content knowledge, pedagogical content knowledge, and general culture courses in the English language teacher education program are insufficient. Furthermore, English teachers stated that they could not apply what they learned during their training to real-life conditions. Therefore, they propose that the English language teacher training program should be revised considering the current conditions.
What Constitutes a ‘Classroom Problem’ for Today's Teacher?: An Exploratory Study
critical incidents teacher competencies teacher education programs teacher-student relationship...
Teachers face situations that are difficult to solve, which affect their practices in the classroom. Teachers´ ability to face problematic situations been related to educators' adaptive and metacognitive capacity. This study aimed to contrast the recent literature on classroom problems with reports from Chilean teachers regarding what they mean today as critical situations in the classroom. The major problems with the highest prevalence were categorized based on a literature review. Subsequently, teachers from three educational levels (pre-school, primary and secondary) were asked to relate situations in which they had experienced a crisis in their profession. After a filtering based on the relevance and textual richness present, the stories (n=145) were subjected to a thematic analysis and contrasted with the categories obtained from the reviewed literature. The results show a low proportion of problems associated with learning management in the classroom and, on the other hand, a high proportion of behavioral problems in students focused on situations of aggression towards the teacher. These conclusions are discussed to reconsider the concept of "classroom problem situations" and, based on this, questioning the role of teacher training in the development of skills for the management of authentic problem situations.
Effects of Worksheets on Problem-Solving Skills: Meta-Analytic Studies
effect meta-analytic problem-solving skill worksheet...
The purpose of this study was to compile and statistically analyze the results of research studies that examined students' problem-solving skills in worksheets. The research method used was a meta-analysis. The study search was conducted from 2013 to 2022 in Google Scholar and the Garuda portal databases. The search yielded 40 studies that met the inclusion criteria for extraction from research and development, experimental, and quasi-experimental. From the extracted results, 45 comparisons of data were examined. Microsoft Excel was used to calculate the effect size of the problem-solving worksheet. This study yielded a value of 1.281 for the entire study, indicating that the worksheet had a significant and positive impact on students' problem-solving skills. The results indicate the need to develop worksheets to improve students' problem-solving skills.
Development of a Digital-Preneurship Measurement Instrument: Alignment Approach Through Project-Based Learning
approach digitalpreneurship instrument development pjbl vocational student...
The purposes of this research are (a) to make an instrument to measure the achievement of project-based digitalpreneurship learning in students; (b) to describe the quality of the project-based digitalpreneurship learning achievement assessment instrument for vocational high school students; (c) to measure the competence and skills. This study employed to research and development as its methodology, using a combination procedure between Oriondo and Antonio and, Mardapi. The development procedure includes three stages: instrument design, instrument testing, and measurement. A total of 795 students who participated in the study at 5 vocational high schools in Yogyakarta's special region served as responders. Data analysis in this development uses the content validity of the formula Aiken V Index, confirmatory factor analysis establishes the construct's validity, and construct reliability. Measurement instrument development. Research findings that (a) the instrument is ready to be used in the measurement; (b) the quality of the project-based digitalpreneruship learning achievement assessment instrument for vocational high school students is well tested. This is evidenced by the validity test which has a high score >.8; The proof of construct validity in this study using CFA > .5; GOF chi-square value with a critical value of df = 289, X2 = 323, p-value with a critical value of .079, RMSEA with a critical value of RMSEA .019 (≤ .08), SMRM with a critical value of SRMR 0.030 (≤ .05), CFI with a critical value of CFI .990 (> .97), and an NFI with a critical value of NFI .989 ( > .90); (c) the measurement results are identified in the process that needs to be improved again regarding the digitalpreneurship skills of vocational high school students.
Predictive Model for Clustering Learning Outcomes Affected by COVID-19 Using Ensemble Learning Techniques
educational data mining learning achievement learning analytics online learning model student model...
The influence of COVID-19 has caused a sudden change in learning patterns. Therefore, this research studied the learning achievement modified by online learning patterns affected by COVID-19 at Rajabhat Maha Sarakham University. This research has three objectives. The first objective is to study the cluster of learning outcomes affected by COVID-19 at Rajabhat Maha Sarakham University. The second objective is to develop a predictive model using machine learning and data mining technique for clustering learning outcomes affected by COVID-19. The third objective is to evaluate the predictive model for clustering learning outcomes affected by COVID-19 at Rajabhat Maha Sarakham University. Data collection comprised 139 students from two courses selected by purposive sampling from the Faculty of Information Technology at the Rajabhat Maha Sarakham University during the academic year 2020-2021. Research tools include student educational information, machine learning model development, and data mining-based model performance testing. The research findings revealed the strengths of using educational data mining techniques for developing student relationships, which can effectively manage quality teaching and learning in online patterns. The model developed in the research has a high level of accuracy. Accordingly, the application of machine learning technology obviously supports and promotes learner quality development.
Game-Based Learning Kit Method in Isometric Transformations: Usability and Effects on Students’ Achievement and Motivation
game based learning isometric transformations mathematics motivation...
This study focused on the development of teaching aids for the topic of Isometric Transformations for Form 2 students in Malaysia. The first objective was to determine the usability of teaching aids in the isometric transformations kit integrates game-based learning (GBL) Method (KitTI Method) and the second objective was to examine the effectiveness of using the KitTI Method on students’ achievement and motivation. This study was directed by the Design and Development Research (DDR) model with survey and quasi-experimental designs. The sample selection was conducted by cluster sampling involving Form 2 students from schools in the district of Muallim and Batang Padang in the state of Perak. The instruments used were KitTI Method Teaching Aids Usability Questionnaire (KMTAUQ), Isometric Transformations Topic Achievement Test (ITTAT), and KitTI Method Motivation Questionnaire (KMMQ). The findings showed that the mean score of KitTI Method‘s usability was high, the treatment group obtained significantly higher improvement in achievement compared to the control group while the mean scores of pre-test achievement as a covariate and students’ motivation in learning Isometric Transformations were high. Therefore, the KitTI Method is suitable to be implemented as a guide for mathematics teachers in designing dynamic teaching and learning and is able to improve students’ achievement and motivation.
An Educational Method Based on Student-Generated Questions
misconceptions participatory learning student-generated questions teaching and learning physics...
This paper describes an experience based on the use of an active method in which students of a basic physics course prepare multiple choice questions (MCQs) to prepare for exams in the subject. The objective of the research was to provide the students with a method that would enhance their desire to learn physics, and consequently lead to an improvement in their meaningful learning. The participants were 57 first-year students from various engineering degrees. The quasi-experimental design with pre- and post-tests and a control group is described. The results showed that students who use the method of generating MCQs to prepare exams sometimes improve their learning significantly in comparison with the control group. The method also provides a new way to detect students' misconceptions about the concepts covered in class, which thus allows the evolution of their knowledge to be evaluated. Finally, it should be noted that the students valued the method used positively.
Visual Thinking and Reading Comprehension: Foreign Language Setting as an Example
imagery reading sub-skills visual thinking strategy visualization yarmouk university...
This study examines how visual thinking may affect Jordanian female ninth-graders reading abilities. The design had an experimental feel about it. The study included 66 ninth-grade female students who were studying English as a foreign language (EFL). An instructional program was created and put into place, and a pre-post reading exam was created to help the study reach its objective. The results were examined using SPSS. The findings show that there are statistically significant changes in the steps of the visual thinking strategy (VTS) modality between the two groups, with the experimental group benefiting more. VTS has been proven to be a successful strategy for greatly enhancing student attainment of good marks and having an impact on student achievement of course learning outcomes. This study triggered the following reading sub-skills: vocabulary acquisition, imaging, building and activating schema, identifying the main idea and details, questioning, inferring, communicating through oral language, and comprehension. VTS has a real impact on teaching reading sub-skills, which is important for both teachers and curriculum designers. Longitudinal research data is required to further analyze and refine this teaching strategy.
The Development of STEM-nuanced Mathematics Teaching Materials to Enhance Students’ Mathematical Literacy Ability Through Information and Communication Technology-Assisted Preprospec Learning Model
mathematical literacy preprospec learning model stem...
The mathematical literacy ability of Indonesian pupils is still relatively low, as indicated by Indonesia's score of 379 for mathematical literacy in PISA 2018. Paying attention to the learning process such as the teaching materials used in learning, is one of ways to increase mathematical literacy skills. To strengthen students' mathematical literacy skills, it is great for building qualified mathematics teaching materials with the nuances of science, technology, engineering, and mathematics (STEM) which are supported by the information and communication technology (ICT)-assisted Preprospec (Prepare, Problem Solving, Presentation and Conclusion) Learning Model. The research method used in this study is research and development (R&D), with the main reference of 4D-model development by Thiagarajan, whose stages are limited to define, design, and develop. The results showed that the feasibility test on teaching materials obtained the total average percentage of validator I to validator V, respectively, 90.19, 95.45, 93.90, 91.95, and 97.95 with very eligible criteria. It is easy to understand by students with a readability score of ρ = .109 > α = .05 or Cochran's Q = 13.091, and it can improve students' mathematical literacy skills, as evidenced by the Wilcoxon test and a gain normalization result of 485.
The Influence of Teacher Efficacy on Education Quality: A Meta-Analysis
education quality meta-analysis study teacher efficacy...
This research aims to prove the influence of teacher efficacy on learning quality with quantitative meta-analysis. The eligibility criteria in this study include: (a) The publication can be searched in Google Scholar, ERIC, DOAJ, Research Gate, and or ScienceDirect; (b) The publication is indexed in Scopus, WoS, SINTA (a portal indexing journal managed by the Ministry of Education and Culture of the Republic of Indonesia, equivalent to DOAJ and Index Copernicus), DOAJ, Index Copernicus, and at least they must be indexed in Google Scholar; (c) The topic of the studies must be relevant; (d) The studies must be carried out in the 2014-2023 year range; (e) The publication must have a value of (r), (t) or (F); (f) The studies have a magnitude of N ≥ 20. This study used the JASP application for data analysis. The results showed that: (a) the 40 studies analyzed were heterogeneous and normally distributed; (b) the influence of teacher efficacy on education quality is classified as strong (p < 0.05; rRE = 0.800); (c) publication bias was not detected. This study concluded that teacher efficacy has a strong influence on education quality.