'Assessment' Search Results
Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review
likert scale literature review potential bias reliability and validity...
This study reviews 60 papers using a Likert scale and published between 2012 – 2021. Screening for literature review uses the PRISMA method. The data analysis technique was carried out through data extraction, then synthesized in a structured manner using the narrative method. To achieve credible research results at the stage of the data collection and data analysis process, a group discussion forum (FGD) was conducted. The findings show that only 10% of studies use a measurement scale with an even answer choice category (4, 6, 8, or 10 choices). In general, (90%) of research uses a measurement instrument that involves a Likert scale with odd response choices (5, 7, 9, or 11) and the most popular researchers use a Likert scale with a total response of 5 points. The use of a rating scale with an odd number of responses of more than five points (especially on a seven-point scale) is the most effective in terms of reliability and validity coefficients, but if the researcher wants to direct respondents to one side, then a scale with an even number of responses (six points) is possible. more suitable. The presence of response bias and central tendency bias can affect the validity and reliability of the use of the Likert scale instrument.
Best Practices of Fostering Undergraduates’ Cross-Cultural Competence Involving Training Them in Foreign Languages: Systemic Review
cross-cultural competence foreign languages training higher education instructional approaches systemic review...
The purpose of the study was to identify and categorise the criteria-specified instructional approaches to fostering undergraduates’ cross-cultural skills involving training them in foreign languages and to evaluate their effectiveness and feasibility. It was a systemic review of the effectiveness type. The descriptive content analysis was used as a methodology within the study to analyse the relevant short-listed sources. The triangular assessment method (TAM) was applied by instructors from Ukraine to rate each approach’s/programme/course’s potential effectiveness and/or feasibility for the context of higher education in Ukraine. This review identified potentially effective and feasible approaches/programmes/courses that can be converged to produce more efficient instructional models for fostering undergraduates’ cross-cultural skills. The selected approaches or courses or programmes could be categorised as technology-driven approaches, approaches based on classroom activities or using specific instruction models, psychological effect-driven approaches, and combined or converged approaches. The use of technology-driven approaches seems to be the emerging instructional trend specifically in training students’ cross-cultural skills.
The Implementation of Dual Language Programme for Mathematics Education in Secondary Schools: A Systematic Literature Review
bilingual dual language programme (dlp) mathematics prisma systematic literature review...
The study discussed in this paper is a systematic literature review related to the role of dual language programme (DLP) in mathematics education which has been published within the last 5 years. This study was conducted to identify the distribution of DLP studies in terms of year of publication, the study context covered in previous studies, the context of study areas used, focus and trends of past studies, research methods used in previous studies and the role of language in school mathematics education. This review study followed the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyzes (PRISMA) to analyze articles from Scopus and Web of Science. The findings of the study indicate that research trends in the implementation of the DLP on mathematics education for secondary school students showed an increase from 2017 to 2019. Most DLP-related articles are widely developed in the United States and Germany. The findings indicate that previous studies are more interested in studying the implementation of DLP in rural areas. Past studies have also preferred to use the design of either a qualitative study or a quantitative study to be implemented. Questionnaires, tests and interviews are among the research instruments that are often used for a study.
Rethinking the Components of Regulation of Cognition through the Structural Validity of the Meta-Text Test
metacognition performance-based testing regulation of cognition structural validity...
The field of studies in metacognition points to some limitations in the way the construct has traditionally been measured and shows a near absence of performance-based tests. The Meta-Text is a performance-based test recently created to assess components of cognition regulation: planning, monitoring, and judgment. This study presents the first evidence on the structural validity of the Meta-Text, by analyzing its dimensionality and reliability in a sample of 655 Honduran university students. Different models were tested, via item confirmatory factor analysis. The results indicated that the specific factors of planning and monitoring do not hold empirically. The bifactor model containing the general cognition regulation factor and the judgment-specific factor was evaluated as the best model (CFI = .992; NFI = .963; TLI = .991; RMSEA = .021). The reliability of the factors in this model proved to be acceptable (Ω = .701 & .699). The judgment items were well loaded only by the judgment factor, suggesting that the judgment construct may actually be another component of the metacognitive knowledge dimension but having little role in cognition regulation. The results show initial evidence on the structural validity of the Meta-Text and give rise to information previously unidentified by the field which has conceptual implications for theorizing metacognitive components.
Language Tests, Motivation, and Demotivation: A Complex Relationship
demotivation language learning motivation language tests motivation...
Tests are an integral part of most formal language learning processes, exerting far-reaching effects on many aspects of language learning. Among other things, tests affect language learning motivation (LLM), an element that is fundamental to many learning contexts. However, little attention has been paid to how tests affect LLM and what the pedagogical implications may be. Using qualitative semi-structured interviews with 20 adolescent Arab learners, this study attempts to explore how and when tests can motivate or demotivate language learners. It also examines the main strategies learners deploy to cope with the demotivating experiences associated with test taking. The data suggest that tests have the potential to both motivate and demotivate learners before, during, and after taking a test. Additionally, the results reveal several strategies that learners employ to cope with demotivation. This leads to a discussion regarding pedagogical implications on how to effectively employ tests to increase learners’ motivation and decrease their demotivation.
Game-Based Learning in Higher Education: The Pedagogical Effect of Genially Games in English as a Foreign Language Instruction
efl teaching game-based learning genially grammar vocabulary...
This study aimed to analyze the effect of game-based learning (GBL) through the use of Genially in English as a foreign language (EFL) online instruction. The participants were 61 EFL undergraduate students, who were distributed into an experimental group (32 students), and a control group (29 students). Their ages ranged from 22 to 56 years old, and their English proficiency level was B1, according to the Common European Framework of References (CEFR). The students were enrolled in two pre-intermediate courses that are part of an EFL Teaching program at a private university in southern Ecuador. The courses were delivered in an online remote learning environment due to the COVID-19 pandemic. The study followed a quasi-experimental approach and it took place over a sixteen-week period. The instruments included a diagnostic survey, a pre-test, a post-test, a students’ perceptions survey, and a semi-structured interview. The main findings revealed that Genially games have the potential to enhance EFL learners’ academic performance in online instruction, particularly in aspects related to students’ knowledge of grammar and vocabulary in context. Besides, it was found that according to students’ perceptions, the implementation of games based on their real learning needs increases their motivation, especially when feedback is effectively provided.
Students’ Challenges and Support Needed in Reaching Academic Literacies in Higher Education: In-Depth Interviews with Swedish Students
academic literacies explicit education feedback pedagogical capital...
The aim of this study is to capture and analyse perspectives on higher education from the views of five students through in-depth interviews. The students' statements are analyzed in order to gain an understanding of their experiences of developing academic literacies in their university studies. They are regularly visiting the university study workshop for help with their exam assignments. The following questions have been formulated to fulfil the aim of the study: (a) what aspects of studies in higher education do the students express as important, favorable, or unfavorable, for their development of academic literacies? and (b) in what way do the students value the study workshops as an educational tool? The analysis reveals three themes: the importance of explicit support structures, the importance of teachers’ feedback, and the importance of using the students’ pedagogical capital. The results also show that the students highly value the study workshop when they reflect upon the one-to-one feedback, but the support seems to be insufficient both in supporting them to be more independent in their studies and in developing academic literacies from a critical and epistemological point of view.
Natural Disaster Education in School: A Bibliometric Analysis with a Detailed Future Insight Overview
bibliometric analysis; natural disaster; natural disaster education; natural disaster literacy...
In some places of the world, disasters occur virtually every day. If disasters are not properly foreseen, they may result in many fatalities. This research aims to examine the growth and pattern of literature on natural disaster education in schools. This analytical strategy combines quantitative and statistical methods to discover trends, assess quality, and track development. A total of 216 documents were chosen from the 403 documents collected. Following 2015, there was a considerable increase in four-year publications. Authors from the United States contributed to 45 papers with 37% citations and ranked first, followed by authors from Japan (31 documents; 15% citations) and Indonesia (31 documents) with rankings citations below the top 10. Most publications were published in the International Journal of Disaster Risk Reduction (12 docs; Q1 Scimago Journal Rank 1.1 (SJR 1.1)). The Journal of Child Psychology and Psychiatry and Allied Disciplines had the most citations (100; Q1 SJR 3.6) and was ranked first in its discipline. The existing core literature on school education on natural disasters demonstrates that this topic is developing rapidly, but with insufficient international research collaboration. Research cooperation in this area must be strengthened to better the global response to natural disaster mitigation, which should begin in schools worldwide. There is a need to widen the scope of study in this field to include natural disaster preparedness education in the school curriculum, assessments, learning media, disaster response education, and instructional designs. Finally, disaster education in schools must be addressed as soon as possible to contribute to disaster preparedness.
Best Practices for Teaching Chemistry Disciplines to Graduates Majoring in Pharmacy During the COVID-19 Restrictions: A Systematic Review
pharmacy graduates higher education systematic review teaching chemistry disciplines...
The purpose of the study was to identify the - interventions that can be adopted for teaching chemistry disciplines to the graduates majoring in Pharmacy (Mpharm) in Ukraine. The study employed a systematic review methodology and a qualitative approach to synthesising the sources. The triangular assessment method was used to rate the short-listed instructional interventions for feasibility, transferability, and duplicability in the settings of teaching chemistry disciplines to pharmacy graduates in Ukraine. The review found seven eligible publications for the analysis. It was identified that the shortlisted instructional models were technology-mediated and positively affected students’ skills and occupational knowledge. Three out of seven instructional models used chatbots and AI to automate the process of management of students learning activity which suggested that automation of the process of educational content delivery was becoming an emerging trend in instructional design. Having performed the triangular assessment method (TAM) analysis, three instructional models were given preference in terms of their use in medical education settings in Ukraine. These models were as follows: a) PhET simulations-based model, b) the model based on automated delivery of the course using the Smart Sender platform and c) the model based on automation of the Moodle-driven e-course using Dialogflow chatbot.
Involvement of Teachers, Parents, and School Committees in Improving Scientific Attitudes of Elementary School Students: Application of Rasch Model Analysis
parents rasch model scientific attitude school committee teachers...
This research analyzed the involvement of teachers, parents, and school committees in improving scientific attitudes in science learning using Rasch model analysis. A survey method was used in this quantitative study. Participants in the study were selected using a purposive sample of 174 teachers, parents, and school committees in Sleman and Kebumen Regencies, Indonesia. A questionnaire was used in data collection to determine the involvement of teachers, parents, and school committees in improving scientific attitudes toward science learning. The questionnaires were completed using a Likert scale of 1-4, and the data were then analyzed using the Rasch model. The result showed that all participants were the average logit items (+1.03 logit). The reliability was 0.89, indicating a positive response to improving students' scientific attitudes. The results of the Rasch model analysis suggested that the involvement of parents, teachers, and school committees in improving scientific attitudes differed according to their roles. Each instrument element was analyzed in more detail in the Rasch model. Participants' roles were reflected in the specific involvements of teachers in learning, parents at home with children, and school committees participating in school policy-making.
Knowledge, Skills and Attitude of Pre-Service Mathematics Teachers Towards Higher-Order Thinking Skills
exposure higher-order thinking skills teaching...
This research was aimed to determine the level of knowledge, skills and attitude of pre-service Mathematics teachers in Universiti Pendidikan Sultan Idris (UPSI) towards higher-order thinking skills (HOTS) and whether the elements of HOTS were translated into the teaching courses. The research was also designed to analyze the relationship between the pre-service Mathematics teachers’ exposure to HOTS through the teaching courses and their level of knowledge, skills and attitude towards HOTS. The study utilized a quantitative approach by administration of a survey to a simple random sample of 110 pre-service Mathematics teachers from UPSI. A questionnaire with five different parts was used as the research instrument with a reliability value of .979. The collected data were then analyzed using descriptive and inferential statistics. The descriptive statistics were used to determine the mean scores of the level of knowledge, skills and attitude among the pre-service Mathematics teachers, whereas inferential statistics using Pearson-r correlation was implemented to describe the relationship between the studied variables. The findings demonstrated that the knowledge and skills of pre-service Mathematics teachers towards HOTS were at a moderate level as opposed to their attitude and exposure to HOTS which were found to be at a high level. The data analysis using Pearson correlation illustrated a significant positive relationship with r = .727, r = .757 and r = .667 between the exposure to HOTS through the teaching courses and the level of knowledge, skills and attitude regarding HOTS of pre-service Mathematics teachers at UPSI, respectively. In conclusion, the research here indicates that pre-service Mathematics teachers in general, are positive towards the implementation of HOTS but they are lacking in terms of knowledge and skills. This research is useful in the field of Mathematics education as it can serve as a guidance to further enhance the knowledge, skills and attitudes especially for future Mathematics teachers in implementing HOTS effectively and improving the quality of the teaching program offered by the university indirectly.
Factor Structure and Dimensionality of an Instrument designed to Measure the Metacognitive Orientation of Thai Science Classroom Learning Environments
classroom learning environments metacognition science education...
The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) in the Thai context. The metacognitive orientation of a science classroom learning environment is defined as the extent to which psychosocial conditions that are known to enhance students’ metacognition are evident in a specific science classroom. This study builds on earlier work in the research areas of science education, metacognition, and learning environments. A sample of 5418 Thai science students in grades 10 to 12, from 40 schools across Thailand, completed the MOLES-S that had been translated into Thai. Exploratory factor analysis was undertaken and Rasch analysis was used to calibrate the scale and explore its dimensionality. The results suggest that the MOLES-S(T), where (T) represents Thailand, has the same factor structure as the original MOLES-S, is reliable, and can be used with confidence in research into metacognition in Thai high school science classrooms.
Psychometric Properties of Online Adolescent Anger Instrument
adolescent anger expressions exploratory factor analysis online instrument...
Anger is a topic that requires intervention from teachers, counsellors, psychologists, parents, and all communities. The expressions of anger are subjective and sometimes hard to identify. Thus, anger should be measured more objectively, while the expressions need to be examined closely. The purpose of this study is to provide valid confirmation for development of an online instrument to measure the types of anger expression among adolescents. Data were collected from 935 adolescents from nine schools in northern Malaysia and the theoretical literature search. The data were analysed to provide evidence of construct validity in terms of item factor analysis, reliability estimates, and correlation between the types of anger expressions. Findings were used to develop an online Adolescent Anger Instrument. It measures five types of anger expressions, namely, physical, verbal, intrinsic, extrinsic, and passive. The results showed that the instrument is internally consistent with high evidence of construct validity. Exploratory factor analysis, with varimax rotation, suggested the existence of five distinct types of anger as conceptualised. Meanwhile, the correlation between types of anger expressions indicates the strength of the relationship between them. Discussions on the findings are provided, while suggestions for future research are also described.
The Evaluation of the English Language Teacher Education Program in Turkey
curriculum evaluation efl teacher education program teacher education...
This study aims to evaluate the English language teacher training program which was put into practice in 2006, according to the views of lecturers and English teachers. This study aims to contribute to the studies on foreign language teaching by presenting an evaluation of teacher education, which is an important dimension of English as a foreign language teaching. The qualitative method was used in the study, which was designed in a descriptive survey model. The population of the research consists of 35 lecturers working at the English Language Teaching Department of different Education Faculties in the 2016-2017 academic year and 11 English teachers working in public schools affiliated with the Ministry of National Education and who have not completed 5 years in the profession. NVIVO-11 program was used in the analysis of the data. The results of the study were compared with the 2018 English teacher education program renewed by the Council of Higher Education. English teachers and lecturers think that the content knowledge, pedagogical content knowledge, and general culture courses in the teacher training program are insufficient. According to English teachers and lecturers the content knowledge, pedagogical content knowledge, and general culture courses in the English language teacher education program are insufficient. Furthermore, English teachers stated that they could not apply what they learned during their training to real-life conditions. Therefore, they propose that the English language teacher training program should be revised considering the current conditions.
Use of Gamification in Primary and Secondary Education: A Systematic Literature Review
game design elements gamification in education systematic literature review...
Gamification in education refers to the application of game design elements and game principles in teaching with the goal of increasing students’ motivation and engagement, which contributes to more successful achievement of learning outcomes. Gamification can be used in education at different levels, from primary and secondary schools to universities and adult education. An analysis of the literature on the use of gamification in education has shown that it is more common in university education and less common in primary and secondary schools. Nonetheless, experience shows that games and numerous digital tools are successfully used in schools for the purpose of gamification, although this is generally not supported by the relevant research published in the papers. The research presented in this paper represents a systematic review of the literature on relevant research on the use of gamification in primary and secondary schools to explore the field and make recommendations for future research. The conclusion is that research on gamification should continue to suggest appropriate pedagogical and technological frameworks which would facilitate the use of gamification in schools by teachers.
Assessment of Gaming Addiction and Perceived Psychological Distress Among Filipino Young Adults During COVID-19 Pandemic
covid-19 pandemic game addiction interactive online games psychological distress psychological intervention program...
Online game addiction and psychological distress are two continuously developing problems in the Philippines, with Filipinos aged 18 to 24 being the second largest age group to overuse interactive online-related games. This sequential explanatory mixed method study aimed to assess the young adults’ gaming addiction and perceived psychological distress during the COVID-19 pandemic and identify the other factors contributing to the respondents’ frequent engagement in online interactive games, which served as a basis for a preventive intervention program. The researcher administered the survey questionnaires of the Gaming Addiction Scale and Depression Anxiety Stress Scale-21 to 399 young adults aged 18–24 and a semi-structured interview guide to 20 addicted and non-addicted gamers. Key results showed that a small percentage of the respondents experienced polythetic and serious monothetic addiction to interactive online games. In contrast, half of the respondents manifested mild to moderate symptoms of depression and anxiety during the COVID-19 pandemic. Major findings also found no significant gender differences in the level of online game addiction and psychological distress during the COVID-19 pandemic, and a moderate level of relationship substantiated the association. Further results revealed that the negative compensatory factors were associated with addicted gamers’ frequent engagement with online games, whereas non-addicted gamers were associated with positive, beneficial factors. This phenomenon has hardly ever been the focus of in-depth research, and the results of this study can be used to further refine the conceptualization of “internet gaming disorder” as a mental disorder and develop a more comprehensive treatment method.
Graded Response Models on the Curiosity Measurement of Elementary School Students
curiosity measurement elementary school graded response models...
Curiosity is one of the most important characters for elementary school students. However, the facts in the field show that the measurement model used by the teacher to identify the student's curiosity is not yet available in a standardized manner. This study aims to develop a model for measuring the curiosity of elementary school students using the graded response model (GRM) approach. This research uses quantitative method with descriptive type. The research sample used was 236 elementary school students who were randomly selected. Data were collected using a questionnaire of 16 statement items using a Likert scale approach. The data were analyzed using the response item theory approach with the GRM. The results showed that the model for measuring student curiosity in elementary schools had good location parameters, a good discriminant index, a fairly good information function with a small estimation error. The curiosity measurement model in this study can be used as an alternative for teachers to identify students' curiosity in elementary schools.
The Effect of Coding Education on Analytical Thinking of Gifted Students
analytical thinking coding gifted students...
This research aims to examine the effect of coding education on the analytical thinking skills of gifted students. The participants are 18 students, 11 to 12 years old. An embedded experimental mixed design was used in the research. The data collection was carried out with the Analytical Thinking Skill Scale to determine the difference in the analytical thinking skills of the study group before and after the coding training; the Analytical Thinking Skill Observation Form to determine the analytical thinking skill levels during the implementation process; and the semi-structured interview form to get their opinions on the coding training. The data were analyzed with a pre-test-post-test quasi-experimental design, descriptive analysis, and content analysis. The results show that coding education developed the participants' analytical thinking skills. The difference in the analytical thinking skills of the study group was not statistically significant in terms of gender. According to the students' views on the coding education application process, there was an improvement in the sub-dimensions of sorting, classification, comparison, and evaluation in analytical thinking skills; coding education developed problem-solving and thinking skills, was useful, encouraged students to choose a profession, and was entertaining, as well as negative opinions such as being difficult, boring, and requiring a lack of time.
Analysing Teachers’ Perception of the Try-Understand-Apply-Mastered Discovery Learning Processes in Vanuatu Using the Constructivist Grounded Theory Approach
21st century skills constructivist grounded theory i do–we do–you do try-understand-apply-mastered (tuam)...
Internal and external assessment instruments, such as the Vanuatu Standard Test of Achievements (VANSTA) and the Pacific Island Literacy and Numeracy Assessment (PILNA), reveal that mathematics achievements in the Republic of Vanuatu remain below the minimum standard. This study drew on the constructivist grounded theory approach to explore teachers' perspectives of the learning and teaching processes in mathematics education in the Republic of Vanuatu. Specifically, the focus was on the ‘I do-we do-you do’ approach of teaching, which is common in mathematics education in the country. Teachers' opinions about the current situation of mathematics education and possibilities for improving it were extracted using semi-structured interviews with 22 teachers from two randomly selected urban schools. Based on the constructivist grounded theory analysis, four major interlink themes were found. Overall, the findings show that mathematics achievements in the country can be improved through proven discovery-learning strategies for stimulating students' mathematical thinking in the 21st century, such as the ‘try-understand-apply-mastered’ (TUAM) discovery learning process.
Mathematical Creativity: Student Geometrical Figure Apprehension in Geometry Problem-Solving Using New Auxiliary Elements
cognitive flexibility geometrical figure apprehension mathematical creativity new auxiliary elements...
The definition of creativity among professional mathematicians and the definition of mathematical creativity in the classroom context are significantly different. The purpose of this study was to investigate the relationship between students’ mathematical creativity (i.e., cognitive flexibility) and figure apprehension when solving geometric problems with novel auxiliary features such as straight lines and curved lines. In other words, this study determined if geometry knowledge influenced mathematical creativity (cognitive flexibility) in problem-solving. Grade-12 students participated in the intervention. The high school that is the research topic attempts to equip students with academic abilities and is, except for vocational schools, the most popular form of high school among all other types. Such a school was chosen for the study so that a significant proportion of students in Makassar could be represented. In this study, we discovered a relationship between cognitive flexibility and the geometric ability of pupils while solving problems involving auxiliary lines. This indicates that the usage of auxiliary lines as a reference for developing pupils’ creative thinking skills must be advocated. In addition, good geometric abilities (e.g., visual thinking, geometrical reasoning) will encourage pupils to generate various problem-solving concepts. This finding contributes significantly to future research by focusing on auxiliary lines.