Search results for: Students’ Assessment and Self-Assessment
11195 Internal and External Factors Affecting Teachers’ Adoption of Formative Assessment to Support Learning
Authors: Kemal Izci
Abstract:
Assessment forms an important part of instruction. Assessment that aims to support learning is known as formative assessment and it contributes student’s learning gain and motivation. However, teachers rarely use assessment formatively to aid their students’ learning. Thus, reviewing the factors that limit or support teachers’ practices of formative assessment will be crucial for guiding educators to support prospective teachers in using formative assessment and also eliminate limiting factors to let practicing teachers to engage in formative assessment practices during their instruction. The study, by using teacher’s change environment framework, reviews literature on formative assessment and presents a tentative model that illustrates the factors impacting teachers’ adoption of formative assessment in their teaching. The results showed that there are four main factors consisting personal, contextual, resource-related and external factors that influence teachers’ practices of formative assessment.Keywords: assessment practices, formative assessment, teacher education, factors for use of formative assessment
Procedia PDF Downloads 37611194 A Study of EFL Learners with Different Goal Orientations in Response to Cognitive Diagnostic Reading Feedback
Authors: Yuxuan Tang
Abstract:
Cognitive diagnostic assessment has received much attention in second language education, and assessment for it can provide pedagogically useful feedback for language learners. However, there is a lack of research on how students interpret and use cognitive diagnostic feedback. Thus the present study aims to adopt a mixed-method approach mainly to explore the relationship between the goal-orientation and students' response to cognitive diagnostic feedback. Almost 200 Chinese undergraduates from two universities in Xi'an, China, will be invited to do a cognitive diagnostic reading test, and each student will receive specialized cognitive diagnostic feedback, comprising of students' reading attributes mastery level generated by applying a well-selected cognitive diagnostic model, students' perceived reading ability assessed by a self-assessing questionnaire and students’ level position in the whole class. And a goal-orientation questionnaire and a self-generated questionnaire on the perception of feedback will be given to students the moment they receive feedback. In addition, interviews of students will be conducted on their future plans to see whether they have awareness of carrying out studying plans. The study aims to find a new perspective towards how students use and interpret cognitive diagnostic feedback in terms of their different goal-orientation (self-based, task-based, and other-based goals) by applying the newest goal orientation model, which is an important construct of motivation in psychology, seldom researched under language learning area. And the study is expected to provide evidence on how diagnostic feedback promotes students' learning under the educational belief of assessment for learning. Practically speaking, according to the personalized diagnostic feedback, students can take remedial self-learning more purposefully, and teachers can target students' weaknesses to adjust teaching methods and carry out tailored teaching.Keywords: assessment for learning, cognitive diagnostic assessment, goal-orientation, personalized feedback
Procedia PDF Downloads 13211193 The Role of Validity and Reliability in the Development of Online Testing
Authors: Ani Demetrashvili
Abstract:
The purpose of this paper is to show how students trust online tests and determine validity and reliability in the development of online testing. The pandemic situation changed every field in the world, and it changed education as well. Educational institutions moved into the online space, which was the only decision they were able to make at that time. Online assessment through online proctoring was a totally new challenge for educational institutions, and they needed to deal with it successfully. Participants were chosen from the English language center. The validity of the questionnaire was identified according to the Likert scale and Cronbach’s alpha; later, data from the participants was analyzed as well. The article summarizes literature that is available about online assessment and is interesting for people who are interested in this kind of assessment. Based on the research findings, students favor in-person testing over online assessment due to their lack of experience and skills in the latter.Keywords: online assessment, online proctoring
Procedia PDF Downloads 4011192 The Comparative Effect of Practicing Self-Assessment and Critical Thinking Skills on EFL Learners’ Writing Ability
Authors: Behdokht Mall-Amiri, Sara Farzaminejad
Abstract:
The purpose of the present study was to discover which of the two writing activities, a self-assessment questioner or a critical thinking skills handout, is more effective on Iranian EFL learners’ writing ability. To fulfill the purpose of the study, a sample of 120 undergraduate students of English SAT for a standardized sample of PET. Eighty-two students whose scores fell one standard deviation above and below the sample mean were selected and randomly divided into two equal groups. One group practiced self-assessment and the other group practiced critical thinking skills while they were learning process writing. A writing posttest was finally administered to the students in both groups and the mean rank scores were compared by t-test. The result led to the rejection of the null hypothesis, indicating that practicing critical thinking skills had a significantly higher effect on the writing ability. The implications of the study for students and teachers as well as course book designers are discussed.Keywords: writing ability, process writing, critical thinking skills, self-assessment
Procedia PDF Downloads 33611191 The Analysis of Gizmos Online Program as Mathematics Diagnostic Program: A Story from an Indonesian Private School
Authors: Shofiayuningtyas Luftiani
Abstract:
Some private schools in Indonesia started integrating the online program Gizmos in the teaching-learning process. Gizmos was developed to supplement the existing curriculum by integrating it into the instructional programs. The program has some features using an inquiry-based simulation, in which students conduct exploration by using a worksheet while teachers use the teacher guidelines to direct and assess students’ performance In this study, the discussion about Gizmos highlights its features as the assessment media of mathematics learning for secondary school students. The discussion is based on the case study and literature review from the Indonesian context. The purpose of applying Gizmos as an assessment media refers to the diagnostic assessment. As a part of the diagnostic assessment, the teachers review the student exploration sheet, analyze particularly in the students’ difficulties and consider findings in planning future learning process. This assessment becomes important since the teacher needs the data about students’ persistent weaknesses. Additionally, this program also helps to build student’ understanding by its interactive simulation. Currently, the assessment over-emphasizes the students’ answers in the worksheet based on the provided answer keys while students perform their skill in translating the question, doing the simulation and answering the question. Whereas, the assessment should involve the multiple perspectives and sources of students’ performance since teacher should adjust the instructional programs with the complexity of students’ learning needs and styles. Consequently, the approach to improving the assessment components is selected to challenge the current assessment. The purpose of this challenge is to involve not only the cognitive diagnosis but also the analysis of skills and error. Concerning the selected setting for this diagnostic assessment that develops the combination of cognitive diagnosis, skills analysis and error analysis, the teachers should create an assessment rubric. The rubric plays the important role as the guide to provide a set of criteria for the assessment. Without the precise rubric, the teacher potentially ineffectively documents and follows up the data about students at risk of failure. Furthermore, the teachers who employ the program of Gizmos as the diagnostic assessment might encounter some obstacles. Based on the condition of assessment in the selected setting, the obstacles involve the time constrain, the reluctance of higher teaching burden and the students’ behavior. Consequently, the teacher who chooses the Gizmos with those approaches has to plan, implement and evaluate the assessment. The main point of this assessment is not in the result of students’ worksheet. However, the diagnostic assessment has the two-stage process; the process to prompt and effectively follow-up both individual weaknesses and those of the learning process. Ultimately, the discussion of Gizmos as the media of the diagnostic assessment refers to the effort to improve the mathematical learning process.Keywords: diagnostic assessment, error analysis, Gizmos online program, skills analysis
Procedia PDF Downloads 18211190 Development and Validation of the University of Mindanao Needs Assessment Scale (UMNAS) for College Students
Authors: Ryan Dale B. Elnar
Abstract:
This study developed a multidimensional need assessment scale for college students called The University of Mindanao Needs Assessment Scale (UMNAS). Although there are context-specific instruments measuring the needs of clinical and non-clinical samples, literature reveals no standardized scales to measure the needs of the college students thus a four-phase item development process was initiated to support its content validity. Comprising seven broad facets namely spiritual-moral, intrapersonal, socio-personal, psycho-emotional, cognitive, physical and sexual, a pyramid model of college needs was deconstructed through FGD sample to support the literature review. Using various construct validity procedures, the model was further tested using a total of 881 Filipino college samples. The result of the study revealed evidences of the reliability and validity of the UMNAS. The reliability indices range from .929-.933. Exploratory and confirmatory factor analyses revealed a one-factor-six-dimensional instrument to measure the needs of the college students. Using multivariate regression analysis, year level and course are found predictors of students’ needs. Content analysis attested the usefulness of the instrument to diagnose students’ personal and academic issues and concerns in conjunction with other measures. The norming process includes 1728 students from the different colleges of the University of Mindanao. Further validation is recommended to establish a national norm for the instrument.Keywords: needs assessment scale, validity, factor analysis, college students
Procedia PDF Downloads 44111189 A Study of Transferable Skills for Work-Based Learning (WBL) Assessment
Authors: Abdool Qaiyum Mohabuth
Abstract:
Transferrable skills are learnt abilities which are mainly acquired when experiencing work. University students have the opportunities to develop the knowledge and aptitude at work when they undertake WBL placement during their studies. There is a range of transferrable skills which students may acquire at their placement settings. Several studies have tried to identify a core set of transferrable skills which students can acquire at their placement settings. However, the different lists proposed have often been criticised for being exhaustive and duplicative. In addition, assessing the achievement of students on practice learning based on the transferrable skills is regarded as being complex and tedious due to the variability of placement settings. No attempt has been made in investigating whether these skills are assessable at practice settings. This study seeks to define a set of generic transferrable skills that can be assessed during WBL practice. Quantitative technique was used involving the design of two questionnaires. One was administered to University of Mauritius students who have undertaken WBL practice and the other was slightly modified, destined to mentors who have supervised and assessed students at placement settings. To obtain a good representation of the student’s population, the sample considered was stratified over four Faculties. As for the mentors, probability sampling was considered. Findings revealed that transferrable skills may be subject to formal assessment at practice settings. Hypothesis tested indicate that there was no significant difference between students and mentors as regards to the application of transferrable skills for formal assessment. A list of core transferrable skills that are assessable at any practice settings has been defined after taking into account their degree of being generic, extent of acquisition at work settings and their consideration for formal assessment. Both students and mentors assert that these transferrable skills are accessible at work settings and require commitment and energy to be acquired successfully.Keywords: knowledge, skills, assessment, placement, mentors
Procedia PDF Downloads 27711188 The Influence of Mathematic Learning Outcomes towards Physics Ability in Senior High School through Authentic Assessment System
Authors: Aida Nurul Safitri, Rosita Sari
Abstract:
Physics is science, which in its learning there are some product such as theory, fact, concept, law and formula. So that to understand physics lesson students not only need a theory or concept but also mathematical calculation to solve physics problem through formula or equation. This is can be taken from mathematics lesson which obtained by students. This research is to know the influence of mathematics learning outcomes towards physics ability in Senior High School through authentic assessment system. Based on the researches have been discussed, is obtained that mathematic lesson have an important role in physics learning but it according to one aspect only, namely cognitive aspect. In Indonesia, curriculum of 2013 reinforces displacement in the assessment, from assessment through test (measuring the competence of knowledge based on the result) toward authentic assessment (measuring the competence of attitudes, skills, and knowledge based on the process and results). In other researches are mentioned that authentic assessment system give positive responses for students to improve their motivation and increase the physics learning in the school.Keywords: authentic assessment, curriculum of 2013, mathematic, physics
Procedia PDF Downloads 24811187 E-Portfolios as a Means of Perceiving Students’ Listening and Speaking Progress
Authors: Heba Salem
Abstract:
This paper aims to share the researcher’s experience of using e-Portfolios as an assessment tool to follow up on students’ learning experiences and performance throughout the semester. It also aims at highlighting the importance of students’ self-reflection in the process of language learning. The paper begins by introducing the advanced media course, with its focus on listening and speaking skills, and introduces the students’ profiles. Then it explains the students’ role in the e-portfolio process as they are given the option to choose a listening text they studied throughout the semester and to choose a recorded oral production of their collection of artifacts throughout the semester. Students showcase and reflect on their progress in both listening comprehension and speaking. According to the research, re-listening to work given to them and to their production is a means of reflecting on both their progress and achievement. And choosing the work students want to showcase is a means to promote independent learning as well as self-expression. Students are encouraged to go back to the class learning outcomes in the process of choosing the work. In their reflections, students express how they met the specific learning outcome. While giving their presentations, students expressed how useful the experience of returning and going over what they covered to select one and going over their production as well. They also expressed how beneficial it was to listen to themselves and literally see their progress in both listening comprehension and speaking. Students also reported that they grasped more details from the texts than they did when first having it as an assignment, which coincided with one of the class learning outcomes. They also expressed the fact that they had more confidence speaking as well as they were able to use a variety of vocabulary and idiomatic expressions that students have accumulated. For illustration, this paper includes practical samples of students’ tasks and instructions as well as samples of their reflections. The results of students’ reflections coincide with what the research confirms about the effectiveness of the e-portfolios as a means of assessment. The employment of e-Portfolios has two-folded benefits; students are able to measure the achievement of the targeted learning outcomes, and teachers receive constructive feedback on their teaching methods.Keywords: e-portfolios, assessment, self assessment, listening and speaking progress, foreign language, reflection, learning out comes, sharing experience
Procedia PDF Downloads 9711186 A Review of End-of-Term Oral Tests for English-Majored Students of HCMC Open University
Authors: Khoa K. Doan
Abstract:
Assessment plays an essential role in teaching and learning English as it aims to measure the learning outcomes. Designing appropriate test types and procedures for four skills, especially productive skills, is a very challenging task for teachers of English. The assessment scheme is supposed to provide precise measures and fair opportunities for students to demonstrate what they can do with their language skills. This involves content domains, measurement techniques, administrative feasibility, target populations, and potential sources of testing bias. Based on these elements, a review of end-of-term speaking tests for English-majored students at Ho Chi Minh City Open University (Viet Nam) was undertaken for the purpose of analyzing the strengths and limitations of the testing tool for the speaking assessment. It helped to identify what could be done to facilitate the process of teaching and learning in that context.Keywords: assessment, oral tests, speaking, testing
Procedia PDF Downloads 32011185 Creativity, Formative Assessment and Students’ Writing of Subject-Specific Texts
Authors: Per Blomqvist
Abstract:
This study is part of a larger research project on creativity and writing cultures in upper secondary schools in Sweden, with the purpose of exploring how formative assessment practices can be developed to better support students' writing of subject-specific texts. The purpose of the study is to shed light on how writing has changed over time in the subjects of Social Studies and Swedish, especially regarding changes in the formative assessment practice in relation to students opportunities to take part in creative writing processes that can develop their subject specific-writing. Theoretically, the study is based on concepts and models concerning creativity, writing instructions and formative assessment, especially regarding scaffolding in relation to the development of students' subject-specific writing. The empirical data consists of video recordings of teacher groups' conversations from five upper secondary schools in Sweden, compromising a total of twenty teachers. The conversations were conducted as so-called collective remembering interviews, a method to stimulate the participants' memory through social interaction, and focused on addressing issues on how writing assessment has changed over time. Topic analysis was used to analyze the conversations in order to identify common descriptions and expressions among the teachers in each group. The result highlights two different assessment practices that are described as giving students different opportunities to take part in creative writing processes to develop their writing of subject-specific texts. One of the assessment practices is characterized by teachers focusing on explaining to the students what the grading criteria mean and showing sample texts that correspond to a certain grade. The teachers describe that this assessment practice has led to a formalized, instrumental and product-oriented writing culture that has negative consequences for the student's development of their subject-specific writing, which often lacks independent reasoning, own conclusions and understanding of concepts. The other assessment practice is characterized by students examining text qualities and discussing a variety of sample texts to understand what different texts require. These teachers describe the assessment practice as an exploratory work that leads to more creative writing processes where the students gradually deepen their understanding of subject-specific texts and develop their writing.Keywords: teaching for creativity, writing processes, formative assessment, subject-specific writing
Procedia PDF Downloads 5511184 Impact of Overall Teaching Program of Anatomy in Learning: A Students Perspective
Authors: Mamatha Hosapatna, Anne D. Souza, Antony Sylvan Dsouza, Vrinda Hari Ankolekar
Abstract:
Our study intends to know the effect of the overall teaching program of Anatomy on a students learning. The advancement of various teaching methodologies in the present era has led to progressive changes in education. A student should be able to correlate well between the theory and practical knowledge attained even in the early years of their education in medicine and should be able to implement the same in patient care. The present study therefore aims to assess the impact the current anatomy teaching program has on a students learning and to what extent is it successful in making the learning program effective. Specific objectives of our study to assess the impact of overall teaching program of Anatomy in a students’ learning. Description of process proposed: A questionnaire will be constructed and the students will be asked to put forth their views regarding the Anatomy teaching program and its method of assessment. Suggestions, if any will also be encouraged to be put forth. Type of study is cross sectional observations. Target population is the first year MBBS students and sample size is 250. Assessment plan is to obtaining students responses using questionnaire. Calculating percentages of the responses obtained. Tabulation of the results will be done.Keywords: anatomy, observational study questionnaire, observational study, M.B.B.S students
Procedia PDF Downloads 49911183 Assessment on Communication Students’ Internship Performances from the Employers’ Perspective
Authors: Yesuselvi Manickam, Tan Soon Chin
Abstract:
Internship is a supervised and structured learning experience related to one’s field of study or career goal. Internship allows students to obtain work experience and the opportunity to apply skills learned during university. Internship is a valuable learning experience for students; however, literature on employer assessment is scarce on Malaysian student’s internship experience. This study focuses on employer’s perspective on student’s performances during their three months of internship. The results are based on the descriptive analysis of 45 sets of question gathered from the on-site supervisors of the interns. The survey of 45 on-site supervisor’s feedback was collected through postal mail. It was found that, interns have not met their on-site supervisor’s expectations in many areas. The significance of this study is employer’s assessment on the internship shall be used as feedback to improve on ways how to prepare students for their internship and employments in future.Keywords: employers perspective, internship, structured learning, student’s performances
Procedia PDF Downloads 29511182 Implementation and Challenges of Assessment Methods in the Case of Physical Education Class in Some Selected Preparatory Schools of Kirkos Sub-City
Authors: Kibreab Alene Fenite
Abstract:
The purpose of this study is to investigate the implementation and challenges of different assessment methods for physical education class in some selected preparatory schools of kirkos sub city. The participants in this study are teachers, students, department heads and school principals from 4 selected schools. Of the total 8 schools offering in kirkos sub city 4 schools (Dandi Boru, Abiyot Kirse, Assay, and Adey Ababa) are selected by using simple random sampling techniques and from these schools all (100%) of teachers, 100% of department heads and school principals are taken as a sample as their number is manageable. From the total 2520 students, 252 (10%) of students are selected using simple random sampling. Accordingly, 13 teachers, 252 students, 4 department heads and 4 school principals are taken as a sample from the 4 selected schools purposefully. As a method of data gathering tools; questionnaire and interview are employed. To analyze the collected data, both quantitative and qualitative methods are used. The result of the study revealed that assessment in physical education does not implement properly: lack of sufficient materials, inadequate time allotment, large class size, and lack of collaboration and working together of teachers towards assessing the performance of students, absence of guidelines to assess the physical education subject, no different assessment method that is implementing on students with disabilities in line with their special need are found as major challenges in implementing the current assessment method of physical education. To overcome these problems the following recommendations have been forwarded. These are: the necessary facilities and equipment should be available; In order to make reliable, accurate, objective and relevant assessment, teachers of physical education should be familiarized with different assessment techniques; Physical education assessment guidelines should be prepared, and guidelines should include different types of assessment methods; qualified teachers should be employed, and different teaching room must be build.Keywords: assessment, challenges, equipment, guidelines, implementation, performance
Procedia PDF Downloads 28011181 Knowing Where the Learning is a Shift from Summative to Formative Assessment
Authors: Eric Ho
Abstract:
Pedagogical approaches in Asia nowadays are imported from the West. In Confucian Heritage Culture (CHC), however, there is a dichotomy between the perceived benefits of Western pedagogies and the real classroom practices in Chinese societies. The success of Hong Kong students in large-scale international assessments has proved that both the strengths of both Western pedagogies and CHC educational approaches should be integrated for the sake of the students. University students aim to equip themselves with employability skills upon graduation. Formative assessments allow students to receive detailed, positive, and timely feedback and they can identify their strengths and weaknesses before they start working. However, there remains a question of whether university year 1 students who come from an examination-driven secondary education background are ready to respond to more formative assessments. The findings show that year 1 students are less concerned about competition in the university and more open to new teaching approaches that will allow them to improve as professionals in their major study areas.Keywords: formative assessment, higher education, learning styles, Confucian heritage cultures
Procedia PDF Downloads 33411180 Albanian Students’ Errors in Spoken and Written English and the Role of Error Correction in Assessment and Self-Assessment
Authors: Arburim Iseni, Afrim Aliti, Nagri Rexhepi
Abstract:
This paper focuses mainly on an important aspect of student-linguistic errors. It aims to explore the nature of Albanian intermediate level or B1 students’ language errors and mistakes and attempts to trace the possible sources or causes by classifying the error samples into both inter lingual and intra lingual errors. The hypothesis that intra lingua errors may be determined or induced somehow by the native language influence seems to be confirmed by the significant number of errors found in Albanian EFL students in the Study Program of the English Language and Literature at the State University of Tetova. Findings of this study have revealed that L1 interference first and then ignorance of the English Language grammar rules constitute the main sources or causes of errors, even though carelessness cannot be ruled out. Although we have conducted our study with 300 students of intermediate or B1 level, we believe that this hypothesis would need to be confirmed by further research, maybe with a larger number of students with different levels in order to draw more steady and accurate conclusions. The analysis of the questionnaires was done according to quantitative and qualitative research methods. This study was also conducted by taking written samples on different topics from our students and then distributing them with comments to the students and University teachers as well. These questionnaires were designed to gather information among 300 students and 48 EFL teachers, all of whom teach in the Study Program of English Language and Literature at the State University of Tetova. From the analyzed written samples of the students and face-to-face interviews, we could get useful insights into some important aspects of students’ error-making and error-correction. These different research methodologies were used in order to comprise a holistic research and the findings of the questionnaires helped us to come up with some more steady solutions in order to minimize the potential gap between students and teachers.Keywords: L1 & L2, Linguistics, Applied linguistics, SLA, Albanian EFL students and teachers, Errors and Mistakes, Students’ Assessment and Self-Assessment
Procedia PDF Downloads 48811179 Fairness in Grading of Work-Integrated Learning Assessment: Key Stakeholders’ Challenges and Solutions
Authors: Geraldine O’Neill
Abstract:
Work-integrated learning is a valuable learning experience for students in higher education. However, the fairness of the assessment process has been identified as a challenge. This study explored solutions to this challenge through interviews with expert authors in the field and workshops across nine different disciplines in Ireland. In keeping with the use of a participatory and action research methodology, the key stakeholders in the process, the students, educators, and practitioners, identified some solutions. The solutions included the need to: clarify the assessments’ expectations; enhance the flexibility of the competencies, reduce the number of competencies; use grading scales with lower specificity; support practitioner training, and empower students in the assessment process. The results are discussed as they relate to interactional, procedural, and distributive fairness.Keywords: competencies, fairness, grading scales, work-integrated learning
Procedia PDF Downloads 12511178 Comprehensive Expert and Social Assessment of the Urban Environment of Almaty in the Process of Training Master's and Doctoral Students on Architecture and Urban Planning
Authors: Alexey Abilov
Abstract:
The article highlights the experience of training master's and doctoral students at Satbayev University by preparing their course works for disciplines "Principles of Sustainable Architecture", "Energy Efficiency in Urban planning", "Urban planning analysis, "Social foundations of Architecture". The purpose of these works is the acquisition by students of practical skills necessary in their future professional activities, which are achieved through comprehensive assessment of individual sections of the Almaty urban environment. The methodology of student’s researches carried out under the guidance of the author of this publication is based on an expert assessment of the territory through its full-scale survey, analysis of project documents and statistical data, as well as on a social assessment of the territory based on the results of a questionnaire survey of residents. A comprehensive qualitative and quantitative assessment of the selected sites according to the criteria of the quality of the living environment also allows to formulate specific recommendations for designers who carry out a pre-project analysis of the city territory in the process of preparing draft master plans and detailed planning projects.Keywords: urban environment, expert/social assessment of the territory, questionnaire survey, comprehensive approach
Procedia PDF Downloads 7311177 Discussion as a Means to Improve Peer Assessment Accuracy
Authors: Jung Ae Park, Jooyong Park
Abstract:
Writing is an important learning activity that cultivates higher level thinking. Effective and immediate feedback is necessary to help improve students' writing skills. Peer assessment can be an effective method in writing tasks because it makes it possible for students not only to receive quick feedback on their writing but also to get a chance to examine different perspectives on the same topic. Peer assessment can be practiced frequently and has the advantage of immediate feedback. However, there is controversy about the accuracy of peer assessment. In this study, we tried to demonstrate experimentally how the accuracy of peer assessment could be improved. Participants (n=76) were randomly assigned to groups of 4 members. All the participant graded two sets of 4 essays on the same topic. They graded the first set twice, and the second set or the posttest once. After the first grading of the first set, each group in the experimental condition 1 (discussion group), were asked to discuss the results of the peer assessment and then to grade the essays again. Each group in the experimental condition 2 (reading group), were asked to read the assessment on each essay by an expert and then to grade the essays again. In the control group, the participants were asked to grade the 4 essays twice in different orders. Afterwards, all the participants graded the second set of 4 essays. The mean score from 4 participants was calculated for each essay. The accuracy of the peer assessment was measured by Pearson correlation with the scores of the expert. The results were analyzed by two-way repeated measure ANOVA. The main effect of grading was observed: Grading accuracy got better as the number of grading experience increased. Analysis of posttest accuracy revealed that the score variations within a group of 4 participants decreased in both discussion and reading conditions but not in the control condition. These results suggest that having students discuss their grading together can be an efficient means to improve peer assessment accuracy. By discussing, students can learn from others about what to consider in grading and whether their grading is too strict or lenient. Further research is needed to examine the exact cause of the grading accuracy.Keywords: peer assessment, evaluation accuracy, discussion, score variations
Procedia PDF Downloads 26711176 Mismatch of Heavy Equipment Repairer Student’s Skills and Employer’s Needs
Authors: Bolormaa Dalanbayar, Batsaikhan Ulaankhuu, Bayarmaa Tsogtbaatar
Abstract:
In this study, we surveyed employers and students to identify compliance between employers' needs and student self-assessment of skills. Employers' survey consisted of fifteen questions to determine employers' assessment of the knowledge and skills of graduates in heavy equipment repairer's programs from four TVET schools. We also compared a survey questionnaire with Liebherr brands' job duty requirements, which determines the training needs and qualification level of their new workers. The study shows more than 76% of employers assessed professional knowledge as sufficient, more than 47% of employers assessed vocational skills as sufficient and more than 43% of employers rated attitudes as sufficient. Therefore, we can state there is a skill mismatch between the employer's assessment and students' self-assessment.Keywords: skill mismatch, employers needs, competence-based curriculum
Procedia PDF Downloads 3011175 Fostering Students' Engagement with Historical Issues Surrounding the Field of Graphic Design
Authors: Sara Corvino
Abstract:
The aim of this study is to explore the potential of inclusive learning and assessment strategies to foster students' engagement with historical debates surrounding the field of graphic design. The goal is to respond to the diversity of L4 Graphic Design students, at Nottingham Trent University, in a way that instead of 'lowering standards' can benefit everyone. This research tests, measures, and evaluates the impact of a specific intervention, an assessment task, to develop students' critical visual analysis skills and stimulate a deeper engagement with the subject matter. Within the action research approach, this work has followed a case study research method to understand students' views and perceptions of a specific project. The primary methods of data collection have been: anonymous electronic questionnaire and a paper-based anonymous critical incident questionnaire. NTU College of Business Law and Social Sciences Research Ethics Committee granted the Ethical approval for this research in November 2019. Other methods used to evaluate the impact of this assessment task have been Evasys's report and students' performance. In line with the constructivist paradigm, this study embraces an interpretative and contextualized analysis of the collected data within the triangulation analytical framework. The evaluation of both qualitative and quantitative data demonstrates that active learning strategies and the disruption of thinking patterns can foster greater students' engagement and can lead to meaningful learning.Keywords: active learning, assessment for learning, graphic design, higher education, student engagement
Procedia PDF Downloads 17711174 Evaluating the Learning Outcomes of Physical Therapy Clinical Fieldwork Course
Authors: Hui-Yi Wang, Shu-Mei Chen, Mei-Fang Liu
Abstract:
Background and purpose: Providing clinical experience in medical education is an important discipline method where students can gradually apply their academic knowledge to clinical situations. The purpose of this study was to establish self-assessment questionnaires for students to assess their learning outcomes for two fields of physical therapy, orthopedic physical therapy, and pediatric physical therapy, in a clinical fieldwork course. Methods: The questionnaires were developed based on the core competence dimensions of the course. The content validity of the questionnaires was evaluated and established by expert meetings. Among the third-year undergraduate students who took the clinical fieldwork course, there were 49 students participated in this study. Teachers arranged for the students to study two professional fields, and each professional field conducted a three-week clinical lesson. The students filled out the self-assessment questionnaires before and after each three-week lesson. Results: The self-assessment questionnaires were established by expert meetings that there were six core competency dimensions in each of the two fields, with 20 and 21 item-questions, respectively. After each three-week clinical fieldwork, the self-rating scores in each core competency dimension were higher when compared to those before the course, indicating having better clinical abilities after the lessons. The best self-rating scores were the dimension of attitude and humanistic literacy, and the two lower scores were the dimensions of professional knowledge and skills and problem-solving critical thinking. Conclusions: This study developed questionnaires for clinical fieldwork courses to reflect students' learning outcomes, including the performance of professional knowledge, practice skills, and professional attitudes. The use of self-assessment of learning performance can help students build up their reflective competencies. Teachers can guide students to pay attention to the performance of abilities in each core dimension to enhance the effectiveness of learning through self-reflection and improvement.Keywords: physical therapy, clinical fieldwork course, learning outcomes assessment, medical education, self-reflection ability
Procedia PDF Downloads 11611173 An Early Attempt of Artificial Intelligence-Assisted Language Oral Practice and Assessment
Authors: Paul Lam, Kevin Wong, Chi Him Chan
Abstract:
Constant practicing and accurate, immediate feedback are the keys to improving students’ speaking skills. However, traditional oral examination often fails to provide such opportunities to students. The traditional, face-to-face oral assessment is often time consuming – attending the oral needs of one student often leads to the negligence of others. Hence, teachers can only provide limited opportunities and feedback to students. Moreover, students’ incentive to practice is also reduced by their anxiety and shyness in speaking the new language. A mobile app was developed to use artificial intelligence (AI) to provide immediate feedback to students’ speaking performance as an attempt to solve the above-mentioned problems. Firstly, it was thought that online exercises would greatly increase the learning opportunities of students as they can now practice more without the needs of teachers’ presence. Secondly, the automatic feedback provided by the AI would enhance students’ motivation to practice as there is an instant evaluation of their performance. Lastly, students should feel less anxious and shy compared to directly practicing oral in front of teachers. Technically, the program made use of speech-to-text functions to generate feedback to students. To be specific, the software analyzes students’ oral input through certain speech-to-text AI engine and then cleans up the results further to the point that can be compared with the targeted text. The mobile app has invited English teachers for the pilot use and asked for their feedback. Preliminary trials indicated that the approach has limitations. Many of the users’ pronunciation were automatically corrected by the speech recognition function as wise guessing is already integrated into many of such systems. Nevertheless, teachers have confidence that the app can be further improved for accuracy. It has the potential to significantly improve oral drilling by giving students more chances to practice. Moreover, they believe that the success of this mobile app confirms the potential to extend the AI-assisted assessment to other language skills, such as writing, reading, and listening.Keywords: artificial Intelligence, mobile learning, oral assessment, oral practice, speech-to-text function
Procedia PDF Downloads 10311172 A Meta-Analysis of the Academic Achievement of Students With Emotional/Behavioral Disorders in Traditional Public Schools in the United States
Authors: Dana Page, Erica McClure, Kate Snider, Jenni Pollard, Tim Landrum, Jeff Valentine
Abstract:
Extensive research has been conducted on students with emotional and behavioral disorders (EBD) and their rates of challenging behavior. In the past, however, less attention has been given to their academic achievement and outcomes. Recent research examining outcomes for students with EBD has indicated that these students receive lower grades, are less likely to pass classes, and experience higher rates of school dropout than students without disabilities and students with other high incidence disabilities. Given that between 2% and 20% of the school-age population is likely to have EBD (though many may not be identified as such), this is no small problem. Despite the need for increased examination of this population’s academic achievement, research on the actual performance of students with EBD has been minimal. This study reports the results of a meta-analysis of the limited research examining academic achievement of students with EBD, including effect sizes of assessment scores and discussion of moderators potentially impacting academic outcomes. Researchers conducted a thorough literature search to identify potentially relevant documents before screening studies for inclusion in the systematic review. Screening identified 35 studies that reported results of academic assessment scores for students with EBD. These studies were then coded to extract descriptive data across multiple domains, including placement of students, participant demographics, and academic assessment scores. Results indicated possible collinearity between EBD disability status and lower academic assessment scores, despite a lack of association between EBD eligibility and lower cognitive ability. Quantitative analysis of assessment results yielded effect sizes for academic achievement of student participants, indicating lower performance levels and potential moderators (e.g., race, socioeconomic status, and gender) impacting student academic performance. In addition to discussing results of the meta-analysis, implications and areas for future research, policy, and practice are discussed.Keywords: students with emotional behavioral disorders, academic achievement, systematic review, meta-analysis
Procedia PDF Downloads 6911171 Analysing a Practical Teamwork Assessment for Distance Education Students at an Australian University
Authors: Celeste Lawson
Abstract:
Learning to embrace and value teamwork assessment at a university level is critical for students, as graduates enter a real-world working environment where teamwork is likely to occur virtually. Student disdain for teamwork exercises is an area often overlooked or disregarded by academics. This research explored the implementation of an online teamwork assessment approach at a regional Australian university with a significant cohort of Distance Education students. Students had disliked teamwork for three reasons: it was not relevant to their study, the grading was unfair amongst team members, and managing the task was challenging in a virtual environment. Teamwork assessment was modified so that the task was an authentic task that could occur in real-world practice; team selection was based on the task topic rather than randomly; grading was based on the individual’s contribution to the task, and students were provided virtual team management skills as part of a the assessment. In this way, management of the team became an output of the task itself. Data was gathered over three years from student satisfaction surveys, failure rates, attrition figures, and unsolicited student comments. In one unit where this approach was adopted (Advanced Public Relations), student satisfaction increased from 3.6 (out of 5) in 2012 to 4.6 in 2016, with positive comments made about the teamwork approach. The attrition rate for another unit (Public Relations and the Media) reduced from 20.7% in 2012 to 2.2% in 2015. In 2012, criticism of teamwork assessment made up 50% of negative student feedback in Public Relations and the Media. By 2015, following the successful implementation of the teamwork assessment approach, only 12.5% of negative comments on the student satisfaction survey were critical of teamwork, while 33% of positive comments related to a positive teamwork experience. In 2016, students explicitly nominated teamwork as the best part of this unit. The approach is transferable to other disciplines and was adopted by other academics within the institution with similar results.Keywords: assessment, distance education, teamwork, virtual
Procedia PDF Downloads 14011170 Pre-Service Science Teachers’ Attitudes about Teaching Science Courses at the Faculty of Education, Lebanese University: An Exploratory Case Study
Authors: Suzanne El Takach
Abstract:
The research study explored pre-service teachers’ attitudes towards 6 courses taught in 3rd till 6th semesters at the Faculty of Education, Lebanese University, during the academic year 2015-2016. They assessed science teaching courses that are essential for teacher preparation for Science at the primary and elementary level. These courses were: Action Research I and II in Teaching Science, New trends in Teaching Science, Teaching Science I and II for the elementary level and Teaching Science for Early Childhood Education. Qualitative and Quantitative Data were gathered from a) a survey questionnaire consisting of 23 closed-ended items; some were of Likert scale type, that aimed at collecting students’ opinions on courses, in terms of teaching, assessment and class interaction (N=102 respondents) and b) a second questionnaire of 10 questions was disseminated on a sample of 39 students in their last semester in science and Mathematics, in order to know more about students’ skills gained, suggestions for new courses and improvement. Students were satisfied with science teaching courses and they have admitted that they gained a good pedagogical content knowledge, such as, lesson planning, students’ misconceptions, and use of various teaching and assessment strategies.Keywords: assessment in higher education, LMD program, pre-service teachers’ attitudes, pre-PCK skills
Procedia PDF Downloads 14811169 High School Students’ Seismic Risk Perception and Preparedness in Shavar, Dhaka
Authors: Mohammad Lutfur Rahman
Abstract:
School students of Dhaka are in extreme risk of natural disasters. However, the study on assessment of the real scenario of high school students about perceptions of earthquake is very little. The purpose of this cross-sectional study is to assess the seismic risk perception and preparedness levels about earthquake among high school students in Shavar, Dhaka. A questionnaire was developed, and data collection was done about a group of high school students in seven classrooms. The author uses a method of surveying high school students to identify and describe the factors that influence their knowledge and perceptions about earthquake. This study examines gender and grade differences in perceived risk and communication behavior in response to the earthquake. Female students’ preparation, participation, and communication with family are more frequent than that of male students. Female students have been found to be more likely to learn about a disaster than male students. Higher grade students have more awareness but less preparedness about earthquake than that of the younger one. This research concludes that irrespective of grades, high school students are vulnerable to earthquake due to the lack of a seismic education program.Keywords: awareness, earthquake, risk perception, seismic
Procedia PDF Downloads 24811168 Mandatory Wellness Assessments for Medical Students at the University of Ottawa
Authors: Haykal. Kay-Anne
Abstract:
The health and well-being of students is a priority for the Faculty of Medicine at the University of Ottawa. The demands of medical studies are extreme, and many studies confirm that the prevalence of psychological distress is very high among medical students and that it is higher than that of the general population of the same age. The main goal is to identify risk factors for mental health among medical students at the University of Ottawa. The secondary objectives are to determine the variation of these risk factors according to demographic variables, as well as to determine if there is a change in the mental health of students during the 1st and 3rd years of their study. Medical students have a mandatory first and third-year wellness check meeting. This assessment includes a questionnaire on demographic information, mental health, and risk factors such as physical health, sleep, social support, financial stress, education and career, stress and drug use and/or alcohol. Student responses were converted to numerical values and analyzed statistically. The results show that 61% of the variation in the mean of the mental health score is explained by the following risk factors (R2 = 0.61, F (9.396) = 67.197, p < 0.01): lack of sleep and fatigue (β = 0.281, p < 0.001), lack of social support (β = 0.217, p <0.001), poor study or career development (β = 0.195, p < 0.001) and an increase stress and drug and alcohol use (β = -0.239, p < 0.001). No demographic variable has a significant effect on the presence of risk factors. In addition, fixed-effects regression demonstrated significantly lower mental health (p < 0.1) among first-year students (M = 0.587, SD = 0.072) than among third-year students (M = 0.719, SD = 0.071). This preliminary study indicates the need to continue data collection and analysis to increase the significance of the study results. As risk factors are present at the beginning of medical studies, it is important to offer resources to students very early in their medical studies and to have close monitoring and supervision.Keywords: assessment of mental health, medical students, risk factors for mental health, wellness assessment
Procedia PDF Downloads 12311167 School Based Assessment Issues in Selected Malaysian Primary Schools
Authors: Nur Amalina Dayana Abd Aziz
Abstract:
Assessment is an integral part of teaching and learning in any syllabus in the world. Recently, a new assessment system, School-Based Assessment (SBA) was introduced and implemented in the Malaysian education system to promote a more holistic, integrated and balanced assessment system. This effort is part of the reformation made in the Government Transformation Plan (GTP) to produce a world-class human capital as we are reaching and achieving the Vision 2020 in the near future. However, this new change has raised awareness and concerns from teachers, students, parents and non-profit organizations on how the new assessment is to be implemented and how it is affecting the students and teachers particularly. Therefore, this paper aims to investigate the issues that teachers face in implementing SBA in primary schools, the measures taken to address the issues and to propose ways of managing school-based assessment. Five national primary schools focusing in the urban areas in the Selangor state are chosen for this study to carry out. Data for the study will be gathered from interviews with teachers from each school, surveys and classrooms observation will be conducted in each school, and relevant documents are collected from the selected schools. The findings of this study will present the current issues that teachers from various types of national primary schools are facing and what actions they took to overcome the problems in carrying out SBA. Suggestions on how to better manage school-based assessment for teachers are also provided in this paper.Keywords: community of practice, curriculum, managing change, school-based assessment
Procedia PDF Downloads 42611166 Evaluation of Learning Outcomes, Satisfaction and Self-Assessment of Students as a Change Factor in the Polish Higher Education System
Authors: Teresa Kupczyk, Selçuk Mustafa Özcan, Joanna Kubicka
Abstract:
The paper presents results of specialist literature analysis concerning learning outcomes and student satisfaction as a factor of the necessary change in the Polish higher education system. The objective of the empirical research was to determine students’ assessment of learning outcomes, satisfaction of their expectations, as well as their satisfaction with lectures and practical classes held in the traditional form, e-learning and video-conference. The assessment concerned effectiveness of time spent at classes, usefulness of the delivered knowledge, instructors’ preparation and teaching skills, application of tools, studies curriculum, its adaptation to students’ needs and labour market, as well as studying conditions. Self-assessment of learning outcomes was confronted with assessment by lecturers. The indirect objective of the research was also to identify how students assessed their activity and commitment in acquisition of knowledge and their discipline in achieving education goals. It was analysed how the studies held affected the students’ willingness to improve their skills and assessment of their perspectives at the labour market. To capture the changes underway, the research was held at the beginning, during and after completion of the studies. The study group included 86 students of two editions of full-time studies majoring in Management and specialising in “Mega-event organisation”. The studies were held within the EU-funded project entitled “Responding to challenges of new markets – innovative managerial education”. The results obtained were analysed statistically. Average results and standard deviations were calculated. In order to describe differences between the studied variables present during the process of studies, as well as considering the respondents’ gender, t-Student test for independent samples was performed with the IBM SPSS Statistics 21.0 software package. Correlations between variables were identified by calculation of Pearson and Spearman correlation coefficients. Research results suggest necessity to introduce some changes in the teaching system applied at Polish higher education institutions, not only considering the obtained outcomes, but also impact on students’ willingness to improve their qualifications constantly, improved self-assessment among students and their opportunities at the labour market.Keywords: higher education, learning outcomes, students, change
Procedia PDF Downloads 240