Search results for: peer feedback
Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 1805

Search results for: peer feedback

1805 Peer-Review as a Means to Improve Students' Translation Skills

Authors: Bahia Braktia, Ahlem Ghamri

Abstract:

Years ago, faculties and administrators realized that students entering college were not prepared for the academic sphere; however, as a type of collaborative learning, peer-review gave students a social context in which they could learn more efficiently. Peer-review has proven its effectiveness in higher education. Numerous studies have been conducted on peer review and its effects on the quality of students’ writing, and several publications recommended peer-review as part of the feedback process. Student writers showed a tendency towards making significant meaning-level revisions and surface-level revisions. Last but not least, studies reported that peer-review helps students develop their self-assessment skills as well as critical thinking. The use of peer-review has become well known and widely adopted to the L2 classroom environment. However, little is known about peer review on translation students. The purpose of this study was to investigate the students' perspective on peer-review, and whether this method affected the quality of their translation. A mixed method design was adopted. Students were requested to translate two texts from Arabic into English, and they gave and received structured feedback to their classmates' translations. A survey was administered, followed by semi-structured interviews, to examine the students' attitudes toward peer-review. The results of the study showed that peer-review was considered a good proofreading method for most students. The students also showed a positive attitude toward it, and they reported that they benefited from the interaction with their peers. The findings implied that the inclusion of peer-review can be an effective pedagogical practice for teaching translation and writing to foreign language learners.

Keywords: language teaching, feedback, peer-review, translation

Procedia PDF Downloads 198
1804 Topological Analyses of Unstructured Peer to Peer Systems: A Survey

Authors: Hend Alrasheed

Abstract:

Due to their different properties that have led to avoid several limitations of classic client/server systems, there has been a great interest in the development and the improvement of different peer to peer systems. Understanding the properties of complex peer to peer networks is essential for their future improvements. It was shown that the performances of peer to peer protocols are directly related to their underlying topologies. Therefore, multiple efforts have analyzed the topologies of different peer to peer systems. This study presents an overview of major findings of close experimental analyses to different topologies of three unstructured peer to peer systems: BitTorrent, Gnutella, and FreeNet.

Keywords: peer to peer networks, network topology, graph diameter, clustering coefficient, small-world property, random graph, degree distribution

Procedia PDF Downloads 381
1803 Peer Corrective Feedback on Written Errors in Computer-Mediated Communication

Authors: S. H. J. Liu

Abstract:

This paper aims to explore the role of peer Corrective Feedback (CF) in improving written productions by English-as-a- foreign-language (EFL) learners who work together via Wikispaces. It attempted to determine the effect of peer CF on form accuracy in English, such as grammar and lexis. Thirty-four EFL learners at the tertiary level were randomly assigned into the experimental (with peer feedback) or the control (without peer feedback) group; each group was subdivided into small groups of two or three. This resulted in six and seven small groups in the experimental and control groups, respectively. In the experimental group, each learner played a role as an assessor (providing feedback to others), as well as an assessee (receiving feedback from others). Each participant was asked to compose his/her written work and revise it based on the feedback. In the control group, on the other hand, learners neither provided nor received feedback but composed and revised their written work on their own. Data collected from learners’ compositions and post-task interviews were analyzed and reported in this study. Following the completeness of three writing tasks, 10 participants were selected and interviewed individually regarding their perception of collaborative learning in the Computer-Mediated Communication (CMC) environment. Language aspects to be analyzed included lexis (e.g., appropriate use of words), verb tenses (e.g., present and past simple), prepositions (e.g., in, on, and between), nouns, and articles (e.g., a/an). Feedback types consisted of CF, affective, suggestive, and didactic. Frequencies of feedback types and the accuracy of the language aspects were calculated. The results first suggested that accurate items were found more in the experimental group than in the control group. Such results entail that those who worked collaboratively outperformed those who worked non-collaboratively on the accuracy of linguistic aspects. Furthermore, the first type of CF (e.g., corrections directly related to linguistic errors) was found to be the most frequently employed type, whereas affective and didactic were the least used by the experimental group. The results further indicated that most participants perceived that peer CF was helpful in improving the language accuracy, and they demonstrated a favorable attitude toward working with others in the CMC environment. Moreover, some participants stated that when they provided feedback to their peers, they tended to pay attention to linguistic errors in their peers’ work but overlook their own errors (e.g., past simple tense) when writing. Finally, L2 or FL teachers or practitioners are encouraged to employ CMC technologies to train their students to give each other feedback in writing to improve the accuracy of the language and to motivate them to attend to the language system.

Keywords: peer corrective feedback, computer-mediated communication (CMC), second or foreign language (L2 or FL) learning, Wikispaces

Procedia PDF Downloads 245
1802 Implementation of Distributed Randomized Algorithms for Resilient Peer-to-Peer Networks

Authors: Richard Tanaka, Ying Zhu

Abstract:

This paper studies a few randomized algorithms in application-layer peer-to-peer networks. The significant gain in scalability and resilience that peer-to-peer networks provide has made them widely used and adopted in many real-world distributed systems and applications. The unique properties of peer-to-peer networks make them particularly suitable for randomized algorithms such as random walks and gossip algorithms. Instead of simulations of peer-to-peer networks, we leverage the Docker virtual container technology to develop implementations of the peer-to-peer networks and these distributed randomized algorithms running on top of them. We can thus analyze their behaviour and performance in realistic settings. We further consider the problem of identifying high-risk bottleneck links in the network with the objective of improving the resilience and reliability of peer-to-peer networks. We propose a randomized algorithm to solve this problem and evaluate its performance by simulations.

Keywords: distributed randomized algorithms, peer-to-peer networks, virtual container technology, resilient networks

Procedia PDF Downloads 216
1801 'You’re Not Alone': Peer Feedback Practices for Cross-Cultural Writing Classrooms and Centers

Authors: Cassandra Branham, Danielle Farrar

Abstract:

As writing instructors and writing center administrators at a large research university with a significant population of English language learners (ELLs), we are interested in how peer feedback pedagogy can be effectively translated for writing center purposes, as well as how various modes of peer feedback can enrich the learning experiences of L1 and L2 writers in these spaces. Although peer feedback is widely used in classrooms and centers, instructor, student, and researcher opinions vary in respect to its effectiveness. We argue that peer feedback - traditional and digital, synchronous and asynchronous - is an indispensable element for both classrooms and centers and emphasize that it should occur with both L1 and L2 students to further develop an array of reading and writing skills. We also believe that further understanding of the best practices of peer feedback in such cross-cultural spaces, like the classroom and center, can optimize the benefits of peer feedback. After a critical review of the literature, we implemented an embedded tutoring program in our university’s writing center in collaboration with its First-Year Composition (FYC) program and Language Institute. The embedded tutoring program matches a graduate writing consultant with L1 and L2 writers enrolled in controlled-matriculation composition courses where ELLs make up at least 50% of each class. Furthermore, this program is informed by what we argue to be some best practices of peer feedback for both classroom and center purposes, including expectation-based training through rubrics, modeling effective feedback, hybridizing traditional and digital modes of feedback, recognizing the significance the body in composition (what we call writer embodiment), and maximizing digital technologies to exploit extended cognition. After conducting surveys and follow-up interviews with students, instructors, and writing consultants in the embedded tutoring program, we found that not only did students see an increased value in peer feedback, but also instructors saw an improvement in both writing style and critical thinking skills. Our L2 participants noted improvements in language acquisition while our L1 students recognized a broadening of their worldviews. We believe that both L1 and L2 students developed self-efficacy and agency in their identities as writers because they gained confidence in their abilities to offer feedback, as well as in the legitimacy of feedback they received from peers. We also argue that these best practices situate novice writers as experts, as writers become a valued and integral part of the revision process with their own and their peers’ papers. Finally, the use of iPads in embedded tutoring recovered the importance of the body and its senses in writing; the highly sensory feedback from these multi-modal sessions that offer audio and visual input underscores the significant role both the body and mind play in compositional practices. After beginning with a brief review of the literature that sparked this research, this paper will discuss the embedded tutoring program in detail, report on the results of the pilot program, and will conclude with a discussion of the pedagogical implications that arise from this research for both classroom and center.

Keywords: English language learners, peer feedback, writing center, writing classroom

Procedia PDF Downloads 402
1800 Discussion as a Means to Improve Peer Assessment Accuracy

Authors: Jung Ae Park, Jooyong Park

Abstract:

Writing is an important learning activity that cultivates higher level thinking. Effective and immediate feedback is necessary to help improve students' writing skills. Peer assessment can be an effective method in writing tasks because it makes it possible for students not only to receive quick feedback on their writing but also to get a chance to examine different perspectives on the same topic. Peer assessment can be practiced frequently and has the advantage of immediate feedback. However, there is controversy about the accuracy of peer assessment. In this study, we tried to demonstrate experimentally how the accuracy of peer assessment could be improved. Participants (n=76) were randomly assigned to groups of 4 members. All the participant graded two sets of 4 essays on the same topic. They graded the first set twice, and the second set or the posttest once. After the first grading of the first set, each group in the experimental condition 1 (discussion group), were asked to discuss the results of the peer assessment and then to grade the essays again. Each group in the experimental condition 2 (reading group), were asked to read the assessment on each essay by an expert and then to grade the essays again. In the control group, the participants were asked to grade the 4 essays twice in different orders. Afterwards, all the participants graded the second set of 4 essays. The mean score from 4 participants was calculated for each essay. The accuracy of the peer assessment was measured by Pearson correlation with the scores of the expert. The results were analyzed by two-way repeated measure ANOVA. The main effect of grading was observed: Grading accuracy got better as the number of grading experience increased. Analysis of posttest accuracy revealed that the score variations within a group of 4 participants decreased in both discussion and reading conditions but not in the control condition. These results suggest that having students discuss their grading together can be an efficient means to improve peer assessment accuracy. By discussing, students can learn from others about what to consider in grading and whether their grading is too strict or lenient. Further research is needed to examine the exact cause of the grading accuracy.

Keywords: peer assessment, evaluation accuracy, discussion, score variations

Procedia PDF Downloads 267
1799 Establishing Feedback Partnerships in Higher Education: A Discussion of Conceptual Framework and Implementation Strategies

Authors: Jessica To

Abstract:

Feedback is one of the powerful levers for enhancing students’ performance. However, some students are under-engaged with feedback because they lack responsibility for feedback uptake. To resolve this conundrum, recent literature proposes feedback partnerships in which students and teachers share the power and responsibilities to co-construct feedback. During feedback co-construction, students express feedback needs to teachers, and teachers respond to individuals’ needs in return. Though this approach can increase students’ feedback ownership, its application is lagging as the field lacks conceptual clarity and implementation guide. This presentation aims to discuss the conceptual framework of feedback partnerships and feedback co-construction strategies. It identifies the components of feedback partnerships and strategies which could facilitate feedback co-construction. A systematic literature review was conducted to answer the questions. The literature search was performed using ERIC, PsycINFO, and Google Scholar with the keywords “assessment partnership”, “student as partner,” and “feedback engagement”. No time limit was set for the search. The inclusion criteria encompassed (i) student-teacher partnerships in feedback, (ii) feedback engagement in higher education, (iii) peer-reviewed publications, and (iv) English as the language of publication. Those without addressing conceptual understanding and implementation strategies were excluded. Finally, 65 publications were identified and analysed using thematic analysis. For the procedure, the texts relating to the questions were first extracted. Then, codes were assigned to summarise the ideas of the texts. Upon subsuming similar codes into themes, four themes emerged: students’ responsibilities, teachers’ responsibilities, conditions for partnerships development, and strategies. Their interrelationships were examined iteratively for framework development. Establishing feedback partnerships required different responsibilities of students and teachers during feedback co-construction. Students needed to self-evaluate performance against task criteria, identify inadequacies and communicate their needs to teachers. During feedback exchanges, they interpreted teachers’ comments, generated self-feedback through reflection, and co-developed improvement plans with teachers. Teachers had to increase students’ understanding of criteria and evaluation skills and create opportunities for students’ expression of feedback needs. In feedback dialogue, teachers responded to students’ needs and advised on the improvement plans. Feedback partnerships would be best grounded in an environment with trust and psychological safety. Four strategies could facilitate feedback co-construction. First, students’ understanding of task criteria could be increased by rubrics explanation and exemplar analysis. Second, students could sharpen evaluation skills if they participated in peer review and received teacher feedback on the quality of peer feedback. Third, provision of self-evaluation checklists and prompts and teacher modeling of self-assessment process could aid students in articulating feedback needs. Fourth, the trust could be fostered when teachers explained the benefits of feedback co-construction, showed empathy, and provided personalised comments in dialogue. Some strategies were applied in interactive cover sheets in which students performed self-evaluation and made feedback requests on a cover sheet during assignment submission, followed by teachers’ response to individuals’ requests. The significance of this presentation lies in unpacking the conceptual framework of feedback partnerships and outlining feedback co-construction strategies. With a solid foundation in theory and practice, researchers and teachers could better enhance students’ engagement with feedback.

Keywords: conceptual framework, feedback co-construction, feedback partnerships, implementation strategies

Procedia PDF Downloads 90
1798 Simulation-Based Learning in the Exercise Science Curriculum: Peer Role Play vs Professional Simulated Patient

Authors: Nathan Reeves

Abstract:

Aim: The aim of this study was to evaluate if there was an impact on student learning when peer role play was substituted for a professional actor in the role of simulated patient in a simulation-based scenario. Method: Third-year exercise science students enrolled in a field project course in 2015 (n=24), and 2016 (n=20) participated in a simulation-based case scenario designed to develop their client-centred exercise prescription skills. During the simulation, students were provided with feedback from the simulated patients. In 2015, three professional actors played the part of the simulated patient, and in 2016 one of the simulated patients was a student from another exercise science cohort (peer role play). The student learning experience, consistency in case fidelity and feedback provided by the simulated patients was evaluated using a 5-point Likert scale survey and collecting phenomenological data. Results: Improvements to student pre and post confidence remained constant between the 2015 and 2016 cohorts (1.04 and 0.85). The perceived usefulness and enjoyability also remained high across the two cohorts (4.96 and 4.71). The feedback provided by all three simulated patients in 2016 was seen to strongly support student learning experience (4.82), and was of a consistent level (4.47). Significance of the findings to allied health: Simulation-based education is rapidly expanding in the curricula across the allied health professions. The simulated patient methodology continues to receive support as a pedagogy to develop a range of clinical skills including communication, engagement and client-centeredness. Upskilling students to peer role play can be a reasonable alternative to engaging paid actors.

Keywords: exercise science, simulation-based learning, simulated patient, peer role play

Procedia PDF Downloads 295
1797 Use of Progressive Feedback for Improving Team Skills and Fair Marking of Group Tasks

Authors: Shaleeza Sohail

Abstract:

Self, and peer evaluations are some of the main components in almost all group assignments and projects in higher education institutes. These evaluations provide students an opportunity to better understand the learning outcomes of the assignment and/or project. A number of online systems have been developed for this purpose that provides automated assessment and feedback of students’ contribution in a group environment based on self and peer evaluations. All these systems lack a progressive aspect of these assessments and feedbacks which is the most crucial factor for ongoing improvement and life-long learning. In addition, a number of assignments and projects are designed in a manner that smaller or initial assessment components lead to a final assignment or project. In such cases, the evaluation and feedback may provide students an insight into their performance as a group member for a particular component after the submission. Ideally, it should also create an opportunity to improve for next assessment component as well. Self and Peer Progressive Assessment and Feedback System encourages students to perform better in the next assessment by providing a comparative analysis of the individual’s contribution score on an ongoing basis. Hence, the student sees the change in their own contribution scores during the complete project based on smaller assessment components. Self-Assessment Factor is calculated as an indicator of how close the self-perception of the student’s own contribution is to the perceived contribution of that student by other members of the group. Peer-Assessment Factor is calculated to compare the perception of one student’s contribution as compared to the average value of the group. Our system also provides a Group Coherence Factor which shows collectively how group members contribute to the final submission. This feedback is provided for students and teachers to visualize the consistency of members’ contribution perceived by its group members. Teachers can use these factors to judge the individual contributions of the group members in the combined tasks and allocate marks/grades accordingly. This factor is shown to students for all groups undertaking same assessment, so the group members can comparatively analyze the efficiency of their group as compared to other groups. Our System provides flexibility to the instructors for generating their own customized criteria for self and peer evaluations based on the requirements of the assignment. Students evaluate their own and other group members’ contributions on the scale from significantly higher to significantly lower. The preliminary testing of the prototype system is done with a set of predefined cases to explicitly show the relation of system feedback factors to the case studies. The results show that such progressive feedback to students can be used to motivate self-improvement and enhanced team skills. The comparative group coherence can promote a better understanding of the group dynamics in order to improve team unity and fair division of team tasks.

Keywords: effective group work, improvement of team skills, progressive feedback, self and peer assessment system

Procedia PDF Downloads 187
1796 Investigating Chinese Students' Engagement with Teacher Feedback: Multiple Case Studies in a UK University

Authors: Fangfei Li

Abstract:

This research was conducted to explore how Chinese overseas students, who rarely received teacher feedback during their undergraduate studies in China, engaged in a different feedback provision context in the UK universities. In particular, this research provides some insights into Chinese students’ perspectives on how they made sense of the teacher feedback they obtained and how they took it on board in their assignments. Research questions in this study are 1) What are Chinese overseas students’ perceptions of teacher feedback on courses in UK higher education? 2) How do they respond to the teacher feedback they obtained? 3) What factors might influence their engagement with teacher feedback? Multiple case studies of five Chinese overseas students in a UK university have been carried out to address the research questions. The main data collection instruments are various types of semi-structured interviews, consisting of background interviews, scenario-based activities, stimulated recall sessions and retrospective interviews. Research findings indicate that student engagement with teacher feedback is a complex learning process incorporating several stages: from initial teacher input to ultimate transformational learning. Apart from students interpreting teachers’ comments/suggestions by themselves, students’ understandings of and responses to teacher feedback could also be influenced by pre-submission guidance, peer discussion, use of exemplars and post-submission discussion with teachers. These are key factors influencing students to make use of teacher feedback. Findings also reveal that the level of students’ reflections on tutor feedback influences the quality of their assignments and even their future learning. To sum up, this paper will discuss the current concepts of teacher feedback in existing studies and research findings of this study from which reconceptualization of teacher feedback has occurred.

Keywords: Chinese students, student engagement, teacher feedback, the UK higher education

Procedia PDF Downloads 348
1795 Students' Perceptions of Assessment and Feedback in Higher Education

Authors: Jonathan Glazzard

Abstract:

National student satisfaction data in England demonstrate that undergraduate students are less satisfied overall with assessment and feedback than other aspects of their higher education courses. Given that research findings suggest that high-quality feedback is a critical factor associated with academic achievement, it is important that feedback enables students to demonstrate improved academic achievement in their subsequent assessments. Given the growing importance of staff-student partnerships in higher education, this research examined students’ perceptions of assessment and feedback in one UK university. Students’ perceptions were elicited through the use of a university-wide survey which was completed by undergraduate students. In addition, three focus groups were used to provide qualitative student perception data across the three university Facilities. The data indicate that whilst students valued detailed feedback on their work, less detailed feedback could be compensated for by the development of pre-assessment literacy skills which are front-loaded into courses. Assessment literacy skills valued by students included the use of clear assessment criteria and assignment briefings which enabled students to fully understand the assessment task. Additionally, students valued assessment literacy pre-assessment tasks which enabled them to understand the standards which they were expected to achieve. Students valued opportunities for self and peer assessment prior to the final assessment and formative assessment feedback which matched the summative assessment feedback. Students also valued dialogic face-to-face feedback after receiving written feedback Above all, students valued feedback which was particular to their work and which gave recognition for the effort they had put into completing specific assessments. The data indicate that there is a need for higher education lecturers to receive systematic training in assessment and feedback which provides a comprehensive grounding in pre-assessment literacy skills.

Keywords: formative assessment, summative assessment, feedback, marking

Procedia PDF Downloads 322
1794 Teacher-Scaffolding vs. Peer-Scaffolding in Task-Based ILP Instruction: Effects on EFL Learners’ Metapragmatic Awareness

Authors: Amir Zand-Moghadam, Mahnaz Alizadeh

Abstract:

The aim of the present study was to investigate the effect of teacher-scaffolding versus peer-scaffolding on EFL learners’ metapragmatic awareness in the paradigm of task-based language teaching (TBLT). To this end, a number of dialogic information-gap tasks requiring two-way interactant relationship were designed for the five speech acts of request, refusal, apology, suggestion, and compliment following Ellis’s (2003) model. Then, 48 intermediate EFL learners were randomly selected, homogenized, and assigned to two groups: 26 participants in the teacher-scaffolding group (Group One) and 22 in the peer-scaffolding group (Group Two). While going through the three phases of pre-task, while-task, and post-task, the participants in the first group completed the designed tasks by the teacher’s interaction, scaffolding, and feedback. On the other hand, the participants in the second group were required to complete the tasks in expert-novice pairs through peer scaffolding in all the three phases of a task-based syllabus. The findings revealed that the participants in the teacher-scaffolding group developed their L2 metapragmatic awareness more than the peer-scaffolding group. Thus, it can be concluded that teacher-scaffolding is more effective than peer scaffolding in developing metapragmatic awareness among EFL learners. It can also be claimed that the use of tasks can be more influential when they are accompanied by teacher-scaffolding. The findings of the present study have implications for language teachers and researchers.

Keywords: ILP, metapragmatic awareness, scaffolding, task-based instruction

Procedia PDF Downloads 584
1793 Feedback in the Language Class: An Action Research Process

Authors: Arash Golzari Koloor

Abstract:

Feedback seems to be an inseparable part of teaching a second/foreign language. One type of feedback is corrective feedback which is one type of error treatment in second language classrooms. This study is a report on the types of corrective feedback employed in an IELTS preparation course. The types of feedback, their frequencies, and their effectiveness are enlisted, enumerated, and interpreted. The results showed that explicit correction and recast were the most frequent types of feedback while repetition and elicitation were the least. The results also revealed that metalinguistic feedback, elicitation, and explicit correction were the most effective types of feedback and affected learners performance greatly.

Keywords: classroom interaction, corrective feedback, error treatment, oral performance

Procedia PDF Downloads 334
1792 Parental Rejection and Psychological Adjustment among Adolescents: Does the Peer Rejection Mediate?

Authors: Sultan Shujja, Farah Malik

Abstract:

The study examined the mediating role of peer rejection in direct relationship of parental rejection and psychological adjustment among adolescents. Researchers used self-report measures e.g., Parental Acceptance-Rejection Questionnaire (PARQ), Children Rejection Sensitivity Questionnaire (PARQ), and Personality Assessment Questionnaire (PAQ) to assess perception of parent-peer rejection, psychological adjustment among adolescents (14-18 years). Findings revealed that peer rejection did not mediate the parental rejection and psychological adjustment whereas parental rejection emerged as strong predictor when demographic variables were statistically controlled. On average, girls were psychologically less adjusted than that of boys. Despite of equal perception of peer rejection, girls more anxiously anticipated peer rejection than did the boys. It is suggested that peer influence on adolescents, specifically girls, should not be underestimated.

Keywords: peer relationships, parental perception, psychological adjustment, applied psychology

Procedia PDF Downloads 512
1791 Working within the Zone of Proximal Development: Does It Help for Reading Strategy?

Authors: Mahmood Dehqan, Peyman Peyvasteh

Abstract:

In recent years there has been a growing interest in issues concerning the impact of sociocultural theory (SCT) of learning on different aspects of second/foreign language learning. This study aimed to find the possible effects of sociocultural teaching techniques on reading strategy of EFL learners. Indeed, the present research compared the impact of peer and teacher scaffolding on EFL learners’ reading strategy use across two proficiency levels. To this end, a pre-test post-test quasi-experimental research design was used and two instruments were utilized to collect the data: Nelson English language test and reading strategy questionnaire. Ninety five university students participated in this study were divided into two groups of teacher and peer scaffolding. Teacher scaffolding group received scaffolded help from the teacher based on three mechanisms of effective help within ZPD: graduated, contingent, dialogic. In contrast, learners of peer scaffolding group were unleashed from the teacher-fronted classroom as they were asked to carry out the reading comprehension tasks with the feedback they provided for each other. Results obtained from ANOVA revealed that teacher scaffolding group outperformed the peer scaffolding group in terms of reading strategy use. It means teacher’s scaffolded help provided within the learners’ ZPD led to better reading strategy improvement compared with the peer scaffolded help. However, the interaction effect between proficiency factor and teaching technique was non-significant, leading to the conclusion that strategy use of the learners was not affected by their proficiency level in either teacher or peer scaffolding groups.

Keywords: peer scaffolding, proficiency level, reading strategy, sociocultural theory, teacher scaffolding

Procedia PDF Downloads 381
1790 An Exploratory Study of Reliability of Ranking vs. Rating in Peer Assessment

Authors: Yang Song, Yifan Guo, Edward F. Gehringer

Abstract:

Fifty years of research has found great potential for peer assessment as a pedagogical approach. With peer assessment, not only do students receive more copious assessments; they also learn to become assessors. In recent decades, more educational peer assessments have been facilitated by online systems. Those online systems are designed differently to suit different class settings and student groups, but they basically fall into two categories: rating-based and ranking-based. The rating-based systems ask assessors to rate the artifacts one by one following some review rubrics. The ranking-based systems allow assessors to review a set of artifacts and give a rank for each of them. Though there are different systems and a large number of users of each category, there is no comprehensive comparison on which design leads to higher reliability. In this paper, we designed algorithms to evaluate assessors' reliabilities based on their rating/ranking against the global ranks of the artifacts they have reviewed. These algorithms are suitable for data from both rating-based and ranking-based peer assessment systems. The experiments were done based on more than 15,000 peer assessments from multiple peer assessment systems. We found that the assessors in ranking-based peer assessments are at least 10% more reliable than the assessors in rating-based peer assessments. Further analysis also demonstrated that the assessors in ranking-based assessments tend to assess the more differentiable artifacts correctly, but there is no such pattern for rating-based assessors.

Keywords: peer assessment, peer rating, peer ranking, reliability

Procedia PDF Downloads 439
1789 Factors Associated with Peer Assessment of Writing Skills among Foreign Languages Students

Authors: Marian Lissett Olaya

Abstract:

This article examined the factors associated with incorporating peer assessment into English language classes in a public university in Colombia. This is done in the context of writing English class for 4th-semester students. The research instruments consisted of peer assessment questionnaires, student diaries, and interviews. Findings showed that among the factors, motivation, frustration, anxiety, and lack of confidence appeared. Data revealed that peer assessment enables students to write competencies through training, teachers' guidance, and the provision of a collaborative environment.

Keywords: writing skills, peer assessment, formative assessment, language acquisition

Procedia PDF Downloads 82
1788 Peer Support Groups as a Tool to Increase Chances of Passing General Practice UK Qualification Exams

Authors: Thomas Abraham, Garcia de la Vega Felipe, Lubna Nishath, Nzekwe Nduka, Powell Anne-Marie

Abstract:

Introduction: The purpose of this paper is to discuss the effectiveness of a peer support network created to provide medical education, pastoral support, and reliable resources to registrars to help them pass the MRCGP exams. This paper will include a description of the network and its purpose, discuss how it has been used by trainees since its creation, and explain how this methodology can be applied to other areas of medical education and primary care. Background: The peer support network was created in February 2021, using Facebook, Telegram, and WhatsApp platforms to facilitate discussion of cases and answer queries about the exams, share resources, and offer peer support from qualified GPs and specialists. The network was created and is maintained by the authors of this paper and is open to anyone who is registered with the General Medical Council (GMC) and is studying for the MRCGP exams. Purpose: The purpose of the network is to provide medical education, pastoral support, and reliable resources to registrars to help them pass the exams. The network is free to use and is designed to take the onus away from a single medical educator and collate a vast amount of information from multiple medical educators/trainers; thereby creating a digital library of information for all trainees - exam related or otherwise. Methodology The network is managed by a team of moderators who respond to queries and facilitate discussion. Smaller study groups are created from the main group and provide a platform for trainees to work together, share resources, and provide peer support. The network has had thousands of trainees using it since February 2021, with positive feedback from all trainees. Results: The feedback from trainees has been overwhelmingly positive. Word of mouth has spread rapidly, growing the groups exponentially. Trainees add colleagues to the groups and often stay after they pass their exams to 'give back' to their fellow trainees. To date, thousands of trainees have passed the MRCGP exams using the resources and support provided by the network. Conclusion The success of this peer support network demonstrates the effectiveness of creating a network of thousands of doctors to provide medical education and support.

Keywords: peer support, medical education, pastoral support, MRCGP exams

Procedia PDF Downloads 135
1787 The Effect of Peer Pressure and Leisure Boredom on Substance Use Among Adolescents in Low-Income Communities in Capetown

Authors: Gaironeesa Hendricks, Shazly Savahl, Maria Florence

Abstract:

The aim of the study is to determine whether peer pressure and leisure boredom influence substance use among adolescents in low-income communities in Cape Town. Non-probability sampling was used to select 296 adolescents between the ages of 16–18 from schools located in two low-income communities. The measurement tools included the Drug Use Disorders Identification Test, the Resistance to Peer Influence and Leisure Boredom Scales. Multiple regression revealed that the combined influence of peer pressure and leisure boredom predicted substance use, while peer pressure emerged as a stronger predictor than leisure boredom on substance use among adolescents.

Keywords: substance use, peer pressure, leisure boredom, adolescents, multiple regression

Procedia PDF Downloads 599
1786 The Differential Role of Written Corrective Feedback in L2 Students’ Noticing and Its Impact on Writing Scores

Authors: Khaled ElEbyary, Ramy Shabara

Abstract:

L2 research has generally acknowledged the role of noticing in language learning. The role of teacher feedback is to trigger learners’ noticing of errors and direct the writing process. Recently L2 learners are seemingly using computerized applications which provide corrective feedback (CF) at different stages of writing (i.e., during and after writing). This study aimed principally to answer the question, “Is noticing likely to be maximized when feedback on erroneous output is electronically provided either during or after the composing stage, or does teacher annotated feedback have a stronger effect?”. Seventy-five participants were randomly distributed into four groups representing four conditions. These include receiving automated feedback at the composing stage, automated feedback after writing, teacher feedback, and no feedback. Findings demonstrate the impact of CF on writing and the intensity of noticing certain language areas at different writing stages and from different feedback sources.

Keywords: written corrective feedback, error correction, noticing, automated written corrective feedback, L2 acquisition

Procedia PDF Downloads 96
1785 Intrusion Detection System Based on Peer to Peer

Authors: Alireza Pour Ebrahimi, Vahid Abasi

Abstract:

Recently by the extension of internet usage, Research on the intrusion detection system takes a significant importance. Many of improvement systems prevent internal and external network attacks by providing security through firewalls and antivirus. In recently years, intrusion detection systems gradually turn from host-based systems and depend on O.S to the distributed systems which are running on multiple O.S. In this work, by considering the diversity of computer networks whit respect to structure, architecture, resource, services, users and also security goals requirement a fully distributed collaborative intrusion detection system based on peer to peer architecture is suggested. in this platform each partner device (matched device) considered as a peer-to-peer network. All transmitted information to network are visible only for device that use security scanning of a source. Experimental results show that the distributed architecture is significantly upgradeable in respect to centralized approach.

Keywords: network, intrusion detection system, peer to peer, internal and external network

Procedia PDF Downloads 547
1784 The Efficacy of a Student Designed and Led Near Peer Anatomy Teaching

Authors: Mark Heads, Carrie Adamson

Abstract:

Introduction This study evaluated the educational merits of the teaching activities of ‘Sheffield Anatomy Society,’ a student society with minimal faculty oversight which delivers near peer teaching in a range of formats to support students in their revision. Near peer, teaching is defined as teaching delivered by more senior students who have themselves recently completed the course content. This study was conducted between early April and late May 2022. This programme aims to improve student knowledge of anatomy, increase student confidence in their anatomy learning and cultivate a sense of community. The sessions were delivered by more senior medical students and by medical students undertaking an intercalated Master's degree in Human Anatomy with Education. Background: The majority of studies concerning near peer teaching focus on faculty designed programmes. Few studies have examined entirely student led near peer teaching of anatomy. Existing studies have been favourable but have limited qualitative examination of the benefits and weaknesses of near peer teaching. Various drawbacks have been proposed in the literature but not extensively investigated in practice. This study examines student led near peer anatomy teaching across a range of formats and considers these proposed criticisms. Methods: The teaching series consisted of 11 online lectures, a small group teaching session, two in person mock spotter examinations, and an online mock examination. Feedback forms were given for each session, and follow up interviews were conducted. Thematic analysis utilising an interpretivist epistemology was conducted on the feedback form responses and interview transcripts. Findings: 207 first year medical students, 34 second year biomedical science students, and 12 third year biomedical science students completed one or more feedback forms following these sessions, with 875 responses being collected in total. Six interviews were conducted. 99.5% of respondents said that they would recommend these sessions to other students. The quantitative results ranged from a mean of 4.6-4.8/5 per session when asked to rate how useful the students found it. Qualitative: analysis yielded numerous strengths and some weaknesses of the programme. The most commonly cited strength was that students found the explanations readily comprehensible. Students also praised the interactive nature of the sessions, with students frequently saying they felt more able to engage with interactive elements and ask questions in these sessions than in faculty teaching. Students did, however, raise some issues. The most common drawback students mentioned was a desire for more help preparing for their examinations, especially more examination style questions. Criticisms of the teaching itself were less prominent and typically reflected time constraints and limited resources. Conclusions : This study suggests student organised near peer teaching, utilising interactive online lectures, small group teaching, and mock examinations, can be an effective method for supporting students studying anatomy. Students reported improvements in their knowledge as a result of the sessions, greater confidence approaching their examinations, and this programme has helped foster an environment where students feel able to ask questions outside of sessions and even get involved with teaching themselves the following academic year.

Keywords: medical education, near peer teaching, anatomy teaching, online learning

Procedia PDF Downloads 65
1783 A Comparative Study of Self, Peer and Teacher Assessment Based on an English Writing Checklist

Authors: Xiaoting Shi, Xiaomei Ma

Abstract:

In higher education, students' self-assessment and peer assessment of compositions in writing classes can effectively improve their ability of evaluative judgment. However, students' self-assessment and peer assessment are not advocated by most teachers because of the significant difference in scoring compared with teacher assessment. This study used a multi-faceted Rasch model to explore whether an English writing checklist containing 30 descriptors can effectively improve rating consistency among self-assessment, peer assessment and teacher assessment. Meanwhile, a questionnaire was adopted to survey students’ and teachers’ attitudes toward self-assessment and peer assessment using the writing checklist. Results of the multi-faceted Rasch model analysis show that the writing checklist can effectively distinguish the students’ writing ability (separate coefficient = 2.05, separate reliability = 0.81, chi-square value (df = 32) = 123.4). Moreover, the results revealed that the checklist could improve rating consistency among self-assessment, peer assessment and teacher assessment. (separate coefficient = 1.71, separate reliability = 0.75, chi-square value (df=4) = 20.8). The results of the questionnaire showed that more than 85% of students and all teachers believed that the checklist had a good advantage in self-assessment and peer assessment, and they were willing to use the checklist to conduct self-assessment and peer assessment in class in the future.

Keywords: english writing, self-assessment, peer assessment, writing checklist

Procedia PDF Downloads 153
1782 Students’ Perceptions of Formative Assessment Feedback: A Case Study for Undergraduate Students in Bahrain

Authors: Hasan Husain Ali Abdulnabi

Abstract:

Formative assessment feedback is increasingly practiced in higher education. Instructors allocate great time and effort to provide assessment feedback. However, educators are not sure about students’ perceptions, understanding and respond to the feedback given, as very limited research have been done about what students do with feedback and whether if they understand it. This study aims to explore students’ conceptions and perceptions of formative assessment feedback through questionnaire and focus group interviews. One hundred eighty undergraduate students doing different courses filled the questionnaire, and ten focus group discussions were conducted. Basic descriptive and content analyses were used to analyze students’ responses to the questionnaire, while grounded theory with open coding was used to analyze the focus group interviews. The study revealed that most students believe assessment feedback is helpful to improve their academic performance, and they take time to read, think and discuss their feedback. Also, the study shows most students understand the feedback given. However, students expressed that most of the written feedback given are too general, and they prefer individual oral feedback as it can lead to better understanding on how what and where to improve. The study concluded that students believe formative assessment feedback is valuable, students have reasonable understanding and respond to the feedback provided. However, this practice could be improved by requesting lecturers to make more specific feedback and communicate with students on the way of interpreting and using assessment feedback as a part of the learning and teaching process.

Keywords: assessment, feedback, formative, undergraduate, higher education

Procedia PDF Downloads 86
1781 An Ethnographic Study on Peer Support Work-Ers in a Peer Driven Non Governmental Organization: The Colorado Mental Wellness Network

Authors: Shawna M. Margesson

Abstract:

This research study seeks to explore the lived experience of peer support workers (PSWs) in a peer-led non-governmental organization in Denver, Colorado, USA. The Colorado Mental Wellness Network offers supportive wellness recovery services such as wellness recovery action plans (WRAP), advocacy trainings for anti-stigma campaigns, and PSWs to work with and for consumers in the community. This study suggests that a peer-run environment is a unique community setting for PSWs to work given all employees are living in mental wellness recovery. Little has been documented about PSWs' personal accounts of working within a recovery-oriented organization and their first-person accounts to working with consumers. The importance of this study is to provide an ethnographic account of both subjects; the lived experiences of PSWs of both organizational and consumer-driven recovery. This study seeks to add to the literature and the social work profession the personal accounts of PSWs as they provide services to others like themselves. It also will provide an additional lens to view the peer-driven movement in mental health and wellness recovery.

Keywords: peer to peer movement, mental health, ethnography, peer support workers

Procedia PDF Downloads 164
1780 Implementing Service Learning in the Health Education Curriculum

Authors: Karen Butler

Abstract:

Johnson C. Smith University, one of the nation’s oldest Historically Black Colleges and Universities, has a strong history of service learning and community service. We first integrated service learning and peer education into health education courses in the spring of 2000. Students enrolled in the classes served as peer educators for the semester. Since then, the program has evolved and expanded but remains an integral part of several courses. The purpose of this session is to describe our program in terms of development, successes, and obstacles, and feedback received. A detailed description of the service learning component in HED 235: Drugs and Drug Education and HED 337: Environmental Health will be provided. These classes are required of our Community Health majors but are also popular electives for students in other disciplines. Three sources of student feedback were used to evaluate and continually modify the component: the SIR II course evaluation, service learning reflection papers, and focus group interviews. Student feedback has been largely positive. When criticism was given, it was thoughtful and constructive – given in the spirit of making it better for the next group. Students consistently agreed that the service learning program increased their awareness of pertinent health issues; that both the service providers and service recipients benefited from the project; and that the goals/issues targeted by the service learning component fit the objectives of the course. Also, evidence of curriculum and learning enhancement was found in the reflection papers and focus group sessions. Service learning sets up a win-win situation. It provides a way to respond to campus and community health needs while enhancing the curriculum, as students learn more by doing things that benefit the health and wellness of others. Service learning is suitable for any health education course and any target audience would welcome the effort.

Keywords: black colleges, community health, health education, service learning

Procedia PDF Downloads 340
1779 Peer-To-Peer Lending and Macroeconomics: Searching for a Link

Authors: Asror Nigmonov Asqar Ogli, Sitora Inoyatova Amonovna

Abstract:

It has been a decade when the crowdfunding and P2P lending opportunities were created. Today, the market of these modern alternative investments is becoming increasingly complex to navigate. There are overwhelming amount of peer-to-peer lending platforms both in developed and emerging economies. This study looks into this market via the cross country empirical study. In this respect, it tests the effect of various macroeconomic factors on P2P loan lending. Based on the existing literature that largely lacks empirical investigations, it builds regression model that aims to explore the relationship between economy and P2P lending. Though the author found it extremely difficult to compare the findings with earlier studies, this paper had identified certain tendencies in the data and had certain policy implications. However, the paper could not find any significant effect of economic variables on P2P lending. The paper can be considered as a starting point in empirical investigation of P2P lending and highlights room further research based on limitations of the study.

Keywords: peer-to-peer lending, crowdfunding, marketplace lending, alternative finance, fintech

Procedia PDF Downloads 199
1778 A Hybrid P2P Storage Scheme Based on Erasure Coding and Replication

Authors: Usman Mahmood, Khawaja M. U. Suleman

Abstract:

A peer-to-peer storage system has challenges like; peer availability, data protection, churn rate. To address these challenges different redundancy, replacement and repair schemes are used. This paper presents a hybrid scheme of redundancy using replication and erasure coding. We calculate and compare the storage, access, and maintenance costs of our proposed scheme with existing redundancy schemes. For realistic behaviour of peers a trace of live peer-to-peer system is used. The effect of different replication, and repair schemes are also shown. The proposed hybrid scheme performs better than existing double coding hybrid scheme in all metrics and have an improved maintenance cost than hierarchical codes.

Keywords: erasure coding, P2P, redundancy, replication

Procedia PDF Downloads 394
1777 A Sustainable Training and Feedback Model for Developing the Teaching Capabilities of Sessional Academic Staff

Authors: Nirmani Wijenayake, Louise Lutze-Mann, Lucy Jo, John Wilson, Vivian Yeung, Dean Lovett, Kim Snepvangers

Abstract:

Sessional academic staff at universities have the most influence and impact on student learning, engagement, and experience as they have the most direct contact with undergraduate students. A blended technology-enhanced program was created for the development and support of sessional staff to ensure adequate training is provided to deliver quality educational outcomes for the students. This program combines innovative mixed media educational modules, a peer-driven support forum, and face-to-face workshops to provide a comprehensive training and support package for staff. Additionally, the program encourages the development of learning communities and peer mentoring among the sessional staff to enhance their support system. In 2018, the program was piloted on 100 sessional staff in the School of Biotechnology and Biomolecular Sciences to evaluate the effectiveness of this model. As part of the program, rotoscope animations were developed to showcase ‘typical’ interactions between staff and students. These were designed around communication, confidence building, consistency in grading, feedback, diversity awareness, and mental health and wellbeing. When surveyed, 86% of sessional staff found these animations to be helpful in their teaching. An online platform (Moodle) was set up to disseminate educational resources and teaching tips, to host a discussion forum for peer-to-peer communication and to increase critical thinking and problem-solving skills through scenario-based lessons. The learning analytics from these lessons were essential in identifying difficulties faced by sessional staff to further develop supporting workshops to improve outcomes related to teaching. The face-to-face professional development workshops were run by expert guest speakers on topics such as cultural diversity, stress and anxiety, LGBTIQ and student engagement. All the attendees of the workshops found them to be useful and 88% said they felt these workshops increase interaction with their peers and built a sense of community. The final component of the program was to use an adaptive e-learning platform to gather feedback from the students on sessional staff teaching twice during the semester. The initial feedback provides sessional staff with enough time to reflect on their teaching and adjust their performance if necessary, to improve the student experience. The feedback from students and the sessional staff on this model has been extremely positive. The training equips the sessional staff with knowledge and insights which can provide students with an exceptional learning environment. This program is designed in a flexible and scalable manner so that other faculties or institutions could adapt components for their own training. It is anticipated that the training and support would help to build the next generation of educators who will directly impact the educational experience of students.

Keywords: designing effective instruction, enhancing student learning, implementing effective strategies, professional development

Procedia PDF Downloads 128
1776 Optimal Peer-to-Peer On-Orbit Refueling Mission Planning with Complex Constraints

Authors: Jing Yu, Hongyang Liu, Dong Hao

Abstract:

On-Orbit Refueling is of great significance in extending space crafts' lifetime. The problem of minimum-fuel, time-fixed, Peer-to-Peer On-Orbit Refueling mission planning is addressed here with the particular aim of assigning fuel-insufficient satellites to the fuel-sufficient satellites and optimizing each rendezvous trajectory. Constraints including perturbation, communication link, sun illumination, hold points for different rendezvous phases, and sensor switching are considered. A planning model has established as well as a two-level solution method. The upper level deals with target assignment based on fuel equilibrium criterion, while the lower level solves constrained trajectory optimization using special maneuver strategies. Simulations show that the developed method could effectively resolve the Peer-to-Peer On-Orbit Refueling mission planning problem and deal with complex constraints.

Keywords: mission planning, orbital rendezvous, on-orbit refueling, space mission

Procedia PDF Downloads 226