Search results for: assessment for learning
12112 Exploring Teachers’ Beliefs about Diagnostic Language Assessment Practices in a Large-Scale Assessment Program
Authors: Oluwaseun Ijiwade, Chris Davison, Kelvin Gregory
Abstract:
In Australia, like other parts of the world, the debate on how to enhance teachers using assessment data to inform teaching and learning of English as an Additional Language (EAL, Australia) or English as a Foreign Language (EFL, United States) have occupied the centre of academic scholarship. Traditionally, this approach was conceptualised as ‘Formative Assessment’ and, in recent times, ‘Assessment for Learning (AfL)’. The central problem is that teacher-made tests are limited in providing data that can inform teaching and learning due to variability of classroom assessments, which are hindered by teachers’ characteristics and assessment literacy. To address this concern, scholars in language education and testing have proposed a uniformed large-scale computer-based assessment program to meet the needs of teachers and promote AfL in language education. In Australia, for instance, the Victoria state government commissioned a large-scale project called 'Tools to Enhance Assessment Literacy (TEAL) for Teachers of English as an additional language'. As part of the TEAL project, a tool called ‘Reading and Vocabulary assessment for English as an Additional Language (RVEAL)’, as a diagnostic language assessment (DLA), was developed by language experts at the University of New South Wales for teachers in Victorian schools to guide EAL pedagogy in the classroom. Therefore, this study aims to provide qualitative evidence for understanding beliefs about the diagnostic language assessment (DLA) among EAL teachers in primary and secondary schools in Victoria, Australia. To realize this goal, this study raises the following questions: (a) How do teachers use large-scale assessment data for diagnostic purposes? (b) What skills do language teachers think are necessary for using assessment data for instruction in the classroom? and (c) What factors, if any, contribute to teachers’ beliefs about diagnostic assessment in a large-scale assessment? Semi-structured interview method was used to collect data from at least 15 professional teachers who were selected through a purposeful sampling. The findings from the resulting data analysis (thematic analysis) provide an understanding of teachers’ beliefs about DLA in a classroom context and identify how these beliefs are crystallised in language teachers. The discussion shows how the findings can be used to inform professional development processes for language teachers as well as informing important factor of teacher cognition in the pedagogic processes of language assessment. This, hopefully, will help test developers and testing organisations to align the outcome of this study with their test development processes to design assessment that can enhance AfL in language education.Keywords: beliefs, diagnostic language assessment, English as an additional language, teacher cognition
Procedia PDF Downloads 19912111 Disease Level Assessment in Wheat Plots Using a Residual Deep Learning Algorithm
Authors: Felipe A. Guth, Shane Ward, Kevin McDonnell
Abstract:
The assessment of disease levels in crop fields is an important and time-consuming task that generally relies on expert knowledge of trained individuals. Image classification in agriculture problems historically has been based on classical machine learning strategies that make use of hand-engineered features in the top of a classification algorithm. This approach tends to not produce results with high accuracy and generalization to the classes classified by the system when the nature of the elements has a significant variability. The advent of deep convolutional neural networks has revolutionized the field of machine learning, especially in computer vision tasks. These networks have great resourcefulness of learning and have been applied successfully to image classification and object detection tasks in the last years. The objective of this work was to propose a new method based on deep learning convolutional neural networks towards the task of disease level monitoring. Common RGB images of winter wheat were obtained during a growing season. Five categories of disease levels presence were produced, in collaboration with agronomists, for the algorithm classification. Disease level tasks performed by experts provided ground truth data for the disease score of the same winter wheat plots were RGB images were acquired. The system had an overall accuracy of 84% on the discrimination of the disease level classes.Keywords: crop disease assessment, deep learning, precision agriculture, residual neural networks
Procedia PDF Downloads 33212110 A Review of Machine Learning for Big Data
Authors: Devatha Kalyan Kumar, Aravindraj D., Sadathulla A.
Abstract:
Big data are now rapidly expanding in all engineering and science and many other domains. The potential of large or massive data is undoubtedly significant, make sense to require new ways of thinking and learning techniques to address the various big data challenges. Machine learning is continuously unleashing its power in a wide range of applications. In this paper, the latest advances and advancements in the researches on machine learning for big data processing. First, the machine learning techniques methods in recent studies, such as deep learning, representation learning, transfer learning, active learning and distributed and parallel learning. Then focus on the challenges and possible solutions of machine learning for big data.Keywords: active learning, big data, deep learning, machine learning
Procedia PDF Downloads 44612109 The Effective Method for Postering Thinking Dispositions of Learners
Authors: H. Jalahi, A. Yazdanpanah Nozari
Abstract:
Background and Purpose: Assessment of learners’ performance is an important factors in teaching-learning process. When a factor is sensitive and has high influence on life, their assessment should be done precisely. Thinking dispositions are very important factors in medical education because of its specific condition. In this study a model is designed for fostering thinking dispositions of learners in which authentic assessment is an important element. Materials and Methods: Objective based research is developmental, and such a model was not designed for curricula. Data collection and comparing approaches about assessment and analyzing current assessments offered applied proposals. Results: Based on research findings, the current assessments are response-based, that is students instead of product of response, only offers the specific response which the teachers expects; but authentic assessment is a form of assessment in which students are asked to perform real-word tasks that demonstrate meaningful application of essential knowledge and skills. Conclusion: Because of the difficulties and unexpected problems in life and individuals needs to lifelong learning and conditions in medical course that require decision making in specific times, we must pay attention to reach thinking dispositions and it should be included in curriculum. Authentic assessment as an important aspect of curriculum can help fostering thinking dispositions of learners. Using this kind of assessments which focus on application of information and skills to solve real-word tasks have more important role in medical courses.Keywords: assessment, authentic, medical courses, developmental
Procedia PDF Downloads 36512108 Learning Performance of Sports Education Model Based on Self-Regulated Learning Approach
Authors: Yi-Hsiang Pan, Ching-Hsiang Chen, Wei-Ting Hsu
Abstract:
The purpose of this study was to compare the learning effects of the sports education model (SEM) to those of the traditional teaching model (TTM) in physical education classes in terms of students learning motivation, action control, learning strategies, and learning performance. A quasi-experimental design was utilized in this study, and participants included two physical educators and four classes with a total of 94 students in grades 5 and 6 of elementary schools. Two classes implemented the SEM (n=47, male=24, female=23; age=11.89, SD=0.78) and two classes implemented the TTM (n=47, male=25, female=22, age=11.77; SD=0.66). Data were collected from these participants using a self-report questionnaire (including a learning motivation scale, action control scale, and learning strategy scale) and a game performance assessment instrument, and multivariate analysis of covariance was used to conduct statistical analysis. The findings of the study revealed that the SEM was significantly better than the TTM in promoting students learning motivation, action control, learning strategies, and game performance. It was concluded that the SEM could promote the mechanics of students self-regulated learning process, and thereby improve students movement performance.Keywords: self-regulated learning theory, learning process, curriculum model, physical education
Procedia PDF Downloads 34212107 Evaluating Imitation Behavior of Children with Autism Spectrum Disorder Using Humanoid Robot NAO
Authors: Masud Karim, Md. Solaiman Mia, Saifuddin Md. Tareeq, Md. Hasanuzzaman
Abstract:
Autism Spectrum Disorder (ASD) is a neurodevelopment disorder. Such disorder is found in childhood life. Children with ASD have less capabilities in communication and social skills. Therapies are used to develop communication and social skills. Recently researchers have been trying to use robots in such therapies. In this paper, we have presented social skill learning test cases for children with ASD. Autism conditions are measured in 30 children in a special school. Among them, twelve children are selected who have equal ASD conditions. Then six children participated in training with humans, and another six children participated in training with robots. The learning session continued for one week and three hours each day. We have taken an assessment test before the learning sessions. After completing the learning sessions, we have taken another assessment test. We have found better performances from children who have participated in robotic sessions rather than the children who have participated in human sessions.Keywords: children with ASD, NAO robot, human-robot interaction, social skills
Procedia PDF Downloads 8812106 An Exploratory Sequential Design: A Mixed Methods Model for the Statistics Learning Assessment with a Bayesian Network Representation
Authors: Zhidong Zhang
Abstract:
This study established a mixed method model in assessing statistics learning with Bayesian network models. There are three variants in exploratory sequential designs. There are three linked steps in one of the designs: qualitative data collection and analysis, quantitative measure, instrument, intervention, and quantitative data collection analysis. The study used a scoring model of analysis of variance (ANOVA) as a content domain. The research study is to examine students’ learning in both semantic and performance aspects at fine grain level. The ANOVA score model, y = α+ βx1 + γx1+ ε, as a cognitive task to collect data during the student learning process. When the learning processes were decomposed into multiple steps in both semantic and performance aspects, a hierarchical Bayesian network was established. This is a theory-driven process. The hierarchical structure was gained based on qualitative cognitive analysis. The data from students’ ANOVA score model learning was used to give evidence to the hierarchical Bayesian network model from the evidential variables. Finally, the assessment results of students’ ANOVA score model learning were reported. Briefly, this was a mixed method research design applied to statistics learning assessment. The mixed methods designs expanded more possibilities for researchers to establish advanced quantitative models initially with a theory-driven qualitative mode.Keywords: exploratory sequential design, ANOVA score model, Bayesian network model, mixed methods research design, cognitive analysis
Procedia PDF Downloads 17912105 Learning for the Future: Flipping English Language Learning Classrooms for Future
Authors: Natarajan Hema, Tamilarasan Karunakaran
Abstract:
Technology is remodeling the process of teaching and learning. An inflection point is faced where technological interventions are rewiring learning process in formal classrooms. Employment depends on dynamic learning capability. Transforming the functionalities of teaching-learning-assessment through innovation is needed to modify the roles of teacher to enabler and learner to the dynamic learner. This makeover is vital for English language teaching where English is acquired as a skill, exercised as ability and get stabilized as a competence. This reshaping could be achieved through providing autonomy to participants of learning. This paper explores parameters and components aiding such a transformation. The differentiated responsibilities and other critical learning support systems are projected as viable options. New age teaching practices are studied for feasibilities to aid transformation and being put forth an inter-operable teaching-learning system for a learner-centric ELT classrooms. LOTUS model developed by the authors is also studied for its inclusiveness to promote skill acquisition.Keywords: ELT methodology, communicative competence, skill acquisition , new age teaching
Procedia PDF Downloads 35812104 Nurturing of Children with Results from Their Nature (DNA) Using DNA-MILE
Authors: Tan Lay Cheng (Cheryl), Low Huiqi
Abstract:
Background: All children learn at different pace. Individualized learning is an approach that tailors to the individual learning needs of each child. When implementing this approach, educators have to base their lessons on the understanding that all students learn differently and that what works for one student may not work for another. In the current early childhood environment, individualized learning is for children with diverse needs. However, a typical developing child is also able to benefit from individualized learning. This research abstract explores the concept of utilizing DNA-MILE, a patented (in Singapore) DNA-based assessment tool that can be used to measure a variety of factors that can impact learning. The assessment report includes the dominant intelligence of the user or, in this case, the child. From the result, a personalized learning plan that is tailored to each individual student's needs. Methods: A study will be conducted to investigate the effectiveness of DNA-MILE in supporting individualized learning. The study will involve a group of 20 preschoolers who were randomly assigned to either a DNA-MILE-assessed group (experimental group) or a control group. 10 children in each group. The experimental group will receive DNA Mile assessments and personalized learning plans, while the control group will not. The children in the experimental group will be taught using the dominant intelligence (as shown in the DNA-MILE report) to enhance their learning in other domains. The children in the control group will be taught using the curriculum and lesson plan set by their teacher for the whole class. Parents’ and teachers’ interviews will be conducted to provide information about the children before the study and after the study. Results: The results of the study will show the difference in the outcome of the learning, which received DNA Mile assessments and personalized learning plans, significantly outperformed the control group on a variety of measures, including standardized tests, grades, and motivation. Conclusion: The results of this study suggest that DNA Mile can be an effective tool for supporting individualized learning. By providing personalized learning plans, DNA Mile can help to improve learning outcomes for all students.Keywords: individualized, DNA-MILE, learning, preschool, DNA, multiple intelligence
Procedia PDF Downloads 11812103 The Effect of Self and Peer Assessment Activities in Second Language Writing: A Washback Effect Study on the Writing Growth during the Revision Phase in the Writing Process: Learners’ Perspective
Authors: Musbah Abdussayed
Abstract:
The washback effect refers to the influence of assessment on teaching and learning, and this washback effect can either be positive or negative. This study implemented, sequentially, self-assessment (SA) and peer assessment (PA) and examined the washback effect of self and peer assessment (SPA) activities on the writing growth during the revision phase in the writing process. Twenty advanced Arabic as a second language learners from a private school in the USA participated in the study. The participants composed and then revised a short Arabic story as a part of a midterm grade. Qualitative data was collected, analyzed, and synthesized from ten interviews with the learners and from the twenty learners’ post-reflective journals. The findings indicate positive washback effects on the learners’ writing growth. The PA activity enhanced descriptions and meaning, promoted creativity, and improved textual coherence, whereas the SA activity led to detecting editing issues. Furthermore, both SPA activities had washback effects in common, including helping the learners meet the writing genre conventions and developing metacognitive awareness. However, the findings also demonstrate negative washback effects on the learners’ attitudes during the revision phase in the writing process, including bias toward self-evaluation during the SA activity and reluctance to rate peers’ writing performance during the PA activity. The findings suggest that self-and peer assessment activities are essential teaching and learning tools that can be utilized sequentially to help learners tackle multiple writing areas during the revision phase in the writing process.Keywords: self assessment, peer assessment, washback effect, second language writing, writing process
Procedia PDF Downloads 6812102 Project Management at University: Towards an Evaluation Process around Cooperative Learning
Authors: J. L. Andrade-Pineda, J.M. León-Blanco, M. Calle, P. L. González-R
Abstract:
The enrollment in current Master's degree programs usually pursues gaining the expertise required in real-life workplaces. The experience we present here concerns the learning process of "Project Management Methodology (PMM)", around a cooperative/collaborative mechanism aimed at affording students measurable learning goals and providing the teacher with the ability of focusing on the weaknesses detected. We have designed a mixed summative/formative evaluation, which assures curriculum engage while enriches the comprehension of PMM key concepts. In this experience we converted the students into active actors in the evaluation process itself and we endowed ourselves as teachers with a flexible process in which along with qualifications (score), other attitudinal feedback arises. Despite the high level of self-affirmation on their discussion within the interactive assessment sessions, they ultimately have exhibited a great ability to review and correct the wrong reasoning when that was the case.Keywords: cooperative-collaborative learning, educational management, formative-summative assessment, leadership training
Procedia PDF Downloads 16912101 An Assessment of Digital Platforms, Student Online Learning, Teaching Pedagogies, Research and Training at Kenya College of Accounting University
Authors: Jasmine Renner, Alice Njuguna
Abstract:
The booming technological revolution is driving a change in the mode of delivery systems especially for e-learning and distance learning in higher education. The report and findings of the study; an assessment of digital platforms, student online learning, teaching pedagogies, research and training at Kenya College of Accounting University (hereinafter 'KCA') was undertaken as a joint collaboration project between the Carnegie African Diaspora Fellowship and input from the staff, students and faculty at KCA University. The participants in this assessment/research met for selected days during a six-week period during which, one-one consultations, surveys, questionnaires, foci groups, training, and seminars were conducted to ascertain 'online learning and teaching, curriculum development, research and training at KCA.' The project was organized into an eight-week project workflow with each week culminating in project activities designed to assess digital online teaching and learning at KCA. The project also included the training of distance learning instructors at KCA and the evaluation of KCA’s distance platforms and programs. Additionally, through a curriculum audit and redesign, the project sought to enhance the curriculum development activities related to of distance learning at KCA. The findings of this assessment/research represent the systematic deliberate process of gathering, analyzing and using data collected from DL students, DL staff and lecturers and a librarian personnel in charge of online learning resources and access at KCA. We engaged in one-on-one interviews and discussions with staff, students, and faculty and collated the findings to inform practices that are effective in the ongoing design and development of eLearning earning at KCA University. Overall findings of the project led to the following recommendations. First, there is a need to address infrastructural challenges that led to poor internet connectivity for online learning, training needs and content development for faculty and staff. Second, there is a need to manage cultural impediments within KCA; for example fears of vital change from one platform to another for effectiveness and Institutional goodwill as a vital promise of effective online learning. Third, at a practical and short-term level, the following recommendations based on systematic findings of the research conducted were as follows: there is a need for the following to be adopted at KCA University to promote the effective adoption of online learning: a) an eLearning compatible faculty lab, b) revision of policy to include an eLearn strategy or strategic management, c) faculty and staff recognitions engaged in the process of training for the adoption and implementation of eLearning and d) adequate website resources on eLearning. The report and findings represent a comprehensive approach to a systematic assessment of online teaching and learning, research and training at KCA.Keywords: e-learning, digital platforms, student online learning, online teaching pedagogies
Procedia PDF Downloads 19112100 Evaluation of Learning Outcomes, Satisfaction and Self-Assessment of Students as a Change Factor in the Polish Higher Education System
Authors: Teresa Kupczyk, Selçuk Mustafa Özcan, Joanna Kubicka
Abstract:
The paper presents results of specialist literature analysis concerning learning outcomes and student satisfaction as a factor of the necessary change in the Polish higher education system. The objective of the empirical research was to determine students’ assessment of learning outcomes, satisfaction of their expectations, as well as their satisfaction with lectures and practical classes held in the traditional form, e-learning and video-conference. The assessment concerned effectiveness of time spent at classes, usefulness of the delivered knowledge, instructors’ preparation and teaching skills, application of tools, studies curriculum, its adaptation to students’ needs and labour market, as well as studying conditions. Self-assessment of learning outcomes was confronted with assessment by lecturers. The indirect objective of the research was also to identify how students assessed their activity and commitment in acquisition of knowledge and their discipline in achieving education goals. It was analysed how the studies held affected the students’ willingness to improve their skills and assessment of their perspectives at the labour market. To capture the changes underway, the research was held at the beginning, during and after completion of the studies. The study group included 86 students of two editions of full-time studies majoring in Management and specialising in “Mega-event organisation”. The studies were held within the EU-funded project entitled “Responding to challenges of new markets – innovative managerial education”. The results obtained were analysed statistically. Average results and standard deviations were calculated. In order to describe differences between the studied variables present during the process of studies, as well as considering the respondents’ gender, t-Student test for independent samples was performed with the IBM SPSS Statistics 21.0 software package. Correlations between variables were identified by calculation of Pearson and Spearman correlation coefficients. Research results suggest necessity to introduce some changes in the teaching system applied at Polish higher education institutions, not only considering the obtained outcomes, but also impact on students’ willingness to improve their qualifications constantly, improved self-assessment among students and their opportunities at the labour market.Keywords: higher education, learning outcomes, students, change
Procedia PDF Downloads 24012099 Risk Assessment and Management Using Machine Learning Models
Authors: Lagnajeet Mohanty, Mohnish Mishra, Pratham Tapdiya, Himanshu Sekhar Nayak, Swetapadma Singh
Abstract:
In the era of global interconnectedness, effective risk assessment and management are critical for organizational resilience. This review explores the integration of machine learning (ML) into risk processes, examining its transformative potential and the challenges it presents. The literature reveals ML's success in sectors like consumer credit, demonstrating enhanced predictive accuracy, adaptability, and potential cost savings. However, ethical considerations, interpretability issues, and the demand for skilled practitioners pose limitations. Looking forward, the study identifies future research scopes, including refining ethical frameworks, advancing interpretability techniques, and fostering interdisciplinary collaborations. The synthesis of limitations and future directions highlights the dynamic landscape of ML in risk management, urging stakeholders to navigate challenges innovatively. This abstract encapsulates the evolving discourse on ML's role in shaping proactive and effective risk management strategies in our interconnected and unpredictable global landscape.Keywords: machine learning, risk assessment, ethical considerations, financial inclusion
Procedia PDF Downloads 7212098 Demystifying Mathematics: Handling Learning Disabilities in Mathematics Among Low Achievers in Kenyan Schools
Authors: Gladys Gakenia Njoroge
Abstract:
Mathematics is a compulsory subject in both primary and secondary schools in Kenya. However, learners’ poor performance in the subject in Kenya national examinations year in year out remains a serious concern for teachers of Mathematics, parents, curriculum developers, and the general public. This is particularly worrying because of the importance attached to the subject in national development hence the need to find out what could be affecting learning of Mathematics in Kenyan schools. The research on which this paper is based sought to examine the factors that influence performance in Mathematics in Kenyan schools; identify the characteristics of Mathematics learning disabilities; determine how the learners with such learning disabilities can be assessed and identified and interventions for these difficulties implemented. A case study was undertaken on class six learners in a primary school in Nairobi County. The tools used for the research were: classroom observations and an Individualized Education Program (IEP) developed by the teachers with the help of the researcher. This paper therefore highlights the findings from the research, discusses the implications of the findings and suggests the way forward as far as teaching, learning and assessment of Mathematics in Kenyan schools is concerned. Perhaps with the application of the right interventions, poor performance in Mathematics in the national examinations in Kenya will be a thing of the past.Keywords: demystifying mathematics, individualized education program, learning difficulties, assessment
Procedia PDF Downloads 9212097 Assessment of E-Learning Facilities in Open and Distance Learning and Information Need by Students
Authors: Sabo Elizabeth
Abstract:
Electronic learning is increasingly popular learning approach in higher educational institutions due to vast growth of internet technology. This approach is important in human capital development. An investigation of open distance and e-learning facilities and information need by open and distance learning students was carried out in Jalingo, Nigeria. Structured questionnaires were administered to 70 registered ODL students of the NOUN. Information sourced from the respondents covered demographic, economic and institutional variables. Data collected for demographic variables were computed as frequency count and percentages. Assessment of the effectiveness of ODL facilities and information need among open and distance learning students was computed on a three or four point Likert Rating Scale. Findings indicated that there are more men compared to women. A large proportion of the respondents are married and there are more matured students in ODL compared to the youth. A high proportion of the ODL students obtained qualifications higher than the secondary school certificate. The proportion of computer literate ODL students was high, and large number of the students does not own a laptop computer. Inadequate e -books and reference materials, internet gadgets and inadequate books (hard copies) and reference material are factors that limit utilization of e-learning facilities in the study areas. Inadequate computer facilities and power back up caused inconveniences and delay in administering and use of e learning facilities. To a high extent, open and distance learning students needed information on university time table and schedule of activities, availability and access to books (hard and e-books) and reference materials. The respondents emphasized that contact with course coordinators via internet will provide a better learning and academic performance.Keywords: open and distance learning, information required, electronic books, internet gadgets, Likert scale test
Procedia PDF Downloads 32512096 Leveraging Learning Analytics to Inform Learning Design in Higher Education
Authors: Mingming Jiang
Abstract:
This literature review aims to offer an overview of existing research on learning analytics and learning design, the alignment between the two, and how learning analytics has been leveraged to inform learning design in higher education. Current research suggests a need to create more alignment and integration between learning analytics and learning design in order to not only ground learning analytics on learning sciences but also enable data-driven decisions in learning design to improve learning outcomes. In addition, multiple conceptual frameworks have been proposed to enhance the synergy and alignment between learning analytics and learning design. Future research should explore this synergy further in the unique context of higher education, identifying learning analytics metrics in higher education that can offer insight into learning processes, evaluating the effect of learning analytics outcomes on learning design decision-making in higher education, and designing learning environments in higher education that make the capturing and deployment of learning analytics outcomes more efficient.Keywords: learning analytics, learning design, big data in higher education, online learning environments
Procedia PDF Downloads 17212095 An Integrated Architecture of E-Learning System to Digitize the Learning Method
Authors: M. Touhidul Islam Sarker, Mohammod Abul Kashem
Abstract:
The purpose of this paper is to improve the e-learning system and digitize the learning method in the educational sector. The learner will login into e-learning platform and easily access the digital content, the content can be downloaded and take an assessment for evaluation. Learner can get access to these digital resources by using tablet, computer, and smart phone also. E-learning system can be defined as teaching and learning with the help of multimedia technologies and the internet by access to digital content. E-learning replacing the traditional education system through information and communication technology-based learning. This paper has designed and implemented integrated e-learning system architecture with University Management System. Moodle (Modular Object-Oriented Dynamic Learning Environment) is the best e-learning system, but the problem of Moodle has no school or university management system. In this research, we have not considered the school’s student because they are out of internet facilities. That’s why we considered the university students because they have the internet access and used technologies. The University Management System has different types of activities such as student registration, account management, teacher information, semester registration, staff information, etc. If we integrated these types of activity or module with Moodle, then we can overcome the problem of Moodle, and it will enhance the e-learning system architecture which makes effective use of technology. This architecture will give the learner to easily access the resources of e-learning platform anytime or anywhere which digitizes the learning method.Keywords: database, e-learning, LMS, Moodle
Procedia PDF Downloads 18812094 A Transformer-Based Question Answering Framework for Software Contract Risk Assessment
Authors: Qisheng Hu, Jianglei Han, Yue Yang, My Hoa Ha
Abstract:
When a company is considering purchasing software for commercial use, contract risk assessment is critical to identify risks to mitigate the potential adverse business impact, e.g., security, financial and regulatory risks. Contract risk assessment requires reviewers with specialized knowledge and time to evaluate the legal documents manually. Specifically, validating contracts for a software vendor requires the following steps: manual screening, interpreting legal documents, and extracting risk-prone segments. To automate the process, we proposed a framework to assist legal contract document risk identification, leveraging pre-trained deep learning models and natural language processing techniques. Given a set of pre-defined risk evaluation problems, our framework utilizes the pre-trained transformer-based models for question-answering to identify risk-prone sections in a contract. Furthermore, the question-answering model encodes the concatenated question-contract text and predicts the start and end position for clause extraction. Due to the limited labelled dataset for training, we leveraged transfer learning by fine-tuning the models with the CUAD dataset to enhance the model. On a dataset comprising 287 contract documents and 2000 labelled samples, our best model achieved an F1 score of 0.687.Keywords: contract risk assessment, NLP, transfer learning, question answering
Procedia PDF Downloads 12912093 A Project-Based Learning Approach in the Course of 'Engineering Skills' for Undergraduate Engineering Students
Authors: Armin Eilaghi, Ahmad Sedaghat, Hayder Abdurazzak, Fadi Alkhatib, Shiva Sadeghi, Martin Jaeger
Abstract:
A summary of experiences, recommendations, and lessons learnt in the application of PBL in the course of “Engineering Skills” in the School of Engineering at Australian College of Kuwait in Kuwait is presented. Four projects were introduced as part of the PBL course “Engineering Skills” to 24 students in School of Engineering. These students were grouped in 6 teams to develop their skills in 10 learning outcomes. The learning outcomes targeted skills such as drawing, design, modeling, manufacturing and analysis at a preliminary level; and also some life line learning and teamwork skills as these students were exposed for the first time to the PBL (project based learning). The students were assessed for 10 learning outcomes of the course and students’ feedback was collected using an anonymous survey at the end of the course. Analyzing the students’ feedbacks, it is observed that 67% of students preferred multiple smaller projects than a single big project because it provided them with more time and attention focus to improve their “soft skills” including project management, risk assessment, and failure analysis. Moreover, it is found that 63% of students preferred to work with different team members during the course to improve their professional communication skills. Among all, 62% of students believed that working with team members from other departments helped them to increase the innovative aspect of projects and improved their overall performance. However, 70% of students counted extra time needed to regenerate momentum with the new teams as the major challenge. Project based learning provided a suitable platform for introducing students to professional engineering practice and meeting the needs of students, employers and educators. It was found that students achieved their 10 learning outcomes and gained new skills developed in this PBL unit. This was reflected in their portfolios and assessment survey.Keywords: project-based learning, engineering skills, undergraduate engineering, problem-based learning
Procedia PDF Downloads 16512092 Navigating the Integration of AI in High School Assessment: Strategic Implementation and Ethical Practice
Authors: Loren Clarke, Katie Reed
Abstract:
The integration of artificial intelligence (AI) in high school education assessment offers transformative potential, providing more personalized, timely, and accurate evaluations of student performance. However, the successful adoption of AI-driven assessment systems requires robust change management strategies to navigate the complexities and resistance that often accompany such technological shifts. This presentation explores effective methods for implementing AI in high school assessment, emphasizing the need for strategic planning and stakeholder engagement. Focusing on a case study of a Victorian high school, it will examine the practical steps taken to integrate AI into teaching and learning. This school has developed innovative processes to support academic integrity and foster authentic cogeneration with AI, ensuring that the technology is used ethically and effectively. By creating comprehensive professional development programs for teachers and maintaining transparent communication with students and parents, the school has successfully aligned AI technologies with their existing curricula and assessment frameworks. The session will highlight how AI has enhanced both formative and summative assessments, providing real-time feedback that supports differentiated instruction and fosters a more personalized learning experience. Participants will learn about best practices for managing the integration of AI in high school settings while maintaining a focus on equity and student-centered learning. This presentation aims to equip high school educators with the insights and tools needed to effectively manage the integration of AI in assessment, ultimately improving educational outcomes and preparing students for future success. Methodologies: The research is a case study of a Victorian high school to examine AI integration in assessments, focusing on practical implementation steps, ethical practices, and change management strategies to enhance personalized learning and assessment. Outcomes: This research explores AI integration in high school assessments, focusing on personalized evaluations, ethical use, and change management. A Victorian school case study highlights best practices to enhance assessments and improve student outcomes. Main Contributions: This research contributes by outlining effective AI integration in assessments, showcasing a Victorian school's implementation, and providing best practices for ethical use, change management, and enhancing personalized learning outcomes.Keywords: artificial intelligence, assessment, curriculum design, teaching and learning, ai in education
Procedia PDF Downloads 2112091 The Twain Shall Meet: First Year Writing Skills in Senior Year Project Design
Authors: Sana Sayed
Abstract:
The words objectives, outcomes, and assessment are commonplace in academia. Educators, especially those who use their emotional intelligence as a useful teaching tool, strive to find creative and innovative ways to connect to their students while meeting the objectives, outcomes, and assessment measures for their respective courses. However, what happens to these outcomes once the objectives have been met, students have completed a specific course, and generic letter grades have been generated? How can their knowledge and acquired skills be assessed over the course of semesters, throughout their years of study, and until their final year right before they graduate? Considering the courses students complete for different departments in various disciplines, how can these outcomes be measured, or at least maintained, across the curriculum? This research-driven paper uses the key course outcomes of first year, required writing courses and traces them in two senior level, required civil engineering design courses at the American University of Sharjah, which is located in the United Arab Emirates. The purpose of this research is two-fold: (1) to assess specific learning outcomes using a case study that focuses on courses from two different disciplines during two very distinctive years of study, and (2) to demonstrate how learning across the curriculum fosters life-long proficiencies among graduating students that are aligned with a university’s mission statement.Keywords: assessment, learning across the curriculum, objectives, outcomes
Procedia PDF Downloads 30212090 E–Learning System in Virtual Learning Environment to Develop Problem Solving Ability and Team Learning for Learners in Higher Education
Authors: Noawanit Songkram
Abstract:
This paper is a report on the findings of a study conducted on e–learning system in virtual learning environment to develop problem solving ability and team learning for learners in higher education. The methodology of this study was R&D research. The subjects were 18 undergraduate students in Faculty of Education, Chulalongkorn University in the academic year of 2013. The research instruments were a problem solving ability assessment, a team learning evaluation form, and an attitude questionnaire. The data was statistically analyzed using mean, standard deviation, one way repeated measure ANOVA and t–test. The research findings discovered the e –learning system in virtual learning environment to develop problem solving ability and team learning for learners in higher education consisted of five components:(1) online collaborative tools, (2) active learning activities, (3) creative thinking, (4) knowledge sharing process, (5) evaluation and nine processes which were (1) preparing in group working, (2) identifying interested topic, (3) analysing interested topic, (4) collecting data, (5) concluding idea (6) proposing idea, (7) creating workings, (8) workings evaluation, (9) sharing knowledge from empirical experience.Keywords: e-learning system, problem solving ability, team leaning, virtual learning environment
Procedia PDF Downloads 43812089 A Holistic Conceptual Measurement Framework for Assessing the Effectiveness and Viability of an Academic Program
Authors: Munir Majdalawieh, Adam Marks
Abstract:
In today’s very competitive higher education industry (HEI), HEIs are faced with the primary concern of developing, deploying, and sustaining high quality academic programs. Today, the HEI has well-established accreditation systems endorsed by a country’s legislation and institutions. The accreditation system is an educational pathway focused on the criteria and processes for evaluating educational programs. Although many aspects of the accreditation process highlight both the past and the present (prove), the “program review” assessment is "forward-looking assessment" (improve) and thus transforms the process into a continuing assessment activity rather than a periodic event. The purpose of this study is to propose a conceptual measurement framework for program review to be used by HEIs to undertake a robust and targeted approach to proactively and continuously review their academic programs to evaluate its practicality and effectiveness as well as to improve the education of the students. The proposed framework consists of two main components: program review principles and the program review measurement matrix.Keywords: academic program, program review principles, curriculum development, accreditation, evaluation, assessment, review measurement matrix, program review process, information technologies supporting learning, learning/teaching methodologies and assessment
Procedia PDF Downloads 23812088 A Comparative Study of Self, Peer and Teacher Assessment Based on an English Writing Checklist
Authors: Xiaoting Shi, Xiaomei Ma
Abstract:
In higher education, students' self-assessment and peer assessment of compositions in writing classes can effectively improve their ability of evaluative judgment. However, students' self-assessment and peer assessment are not advocated by most teachers because of the significant difference in scoring compared with teacher assessment. This study used a multi-faceted Rasch model to explore whether an English writing checklist containing 30 descriptors can effectively improve rating consistency among self-assessment, peer assessment and teacher assessment. Meanwhile, a questionnaire was adopted to survey students’ and teachers’ attitudes toward self-assessment and peer assessment using the writing checklist. Results of the multi-faceted Rasch model analysis show that the writing checklist can effectively distinguish the students’ writing ability (separate coefficient = 2.05, separate reliability = 0.81, chi-square value (df = 32) = 123.4). Moreover, the results revealed that the checklist could improve rating consistency among self-assessment, peer assessment and teacher assessment. (separate coefficient = 1.71, separate reliability = 0.75, chi-square value (df=4) = 20.8). The results of the questionnaire showed that more than 85% of students and all teachers believed that the checklist had a good advantage in self-assessment and peer assessment, and they were willing to use the checklist to conduct self-assessment and peer assessment in class in the future.Keywords: english writing, self-assessment, peer assessment, writing checklist
Procedia PDF Downloads 15312087 Teachers’ Awareness of the Significance of Lifelong Learning: A Case Study of Secondary School Teachers of Batna - Algeria
Authors: Bahloul Amel
Abstract:
This study is an attempt to raise the awareness of the stakeholders and the authorities on the sensitivity of Algerian secondary school teachers of English as a Foreign Language about the students’ loss of English language skills learned during formal schooling with effort and at expense and the supposed measures to arrest that loss. Data was collected from secondary school teachers of EFL and analyzed quantitatively using a questionnaire containing open-ended and close-ended questions. The results advocate a consensus about the need for actions to be adopted to make assessment techniques outcome-oriented. Most of the participants were in favor of including curricular activities involving contextualized learning, problem-solving learning critical self-awareness, self and peer-assisted learning, use of computers and internet so as to make learners autonomous.Keywords: lifelong learning, EFL, contextualized learning, Algeria
Procedia PDF Downloads 34812086 Active Learning Strategies to Develop Student Skills in Information Systems for Management
Authors: Filomena Lopes, Sandra Fernandes
Abstract:
Active learning strategies are at the center of any change process aimed to improve the development of student skills. This paper aims to analyse the impact of teaching strategies, including problem-based learning (PBL), in the curricular unit of information system for management, based on students’ perceptions of how they contribute to develop the desired learning outcomes of the curricular unit. This course is part of the 1st semester and 3rd year of the graduate degree program in management at a private higher education institution in Portugal. The methodology included an online questionnaire to students (n=40). Findings from students reveal a positive impact of the teaching strategies used. In general, 35% considered that the strategies implemented in the course contributed to the development of courses’ learning objectives. Students considered PBL as the learning strategy that better contributed to enhance the courses’ learning outcomes. This conclusion brings forward the need for further reflection and discussion on the impact of student feedback on teaching and learning processes.Keywords: higher education, active learning strategies, skills development, student assessment
Procedia PDF Downloads 6112085 The Effectiveness of Using Plickers as a Formative Assessment Tool in EFL Classrooms
Authors: Alhanouf Alharbi, Wafa Alotaibi
Abstract:
This study aims to analyse students’ and teachers’ perceptions of using Plickers as a formative assessment tool in EFL classrooms. The study implements a mixed methods approach. First, a questionnaire was administered to 64 students from two schools in Almadinah, a Saudi city. Then, in structured interviews, two English teachers provided their opinions on the advantages and disadvantages of integrating Plickers into their classrooms. The findings reveal that both teachers and students believe that using Plickers positively impacts students’ learning. Moreover, the findings encourage teachers to integrate technology-based formative assessments in EFL classrooms. However, there are some drawbacks to using Plickers, such as technological issues. Finally, English teachers are recommended to engage all their students in a daily formative assessment by implementing Plickers in their classes.Keywords: plickers, formative assessment, technology, students, EFL classroom
Procedia PDF Downloads 14112084 OSEME: A Smart Learning Environment for Music Education
Authors: Konstantinos Sofianos, Michael Stefanidakis
Abstract:
Nowadays, advances in information and communication technologies offer a range of opportunities for new approaches, methods, and tools in the field of education and training. Teacher-centered learning has changed to student-centered learning. E-learning has now matured and enables the design and construction of intelligent learning systems. A smart learning system fully adapts to a student's needs and provides them with an education based on their preferences, learning styles, and learning backgrounds. It is a wise friend and available at any time, in any place, and with any digital device. In this paper, we propose an intelligent learning system, which includes an ontology with all elements of the learning process (learning objects, learning activities) and a massive open online course (MOOC) system. This intelligent learning system can be used in music education.Keywords: intelligent learning systems, e-learning, music education, ontology, semantic web
Procedia PDF Downloads 31212083 An Augmented-Reality Interactive Card Game for Teaching Elementary School Students
Authors: YuLung Wu, YuTien Wu, ShuMey Yu
Abstract:
Game-based learning can enhance the learning motivation of students and provide a means for them to learn through playing games. This study used augmented reality technology to develop an interactive card game as a game-based teaching aid for delivering elementary school science course content with the aim of enhancing student learning processes and outcomes. Through playing the proposed card game, students can familiarize themselves with appearance, features, and foraging behaviors of insects. The system records the actions of students, enabling teachers to determine their students’ learning progress. In this study, 37 students participated in an assessment experiment and provided feedback through questionnaires. Their responses indicated that they were significantly more motivated to learn after playing the game, and their feedback was mostly positive.Keywords: game-based learning, learning motivation, teaching aid, augmented reality
Procedia PDF Downloads 375