Search results for: learning outcomes evaluation

Authors: Suriyani Ariffin, Nor Aziah Alias, Khairil Iskandar Othman, Haslinda Yusoff

Abstract:

An Integrated Cumulative Grade Point Average (iCGPA) is a mechanism and strategy to ensure the curriculum of an academic programme is constructively aligned to the expected learning outcomes and student performance based on the attainment of those learning outcomes that is reported objectively in a spider web. Much effort and time has been spent to develop a viable mechanism and trains academics to utilize the platform for reporting. The question is: How well do learners conceive the idea of their achievement via iCGPA and whether quality learner attributes have been nurtured through the iCGPA mechanism? This paper presents the architecture of an integrated CGPA mechanism purported to address a holistic evaluation from the evaluation of courses learning outcomes to aligned programme learning outcomes attainment. The paper then discusses the students’ understanding of the mechanism and evaluation of their achievement from the generated spider web. A set of questionnaires were distributed to a group of students with iCGPA reporting and frequency analysis was used to compare the perspectives of students on their performance. In addition, the questionnaire also explored how they conceive the idea of an integrated, holistic reporting and how it generates their motivation to improve. The iCGPA group was found to be receptive to what they have achieved throughout their study period. They agreed that the achievement level generated from their spider web allows them to develop intervention and enhance the programme learning outcomes before they graduate.

Keywords: learning outcomes attainment, iCGPA, programme learning outcomes, spider web, iCGPA reporting skills

Procedia PDF Downloads 182

Authors: Radesh Palakurthi

Abstract:

The purpose of this study was to determine the impact of experiential learning on learning outcomes in hospitality education. This paper presents the results of an online survey of students from the U.S. studying abroad and their self-reported change in learning outcomes as assessed using the Core Competencies Model for the Hospitality Industry developed by Employment and Training Development Office of the U.S. Department of Labor. The impact of student learning styles on learning outcomes is also evaluated in this study. Kolb’s Learning Styles Inventory Model was used to assess students’ learning style. The results show that students reported significant improvements in their learning outcomes because of engaging in study abroad experiential learning programs. The learning styles of the students had significant effect on one of core learning outcomes- personal effectiveness.

Keywords: hospitality competencies, hospitality education, Kolb’s learning style inventory, learning outcomes, study abroad

Procedia PDF Downloads 193

Authors: Jeongim Kang, Moon Hee Kim, Seong Baeg Kim

Abstract:

This paper proposes a novel e-learning model that is based on a dynamic formative evaluation. On evaluating the existing format of e-learning, conditions regarding repetitive learning to achieve mastery, causes issues for learners to lose tension and become neglectful of learning. The dynamic formative evaluation proposed is able to supplement limitation of the existing approaches. Since a repetitive learning method does not provide a perfect feedback, this paper puts an emphasis on the dynamic formative evaluation that is able to maximize learning achievement. Through the dynamic formative evaluation, the instructor is able to refer to the evaluation result when making estimation about the learner. To show the flow chart of learning, based on the dynamic formative evaluation, the model proves its effectiveness and validity.

Keywords: online learning, dynamic formative evaluation, mastery learning, repetitive learning method, learning achievement

Procedia PDF Downloads 479

Authors: Huie-Wen Lin

Abstract:

This study integrated various teaching factors -based on the idea of a flipped classroom- in a financial management course. The study’s aim was to establish an effective teaching implementation strategy and evaluation mechanism with respect to learning outcomes, which can serve as a reference for the future modification of teaching methods. This study implemented a teaching method in five stages and estimated the learning efficiencies of 22 students (in the teaching scenario and over two semesters). Subsequently, data envelopment analysis (DEA) was used to compare, for each student, between the learning efficiencies before and after participation in the flipped classroom -in the first and second semesters, respectively- to identify the crucial external factors influencing learning efficiency. According to the results, the average overall student learning efficiency increased from 0.901 in the first semester to 0.967 in the second semester, which demonstrate that the flipped classroom approach can improve teaching effectiveness and learning outcomes. The results also revealed a difference in learning efficiency between male and female students.

Keywords: data envelopment analysis, flipped classroom, learning outcome, teaching and learning

Procedia PDF Downloads 123

Authors: Mingming Jiang

Abstract:

This literature review aims to offer an overview of existing research on learning analytics and learning design, the alignment between the two, and how learning analytics has been leveraged to inform learning design in higher education. Current research suggests a need to create more alignment and integration between learning analytics and learning design in order to not only ground learning analytics on learning sciences but also enable data-driven decisions in learning design to improve learning outcomes. In addition, multiple conceptual frameworks have been proposed to enhance the synergy and alignment between learning analytics and learning design. Future research should explore this synergy further in the unique context of higher education, identifying learning analytics metrics in higher education that can offer insight into learning processes, evaluating the effect of learning analytics outcomes on learning design decision-making in higher education, and designing learning environments in higher education that make the capturing and deployment of learning analytics outcomes more efficient.

Keywords: learning analytics, learning design, big data in higher education, online learning environments

Procedia PDF Downloads 123

Authors: Thuy T. T. Tran, Hamish Coates, Sophie Arkoudis

Abstract:

Evaluation instruments of teaching are abundant; however, these do not prompt any enhancement in the quality of teaching, not least because these instruments are framed only by teacher-centered conceptions of teaching. There is a need for more sophisticated teaching evaluation measures that focus on student learning and multi-stakeholder involvement. This study aims to develop such an evaluation instrument for Vietnamese higher education. The study uses several kinds of methods. The instrument was initially drafted through in-depth review of research, paying close attention to Vietnamese higher education. Draft evaluation instruments were produced and reviewed by 34 experts. The outcomes of this qualitative and quantitative data reveal an instrument that highlights the value of a multisource student-centered approach, and the rich integration of contextual and cultural traits where Confucian values are emphasized. The validation affirms that evaluating teaching in such way will facilitate the continuous learning growth of all stakeholders involved.

Keywords: multi stakeholders, quality teaching, student learning, teaching evaluation

Procedia PDF Downloads 271

Authors: Susan Lewis

Abstract:

The assessment of learning outcomes at the program level has attracted much international interest from the perspectives of quality assurance and ongoing curricular redesign and renewal. This paper examines program-level learning outcomes in the field of music and technology, an area of study that has seen an explosion in program development over the past fifteen years. The Audio Engineering Society (AES) maintains an online directory of educational institutions worldwide, yielding the most comprehensive inventory of programs and courses in music and technology. The inventory includes courses, programs, and degrees in music and technology, music and computer science, music production, and the music industry. This paper focuses on published student learning outcomes for undergraduate degrees in music and technology and analyses commonalities at institutions in North America, the United Kingdom, and Europe. The results of a survey of student learning outcomes at twenty institutions indicates a focus on three distinct student learning outcomes: (1) cross-disciplinary knowledge in the fields of music and technology; (2) the practical application of training through the professional industry; and (3) the acquisition of skills in communication and collaboration. The paper then analyses assessment mechanisms for tracking student learning and achievement of learning outcomes at these institutions. The results indicate highly variable assessment practices. Conclusions offer recommendations for enhancing assessment techniques and better communicating learning outcomes to students.

Keywords: quality assurance, student learning; learning outcomes, music and technology

Procedia PDF Downloads 142

Authors: Janet C. Read

Abstract:

UClan set collaboration with Lingokids to assess the Lingokids learning app's impact on learning outcomes in classrooms in the UK for children with ages ranging from 3 to 5 years. Data gathered during the controlled study with 69 children includes attitudinal data, engagement, and learning scores. Data shows that children enjoyment while learning was higher among those children using the game-based app compared to those children using other traditional methods. It’s worth pointing out that engagement when using the learning app was significantly higher than other traditional methods among older children. According to existing literature, there is a direct correlation between engagement, motivation, and learning. Therefore, this study provides relevant data points to conclude that Lingokids learning app serves its purpose of encouraging learning through playful and interactive content. That being said, we believe that learning outcomes should be assessed with a wider range of methods in further studies. Likewise, it would be beneficial to assess the level of usability and playability of the app in order to evaluate the learning app from other angles.

Keywords: learning app, learning outcomes, rapid test activity, Smileyometer, early childhood education, innovative pedagogy

Procedia PDF Downloads 40

Authors: Kanu Priya Mohan

Abstract:

Innovation in education is one of the essential pathways to achieve both educational, and development goals in today’s dynamically changing world. Over the last decade, coaching and mentoring have been applied in the field of education as positive intervention techniques for fostering teaching and learning reforms in the developed countries. The context of this research was Thailand’s educational reform process, wherein a project on coaching and mentoring (C&M) was launched in 2014. The C&M project endeavored to support the professional development of the school teachers in the various provinces of Thailand, and to also enable them to apply C&M for teaching innovative instructional techniques. This research aimed to empirically investigate the learning outcomes for the master trainers, who trained for coaching and mentoring as the first step in the process to train the school teachers. A mixed method study was used for evaluating the learning outcomes of training in terms of cognitive- behavioral-affective dimensions. In the first part of the research a quantitative research design was incorporated to evaluate the effects of learner characteristics and instructional techniques, on the learning outcomes. In the second phase, a qualitative method of in-depth interviews was used to find details about the training outcomes, as well as the perceived barriers and enablers of the training process. Sample size constraints were there, yet these exploratory results, integrated from both methods indicated the significance of evaluating training outcomes from the three dimensions, and the perceived role of other factors in the training. Findings are discussed in terms of their implications for the training of C&M, and also their impact in fostering positive education through innovative educational techniques in the developing countries.

Keywords: cognitive-behavioral-affective learning outcomes, mixed method research, teachers in Thailand, training evaluation

Procedia PDF Downloads 248

Authors: Jamaludin Jamaludin, Suparji Suparji, Lilik Anifah, I. Gusti Putu Asto Buditjahjanto, Eppy Yundra

Abstract:

Learning media is an important and main component in the learning process. By using currently available media, cadets still have difficulty understanding how the piston engine works, so they are not able to apply these concepts appropriately. This study aims to examine the development of interactive media for piston engine courses in order to improve student learning outcomes. The research method used is a literature study of several articles, journals and proceedings of interactive media development results from 2010-2020. The results showed that the development of interactive media is needed to support the learning process and influence the cognitive abilities of students. With this interactive media, learning outcomes can be improved and the learning process can be effective.

Keywords: interactive media, learning outcomes, learning process, literature study

Procedia PDF Downloads 121

Authors: M. H. Imam, Imran A. Tasadduq, Abdul-Rahim Ahmad, Fahd M. Aldosari

Abstract:

Learning outcomes of a course (CLOs) and the abilities at the time of graduation referred to as Student Outcomes (SOs) are required to be assessed for ABET accreditation. A question in an assessment must target a CLO as well as an SO and must represent a required level of competence. This paper presents the idea of an Expert System (ES) to select a proper question to satisfy ABET accreditation requirements. For ES implementation, seven attributes of a question are considered including the learning outcomes and Bloom’s Taxonomy level. A database contains all the data about a course including course content topics, course learning outcomes and the CLO-SO relationship matrix. The knowledge base of the presented ES contains a pool of questions each with tags of the specified attributes. Questions and the attributes represent expert opinions. With implicit rule base the inference engine finds the best possible question satisfying the required attributes. It is shown that the novel idea of such an ES can be implemented and applied to a course with success. An application example is presented to demonstrate the working of the proposed ES.

Keywords: expert system, student outcomes, course learning outcomes, question attributes

Procedia PDF Downloads 225

Authors: Ting Hsiang Chang

Abstract:

Nowadays in Taiwan, higher education, which was previously more emphasized on teaching-oriented approaches, has gradually shifted to an approach more focusing on students learning outcomes. With student employment rate as an important indicator for University Program Evaluation periodically held by the Ministry of Education, it becomes extremely critical for a university to build up a teaching and learning quality assurance system to bridge the gap between learning and practice. Teaching and Learning Quality Assurance System has been built and implemented at Chaoyang University of Technology for years and has received substantial results. By employing various forms of evaluation and performance appraisals, the effectiveness of teaching and learning can consistently be tracked as a means of ensuring teaching and learning quality. This study aims to explore the evaluation system of teaching and learning quality assurance system at the Chaoyang University of Technology by means of content analysis. The study contents the evaluation reports on the teaching and learning quality assurance at the Chaoyang University of Technology in the Academic Year 2013-2015. The quantitative results of the assessment were analyzed using the five-point Likert Scale. Quality assurance Committee meetings were further held for examining and discussions on the results. To the end, the annual evaluation report is to be produced as references used to improve approaches in both teaching and learning. The findings indicate that there is a respective relationship between the overall teaching evaluation items and the teaching goals and core competencies. In addition, graduates’ feedbacks were also collected for further analysis to examine if the current educational planning is able to achieve the university’s teaching goal and cultivation of core competencies.

Keywords: core competencies, teaching and learning quality assurance system, teaching goals, university program evaluation

Procedia PDF Downloads 264

Authors: Mohammed Alhawiti

Abstract:

Assessment of Learning Management Systems has been of less importance than its due share. This paper investigates the evaluation of learning management systems (LMS) within educational setting as both an online learning system as well as a helpful tool for multidisciplinary learning environment. This study suggests a theoretical e-learning evaluation model, studying a multi-dimensional methods for evaluation through LMS system, service and content quality, learner`s perspective and attitudes of the instructor. A survey was conducted among 105 e-learners. The sample consisted of students at both undergraduate and master’s levels. Content validity, reliability were tested through the instrument, Findings suggested the suitability of the proposed model in evaluation for the satisfaction of learners through LMS. The results of this study would be valuable for both instructors and users of e-learning systems.

Keywords: e-learning, LMS, higher education, management systems

Procedia PDF Downloads 369

Authors: Suratno

Abstract:

Metacognition thinking skills should be developed early on in learning. The aim of research builds metacognition thinking skills through collaborative learning with self-evaluation. Approach to action research study involving 32 middle school students in Jember Indonesia. Indicators metacognition skills consist of planning, information management strategies, comprehension monitoring, and debugging strategies. Data were analyzed by t test and analysis of instructional videos. Results of the study here were significant differences in metacognition skills before and after the implementation of collaborative learning with self-evaluation. Analysis instructional video showing the difference artifacts of student learning activities to learning before and after implementation of collaborative learning with self-evaluation. Self-evaluation makes students familiar practice thinking skills metacognition.

Keywords: metacognition, collaborative, evaluation, thinking skills

Procedia PDF Downloads 323

Authors: Juan Manuel Real-Espinosa

Abstract:

This paper addresses the first step to evaluate language learning apps: what theoretical framework to adopt when designing the app evaluation framework. The answer is not just one since there are several options that could be proposed. However, the question to be clarified is to what extent the learning design of apps is based on a specific learning approach, or on the contrary, on a fusion of elements from several theoretical proposals and paradigms, such as m-learning, mobile assisted language learning, and a number of theories about language acquisition. The present study suggests that the reality is closer to the second assumption. This implies that the theoretical framework against which the learning design of the apps should be evaluated must also be a hybrid theoretical framework, which integrates evaluation criteria from the different theories involved in language learning through mobile applications.

Keywords: mobile-assisted language learning, action-oriented approach, apps evaluation, post-method pedagogy, second language acquisition

Procedia PDF Downloads 164

Authors: Aqeel Zeid, Hasna Anees, Mohamed Adheeb, Mohamed Rifan, Kalpani Manathunga

Abstract:

To achieve constructive alignment in a higher education program, a clear set of learning outcomes must be defined. Traditional learning outcome definition techniques such as Bloom’s taxonomy are not written to be utilized by the student. This might be disadvantageous for students in student-centric learning settings where the students are expected to formulate their own learning strategies. To solve the problem, we propose the learning outcome relation and aggregation (LORA) model. To achieve alignment, we developed learning outcome, assessment, and resource authoring tools which help teachers to tag learning outcomes during creation. A pilot study was conducted with an expert panel consisting of experienced professionals in the education domain to evaluate whether the LORA model and tools present an improvement over the traditional methods. The panel unanimously agreed that the model and tools are beneficial and effective. Moreover, it helped them model learning outcomes in a more student centric and descriptive way.

Keywords: learning design, constructive alignment, Bloom’s taxonomy, learning outcome modelling

Procedia PDF Downloads 157

Authors: Hisyam Hidayatullah

Abstract:

Utilization game on a lesson needs to be done in order to provide proper motoric learning model to improve students' skills. Approach to the game, as one of the models of a motoric learning, is intended to improve student learning outcomes math trigonometry materials generally that prioritize a Memory or rote. The purpose of this study is producting innovation to improve a cognitive abilities of students in the field, to improve student performance, and ultimately to improve student understanding in determining a value of trigonometry in various quadrants, and it apply a approach to the game Domino "Cassava H154M" who is adopted from cassava game and it has made total revised in cassava content. The game is divided into 3 sessions: sine cassava, cosine cassava and cassava tangent. Researchers using action of research method, which consists of several stages such as: planning, implementation, observation, reporting and evaluation. Researchers found that a game approaches can improve student learning outcomes, enhance students' creativity in terms of their motoric learning, and creating a supportive learning environment.

Keywords: cassava "H154M", motoric, value of trigonometry, quadrant

Procedia PDF Downloads 298

Authors: Angela Knox

Abstract:

Student diversity in postgraduate classes puts major challengesoneducatorsseekingtoencouragestudentengagementand desired learning outcomes. This paper outlines the impact of a set of teaching initiatives aimed at addressing challenges associated with teaching and learning in an environment characterized by diversity in the student cohort. The study examines postgraduate students completing the core capstone unit within a specialized business degree. Although relatively small, the student cohort is highly diverse in terms of cultural backgrounds represented, prior learning and/or qualifications,aswellasdurationandtypeofworkexperiencerelevant to the degree being completed. The wide range of cultures, existing knowledge, and experience create enormous challenges with respect to students’ learning needs and outcomes. Subsequently, a suite of teaching innovations has been adopted to enhance curriculum content/delivery and the design of assessments. This paperexplores the impact of formalized group charters on students’ learning outcomes. Data from surveys and focus groups are used to assess the effectiveness of these practices. The results highlight the effectiveness of formalizedgroup charters in addressing diverse student needs and enhancing student engagement and learning outcomes. Thesefindings suggest that such practices would benefit students’ learning in environments marked by diversity in the student cohort. Specific recommendationsareofferedforothereducatorsworkingwithdiverse classes.

Keywords: assessment design, curriculum content, curriculum delivery, group charter, student diversity

Procedia PDF Downloads 107

Authors: Sheila Santharamohana, Susan Bennett

Abstract:

Historically, the attrition rates in secondary schools of Indigenous people or Orang Asli of Malaysia have been a cause for nationwide concern. Efforts to increase student engagement focusing on curriculum re-design and aid have not had the targeted impact. The scope of the research explored a change model incorporating project-based learning and wrap-around support through school-community partnerships to increase Orang Asli engagement, student outcomes and improve cultural connectedness. The evaluation methodology was mixed-method comprising a student questionnaire, interviews, and document analysis. Data and evidence were gathered from school staff, community, the Orang Asli governmental authority (JAKOA) and external agencies. Findings from the year-long research suggests shared values and goals in school-community partnerships foster responsive leadership and is key to safeguarding vulnerable Orang Asli, resulting in improved student outcomes. The research highlighted the barriers to the recognition and distinct needs and unique values of the Orang Asli that impact their educational equity and outcomes.

Keywords: Indigenous Education, Cultural Connectedness, School-Community Partnership, Student Outcomes

Procedia PDF Downloads 108

Authors: Y. Salfati, D. Sharef Bussel, J. Zamir

Abstract:

In this paper, we present an Evaluation Case Study implementing the eight principles of Collaborative Approaches to Evaluation (CAE) as designed by Brad Cousins in the past decade. The focus of this paper is sharing a rich experience in which we achieved two main goals. The first was the development of a valuable and meaningful new teacher training program, and the second was a successful implementation of the CAE principles. The innovative teacher training program is based on the idea of including physical movement during the process of teaching and learning academic themes. The program is called Learning through Movement. This program is a response to a call from the Ministry of Education, claiming that today children sit in front of screens and do not exercise any physical activity. In order to contribute to children’s health, physical, and cognitive development, the Ministry of Education promotes learning through physical activities. Research supports the idea that sports and physical exercise improve academic achievements. The Learning through Movement program is operated by Kaye Academic College. Students in the Elementary School Training Program, together with students in the Physical Education Training Program, implement the program in collaboration with two mentors from the College. The program combines academic learning with physical activity. The evaluation began at the beginning of the program. During the evaluation process, data was collected by means of qualitative tools, including interviews with mentors, observations during the students’ collaborative planning, class observations at school and focus groups with students, as well as the collection of documentation related to the teamwork and to the program itself. The data was analyzed using content analysis and triangulation. The preliminary results show outcomes relating to the Teacher Training Programs, the student teachers, the pupils in class, the role of Physical Education teachers, and the evaluation. The Teacher Training Programs developed a collaborative approach to lesson planning. The students' teachers demonstrated a change in their basic attitudes towards the idea of integrating physical activities during the lessons. The pupils indicated higher motivation through full participation in classes. These three outcomes are indicators of the success of the program. An additional significant outcome of the program relates to the status and role of the physical education teachers, changing their role from marginal to central in the school. Concerning evaluation, a deep sense of trust and confidence was achieved, between the evaluator and the whole team. The paper includes the perspectives and challenges of the heads and mentors of the two programs as well as the evaluator’s conclusions. The evaluation unveils challenges in conducting a CAE evaluation in such a complex setting.

Keywords: collaborative evaluation, training teachers, learning through movement

Procedia PDF Downloads 119

Authors: Abdullah Abu-Tineh, Youmen Chaaban

Abstract:

This study examines the development of a professional development (PD) model for teacher growth and learning that is embedded into the school context. The School based Support Program (SBSP), designed for the Qatari context, targets the practices, knowledge and skills of both school leadership and teachers in an attempt to improve student learning outcomes. Key aspects of the model include the development of learning communities among teachers, strong leadership that supports school improvement activities, and the use of research-based PD to improve teacher practices and student achievement. This paper further presents findings from an evaluation of this PD program. Based on an adaptation of Guskey’s evaluation of PD models, 100 teachers at the participating schools were selected for classroom observations and 40 took part in in-depth interviews to examine changed classroom practices. The impact of the PD program on student learning was also examined. Teachers’ practices and their students’ achievement in English, Arabic, mathematics and science were measured at the beginning and at the end of the intervention.

Keywords: initiative, professional development, school based support Program (SBSP), school reform

Procedia PDF Downloads 455

Authors: M. Dakshayini, P. Jayarekha

Abstract:

In traditional output-based education system, class room lecture and laboratory are the traditional delivery methods used during the course. Written examination and lab examination have been used as a conventional tool for evaluating student’s performance. Hence, there are certain apprehensions that the traditional education system may not efficiently prepare the students for competent professional life. This has led for the change from Traditional output-based education to Outcome-Based Education (OBE). OBE first sets the ideal programme learning outcome consecutively on increasing degree of complexity that students are expected to master. The core curriculum, teaching methodologies and assessment tools are then designed to achieve the proposed outcomes mainly focusing on what students can actually attain after they are taught. In this paper, we discuss a promising applications based learning and evaluation component involving industry collaboration to improve the quality of teaching and student learning process. Incorporation of this component definitely improves the quality of student learning in engineering education and helps the student to attain the competency as per the graduate attributes. This may also reduce the Industry-academia gap.

Keywords: outcome-based education, programme learning outcome, teaching-learning process, evaluation, industry collaboration

Procedia PDF Downloads 422

Authors: Sana Sayed

Abstract:

The words objectives, outcomes, and assessment are commonplace in academia. Educators, especially those who use their emotional intelligence as a useful teaching tool, strive to find creative and innovative ways to connect to their students while meeting the objectives, outcomes, and assessment measures for their respective courses. However, what happens to these outcomes once the objectives have been met, students have completed a specific course, and generic letter grades have been generated? How can their knowledge and acquired skills be assessed over the course of semesters, throughout their years of study, and until their final year right before they graduate? Considering the courses students complete for different departments in various disciplines, how can these outcomes be measured, or at least maintained, across the curriculum? This research-driven paper uses the key course outcomes of first year, required writing courses and traces them in two senior level, required civil engineering design courses at the American University of Sharjah, which is located in the United Arab Emirates. The purpose of this research is two-fold: (1) to assess specific learning outcomes using a case study that focuses on courses from two different disciplines during two very distinctive years of study, and (2) to demonstrate how learning across the curriculum fosters life-long proficiencies among graduating students that are aligned with a university’s mission statement.

Keywords: assessment, learning across the curriculum, objectives, outcomes

Procedia PDF Downloads 277

Authors: Seyed-Ali Sadegh-Zadeh, Kaveh Kavianpour, Hamed Atashbar, Elham Heidari, Saeed Shiry Ghidary, Amir M. Hajiyavand

Abstract:

Evaluation metrics play a critical role in assessing the performance of machine learning models. In this review paper, we provide a comprehensive overview of performance measurement approaches for machine learning models. For each category, we discuss the most widely used metrics, including their mathematical formulations and interpretation. Additionally, we provide a comparative analysis of performance measurement approaches for metric combinations. Our review paper aims to provide researchers and practitioners with a better understanding of performance measurement approaches and to aid in the selection of appropriate evaluation metrics for their specific applications.

Keywords: evaluation metrics, performance measurement, supervised learning, unsupervised learning, reinforcement learning, model robustness and stability, comparative analysis

Procedia PDF Downloads 20

Authors: Stephen Grant Atkins

Abstract:

Radical use of project-based learning (PBL) in a small New Zealand business school provides an opportunity to longitudinally examine its effects over a decade of pre-Covid data. Prior to this business school’s implementation of PBL, starting in 2012, the business pedagogy literature presented just one example of PBL replacing an entire core-set of courses. In that instance, a British business school merged four of its ‘degree Year 3’ accounting courses into one PBL semester. As radical as that would have seemed, to students aged 20-to-22, the PBL experiment conducted in a New Zealand business school was notably more extreme: 41 nationally-approved Learning Outcomes (L.O.s), these deriving from 8 separate core courses, were aggregated into one grand set of L.O.s, and then treated as a ‘full-year’/‘full-time’ single course. The 8 courses in question were all components of this business school’s compulsory ‘degree Year 1’ curriculum. Thus, the students involved were notably younger (…ages 17-to-19…), and no ‘part-time’ enrolments were allowed. Of interest are this PBL experiment’s effects on subsequent performance outcomes in ‘degree Years 2 & 3’ (….which continued to operate in their traditional ways). Of special interest is the quality of ‘group project’ outcomes. This is because traditionally, ‘degree Year 1’ course assessments are only minimally based on group work. This PBL experiment altered that practice radically, such that PBL ‘degree Year 1’ alumni entered their remaining two years of business coursework with far more ‘project group’ experience. Timeline-wise, thus of interest here, firstly, is ‘degree Year 2’ performance outcomes data from years 2010-2012 + 2016-2018, and likewise ‘degree Year 3’ data for years 2011-2013 + 2017-2019. Those years provide a pre-&-post comparative baseline for performance outcomes in students never exposed to this school’s radical PBL experiment. That baseline is then compared to PBL alumni outcomes (2013-2016….including’Student Evaluation of Course Quality’ outcomes…) to clarify ‘radical PBL’ effects.

Keywords: project-based learning, longitudinal mixed-methods, students criticism, effects-on-learning

Procedia PDF Downloads 69

Authors: Jatuphum Ketchatturat

Abstract:

Value-added assessment has been used for developing the model of monitoring and evaluation of student's learning achievement. The steps of model development consist of 1) study and analyisis of the school and the district report system of student achievement and progress, 2) collecting the data of student achievement to develop the value added indicator, 3) developing the system of value-added assessment by participatory action research approach, 4) putting the system of value-added assessment into the educational district of secondary school, 5) determining the quality of the developed system of value-added assessment. The components of the developed model consist of 1) the database of value-added assessment of student's learning achievement, 2) the process of monitoring and evaluation the student's learning achievement, and 3) the reporting system of value-added assessment of student's learning achievement.

Keywords: learning achievement, monitoring and evaluation, value-added assessment

Procedia PDF Downloads 391

Authors: Ladda Silanoi

Abstract:

One of the main purposes in establishment of ASEAN Community is educational development. All countries in ASEAN shall then prepare for plans and strategies for country development. Therefore, Thailand set up the policy concerning educational management for all educational institutions to understand about ASEAN Community. However, some educational institutions lack of precision in determining the curriculums of ASEAN Community, especially schools in rural areas, for example, schools along the common border with Laos, and Cambodia. One of the effective methods to promote the precision in ASEAN Community is to design additional learning courses. The important process of additional learning courses design is to provide learning outcomes of ASEAN Community for course syllabus determination. Therefore, the researcher is interested in developing teachers in the schools of common border with Laos, and Cambodia to provide learning outcomes and learning process. This research has the objective of developing the learning outcomes and learning process management of basic education along Thailand, Laos, and Cambodia Common Border for the ASEAN Community Preparation. Research methodology consists of 2 steps. Step 1: Delphi Technique was used to provide guidelines in development of learning outcomes and learning process. Step 2: Action Research procedures was employed to study the result of additional learning courses design. Result of the study: By using Delphi technique, consensus is expected to be achieved, from 50 experts in the study within 3 times of the survey. The last survey found that experts’ opinions were compatible on every item (inter-quartile range = 0) leading to the arrangement of training courses in step of Action Research. The result from the workshop found that teachers in schools of Srisaket and Bueng Kan provinces could be able to provide learning outcomes of all courses.

Keywords: learning outcome and learning process, basic education, ASEAN Community preparation, Thailand Laos and Cambodia common border

Procedia PDF Downloads 406

Authors: Gae Hee Song

Abstract:

This paper aims to address the evolution of public-private partnerships for mainstreaming an evaluation approach in the community-based education project. It examines the distinctive features of Save the Children’s School Me project in terms of empowerment evaluation principles introduced by David M. Fetterman, especially community ownership, capacity building, and organizational learning. School Me is a Save the Children Korea funded-project, having been implemented in Cote d’Ivoire and Sierra Leone since 2016. The objective of this project is to reduce gender-based disparities in school completion and learning outcomes by creating an empowering learning environment for girls and boys. Both quasi-experimental and experimental methods for impact evaluation have been used to explore changes in learning outcomes, gender attitudes, and learning environments. To locate School Me in the public-private partnership framework for community empowerment and sustainability, the data have been collected from School Me progress/final reports, baseline, and endline reports, fieldwork observations, inter-rater reliability of baseline and endline data collected from a total of 75 schools in Cote d’Ivoire and Sierra Leone. The findings of this study show that School Me project has a significant evaluation component, including qualitative exploratory research, participatory monitoring, and impact evaluation. It strongly encourages key actors, girls, boys, parents, teachers, community leaders, and local education authorities, to participate in the collection and interpretation of data. For example, 45 community volunteers collected baseline data in Cote d’Ivoire; on the other hand, three local government officers and fourteen enumerators participated in the follow-up data collection of Sierra Leone. Not only does this public-private partnership improve local government and community members’ knowledge and skills of monitoring and evaluation, but the evaluative findings also help them find their own problems and solutions with a strong sense of community ownership. Such community empowerment enables Save the Children country offices and member offices to gain invaluable experiences and lessons learned. As a result, empowerment evaluation leads to community-oriented governance and the sustainability of the School Me project.

Keywords: community empowerment, Cote d’Ivoire, empowerment evaluation, public-private partnership, save the children, school me, Sierra Leone, sustainability

Procedia PDF Downloads 99

Authors: Ryota Sugino, Satoshi Mizoguchi, Koji Kimita, Keiichi Muramatsu, Tatsunori Matsui, Yoshiki Shimomura

Abstract:

Improving added value and productivity of services entails improving both value-in-exchange and value-in-use. Value-in-use is realized by value co-creation, where providers and receivers create value together. In higher education services, value-in-use comes from learners achieving learning outcomes (e.g., knowledge and skills) that are consistent with their learning goals. To enhance the learning outcomes of a learner, it is necessary to enhance and utilize the abilities of the teacher along with the abilities of the learner. To do this, however, the learner and the teacher need to build a consensus about their respective roles. Teachers need to provide effective learning content; learners need to choose the appropriate learning strategies by using the learning content through consensus building. This makes consensus building an important factor in value co-creation. However, methods to build a consensus about their respective roles may not be clearly established, making such consensus difficult. In this paper, we propose some strategies for consensus building between a teacher and a learner in value co-creation. We focus on a teacher and learner co-design and propose an analysis method to clarify a collaborative design process to realize value co-creation. We then analyze some counseling data obtained from a university class. This counseling aimed to build a consensus for value-in-use, learning outcomes, and learning strategies between the teacher and the learner.

Keywords: consensus building, value co-creation, higher education, learning service

Procedia PDF Downloads 272

Authors: Randa El Bedawy

Abstract:

Exchanging best practices in the scope of entrepreneurship education and the use of experiential learning approaches are growing lately at a very fast pace. Educators should be challenged to promote such a learning approach to bridge the gap between entrepreneurship students and the actual business work environment. The study aims to share best practices, experiences, and knowledge to support entrepreneurship education. The study is exploratory qualitative research based on a case study approach to demonstrate how experiential learning can be used for supporting learning effectiveness in entrepreneurship education through demonstrating a set of fourteen tasks that were used to engage practically the students who were studying a course of entrepreneurship at the American University in Cairo. The study sheds the light on the rational process of using experiential learning to endorse entrepreneurship education through the illustration of each task along with its learning outcomes. The study explores the benefits and obstacles that educators may face when implementing such an experiential approach. The results of the study confirm that developing an experiential learning approach based on constructing a set of well designed practical tasks that complement the overall intended learning outcomes has proven very effective for promoting the students’ learning of entrepreneurship education. However, good preparation for both educators and students is needed primarily to ensure the effective implementation of such an experiential learning approach.

Keywords: business education, entrepreneurship, entrepreneurship education, experiential learning

Procedia PDF Downloads 121