Search results for: learning assessment

Authors: Mehmet Oren, Susan Pedersen, Sevket C. Cetin

Abstract:

Despite the frequently criticized disadvantages of the traditional used paper and pencil assessment, it is the most frequently used method in our schools. Although assessments do an acceptable measurement, they are not capable of measuring all the aspects and the richness of learning and knowledge. Also, many assessments used in schools decontextualize the assessment from the learning, and they focus on learners’ standing on a particular topic but do not concentrate on how student learning changes over time. For these reasons, many scholars advocate that using simulations and games (S&G) as a tool for assessment has significant potentials to overcome the problems in traditionally used methods. S&G can benefit from the change in technology and provide a contextualized medium for assessment and teaching. Furthermore, S&G can serve as an instructional tool rather than a method to test students’ learning at a particular time point. To investigate the potentials of using educational games as an assessment and teaching tool, this study presents the implementation and the validation of an automated embedded assessment (AEA), which can constantly monitor student learning in the game and assess their performance without intervening their learning. The experiment was conducted on an undergraduate level engineering course (Digital Circuit Design) with 99 participant students over a period of five weeks in Spring 2016 school semester. The purpose of this research study is to examine if the proposed method of AEA is valid to assess student learning in a 3D Educational game and present the implementation steps. To address this question, this study inspects three aspects of the AEA for the validation. First, the evidence-centered design model was used to lay out the design and measurement steps of the assessment. Then, a confirmatory factor analysis was conducted to test if the assessment can measure the targeted latent constructs. Finally, the scores of the assessment were compared with an external measure (a validated test measuring student learning on digital circuit design) to evaluate the convergent validity of the assessment. The results of the confirmatory factor analysis showed that the fit of the model with three latent factors with one higher order factor was acceptable (RMSEA < 0.00, CFI =1, TLI=1.013, WRMR=0.390). All of the observed variables significantly loaded to the latent factors in the latent factor model. In the second analysis, a multiple regression analysis was used to test if the external measure significantly predicts students’ performance in the game. The results of the regression indicated the two predictors explained 36.3% of the variance (R2=.36, F(2,96)=27.42.56, p<.00). It was found that students’ posttest scores significantly predicted game performance (β = .60, p < .000). The statistical results of the analyses show that the AEA can distinctly measure three major components of the digital circuit design course. It was aimed that this study can help researchers understand how to design an AEA, and showcase an implementation by providing an example methodology to validate this type of assessment.

Keywords: educational video games, automated embedded assessment, assessment validation, game-based assessment, assessment design

Procedia PDF Downloads 398

Authors: Tom O'Mahony

Abstract:

This article considers the design of a student-centered learning environment in engineering education. The learning environment integrates a number of components, including project-based learning, collaborative learning, two-stage assignments, active learning lectures, and a flipped-classroom. Together these elements place the individual learner and their learning at the center of the environment by focusing on understanding, enhancing relevance, applying learning, obtaining rich feedback, making choices, and taking responsibility. The evolution of this environment from 2014 to the present day is outlined. The impact of this environment on learners and their learning is evaluated via student questionnaires that consist of both open and closed-ended questions. The closed questions indicate that students found the learning environment to be really interesting and enjoyable (rated as 4.7 on a 5 point scale) and encouraged students to adopt a deep approach towards studying the course materials (rated as 4.0 on a 5 point scale). A content analysis of the open-ended questions provides evidence that the project, active learning lectures, and flipped classroom all contribute to the success of this environment. Furthermore, this analysis indicates that the two-stage assessment process, in which feedback is provided between a draft and final assignment, is the key component and the dominant theme. A limitation of the study is the small class size (less than 20 learners per year), but, to some degree, this is compensated for by the longitudinal nature of the study.

Keywords: deep approaches, formative assessment, project-based learning, student-centered learning

Procedia PDF Downloads 83

Authors: Yesuselvi Manickam, Tan Soon Chin

Abstract:

Internship is a supervised and structured learning experience related to one’s field of study or career goal. Internship allows students to obtain work experience and the opportunity to apply skills learned during university. Internship is a valuable learning experience for students; however, literature on employer assessment is scarce on Malaysian student’s internship experience. This study focuses on employer’s perspective on student’s performances during their three months of internship. The results are based on the descriptive analysis of 45 sets of question gathered from the on-site supervisors of the interns. The survey of 45 on-site supervisor’s feedback was collected through postal mail. It was found that, interns have not met their on-site supervisor’s expectations in many areas. The significance of this study is employer’s assessment on the internship shall be used as feedback to improve on ways how to prepare students for their internship and employments in future.

Keywords: employers perspective, internship, structured learning, student’s performances

Procedia PDF Downloads 274

Authors: Shofiayuningtyas Luftiani

Abstract:

Some private schools in Indonesia started integrating the online program Gizmos in the teaching-learning process. Gizmos was developed to supplement the existing curriculum by integrating it into the instructional programs. The program has some features using an inquiry-based simulation, in which students conduct exploration by using a worksheet while teachers use the teacher guidelines to direct and assess students’ performance In this study, the discussion about Gizmos highlights its features as the assessment media of mathematics learning for secondary school students. The discussion is based on the case study and literature review from the Indonesian context. The purpose of applying Gizmos as an assessment media refers to the diagnostic assessment. As a part of the diagnostic assessment, the teachers review the student exploration sheet, analyze particularly in the students’ difficulties and consider findings in planning future learning process. This assessment becomes important since the teacher needs the data about students’ persistent weaknesses. Additionally, this program also helps to build student’ understanding by its interactive simulation. Currently, the assessment over-emphasizes the students’ answers in the worksheet based on the provided answer keys while students perform their skill in translating the question, doing the simulation and answering the question. Whereas, the assessment should involve the multiple perspectives and sources of students’ performance since teacher should adjust the instructional programs with the complexity of students’ learning needs and styles. Consequently, the approach to improving the assessment components is selected to challenge the current assessment. The purpose of this challenge is to involve not only the cognitive diagnosis but also the analysis of skills and error. Concerning the selected setting for this diagnostic assessment that develops the combination of cognitive diagnosis, skills analysis and error analysis, the teachers should create an assessment rubric. The rubric plays the important role as the guide to provide a set of criteria for the assessment. Without the precise rubric, the teacher potentially ineffectively documents and follows up the data about students at risk of failure. Furthermore, the teachers who employ the program of Gizmos as the diagnostic assessment might encounter some obstacles. Based on the condition of assessment in the selected setting, the obstacles involve the time constrain, the reluctance of higher teaching burden and the students’ behavior. Consequently, the teacher who chooses the Gizmos with those approaches has to plan, implement and evaluate the assessment. The main point of this assessment is not in the result of students’ worksheet. However, the diagnostic assessment has the two-stage process; the process to prompt and effectively follow-up both individual weaknesses and those of the learning process. Ultimately, the discussion of Gizmos as the media of the diagnostic assessment refers to the effort to improve the mathematical learning process.

Keywords: diagnostic assessment, error analysis, Gizmos online program, skills analysis

Procedia PDF Downloads 151

Authors: Li-Ching Hung

Abstract:

The lack of empirical research on portfolio assessment in aboriginal EFL English classes of junior high schools in Taiwan may inhibit EFL teachers from appreciating the utility of this alternative assessment approach. This study addressed the following research questions: 1) understand how aboriginal EFL students and instructors of junior high schools in Taiwan perceive portfolio assessment, and 2) how portfolio assessment affects Taiwanese aboriginal EFL students’ learning outcomes. Ten classes of five junior high schools in Taiwan (from different regions of Taiwan) participated in this study. Two classes from each school joined the study, and each class was randomly assigned as a control group, and one was the experimental group. These five junior high schools consisted of at least 50% of aboriginal students. A mixed research design was utilized. The instructor of each class implemented a portfolio assessment for 15 weeks of the 2015 Fall Semester. At the beginning of the semester, all participants took a GEPT test (pretest), and in the 15th week, all participants took the same level of GEPT test (post-test). Scores of students’ GEPT tests were checked by the researcher as supplemental data in order to understand each student’s performance. In addition, each instructor was interviewed to provide qualitative data concerning students’ general learning performance and their perception of implementing portfolio assessments in their English classes. The results of this study were used to provide suggestions for EFL instructors while modifying their lesson plans regarding assessment. In addition, the empirical data were used as references for EFL instructors implementing portfolio assessments in their classes effectively.

Keywords: assessment, portfolio assessment, qualitative design, aboriginal ESL students

Procedia PDF Downloads 109

Authors: D. A. Carnegie

Abstract:

Whilst there is a movement towards increased digital augmentation in order to facilitate effective tertiary learning, this must come with an awareness of the limitations of such an approach. Learning is best achieved in an environment that includes their learning peers where difficulties can be shared and learning enabled. Policy that advocates for digital technology in place of a physical classroom is dangerous and is often driven by financial concerns rather than pedagogical ones. In this paper, a mostly digital-less form of teaching is presented – one that has proven to be extremely effective. Implicit is anecdotal evidence that student prefer the old overhead transparencies to PowerPoint presentations. Varying and reinforcing assessment, facilitation of effective note-taking, and just actively engaging with students is at the core of a good tertiary education experience. Digital techniques can augment and complement, but not replace these core personal teaching requirements.

Keywords: engineering education, active classroom engagement, effective note taking, reinforcing assessment

Procedia PDF Downloads 311

Authors: Peter Akayuure

Abstract:

One key determinant of the quality of mathematics learning is the teacher’s ability to assess students adequately and effectively and make assessment an integral part of the instructional practices. If the mathematics teacher lacks the required literacy to perform classroom assessment roles, the true trajectory of learning success and attainment of curriculum expectations might be indeterminate. It is therefore important that educators and policymakers understand and seek ways to improve the literacy level of mathematics teachers to implement classroom assessments that would meet curriculum demands. This study employed a descriptive survey design to explore perceived levels of assessment literacy of mathematics teachers to implement classroom assessment with the school based assessment framework in Ghana. A 25-item classroom assessment inventory on teachers’ assessment scenarios was adopted, modified, and administered to a purposive sample of 48 mathematics teachers from eleven Senior High Schools. Seven other items were included to further collect data on their self-efficacy towards assessment literacy. Data were analyzed using descriptive and bivariate correlation statistics. The result shows that, on average, 48.6% of the mathematics teachers attained standard levels of assessment literacy. Specifically, 50.0% met standard one in choosing appropriate assessment methods, 68.3% reached standard two in developing appropriate assessment tasks, 36.6% reached standard three in administering, scoring, and interpreting assessment results, 58.3% reached standard four in making appropriate assessment decisions, 41.7% reached standard five in developing valid grading procedures, 45.8% reached standard six in communicating assessment results, and 36.2 % reached standard seven by identifying unethical, illegal and inappropriate use of assessment results. Participants rated their self-efficacy belief in performing assessments high, making the relationships between participants’ assessment literacy scores and self-efficacy scores weak and statistically insignificant. The study recommends that institutions training mathematics teachers or providing professional developments should accentuate assessment literacy development to ensure standard assessment practices and quality instruction in mathematics education at senior high schools.

Keywords: assessment literacy, mathematics teacher, senior high schools, Ghana

Procedia PDF Downloads 103

Authors: Joyce Joas Kahembe

Abstract:

The implementation of education assessment reforms in developing countries has been claimed to be problematic and difficult. The socio-economic teaching and learning environment has pointed to constraints in the education reform process. Nevertheless, there are existing assessment practices that if enhanced, can have potential to foster formative assessment practices in those contexts. The present study used the sociocultural perspective to explore teachers’ assessment practices and factors influencing them in Tanzania. Specifically, the sociocultural perspective helped to trace social, economic and political histories imparted to teachers’ assessment practices. The ethnographic oriented methods like interviews, observations and document reviews was used in this exploration. Teachers used assessment practices, such as questioning and answering, tests, assignments and examinations, for evaluating, monitoring and diagnosing students’ understanding, achievement and performance and standards and quality of instruction practices. The obtained assessment information functioned as feedback for improving students’ understanding, performance, and the standard and quality of teaching instruction and materials. For example, teachers acknowledged, praised, approved, disapproved, denied, graded, or marked students’ responses to give students feedback and aid learning. Moreover, teachers clarified and corrected or repeated students’ responses with worded/added words to improve students’ mastery of the subject content. Teachers’ assessment practices were influenced by the high demands of passing marks in the high stakes examinations and the contexts of the social economic teaching environment. There is a need to ally education assessment reforms with existing socio-economic teaching environments and society and institutional demands of assessment to make assessment reforms meaningful and sustainable. This presentation ought to contribute on ongoing strategies for contextualizing assessment practices for formative uses.

Keywords: assessment, feedback, practices, formative assessment

Procedia PDF Downloads 472

Authors: Hsiaoping Wu

Abstract:

With the wide use of Internet, learners are exposed to the wider world. This exposure permits learners to discover new information and combine a variety of media in order to reach in-depth and broader understanding of their literacy and the world. Many paper-based teaching, learning and assessment modalities can be transferred to a digital platform. This study examines the use of e-portfolios for ESL (English as a second language) pre-service teacher. The data were collected by reviewing 100 E-portfolio from 2013 to 2015 in order to synthesize meaningful information about e-portfolios for ESL pre-service teachers. Participants were generalists, bilingual and ESL pre-service teachers. The studies were coded into two main categories: learning gains, including assessment, and technical skills. The findings showed that using e-portfolios enhanced and developed ESL pre-service teachers’ teaching and assessment skills. Also, the E-portfolio also developed the pre-service teachers’ technical stills to prepare a comprehensible portfolio to present who they are. Finally, the study and presentation suggested e-portfolios for ecological issues and educational purposes.

Keywords: assessment, e-portfolio, pre-service teacher, reflection

Procedia PDF Downloads 292

Authors: Gloria Chen

Abstract:

When offering conventional level-appropriate ESL classes for adults is not feasible, a multilevel adult ESL class can be formed to benefit those who need to learn English for daily function. This paper examines the rationale, the process, the contents, and the outcomes of a multilevel ESL class for adults. The action research discusses a variety of assessments, lesson plans, teaching strategies that facilitate lifelong language learning. In small towns where adult ESL learners are only a handful, often advanced students and inexperienced students have to be placed in one class. Such class might not be viewed as desirable, but with on-going assessments, careful lesson plans, and purposeful strategies, a multilevel ESL class for adults can overcome the obstacles and help learners to reach a higher level of English proficiency. This research explores some hand-on strategies, such as group rotating, cooperative learning, and modifying textbook contents for practical purpose, and evaluate their effectiveness. The data collected in this research include Needs Assessment (beginning of class term), Mid-term Self-Assessment (5 months into class term), End-of-term Student Reflection (10 months into class), and End-of-term Assessment from the Instructor (10 months into class). A descriptive analysis of the data explains the practice of this particular learning community, and reveal the areas for improvement and enrichment. This research answers the following questions: (1) How do the assessments positively help both learners and instructors? (2) How do the learning strategies prepare students to become independent, life-long English learners? (3) How do materials, grouping, and class schedule enhance the learning? The result of the research contributes to the field of teaching and learning in language, not limited in English, by (a) examining strategies of conducting a multilevel adult class, (b) involving adult language learners with various backgrounds and learning styles for reflection and feedback, and (c) improving teaching and learning strategies upon research methods and results. One unique feature of this research is how students can work together with the instructor to form a learning community, seeking and exploring resources available to them, to become lifelong language learners.

Keywords: adult language learning, assessment, multilevel, teaching strategies

Procedia PDF Downloads 325

Authors: R. Ajith, Kamal Bijlani

Abstract:

Over the past few years, tremendous evolutions have happened in the educational discipline. Serious game, which is regarded as one of the most important inventions is being widely for learning purposes. Serious games can be used to negate the various drawbacks that the current evaluation and assessment methods have, like examination anxiety and the lack of proper feedback given to the learners. This paper proposes serious game as a tool for conducting evaluations and assessments. The examination anxiety faced by learners can be reduced, as they are provided with a game as an examination. The serious game also tracks learner’s actions, records them and provide feedback based on the predefined set of actions according to the course objectives. The appropriate feedback given to the learner will help in developmental activities in the learning process.

Keywords: serious games, evaluation, performance assessment, examination anxiety, performance feedback

Procedia PDF Downloads 569

Authors: Bruno Pinto Vieira, Marco Antonio Calijorne Soares, Armando Sérgio de Aguiar Filho

Abstract:

Nowadays, a massive amount of information has been produced by different data sources, including mobile devices and transactional systems. In this scenario, concerns arise on how to maintain or establish data quality, which is now treated as a product to be defined, measured, analyzed, and improved to meet consumers' needs, which is the one who uses these data in decision making and companies strategies. Information that reaches low levels of quality can lead to issues that can consume time and money, such as missed business opportunities, inadequate decisions, and bad risk management actions. The step of selecting, identifying, evaluating, and selecting data sources with significant quality according to the need has become a costly task for users since the sources do not provide information about their quality. Traditional data quality control methods are based on user experience or business rules limiting performance and slowing down the process with less than desirable accuracy. Using advanced machine learning algorithms, it is possible to take advantage of computational resources to overcome challenges and add value to companies and users. In this study, machine learning is applied to data quality analysis on different datasets, seeking to compare the performance of the techniques according to the dimensions of quality assessment. As a result, we could create a ranking of approaches used, besides a system that is able to carry out automatically, data quality assessment.

Keywords: machine learning, data quality, quality dimension, quality assessment

Procedia PDF Downloads 114

Authors: Ruangdech Sirikit

Abstract:

The purposes of this research were to study the variables affecting the quality assessment of mathematics subject in Thailand by using value-added analysis on TIMSS 2011. The data used in this research is the secondary data from the 2011 Trends in International Mathematics and Science Study (TIMSS), collected from 6,124 students in 172 schools from Thailand, studying only mathematics subjects. The data were based on 14 assessment tests of knowledge in mathematics. There were 3 steps of data analysis: 1) To analyze descriptive statistics 2) To estimate competency of students from the assessment of their mathematics proficiency by using MULTILOG program; 3) analyze value added in the model of quality assessment using Value-Added Model with Hierarchical Linear Modeling (HLM) and 2 levels of analysis. The research results were as follows: 1. Student level variables that had significant effects on the competency of students at .01 levels were Parental care, Resources at home, Enjoyment of learning mathematics and Extrinsic motivation in learning mathematics. Variable that had significant effects on the competency of students at .05 levels were Education of parents and self-confident in learning mathematics. 2. School level variable that had significant effects on competency of students at .01 levels was Extra large school. Variable that had significant effects on competency of students at .05 levels was medium school.

Keywords: quality assessment, value-added model, TIMSS, mathematics, Thailand

Procedia PDF Downloads 258

Authors: Celeste Labuschagne, Sam Ramaila, Thasmai Dhurumraj

Abstract:

Although formative assessment is acknowledged as crucial for teachers to gauge students’ understanding of subject content, applying formative assessment in an online context is more challenging than in a traditional Physical Sciences classroom. This study examines challenges experienced by Grade 10 Physical Sciences teachers when enacting online formative assessment. The empirical investigation adopted a generic qualitative design and involved three purposively selected Grade 10 Physical Sciences teachers from three different schools and quintiles within the Tshwane North District in South Africa. Data were collected through individual and focus group interviews. Technological, pedagogical, and content knowledge (TPACK) was utilised as a theoretical framework underpinning the study. The study identified a myriad of challenges experienced by Grade 10 Physical Sciences teachers when enacting online formative assessment. These challenges include the utilisation of Annual Teaching Plans, lack of technological knowledge, and internet connectivity. The Department of Basic Education faces the key imperative to provide continuous teacher professional development and concomitant online learning materials that can facilitate meaningful enactment of online formative assessment in various educational settings.

Keywords: COVID-19, challenges, online formative assessment, physical sciences, TPACK

Procedia PDF Downloads 37

Authors: Wang Yanli, Cheng Yun, Yang Jiarui

Abstract:

Due to the separation of teachers and students, online teaching during the COVID-19 epidemic was faced with many problems, such as low enthusiasm of students, distraction, low learning atmosphere, and insufficient interaction between teachers and students. The essay designed the elaborate online learning activities of the course 'Research Methods of Educational Science' based on the APT model from three aspects of multiple assessment methods, a variety of teaching methods, and online learning environment and technology. Student's online learning experience was examined from the perception of online course, the perception of the online learning environment, and satisfaction after the course’s implementation. The research results showed that students have a positive overall evaluation of online courses, a high degree of engagement in learning, positive acceptance of online learning, and high satisfaction with it, but students hold a relatively neutral attitude toward online learning. And some dimensions in online learning experience were found to have positive influence on students' satisfaction with online learning. We suggest making the good design of online courses, selecting proper learning platforms, and conducting blended learning to improve students’ learning experience. This study has both theoretical and practical significance for the design, implementation, effect feedback, and sustainable development of online teaching in the post-epidemic era.

Keywords: APT model, online learning, online learning activities, learning experience

Procedia PDF Downloads 97

Authors: Hussain A. Alkharusi, Said S. Aldhafri, Hilal Z. Alnabhani, Muna Alkalbani

Abstract:

Analysing classroom assessments is one of the responsibilities of the teacher. It aims improving teacher’s instruction and assessment as well as student learning. The present study investigated factors that might explain variation in teachers’ practices regarding analysis of classroom assessments. The factors considered in the investigation included gender, in-service assessment training, teaching load, teaching experience, knowledge in assessment, attitude towards quantitative aspects of assessment, and self-perceived competence in analysing assessments. Participants were 246 in-service teachers in Oman. Results of a stepwise multiple linear regression analysis revealed that self-perceived competence was the only significant factor explaining the variance in teachers’ analysis of assessments. Implications for research and practice are discussed.

Keywords: analysis of assessment, classroom assessment, in-service teachers, self-competence

Procedia PDF Downloads 301

Authors: Bulatbayeva A. A., Maxutova I. O., Ergalieva A. N.

Abstract:

This article presents a study of the practice of self-assessment of the quality of training cadets in a military higher specialized educational institution. The research was carried out by means of a questionnaire survey aimed at identifying the degree of satisfaction of cadets with the organization of the educational process, quality of teaching, the quality of the organization of independent work, and the system of their assessment. In general, the results of the study are of an intermediate nature. Proven tools will be incorporated into the planning and effective management of the learning process. The results of the study can be useful for the administrators and managers of the military education system for teachers of military higher educational institutions for adjusting the content and technologies of training future specialists. The publication was prepared as part of applied grant research for 2020-2022 by order of the Ministry of Education and Science of the Republic of Kazakhstan on the topic "Development of a comprehensive methodology for assessing the quality of education of graduates of military special educational institutions."

Keywords: teaching quality, quality satisfaction, learning management, quality management, process approach, classroom learning, interactive technologies, teaching quality

Procedia PDF Downloads 97

Authors: Yuxuan Tang

Abstract:

Cognitive diagnostic assessment has received much attention in second language education, and assessment for it can provide pedagogically useful feedback for language learners. However, there is a lack of research on how students interpret and use cognitive diagnostic feedback. Thus the present study aims to adopt a mixed-method approach mainly to explore the relationship between the goal-orientation and students' response to cognitive diagnostic feedback. Almost 200 Chinese undergraduates from two universities in Xi'an, China, will be invited to do a cognitive diagnostic reading test, and each student will receive specialized cognitive diagnostic feedback, comprising of students' reading attributes mastery level generated by applying a well-selected cognitive diagnostic model, students' perceived reading ability assessed by a self-assessing questionnaire and students’ level position in the whole class. And a goal-orientation questionnaire and a self-generated questionnaire on the perception of feedback will be given to students the moment they receive feedback. In addition, interviews of students will be conducted on their future plans to see whether they have awareness of carrying out studying plans. The study aims to find a new perspective towards how students use and interpret cognitive diagnostic feedback in terms of their different goal-orientation (self-based, task-based, and other-based goals) by applying the newest goal orientation model, which is an important construct of motivation in psychology, seldom researched under language learning area. And the study is expected to provide evidence on how diagnostic feedback promotes students' learning under the educational belief of assessment for learning. Practically speaking, according to the personalized diagnostic feedback, students can take remedial self-learning more purposefully, and teachers can target students' weaknesses to adjust teaching methods and carry out tailored teaching.

Keywords: assessment for learning, cognitive diagnostic assessment, goal-orientation, personalized feedback

Procedia PDF Downloads 106

Authors: Mei-Hui Liu

Abstract:

This paper reports the progression of language teachers’ learning to assess students’ speech act performance via online videos in a cross-tier professional growth community. This yearlong research project collected multiple data sources from several stakeholders, including 12 preservice and 4 inservice English as a foreign language (EFL) teachers, 4 English professionals, and 82 high school students. Data sources included surveys, (focus group) interviews, online reflection journals, online video-based assessment items/scores, and artifacts related to teacher professional learning. The major findings depicted the effectiveness of this proposed learning module on language teacher development in pragmatic assessment as well as its impact on student learning experience. All these teachers appreciated this professional learning experience which enhanced their knowledge in assessing students’ pragmalinguistic and sociopragmatic performance in an English speech act (i.e., making refusals). They learned how to design online video-based assessment items by attending to specific linguistic structures, semantic formula, and sociocultural issues. They further became aware of how to sharpen pragmatic instructional skills in the near future after putting theories into online assessment and related classroom practices. Additionally, data analysis revealed students’ achievement in and satisfaction with the designed online assessment. Yet, during the professional learning process most participating teachers encountered challenges in reaching a consensus on selecting appropriate video clips from available sources to present the sociocultural values in English-speaking refusal contexts. Also included was to construct test items which could testify the influence of interlanguage transfer on students’ pragmatic performance in various conversational scenarios. With pedagogical implications and research suggestions, this study adds to the increasing amount of research into integrating preservice and inservice EFL teacher education in pragmatic assessment and relevant instruction. Acknowledgment: This research project is sponsored by the Ministry of Science and Technology in the Republic of China under the grant number of MOST 106-2410-H-029-038.

Keywords: cross-tier professional development, inservice EFL teachers, pragmatic assessment, preservice EFL teachers, student learning experience

Procedia PDF Downloads 231

Authors: Sara Corvino

Abstract:

The aim of this study is to explore the potential of inclusive learning and assessment strategies to foster students' engagement with historical debates surrounding the field of graphic design. The goal is to respond to the diversity of L4 Graphic Design students, at Nottingham Trent University, in a way that instead of 'lowering standards' can benefit everyone. This research tests, measures, and evaluates the impact of a specific intervention, an assessment task, to develop students' critical visual analysis skills and stimulate a deeper engagement with the subject matter. Within the action research approach, this work has followed a case study research method to understand students' views and perceptions of a specific project. The primary methods of data collection have been: anonymous electronic questionnaire and a paper-based anonymous critical incident questionnaire. NTU College of Business Law and Social Sciences Research Ethics Committee granted the Ethical approval for this research in November 2019. Other methods used to evaluate the impact of this assessment task have been Evasys's report and students' performance. In line with the constructivist paradigm, this study embraces an interpretative and contextualized analysis of the collected data within the triangulation analytical framework. The evaluation of both qualitative and quantitative data demonstrates that active learning strategies and the disruption of thinking patterns can foster greater students' engagement and can lead to meaningful learning.

Keywords: active learning, assessment for learning, graphic design, higher education, student engagement

Procedia PDF Downloads 150

Authors: M. H. Imam, Imran A. Tasadduq, Abdul-Rahim Ahmad, Fahd M. Aldosari

Abstract:

Learning outcomes of a course (CLOs) and the abilities at the time of graduation referred to as Student Outcomes (SOs) are required to be assessed for ABET accreditation. A question in an assessment must target a CLO as well as an SO and must represent a required level of competence. This paper presents the idea of an Expert System (ES) to select a proper question to satisfy ABET accreditation requirements. For ES implementation, seven attributes of a question are considered including the learning outcomes and Bloom’s Taxonomy level. A database contains all the data about a course including course content topics, course learning outcomes and the CLO-SO relationship matrix. The knowledge base of the presented ES contains a pool of questions each with tags of the specified attributes. Questions and the attributes represent expert opinions. With implicit rule base the inference engine finds the best possible question satisfying the required attributes. It is shown that the novel idea of such an ES can be implemented and applied to a course with success. An application example is presented to demonstrate the working of the proposed ES.

Keywords: expert system, student outcomes, course learning outcomes, question attributes

Procedia PDF Downloads 226

Authors: Heba Salem

Abstract:

This paper aims to share the researcher’s experience of using e-Portfolios as an assessment tool to follow up on students’ learning experiences and performance throughout the semester. It also aims at highlighting the importance of students’ self-reflection in the process of language learning. The paper begins by introducing the advanced media course, with its focus on listening and speaking skills, and introduces the students’ profiles. Then it explains the students’ role in the e-portfolio process as they are given the option to choose a listening text they studied throughout the semester and to choose a recorded oral production of their collection of artifacts throughout the semester. Students showcase and reflect on their progress in both listening comprehension and speaking. According to the research, re-listening to work given to them and to their production is a means of reflecting on both their progress and achievement. And choosing the work students want to showcase is a means to promote independent learning as well as self-expression. Students are encouraged to go back to the class learning outcomes in the process of choosing the work. In their reflections, students express how they met the specific learning outcome. While giving their presentations, students expressed how useful the experience of returning and going over what they covered to select one and going over their production as well. They also expressed how beneficial it was to listen to themselves and literally see their progress in both listening comprehension and speaking. Students also reported that they grasped more details from the texts than they did when first having it as an assignment, which coincided with one of the class learning outcomes. They also expressed the fact that they had more confidence speaking as well as they were able to use a variety of vocabulary and idiomatic expressions that students have accumulated. For illustration, this paper includes practical samples of students’ tasks and instructions as well as samples of their reflections. The results of students’ reflections coincide with what the research confirms about the effectiveness of the e-portfolios as a means of assessment. The employment of e-Portfolios has two-folded benefits; students are able to measure the achievement of the targeted learning outcomes, and teachers receive constructive feedback on their teaching methods.

Keywords: e-portfolios, assessment, self assessment, listening and speaking progress, foreign language, reflection, learning out comes, sharing experience

Procedia PDF Downloads 69

Authors: Hui-Yi Wang, Shu-Mei Chen, Mei-Fang Liu

Abstract:

Background and purpose: Providing clinical experience in medical education is an important discipline method where students can gradually apply their academic knowledge to clinical situations. The purpose of this study was to establish self-assessment questionnaires for students to assess their learning outcomes for two fields of physical therapy, orthopedic physical therapy, and pediatric physical therapy, in a clinical fieldwork course. Methods: The questionnaires were developed based on the core competence dimensions of the course. The content validity of the questionnaires was evaluated and established by expert meetings. Among the third-year undergraduate students who took the clinical fieldwork course, there were 49 students participated in this study. Teachers arranged for the students to study two professional fields, and each professional field conducted a three-week clinical lesson. The students filled out the self-assessment questionnaires before and after each three-week lesson. Results: The self-assessment questionnaires were established by expert meetings that there were six core competency dimensions in each of the two fields, with 20 and 21 item-questions, respectively. After each three-week clinical fieldwork, the self-rating scores in each core competency dimension were higher when compared to those before the course, indicating having better clinical abilities after the lessons. The best self-rating scores were the dimension of attitude and humanistic literacy, and the two lower scores were the dimensions of professional knowledge and skills and problem-solving critical thinking. Conclusions: This study developed questionnaires for clinical fieldwork courses to reflect students' learning outcomes, including the performance of professional knowledge, practice skills, and professional attitudes. The use of self-assessment of learning performance can help students build up their reflective competencies. Teachers can guide students to pay attention to the performance of abilities in each core dimension to enhance the effectiveness of learning through self-reflection and improvement.

Keywords: physical therapy, clinical fieldwork course, learning outcomes assessment, medical education, self-reflection ability

Procedia PDF Downloads 91

Authors: Badiossadat Hassanpour, Reza Sirjani, Nangkuala Utaberta

Abstract:

The avant-garde educational systems are striving to find a life long learning methods. Different fields and majors have test variety of proposed models, and found their difficulties and strengths. Architecture as a critical stage of education due to its characteristics which are learning by doing and critique based education and evaluation is out of this study procedure. Learning contracts is a new alternative form of evaluation of students’ achievements, while it acts as agreement about learning goals. Obtained results from studies in different fields which confirm its positive impact on students' learning in those fields and positively affected students' motivation and confidence in meeting their own learning needs, prompted us to implement this model in architecture design studio. In this implemented contract to the studio, students were asked to use the existing possibility of contract to have self assessment and examine their professional development to identify whether they are deficient or they would like to develop more expertise. The evidences of this research as well indicate that students feel positive about the learning contract and see it accommodating their individual learning needs.

Keywords: contract (LC), architecture design studio, education, student-centered learning

Procedia PDF Downloads 407

Authors: Mamatha Hosapatna, Anne D. Souza, Antony Sylvan Dsouza, Vrinda Hari Ankolekar

Abstract:

Our study intends to know the effect of the overall teaching program of Anatomy on a students learning. The advancement of various teaching methodologies in the present era has led to progressive changes in education. A student should be able to correlate well between the theory and practical knowledge attained even in the early years of their education in medicine and should be able to implement the same in patient care. The present study therefore aims to assess the impact the current anatomy teaching program has on a students learning and to what extent is it successful in making the learning program effective. Specific objectives of our study to assess the impact of overall teaching program of Anatomy in a students’ learning. Description of process proposed: A questionnaire will be constructed and the students will be asked to put forth their views regarding the Anatomy teaching program and its method of assessment. Suggestions, if any will also be encouraged to be put forth. Type of study is cross sectional observations. Target population is the first year MBBS students and sample size is 250. Assessment plan is to obtaining students responses using questionnaire. Calculating percentages of the responses obtained. Tabulation of the results will be done.

Keywords: anatomy, observational study questionnaire, observational study, M.B.B.S students

Procedia PDF Downloads 462

Authors: Sirimanee Banjong

Abstract:

This study aimed to 1) develop pre-service teachers’ leadership skills through camp-based learning, and 2) develop pre-service teachers’ teamwork skills through camp-based learning. An applied research methodology was used. The target group was derived from a purposive selection. It involved 32 fourth-year students in Early Childhood Education Program enrolling in a course entitled Seminar in Early Childhood Education provided during the second semester of the academic year 2013. The treatment was camp-based learning activities which applied a PDCA process including four stages: 1) plan, 2) do, 3) check, and 4) act. Research instruments were a learning camp program, a camp-based learning management plan, a 5-level assessment form for leadership skills and a 5-level assessment form for assessing teamwork skills. Data were analyzed using descriptive statistics. Results were: 1) pre-service teachers’ leadership skills yielded the before treatment average score at ¯("x" )=3.4, S.D.= 0.62 and the after-treatment average score at ¯("x" ) 4.29, S.D.=0.66 pre-service teachers’ teamwork skills yielded the before-treatment average score at ¯("x" )=3.31, S.D.= 0.60 and the after-treatment average score at ¯("x" )=4.42, S.D.= 0.66. Both differences were statistically significant at the .05 level. Thus, the pre-service teachers’ leadership and teamwork skills were significantly improved through the camp-based learning approach.

Keywords: learning camp, leadership skills, teamwork skills, pre-service teachers

Procedia PDF Downloads 334

Authors: Nabila Daly, Hamdi Ellouzi, Hela Ltifi

Abstract:

In last year’s, several recent researches’ that focus on e-learning approaches having as goal to improve pedagogy and student’s academy level assessment. E-learning-related works have become an important research file nowadays due to several problems that make it impossible for students join classrooms, especially in last year’s. Among those problems, we note the current epidemic problems in the word case of Covid-19. For those reasons, several e-learning-related works based on Artificial Intelligence techniques are proposed to improve distant education targets. In the current paper, we will present a short survey of the most relevant e-learning based on Artificial Intelligence techniques giving birth to newly developed e-learning tools that rely on new technologies.

Keywords: artificial intelligence techniques, decision, e-learning, support system, survey

Procedia PDF Downloads 189

Authors: Huey-Yeu Yan, Ching-Ying Lee, Hung-Ru Lin

Abstract:

Background: Physical assessment is a vital clinical nursing competence. The gap between conventional teaching method and the way e-generation students’ preferred could be bridged owing to the support of Internet technology, i.e. interacting with online media to manage learning works. Nursing instructors in the wake of new learning pattern of the e-generation students are challenged to actively adjust and make teaching contents and methods more versatile. Objective: The objective of this research is to explore the effects on teaching and learning with live webcast-assisted on a specific topic, Physical Assessment technique, on a designated group of young nursing majors. It’s hoped that, with a way of nursing instructing, more versatile learning resources may be provided to facilitate self-directed learning. Design: This research adopts a cross-sectional descriptive survey. The instructor demonstrated physical assessment techniques and operation procedures via live webcast broadcasted online to all students. It increased both the off-time interaction between teacher and students concerning teaching materials. Methods: A convenient sampling was used to recruit a total of 52 nursing-majors at a certain university. The nursing majors took two-hour classes of Physical Assessment per week for 18 weeks (36 hrs. in total). The instruction covered four units with live webcasting and then conducted an online anonymous survey of learning outcomes by questionnaire. The research instrument was the online questionnaire, covering three major domains—online media used, learning outcome evaluation and evaluation result. The data analysis was conducted via IBM SPSS Statistics Version 2.0. The descriptive statistics was undertaken to describe the analysis of basic data and learning outcomes. Statistical methods such as descriptive statistics, t-test, ANOVA, and Pearson’s correlation were employed in verification. Results: Results indicated the following five major findings. (1) learning motivation, about four fifth of the participants agreed the online instruction resources are very helpful in improving learning motivation and raising the learning interest. (2) learning needs, about four fifth of participants agreed it was helpful to plan self-directed practice after the instruction, and meet their needs of repetitive learning and/or practice at their leisure time. (3) learning effectiveness, about two third agreed it was helpful to reduce pre-exam anxiety, and improve their test scores. (4) course objects, about three fourth agreed that it was helpful to achieve the goal of ‘executing the complete Physical Assessment procedures with proper skills’. (5) finally, learning reflection, about all of participants agreed this experience of online instructing, learning, and practicing is beneficial to them, they recommend instructor to share with other nursing majors, and they will recommend it to fellow students too. Conclusions: Live webcasting is a low-cost, convenient, efficient and interactive resource to facilitate nursing majors’ motivation of learning, need of self-directed learning and practice, outcome of learning. When live webcasting is integrated into nursing teaching, it provides an opportunity of self-directed learning to promote learning effectiveness, as such to fulfill the teaching objective.

Keywords: innovative teaching, learning effectiveness, live webcasting, physical assessment technique

Procedia PDF Downloads 104

Authors: Oluwaseun Ijiwade, Chris Davison, Kelvin Gregory

Abstract:

In Australia, like other parts of the world, the debate on how to enhance teachers using assessment data to inform teaching and learning of English as an Additional Language (EAL, Australia) or English as a Foreign Language (EFL, United States) have occupied the centre of academic scholarship. Traditionally, this approach was conceptualised as ‘Formative Assessment’ and, in recent times, ‘Assessment for Learning (AfL)’. The central problem is that teacher-made tests are limited in providing data that can inform teaching and learning due to variability of classroom assessments, which are hindered by teachers’ characteristics and assessment literacy. To address this concern, scholars in language education and testing have proposed a uniformed large-scale computer-based assessment program to meet the needs of teachers and promote AfL in language education. In Australia, for instance, the Victoria state government commissioned a large-scale project called 'Tools to Enhance Assessment Literacy (TEAL) for Teachers of English as an additional language'. As part of the TEAL project, a tool called ‘Reading and Vocabulary assessment for English as an Additional Language (RVEAL)’, as a diagnostic language assessment (DLA), was developed by language experts at the University of New South Wales for teachers in Victorian schools to guide EAL pedagogy in the classroom. Therefore, this study aims to provide qualitative evidence for understanding beliefs about the diagnostic language assessment (DLA) among EAL teachers in primary and secondary schools in Victoria, Australia. To realize this goal, this study raises the following questions: (a) How do teachers use large-scale assessment data for diagnostic purposes? (b) What skills do language teachers think are necessary for using assessment data for instruction in the classroom? and (c) What factors, if any, contribute to teachers’ beliefs about diagnostic assessment in a large-scale assessment? Semi-structured interview method was used to collect data from at least 15 professional teachers who were selected through a purposeful sampling. The findings from the resulting data analysis (thematic analysis) provide an understanding of teachers’ beliefs about DLA in a classroom context and identify how these beliefs are crystallised in language teachers. The discussion shows how the findings can be used to inform professional development processes for language teachers as well as informing important factor of teacher cognition in the pedagogic processes of language assessment. This, hopefully, will help test developers and testing organisations to align the outcome of this study with their test development processes to design assessment that can enhance AfL in language education.

Keywords: beliefs, diagnostic language assessment, English as an additional language, teacher cognition

Procedia PDF Downloads 169

Authors: Aqeel Zeid, Hasna Anees, Mohamed Adheeb, Mohamed Rifan, Kalpani Manathunga

Abstract:

To achieve constructive alignment in a higher education program, a clear set of learning outcomes must be defined. Traditional learning outcome definition techniques such as Bloom’s taxonomy are not written to be utilized by the student. This might be disadvantageous for students in student-centric learning settings where the students are expected to formulate their own learning strategies. To solve the problem, we propose the learning outcome relation and aggregation (LORA) model. To achieve alignment, we developed learning outcome, assessment, and resource authoring tools which help teachers to tag learning outcomes during creation. A pilot study was conducted with an expert panel consisting of experienced professionals in the education domain to evaluate whether the LORA model and tools present an improvement over the traditional methods. The panel unanimously agreed that the model and tools are beneficial and effective. Moreover, it helped them model learning outcomes in a more student centric and descriptive way.

Keywords: learning design, constructive alignment, Bloom’s taxonomy, learning outcome modelling

Procedia PDF Downloads 158