Search results for: psychometric evaluation
Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 6345

Search results for: psychometric evaluation

6315 Screening Psychological Wellness in a South African Banking Industry: Psychometric Properties of the Sense of Coherence-29 Questionnaire and Multifactor Leadership Questionnaire

Authors: Nisha Harry, Keshia Sing

Abstract:

Orientation: The Multifactor Leadership Questionnaire (MLF) and the sense of coherence-29 (SCS) is an effective tools to assess the prevalence and underlying structures of empirically based taxonomies related to leadership and wellbeing. Research purpose: The purpose of the study was to test the psychometric properties of the SCS and Multifactor Leadership Questionnaire (MLQ) to screen for psychological wellness indices within the banking industry in South Africa. Motivation for the study: The contribution of these two instruments for the purpose of determining psychological wellness in a banking work environment is unique. Research design, approach, or method: The sample consisted of (N = 150) financial staff employed in a South African banking organisation. The age of the sample was: 37% (30 -40 yrs), 31% (20-30 yrs), 26% (40- 50 yrs), and 6% (50+yrs), of which 52% were males, 48% were females. The white race group was the majority at 29%, African at 26%, Coloured at 23%, and Indian was 22%. Main findings: Results from the exploratory factor analysis revealed a two-factor structure as the most satisfactory. Confirmatory factor analyses revealed the two-factor model displayed better good of-fit indices. Practical implications: The factor structure of the Sense of Coherence-29 scale (SCS), and the Multifactor Leadership Questionnaire (MLQ), have a value-added focus to determine psychological wellness within banking staff. It is essential to take into account these constructs when developing employee wellness interventions. Contribution/value add: Understanding the psychometric properties of the SCS, the self-reported form, and the MLQ questionnaire contributes to screening psychological wellness indices such as coping within the banking industry in a developing country like South Africa. Leaders are an important part of the implementation process of organisational employee wellness practices.

Keywords: factorial structure, leadership, measurement invariance, psychological wellness, sense of coherence

Procedia PDF Downloads 76
6314 Development of a Psychometric Testing Instrument Using Algorithms and Combinatorics to Yield Coupled Parameters and Multiple Geometric Arrays in Large Information Grids

Authors: Laith F. Gulli, Nicole M. Mallory

Abstract:

The undertaking to develop a psychometric instrument is monumental. Understanding the relationship between variables and events is important in structural and exploratory design of psychometric instruments. Considering this, we describe a method used to group, pair and combine multiple Philosophical Assumption statements that assisted in development of a 13 item psychometric screening instrument. We abbreviated our Philosophical Assumptions (PA)s and added parameters, which were then condensed and mathematically modeled in a specific process. This model produced clusters of combinatorics which was utilized in design and development for 1) information retrieval and categorization 2) item development and 3) estimation of interactions among variables and likelihood of events. The psychometric screening instrument measured Knowledge, Assessment (education) and Beliefs (KAB) of New Addictions Research (NAR), which we called KABNAR. We obtained an overall internal consistency for the seven Likert belief items as measured by Cronbach’s α of .81 in the final study of 40 Clinicians, calculated by SPSS 14.0.1 for Windows. We constructed the instrument to begin with demographic items (degree/addictions certifications) for identification of target populations that practiced within Outpatient Substance Abuse Counseling (OSAC) settings. We then devised education items, beliefs items (seven items) and a modifiable “barrier from learning” item that consisted of six “choose any” choices. We also conceptualized a close relationship between identifying various degrees and certifications held by Outpatient Substance Abuse Therapists (OSAT) (the demographics domain) and all aspects of their education related to EB-NAR (past and present education and desired future training). We placed a descriptive (PA)1tx in both demographic and education domains to trace relationships of therapist education within these two domains. The two perceptions domains B1/b1 and B2/b2 represented different but interrelated perceptions from the therapist perspective. The belief items measured therapist perceptions concerning EB-NAR and therapist perceptions using EB-NAR during the beginning of outpatient addictions counseling. The (PA)s were written in simple words and descriptively accurate and concise. We then devised a list of parameters and appropriately matched them to each PA and devised descriptive parametric (PA)s in a domain categorized information grid. Descriptive parametric (PA)s were reduced to simple mathematical symbols. This made it easy to utilize parametric (PA)s into algorithms, combinatorics and clusters to develop larger information grids. By using matching combinatorics we took paired demographic and education domains with a subscript of 1 and matched them to the column with each B domain with subscript 1. Our algorithmic matching formed larger information grids with organized clusters in columns and rows. We repeated the process using different demographic, education and belief domains and devised multiple information grids with different parametric clusters and geometric arrays. We found benefit combining clusters by different geometric arrays, which enabled us to trace parametric variables and concepts. We were able to understand potential differences between dependent and independent variables and trace relationships of maximum likelihoods.

Keywords: psychometric, parametric, domains, grids, therapists

Procedia PDF Downloads 249
6313 Neuropsychological Assessment and Rehabilitation Settings for Developmental Dyslexia in Children in Greece: The Use of Music at Intervention Protocols

Authors: Argyris B. Karapetsas, Rozi M. Laskaraki, Aikaterini A. Karapetsa, Maria Bampou, Valentini N. Vamvaka

Abstract:

The main aim of the current protocol is the contribution of neuropsychology in both assessment and rehabilitation settings for children with dyslexia. Objectives: The purpose of this study was to evaluate the significant role of neuropsychological assessment including both Psychometric and electrophysiological tests as well as to investigate the effectiveness of an Auditory Training program, designed via Music designed for children with Developmental Dyslexia (DD). Materials: In our study, participated 45 third-, and fourth-grade students with DD and a matched control group (n=45). Method: At the first phase of the protocol, children underwent a clinical assessment, including both electrophysiological, i.e. Event Related Potentials (ERPs) esp. P300 waveform, and psychometric tests, being conducted in Laboratory of Neuropsychology, at University of Thessaly, in Volos, Greece. Assessment’s results confirmed statistically significant lower performance for children with DD for all tests, compared to the typical readers of the control group. After evaluation, a subgroup of children with DD participated in a Rehabilitation Program including digitized musical auditory training activities. Results: The electrophysiological recordings after the intervention revealed shorter, almost similar, P300 latency values for children with DD to those of the control group, indicating the beneficial effects of the Intervention, thus enabling children develop reading skills and become successful readers. Discussion: Similar research data confirm the crucial role of neuropsychology in both diagnosis and treatment of common disorders, observed in children. Indeed, as for DD, there is growing evidence that brain activity dysfunction does occur, as it is confirmed by neuropsychological assessment and also musical auditory training may have remedial effects. Conclusions: The outcomes of the current study suggest that due to the neurobiological origin of DD, neuropsychology may give the means in both neuropsychological assessment and rehabilitation, enabling professionals to cope with cerebral dysfunction and recovery more efficiently.

Keywords: diagnosis, dyslexia, ERPs, Music, neuropsychology, rehabilitation

Procedia PDF Downloads 108
6312 The Negative Impact of Mindfulness on Creativity: An Experimental Test

Authors: Marine Agogue, Beatrice Parguel, Emilie Canet

Abstract:

Defined as receptive attention to and awareness of present events and experience, mindfulness has grown in popularity over the past 30 years to become a trendy buzzword in business media, which regularly reports on its organizational benefits. Mindfulness would enhance or impede creative thinking depending on the type of meditation. Specifically, focused-attention meditation (focusing attention on one object instead of being open to perceive and observe any sensation or thought) would not be or negatively correlated to creativity. This research explores whether mood, in its two dimensions (i.e., hedonic tone, activation level), could mediate this potentially negative effect. The rationale is that focused-attention meditation is likely to improve hedonic tone but, in the meantime, damage activation level, resulting in opposite effects on creativity through the mediation effect of creative self-efficacy, i.e., the belief that one can perform successfully in an ideation setting. To test this conceptual model, a survey was administered to 97 subjects (53% women, mean age: 25 years), randomly assigned to three conditions (a 10-minute focused-attention meditation session vs. a 10-minute psychometric tests session vs. a control condition) and asked to participate in the egg creative task. Creativity was measured in terms of fluency, expansivity, and originality, the other variables using existing scales: hedonic tone (e.g., joyful, happy), activation level (e.g., passive, sluggish), creative self-efficacy (e.g., ‘I felt confident in my ability to do the task effectively’) and self-perceived creativity (e.g., ‘I have lots of original ideas’). The chains of mediation were tested using PROCESS macro (model 6) and controlled for subjects’ gender, age, and self-perceived creativity. Comparing the mindfulness and the control conditions, no difference appeared in terms of creativity, nor any mediation chain by hedonic tone. However, subjects who participated in the meditation session felt less active than those in the control condition, which decreased their creative self-efficacy, and creativity (whatever the indicator considered). Comparing the mindfulness and the psychometric tests conditions, analyses showed that creativity was higher in the psychometric tests condition. As previously, no mediation chain appeared by hedonic tone. However, subjects who participated in the meditation session felt less active than those in the psychometric tests condition, which decreased their creative self-efficacy, and creativity. These findings confirm that focused-attention meditation does not enhance creativity. They demonstrate an emotional underlying mechanism based on activation level and suggest that both positive and active mood states have the potential to enhance creativity through creative self-efficacy. In the end, they should discourage organizations from trying to nudge creativity using mindfulness ad hoc devices.

Keywords: creativity, mindfulness, creative self-efficacy, experiment

Procedia PDF Downloads 111
6311 An Online Mastery Learning Method Based on a Dynamic Formative Evaluation

Authors: Jeongim Kang, Moon Hee Kim, Seong Baeg Kim

Abstract:

This paper proposes a novel e-learning model that is based on a dynamic formative evaluation. On evaluating the existing format of e-learning, conditions regarding repetitive learning to achieve mastery, causes issues for learners to lose tension and become neglectful of learning. The dynamic formative evaluation proposed is able to supplement limitation of the existing approaches. Since a repetitive learning method does not provide a perfect feedback, this paper puts an emphasis on the dynamic formative evaluation that is able to maximize learning achievement. Through the dynamic formative evaluation, the instructor is able to refer to the evaluation result when making estimation about the learner. To show the flow chart of learning, based on the dynamic formative evaluation, the model proves its effectiveness and validity.

Keywords: online learning, dynamic formative evaluation, mastery learning, repetitive learning method, learning achievement

Procedia PDF Downloads 483
6310 Usability Evaluation in Practice: Selecting the Appropriate Method

Authors: Hanan Hayat, Russell Lock

Abstract:

The importance of usability in ensuring software quality has been well established in literature and widely accepted by software development practitioners. Consequently, numerous usability evaluation methods have been developed. However, the availability of large variety of evaluation methods alongside insufficient studies that critically analyse them resulted in an ambiguous process of selection amongst non-usability-expert practitioners. This study investigates the factors affecting the selection of usability evaluation methods within a project by interviewing a software development team. The results of the data gathered are then analysed and integrated in developing a framework. The framework developed poses a solution to the selection processes of usability evaluation methods by adjusting to individual projects resources and goals. It has the potential to be further evaluated to verify its applicability and usability within the domain of this study.

Keywords: usability evaluation, evaluating usability in non-user entered designs, usability evaluation methods (UEM), usability evaluation in projects

Procedia PDF Downloads 133
6309 Development and Psychometric Evaluation of the Malaysian Multi-Ethnic Discrimination Scale

Authors: Chua Bee Seok, Shamsul Amri Baharuddin, Ferlis Bahari, Jasmine Adela Mutang, Lailawati Madlan, Rosnah Ismail, Asong Joseph

Abstract:

Malaysia is a country famously known for its multiple unique cultural and ethnic diversities. Despite the diversity of culture, customs and beliefs, respectively, Malaysia still be able to stand as a harmonious country. However, if there is an attitude of stereotypes, prejudice and discrimination among ethnic, it may seriously affect the solidarity between people in Malaysia. Thus, this study focuses on constructing a scale measuring the Malaysian experience, strategy and effect of ethnic discrimination. To develop a quantitative measure on ethnic discrimination directed against Malaysian, a three-step process is proposed: Exploratory factor analysis, validity analysis, and internal consistency reliability analysis. Results, limitations, and implications of the study are discussed.

Keywords: test development, Malaysian multi-ethnic discrimination scale, exploratory factor analysis, validity, multi-ethnic, reliability, psychometrics

Procedia PDF Downloads 703
6308 Psychometric Properties of the Sensory Processing Measure Preschool-Home among Children with Autism in Saudi Arabia

Authors: Shahad Alkhalifah, Jonh Wright

Abstract:

Autism spectrum disorder (ASD) is a pervasive developmental disorder associated, for 42% to 88% of people with ASD, with sensory processing disorders. Sensory processing disorders (SPD) impact daily functioning, and it is, therefore, essential to be able to diagnose them accurately. Currently, however, there is no assessment tool available for the Saudi Arabia (SA) population that would cover a wider enough age range. Therefore, this study aimed to assess the psychometric properties of the Sensory Processing Measure Preschool-Home Form (SPM-P) when used in English, with a population of English-speaking Saudi participants. This was chosen due to time limitations and the urgency in providing practitioners with appropriate tools. Using a convenience sampling approach group of caregivers of typically developing (TD) children and a group of caregivers for children with ASD were recruited (N = 40 and N = 16, respectively), and completed the SPM-P Home Form. Participants were also invited to complete it again after two weeks for test-retest reliability, and respectively, nine and five agreed. Reliability analyses suggested some issues with a few items when used in the Saudi culture, and, along with interscale correlations, it highlighted concerns with the factor structure. However, it was also found that the SPM-P Home has good criterion-based validity, and it is, therefore, suggested that it can be used until a tool is developed through translation and cultural adaptation. It is also suggested that the current factor structure of SPM-P Home is reassessed using a large sample.

Keywords: autism, sensory, assessment, reliability, sensory processing dysfunction, preschool, validity

Procedia PDF Downloads 205
6307 Towards a Systematic Evaluation of Web Design

Authors: Ivayla Trifonova, Naoum Jamous, Holger Schrödl

Abstract:

A good web design is a prerequisite for a successful business nowadays, especially since the internet is the most common way for people to inform themselves. Web design includes the optical composition, the structure, and the user guidance of websites. The importance of each website leads to the question if there is a way to measure its usefulness. The aim of this paper is to suggest a methodology for the evaluation of web design. The desired outcome is to have an evaluation that is concentrated on a specific website and its target group.

Keywords: evaluation methodology, factor analysis, target group, web design

Procedia PDF Downloads 605
6306 Characterisation of Human Attitudes in Software Requirements Elicitation

Authors: Mauro Callejas-Cuervo, Andrea C. Alarcon-Aldana

Abstract:

It is evident that there has been progress in the development and innovation of tools, techniques and methods in the development of software. Even so, there are few methodologies that include the human factor from the point of view of motivation, emotions and impact on the work environment; aspects that, when mishandled or not taken into consideration, increase the iterations in the requirements elicitation phase. This generates a broad number of changes in the characteristics of the system during its developmental process and an overinvestment of resources to obtain a final product that, often, does not live up to the expectations and needs of the client. The human factors such as emotions or personality traits are naturally associated with the process of developing software. However, most of these jobs are oriented towards the analysis of the final users of the software and do not take into consideration the emotions and motivations of the members of the development team. Given that in the industry, the strategies to select the requirements engineers and/or the analysts do not take said factors into account, it is important to identify and describe the characteristics or personality traits in order to elicit requirements effectively. This research describes the main personality traits associated with the requirements elicitation tasks through the analysis of the existing literature on the topic and a compilation of our experiences as software development project managers in the academic and productive sectors; allowing for the characterisation of a suitable profile for this job. Moreover, a psychometric test is used as an information gathering technique, and it is applied to the personnel of some local companies in the software development sector. Such information has become an important asset in order to make a comparative analysis between the degree of effectiveness in the way their software development teams are formed and the proposed profile. The results show that of the software development companies studied: 53.58% have selected the personnel for the task of requirements elicitation adequately, 37.71% possess some of the characteristics to perform the task, and 10.71% are inadequate. From the previous information, it is possible to conclude that 46.42% of the requirements engineers selected by the companies could perform other roles more adequately; a change which could improve the performance and competitiveness of the work team and, indirectly, the quality of the product developed. Likewise, the research allowed for the validation of the pertinence and usefulness of the psychometric instrument as well as the accuracy of the characteristics for the profile of requirements engineer proposed as a reference.

Keywords: emotions, human attitudes, personality traits, psychometric tests, requirements engineering

Procedia PDF Downloads 239
6305 The Meta–Evaluation of Master Degree Theses in Science Program of Evaluation Methodology, Srinakharinwirot University

Authors: Panwasn Mahalawalert

Abstract:

The objective of this study was to meta-evaluation of Master Degree theses in Science Program of Evaluation Methodology at Srinakharinwirot University, published during 2008-2011. This study was summative meta-evaluation that evaluated all theses of Master Degree in Science Program of Evaluation Methodology. Data were collected using the theses characteristics recording form and the evaluation meta-evaluation checklist. The collected data were analyzed by two parts: 1) Quantitative data were analyzed by descriptive statistics presented in frequency, percentages, mean, and standard deviation and 2) Qualitative data were analyzed by content analysis. The results of this study were found the theses characteristics was results revealed that most of theses were published in 2011. The largest group of theses researcher were female and were from the government office. The evaluation model of all theses were Decision-Oriented Evaluation Model. The objective of all theses were evaluate the project or curriculum. The most sampling technique were used the multistage random sampling technique. The most tool were used to gathering the data were questionnaires. All of the theses were analysed by descriptive statistics. The meta-evaluation results revealed that most of theses had fair on Utility Standards and Feasibility Standards, good on Propriety Standards and Accuracy Standards.

Keywords: meta-evaluation, evaluation, master degree theses, Srinakharinwirot University

Procedia PDF Downloads 504
6304 The Research of Weights Identify of Harbin Ecological Security Evaluation Index Based on AHP

Authors: Rong Guo, Mengshi Huang, Yujing Bai

Abstract:

With the rapid development of urbanization, the urban population increases and urban sprawl appeared. And these issues led to a sharp deterioration of the ecological environment. So, the urban ecological security evaluation was imminent. The weights identify of index was a key step of the research of ecological security evaluation. The AHP was widely used in the extensive research of weights identify of ecological security index. The characteristics of authority and quantitative can fully reflect the views of relevant experts. On the basis of building the ecological security evaluation index of Harbin, the paper combed and used the basic principle of the AHP, and calculated the weights of Harbin ecological security evaluation index through the process of the expert opinions “summary-feedback-summary”. And lay a foundation of future study of Harbin ecological security index, and guide the quantitative evaluation of Harbin ecological security.

Keywords: AHP, ecological security, evaluation Index, weights identify, harbin

Procedia PDF Downloads 471
6303 Developing a Health Literacy Questionnaire in Breast Cancer

Authors: Lida Moghaddam-Banaem, Mahmood Tavoosi, Soheila Khalili

Abstract:

Objective: The main objective of this study was designing a breast cancer health literacy questionnaire and assess its psychometric properties. Methods: A comprehensive literature review was performed to develop a primary questionnaire consisting of five domains. Qualitative and quantitative content validity were assessed by relevant experts, and after some modifications, the content validity index (CVI) and content validity ratio (CVR) were calculated. Qualitative and quantitative face validity were evaluated by a number of patients, and the impact score for each item was calculated. 225 women with breast cancer were asked to fill out the questionnaire and construct validity was determined by using exploratory factor analysis. The reliability was tested by Cronbach's alpha coefficient. Results: A 36-item questionnaire with five domains of reading, having access, understanding, assessing/judgment, and decision making/behavior was designed. 2 items were omitted in the qualitative content validity process. All items achieved optimum values in CVI, CVR and impact scores. Content and face validity of the questionnaire were confirmed too. According to the exploratory factor analysis, the five-factor solution accounted for 64.98 percent of the observed variance. Conclusion: Due to the obtained satisfactory validity and reliability, this tool can be used to assess health literacy in women with breast cancer. Health policy makers can use these findings for improving health-related behaviors in breast cancer patients.

Keywords: health literacy, breast cancer, questionnaire, psychometric properties

Procedia PDF Downloads 210
6302 A Study to Design a Survey to Encourage the University-Industry Relation

Authors: Lizbeth Puerta, Enselmina Marín

Abstract:

The purpose of this research is to present a survey to be applied to professors of public universities, to identify the factors that benefit or hinder the university-industry relation. Hence, this research studies some elements that integrate the variables: Knowledge management, technology management, and technology transfer; to define the existence of a relation between these variables and the industry necessities of innovation. This study is exploratory, descriptive and non-experimental. The research question is: What is the impact of the knowledge management, the technology management, and the technology transfer, made by administrative support areas of the public universities, in the industries innovation? Thus, literature review was made to identify some elements that should be considered to design a survey that allows to obtain valid information to the study variables. After this, the survey was developed, and the Content Validity Analysis was made through the Lawshe Model. The analysis indicated that the Content Validity Index (CVI) was 0.80. Hence, it was determined that this survey presents acceptable psychometric properties to be used as an evaluation tool.

Keywords: innovation, knowledge management, technology management, technology transfer

Procedia PDF Downloads 377
6301 Development of Non-Intrusive Speech Evaluation Measure Using S-Transform and Light-Gbm

Authors: Tusar Kanti Dash, Ganapati Panda

Abstract:

The evaluation of speech quality and intelligence is critical to the overall effectiveness of the Speech Enhancement Algorithms. Several intrusive and non-intrusive measures are employed to calculate these parameters. Non-Intrusive Evaluation is most challenging as, very often, the reference clean speech data is not available. In this paper, a novel non-intrusive speech evaluation measure is proposed using audio features derived from the Stockwell transform. These features are used with the Light Gradient Boosting Machine for the effective prediction of speech quality and intelligibility. The proposed model is analyzed using noisy and reverberant speech from four databases, and the results are compared with the standard Intrusive Evaluation Measures. It is observed from the comparative analysis that the proposed model is performing better than the standard Non-Intrusive models.

Keywords: non-Intrusive speech evaluation, S-transform, light GBM, speech quality, and intelligibility

Procedia PDF Downloads 233
6300 Nuclear Decay Data Evaluation for 217Po

Authors: S. S. Nafee, A. M. Al-Ramady, S. A. Shaheen

Abstract:

Evaluated nuclear decay data for the 217Po nuclide ispresented in the present work. These data include recommended values for the half-life T1/2, α-, β--, and γ-ray emission energies and probabilities. Decay data from 221Rn α and 217Bi β—decays are presented. Q(α) has been updated based on the recent published work of the Atomic Mass Evaluation AME2012. In addition, the logft values were calculated using the Logft program from the ENSDF evaluation package. Moreover, the total internal conversion electrons has been calculated using Bricc program. Meanwhile, recommendation values or the multi-polarities have been assigned based on recently measurement yield a better intensity balance at the 254 keV and 264 keV gamma transitions.

Keywords: nuclear decay data evaluation, mass evaluation, total converison coefficients, atomic mass evaluation

Procedia PDF Downloads 395
6299 Rasch Analysis in the Development of 'Kohesif-Ques': An Instrument to Measure Social Cohesion

Authors: Paramita Sekar Ayu, Sunjaya Deni Kurniadi, Yamazaki Chiho, Hilfi Lukman, Koyama Hiroshi

Abstract:

Social cohesion, or closeness among members of society, is an important determinant of population health. A cohesive society is a crucial societal condition for a positive life evaluation and subjective wellbeing, and people living in a cohesive society are happier and more satisfied with life and achieve better health status. The objective of this study was to compose and validate a questionnaire for measuring social cohesion with Rasch analysis. We develop a set of 13 questions to measure 4 dimensions of social cohesion. Random samples of 166 Bandung citizens’ were selected to answer the questionnaire. To evaluate the questionnaire’s validity and reliability, Rasch analysis (a psychometric model for analyzing categorical data on questionnaire responses) was carried out using Winsteps version 3.75.0. Rasch analysis was performed on the response given to 13 items included in the questionnaire. The reliability coefficient, Cronbach’s alpha was 0.70, model RMSE 0.08, SD 0.54, separation 7.14, and reliability of 0.98. ‘Kohesif-Ques’ is a useful instrument to assess social cohesion.

Keywords: rasch analysis, rasch model, social cohesion, quesionnaire

Procedia PDF Downloads 141
6298 Scenario-Based Scales and Situational Judgment Tasks to Measure the Social and Emotional Skills

Authors: Alena Kulikova, Leonid Parmaksiz, Ekaterina Orel

Abstract:

Social and emotional skills are considered by modern researchers as predictors of a person's success both in specific areas of activity and in the life of a person as a whole. The popularity of this scientific direction ensures the emergence of a large number of practices aimed at developing and evaluating socio-emotional skills. Assessment of social and emotional development is carried out at the national level, as well as at the level of individual regions and institutions. Despite the fact that many of the already existing social and emotional skills assessment tools are quite convenient and reliable, there are now more and more new technologies and task formats which improve the basic characteristics of the tools. Thus, the goal of the current study is to develop a tool for assessing social and emotional skills such as emotion recognition, emotion regulation, empathy and a culture of self-care. To develop a tool assessing social and emotional skills, Rasch-Gutman scenario-based approach was used. This approach has shown its reliability and merit for measuring various complex constructs: parental involvement; teacher practices that support cultural diversity and equity; willingness to participate in the life of the community after psychiatric rehabilitation; educational motivation and others. To assess emotion recognition, we used a situational judgment task based on OCC (Ortony, Clore, and Collins) emotions theory. The main advantage of these two approaches compare to classical Likert scales is that it reduces social desirability in answers. A field test to check the psychometric properties of the developed instrument was conducted. The instrument was developed for the presidential autonomous non-profit organization “Russia - Land of Opportunity” for nationwide soft skills assessment among higher education students. The sample for the field test consisted of 500 people, students aged from 18 to 25 (mean = 20; standard deviation 1.8), 71% female. 67% of students are only studying and are not currently working and 500 employed adults aged from 26 to 65 (mean = 42.5; SD 9), 57% female. Analysis of the psychometric characteristics of the scales was carried out using the methods of IRT (Item Response Theory). A one-parameter rating scale model RSM (Rating scale model) and Graded Response model (GRM) of the modern testing theory were applied. GRM is a polyatomic extension of the dichotomous two-parameter model of modern testing theory (2PL) based on the cumulative logit function for modeling the probability of a correct answer. The validity of the developed scales was assessed using correlation analysis and MTMM (multitrait-multimethod matrix). The developed instrument showed good psychometric quality and can be used by HR specialists or educational management. The detailed results of a psychometric study of the quality of the instrument, including the functioning of the tasks of each scale, will be presented. Also, the results of the validity study by MTMM analysis will be discussed.

Keywords: social and emotional skills, psychometrics, MTMM, IRT

Procedia PDF Downloads 48
6297 Metacognition Skill on Collaborative Study with Self Evaluation

Authors: Suratno

Abstract:

Metacognition thinking skills should be developed early on in learning. The aim of research builds metacognition thinking skills through collaborative learning with self-evaluation. Approach to action research study involving 32 middle school students in Jember Indonesia. Indicators metacognition skills consist of planning, information management strategies, comprehension monitoring, and debugging strategies. Data were analyzed by t test and analysis of instructional videos. Results of the study here were significant differences in metacognition skills before and after the implementation of collaborative learning with self-evaluation. Analysis instructional video showing the difference artifacts of student learning activities to learning before and after implementation of collaborative learning with self-evaluation. Self-evaluation makes students familiar practice thinking skills metacognition.

Keywords: metacognition, collaborative, evaluation, thinking skills

Procedia PDF Downloads 328
6296 Research on the Teaching Quality Evaluation of China’s Network Music Education APP

Authors: Guangzhuang Yu, Chun-Chu Liu

Abstract:

With the advent of the Internet era in recent years, social music education has gradually shifted from the original entity education mode to the mode of entity plus network teaching. No matter for school music education, professional music education or social music education, the teaching quality is the most important evaluation index. Regarding the research on teaching quality evaluation, scholars at home and abroad have contributed a lot of research results on the basis of multiple methods and evaluation subjects. However, to our best knowledge the complete evaluation model for the virtual teaching interaction mode of the emerging network music education Application (APP) has not been established. This research firstly found out the basic dimensions that accord with the teaching quality required by the three parties, constructing the quality evaluation index system; and then, on the basis of expounding the connotation of each index, it determined the weight of each index by using method of fuzzy analytic hierarchy process, providing ideas and methods for scientific, objective and comprehensive evaluation of the teaching quality of network education APP.

Keywords: network music education APP, teaching quality evaluation, index and connotation

Procedia PDF Downloads 97
6295 A Preliminary Study of the Subcontractor Evaluation System for the International Construction Market

Authors: Hochan Seok, Woosik Jang, Seung-Heon Han

Abstract:

The stagnant global construction market has intensified competition since 2008 among firms that aim to win overseas contracts. Against this backdrop, subcontractor selection is identified as one of the most critical success factors in overseas construction project. However, it is difficult to select qualified subcontractors due to the lack of evaluation standards and reliability. This study aims to identify the problems associated with existing subcontractor evaluations using a correlations analysis and a multiple regression analysis with pre-qualification and performance evaluation of 121 firms in six countries.

Keywords: subcontractor evaluation system, pre-qualification, performance evaluation, correlation analysis, multiple regression analysis

Procedia PDF Downloads 340
6294 Comparative Analysis of Forensic Medicine Course Evaluation: A Two Year Study

Authors: Prateek Rastogi

Abstract:

Medical teaching in present era concentrates not only on teaching but on effective teaching. For effective teaching a combination of effective carefully designed curriculum, an educated educator, competent learner and fool proof evaluation system is required. Keeping these parameters in mind and study was undertaken at Kasturba Medical College, Mangalore among medical students. In this study, evaluation of Forensic Medicine syllabus along with its teaching and evaluation methodology was done using 20 different parameters. This questionnaire based study was done over a period of two years i.e. 2013 and 2014. Batch of students who just passed the forensic medicine subject was included for study. Carefully designed questionnaire contained questions related to course content, teaching methodology and evaluation system along with provisions to mention merits and demerits of subject. The feedbacks in first round were analyzed and suggestions were implemented before conducting the second round of study. Overall evaluation of course was done as well as it was compared with other subjects of second MBBS. It was noted that Scores improved in 2nd survey thus stressing the importance of course evaluation and student feedback in teaching improvement.

Keywords: teaching methodology, system of evaluation, course content, bioinformatics, biomedicine

Procedia PDF Downloads 326
6293 The Evaluation Model for the Quality of Software Based on Open Source Code

Authors: Li Donghong, Peng Fuyang, Yang Guanghua, Su Xiaoyan

Abstract:

Using open source code is a popular method of software development. How to evaluate the quality of software becomes more important. This paper introduces an evaluation model. The model evaluates the quality from four dimensions: technology, production, management, and development. Each dimension includes many indicators. The weight of indicator can be modified according to the purpose of evaluation. The paper also introduces a method of using the model. The evaluating result can provide good advice for evaluating or purchasing the software.

Keywords: evaluation model, software quality, open source code, evaluation indicator

Procedia PDF Downloads 357
6292 Integrating Eye-Tracking Analysis to Enhance Web Usability Evaluation

Authors: Johanna Renny Octavia, Meliana Nurdin, Ignatius Kevin Kurniawan, Ricca Aksara

Abstract:

It is widely believed that usability evaluation is necessary to evaluate a website design for further improvement. Traditional methods of usability evaluation have given sufficient insights to reveal usability problems of websites. Eye-tracking analysis has been considered as a useful method that adds a powerful dimension to web usability evaluation. It allows web designers and usability researchers to understand exactly what users do and do not see on a web page, thus disclose more information on web usability and provide a more complete insights on a website design. This paper elaborates on moving beyond traditional methods of web usability evaluation by integrating eye-tracking analysis to enhance the evaluation of website design, and presents three case studies to support this approach. In these case studies, eye movement metrics such as gaze plots and fixation-derived metrics, and user performance data such as task completion times and number of errors were recorded as objective measurements that can inform the necessity for website design improvements.

Keywords: design, eye-tracking, usability evaluation, website

Procedia PDF Downloads 275
6291 Evaluation of the Matching Optimization of Human-Machine Interface Matching in the Cab

Authors: Yanhua Ma, Lu Zhai, Xinchen Wang, Hongyu Liang

Abstract:

In this paper, by understanding the development status of the human-machine interface in today's automobile cab, a subjective and objective evaluation system for evaluating the optimization of human-machine interface matching in automobile cab was established. The man-machine interface of the car cab was divided into a software interface and a hard interface. Objective evaluation method of software human factor analysis is used to evaluate the hard interface matching; The analytic hierarchy process is used to establish the evaluation index system for the software interface matching optimization, and the multi-level fuzzy comprehensive evaluation method is used to evaluate hard interface machine. This article takes Dongfeng Sokon (DFSK) C37 model automobile as an example. The evaluation method given in the paper is used to carry out relevant analysis and evaluation, and corresponding optimization suggestions are given, which have certain reference value for designers.

Keywords: analytic hierarchy process, fuzzy comprehension evaluation method, human-machine interface, matching optimization, software human factor analysis

Procedia PDF Downloads 119
6290 Development of the New York Misophonia Scale: Implications for Diagnostic Criteria

Authors: Usha Barahmand, Maria Stalias, Abdul Haq, Esther Rotlevi, Ying Xiang

Abstract:

Misophonia is a condition in which specific repetitive oral, nasal, or other sounds and movements made by humans trigger impulsive aversive reactions of irritation or disgust that instantly become anger. A few measures exist for the assessment of misophonia, but each has some limitations, and evidence for a formal diagnosis is still lacking. The objective of this study was to develop a reliable and valid measure of misophonia for use in the general population. Adopting a purely descriptive approach, this study focused on developing a self-report measure using all triggers and reactions identified in previous studies on misophonia. A measure with two subscales, one assessing the aversive quality of various triggers and the other assessing reactions of individuals, was developed. Data were gathered from a large sample of both men and women ranging in age from 18 to 65 years. Exploratory factor analysis revealed three main triggers: oral/nasal sounds, hand and leg movements, and environmental sounds. Two clusters of reactions also emerged: nonangry attempts to avoid the impact of the aversive stimuli and angry attempts to stop the aversive stimuli. The examination of the psychometric properties of the scale revealed its internal consistency and test-retest reliability to be excellent. The scale was also found to have very good concurrent and convergent validity. Significant annoyance and disgust in response to the triggers were reported by 12% of the sample, although for some specific triggers, rates as high as 31% were also reported. These findings have implications for the delineation of the criteria for identifying misophonia as a clinical condition.

Keywords: adults, factor analysis, misophonia, psychometric properties, scale

Procedia PDF Downloads 169
6289 Model of Multi-Criteria Evaluation for Railway Lines

Authors: Juraj Camaj, Martin Kendra, Jaroslav Masek

Abstract:

The paper is focused to the evaluation railway tracks in the Slovakia by using Multi-Criteria method. Evaluation of railway tracks has important impacts for the assessment of investment in technical equipment. Evaluation of railway tracks also has an important impact for the allocation of marshalling yards. Marshalling yards are in transport model as centers for the operation assigned catchment area. This model is one of the effective ways to meet the development strategy of the European Community's railways. By applying this model in practice, a transport company can guarantee a higher quality of service and then expect an increase in performance. The model is also applicable to other rail networks. This model supplements a theoretical problem of train formation problem of new ways of looking at evaluation of factors affecting the organization of wagon flows.

Keywords: railway track, multi-criteria methods, evaluation, transportation model

Procedia PDF Downloads 435
6288 Use of Computer and Machine Learning in Facial Recognition

Authors: Neha Singh, Ananya Arora

Abstract:

Facial expression measurement plays a crucial role in the identification of emotion. Facial expression plays a key role in psychophysiology, neural bases, and emotional disorder, to name a few. The Facial Action Coding System (FACS) has proven to be the most efficient and widely used of the various systems used to describe facial expressions. Coders can manually code facial expressions with FACS and, by viewing video-recorded facial behaviour at a specified frame rate and slow motion, can decompose into action units (AUs). Action units are the most minor visually discriminable facial movements. FACS explicitly differentiates between facial actions and inferences about what the actions mean. Action units are the fundamental unit of FACS methodology. It is regarded as the standard measure for facial behaviour and finds its application in various fields of study beyond emotion science. These include facial neuromuscular disorders, neuroscience, computer vision, computer graphics and animation, and face encoding for digital processing. This paper discusses the conceptual basis for FACS, a numerical listing of discrete facial movements identified by the system, the system's psychometric evaluation, and the software's recommended training requirements.

Keywords: facial action, action units, coding, machine learning

Procedia PDF Downloads 81
6287 Evaluation Model in the Branch of Virtual Education of “Universidad Manuela Beltrán” Bogotá-Colombia

Authors: Javier López

Abstract:

This Paper presents the evaluation model designed for the virtual education branch of The “Universidad Manuela Beltrán, Bogotá-Colombia”. This was the result of a research, developed as a case study, which had three stages: Document review, observation, and a perception survey for teachers. In the present model, the evaluation is a cross-cutting issue to the educational process. Therefore, it consists in a group of actions and guidelines which lead to analyze the student’s learning process from the admission, during the academic training, and to the graduation. This model contributes to the evaluation components which might interest other educational institutions or might offer methodological guidance to consolidate an own model

Keywords: model, evaluation, virtual education, learning process

Procedia PDF Downloads 422
6286 Development of a Value Evaluation Model of Highway Box-Girder Bridge

Authors: Hao Hsi Tseng

Abstract:

Taiwan’s infrastructure is gradually deteriorating, while resources for maintenance and replacement are increasingly limited, raising the urgent need for methods for maintaining existing infrastructure within constrained budgets. Infrastructure value evaluation is used to enhance the efficiency of infrastructure maintenance work, allowing administrators to quickly assess the maintenance needs and performance by observing variation in infrastructure value. This research establishes a value evaluation model for Taiwan’s highway box girder bridges. The operating mechanism and process of the model are illustrated in a practical case.

Keywords: box girder bridge, deterioration, infrastructure, maintenance, value evaluation

Procedia PDF Downloads 164