Search results for: psychometric assessment

Authors: Matthew J. Zagumny

Abstract:

The current study reports an examination of the QUEST-25 (Q-Assessment of Undergraduate Epistemology and Scientific Thinking) online version for assessing the dispositional attitudes toward scientific thinking and intellectual curiosity among undergraduate students. The QUEST-25 consists of scientific thinking (SIQ-25) and intellectual curiosity (ICIQ-25), which were correlated in hypothesized directions with the Religious Commitment Inventory, Curiosity and Exploration Inventory, Belief in Science scale, and measures of academic self-efficacy. Additionally, concurrent validity was established by the resulting significant differences between those identifying the centrality of religious belief in their lives and those who do not self-identify as being guided daily by religious beliefs. This study demonstrates the utility of the QUEST-25 for research, evaluation, and theory development.

Keywords: guided-inquiry learning, intellectual curiosity, psychometric assessment, scientific thinking

Procedia PDF Downloads 235

Authors: Nadwah Onwi, Puspa Maniam, Azmawanie A. Aziz, Fairus Mukhtar, Nor Azrita Mohamed Zin, Nurul Haslina Mohd Zin, Nurul Fatehah Ismail, Mohamad Safwan Yusoff, Susilidianamanalu Abd Rahman, Siti Munirah Harris, Maryam Aizuddin

Abstract:

Objective: Malaysia has a growing number of individuals with complex communication needs (CCN). The initiation of augmentative and alternative communication (AAC) intervention may facilitate individuals with CCN to understand and express themselves optimally and actively participate in activities in their daily life. AAC is defined as multimodal use of communication ability to allow individuals to use every mode possible to communicate with others using a set of symbols or systems that may include the symbols, aids, techniques, and strategies. It is consequently critical to evaluate the deficits to inform treatment for AAC intervention. However, no known measurement tools are available to evaluate the user with CCN available locally. Design: A systematic review (SR) is designed to analyze the psychometric properties of AAC assessment for adolescents with CCN published in peer-reviewed journals. Tools are rated by the methodological quality of studies and the psychometric measurement qualities of each tool. Method: A literature search identifying AAC assessment tools with psychometrically robust properties and conceptual framework was considered. Two independent reviewers screened the abstracts and full-text articles and review bibliographies for further references. Data were extracted using standardized forms and study risk of bias was assessed. Result: The review highlights the psychometric properties of AAC assessment tools that can be used by speech-language therapists applicable to be used in the Malaysian context. The work outlines how systematic review methods may be applied to the consideration of published material that provides valuable data to initiate the development of Malay Language AAC assessment tools. Conclusion: The synthesis of evidence has provided a framework for Malaysia Speech-Language therapists in making an informed decision for AAC intervention in our standard operating procedure in the Ministry of Health, Malaysia.

Keywords: augmentative and alternative communication, assessment, adolescents, complex communication needs

Procedia PDF Downloads 121

Authors: Barbara Erjauz, Juliane Eichhorn

Abstract:

Background and Purpose: The world´s population is rapidly aging, wherefore the World Health Organization (WHO) is dealing with concepts of Age-Friendly-Communities and criteria to define them. Also in Germany, we can find an aging population and a large amount of seniors is living in rural areas. Those regions are defined by unique social and environmental characteristics, which can enhance or decrease age-friendliness. To identify and work with these characteristics, we are in need of appropriate assessment instruments. To the author’s best knowledge until now, no instrument could be identified as suitable and scientifically proven for the German speaking area. The aim of the study was to identify an assessment instrument to measure the age-friendliness of rural communities and its psychometric testing regarding the content validity. Methods: A literature search was carried out to identify instruments related to concepts of Age-Friendly-Communities. According to the German situation, an instrument was chosen and modified based on a Delphi-study. In this context, the content validity was investigated by calculating the Content Validity Index (CVI). Results: An instrument consisting of 86 items based on WHO indicators and the German situation in rural areas was created. 43 items (50%) had a Content Validity Index for Items (I-CVI) of 1,00, 37 items (43%) had an I-CVI of >0,78 and > 1.00, and 6 items had an I-CVI of >0,78. The value of the Content Validity Index for Scales, averaging calculation method (S-CVI/Ave) for the entire scale was 0,91. Conclusions: The results indicate a good content validity and it can be concluded that the created instrument represents the phenomenon of age-friendliness in rural areas. Nevertheless, further psychometric testing related to reliability, validity and responsiveness is recommended.

Keywords: assessment, age-friendly, rural, psychometric testing

Procedia PDF Downloads 202

Authors: Mona Rezaei, Habib Honari, Mehrzad Hamidi, Fatemeh Kiani

Abstract:

Make strong brands has become a priority for many organizations in marketing. Brand is an important indicator of marketing status. Brand Strength is in kept customer, profit, brand development and gain competitive advantage and In fact it is a concept that was created from a consumer perspective. It is assumed that the creation of a strong brand is creating numerous marketing benefits. The purpose of this study was to evaluate the psychometric characteristics of the questionnaire the most strong sports brands in the consumer society. Questionnaire was conducted to a sample of 340 customers of sports brands. Psychometric parameters were determined by using appropriate statistical methods. The results of the factor analysis and Varimax rotation revealed five factors of strong brands. The results confirms that questionnaire structure have acceptable associated to the data and confirmed all indicators of the model. Reliability (859/0) was satisfactory. According to calculated psychometric indices, this questionnaire could be appropriate to assess the most strong sports brands.

Keywords: reliability, strong brand, sport brands, psychometric

Procedia PDF Downloads 323

Authors: Aspasia Simpsi

Abstract:

The aim of this study was to translate into Greek and then validate the psychometric properties of the Internet Gaming Disorder Scale–Short-Form (IGDS9-SF) (Pontes & Griffiths, 2015). This is the first short standardized psychometric tool to assess Internet Gaming Disorder (IGD) according to the DSM-V nine clinical criteria and among the most frequently examined. The translation of the test was done through the process of back-translation. To gain a better insight into the psychometric properties of this test, the questionnaire included demographic questions and the Greek version of the Internet Addiction Test (Young, 1998). The participants of the study were 241 adolescents aged between 12 to 18. They were nationally recruited in Greece through an online survey that was hosted on the platform of Qualtrics. Analysis revealed excellent reliability with Cronbach’s alpha coefficients α = .939 for IGDS9-SF and α = .940 for IAT. The use of Pearson product-moment correlation revealed a significant positive relationship between IGDS9-SF and IAT r (241) =.45, p < .001. Due to inconsistencies in terminology and tests in the field of IGD, what is recommended for future research is a consensus regarding IGD testing and research.

Keywords: internet gaming disorder, IGDS9-SF, psychometric properties, internet addiction

Procedia PDF Downloads 29

Authors: Jorn Meyer, Stefan Sturmer

Abstract:

The assessment of attachment patterns in toddlers and adults has been well researched, and valid diagnostic methods (e.g., Strange Situation Test, Adult Attachment Interview) are applicable. For middle and late childhood, on the other hand, there are only few validated methods available so far. For the Child Attachment Interview (CAI) promising validation studies from English-speaking countries are available, but so far a comprehensive study on the validity of a German sample is lacking. Within the scope of a longitudinal project, the results of the first point of measurement are reported in this study. A German-language version of the CAI was carried out with 111 primary school children (56% female; age: M = 8.34, SD = 0.49). In relation to psychometric quality criteria, parameters on interrater reliability, construct validity and discriminant, and convergent validity are reported. Analyses of the correlations between attachment patterns and internalizing and externalizing behavior problems from parent and teacher reports are presented. The implications for the German-language assessment of attachment in middle and late childhood in research and individual case diagnostics, e.g., in the context of conducting expert evaluation reports for family courts, are discussed.

Keywords: attachment, attachment assessment, developmental psychology, longitudinal study

Procedia PDF Downloads 210

Authors: Leon Holtzhausen, Emma Campbell

Abstract:

This study aimed to explore the psychometric properties of the Youth Psychopathic Traits Inventory- short version (YPI-S) and the applicability of Psychopathy as a Unified Theory of Crime among 213 young adults in South Africa. The deviant behaviour variety scale and the YPI-S were used in this study. Results from factor analysis and reliability measures indicated the YPI-S seemed to have good psychometric properties when applied to the South African sample, however applicability of the behavioural dimension was a challenge. The results related to the association between deviant behaviours and psychopathic traits suggested that Psychopathy as a Unified Theory of Crime could be applied in the South African context. It is however important to note that future research should explore how the relevant scales could be culturally and contextually adapted for better psychometric outcomes.

Keywords: testing psychopathy, adverse childhood experiences, youth psychopathic traits inventory, young adults

Procedia PDF Downloads 44

Authors: Nadereh Sohrabi Shegefti, Siamak Samani

Abstract:

Level of adjustment is the first index to check mental health. The aim of this study was developing a valid and reliable Multidimensional Adjustment Scale (MAS). The sample consisted of 150 college students. Multidimensional adjustment scale and Depression, Anxiety, and stress scale (DASS) were used in this study. Principle factor analysis, Pearson correlation coefficient, and Cornbach's Alpha were used to check the validity and reliability of the MAS. Principle component factor analysis showed a 5 factor solution for the MAS. Alpha coefficients for the MAS sub scales were ranged between .69 to .83. Test-retest reliability for MAS was .88 and the mean of sub scales- total score correlation was .88. All these indexes revealed an acceptable reliability and validity for the MAS. The MAS is a short assessment instrument with good acceptable psychometric properties to use in clinical filed.

Keywords: psychological adjustment, psychometric properties, validity, Pearson correlation

Procedia PDF Downloads 597

Authors: Argyris B. Karapetsas, Rozi M. Laskaraki, Aikaterini A. Karapetsa, Maria Bampou, Valentini N. Vamvaka

Abstract:

The main aim of the current protocol is the contribution of neuropsychology in both assessment and rehabilitation settings for children with dyslexia. Objectives: The purpose of this study was to evaluate the significant role of neuropsychological assessment including both Psychometric and electrophysiological tests as well as to investigate the effectiveness of an Auditory Training program, designed via Music designed for children with Developmental Dyslexia (DD). Materials: In our study, participated 45 third-, and fourth-grade students with DD and a matched control group (n=45). Method: At the first phase of the protocol, children underwent a clinical assessment, including both electrophysiological, i.e. Event Related Potentials (ERPs) esp. P300 waveform, and psychometric tests, being conducted in Laboratory of Neuropsychology, at University of Thessaly, in Volos, Greece. Assessment’s results confirmed statistically significant lower performance for children with DD for all tests, compared to the typical readers of the control group. After evaluation, a subgroup of children with DD participated in a Rehabilitation Program including digitized musical auditory training activities. Results: The electrophysiological recordings after the intervention revealed shorter, almost similar, P300 latency values for children with DD to those of the control group, indicating the beneficial effects of the Intervention, thus enabling children develop reading skills and become successful readers. Discussion: Similar research data confirm the crucial role of neuropsychology in both diagnosis and treatment of common disorders, observed in children. Indeed, as for DD, there is growing evidence that brain activity dysfunction does occur, as it is confirmed by neuropsychological assessment and also musical auditory training may have remedial effects. Conclusions: The outcomes of the current study suggest that due to the neurobiological origin of DD, neuropsychology may give the means in both neuropsychological assessment and rehabilitation, enabling professionals to cope with cerebral dysfunction and recovery more efficiently.

Keywords: diagnosis, dyslexia, ERPs, Music, neuropsychology, rehabilitation

Procedia PDF Downloads 105

Authors: Shahad Alkhalifah, Jonh Wright

Abstract:

Autism spectrum disorder (ASD) is a pervasive developmental disorder associated, for 42% to 88% of people with ASD, with sensory processing disorders. Sensory processing disorders (SPD) impact daily functioning, and it is, therefore, essential to be able to diagnose them accurately. Currently, however, there is no assessment tool available for the Saudi Arabia (SA) population that would cover a wider enough age range. Therefore, this study aimed to assess the psychometric properties of the Sensory Processing Measure Preschool-Home Form (SPM-P) when used in English, with a population of English-speaking Saudi participants. This was chosen due to time limitations and the urgency in providing practitioners with appropriate tools. Using a convenience sampling approach group of caregivers of typically developing (TD) children and a group of caregivers for children with ASD were recruited (N = 40 and N = 16, respectively), and completed the SPM-P Home Form. Participants were also invited to complete it again after two weeks for test-retest reliability, and respectively, nine and five agreed. Reliability analyses suggested some issues with a few items when used in the Saudi culture, and, along with interscale correlations, it highlighted concerns with the factor structure. However, it was also found that the SPM-P Home has good criterion-based validity, and it is, therefore, suggested that it can be used until a tool is developed through translation and cultural adaptation. It is also suggested that the current factor structure of SPM-P Home is reassessed using a large sample.

Keywords: autism, sensory, assessment, reliability, sensory processing dysfunction, preschool, validity

Procedia PDF Downloads 203

Authors: Sakinah Idris, Femke Ten Hoeve, Kirstin Greaves-Lord

Abstract:

Background: Social skills interventions are considered to be efficacious if social skills are improved as a result of an intervention. Nevertheless, the objective assessment of social skills is hindered by a lack of sensitive and validated measures. To measure the change in social skills after an intervention, questionnaires reported by parents, clinicians and/or teachers are commonly used. Observations are the most ecologically valid method of assessing improvements in social skills after an intervention. For this purpose, The Program for the Educational and Enrichment of Relational Skills (PEERS) was developed for adolescents, in order to teach them the age-appropriate skills needed to participate in society. It is an evidence-based intervention for adolescents with ASD that taught ecologically valid social skills techniques. Objectives: The current study aims to describe the development and psychometric evaluation of the Dutch Contextual Assessment of Social Skills (CASS), an observational outcome measure of social skills for adolescents with Autism Spectrum Disorder (ASD). Methods: 64 adolescents (M = 14.68, SD = 1.41, 71% boys) with ASD performed the CASS before and after a social skills intervention (i.e. PEERS or the active control condition). Each adolescent completed a 3-minute conversation with a confederate. The conversation was prompt as a natural introduction between two-unfamiliar, similar ages, opposite-sex peers who meet for the first time. The adolescent and the confederate completed a brief questionnaire about the conversation (Conversation Rating Scale). Results: Results indicated sufficient psychometric properties. The Dutch CASS has a high level of internal consistency (Cronbach's α coefficients = 0.84). Data supported the convergent validity (i.e., significant correlated with the Social Skills Improvement System (SSiS). The Dutch CASS did not significantly correlate with the autistic mannerism subscale from Social Responsiveness Scale (SRS), thus proved the divergent validity. Based on scorings made by raters who were kept blind to the time points, reliable change index was computed to assess the change in social skills. With regard to the content validity, only the learning objectives of the first two meetings of PEERS about conversational skills relatively matched with rating domains of the CASS. Due to this underrepresentation, we found an existing observational measure (TOPICC) that covers some of the other learning objectives of PEERS. TOPICC covers 22% of the learning objectives of PEERS about conversational skills, meanwhile, CASS is 45%. Unfortunately, 33% of the learning objectives of PEERS was not covered by CASS or TOPICC. Conclusion: Recommendations are made to improve the psychometric properties and content validity of the Dutch CASS.

Keywords: autism spectrum disorder, observational, PEERS, social skills

Procedia PDF Downloads 115

Authors: Lucie Mrackova, Helena Kisvetrova

Abstract:

Spirituality is an integral part of human life. In a secular environment, spiritual needs are often overlooked, especially in acute nursing care. Spiritual needs assessment for patients (SNAP), which also exists in the Czech version (SNAP-CZ), can be used for objective evaluation. The aim of this study was to measure the psychometric properties of SNAP-CZ and to find correlations between SNAP-CZ and sociodemographic and clinical variables. A cross-sectional study with tools assessing spiritual needs (SNAP-CZ), anxiety (Beck Anxiety Inventory; BAI), depression (Beck Depression Inventory; BDI), pain (Visual Analogue Scale; VAS), self-sufficiency (Barthel Index; BI); cognitive function (Montreal Cognitive Test; MoCa) and selected socio-demographic data was performed. The psychometric properties of SNAP-CZ were tested using factor analysis, reliability and validity tests, and correlations between the questionnaire and sociodemographic data and clinical variables. Internal consistency was established with Cronbach’s alfa for the overall score, respective domains, and individual items. Reliability was assessed by test-retest by Interclass correlation coefficient (ICC). Data for correlation analysis were processed according to Pearson's correlation coefficient. The study included 172 trauma patients (the mean age = 40.6 ± 12.1 years) who experienced polytrauma or severe monotrauma. There were a total of 106 (61.6%) male subjects, 140 (81.4%) respondents identified themselves as non-believers. The full-scale Cronbach's alpha was 0.907. The test-retest showed the reliability of the individual domains in the range of 0.924 to 0.960 ICC. Factor analysis resulted in a three-factor solution (psychosocial needs (alfa = 0.788), spiritual needs (alfa = 0.886) and religious needs (alfa = 0.841)). Correlation analysis using Pearson's correlation coefficient showed that the domain of psychosocial needs significantly correlated only with gender (r = 0.178, p = 0.020). Males had a statistically significant lower average value in this domain (mean = 12.5) compared to females (mean = 13.8). The domain of spiritual needs significantly correlated with gender (r = 0.199, p = 0.009), social status (r = 0.156, p = 0.043), faith (r = -0.250, p = 0.001), anxiety (r = 0.194, p = 0.011) and depression (r = 0.155, p = 0.044). The domain of religious needs significantly correlated with age (r = 0,208, p = 0,007), education (r = -0,161, p = 0,035), faith (r = -0,575, p < 0,0001) and depression (r = 0,179, p = 0,019). Overall, the whole SNAP scale significantly correlated with gender (r = 0.219, p = 0.004), social status (r = 0.175, p = 0.023), faith (r = -0.334, p <0.0001), anxiety (r = 0.177, p = 0.022) and depression (r = 0.173, p = 0.025). The results of this study corroborate the reliability of the SNAP-CZ and support its future use in the nursing care of trauma patients in a secular society. Acknowledgment: The study was supported by grant nr. IGA_FZV_2020_003.

Keywords: acute nursing care, assessment of spiritual needs, patient, psychometric validation, spirituality

Procedia PDF Downloads 72

Authors: Pedro Dias, Lurdes Verissimo, Maria Joao Baptista, Ana Pinheiro, Patricia Oliveira-Silva, Sofia Serra, Daniela Coimbra

Abstract:

To achieve a high standard in performance, a musician must be well in all aspects of health (physical, mental and social). Anxiety in performance is related to the high level of coordination and skill needed in performance, as well as to the public evaluation of the performer. It affects some key elements of performance, such as concentration, memory, motor coordination, and relaxation. This work presents two studies focused on the adaptation and evaluation of the psychometric properties of the Music Performance Anxiety Inventory (MPAI-A) in young Portuguese music students. The first study was conducted with a sample of 161 adolescent music students, who responded to the Portuguese version of this instrument, and to the State-Trait Anxiety Inventory for Children (STAIC-c2). Validity and reliability were examined, and this measure revealed robust psychometric properties in this sample. The second study aimed to adapt the MPAI to a younger population (one hundred 8-10 years-old music students). Again, the MPAI and the STAIC c-2 were used in this study. Exploratory factor analysis, correlations, and internal consistency were used to evaluate the final children version of the instrument (MPAI-C), presenting a different factor structure compared to the adolescent version (10 items organized in 2 factors) and high levels of reliability and convergent validity.

Keywords: anxiety, assessment, children and adolescents, music performance

Procedia PDF Downloads 156

Authors: T. Keiller, E. Hindman, P. Hassmen, K. Radford, L. Lavrencic

Abstract:

Background: Psychosocial disadvantage is associated with impaired cognitive abilities, with executive functioning (EF) abilities particularly vulnerable. EF abilities strongly predict general daily functioning, educational and career prospects, and health choices. A reliable and valid assessment of EF is important to support appropriate care and intervention strategies. However, evidence-based EF assessment tools for use with Aboriginal Australians are limited. Aim and Method: This research aims to develop and validate a culturally appropriate EF tool for use with indigenous Australians. To this end, Study One aims to review current literature examining the benefits and disadvantages of current EF assessment tools for use with Indigenous Australians. Study Two aims to collate expert opinion on the strengths and weaknesses of various current EF assessment tools for use with Indigenous Australians using Delphi methodology with experienced psychologists (n = 10). The initial two studies will inform the development of a culturally appropriate assessment tool. Study Three aims to evaluate the psychometric properties of the tool with an Indigenous sample living in the New South Wales Mid-North Coast. The study aims to quantify the predictive validity of this tool via comparison to functionality predictors and neuropsychological assessment scores. Study Four aims to collect qualitative data surrounding the feasibility and acceptability of the tool among indigenous Australians and health professionals. Expected Results: Findings from this research are likely to inform cognitive assessment practices and tool selection for health professionals conducting cognitive assessments with Indigenous Australians. Improved assessment of EF will inform appropriate care and intervention strategies for individuals with EF deficits.

Keywords: aboriginal Australians, assessment tool, cognition, executive functioning

Procedia PDF Downloads 238

Authors: Yiannis Koumpouros, Effie Papageorgiou, Alexandra Karavasili, Foteini Koureta

Abstract:

The objective of the present study was to develop a scale called PYTHEIA. The PYTHEIA is a self-reported measure for the assessment of rehabilitation and assistive robotics and other assistive technology devices. The development of PYTHEIA faced the absence of a valid instrument that can be used to evaluate the assistive robotic devices both as a whole, as well as any of their individual components or functionalities implemented. According to the results presented, PYTHEIA is a valid and reliable scale able to be applied to different target groups for the subjective evaluation of various assistive technology devices.

Keywords: rehabilitation, assistive technology, assistive robots, rehabilitation robots, scale, psychometric test, assessment, validation, user satisfaction

Procedia PDF Downloads 282

Authors: Dwi Endarti, Susi a Kristina, Rizki Noorizzati, Akbar E Nugraha, Fera Maharani, Kika a Putri, Asninda H Azizah, Sausanzahra Angganisaputri, Yunisa Yustikarini

Abstract:

Cost utility analysis is the most recommended pharmacoeconomic method since it allows widely comparison of cost-effectiveness results from different interventions. The method uses outcome of quality-adjusted life year (QALY) or disability-adjusted life year (DALY). Measurement of QALY requires the data of utility dan life years gained. Utility is measured with the instrument for quality of life measurement such as EQ-5D. Recently, the EQ-5D is available in two versions which are EQ-5D-3L and EQ-5D-5L. This study aimed to compare the EQ-5D-3L and EQ-5D-5L to examine the most suitable version for Indonesian population. This study was an observational study employing cross sectional approach. Data of quality of life measured with EQ-5D-3L and EQ-5D-5L were collected from several groups of population which were respondent with chronic diseases, respondent with acute diseases, and respondent from general population (without illness) in Yogyakarta Municipality, Indonesia. Convenience samples of hypertension patients (83), diabetes mellitus patients (80), and osteoarthritis patients (47), acute respiratory tract infection (81), cephalgia (43), dyspepsia (42), and respondent from general population (293) were recruited in this study. Responses on the 3L and 5L versions of EQ-5D were compared by examining the psychometric properties including agreement, internal consistency, ceiling effect, and convergent validity. Based on psychometric properties tests of EQ-5D-3L dan EQ-5D-5L, EQ-5D-5L tended to have better psychometric properties compared to EQ-5D-3L. Future studies for health related quality of life (HRQOL) measurements for pharmacoeconomic studies in Indonesia should apply EQ-5D-5L.

Keywords: EQ-5D, Health Related Quality of Life, Indonesian Population, Psychometric Properties

Procedia PDF Downloads 444

Authors: Kougioumtzis Konstantin, Rylander Pär, Karlsteen Magnus

Abstract:

Ball skills as a subset of fundamental motor skills are predictors for performance in sports. Currently, most tools evaluate ball skills utilizing subjective ratings. The aim of this study was to examine the psychometric properties of a newly developed instrument to objectively measure ball handling skills (BHS-test) utilizing digital instrument. Participants were a convenience sample of 213 adolescents (age M = 17.1 years, SD =3.6; 55% females, 45% males) recruited from upper secondary schools and invited to a sports hall for the assessment. The 8-item instrument incorporated both accuracy-based ball skill tests and repetitive-performance tests with a ball. Testers counted performance manually in the four tests (one throwing and three juggling tasks). Furthermore, assessment was technologically enhanced in the other four tests utilizing a ball machine, a Kinect camera and balls with motion sensors (one balancing and three rolling tasks). 3D printing technology was used to construct equipment, while all results were administered digitally with smart phones/tablets, computers and a specially constructed application to send data to a server. The instrument was deemed reliable (α = .77) and principal component analysis was used in a random subset (53 of the participants). Furthermore, latent variable modeling was employed to confirm the structure with the remaining subset (160 of the participants). The analysis showed good factorial-related validity with one factor explaining 57.90 % of the total variance. Four loadings were larger than .80, two more exceeded .76 and the other two were .65 and .49. The one factor solution was confirmed by a first order model with one general factor and an excellent fit between model and data (χ² = 16.12, DF = 20; RMSEA = .00, CI90 .00–.05; CFI = 1.00; SRMR = .02). The loadings on the general factor ranged between .65 and .83. Our findings indicate good reliability and construct validity for the BHS-test. To develop the instrument further, more studies are needed with various age-groups, e.g. children. We suggest using the BHS-test for diagnostic or assessment purpose for talent development and sports participation interventions that focus on ball games.

Keywords: ball-handling skills, ball-handling ability, technologically-enhanced measurements, assessment

Procedia PDF Downloads 61

Authors: Amani Kappi, Ana Maria Linares, Gia Mudd-Martin

Abstract:

Children with Attention Deficit Hyperactivity Disorder (ADHD) are more likely to develop social skills deficits that can lead to academic underachievement, peer rejection, and maladjustment. Surveying teachers about children's social skills with ADHD will become a significant factor in identifying whether the children will be diagnosed with social skills deficits. The teacher-specific version of the Social Skills Rating System scale (SSRS-T) has been used as a screening tool for children's social behaviors. The psychometric properties of the SSRS-T have been evaluated in various populations and settings, such as when used by teachers to assess social skills for children with learning disabilities. However, few studies have been conducted to examine the psychometric properties of the SSRS-T when used to assess children with ADHD. The purpose of this study was to examine the psychometric properties of the SSRS-T and two SSRS-T subscales, Social Skills and Problem Behaviors. This was a secondary analysis of longitudinal data from the Fragile Families and Child Well-Being Study. This study included a sample of 194 teachers who used the SSRS-T to assess the social skills of children aged 8 to 10 years with ADHD. Exploratory principal components factor analysis was used to assess the construct validity of the SSRS-T scale. Cronbach’s alpha value was used to assess the internal consistency reliability of the total SSRS-T scale and the subscales. Item analyses included item-item intercorrelations, item-to-subscale correlations, and Cronbach’s alpha value changes with item deletion. The results of internal consistency reliability for both the total scale and subscales were acceptable. The results of the exploratory factor analysis supported the five factors of SSRS-T (Cooperation, Self-control, Assertion, Internalize behaviors, and Externalize behaviors) reported in the original version. Findings indicated that SSRS-T is a reliable and valid tool for assessing the social behaviors of children with ADHD.

Keywords: ADHD, children, social skills, SSRS-T, psychometric properties

Procedia PDF Downloads 102

Authors: Eirini Petratou, Pezirkianidis Christos, Anastassios Stalikas

Abstract:

Nostalgia is characterized as a mental state of human’s emotional longing for the past that activates both positive and negative emotions. The bittersweet emotions that are activated by nostalgia aid psychological functions to humans and are depended on the type of stimuli that evoke nostalgia but also on the nostalgia activation context. In general, despite that nostalgia can be activated and experienced by all people; however, it differs both in terms of nostalgia experience but also nostalgia frequency. As a matter of fact, nostalgia experience along with nostalgia frequency differs according to the level of the nostalgia proneness. People with high nostalgia proneness tend to experience nostalgia more intensely and frequently than people with low nostalgia proneness. Nostalgia proneness is considered as a basic individual difference that affects the experience of nostalgia, and it can be measured by the Southampton Nostalgia Scale (SNS); a psychometric instrument that measures human’s nostalgia proneness consisting of seven questions that assess a person’s attitude towards nostalgia, the degree of experience or tendency to nostalgic feelings and the nostalgia frequency. In the current study, we translated, validated and calibrated the SNS in Greek population (N = 267). For the calibration process, we used several scales relevant to positive dimensions, such as life satisfaction, positive and negative emotions, time perspective and wellbeing. A confirmatory factor analysis revealed the factors that provide a good Southampton Nostalgia Proneness model fit for young adult Greek population.

Keywords: nostalgia proneness, nostalgia, psychometric instruments, psychometric properties

Procedia PDF Downloads 125

Authors: Alena Kulikova, Leonid Parmaksiz, Ekaterina Orel

Abstract:

Social and emotional skills are considered by modern researchers as predictors of a person's success both in specific areas of activity and in the life of a person as a whole. The popularity of this scientific direction ensures the emergence of a large number of practices aimed at developing and evaluating socio-emotional skills. Assessment of social and emotional development is carried out at the national level, as well as at the level of individual regions and institutions. Despite the fact that many of the already existing social and emotional skills assessment tools are quite convenient and reliable, there are now more and more new technologies and task formats which improve the basic characteristics of the tools. Thus, the goal of the current study is to develop a tool for assessing social and emotional skills such as emotion recognition, emotion regulation, empathy and a culture of self-care. To develop a tool assessing social and emotional skills, Rasch-Gutman scenario-based approach was used. This approach has shown its reliability and merit for measuring various complex constructs: parental involvement; teacher practices that support cultural diversity and equity; willingness to participate in the life of the community after psychiatric rehabilitation; educational motivation and others. To assess emotion recognition, we used a situational judgment task based on OCC (Ortony, Clore, and Collins) emotions theory. The main advantage of these two approaches compare to classical Likert scales is that it reduces social desirability in answers. A field test to check the psychometric properties of the developed instrument was conducted. The instrument was developed for the presidential autonomous non-profit organization “Russia - Land of Opportunity” for nationwide soft skills assessment among higher education students. The sample for the field test consisted of 500 people, students aged from 18 to 25 (mean = 20; standard deviation 1.8), 71% female. 67% of students are only studying and are not currently working and 500 employed adults aged from 26 to 65 (mean = 42.5; SD 9), 57% female. Analysis of the psychometric characteristics of the scales was carried out using the methods of IRT (Item Response Theory). A one-parameter rating scale model RSM (Rating scale model) and Graded Response model (GRM) of the modern testing theory were applied. GRM is a polyatomic extension of the dichotomous two-parameter model of modern testing theory (2PL) based on the cumulative logit function for modeling the probability of a correct answer. The validity of the developed scales was assessed using correlation analysis and MTMM (multitrait-multimethod matrix). The developed instrument showed good psychometric quality and can be used by HR specialists or educational management. The detailed results of a psychometric study of the quality of the instrument, including the functioning of the tasks of each scale, will be presented. Also, the results of the validity study by MTMM analysis will be discussed.

Keywords: social and emotional skills, psychometrics, MTMM, IRT

Procedia PDF Downloads 47

Authors: Akram Farhadi, Mahshid Froughan, Farahnaz Mohammadi, Maryam Rassouli, Maryam Noroozian, Leila Sadeghmoghaddam

Abstract:

Background: The caregivers’ assessment of their own caregiving is considered the most important concept in exploring their experiences and has a major role in care outcomes. The rising number of people with dementia and their need for care makes family caregiving really important matter to consider and evaluate. Objectives: This study was conducted with the aim to naturalize and validate the Persian version of the Revised Caregiving Appraisal Scale (RCAS) in family caregivers of older adults with dementia. Patients and Method: In this cross-sectional methodological study, the Revised Caregiving Appraisal Scale (RCAS) was translated using International Quality of Life Assessment (IQOLA) protocol, and then a panel of experts examined its face and content validities. To ensure construct validity, the translated Revised Caregiving Appraisal Scale (RCAS) was completed by 236 family caregivers, and factor construct of the scale was assessed with 5 initial factors using confirmatory factor analysis. Internal consistency was found using Cronbach's alpha, and test-retest using intraclass correlation coefficient. Confirmatory factor analysis was performed in LISREL-8.8 software in Windows®. Results: Participating caregivers' mean age was 53.5±13.13 years. Content and face validities of the scale were confirmed according to the views expressed by family caregivers and panel of experts. The confirmatory factor analysis (CFA) results showed appropriate values for all fitness indices (RMSEA=0.046, df/X2=2.428, CFI=0.98, AGFI=0.84, GFI=0.9), and the 5-factor model was confirmed with 27 items. Overall Cronbach's alpha was reported 0.894, and test retest showed overall ICC=0.94. Conclusion: The Persian version of RCAS is a valid and reliable tool for family caregivers' assessment of their caregiving of older adults with dementia, and can be useful in assessing family caregiving interventions.

Keywords: psychometric, family caregivers, reliability and validity, elderly, dementia, self-appraisal

Procedia PDF Downloads 201

Authors: Fadwa Alhalaiqa, Othman Alfuqaha, Anas H. Khalifeh, Mahmoud Alsaraireh, Rami Masa’Deh, Natija S Manaa

Abstract:

Background: Post-traumatic stress disorders (PTSD) usually occur after traumatic occurrences that exceed the range of common human experience. This study aimed to test the psychometric properties of PCL-5 checklist for the 20 PTSD symptoms from DSM-5 among Lebanese population and to identify the prevalence of PTSD. Methods: A cross sectional survey of PCL5 among 950 Lebanese using the online survey platform by Google form was conducted. Snowball recruitment was used to identify participants for the survey. STROBE guideline was used in reporting the current study. Results: Face content, construct, discriminant, and convergent validity had been accomplished of PCL-5. The reliability by Cronbach alpha, composite, and average variance extracted were set superior. We found also that more than half of the participants (55.6%) scored 33 or above, which is the cutoff score for a likely diagnosis of PTSD. Conclusion: The current study provides further support for the Arabic version PCL-5 validity and reliability among non-Western populations. This support using this tool in the screening of PTSD.

Keywords: post traumatic stress disorder, psychometric properties, stress, adult population

Procedia PDF Downloads 75

Authors: Dilek Saritas Atalar, Cansu Alsancak Akbulut, İrem Metin Orta, Feyza Yön, Zeynep Yenen, Joan Grusec

Abstract:

Objective: The aim of this study was to develop semi-structured Domains of Socialization Interview and its coding manual and to test their psychometric properties. Domains of Socialization Interview was designed to assess maternal awareness regarding effective parenting in five socialization domains (protection, mutual reciprocity, control, guided learning, and group participation) within the framework of the domains-of-socialization approach. Method: A series of two studies were conducted to develop and validate the interview and its coding manual. The pilot study, sampled 13 mothers of preschool-aged children, was conducted to develop the assessment tools and to test their function and clarity. Participants of the main study were 82 Turkish mothers (Xage = 34.25, SD = 3.53) who have children aged between 35-76 months (Xage = 50.75, SD = 11.24). Mothers filled in a questionnaire package including Coping with Children’s Negative Emotions Questionnaire, Social Competence and Behavior Evaluation-30, Child Rearing Questionnaire, and Two Dimensional Social Desirability Questionnaire. Afterward, interviews were conducted online by a single interviewer. Interviews were rated independently by two graduate students based on the coding manual. Results: The relationships of the awareness of effective parenting scores to the other measures demonstrate convergent, discriminant, and predictive validity of the coding manual. Intra-class correlation coefficient estimates were ranged between 0.82 and 0.90, showing high interrater reliability of the coding manual. Conclusion: Taken as a whole, the results of these studies demonstrate the validity and reliability of a new and useful interview to measure maternal awareness regarding effective parenting within the framework of the domains-of-socialization approach.

Keywords: domains of socialization, parenting, interview, assessment

Procedia PDF Downloads 155

Authors: Atara Shriki, Ilana Lavy

Abstract:

In a rapidly changing technological society, creativity is considered as an engine of economic and social progress. No doubt the education system has a central role in nurturing all students’ creativity, however, it is normally not encouraged at school. The causes of this reality are related to a variety of circumstances, among them: external pressures to cover the curriculum and succeed in standardized tests that mostly require algorithmic thinking and implementation of rules; teachers’ tendency to teach similarly to the way they themselves were taught as school students; relating creativity to giftedness, and therefore avoid nurturing all students' creativity; lack of adequate learning materials and accessible tools for following and evaluating the development of students’ creativity; and more. Since success in academic studies requires, among other things, creativity, lecturers in higher education institutions should consider appropriate ways to nurture students’ creative thinking and assess its development. Obviously, creativity has a multifaceted nature, numerous definitions, various perspectives for studying its essence (e.g., process, personality, environment, and product), and several approaches aimed at evaluating and assessing creative expressions (e.g., cognitive, social-personal, and psychometric). In this framework, we suggest nurturing students’ creativity through engaging them in problem posing activities that are part of inquiry assignments. In order to assess the development of their creativity, we propose to employ a model that was designed for this purpose, based on the psychometric approach, viewing the posed problems as the “creative product”. The model considers four measurable aspects- fluency, flexibility, originality, and organization, as well as a total score of creativity that reflects the relative weights of each aspect. The scores given to learners are of two types: (1) Total scores- the absolute number of posed problems with respect to each of the four aspects, and a final score of creativity; (2) Relative scores- each absolute number is transformed into a number that relates to the relative infrequency of the posed problems in student’s reference group. Through converting the scores received over time into a graphical display, students can assess their progress both with respect to themselves and relative to their reference group. Course lecturers can get a picture of the strengths and weaknesses of each student as well as the class as a whole, and to track changes that occur over time in response to the learning environment they had generated. Such tracking may assist lecturers in making pedagogical decisions about emphases that should be put on one or more aspects of creativity, and about the students that should be given a special attention. Our experience indicates that schoolteachers and lecturers in higher education institutes find the combination of engaging learners in problem posing along with self-assessment of their progress through utilizing the graphical display of accumulating total and relative scores has the potential to realize most learners’ creative potential.

Keywords: creativity, problem posing, psychometric model, self-assessment

Procedia PDF Downloads 281

Authors: Marina Charalambous, Phivos Phylactou, Thekla Elriz, Loukia Psychogios, Jean-Marie Annoni

Abstract:

Background: Evidence-based practices for the evaluation and treatment of people with aphasia (PWA) in Greek are mainly impairment-based. Functional and multimodal communication is usually under assessed and neglected by clinicians. This study explores the adaptation and psychometric testing of the Greek (GR) version of The Scenario Test. The Scenario Test assesses the everyday functional communication of PWA in an interactive multimodal communication setting with the support of an active communication facilitator. Aims: To define the reliability and validity of The Scenario Test GR and discuss its clinical value. Methods & Procedures: The Scenario Test-GR was administered to 54 people with chronic stroke (6+ months post-stroke): 32 PWA and 22 people with stroke without aphasia. Participants were recruited from Greece and Cyprus. All measures were performed in an interview format. Standard psychometric criteria were applied to evaluate reliability (internal consistency, test-retest, and interrater reliability) and validity (construct and known – groups validity) of the Scenario Test GR. Video analysis was performed for the qualitative examination of the communication modes used. Outcomes & Results: The Scenario Test-GR shows high levels of reliability and validity. High scores of internal consistency (Cronbach’s α = .95), test-retest reliability (ICC = .99), and interrater reliability (ICC = .99) were found. Interrater agreement in scores on individual items fell between good and excellent levels of agreement. Correlations with a tool measuring language function in aphasia (the Aphasia Severity Rating Scale of the Boston Diagnostic Aphasia Examination), a measure of functional communication (the Communicative Effectiveness Index), and two instruments examining the psychosocial impact of aphasia (the Stroke and Aphasia Quality of Life questionnaire and the Aphasia Impact Questionnaire) revealed good convergent validity (all ps< .05). Results showed good known – groups validity (Mann-Whitney U = 96.5, p < .001), with significantly higher scores for participants without aphasia compared to those with aphasia. Conclusions: The psychometric qualities of The Scenario Test-GR support the reliability and validity of the tool for the assessment of functional communication for Greek-speaking PWA. The Scenario Test-GR can be used to assess multimodal functional communication, orient aphasia rehabilitation goal setting towards the activity and participation level, and be used as an outcome measure of everyday communication. Future studies will focus on the measurement of sensitivity to change in PWA with severe non-fluent aphasia.

Keywords: the scenario test GR, functional communication assessment, people with aphasia (PWA), tool validation

Procedia PDF Downloads 104

Authors: Laith F. Gulli, Nicole M. Mallory

Abstract:

The undertaking to develop a psychometric instrument is monumental. Understanding the relationship between variables and events is important in structural and exploratory design of psychometric instruments. Considering this, we describe a method used to group, pair and combine multiple Philosophical Assumption statements that assisted in development of a 13 item psychometric screening instrument. We abbreviated our Philosophical Assumptions (PA)s and added parameters, which were then condensed and mathematically modeled in a specific process. This model produced clusters of combinatorics which was utilized in design and development for 1) information retrieval and categorization 2) item development and 3) estimation of interactions among variables and likelihood of events. The psychometric screening instrument measured Knowledge, Assessment (education) and Beliefs (KAB) of New Addictions Research (NAR), which we called KABNAR. We obtained an overall internal consistency for the seven Likert belief items as measured by Cronbach’s α of .81 in the final study of 40 Clinicians, calculated by SPSS 14.0.1 for Windows. We constructed the instrument to begin with demographic items (degree/addictions certifications) for identification of target populations that practiced within Outpatient Substance Abuse Counseling (OSAC) settings. We then devised education items, beliefs items (seven items) and a modifiable “barrier from learning” item that consisted of six “choose any” choices. We also conceptualized a close relationship between identifying various degrees and certifications held by Outpatient Substance Abuse Therapists (OSAT) (the demographics domain) and all aspects of their education related to EB-NAR (past and present education and desired future training). We placed a descriptive (PA)1tx in both demographic and education domains to trace relationships of therapist education within these two domains. The two perceptions domains B1/b1 and B2/b2 represented different but interrelated perceptions from the therapist perspective. The belief items measured therapist perceptions concerning EB-NAR and therapist perceptions using EB-NAR during the beginning of outpatient addictions counseling. The (PA)s were written in simple words and descriptively accurate and concise. We then devised a list of parameters and appropriately matched them to each PA and devised descriptive parametric (PA)s in a domain categorized information grid. Descriptive parametric (PA)s were reduced to simple mathematical symbols. This made it easy to utilize parametric (PA)s into algorithms, combinatorics and clusters to develop larger information grids. By using matching combinatorics we took paired demographic and education domains with a subscript of 1 and matched them to the column with each B domain with subscript 1. Our algorithmic matching formed larger information grids with organized clusters in columns and rows. We repeated the process using different demographic, education and belief domains and devised multiple information grids with different parametric clusters and geometric arrays. We found benefit combining clusters by different geometric arrays, which enabled us to trace parametric variables and concepts. We were able to understand potential differences between dependent and independent variables and trace relationships of maximum likelihoods.

Keywords: psychometric, parametric, domains, grids, therapists

Procedia PDF Downloads 247

Authors: David Ruiz, Carlos Nava, Roberto Carbajal

Abstract:

The psychological profile has become one of the most important sources of information when it comes to individual selection and the hiring process in any organization. Psychological instruments are used to collect data about variables that are considered critically important for performance in work. However, because of conceptual chaos in organizational psychology, most of the information provided by psychological testing is not directly useful for Mexican human resources professionals to take hiring decisions. The aims of this paper are 1) to underline the lack of conceptual precision in theoretical testing foundations in Mexico and 2) presenting a reliability and validity analysis of a frustration tolerance instrument created as an alternative to a heuristically conduct individual assessment in organizations. First, a description of assessment conditions in Mexico is made. Second, an instrument and a theoretical framework is presented as an alternative to the assessment practices in the country. A total of 65 Psychology Iztacala Superior Studies Faculty students were assessed. Cronbach´s alpha coefficient was calculated and an exploratory factor analysis was carried out to prove the scale unidimensionality. Reliability analysis revealed good internal consistency of the scale (Cronbach’s α = 0.825). Factor analysis produced 4 factors for the scale. However, factor loadings and explained variation give proof to the scale unidimensionality. It is concluded that the instrument has good psychometric properties that will allow human resources professionals to collect useful data. Different possibilities to conduct psychological assessment are suggested for future development.

Keywords: psychological assessment, frustration tolerance, human resources, organizational psychology

Procedia PDF Downloads 282

Authors: Kuni Vergauwen, Ivan P. J. Huijnen, Astrid Depuydt, Jasmine Van Regenmortel, Mira Meeus

Abstract:

A lower activity level and imbalanced activity pattern are frequently observed in persons with chronic fatigue syndrome (CFS) / myalgic encephalomyelitis (ME) due to debilitating fatigue and post-exertional malaise (PEM). Identification of measurement instruments to evaluate the activity level and pattern is therefore important. The objective is to identify measurement instruments suited to evaluate the activity level and/or pattern in patients with CFS/ME and review their psychometric properties. A systematic literature search was performed in the electronic databases PubMed and Web of Science until 12 October 2016. Articles including relevant measurement instruments were identified and included for further analysis. The psychometric properties of relevant measurement instruments were extracted from the included articles and rated based on the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. The review was performed and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. A total of 49 articles and 15 unique measurement instruments were found, but only three instruments were evaluated in patients with CFS/ME: the Chronic Fatigue Syndrome-Activity Questionnaire (CFS-AQ), Activity Pattern Interview (API) and International Physical Activity Questionnaire-Short Form (IPAQ-SF), three self-report instruments measuring the physical activity level. The IPAQ-SF, CFS-AQ and API are all equally capable of evaluating the physical activity level, but none of the three measurement instruments are optimal to use. No studies about the psychometric properties of activity monitors in patients with CFS/ME were found, although they are often used as the gold standard to measure the physical activity pattern. More research is needed to evaluate the psychometric properties of existing instruments, including the use of activity monitors.

Keywords: chronic fatigue syndrome, data collection, physical activity, psychometrics

Procedia PDF Downloads 199

Authors: Mai Alharthy, Agnes Shiel, Hynes Sinead

Abstract:

Objectives: The objectives of the study are to translate and culturally adapt the RBMT-3 to be appropriate for use within an Arabic-speaking population and to achieve maximum equivalency between the translated and original versions and to evaluate the psychometric properties of the Arabic version of the RBMT-3. Participants' numbers are 16 (10 females and 6 males). All participants are bilingual speakers of Arabic and English, above 18 years old and with no current nor past memory impairment. Methods: The study was conducted in two stages: Translation and cultural adaptation stage: Forward and backward translations were completed by professional translators. Five out of the 14 RBMT-3 subtests required cultural adaptations. Half of the faces in the face recognition subtests were replaced with Arabic faces by a professional photographer. Pictures that are irrelevant to the Arabic culture in the picture recognition subtests were replaced. Names, story and orientations subtests were also adapted to suit the Arabic culture. An expert committee was formed to compare the translated and original versions and to advise on further changes required for test materials. Validation of the Arabic RBMT-3- pilot: 16 Participants were tested on version 1 of the English version and the two versions of the Arabic RBMT-3 ( counterbalanced ). The assessment period was 6 weeks long, with two weeks gap between tests. All assessments took place in a quiet room in the National University of Ireland Galway. Two qualified occupational therapists completed the assessments. Results: Wilcox signed-rank test was used to compare between subtest scores. Significant differences were found in the story, orientation and names subtests between the English and Arabic versions. No significant differences were found in subtests from both Arabic versions except for the story subtest. Conclusion: The story and orientation subtests should be revised by the expert committee members to make further adaptations. The rest of the Arabic RBMT-3 subtests are equivalent to the subtests of the English version. The psychometric properties of the Arabic RBMT-3 will be investigated in a larger Arabic-speaking sample in Saudi Arabia. The outcome of this research is to provide clinicians and researchers with a reliable tool to assess memory problems in Arabic speaking population.

Keywords: memory impairment, neuropsychological assessment, cultural adaptation, cognitive assessment

Procedia PDF Downloads 221

Authors: Eric S. Lee, Connie Bygrave, Jordan Mahar, Naina Garg, Suzanne Cottreau

Abstract:

Marking exams is universally detested by lecturers. Final exams in many higher education courses often last 3.0 hrs. Do exams really need to be so long? Can we justifiably reduce the number of questions on them? Surprisingly few have researched these questions, arguably because of the complexity and difficulty of using traditional methods. To answer these questions empirically, we used a new approach based on three key elements: Use of an unusual variation of a true experimental design, equivalence hypothesis testing, and an expanded set of six psychometric criteria to be met by any shortened exam if it is to replace a current 3.0-hr exam (reliability, validity, justifiability, number of exam questions, correspondence, and equivalence). We compared student performance on each official 3.0-hr exam with that on five shortened exams having proportionately fewer questions (2.5, 2.0, 1.5, 1.0, and 0.5 hours) in a series of four experiments conducted in two classes in each of two finance courses (224 students in total). We found strong evidence that, in these courses, shortening of final exams to 2.0 hrs was warranted on all six psychometric criteria. Shortening these exams by one hour should result in a substantial one-third reduction in lecturer time and effort spent marking, lower student stress, and more time for students to prepare for other exams. Our approach provides a relatively simple, easy-to-use methodology that lecturers can use to examine the effect of shortening their own exams.

Keywords: exam length, psychometric criteria, synthetic experimental designs, test length

Procedia PDF Downloads 250