Search results for: validity studies

Authors: Helena Chytilova, Robin Maialeh

Abstract:

Experimental economics is subject to criticism with regards to frequently discussed trade-off between internal and external validity requirements, which seems to be critically flawed. Incompatibility of trade-off condition and condition of internal validity as a prerequisite for external validity is presented. In addition, the imprecise concept of artificiality found to be rather improving external validity, seems to strengthen illusory status of external versus internal validity tension. Internal validity will be further analysed with regards to Duhem-Quine problem, where unpredictability argument is significantly weakened trough application of inductivism within the illustrative hypothetical-deductive model. Discussion outlined above partially weakens critical arguments related to robustness of results in experimental economics, if perfectly controlled experimental environment is secured.

Keywords: Duhem-Quine problem, external validity, inductivism, internal validity

Procedia PDF Downloads 247

Authors: Anggi Permana, Zahrah Nabila Putri, Anisa Dwi Arifani, Veany Aprillia

Abstract:

This research aims to evaluate the validity of Zimbardo’s Stanford Time Perspective Inventory (STPI) in Indonesian context. The model of validity used in this study is the criterion-based validity, in which the associated variables are depression and subjective well-being (SWB). BDI (Beck Depression Inventory) was used to measure depression, while PANAS (Positive Affect and Negative Affect Scale) and SWLS (Satisfaction with Life Scale) were used to measure subjective well-being. The analysis showed that STPI variables are closely related to STPI Dimension, Present Hedonistic showed pro validity to SWB, Future indicated contra validity to SWB, and Present Fatalistic revealed contra validity to depression and pro validity to SWB. The subjects of this research are from the same university.

Keywords: BDI, PANAS, STPI, subjective well-being, SWLS

Procedia PDF Downloads 214

Authors: L. Freeborn

Abstract:

Recent years have seen an increasing number of neuroimaging studies related to language learning as imaging techniques such as fMRI and EEG have become more widely accessible to researchers. By using a variety of structural and functional neuroimaging techniques, these studies have already made considerable progress in terms of our understanding of neural networks and processing related to first and second language acquisition. However, the methodological designs employed in neuroimaging studies to test language learning have been questioned by applied linguists working within the field of second language acquisition (SLA). One of the major criticisms is that tasks designed to measure language learning gains rarely have a communicative function, and seldom assess learners’ ability to use the language in authentic situations. This brings the validity of many neuroimaging tasks into question. The fundamental reason why people learn a language is to communicate, and it is well-known that both first and second language proficiency are developed through meaningful social interaction. With this in mind, the SLA field is in agreement that second language acquisition and proficiency should be measured through learners’ ability to communicate in authentic real-life situations. Whilst authenticity is not always possible to achieve in a classroom environment, the importance of task authenticity should be reflected in the design of language assessments, teaching materials, and curricula. Tasks that bear little relation to how language is used in real-life situations can be considered to lack construct validity. This paper first describes the typical tasks used in neuroimaging studies to measure language gains and proficiency, then analyses to what extent these tasks can validly assess these constructs.

Keywords: neuroimaging studies, research design, second language acquisition, task validity

Procedia PDF Downloads 101

Authors: Gökhan Kayili, Ramazan Ari

Abstract:

In this research, it is aimed to be adapted Wally Feelings Test to Turkish children and performed the reliability and validity analysis of the test. The sampling of the research was composed of three to five year-old 699 Turkish preschoolers who are attending official and private nursery school. The schools selected with simple random sampling method by considering different socio economic conditions and different central district in Konya. In order to determine reliability of Wally Feelings Test, internal consistency coefficients (KR-20), split-half reliability and test- retest reliability analysis have been performed. During validation process construct validity, content/scope validity and concurrent/criterion validity were used. When validity and reliability of the test examined, it is seen that Wally Feelings Test is a valid and reliable instrument to evaluate three to five year old Turkish children’s understanding feeling skills.

Keywords: reliability, validity, wally feelings test, social sciences

Procedia PDF Downloads 495

Authors: İsmail Seçer

Abstract:

Although depression and anxiety disorders are considered to be adult disorders, the evidence obtained from several studies conducted recently shows that the roots of depression and anxiety disorders go back to childhood years. Thus, it is thought that analyzing depressive symptoms and anxiety disorders observed in the childhood is an important necessity. In the direction of the problem status of the study, the purpose of this study is to adapt anxiety and depression questionnaire for children into Turkish culture and analyze the psychometric characteristics of it on clinical and nonclinical samples separately. The study is a descriptive survey research. The study was conducted on two different sample groups, clinical and nonclinical. The clinical sample is formed of 205 individuals and the nonclinical sample is formed of 630 individuals. Through the study, anxiety and depression questionnaire for children, anxiety sensitivity index and obsessive compulsive disorder questionnaire for children were used. Experts’ opinions were asked to provide language validity of the scale. Confirmatory factor analysis and criterion-related validity to analyze construct validity and internal consistency and split-half reliability analyses were done for reliability. In the direction of experts’ opinions, construct validity of the scale was analyzed with simple confirmatory factor analysis and it was determined that the model fit of the two-factor structure of the scale gives good fit on both the clinical and nonclinical samples after determining that the language validity of the scale is provided. In criterion-related validity, it was determined that there are positive and significant relations between anxiety and depression questionnaire for children and anxiety sensitivity and obsessive compulsive disorder. The results of internal consistency and half-split reliability analyses also show that the scale has adequate reliability value. It can be said that depression and anxiety questionnaire for children which was adapted to determine depressive symptoms and anxiety disorders observed in childhood has adequate reliability and validity values and it can be used in future studies. It can be recommended that the psychometric characteristics of the scale can be analyzed and reported on new samples in the future studies.

Keywords: scale adapting, construct validity, confirmatory factor analysis, childhood depression

Procedia PDF Downloads 306

Authors: Hazaila Binti Hassan, Abu Yazid Bin Abu Bakar, Salleh Amat

Abstract:

This study is to get the validity and reliability of the questionnaire for behaviour change on low-performing officers. This study aimed to develop and evaluate the behaviour of low performing officers. There are 75 items in this questionnaire which involves 5 subscales, which are the 5 dimensions intended to be studied: 1st emotional stability, 2nd psycho-spiritual enhancement, 3rd social skills development, 4th cognitive and rationality improvement and 5th behavioural alignment and adjustment. There are 2 processes in this research whereby to check the validity and reliability. Both use quantitative methods. Validity content testing has been conducted to validate the behavioural change questionnaire of the low performing officers. For the face validity, 4 people are involved, two are psychologists who carried out the program and the other two are officers of the same rank, i.e. supporting officers. They are involved in correction of sentences, languages, and grammar as well as the sentence structures so that it tallies with the purpose of studies. The questionnaire underwent content validity by the experts. Five experts are appointed to attend this session, 3 are directly involved in the construction of this questionnaire and 2 others are experts from the university with a background in questionnaire development. The result shows that the content validity obtained a high coefficient of 0.745 with a minimum and maximum value of more than 0.60 which satisfies the characteristic of Content Value Ratio. The Cronbach’s alpha result is 0.867. The highest scores are the behavioural alignment and adjustment sub-scale recorded the highest value, followed by social skills development sub-scale, cognitive and rational improvements sub-scale, psycho-spiritual enhancement sub-scale, and lastly emotional stability. Therefore, both of validity and reliability result were accepted that this questionnaire is valid and reliable can be used in the study of behaviour changes of low performing officers in the civil service.

Keywords: content validity, reliability, five dimension, low-performing officers, questionnaire

Procedia PDF Downloads 241

Authors: A. Nazilah

Abstract:

Floods are classified among sudden onset phenomenon and the highest natural disasters happen in Malaysia. Floods have a negative impact on mental health. Measuring the psychopathology symptoms among flood victims is an important step for intervention and treatment. However, there is a gap of a valid, reliable and an efficient instrument to measure flood victims' mental health, especially in Malaysia. This study aims to replicate the earlier studies of developing e-Psychological Instrument for Flood Victims (e-PIFV). The e-PIFV is a digital self-report inventory that has 84 items with 4 dimension scales namely stress, anxiety, depression, and trauma. Two replicated studies have been done to validate the instrument using expert judgment method. Results showed that content coefficient validity for each sub-scale of the instrument ranging from moderate to very strong validity. In study I, coefficient values of stress was 0.7, anxiety was 0.9, depression was 1.0, trauma was 0.6 and overall was 0.8. In study II, the coefficient values for two subscales and overall scale were increased. The coefficient value of stress was 0.8, anxiety was 0.9, depression was 1.0, trauma was 0.8 and overall was 0.9. This study supports the theoretical framework and provides practical implication in the field of clinical psychology and flood management.

Keywords: developing e-psychological instrument, content validity, instrument, mental health management, flood victims, psychopathology, validity

Procedia PDF Downloads 97

Authors: Maggie Mosher, Adam Carreon, Sean Smith

Abstract:

A systematic literature review was conducted to explore the evidence base on the use of augmented reality (AR), virtual reality (VR), mixed reality (MR), and extended reality (XR) to present social skill instruction to school-age students with autism spectrum disorder (ASD). Specifically, the systematic review focus was on a. the participants and intervention agents using AR, VR, MR, and XR for social skill acquisition b. the social skills taught through these mediums and c. the social validity measures (i.e., goals, procedures, and outcomes) reported in these studies. Forty-one articles met the inclusion criteria. Researchers in six studies taught social skills to students through AR, in 27 studies through non-immersive VR, and in 10 studies through immersive VR. No studies used MR or XR. The primary targeted social skills were relationship skills, emotion recognition, social awareness, cooperation, and executive functioning. An intervention to improve many social skills was implemented by 73% of researchers, 17% taught a single skill, and 10% did not clearly state the targeted skill. The intervention was considered effective in 26 of the 41 studies (63%), not effective in four studies (10%), and 11 studies (27%) reported mixed results. No researchers reported information for all 17 social validity indicators. The social validity indicators reported by researchers ranged from two to 14. Social validity measures on the feelings toward and use of the technology were provided in 22 studies (54%). Findings indicated both AR and VR are promising platforms for providing social skill instruction to students with ASD. Studies utilizing this technology show a number of social validity indicators. However, the limited information provided on the various interventions, participant characteristics, and validity measures, offers insufficient evidence of the impact of these technologies in teaching social skills to students with ASD. Future research should develop a protocol for training treatment agents to assess the role of different variables (i.e., whether agents are customizing content, monitoring student learning, using intervention specific vocabulary in their day to day instruction). Sustainability may be increased by providing training in the technology to both treatment agents and participants. Providing scripts of instruction occurring within the intervention would provide the needed information to determine the primary method of teaching within the intervention. These variables play a role in maintenance and generalization of the social skills. Understanding the type of feedback provided would help researchers determine if students were able to feel rewarded for progressing through the scenarios or if students require rewarding aspects within the intervention (i.e., badges, trophies). AR has the potential to generalize instruction and VR has the potential for providing a practice environment for performance deficits. Combining these two technologies into a mixed reality intervention may provide a more cohesive and effective intervention.

Keywords: autism, augmented reality, social and emotional learning, social skills, virtual reality

Procedia PDF Downloads 76

Authors: A. V. Varfolomeeva, N. S. Tkachenko, A. G. Tishchenko

Abstract:

The problem of violation of internal validity in studies of psychological structures is considered. The role of epistemological attitudes of researchers in the planning of research within the methodology of the system-evolutionary approach is assessed. Alternative programs of psychological research involving representatives of different biological species are presented. On the example of the results of two research series the variants of solving the problem are discussed.

Keywords: epistemological attitudes, experimental design, validity, psychological structure, learning

Procedia PDF Downloads 85

Authors: Zhidong Zhang, Zhi-Chao Zhang

Abstract:

This study investigated the structural validity of externalizing issues of Achenbach System of Empirically Based Assessment (ASEBA) via a Chinese sample. The externalizing problems consist of two sub-problems: rule-breaking behavior and aggressive behavior. The rule-breaking behavior consists of 17 items, and aggressive behavior consists of 18 items. The factor analysis model was used to examine the structure validity. For the rule breaking behavior, at the first step, the most items weighted with component 2. After the rotation, there was a clear weight on both component 1 and 2. For the aggressive behavior, at the first step, there was no clear picture about the components. After the rotation, two clusters of items were closer to component 1 and 2 respectively. It seemed that both rule breaking behavior issue and aggressive behavior issue suggested two components. Further studies should be done to examine both samples and structures of externalizing problems.

Keywords: confirmatory analysis, externalizing issue, structural validity, varimax rotations

Procedia PDF Downloads 403

Authors: Sri Rejeki Dwi Astuti, Suyanta

Abstract:

The demanding of the asessment in learning process was impact by policy changes. Nowadays, the assessment not only emphasizes knowledge, but also skills and attitude. However, in reality there are many obstacles in measuring them. This paper aimed to describe how to develop instrument of integrated assessment as alternative assessment to measure critical thinking skills and science process skills in electrolyte solution and to describe instrument’s characteristic such as logic validity and construct validity. This instrument development used test development model by McIntire. Development process data was acquired based on development test step and was analyzed by qualitative analysis. Initial product was observed by three peer reviewer and six expert judgment (two subject matter expert, two evaluation expert and two chemistry teacher) to acquire logic validity test. Logic validity test was analyzed using Aiken’s formula. The estimation of construct validity was analyzed by exploratory factor analysis. Result showed that integrated assessment instrument has 0,90 of Aiken’s Value and all item in integrated assessment asserted valid according to construct validity.

Keywords: construct validity, critical thinking skills, integrated assessment instrument, logic validity, science process skills

Procedia PDF Downloads 234

Authors: Fakhrul Abedin Tanvir

Abstract:

This paper examines the validity of human intention for action, specifically focusing on unintentional actions that are unaffected by bias. Through the observation of a substantial number of individuals, estimated to be over 100, we investigate the power of human actions and their corresponding intentions. Given the underlying similarities in general thought processes and intentions among humans, it becomes possible to establish common patterns by observing a significant sample size. While this research provides observational results indicating a one-second validity of human intentions, it is important to note that these findings have not been scientifically proven. Nevertheless, this study contributes to the ongoing discourse by shedding light on participant expressions and experiences, furthering our understanding of human intentionality and action.

Keywords: human intention, bias, observation, validity

Procedia PDF Downloads 36

Authors: Binger Lu

Abstract:

It remains unclear whether second language (L2) speakers could use discourse context cues to predict upcoming information as native speakers do during online comprehension. Some researchers propose that L2 learners may have a reduced ability to generate predictions during discourse processing. At the same time, there is evidence that discourse-level cues are weighed more heavily in L2 processing than in L1. Previous studies showed that L1 prediction is sensitive to the global validity of predictive cues. The current study aims to explore whether and to what extent L2 learners can dynamically and strategically adjust their prediction in accord with the global validity of predictive cues in L2 discourse comprehension as native speakers do. In a self-paced reading experiment, Chinese native speakers (N=128), C-E bilinguals (N=128), and English native speakers (N=128) read high-predictable (e.g., Jimmy felt thirsty after running. He wanted to get some water from the refrigerator.) and low-predictable (e.g., Jimmy felt sick this morning. He wanted to get some water from the refrigerator.) discourses in two-sentence frames. The global validity of predictive cues was manipulated by varying the ratio of predictable (e.g., Bill stood at the door. He opened it with the key.) and unpredictable fillers (e.g., Bill stood at the door. He opened it with the card.), such that across conditions, the predictability of the final word of the fillers ranged from 100% to 0%. The dependent variable was reading time on the critical region (the target word and the following word), analyzed with linear mixed-effects models in R. C-E bilinguals showed reliable prediction across all validity conditions (β = -35.6 ms, SE = 7.74, t = -4.601, p< .001), and Chinese native speakers showed significant effect (β = -93.5 ms, SE = 7.82, t = -11.956, p< .001) in two of the four validity conditions (namely, the High-validity and MedLow conditions, where fillers ended with predictable words in 100% and 25% cases respectively), whereas English native speakers didn’t predict at all (β = -2.78 ms, SE = 7.60, t = -.365, p = .715). There was neither main effect (χ^²(3) = .256, p = .968) nor interaction (Predictability: Background: Validity, χ^²(3) = 1.229, p = .746; Predictability: Validity, χ^²(3) = 2.520, p = .472; Background: Validity, χ^²(3) = 1.281, p = .734) of Validity with speaker groups. The results suggest that prediction occurs in L2 discourse processing but to a much less extent in L1, witha significant effect in some conditions of L1 Chinese and anull effect in L1 English processing, consistent with the view that L2 speakers are more sensitive to discourse cues compared with L1 speakers. Additionally, the pattern of L1 and L2 predictive processing was not affected by the global validity of predictive cues. C-E bilinguals’ predictive processing could be partly transferred from their L1, as prior research showed that discourse information played a more significant role in L1 Chinese processing.

Keywords: bilingualism, discourse processing, global validity, prediction, self-paced reading

Procedia PDF Downloads 101

Authors: Nathakhun Wiroonsri

Abstract:

There are various cluster validity measures used for evaluating clustering results. One of the main objectives of using these measures is to seek the optimal unknown number of clusters. Some measures work well for clusters with different densities, sizes and shapes. Yet, one of the weaknesses that those validity measures share is that they sometimes provide only one clear optimal number of clusters. That number is actually unknown and there might be more than one potential sub-optimal option that a user may wish to choose based on different applications. We develop two new cluster validity indices based on a correlation between an actual distance between a pair of data points and a centroid distance of clusters that the two points are located in. Our proposed indices constantly yield several peaks at different numbers of clusters which overcome the weakness previously stated. Furthermore, the introduced correlation can also be used for evaluating the quality of a selected clustering result. Several experiments in different scenarios, including the well-known iris data set and a real-world marketing application, have been conducted to compare the proposed validity indices with several well-known ones.

Keywords: clustering algorithm, cluster validity measure, correlation, data partitions, iris data set, marketing, pattern recognition

Procedia PDF Downloads 76

Authors: Francisco Bolaños-Burgos, Antonio Cevallos Gamboa

Abstract:

The aim of this paper is to evaluate the validity of a literature review rubric in the Ecuadorian context at the graduate level. The sample was composed of 73 students of the online and on-site study format in the years 2015-2016. The instrument has 20 items (α=0.974) ranked in a 5-point Likert scale with six dimensions. The validity analysis was made by experts´ criterion. Findings evidenced that there is no significance difference between grades based on the study formats and that women write better than men. Furthermore, the students lacked to describe the limitation of their research and are good in writing: the research topic of the abstract, the conclusion in terms of the research objective and the citation norms (APA).

Keywords: literature review, rubric, validity, Ecuadorian context, graduate level

Procedia PDF Downloads 229

Authors: Young-Kwang Lee, Eun-Gu Ji, Min-Joo Kim, Seung-Jae Oh

Abstract:

The purpose of this study is to develop a social participation activity scale for the elderly. As a result of exploratory factor analysis, confirmatory factor analysis was conducted using maximum likelihood method using bundled items. In conclusion, thirteen items of social participation activity scale seemed appropriate. Finally, convergent validity and discriminant validity were verified on the scale with the fit. The convergent validity was based on the variance extracted value. In other words, the hypothesis that the variables are the same is rejected and the validity is confirmed. This study extensively considered the measurement items of the social participation activity scale used to measure social participation activities of the elderly. In the future, it will be meaningful that it can be used as a tool to verify the effectiveness of services in organizations that provide social welfare services to elderly people such as comprehensive social welfare centers and the elderly comprehensive social welfare centers.

Keywords: elderly, social participation, scale development, validity

Procedia PDF Downloads 146

Authors: Phoutsathaphone Sibounheuang, Phayom Sookaneknun Olson, Chanuttha Ploylearmsang, Santiparp Sookaneknun, Chanthanom Manithip

Abstract:

Patient satisfaction is an outcome that can be measured and used to improve diabetes care and management. There are limited instruments for assessing patient satisfaction covering the whole process of diabetes management. In this study, the questionnaire was developed with items pooled from a systematic review of qualitative studies of patients’ and healthcare providers’ perspectives in diabetes management. The questionnaire consists of 11 domains with 45 items. The Thai version was translated to Lao and then checked by back-translating it into Thai. We tested the questionnaire on 150 diabetes patients in Thailand and 150 in Lao People Democratic Republic (PDR). Validity was performed by factor analysis and Pearson correlation. Internal consistency reliability was estimated by calculating Cronbach’s alpha. The study was approved by the Mahasarakham University Ethics Committee, and the National Ethics Committee for Health Research, Lao PDR. The Thai and Lao versions showed the construct validity by principal component analysis. This consisted of 11 domains which account for 71.23% of the variance (Thai version) and 71.66% of the variance (Lao version) in the total patient satisfaction scores. The Kaiser-Meyer-Olkin (KMO) measures were 0.85 for the Thai version and 0.75 for the Lao version. The Bartlett tests of sphericity of both versions were significant (p < 0.001). The factor loadings of all items in both versions were > 0.40. The convergent validity of the Thai and Lao versions was 93.63% and 79.54% respectively. The discriminant validity for the Thai and Lao versions was 92.68% and 88.68% respectively. Cronbach’s alpha was 0.95 in both versions. The Patient Satisfaction Questionnaire (PSQ) in both versions had acceptable properties. This study has yielded evidence supporting the validity and reliability of both versions.

Keywords: construct validity, diabetes management, patient satisfaction, questionnaire development, reliability

Procedia PDF Downloads 109

Authors: Lida Moghaddam-Banaem, Mahmood Tavoosi, Soheila Khalili

Abstract:

Objective: The main objective of this study was designing a breast cancer health literacy questionnaire and assess its psychometric properties. Methods: A comprehensive literature review was performed to develop a primary questionnaire consisting of five domains. Qualitative and quantitative content validity were assessed by relevant experts, and after some modifications, the content validity index (CVI) and content validity ratio (CVR) were calculated. Qualitative and quantitative face validity were evaluated by a number of patients, and the impact score for each item was calculated. 225 women with breast cancer were asked to fill out the questionnaire and construct validity was determined by using exploratory factor analysis. The reliability was tested by Cronbach's alpha coefficient. Results: A 36-item questionnaire with five domains of reading, having access, understanding, assessing/judgment, and decision making/behavior was designed. 2 items were omitted in the qualitative content validity process. All items achieved optimum values in CVI, CVR and impact scores. Content and face validity of the questionnaire were confirmed too. According to the exploratory factor analysis, the five-factor solution accounted for 64.98 percent of the observed variance. Conclusion: Due to the obtained satisfactory validity and reliability, this tool can be used to assess health literacy in women with breast cancer. Health policy makers can use these findings for improving health-related behaviors in breast cancer patients.

Keywords: health literacy, breast cancer, questionnaire, psychometric properties

Procedia PDF Downloads 200

Authors: S. J. Yune, K. H. Park

Abstract:

The purpose of this study was to examine the validity of the research process for enhancing the humanities competence of the medical students. The research process was developed to be operated as a core subject course of 3 semesters. Among them, the research process for enhancing humanities capacity consisted of humanities and societies (6 teams) and education-psychology (2teams). The subjects of this study were 88-second grade students and 22 professors who participated in the research process. Among them, 13 professors participated in the study of humanities and 37 students. In the validity test, the professors were more likely to have more validity in the research process than the students in all areas of logic (p = .001), influence (p = .037), process (p = .001). The validity of the professor was higher than that of the students. The professors highly evaluated the students' learning outcomes and showed the most frequency to the prize group. As a result of analyzing the agreement between the students and the professors through the Kappa coefficient, the agreement degree of communication and cooperation competence was moderate to .430. Problem-solving ability was .340, which showed a fair degree of agreement. However, other factors showed only a slight degree of agreement of less than .20.

Keywords: research process, medical school, humanities competence, validity verification

Procedia PDF Downloads 146

Authors: Barbara Erjauz, Juliane Eichhorn

Abstract:

Background and Purpose: The world´s population is rapidly aging, wherefore the World Health Organization (WHO) is dealing with concepts of Age-Friendly-Communities and criteria to define them. Also in Germany, we can find an aging population and a large amount of seniors is living in rural areas. Those regions are defined by unique social and environmental characteristics, which can enhance or decrease age-friendliness. To identify and work with these characteristics, we are in need of appropriate assessment instruments. To the author’s best knowledge until now, no instrument could be identified as suitable and scientifically proven for the German speaking area. The aim of the study was to identify an assessment instrument to measure the age-friendliness of rural communities and its psychometric testing regarding the content validity. Methods: A literature search was carried out to identify instruments related to concepts of Age-Friendly-Communities. According to the German situation, an instrument was chosen and modified based on a Delphi-study. In this context, the content validity was investigated by calculating the Content Validity Index (CVI). Results: An instrument consisting of 86 items based on WHO indicators and the German situation in rural areas was created. 43 items (50%) had a Content Validity Index for Items (I-CVI) of 1,00, 37 items (43%) had an I-CVI of >0,78 and > 1.00, and 6 items had an I-CVI of >0,78. The value of the Content Validity Index for Scales, averaging calculation method (S-CVI/Ave) for the entire scale was 0,91. Conclusions: The results indicate a good content validity and it can be concluded that the created instrument represents the phenomenon of age-friendliness in rural areas. Nevertheless, further psychometric testing related to reliability, validity and responsiveness is recommended.

Keywords: assessment, age-friendly, rural, psychometric testing

Procedia PDF Downloads 193

Authors: D. Reich, R. Stark

Abstract:

To provide reliable and valid findings when evaluating innovative in-car devices in the automotive context highly realistic driving environments are recommended. Nowadays, in-car devices are mostly evaluated due to driving simulator studies followed by real car driving experiments. Driving simulators are characterized by high internal validity, but weak regarding ecological validity. Real car driving experiments are ecologically valid, but difficult to standardize, more time-robbing and costly. One economizing suggestion is to implement more immersive driving environments when applying driving simulator studies. This paper presents research comparing non-immersive standard PC conditions with mobile and highly immersive Oculus Rift conditions while performing the Lane Change Task (LCT). Subjective data with twenty participants show advantages regarding presence and immersion experience when performing the LCT with the Oculus Rift, but affect adversely cognitive workload and simulator sickness, compared to non-immersive PC condition.

Keywords: immersion, oculus rift, presence, situation awareness

Procedia PDF Downloads 147

Authors: Stanley Yap Peng Lok, Chong Wei Ying, Leow Hon Wei, Fatemeh Kimiyaghalam

Abstract:

Purpose: This paper examines how people treat on the importance of financial planning for their retirement. There is lack of standard instrument that enable us to access the retirement planning behavior. This paper studies the reliability and validity of a proposed scale for accessing this behavior. Design/methodology/approach: The Retirement Planning Behavior scale (RPB) is developed from the results of reviewing different papers on this topic. A total of 900 Malaysians from the age of 18 and above are used as the sample. Findings: Our results show, firstly, the RPB meets all criteria from the instrument reliability and validity which based on the theory of planned behavior. Second, our findings propose two components for this RPB scale; attitude toward planning for retirement and intention towards retirement planning behavior. Practical implication: An effective retirement planning achieves financial independence after the retirement. Our findings have important implications for the scope and significance of the retirement planning behavior measurement, especially for retirees. Originality/value: This study proposes a new approach to cater consumers’ needs for retirement planning. Therefore, consumers are able to achieve financial independence in their retirement age.

Keywords: retirement planning behavior (RPB) scale, reliability, validity, retirement planning, financial independence

Procedia PDF Downloads 371

Authors: Ayşegül Bilge, Merve Uğuryol, Şeyda Dülgerler, Mustafa Yıldız

Abstract:

The purpose of this research is to prove the Attitude towards Using Complementary Treatments Scale reliability and validity. The research is a methodological type of research that has been planned to determine the validity and reliability of the Attitude towards Using Complementary Treatments Scale. The scale has been developed by the researchers. In the scale, there are 23 questions including complementary and modern therapies individuals apply when they have health problems 4-item Likert-type evaluation has been carried out in preparing the questionnaire. High score obtained from the scale indicates a positive attitude towards complementary therapies. In the course of validity assessment of the scale, expert opinion has been received, and the content validity of the scale has been determined by using Kendall coefficient correlation test (Wa=0.200, p = 0.460). In the course of the reliability assessment of the scale, total score correlations of 23 materials have been examined, and those under 0.20 correlation limit has been removed from the scale correlation. As a result, the scale was left to be 13 items. In the internal consistency tests of the analyses, Cronbach's alpha value has been found to be 0.79. As a result, of the validity analyses of the Attitude towards Using Complementary Treatments Scale, the content and language validity analyses has been found to be at the expected level. It has been determined to be a highly reliable scale as the result of the reliability analyses. In conclusion, Attitude towards Using Complementary Treatments Scale is a valid and reliable scale.

Keywords: alternative health care, complementary treatment, instrument development, nursing practice

Procedia PDF Downloads 361

Authors: Jorn Meyer, Stefan Sturmer

Abstract:

The assessment of attachment patterns in toddlers and adults has been well researched, and valid diagnostic methods (e.g., Strange Situation Test, Adult Attachment Interview) are applicable. For middle and late childhood, on the other hand, there are only few validated methods available so far. For the Child Attachment Interview (CAI) promising validation studies from English-speaking countries are available, but so far a comprehensive study on the validity of a German sample is lacking. Within the scope of a longitudinal project, the results of the first point of measurement are reported in this study. A German-language version of the CAI was carried out with 111 primary school children (56% female; age: M = 8.34, SD = 0.49). In relation to psychometric quality criteria, parameters on interrater reliability, construct validity and discriminant, and convergent validity are reported. Analyses of the correlations between attachment patterns and internalizing and externalizing behavior problems from parent and teacher reports are presented. The implications for the German-language assessment of attachment in middle and late childhood in research and individual case diagnostics, e.g., in the context of conducting expert evaluation reports for family courts, are discussed.

Keywords: attachment, attachment assessment, developmental psychology, longitudinal study

Procedia PDF Downloads 202

Authors: Rylle Evan Gabriel Zamora, Micah Dennise Malia, Abygail Deniese Villabona

Abstract:

When examining studies on aggression, the studies about individual aggression vastly outnumbers those studies on group aggression. Given the nature of aggression to be violent and cyclical, and the amount violent events that have occurred in the near present, the study of group aggression is relevant now more than ever. This discrepancy is parallel with the number of valid and reliable psychological tests that measure group aggression. Throughout history, one of the biggest causes of group based violence and aggression is religion. This is particularly true within the context of the Philippines as there are a large number of religious groups. Thus, this study aimed to develop a standardized test that measures an individual’s tendency to be aggressive to those who are in conflict with his or her religious beliefs. This study employs a test development design that employs a qualitative phase to ensure the validity of the scale. Thus, the study was divided into three phases. First is a pilot test wherein an instrument was designed from existing literature which was then administered to 173 respondents from the four largest religious groups in the Philippines. After extensive factor analysis and reliability testing, new items were then formed from the qualitative data collected from eight participants, consisting of two individuals per religious group. The final testing integrates all statistically significant items from the first phase, and the newly formed items from the second phase, which was then administered to 200 respondents. The results were then tested further for reliability using Cronbach’s alpha and validity through factor analysis. The items that were proven to be significant were then combined to create a final instrument that may be used by future studies.

Keywords: religious aggression, group aggression, test development, psychological assessment, social psychology

Procedia PDF Downloads 259

Authors: Chih Hung Shih

Abstract:

Eyewitness identification is one of the efficient information to identify suspects during criminal investigation. However eyewitness identification is improved frequently, inaccurate and plays vital roles in wrongful convictions. Most eyewitness misidentifications are made during police criminal investigation stage and then accepted by juries. Four failure investigation case studies in Taiwan are conduct to demonstrate how misidentifications are caused during the police investigation context. The result shows that there are several common grounds among these cases: (1) investigators lacked for knowledge about eyewitness memory so that they couldn’t evaluate the validity of the eyewitnesses’ accounts and identifications, (2) eyewitnesses were always asked to filter out several suspects during the investigation, and received investigation information which contaminated the eyewitnesses’ memory, (3) one to one live individual identifications were made in most of cases, (4) eyewitness identifications were always used to support the hypotheses of investigators, and exaggerated theirs powers when conform with the investigation lines, (5) the eyewitnesses’ confidence didn’t t reflect the validity of their identifications , but always influence the investigators’ beliefs for the identifications, (6) the investigators overestimated the power of the eyewitness identifications and ignore the inconsistency with other evidence. Recommendations have been proposed for future academic research and police practice of eyewitness identification in Taiwan.

Keywords: criminal investigation, eyewitness identification, investigative bias, investigative failures

Procedia PDF Downloads 209

Authors: Nurfirdawati Muhamad Hanafi, Azmanirah Ab Rahman, Marina Ibrahim Mukhtar, Jamil Ahmad, Sarebah Warman

Abstract:

This study was conducted to generate empirical evidence on validity and reliability of the item of Competency Assessment Implementation (CAI) Instrument using Rasch Model for polythomous data aided by Winstep software version 3.68. The construct validity was examined by analyzing the point-measure correlation index (PTMEA), in fit and outfit MNSQ values; meanwhile the reliability was examined by analyzing item reliability index. A survey technique was used as the major method with the CAI instrument on 156 teachers from vocational schools. The results have shown that the reliability of CAI Instrument items were between 0.80 and 0.98. PTMEA Correlation is in positive values, in which the item is able to distinguish between the ability of the respondent. Statistical data obtained shows that out of 154 items, 12 items from the instrument suggested to be omitted. This study is hoped could bring a new direction to the process of data analysis in educational research.

Keywords: competency assessment, reliability, validity, item analysis

Procedia PDF Downloads 401

Authors: Marina Charalambous, Phivos Phylactou, Thekla Elriz, Loukia Psychogios, Jean-Marie Annoni

Abstract:

Background: Evidence-based practices for the evaluation and treatment of people with aphasia (PWA) in Greek are mainly impairment-based. Functional and multimodal communication is usually under assessed and neglected by clinicians. This study explores the adaptation and psychometric testing of the Greek (GR) version of The Scenario Test. The Scenario Test assesses the everyday functional communication of PWA in an interactive multimodal communication setting with the support of an active communication facilitator. Aims: To define the reliability and validity of The Scenario Test GR and discuss its clinical value. Methods & Procedures: The Scenario Test-GR was administered to 54 people with chronic stroke (6+ months post-stroke): 32 PWA and 22 people with stroke without aphasia. Participants were recruited from Greece and Cyprus. All measures were performed in an interview format. Standard psychometric criteria were applied to evaluate reliability (internal consistency, test-retest, and interrater reliability) and validity (construct and known – groups validity) of the Scenario Test GR. Video analysis was performed for the qualitative examination of the communication modes used. Outcomes & Results: The Scenario Test-GR shows high levels of reliability and validity. High scores of internal consistency (Cronbach’s α = .95), test-retest reliability (ICC = .99), and interrater reliability (ICC = .99) were found. Interrater agreement in scores on individual items fell between good and excellent levels of agreement. Correlations with a tool measuring language function in aphasia (the Aphasia Severity Rating Scale of the Boston Diagnostic Aphasia Examination), a measure of functional communication (the Communicative Effectiveness Index), and two instruments examining the psychosocial impact of aphasia (the Stroke and Aphasia Quality of Life questionnaire and the Aphasia Impact Questionnaire) revealed good convergent validity (all ps< .05). Results showed good known – groups validity (Mann-Whitney U = 96.5, p < .001), with significantly higher scores for participants without aphasia compared to those with aphasia. Conclusions: The psychometric qualities of The Scenario Test-GR support the reliability and validity of the tool for the assessment of functional communication for Greek-speaking PWA. The Scenario Test-GR can be used to assess multimodal functional communication, orient aphasia rehabilitation goal setting towards the activity and participation level, and be used as an outcome measure of everyday communication. Future studies will focus on the measurement of sensitivity to change in PWA with severe non-fluent aphasia.

Keywords: the scenario test GR, functional communication assessment, people with aphasia (PWA), tool validation

Procedia PDF Downloads 100

Authors: Cao Xi

Abstract:

This paper reports a study which used eye-tracking to examine the cognitive validity of TEM 8(Test for English Majors, Band 8). The study investigated test takers' reading patterns on four -item types using eye-tracking, and interviews. Thirty participants completed 22 items on a computer, with the Tobii X2 Eye Tracker recording their eye movements on screen. Eleven students further participated in a recall interview while viewing video footage of their gaze patterns on the test. The findings will indicate that first, different reading item types will employ different cognitive processes; then different reading patterns for stronger and weaker test takers’on each item types. The implication of this study is to provide recommendations for the use of eye tracking technology in language research.

Keywords: eye tracking, reading patterns, test for english majors, cognitive validity

Procedia PDF Downloads 115

Authors: Natcha Lueangapapong, Chariya Chuthapisith, Lunliya Thampratankul

Abstract:

Background: There is a need to find an appropriate tool to help healthcare providers determine sleep problems in children for early diagnosis and management. The Japanese Sleep Questionnaire for Preschoolers (JSQ-P) is a parent-reported sleep questionnaire that has good psychometric properties and can be used in the context of Asian culture, which is likely suitable for Thai children. Objectives: This study aimed to translate and validate the Japanese Sleep Questionnaire for Preschoolers (JSQ-P) into a Thai version and to evaluate factors associated with sleep disorders in preschoolers. Methods: After approval by the original developer, the cross-cultural adaptation process of JSQ-P was performed, including forward translation, reconciliation, backward translation, and final approval of the Thai version of JSQ-P (TH-JSQ-P) by the original creator. This study was conducted between March 2021 and February 2022. The TH-JSQ-P was completed by 2,613 guardians whose children were aged 2-6 years twice in 10-14 days to assess its reliability and validity. Content validity was measured by an index of item-objective congruence (IOC) and a content validity index (CVI). Face validity, content validity, structural validity, construct validity (discriminant validity), criterion validity and predictive validity were assessed. The sensitivity and specificity of the TH-JSQ-P were also measured by using a total JSQ-P score cutoff point 84, recommended by the original JSQ-P and each subscale score among the clinical samples of obstructive sleep apnea syndrome. Results: Internal consistency reliability, evaluated by Cronbach’s α coefficient, showed acceptable reliability in all subscales of JSQ-P. It also had good test-retest reliability, as the intraclass correlation coefficient (ICC) for all items ranged between 0.42-0.84. The content validity was acceptable. For structural validity, our results indicated that the final factor solution for the Th-JSQ-P was comparable to the original JSQ-P. For construct validity, age group was one of the clinical parameters associated with some sleep problems. In detail, parasomnias, insomnia, daytime excessive sleepiness and sleep habits significantly decreased when the children got older; on the other hand, insufficient sleep was significantly increased with age. For criterion validity, all subscales showed a correlation with the Epworth Sleepiness Scale (r = -0.049-0.349). In predictive validity, the Epworth Sleepiness Scale was significantly a strong factor that correlated to sleep problems in all subscales of JSQ-P except in the subscale of sleep habit. The sensitivity and specificity of the total JSQ-P score were 0.72 and 0.66, respectively. Conclusion: The Thai version of JSQ-P has good internal consistency reliability and test-retest reliability. It passed 6 validity tests, and this can be used to evaluate sleep problems in preschool children in Thailand. Furthermore, it has satisfactory general psychometric properties and good reliability and validity. The data collected in examining the sensitivity of the Thai version revealed that the JSQ-P could detect differences in sleep problems among children with obstructive sleep apnea syndrome. This confirmed that the measure is sensitive and can be used to discriminate sleep problems among different children.

Keywords: preschooler, questionnaire, validation, Thai version

Procedia PDF Downloads 55