The method yields interval estimates of these coefficients in a construct validation study conducted via the multitraitmultimethod approach, as well as permits. Discriminant validity isreached if the ave estimate for a factor is greater than the. It is designed to measure the particular construct like the intelligence etc is actually measuring the construct. And it can be answered by listing the features that the two items have in common, where both might be used to write, have the same shapes, and likewise in. Twenty items from three competenciessocial competencies, communication competencies, and technical competencieswere. Confirmatory factor analysis investigated the convergent and discriminant validities of teacher, child, and peer reports of teacher student support and child conduct. In research, there are three ways to approach validity and they include. Higher measures of convergent validity are average variance explained and factor loadings. If you are unsure what construct validity is, we recommend you first read. For eg you are measuring the level of depression among the college students and in order to measure it, you use the two measurements like the survey and participant. A multilevel multitraitmultimethod analysis cora j. Convergent and discriminant validation by the multitrait.
Convergent and discriminant validity are both considered subcategories or subtypes of construct validity. Confirmatory factor analysis cfa is used frequently to analyze. They stressed the importance of using both discriminant and convergent validation techniques when assessing new tests. The method uses ordinary leastsquares regression ols with the correlations between measures as the depen dent variable. Factor analysis metaanalysis discriminant validity degree to which an instrument does not measure other constructs logic. Second, a validity diagonal value should be higher than the values lying in its column and row in. Convergent and discriminant validity of three measures of. Construct validity examination of critical thinking. Thus, a researcher interested in rumination as a personality trait might present correlations indicating that her new measure correlates r. In order to establish the construct validity, we need to show that both convergent and discriminant validity are demonstrated. The point of a factor analysis is to show that you have distinct constructs discriminant validity that each measures a single thing convergent validity, and that are. In this video i demonstrate a new excel tool ive developed for quickly creating a factor correlation matrix and validity table using the output from amos. Convergent and discriminant validity were tested using both an examination of observed correlations and confirmatory factor analysis cfa.
A number of factoranalytic procedures have been suggested for assessing convergent and discriminant validity. The personality assessment inventoryantisocial features. The results indicate clear convergence and divergence of the reflective indicators along construct lines as shown below in table 1. An examination of the factor, convergent, and discriminant validity.
Factor analysis, either efa or cfa are techniques that can be used to find or not find support. Goodman, 1997 with a sample of firstgrade children at risk for educational failure. Racial and gender differences were relatively small for both instruments. They discussed validity including the traditional division of construct validity evidence convergent and discriminant evidence, criterion. Campbell and fiske 1959 introduced the concept of discriminant validity within their discussion on evaluating test validity. Henseler facultyofengineeringtechnology,universityoftwente,enschede.
Based on the results obtained, it seems that the pcq is a suitable valid and reliable instrument for measuring psycap. Cole 1987 indicated that confirmatory factor analysis can determine whether factors are redundant with one another and can address both convergent and discriminant validity, whereas exploratory factor analysis only addresses convergent validity. Assessing convergent and discriminant validity in the adhdr. The convergent validity is the subtype of the construct validity. Testing the convergent and discriminant validity of the. Convergent and discriminant validity and common method bias. Convergent validity helps to establish construct validity when you use two different measurement procedures and research methods e. This study examined the factor structure of the parent and teacher versions of the strengths and difficulties questionnaire sdq. The method uses ordinary leastsquares regression ols with the correlations between measures as the dependent variable. This shows that the latent variables under study faced the. The classical multitraitmultimethod mtmm matrix can be viewed as a twodimensional crossclassi.
These results support the construct validity of the ipip. In the context of this study, method refers to each of the measures i. Are these two policing philosophies are being implemented as separate and distinct strategies. A model with five correlated trait factors and two method factors provided the best fit to the data. Lehmann columbia university this paper presents a simple procedure for estab lishing convergent and discriminant validity. Support for convergent and discriminant validity was also found. Convergent and discriminant validity for the revised scales were not. Validity refers to the extent that the instrument measures what it was designed to measure. In the convergent validity, the issue is seen as having only one answer and the whole line of thinking shall eventually lead to a single answer by utilizing the previous knowledge and logic.
Second, a validity diagonal value should be higher than the values lying in its column and row in the heterotraitheteromethod triangles. Lehmann columbia university this paper presents a simple procedure for establishing convergent and discriminant validity. The correlations among the observed measures showed that the convergent validity coefficients were generally large, whereas the discriminant validity coefficients were moderate to small. This requirement is evidence of convergent validity. How can i carry out convergent and discriminant validity. Conducting a discriminant analysis in spss youtube. They completed computerized and paper versions of the questionnaire on 3 occasions over 2 years.
Learn to conduct divergent discriminant validity in r with data from the opinions and lifestyle survey, wellbeing module aprilmay 2015 implementing factor analysis. Using factor analysis to identify underlying constructs part 1. The 5 factor model previously found in studies using exploratory factor analysis was fit to the data for both parent and teacher questionnaires. Estimating and evaluating convergent and discriminant validity evidence. Assessing convergent and discriminant validity of the motivation. In press, british journal of mathematical and statistical. Convergent validity coefficients indicate correlations between the scores of the same trait using heteromethods. The 5factor model previously found in studies using exploratory factor analysis was fit to the data for both parent and teacher questionnaires. Testing the convergent and discriminant validity of the decisional. The word of construct shows a theoretical viewpoint to explain some phenomenon wiersma, 2000. Urica, rcq and socrates, while trait refers to each of the constructs measured by the. Confirmatory factor analysis and correlations were used to examine the factor structure and convergent and discriminant validity of the bcfqol scale. From the analysis, the convergent, divergent and discriminant validity were established and admissible using fornell and larcker criterion. Fiske proposed a way of test validation based on the idea that it is not sufficient to consider a single operationalization of a construct but that multiple measures are necessary.
Reliability refers to the extent that the instrument yields the same results over multiple trials. A new criterion for assessing discriminant validity. Subsequent testing confirmed discriminant validity between the factors and convergent. Convergent validity degree to which an instrument measures the concept or construct it is intended to measure cronbachs.
An examination of the convergent and discriminant validity. Convergent validity is problematic as various measures of impulsivity e. Convergent validity of a factor is reached if all standardized loadings of items are significant and higher than 0. Assessing convergent and discriminant validity in the adhd. Discriminant validity or divergent validity tests that constructs that should have no relationship do, in. An mtmm correlation matrix an mtmm correlation matrix of the variables under consideration was examined. Using factor analysis to identify underlying constructs part 3. Convergent validity means two measures of constructs that theoretically should be related, are in fact related. Convergent validity and discriminant validity are commonly regarded as subsets of construct validity. Dec 09, 2011 in this video i demonstrate a new excel tool ive developed for quickly creating a factor correlation matrix and validity table using the output from amos.
Convergent and discriminant validity of a naturalistic. The point of a factor analysis is to show that you have distinct constructs discriminant validity that each measures a single thing convergent validity, and that are reliable reliability. These caregivers completed the bcfqol scale and external validity measures of family outcomes, psychological distress, and life situation. Convergent validity helps to establish construct validity when you use two different measurement procedures and research. Hierarchical confirmatory factor analysis multitrait multimethod approach hcfa mtmm was used with data from 2,334 uk adolescents, both smokers and nonsmokers. Convergent and discriminant validities are two fundamental aspects of construct validity. Using confirmatory factor analysis, we demonstrated that family adaptability, cohesion, and talkativeness are distinct traits, and that the different sources of information about these traits, including faces. Appendix b construct reliability and validity analysis. Internal validity becomes a problem in experimental studies, where each experimental group has to follow the same methodology in order to be able to correctly isolate the effect. Evidence of convergent and discriminant validity of child. In psychology, discriminant validity tests whether concepts or measurements that are not supposed to be related are actually unrelated campbell and fiske 1959 introduced the concept of discriminant validity within their discussion on evaluating test validity. Convergent and discriminant validity of the perceived risk.
The most commonly discussed types are face, content. An exploratory factor analysis and reliability analysis of. An examination of the convergent and discriminant validity of. A successful evaluation of discriminant validity shows that a test of a concept is not highly. Convergent validity tests that constructs that are expected to be related are, in fact, related. In their 1959 article convergent and discriminant validation by the multitraitmultimethod matrix, donald t. The validity and reliability of the student online learning readiness solr instrument were tested using exploratory factor analysis efa and reliability analysis. Learn to conduct divergent discriminant validity in spss. Discriminant validity gets established when there is low correlation between two scales. Hox department of methodology and statistics, utrecht university, the netherlands abstract. Discriminant validity isreached if the ave estimate for a factor is greater than the squared inter factor correlations associated with that factor. Assessing the convergent and discriminant validity of. Discriminant validity or divergent validity tests that constructs that should have no relationship do, in fact, not have any relationship. Convergent and discriminant validity are considered subcategories of construct validity.
The first part was the calculation of mean, standard deviation, and score range for the achs based on the children with and without disabilities. Testing the validity and reliability of the levels of self. Objetives 1 the present work presents a series of userwritten commands to assess convergent and discriminant validity for con. They discussed validity including the traditional division of construct validity evidence. An for assessing convergent and discriminant validity. The important thing to recognize is that they work together if you can demonstrate that you have evidence for both convergent and discriminant validity, then youve by definition demonstrated that you have evidence for construct validity. The present study examined the factor structure of the personality assessment inventory antisocial features scale paiant in a nonforensic sample of 1257 undergraduate students. However, the discriminant validity is an issue when employing the htmt criterion. Evaluation of convergent and discriminant validity with. In study 1, confirmatory factor analysis supported previous findings that suggested. An alternative procedure for assessing convergent and discriminant validity donald r. This study could thus serve as a reference for the accurate measurement of psycap.
This study investigated the construct validity of measures of teacherstudent support in a sample of 709 ethnically diverse 2nd and 3rdgrade academically atrisk students. Assessments of convergent and discriminant validity rely on a wellfounded a priori predictions about which scales should correlate with a. An investigation of scale convergent and discriminant validity using lisrel confirmatory factor analysis. Assessing convergent and discriminant validity of the. One to fourfactor models were tested using exploratory factor analysis efa, with a fourfactor solution exhibiting the best fitting model bentler 1995. This study included two parts of data analysis to examine the convergent and discriminant validity of the achs, respectively. The two insiders responses were averaged together, as were the two outsiders responses. Construct, convergent, and discriminant validity of the. Construct, convergent, and discriminant validity of the beac.
Convergent and discriminant validity evaluation 1 in press, british journal of mathematical and statistical psychology evaluation of convergent and discriminant validity with multitraitmultimethod correlations tenko raykov michigan state university author note. An examination of convergent or discriminant validity. Convergent validity an overview sciencedirect topics. May 16, 20 reliability and validity are important aspects of selecting a survey instrument. The important thing to recognize is that they work together if you can demonstrate that you have evidence for both convergent and discriminant.
550 266 1362 588 682 598 1186 985 1092 522 1144 867 1012 1454 502 783 1420 898 573 1301 1364 1021 278 1344 1132 54 1120 1451 476 471 281 994 826 606 588 856 61 1336 942 1288 407