HTMT discriminant validity
-
- PLS Junior User
- Posts: 2
- Joined: Mon Apr 13, 2015 1:57 pm
- Real name and title: Cathy van der Veeken
HTMT discriminant validity
Good afternoon,
I have a question about the discriminant validity.
All of my statistics are right except the discriminant validity.
My Fornell Larcker Criterion is as follows:
Perceived value Satisfaction Loyalty
Perceived value 0.767
Satisfaction 0.876 1.000
Loyalty 0.882 0.846 0.893
All my Cross Loadings are correct but the HTMT is not:
Perceived value Satisfaction Loyalty
Perceived value
Satisfaction 0.875
Loyalty 0.937 0.888
How can I describe this correctly in my thesis and what does this mean for my results?
Because the other statistics are correct.
I will appreciate your help with this situation.
Best Regards,
I have a question about the discriminant validity.
All of my statistics are right except the discriminant validity.
My Fornell Larcker Criterion is as follows:
Perceived value Satisfaction Loyalty
Perceived value 0.767
Satisfaction 0.876 1.000
Loyalty 0.882 0.846 0.893
All my Cross Loadings are correct but the HTMT is not:
Perceived value Satisfaction Loyalty
Perceived value
Satisfaction 0.875
Loyalty 0.937 0.888
How can I describe this correctly in my thesis and what does this mean for my results?
Because the other statistics are correct.
I will appreciate your help with this situation.
Best Regards,
- cringle
- SmartPLS Developer
- Posts: 818
- Joined: Tue Sep 20, 2005 9:13 am
- Real name and title: Prof. Dr. Christian M. Ringle
- Location: Hamburg (Germany)
- Contact:
Re: HTMT discriminant validity
Hi
You should focus on HTMT since cross loadings and Fornell-Larcker do not reliably detect discriminant validity problems.
In your case, discriminant validity has not been established und your results are not valid.
Take a look at this paper, Fig. 8., where you find some hints on how to establish discriminant validity.
http://dx.doi.org/10.1007/s11747-014-0403-8
Best regards,
Christian Ringle
You should focus on HTMT since cross loadings and Fornell-Larcker do not reliably detect discriminant validity problems.
In your case, discriminant validity has not been established und your results are not valid.
Take a look at this paper, Fig. 8., where you find some hints on how to establish discriminant validity.
http://dx.doi.org/10.1007/s11747-014-0403-8
Best regards,
Christian Ringle
Prof. Dr. Christian M. Ringle, Hamburg University of Technology (TUHH), SmartPLS
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
-
- PLS Junior User
- Posts: 2
- Joined: Mon Apr 13, 2015 1:57 pm
- Real name and title: Cathy van der Veeken
Re: HTMT discriminant validity
Thanks for your response! Yes that's what I thought, I will try to work with the research paper!
But when the discriminant validity is not established, does that imply that all my results are invalid?
Since AVE and VIF are correct (above 0.5 and below 5.0, resp.) in the research.
Besides those values, my Chronbach's Alpha, Composite Reliability, Outer Loadings and Bootstrapping are correct.
Can I still use these results to describe the reliability of the model and the validity of the other two tests?
Best Regards,
But when the discriminant validity is not established, does that imply that all my results are invalid?
Since AVE and VIF are correct (above 0.5 and below 5.0, resp.) in the research.
Besides those values, my Chronbach's Alpha, Composite Reliability, Outer Loadings and Bootstrapping are correct.
Can I still use these results to describe the reliability of the model and the validity of the other two tests?
Best Regards,
-
- PLS Junior User
- Posts: 4
- Joined: Mon May 25, 2015 4:31 pm
- Real name and title: Fares Brini, Teaching assistant
Re: HTMT discriminant validity
Hi CvdV and P. Ringle,
If I well understand your comments on discriminant validity, I shall conclude that:
-discriminant validity shall be established if the HTMT value, in respect to the Confidence interval as shown in PLS3 [2.5%, 97.5%], should be between this interval.
-example: HTMT value X>Y=0.383; the CI is set on [0.215, 0.678]
So, do I consider that these two constructs are discriminant from each others?
Thank you for answering me,
If I well understand your comments on discriminant validity, I shall conclude that:
-discriminant validity shall be established if the HTMT value, in respect to the Confidence interval as shown in PLS3 [2.5%, 97.5%], should be between this interval.
-example: HTMT value X>Y=0.383; the CI is set on [0.215, 0.678]
So, do I consider that these two constructs are discriminant from each others?
Thank you for answering me,
- cringle
- SmartPLS Developer
- Posts: 818
- Joined: Tue Sep 20, 2005 9:13 am
- Real name and title: Prof. Dr. Christian M. Ringle
- Location: Hamburg (Germany)
- Contact:
Re: HTMT discriminant validity
Please take a look at this paper:
http://dx.doi.org/10.1007/s11747-014-0403-8
If 1 does not fall into the CI, then things are fine.
Best
CR
http://dx.doi.org/10.1007/s11747-014-0403-8
If 1 does not fall into the CI, then things are fine.
Best
CR
Prof. Dr. Christian M. Ringle, Hamburg University of Technology (TUHH), SmartPLS
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
-
- PLS Junior User
- Posts: 4
- Joined: Mon May 25, 2015 4:31 pm
- Real name and title: Fares Brini, Teaching assistant
Re: HTMT discriminant validity
Dear Professor,
Thanks a lot for your answer.
Regards,
Thanks a lot for your answer.
Regards,
HTMT discriminant validity
Dear Forum,
I have a question about discriminant validity. In my model, I would like to investigate different determinants for two dependent variables A and B with 3 items each. From a theoretical perspective, the items x1 to x6 belong to a single concept (sometimes measured as a higher order construct) with different subdimensions (x1-x3 belongs to subdimension 1 of the concept; x4-x6 belongs to the subdimension 2 of the concept).
In the existing literature, the subdimension 1 (x1-x3) was operationalized as a dependent variable and also both subdimensions (x1-x6) were operationalized as a single dependent variable. The aim of the study is to check the importance of identified determinants for the two subdimensions separately (therefore two dependent variables A and B). The results show that there are significant differences but it is not possible to distinguish discriminant validity between these two subdimensions by using HtMt.
My question to you: Is it necessary to create two models to avoid the problem of a lack of discriminant validity or, in spite of a lack of discriminant validity, to capture both dependent variables into one model?
Thank you in advance!
I have a question about discriminant validity. In my model, I would like to investigate different determinants for two dependent variables A and B with 3 items each. From a theoretical perspective, the items x1 to x6 belong to a single concept (sometimes measured as a higher order construct) with different subdimensions (x1-x3 belongs to subdimension 1 of the concept; x4-x6 belongs to the subdimension 2 of the concept).
In the existing literature, the subdimension 1 (x1-x3) was operationalized as a dependent variable and also both subdimensions (x1-x6) were operationalized as a single dependent variable. The aim of the study is to check the importance of identified determinants for the two subdimensions separately (therefore two dependent variables A and B). The results show that there are significant differences but it is not possible to distinguish discriminant validity between these two subdimensions by using HtMt.
My question to you: Is it necessary to create two models to avoid the problem of a lack of discriminant validity or, in spite of a lack of discriminant validity, to capture both dependent variables into one model?
Thank you in advance!
- cringle
- SmartPLS Developer
- Posts: 818
- Joined: Tue Sep 20, 2005 9:13 am
- Real name and title: Prof. Dr. Christian M. Ringle
- Location: Hamburg (Germany)
- Contact:
Re: HTMT discriminant validity
Well, we are not so great fans of higher order models but addressed this issue in the advanced PLS-SEM book, Chapter 2: https://www.smartpls.com/documentation/ ... sem-issues
"In the next step, you can assess the discriminant validity between the LOCs COMP and LIKE using the HTMT criterion (Henseler et al., 2015). Exhibit 2.11 shows the HTMT values along with their 95% bias-corrected and accelerated (BCa) bootstrap confidence intervals. The results indicate discriminant validity between COMP and LIKE since the HTMT value of 0.780 is below the (conservative) threshold value of 0.85. Furthermore, the corresponding bootstrap confidence interval does not include the value 1 (i.e., the HTMT value is significantly lower than 1). Also, we establish discriminant validity between LOCs and the reflectively measured construct CUSL as well as with the single item construct CUSA. At the same time, however, we cannot establish discriminant validity between COMP and LIKE and their HOC REPU. This result is expected, however, as the measurement model of the HOC repeats the indicators of its LOCs." (p. 60-61).
Hence, you would like to establish discriminant validity between the LOCs (otherwise it makes probably more sense if you just use the higher order construct without subdimensions).
Best
Christian
"In the next step, you can assess the discriminant validity between the LOCs COMP and LIKE using the HTMT criterion (Henseler et al., 2015). Exhibit 2.11 shows the HTMT values along with their 95% bias-corrected and accelerated (BCa) bootstrap confidence intervals. The results indicate discriminant validity between COMP and LIKE since the HTMT value of 0.780 is below the (conservative) threshold value of 0.85. Furthermore, the corresponding bootstrap confidence interval does not include the value 1 (i.e., the HTMT value is significantly lower than 1). Also, we establish discriminant validity between LOCs and the reflectively measured construct CUSL as well as with the single item construct CUSA. At the same time, however, we cannot establish discriminant validity between COMP and LIKE and their HOC REPU. This result is expected, however, as the measurement model of the HOC repeats the indicators of its LOCs." (p. 60-61).
Hence, you would like to establish discriminant validity between the LOCs (otherwise it makes probably more sense if you just use the higher order construct without subdimensions).
Best
Christian
Prof. Dr. Christian M. Ringle, Hamburg University of Technology (TUHH), SmartPLS
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
Re: HTMT discriminant validity
Dear Prof. Ringle,
thank you for your answer!
Best regards
Holger
thank you for your answer!
Best regards
Holger
-
- PLS Junior User
- Posts: 6
- Joined: Sun Jan 13, 2019 12:49 pm
- Real name and title: Mr Steven Gregory Bamba
Re: HTMT discriminant validity
hi i wanna ask something regarding to this HTMT criterion, im currently doing my Thesis and in my thesis my HTMT is a little bit above 0.9 which is 0.914.
is it still can be accepted or consider as discriminant in some extent even though the value is only a little bit above the requirement?
Thank you very much in advance!
is it still can be accepted or consider as discriminant in some extent even though the value is only a little bit above the requirement?
Thank you very much in advance!
- cringle
- SmartPLS Developer
- Posts: 818
- Joined: Tue Sep 20, 2005 9:13 am
- Real name and title: Prof. Dr. Christian M. Ringle
- Location: Hamburg (Germany)
- Contact:
Re: HTMT discriminant validity
Well, it's a little bit high. Can you get it below 0.9? Otherwise, bootstrap the HTMT (use complete bootstrapping in SmartPLS 3) and show that the HTMT is significantly lower than 1 (look at the upper bound of HTMT's bootstrap confidence interval).
Best
Christian
Best
Christian
Prof. Dr. Christian M. Ringle, Hamburg University of Technology (TUHH), SmartPLS
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
-
- PLS Junior User
- Posts: 6
- Joined: Sun Jan 13, 2019 12:49 pm
- Real name and title: Mr Steven Gregory Bamba
Re: HTMT discriminant validity
Dear Professor Ringle,
this what i got from the HTMT Confidence Interval after complete bootstrapping Sir
Original Sample Sample Mean 2.5% 97.5%
Latent variable 2 > Latent variable 1 0.914 0.905 0.734 1.018
Latent variable 3 > Latent variable 1 0.762 0.763 0.411 1.023
Latent Variable 3 > Latent variable 2 0.778 0.782 0.449 1.038
is it alright like this Sir?, pardon me Si i'm a beginner regarding to smartpls statistics
Thank you
Regards
Steven
this what i got from the HTMT Confidence Interval after complete bootstrapping Sir
Original Sample Sample Mean 2.5% 97.5%
Latent variable 2 > Latent variable 1 0.914 0.905 0.734 1.018
Latent variable 3 > Latent variable 1 0.762 0.763 0.411 1.023
Latent Variable 3 > Latent variable 2 0.778 0.782 0.449 1.038
is it alright like this Sir?, pardon me Si i'm a beginner regarding to smartpls statistics
Thank you
Regards
Steven
- Attachments
-
- Capture.PNG (9.48 KiB) Viewed 18571 times
- cringle
- SmartPLS Developer
- Posts: 818
- Joined: Tue Sep 20, 2005 9:13 am
- Real name and title: Prof. Dr. Christian M. Ringle
- Location: Hamburg (Germany)
- Contact:
Re: HTMT discriminant validity
You would like to do a one-sided test (or use a 10% probability of error with the 2-sided test) to obtain the upper bound at the 95% point (and not at 97.5%.
Prof. Dr. Christian M. Ringle, Hamburg University of Technology (TUHH), SmartPLS
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
-
- PLS Junior User
- Posts: 6
- Joined: Sun Jan 13, 2019 12:49 pm
- Real name and title: Mr Steven Gregory Bamba
Re: HTMT discriminant validity
These are what i got Sir, the first one is using one-sided test and the second one is using two-sided test but with 10% probability
- Attachments
-
- two-sided test with 10% probability of error
- Capture 1.PNG (8.77 KiB) Viewed 18568 times
-
- one-sided test
- Capture.PNG (8.77 KiB) Viewed 18568 times
- cringle
- SmartPLS Developer
- Posts: 818
- Joined: Tue Sep 20, 2005 9:13 am
- Real name and title: Prof. Dr. Christian M. Ringle
- Location: Hamburg (Germany)
- Contact:
Re: HTMT discriminant validity
Thanks. Use the one or the other approach but with 5,000 bootstrap samples.
However, your upper bound is above 1 which means that discriminant validity has not been established. Your confidence intervals are very wide. I suppose that you use a small sample (which would be a data problem) and/or a fuzzy dataset (which would also be a data problem).
There is no straightforward recommendation and solution which we can offer.
However, your upper bound is above 1 which means that discriminant validity has not been established. Your confidence intervals are very wide. I suppose that you use a small sample (which would be a data problem) and/or a fuzzy dataset (which would also be a data problem).
There is no straightforward recommendation and solution which we can offer.
Prof. Dr. Christian M. Ringle, Hamburg University of Technology (TUHH), SmartPLS
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de
- Literature on PLS-SEM: https://www.smartpls.com/documentation
- Google Scholar: https://scholar.google.de/citations?use ... AAAJ&hl=de