HTMT discriminant validity

Questions about the implementation and application of the PLS-SEM method, that are not related to the usage of the SmartPLS software.
CvdV
PLS Junior User
Posts: 2
Joined: Mon Apr 13, 2015 1:57 pm
Real name and title: Cathy van der Veeken

HTMT discriminant validity

Post by CvdV »

Good afternoon,

I have a question about the discriminant validity.
All of my statistics are right except the discriminant validity.
My Fornell Larcker Criterion is as follows:
Perceived value Satisfaction Loyalty
Perceived value 0.767
Satisfaction 0.876 1.000
Loyalty 0.882 0.846 0.893

All my Cross Loadings are correct but the HTMT is not:
Perceived value Satisfaction Loyalty
Perceived value
Satisfaction 0.875
Loyalty 0.937 0.888

How can I describe this correctly in my thesis and what does this mean for my results?
Because the other statistics are correct.

I will appreciate your help with this situation.

Best Regards,
User avatar
cringle
SmartPLS Developer
Posts: 818
Joined: Tue Sep 20, 2005 9:13 am
Real name and title: Prof. Dr. Christian M. Ringle
Location: Hamburg (Germany)
Contact:

Re: HTMT discriminant validity

Post by cringle »

Hi

You should focus on HTMT since cross loadings and Fornell-Larcker do not reliably detect discriminant validity problems.

In your case, discriminant validity has not been established und your results are not valid.

Take a look at this paper, Fig. 8., where you find some hints on how to establish discriminant validity.
http://dx.doi.org/10.1007/s11747-014-0403-8

Best regards,
Christian Ringle
CvdV
PLS Junior User
Posts: 2
Joined: Mon Apr 13, 2015 1:57 pm
Real name and title: Cathy van der Veeken

Re: HTMT discriminant validity

Post by CvdV »

Thanks for your response! Yes that's what I thought, I will try to work with the research paper!
But when the discriminant validity is not established, does that imply that all my results are invalid?
Since AVE and VIF are correct (above 0.5 and below 5.0, resp.) in the research.
Besides those values, my Chronbach's Alpha, Composite Reliability, Outer Loadings and Bootstrapping​ are correct.
Can I still use these results to describe the reliability of the model and the validity of the other two tests?

Best Regards,
faresbrini
PLS Junior User
Posts: 4
Joined: Mon May 25, 2015 4:31 pm
Real name and title: Fares Brini, Teaching assistant

Re: HTMT discriminant validity

Post by faresbrini »

Hi CvdV and P. Ringle,
If I well understand your comments on discriminant validity, I shall conclude that:
-discriminant validity shall be established if the HTMT value, in respect to the Confidence interval as shown in PLS3 [2.5%, 97.5%], should be between this interval.
-example: HTMT value X>Y=0.383; the CI is set on [0.215, 0.678]

So, do I consider that these two constructs are discriminant from each others?

Thank you for answering me,
User avatar
cringle
SmartPLS Developer
Posts: 818
Joined: Tue Sep 20, 2005 9:13 am
Real name and title: Prof. Dr. Christian M. Ringle
Location: Hamburg (Germany)
Contact:

Re: HTMT discriminant validity

Post by cringle »

Please take a look at this paper:
http://dx.doi.org/10.1007/s11747-014-0403-8

If 1 does not fall into the CI, then things are fine.

Best
CR
faresbrini
PLS Junior User
Posts: 4
Joined: Mon May 25, 2015 4:31 pm
Real name and title: Fares Brini, Teaching assistant

Re: HTMT discriminant validity

Post by faresbrini »

Dear Professor,

Thanks a lot for your answer.

Regards,
Leho
PLS Junior User
Posts: 5
Joined: Mon Nov 27, 2017 11:38 am
Real name and title: Holger Leuveld

HTMT discriminant validity

Post by Leho »

Dear Forum,

I have a question about discriminant validity. In my model, I would like to investigate different determinants for two dependent variables A and B with 3 items each. From a theoretical perspective, the items x1 to x6 belong to a single concept (sometimes measured as a higher order construct) with different subdimensions (x1-x3 belongs to subdimension 1 of the concept; x4-x6 belongs to the subdimension 2 of the concept).

In the existing literature, the subdimension 1 (x1-x3) was operationalized as a dependent variable and also both subdimensions (x1-x6) were operationalized as a single dependent variable. The aim of the study is to check the importance of identified determinants for the two subdimensions separately (therefore two dependent variables A and B). The results show that there are significant differences but it is not possible to distinguish discriminant validity between these two subdimensions by using HtMt.

My question to you: Is it necessary to create two models to avoid the problem of a lack of discriminant validity or, in spite of a lack of discriminant validity, to capture both dependent variables into one model?

Thank you in advance!
User avatar
cringle
SmartPLS Developer
Posts: 818
Joined: Tue Sep 20, 2005 9:13 am
Real name and title: Prof. Dr. Christian M. Ringle
Location: Hamburg (Germany)
Contact:

Re: HTMT discriminant validity

Post by cringle »

Well, we are not so great fans of higher order models but addressed this issue in the advanced PLS-SEM book, Chapter 2: https://www.smartpls.com/documentation/ ... sem-issues

"In the next step, you can assess the discriminant validity between the LOCs COMP and LIKE using the HTMT criterion (Henseler et al., 2015). Exhibit 2.11 shows the HTMT values along with their 95% bias-corrected and accelerated (BCa) bootstrap confidence intervals. The results indicate discriminant validity between COMP and LIKE since the HTMT value of 0.780 is below the (conservative) threshold value of 0.85. Furthermore, the corresponding bootstrap confidence interval does not include the value 1 (i.e., the HTMT value is significantly lower than 1). Also, we establish discriminant validity between LOCs and the reflectively measured construct CUSL as well as with the single item construct CUSA. At the same time, however, we cannot establish discriminant validity between COMP and LIKE and their HOC REPU. This result is expected, however, as the measurement model of the HOC repeats the indicators of its LOCs." (p. 60-61).

Hence, you would like to establish discriminant validity between the LOCs (otherwise it makes probably more sense if you just use the higher order construct without subdimensions).

Best
Christian
Leho
PLS Junior User
Posts: 5
Joined: Mon Nov 27, 2017 11:38 am
Real name and title: Holger Leuveld

Re: HTMT discriminant validity

Post by Leho »

Dear Prof. Ringle,

thank you for your answer!

Best regards
Holger
StevenGregory
PLS Junior User
Posts: 6
Joined: Sun Jan 13, 2019 12:49 pm
Real name and title: Mr Steven Gregory Bamba

Re: HTMT discriminant validity

Post by StevenGregory »

hi i wanna ask something regarding to this HTMT criterion, im currently doing my Thesis and in my thesis my HTMT is a little bit above 0.9 which is 0.914.
is it still can be accepted or consider as discriminant in some extent even though the value is only a little bit above the requirement?
Thank you very much in advance!
User avatar
cringle
SmartPLS Developer
Posts: 818
Joined: Tue Sep 20, 2005 9:13 am
Real name and title: Prof. Dr. Christian M. Ringle
Location: Hamburg (Germany)
Contact:

Re: HTMT discriminant validity

Post by cringle »

Well, it's a little bit high. Can you get it below 0.9? Otherwise, bootstrap the HTMT (use complete bootstrapping in SmartPLS 3) and show that the HTMT is significantly lower than 1 (look at the upper bound of HTMT's bootstrap confidence interval).

Best
Christian
StevenGregory
PLS Junior User
Posts: 6
Joined: Sun Jan 13, 2019 12:49 pm
Real name and title: Mr Steven Gregory Bamba

Re: HTMT discriminant validity

Post by StevenGregory »

Dear Professor Ringle,

this what i got from the HTMT Confidence Interval after complete bootstrapping Sir

Original Sample Sample Mean 2.5% 97.5%
Latent variable 2 > Latent variable 1 0.914 0.905 0.734 1.018
Latent variable 3 > Latent variable 1 0.762 0.763 0.411 1.023
Latent Variable 3 > Latent variable 2 0.778 0.782 0.449 1.038

is it alright like this Sir?, pardon me Si i'm a beginner regarding to smartpls statistics

Thank you
Regards

Steven
Attachments
Capture.PNG
Capture.PNG (9.48 KiB) Viewed 18307 times
User avatar
cringle
SmartPLS Developer
Posts: 818
Joined: Tue Sep 20, 2005 9:13 am
Real name and title: Prof. Dr. Christian M. Ringle
Location: Hamburg (Germany)
Contact:

Re: HTMT discriminant validity

Post by cringle »

You would like to do a one-sided test (or use a 10% probability of error with the 2-sided test) to obtain the upper bound at the 95% point (and not at 97.5%.
StevenGregory
PLS Junior User
Posts: 6
Joined: Sun Jan 13, 2019 12:49 pm
Real name and title: Mr Steven Gregory Bamba

Re: HTMT discriminant validity

Post by StevenGregory »

These are what i got Sir, the first one is using one-sided test and the second one is using two-sided test but with 10% probability
Attachments
two-sided test with 10% probability of error
two-sided test with 10% probability of error
Capture 1.PNG (8.77 KiB) Viewed 18304 times
one-sided test
one-sided test
Capture.PNG (8.77 KiB) Viewed 18304 times
User avatar
cringle
SmartPLS Developer
Posts: 818
Joined: Tue Sep 20, 2005 9:13 am
Real name and title: Prof. Dr. Christian M. Ringle
Location: Hamburg (Germany)
Contact:

Re: HTMT discriminant validity

Post by cringle »

Thanks. Use the one or the other approach but with 5,000 bootstrap samples.

However, your upper bound is above 1 which means that discriminant validity has not been established. Your confidence intervals are very wide. I suppose that you use a small sample (which would be a data problem) and/or a fuzzy dataset (which would also be a data problem).

There is no straightforward recommendation and solution which we can offer.
Post Reply