Direct effect not significant, Indirect effect not significant, result total effect significant

Questions about the implementation and application of the PLS-SEM method, that are not related to the usage of the SmartPLS software.
Post Reply
carl29
PLS Junior User
Posts: 1
Joined: Fri Jul 14, 2023 6:22 am
Real name and title: Carl Jonathan

Direct effect not significant, Indirect effect not significant, result total effect significant

Post by carl29 »

Hello all,

I am doing a research with SmartPLS3 and get a result like this:

Direct effect
Internet Quality -> Repurchase Intention : 0,128 (p-value:0,087) insignificant
Specific Indirect effect
Internet Quality -> Customer Satisfaction -> Repurchase Intention : 0,035 (p-value:0,205) insignificant
Total Effect
Internet Quality -> Repurchase Intention : 0,163 (p-value:0,026) significant

Can someone tell me what is the meaning of this results?
I hope someone can answer me ASAP
Thank you very much!
jmbecker
SmartPLS Developer
Posts: 1284
Joined: Tue Mar 28, 2006 11:09 am
Real name and title: Dr. Jan-Michael Becker

Re: Direct effect not significant, Indirect effect not significant, result total effect significant

Post by jmbecker »

Significance is a strange concept that is also often criticized because of its dichotomous nature. Yes/no

In laymen terms (and not 100% correct): What you actually want to know is whether your effect is strong enough given the sampling uncertainty that you have to conclude that is is likely different from zero. The individual direct and indirect effect are small and the uncertainty around them is too large to make a definite conclusion (with 5% certainty). However, when you combine them the total effect is stronger while the uncertainty remains similar. Thus, you have more confidence in your total effect, then in the smaller direct (or even much smaller indirect) effect.

So in short: You probably have not enough power (sample size) to make a good conclusion about the weaker direct and indirect effects, while your sample size seem sufficient for the stronger total effect that is a combination of both.
Dr. Jan-Michael Becker, BI Norwegian Business School, SmartPLS Developer
Researchgate: https://www.researchgate.net/profile/Jan_Michael_Becker
GoogleScholar: http://scholar.google.de/citations?user ... AAAJ&hl=de
jmbecker
SmartPLS Developer
Posts: 1284
Joined: Tue Mar 28, 2006 11:09 am
Real name and title: Dr. Jan-Michael Becker

Re: Direct effect not significant, Indirect effect not significant, result total effect significant

Post by jmbecker »

BTW: This is a really good paper on why dichotomization into significant and not significant is not a good idea:
https://doi.org/10.1016/j.jbusres.2023.114086

Rigdon, E. E. (2023). How improper dichotomization and the misrepresentation of uncertainty undermine social science research. Journal of Business Research, 165, 114086.
Dr. Jan-Michael Becker, BI Norwegian Business School, SmartPLS Developer
Researchgate: https://www.researchgate.net/profile/Jan_Michael_Becker
GoogleScholar: http://scholar.google.de/citations?user ... AAAJ&hl=de
charlie323a
PLS Junior User
Posts: 1
Joined: Mon Aug 14, 2023 6:45 am
Real name and title: rohan

Re: Direct effect not significant, Indirect effect not significant, result total effect significant

Post by charlie323a »

The individual direct and indirect effect are small and the uncertainty around them is too large to make a definite conclusion (with 5% certainty). However, when you combine them the total effect is stronger while the uncertainty remains similar. Thus, you have more confidence in your total effect, then in the smaller direct (or even much smaller indirect) effect.
Post Reply