Page 1 of 1

Moderating effect test: different results

Posted: Sat Oct 14, 2017 2:01 am
by xchen99
Dear experts:
I am testing the moderating effect of a moderator variable (response cost) on a relationship between sanction severity and compliance. All my latent variables are measured with reflective indicators. When I ran the moderating test in SmartPLS3, I first used the two-stage approach, the result is no moderating effect. Then, I ran the test again using the product indicator approach, the result shows a significant moderating effect. The data has 232 records. I set the resampling at 5000. Please see the following two images for the two results. I am not sure how to interpret the results. Would you help me to comprehend the two different results?

Thank you very much!

Xavier

The two stage result:
moderating-two stage.PNG
moderating-two stage.PNG (8.39 KiB) Viewed 6041 times
The product indicator result:
moderating-product indicator.PNG
moderating-product indicator.PNG (13.76 KiB) Viewed 6041 times

Re: Moderating effect test: different results

Posted: Sun Oct 15, 2017 3:18 pm
by xchen99
I am puzzled by the different results from the two approaches. I thought that the two stage approach has higher statistic power than the product indicator approach. But the results seem showing the other way around: the product indicator approach shows the significant moderating effect, but the two stage approach shows insignificant effect. It seems to me that in this case product indicator approach has higher statistical power.

Re: Moderating effect test: different results

Posted: Sun Oct 22, 2017 9:09 pm
by jmbecker
Which options do you use with the product indicator approach. It is usally recommended to use standardzed variables before multiplication in the product terms because all other (latent) variables in the model are also standardized.

Re: Moderating effect test: different results

Posted: Mon Oct 23, 2017 4:30 pm
by xchen99
Dr. Becker,

Thanks for your reply. I did use the Standardized option for Product Term Generation when setting up the moderator.

Should any other settings I need to change?

Thanks,
Xavier

Re: Moderating effect test: different results

Posted: Tue Oct 24, 2017 11:08 am
by jmbecker
I think a potential problem is that all the effects are very small. Therefore, it can easily happen that you just find some chance effects that might not be really there. I don't know how the rest of your model looks like, but given the snippet of results that you showed us, I would not trust any of the two results.

Re: Moderating effect test: different results

Posted: Thu Oct 26, 2017 4:56 pm
by xchen99
Dear Dr. Becker,

Thank you so much for your reply. I will take your suggestion into consideration when I explain the result.

Thanks again,
Xavier

Double Moderation effect

Posted: Sat Nov 04, 2017 6:21 pm
by asifkhan
, In my model I have two IVs single DV and two moderating variables. how can I check for the combine effect of these two moderating variables