Construct operationalization

[mgruber]

Hi everyone,

I would like to examine possible success determinants of a digital learning game with PLS-SEM. At the moment, I have constructs like ease of use, interest, motivation etc. and at the end, I have the construct "use of the game", which I can operationalize by data extracted from the game (e.g. correct answers, objects clicked, time played etc.). Moreover, I plan to pose a written questionnaire after playing the game with questions on their individual gaming experience.
In addition, I would like to draw conclusions towards learning outcome of the students playing the game. So, I thought about bringing in another construct at the end called "learning success" and thought about operationalizing via pretest-posttest knowledge tests. Do you have any idea how I can operationalize?

My mentor said usually, pretest-posttest is used for group comparisons, but in my case would fit better as a construct operationalization.
Is anyone out there who can help me operationalize "learning success"?

I am looking forward to hearing from you - any kind of support is highly appreciated.
Best regards

Melissa

[anupkumar]

Hi Melissa, you can measure 'learning success' by comparing pretest and posttest scores. You can also ask students how much they feel they learned and look at in-game activities like problem-solving.

[mgruber]

Hi,

Thank you very much for your reply.
Regarding the comparison of the pretest and posttest test results, I am not quite sure how to operationalize this. Do you know whether there are any studies in which this was done before? OR can one simply "make up" a scale behind this, e.g. 10% improvement by intervention, 20% improvement etc. ?

Thank you so much in advance.
Best regards

Melissa

[anupkumar]

Hi Melissa, you're welcome. Studies use pretest-posttest comparisons with specific rubrics or scales. It's best not to "make up" a scale, but you can design one based on learning objectives and intervention difficulty.