Participants quitting- random assignment issue

Back

Home
»
Millisecond Forums
»
Inquisit 4
»
Participants quitting- random assignment issue

Participants quitting- random assignment issue

Author	Message
jennifer.perry	jennifer.perry posted 9 Years Ago Topic Details Share Topic
Group: Forum Members Posts: 4, Visits: 16	Hello, We are currently hosting an experiment using a combination of Qualtrics and Inquisit and are stumped about a random assignment issue. We have 6 between subjects conditions. Right now, participants complete the consent form in Qualtrics, which then randomly (and evenly) sends them to the task with one of six links that have a URL query parameter that defines the condition. Inquisit then uses this parameter as the group number and loads the correct task. The problem we're having is that some of the participants (MTurkers) quit the study after Qualtrics sends them to the task. In this case, Qualtrics does not know that the experiment wasn't completed and continues to randomly assign to the conditions as though the cell counts are even. Some of our cell counts are therefore less than others, as by chance, participants have quit more within certain conditions than in others. We would like to re-run this study and are wondering if there a way to use random assignment methods in Inquisit that would update the condition counts only if the task was completed? Or any other way that would get around this issue?
	Reply Like 69
Dave	Dave posted 9 Years Ago ANSWER Post Details Share Post
Group: Administrators Posts: 13K, Visits: 104K	Since it is Qualtrics that tracks the condition counts, there's not much you could do on the Inquisit-side, especially if a participant never even starts Inquisit. The only way I can think of is to send participants back to Qualtrics after completing the Inquisit-portion and set up Qualtrics to only update condition counts if that redirection actually happens (i.e., if it "sees" the participant again at a specific URL). Participants who never start the Inquisit-portion would never get there and thus not inflate your condition counts artificially. Whether that's technically possible in Qualtrics, I don't know (but I would think it is). Hope this helps.
	Reply Like 63
jennifer.perry	jennifer.perry posted 9 Years Ago ANSWER Post Details Share Post
Group: Forum Members Posts: 4, Visits: 16	Great, thank you, I can definitely try that. I'm wondering, though, if I don't try to randomize with Qualtrics at all, is there a way to randomize only with Inquisit that can take into account if people quit?
	Reply Like 60
Dave	Dave posted 9 Years Ago ANSWER Post Details Share Post
Group: Administrators Posts: 13K, Visits: 104K	> I'm wondering, though, if I don't try to randomize with Qualtrics at all, is there a way to randomize only with Inquisit that can take > into account if people quit? At present there isn't anything that would do that automatically, no.
	Reply Like 73