Millisecond Forums » Millisecond Forums » Inquisit 5 » Running an Inquisit battery on MTurk

Running an Inquisit battery on MTurk

Lizeroo — Fri, 21 Feb 2020 17:22:14 GMT

1. Do you have a detailed guide somewhere about how to post an Inquisit-based HIT on MTurk? I am particularly looking for guidance on how to generate the code they need to get paid and what the instructions should say on that page.

2. I just tried running my current battery on Inquisit Lab 5 and it took quite a long time to load all the files. (I have a lot of images in my tasks, though they are not large.) Is there any way to speed up the loading time?

Thank you!

RE: Running an Inquisit battery on MTurk

Lizeroo — Fri, 21 Feb 2020 17:22:14 GMT

+x[quote]

[b]Liz Shulman - 2/21/2020[/b]
+x[quote]

[b]Dave - 2/21/2020[/b]
+x[quote]

[b]Liz Shulman - 2/21/2020[/b]
1. Do you have a detailed guide somewhere about how to post an Inquisit-based HIT on MTurk? I am particularly looking for guidance on how to generate the code they need to get paid and what the instructions should say on that page.

2. I just tried running my current battery on Inquisit Lab 5 and it took quite a long time to load all the files. (I have a lot of images in my tasks, though they are not large.) Is there any way to speed up the loading time?

Thank you!
[/quote]

Re. 1.) No, there isn't a guide specific to MTurk. Generally, though, MTurk's guidance for Qualtrics https://blog.mturk.com/getting-great-survey-results-from-mturk-and-qualtrics-be1704ff9786 largely applies to Inquisit as well. Examples on how to generate a random code can be found on the forums, e.g. here https://www.millisecond.com/forums/FindPost6753.aspx .

Alternatively, you have the option to have Inquisit Web generate a subject ID, display that at the end and use that as the completion code in MTurk.

Please note that MTurk and TurkPrime are not the same thing. The latter platform integrates with MTurk and does some management on top. The TurkPirme confirmation code option only applies if you use the TurkPrime platform, not if you use plain MTurk by itself.

If you are using TurkPrime, see https://go.cloudresearch.com/knowledge/determining-how-workers-are-approved

Re. 2) I've tried your battery and loading times were between 30 to 90 seconds for the various scripts that employ a large amount of images. Those times didn't seem excessive to me, are you seeing longer load times on your end?
[/quote]

1. Thanks for this. Hopefully I can figure it out...
2. I would say that 90 sec is about what I was experiencing for the larger sets--I'm just worried about impatient MTurk workers...
[/quote]

I figured out how to further compress a lot of the jpegs. Hopefully, that will made everything load a bit faster.

RE: Running an Inquisit battery on MTurk

Lizeroo — Fri, 21 Feb 2020 16:49:58 GMT

+x[quote]

[b]Dave - 2/21/2020[/b]
+x[quote]

[b]Liz Shulman - 2/21/2020[/b]
1. Do you have a detailed guide somewhere about how to post an Inquisit-based HIT on MTurk? I am particularly looking for guidance on how to generate the code they need to get paid and what the instructions should say on that page.

2. I just tried running my current battery on Inquisit Lab 5 and it took quite a long time to load all the files. (I have a lot of images in my tasks, though they are not large.) Is there any way to speed up the loading time?

Thank you!
[/quote]

Re. 1.) No, there isn't a guide specific to MTurk. Generally, though, MTurk's guidance for Qualtrics https://blog.mturk.com/getting-great-survey-results-from-mturk-and-qualtrics-be1704ff9786 largely applies to Inquisit as well. Examples on how to generate a random code can be found on the forums, e.g. here https://www.millisecond.com/forums/FindPost6753.aspx .

Alternatively, you have the option to have Inquisit Web generate a subject ID, display that at the end and use that as the completion code in MTurk.

Please note that MTurk and TurkPrime are not the same thing. The latter platform integrates with MTurk and does some management on top. The TurkPirme confirmation code option only applies if you use the TurkPrime platform, not if you use plain MTurk by itself.

If you are using TurkPrime, see https://go.cloudresearch.com/knowledge/determining-how-workers-are-approved

Re. 2) I've tried your battery and loading times were between 30 to 90 seconds for the various scripts that employ a large amount of images. Those times didn't seem excessive to me, are you seeing longer load times on your end?
[/quote]

1. Thanks for this. Hopefully I can figure it out...
2. I would say that 90 sec is about what I was experiencing for the larger sets--I'm just worried about impatient MTurk workers...

RE: Running an Inquisit battery on MTurk

Dave — Fri, 21 Feb 2020 16:42:57 GMT

+x[quote]

[b]Liz Shulman - 2/21/2020[/b]
1. Do you have a detailed guide somewhere about how to post an Inquisit-based HIT on MTurk? I am particularly looking for guidance on how to generate the code they need to get paid and what the instructions should say on that page.

2. I just tried running my current battery on Inquisit Lab 5 and it took quite a long time to load all the files. (I have a lot of images in my tasks, though they are not large.) Is there any way to speed up the loading time?

Thank you!
[/quote]

Re. 1.) No, there isn't a guide specific to MTurk. Generally, though, MTurk's guidance for Qualtrics https://blog.mturk.com/getting-great-survey-results-from-mturk-and-qualtrics-be1704ff9786 largely applies to Inquisit as well. Examples on how to generate a random code can be found on the forums, e.g. here https://www.millisecond.com/forums/FindPost6753.aspx .

Alternatively, you have the option to have Inquisit Web generate a subject ID, display that at the end and use that as the completion code in MTurk.

Please note that MTurk and TurkPrime are not the same thing. The latter platform integrates with MTurk and does some management on top. The TurkPirme confirmation code option only applies if you use the TurkPrime platform, not if you use plain MTurk by itself.

If you are using TurkPrime, see https://go.cloudresearch.com/knowledge/determining-how-workers-are-approved

Re. 2) I've tried your battery and loading times were between 30 to 90 seconds for the various scripts that employ a large amount of images. Those times didn't seem excessive to me, are you seeing longer load times on your end?