Running an Inquisit battery on MTurk


Author
Message
Liz Shulman
Liz Shulman
Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)
Group: Forum Members
Posts: 21, Visits: 60
1. Do you have a detailed guide somewhere about how to post an Inquisit-based HIT on MTurk? I am particularly looking for guidance on how to generate the code they need to get paid and what the instructions should say on that page.

2. I just tried running my current battery on Inquisit Lab 5 and it took quite a long time to load all the files. (I have a lot of images in my tasks, though they are not large.) Is there any way to speed up the loading time?

Thank you!
Dave
Dave
Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)
Group: Administrators
Posts: 13K, Visits: 104K
Liz Shulman - 2/21/2020
1. Do you have a detailed guide somewhere about how to post an Inquisit-based HIT on MTurk? I am particularly looking for guidance on how to generate the code they need to get paid and what the instructions should say on that page.

2. I just tried running my current battery on Inquisit Lab 5 and it took quite a long time to load all the files. (I have a lot of images in my tasks, though they are not large.) Is there any way to speed up the loading time?

Thank you!

Re. 1.) No, there isn't a guide specific to MTurk. Generally, though, MTurk's guidance for Qualtrics https://blog.mturk.com/getting-great-survey-results-from-mturk-and-qualtrics-be1704ff9786 largely applies to Inquisit as well. Examples on how to generate a random code can be found on the forums, e.g. here https://www.millisecond.com/forums/FindPost6753.aspx .

Alternatively, you have the option to have Inquisit Web generate a subject ID, display that at the end and use that as the completion code in MTurk.





Please note that MTurk and TurkPrime are not the same thing. The latter platform integrates with MTurk and does some management on top. The TurkPirme confirmation code option only applies if you use the TurkPrime platform, not if you use plain MTurk by itself.

If you are using TurkPrime, see https://go.cloudresearch.com/knowledge/determining-how-workers-are-approved

Re. 2) I've tried your battery and loading times were between 30 to 90 seconds for the various scripts that employ a large amount of images. Those times didn't seem excessive to me, are you seeing longer load times on your end?

Liz Shulman
Liz Shulman
Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)
Group: Forum Members
Posts: 21, Visits: 60
Dave - 2/21/2020
Liz Shulman - 2/21/2020
1. Do you have a detailed guide somewhere about how to post an Inquisit-based HIT on MTurk? I am particularly looking for guidance on how to generate the code they need to get paid and what the instructions should say on that page.

2. I just tried running my current battery on Inquisit Lab 5 and it took quite a long time to load all the files. (I have a lot of images in my tasks, though they are not large.) Is there any way to speed up the loading time?

Thank you!

Re. 1.) No, there isn't a guide specific to MTurk. Generally, though, MTurk's guidance for Qualtrics https://blog.mturk.com/getting-great-survey-results-from-mturk-and-qualtrics-be1704ff9786 largely applies to Inquisit as well. Examples on how to generate a random code can be found on the forums, e.g. here https://www.millisecond.com/forums/FindPost6753.aspx .

Alternatively, you have the option to have Inquisit Web generate a subject ID, display that at the end and use that as the completion code in MTurk.





Please note that MTurk and TurkPrime are not the same thing. The latter platform integrates with MTurk and does some management on top. The TurkPirme confirmation code option only applies if you use the TurkPrime platform, not if you use plain MTurk by itself.

If you are using TurkPrime, see https://go.cloudresearch.com/knowledge/determining-how-workers-are-approved

Re. 2) I've tried your battery and loading times were between 30 to 90 seconds for the various scripts that employ a large amount of images. Those times didn't seem excessive to me, are you seeing longer load times on your end?

1. Thanks for this.  Hopefully I can figure it out...
2. I would say that 90 sec is about what I was experiencing for the larger sets--I'm just worried about impatient MTurk workers...

Liz Shulman
Liz Shulman
Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)Expert (1.2K reputation)
Group: Forum Members
Posts: 21, Visits: 60
Liz Shulman - 2/21/2020
Dave - 2/21/2020
Liz Shulman - 2/21/2020
1. Do you have a detailed guide somewhere about how to post an Inquisit-based HIT on MTurk? I am particularly looking for guidance on how to generate the code they need to get paid and what the instructions should say on that page.

2. I just tried running my current battery on Inquisit Lab 5 and it took quite a long time to load all the files. (I have a lot of images in my tasks, though they are not large.) Is there any way to speed up the loading time?

Thank you!

Re. 1.) No, there isn't a guide specific to MTurk. Generally, though, MTurk's guidance for Qualtrics https://blog.mturk.com/getting-great-survey-results-from-mturk-and-qualtrics-be1704ff9786 largely applies to Inquisit as well. Examples on how to generate a random code can be found on the forums, e.g. here https://www.millisecond.com/forums/FindPost6753.aspx .

Alternatively, you have the option to have Inquisit Web generate a subject ID, display that at the end and use that as the completion code in MTurk.





Please note that MTurk and TurkPrime are not the same thing. The latter platform integrates with MTurk and does some management on top. The TurkPirme confirmation code option only applies if you use the TurkPrime platform, not if you use plain MTurk by itself.

If you are using TurkPrime, see https://go.cloudresearch.com/knowledge/determining-how-workers-are-approved

Re. 2) I've tried your battery and loading times were between 30 to 90 seconds for the various scripts that employ a large amount of images. Those times didn't seem excessive to me, are you seeing longer load times on your end?

1. Thanks for this.  Hopefully I can figure it out...
2. I would say that 90 sec is about what I was experiencing for the larger sets--I'm just worried about impatient MTurk workers...

I figured out how to further compress a lot of the jpegs.  Hopefully, that will made everything load a bit faster.
GO

Merge Selected

Merge into selected topic...



Merge into merge target...



Merge into a specific topic ID...




Reading This Topic

Explore
Messages
Mentions
Search