Missing Data


Author
Message
nashby
nashby
Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)
Group: Forum Members
Posts: 78, Visits: 159
Yes I fixed it but again it has nothing to do with the issue I am having here with the data not being uploaded.
seandr
seandr
Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)
Group: Administrators
Posts: 1.3K, Visits: 6K
Just to be clear, unless you've updated the script, the only choice is to click the invisible rectangle. You'll need to list "proceed2" as a response for that response to be recognized.

I'll look further at the logs to see if I can find more data to make sense of the feedback you're getting from respondents.

-Sean
nashby
nashby
Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)
Group: Forum Members
Posts: 78, Visits: 159
Well there are quite a few people who are emailing me saying they completed the task, they know all the details of the task, yet there is no data file for them there. If it was just one or two  I would say its a scam, but its actually a lot of them.

The attention check goes on to a next page that then does as you suggest already (e.g., you have failed to pay attention so you cannot take part in this task). No one has complained about this and there files still show up if the control quit or are kicked out.



seandr
seandr
Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)
Group: Administrators
Posts: 1.3K, Visits: 6K
Ok, doing some more digging here.

I'm counting data files, and what I'm seeing is 96 data files in your account right now. Another 18 data files were deleted, one on 10/28 and the others on 10/30, so the cumulative total is 114. The log for the experiment reports there should be 112 - not sure why the discrepancy, but possibly the log was cleared after 2 test runs, or there were 2 duplicate uploads (which can happen if the server returns an error after the first attempt, so Inquisit tries again, and then both attempts succeed). In any case, all of the data files that made it to the server seem to be accounted for.

What makes you think there are additional data files that didn't make it to the server?

Regarding the attention check, it's clever, but there's no way to differentiate
1) someone who misses or is confused by the instructions, repeatedly clicks the "Let's get started" link, assumes Inquisit is hung when nothing happens, and angrily shuts down Inquisit using Ctrl+Alt+Delete.
2) someone who encountered a legitimate bug.

Also note that every participant who misses the instructions is going to blame you and/or Inquisit for their inability to proceed, which ruins both yours and Inquisit's reputation. If you're going to use this kind of check, you should allow them to respond with either the link or the invisible box, and show them a message that says "Sorry, you weren't reading instructions, the experiment will now end" if they click the wrong one. That would also give you a record in the data file that they did, in fact, click the wrong link. It looks like 18 people dropped out after successfully starting the experiment - I'm guessing most or all of them got caught in your trap without knowing it.

If you have any additional info regarding data files that didn't get sent to the server, let me know. I'm looking into the missing finish page entries in the log now...

-Sean
Edited 11 Years Ago by seandr
nashby
nashby
Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)
Group: Forum Members
Posts: 78, Visits: 159
Thanks for catching this but that is actually an attention check. If they click proceed they fail and it kicks them out anyways so if they ctrl quit out that would be for the best. 

The problem with the data not uploading still remains since this is people who did the whole experiment and then it didnt upload.
seandr
seandr
Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)Supreme Being (144K reputation)
Group: Administrators
Posts: 1.3K, Visits: 6K
I just tried your script, and I was unable to proceed past the following trial:


<trial genintro>
/ stimulusframes = [1 = intro2, proceed2, box]
/ validresponse = (proceed, box)
/ recorddata = false
/ ontrialend = [if(trial.genintro.response == "proceed"){values.kickem = 1}]
</trial>


The problem is that "proceed" is listed as a valid response, but it isn't actually presented anywhere on the screen, so there's no way to actually proceed. Instead, the trial presents a stimulus called "proceed2". I'm guessing your participants click about 10 times in vain on the "proceed2" stimulus, and then bail out by hitting Ctrl+Alt+Delete.

You'll likely see higher completion rates if you fix this problem. 

-Sean


nashby
nashby
Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)
Group: Forum Members
Posts: 78, Visits: 159
Thanks had a look only 1 error reported and so dont think thats going to shed much light. I think I would then simply say if you are going to run a study online don't use Inquisit because it doesn't work so well and will just get you in trouble :( Back to using java I guess.
Dave
Dave
Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)
Group: Administrators
Posts: 13K, Visits: 109K
Hmm, offhand I have no idea what other problem that may be. In case you have participant tracking enabled, the logs accessible via your account at https://www.millisecond.com/myaccount/logs.aspx may provide some hint(s).

nashby
nashby
Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)Guru (8.8K reputation)
Group: Forum Members
Posts: 78, Visits: 159
Actually it does upload the data on the script abort as well, just doesnt show the finish page.

So its some other problem and its costing me dearly. I dont have any other details to go off of people report using a variety of browsers and many report that inquist has worked for them in the past. This is really frustrating.
Dave
Dave
Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)Supreme Being (1M reputation)
Group: Administrators
Posts: 13K, Visits: 109K
Thanks for the link. I did a couple of quick test runs and it's working as expected for me. It appears to properly save data and redirect to the finish page *if* a participant fully completes the procedure.

It will not do so if a given participant triggers one of your various script.abort() conditions, which is also the expected behavior.

It would seem plausible that the above is the case for at least *some* of your participants reporting an apparent breakdown / not being redirected. As for the others experiencing issues, if you have any additional details (error messages and the like), please don't hesitate to share them.

GO

Merge Selected

Merge into selected topic...



Merge into merge target...



Merge into a specific topic ID...




Reading This Topic

Explore
Messages
Mentions
Search