Millisecond Forums » Millisecond Forums » Inquisit 4 » Question mouse AAT output

Question mouse AAT output

c.witteki — Thu, 01 Feb 2018 09:13:06 GMT

Hi,

we administered the mouse AAT using the Inquisit script. In the raw data files, there are several trials where:
initial RT: PULL
final RT: Pull
change.direction = 0
values.correct = 0

And the mouse was moved in the correct direction. I was wondering why there is an error message when the response direction was correct and there was not change of direction. How could that be possible?

Best
Charlotte

RE: Question mouse AAT output

Dave — Thu, 01 Feb 2018 09:13:06 GMT

[quote]

[b]c.witteki - Thursday, February 1, 2018[/b]

[quote]

[b]c.witteki - Wednesday, January 17, 2018[/b]

[quote]

[b]Dave - Monday, January 15, 2018[/b]

Sorry for the delay. I have looked at that file at considerable length:
(1) The coordinates look fine, i.e. they are exactly within the ranges they'd be expected to be given the screen and canvas size.
(2) As far as I can see, that data file does not show the issue, i.e. all initial responses, final responses and direction changes logged are consistent / what they should be. As such, that particular data file is of less diagnostic value than a file that contains (seemingly?) inconsistent data.
(3) The only thing that sticks out in the data is that -- on a few, rare occasions -- there are fairly large jumps in terms of the absolute distance (in pixels) the mouse moves within a single trial. That may suggest either extremely rapid movement (perhaps quicker than the program can reliably detect) or some other problem. That may have something to do with the original problem, but given (2) it's not clear.

If you have a data file with extended logging around that _does_ contain inconsistent trials (i.e. initial and final response differ, but no direction change indicated), that would be helpful. Thanks!

[/quote]

Hi Dave, sorry, I didn´t check the file as I was sure that the error would occur. Please find attached an output file in which the problem occurs.

Best
Charlotte

[/quote]

Hi Dave,

two weeks ago I uploaded an update file containing the error trials. Can you estimate when you will find the time to check the file?

Thanks a lot and best,
Charlotte

[/quote]

Hi Charlotte,

I did check the file and it clearly shows the issue, the reason for the issue occurring in the 1st place, however, is still unclear to me. As before, the only thing that sticks out are large jumps in the mouse coordinates within the space of a single trial -- something I have been unable to reproduce, so it's unclear to me still how this may or may not relate to the problem. Although those jumps are large, the coordinates aren't "wrong" per se, i.e. they are not outside of the defined screen and canvas dimensions.

RE: Question mouse AAT output

c.witteki — Thu, 01 Feb 2018 01:39:29 GMT

[quote]

[b]c.witteki - Wednesday, January 17, 2018[/b]

[quote]

[b]Dave - Monday, January 15, 2018[/b]

[/quote]

Hi Dave, sorry, I didn´t check the file as I was sure that the error would occur. Please find attached an output file in which the problem occurs.

Best
Charlotte

[/quote]

Hi Dave,

two weeks ago I uploaded an update file containing the error trials. Can you estimate when you will find the time to check the file?

Thanks a lot and best,
Charlotte

RE: Question mouse AAT output

c.witteki — Wed, 17 Jan 2018 13:04:44 GMT

[quote]

[b]Dave - Monday, January 15, 2018[/b]

[/quote]

Hi Dave, sorry, I didn´t check the file as I was sure that the error would occur. Please find attached an output file in which the problem occurs.

Best
Charlotte

RE: Question mouse AAT output

Dave — Mon, 15 Jan 2018 08:59:14 GMT

RE: Question mouse AAT output

c.witteki — Sat, 13 Jan 2018 07:26:41 GMT

Hi! I posted the output file several days ago. Can you estimate how long it will take to check the file?

Thanks a lot and best
Charlotte

RE: Question mouse AAT output

c.witteki — Mon, 08 Jan 2018 04:12:04 GMT

[quote]

[b]Dave - Wednesday, January 3, 2018[/b]

[quote]

[b]c.witteki - Wednesday, January 3, 2018[/b]

[quote]

[b]Dave - Thursday, December 21, 2017[/b]

[quote]

[b]c.witteki - Thursday, December 21, 2017[/b]

[quote]

[b]Dave - Wednesday, December 20, 2017[/b]

[quote]

[b]c.witteki - Wednesday, December 20, 2017[/b]

[/quote]

> How could that be possible?

If you modified the script, it's possible that you introduced a mistake. I'd have to see the actual script you used as well as a raw data file including ostensibly wrong values for the correctness.

[/quote]

I modified the script, but only the stimuli items. Attached please find the script and one output file. The participant was in experimental condition 1 (blue [_b] is associated with pulling, yellow [_y] with pushing). I highlighted the trials in which the inital and the final response were correct, no change of direction emerged, but still the trials were considered incorrect.

[/quote]

Thanks for attaching the script and example data. So far I have not discovered any obvious issue in the code (and I haven't been able to produce inconsistent results using the script either yet). One thing I can imagine happening is some sort of physical problem with the mouse. For an optical mouse, imagine it getting moved past the pixel tolerance, thus making the /isvalidresponse logic fire, then the sensor hits a spec of reflective surface or other obstruction, making the mouse briefly "jump" to different coordinates, causing the /iscorrectresponse logic to rate the response as wrong, once past the obstruction and back at the proper coordinates things proceed normally (i.e. no direction changes detected).

This, of course, only "works" as an explanation if the ostensible inconsistencies are relatively rare in the overall data. If they are more frequent and happened across subjects tested on different computers in different locations, it would seem far-fetched as an explanation. Can you give me a sense of the frequency of the problem and the situation under which the tests occurred?

[/quote]

Thanks for your response and apologies for the late reply. We also thought of a physical problem as most participants probably used optical mouse. The error occurred in 495 (out of 15.731) trials (=3,1%), however, it occurred in two thirds of our participants. Thus, although the error is rather rare in the overall data, it is not rare across participants. We tested the AAT, counting the change of directions and error messages. The error also occurred in our data and this was always the case when the direction was changed once (although the output file indicated no change of direction). Any ideas?

[/quote]

Thanks for the additional information -- I agree, that makes some kind of physical problem with the mouse a lot less likely. I must be missing some kind of edge-case in the code (i.e. some rare, specific set of conditions under which no change of direction is detected or the initial response is somehow misclassified), but having review the code again over the past couple of hours, I'm still not seeing where exactly things could go wrong. Maybe it has to do something with how the canvas aspect ratio works out mathematically on specific displays.

If you have the time, could you perform a test run with the attached script on a system where you observed the issue? It would be great to capture at least a few erroneous trials with that script -- it is identical to yours, except it logs a lot more information (e.g. the mouse y coordinates at every single in- or decrease step). That might help me pinpoint what exactly is happening and where.

[/quote]

Hi Dave,

we performed the AAT with the script you sent us, please fine the output attached. Hopefully, it yields some clarification.

Best
Charlotte

RE: Question mouse AAT output

Dave — Wed, 03 Jan 2018 12:42:41 GMT

[quote]

[b]c.witteki - Wednesday, January 3, 2018[/b]

[quote]

[b]Dave - Thursday, December 21, 2017[/b]

[quote]

[b]c.witteki - Thursday, December 21, 2017[/b]

[quote]

[b]Dave - Wednesday, December 20, 2017[/b]

[quote]

[b]c.witteki - Wednesday, December 20, 2017[/b]

[/quote]

RE: Question mouse AAT output

c.witteki — Wed, 03 Jan 2018 09:20:41 GMT

[quote]

[b]Dave - Thursday, December 21, 2017[/b]

[quote]

[b]c.witteki - Thursday, December 21, 2017[/b]

[quote]

[b]Dave - Wednesday, December 20, 2017[/b]

[quote]

[b]c.witteki - Wednesday, December 20, 2017[/b]

[/quote]

RE: Question mouse AAT output

Dave — Thu, 21 Dec 2017 11:55:41 GMT

[quote]

[b]c.witteki - Thursday, December 21, 2017[/b]

[quote]

[b]Dave - Wednesday, December 20, 2017[/b]

[quote]

[b]c.witteki - Wednesday, December 20, 2017[/b]

[/quote]

RE: Question mouse AAT output

c.witteki — Thu, 21 Dec 2017 00:21:08 GMT

[quote]

[b]Dave - Wednesday, December 20, 2017[/b]

[quote]

[b]c.witteki - Wednesday, December 20, 2017[/b]

[/quote]

RE: Question mouse AAT output

Dave — Wed, 20 Dec 2017 12:55:40 GMT

[quote]

[b]c.witteki - Wednesday, December 20, 2017[/b]

[/quote]