Millisecond Forums » Millisecond Forums » Inquisit 5 » A question on the expressions.d (overall d-score) in the Age IAT

A question on the expressions.d (overall d-score) in the Age IAT

lovetolearn — Thu, 15 Jun 2017 08:48:54 GMT

Hi There,

In the Age IAT script, the key IAT measure is referred to as "d-score" (e.g., "The strength of an association between concepts is measured by the standardized mean difference score of the 'hypothesis-inconsistent' pairings and 'hypothesis-consistent' pairings (d-score) (Greenwald, Nosek, & Banaji, 2003)"; "expressions.d:overall d-score").

My question is: is expressions.d (overall d-score) in the Age IAT summary data file the "D measure" mentioned in Greenwald, Nosek, & Banaji (2003, p. 201)? The reason for asking this is Greenwald, Nosek, & Banaji (2003) does refer to the "D measure" and the "d measure of effect size".

Thanks so much!

RE: A question on the expressions.d (overall d-score) in the Age IAT

Dave — Thu, 15 Jun 2017 08:48:54 GMT

[quote]

[b]lovetolearn - Wednesday, June 14, 2017[/b]

Thanks again Dave. I wonder in addition to step 5 and step 7 being not relevant to the calculation of expressions.d, whether "eliminate subjects for whom more than 10% of trials have latency less than 300 ms" in step 2 is also not relevant to the calculation of expressions.d?

That is, is the calculation of expressions.d only based on the following steps under "Improved algorithm" column of Table 4:
step 1;
part of step 2 ("Eliminate trials with latencies > 10,000 ms");
step 3;
step 6;
step 9;
step 10;
step 11;
step 12.

[/quote]

> "eliminate subjects for whom more than 10% of trials have latency less than 300 ms

Those subjects are supposed to be eliminated entirely -- i.e. the recommendation is to not use / analyze their data at all. It is *not* something that factors in to calculating D.

> part of step 2 ("Eliminate trials with latencies > 10,000 ms");

The script does that. Trials with latencies greater than 10.000 ms are not included in the calculation of expressions.d.

RE: A question on the expressions.d (overall d-score) in the Age IAT

lovetolearn — Wed, 14 Jun 2017 23:14:42 GMT

RE: A question on the expressions.d (overall d-score) in the Age IAT

Dave — Mon, 05 Jun 2017 08:44:06 GMT

[quote]

[b]lovetolearn - Sunday, June 4, 2017[/b]

Thanks so much for your advice Dave!

I wonder if I may ask another question on the Age IAT script. In that script, it is mentioned "Inquisit calculates d scores using the improved scoring algorithm as described in Greenwald et al (2003). Error trials are handled by requiring respondents to correct their responses according to recommendation (p.214)."

Does that mean the expressions.d in the Age IAT summary data file is calculated through Steps 1-12 under "Improved algorithm" column of Table 4 on p214 of Greenwald et al. (2003)?

Or is the expressions.d calculated through Steps 1-3, 8, 9, 11, and 12 under "Improved algorithm" column of Table 4, as well as Steps 4-7, and 10 under "Approximately equivalent alternatives for improved algorithm" column of Table 4?

Thanks again!

[/quote]

> "Does that mean the expressions.d in the Age IAT summary data file is calculated through
> Steps 1-12 under "Improved algorithm" column of Table 4 on p214 of Greenwald et al. (2003)?"

Yes, in essence. But steps 5 and 7 aren't applicable -- the Inquisit scripts calculate D1 ("D with built-in error penalty", cf. Table 3).

RE: A question on the expressions.d (overall d-score) in the Age IAT

lovetolearn — Sun, 04 Jun 2017 03:34:08 GMT

RE: A question on the expressions.d (overall d-score) in the Age IAT

Dave — Tue, 23 May 2017 21:41:54 GMT

[quote]

[b]lovetolearn - Tuesday, May 23, 2017[/b]

[/quote]

expressions.d is the D (capital D) measure / score in Greenwald et al. (2003). It is not Cohen's d (lowercase d), although the two are mathematically similar: http://www.jakewestfall.org/misc/D_bound.html

Both the IAT D-score and Cohen's d are in essence measures of effect size of the form (Mean1 - Mean2) / StandardDeviation.
Mathematically, the key difference between the two is how the standard deviation is calculated. IAT D-scores are calculated using the overall standard deviation. Cohen's d ( https://en.wikipedia.org/wiki/Effect_size#Cohen.27s_d ), on the other hand, is calculated using the pooled standard deviation. The consequence is that D-scores and Cohen's d have different boundaries: IAT D-scores vary between -2 and +2, whereas Cohen's d has no finite lower and upper boundaries (d may trail off into infinity in theory).