The Gender Violence - Implicit Association Test to measure attitudes toward intimate partner violence against women

Abstract

Attitudes play a central role in intimate partner violence against women and are related to its origin, to the responses of women who suffer violence, and to the settings where it occurs. In fact, these attitudes are recognized as one of the risk factors linked to violent perpetration and to public, professional, and victim responses to this type of violence. However, even though available research generally shows a broad rejection of this violence, it remains a serious social and health problem that has reached epidemic proportions. This suggests that the information available about these attitudes (obtained through explicit and direct measures, i.e., self-reports) may be distorted or influenced by factors such as social desirability. In this context, the overall objective of our research project is to provide multi-method measures (explicit and implicit) of attitudes toward intimate partner violence against women, and the main goal of this paper is to propose an instrument for the implicit measurement of these attitudes. In this regard, the Implicit Association Test (IAT) is the most common procedure used, providing a superior predictive validity compared to explicit measures for socially sensitive topics. We will present an exploratory study that describes its adaptation for our purposes, and the development of the Gender Violence - Implicit Association Test (GV-IAT) to use among Spanish-speaking populations, and discuss the strengths and limitations of this proposal.

Keywords:
Intimate partner violence against women; Attitudes; Implicit Association Test (IAT); Gender Violence - Implicit Association Test (GV-IAT)

Introduction

Violence against women and girls (VAW) is a gender-based violence recognized by the international community as a fundamental violation of human rights and as a social and public health problem of epidemic proportions, which can take multiple forms and occurs in different contexts (Devries et al., 2013; European Union Agency for Fundamental Rights, 2014; Stockl et al., 2013; World Health Organization, 2013). One of the most common forms of VAW is that which is inflicted by a male partner, referred to as intimate partner violence against women (IPVAW) (World Health Organization, 2013). This violence comprises a whole range of coercive sexual, psychological, and physical aggression acts, inflicted against adult or teenage women by their current or previous partner (United Nations, 2006).

Attitudes can play a central role in VAW and IPVAW (Flood & Pease, 2009; Gracia & Lila, 2015; Gracia, Rodríguez, & Lila, 2015; Gracia & Tomás, 2014; Heise & Kotsadam, 2015; Wang, 2016), both in terms of the origin of that violence, including the community where it occurs, and in the responses of women who suffer it (Capaldi, Knoble, Shortt, & Kim, 2012; Copp, Giordano, Longmore, & Manning, 2019; Fulu, Jewkes, & Garcia-Moreno, 2013; Gracia, Garcia, & Lila, 2014; Jewkes, Flood, & Lang, 2015; Puente, Ubillos, Echeburua, & Paez, 2016). In fact, some of the main risk factors for the occurrence of this type of violence are acceptance, in addition to tolerant beliefs and attitudes toward this violence, all at sociocultural and individual levels (Ferrer & Bosch, 2014; Garcia-Moreno et al., 2015; Gracia & Tomás, 2014; Puente et al., 2016). This work is centered on the analysis of social attitudes (public opinion or public attitudes) towards IPVAW.

In countries such as Spain, the measurement of explicit attitudes toward IPVAW demonstrate that around 90-95% of public opinion rejects this violence (Ferrer & Bosch, 2014; Meil, 2014; Spanish Government Office for Gender-Based Violence, 2014; Spanish Ministry of Health, Social Services and Equality, 2013), even though available data indicate that between 11 and 25% of women have suffered IPVAW at some point in their life and between 3 and 15% have experienced it in the last year (European Union Agency for Fundamental Rights, 2014; Spanish Ministry of Health, Social Services and Equality, 2015). This discrepancy between informed attitudes and the reality of the IPVAW may be due, among other things, to the social desirability effect in explicit measures (Eckhardt, Samper, Suhr, & Holtzworth-Munroe, 2012; Gracia et al., 2015; Gracia & Lila, 2015). For example, some research points out that males and people with a traditional gender role would have more positive attitudes toward IPVAW than women and people with an equal gender role attitude (Abrahams, Jewkes, Laubscher, & Hoffman, 2006; Flood & Pease, 2009; Obeid, Chang, & Ginges, 2010; Sánchez-Prada, Delgado-Álvarez, Bosch-Fiol, & Ferrer-Pérez, 2018). However, in sensitive areas such as this, respondents may avoid sharing their real beliefs because of a fear of negative consequences or judgments and may instead offer distorted responses, provide inaccurate information, or present themselves in a more socially acceptable manner (Eckhardt et al., 2012; Gracia et al., 2015).

In summary, the availability of reliable and valid measures of the acceptability of IPVAW is important for research and intervention purposes, as they can provide knowledge about the social conditions that contribute to them (Gracia et al., 2015; Gracia & Lila, 2015) and because explicit measures do not always achieve this goal.

The measure of attitudes

The nature of attitudes can be analyzed from different points of view: in dual-attitude models, the main postulate is that implicit and explicit attitudes have separate mental representations (Petty, Briñol, & DeMarree, 2007), while single-attitude models imply that there is only a single construct of attitude and individual differences in the tendency to like or dislike an attitude object across different situations (Fazio & Olson, 2014).

Nevertheless, and beyond any discussion about its nature or composition, one of the fundamental topics in attitudinal studies is the distinction between explicit and implicit approaches to assess them (Gawronski & Bodenhausen, 2006). In general, the measurement of attitudes through explicit measures and direct procedures, such as self-reports, have been successful due to their ease of administration, cost- effectiveness, and efficacy (Paulhus & Vazire, 2007). However, these procedures entail substantive or methodological limitations. In fact, some researchers have questioned the validity of self-report measures, arguing that in the case of IPVAW, social desirability and self-presentational concerns produce inaccuracy (De Houwer, Teige-Mocigemba, Spruyt, & Moors, 2009; Fazio & Olson, 2003; Nosek, 2005; Nosek, Hawkins, & Frazier, 2011; Ryan, 2013; Scott & Straus, 2007), supporting the need for alternative methods of assessment.

For this reason, some researchers have used implicit methods of assessment that measure attitudes at an indirect level and can provide information that is distinct from self-reports and predicts social behavior (Nosek et al., 2011; Olson & Fazio, 2004). In fact, previous research indicates that implicit measures are widespread and robust on average (Nosek et al., 2007; Payne et al., 2010) and aggregate scores of these measures at the macro level (such as states or countries) show strong relations with indicators of discrimination at the same level of analysis (Leitner, Hehman, Ayduk, & Mendoza-Denton, 2016; Nosek et al., 2009).

In this sense, and in an attempt to overcome the limitations of direct measures, attitudes can be measured through reaction times (RT) (Blair, Dasgupta, & Glaser, 2015; Kihlstrom, 2004; Tosi, Ledesma, Poo, Montes, & López, 2018). One of the best researched implicit instruments is the IAT, developed by Greenwald, McGhee, and Schwartz (1998). In general terms, IAT is an indirect measure used to assess the relative strength of cognitive associations between two target concepts and an evaluative dimension by utilizing a number of response discrimination tasks (Fazio & Olson, 2003; Greenwald et al., 1998). Specifically, the IAT measures the strength of these associations (implicit attitudes) by comparing response latency (in milliseconds) to different pairings of the concepts of interest with target stimuli. The preferences of the individual are inferred from the speed of responding to stimuli in a categorization task (Bar-Anan & Nosek, 2014; Blair et al., 2015; De Houwer et al., 2009; Greenwald, Nosek, & Banaji, 2003; Nosek, Greenwald, & Banaji, 2007).

It is worth noting that IAT is increasingly used for analysis in several areas of social cognition and social phenomena (Payne & Gawronski, 2010) such as prejudice (McConnell & Liebold, 2001), self-esteem (Greenwald & Farnham, 2000), or social identity (Greenwald, Banaji, Rudman, Farnham, & Nosek, 2002). In fact, the IAT has quickly become the most frequently chosen implicit measurement tool for many relevant social, cognitive, and personality variables (Nosek, Bar-Anan, Sriram, Axt, & Greenwald, 2014; Olson & Fazio, 2004). The paper published by Greenwald et al. (1998) is one of the most influential in personality and social psychology, having had an even greater impact outside psychology, as indicated by the millions of visitors to the IAT website (Schimmack, 2019).

Despite this popularity, it must be pointed out that there are different controversies about the internal structure of the IAT, the nature of the underlying processes, the possible effects of confounding variables, and, particularly, about their validity (Nosek, Greenwald, & Banaji, 2007; Rezaei, 2011; Schimmack, 2019; Tosi et al., 2018). One of the most important controversies concerns precisely the validity of what IAT measures. From a dual-attitude model, some researchers consider that it measures implicit constructs or unconscious processes, such as implicit attitudes or implicit preferences that cannot be measured with self-report measures (Banaji & Greenwald, 2013; Greenwald et al., 1998; Nosek, Greenwald, & Banaji, 2007). However, others argue that it is an implicit or indirect measure of the same constructs that are measured with explicit measures (Samayoa & Fazio, 2017), suggesting that it is better to avoid writing about implicit constructs (Greenwald & Banaji, 2017; Schimmack, 2019). Another controversy arises from the fact that the discrepancy between implicit and explicit measures is more often the standard than the exception. In fact, correlations between implicit and explicit measures tend to be low (Hofmann, Gawronski, Gschwendner, Le, & Schmitt, 2005; Kurdi & Banaji, 2019), to the extent that some authors question whether this is a convergent or a discriminating validity criterion (Tosi et al., 2018). In this sense, the debate is still open on how correlations with explicit measures of the same construct should be interpreted and which results would support greater evidence of validity: high correlations would support the idea of convergent validity, while low correlations would support the idea of discriminant validity. This divergence in interpretation, as well as the variability of explicit-implicit correlations as a function of the measured construct, supports the need for greater empirical evidence to advance the construction of a theoretical interpretative framework for the meaning of IAT measures. A detailed discussion about the limitations of the IAT procedure is addressed in Schimmack (2019) or Tosi et al. (2018).

Applying implicit measures to assess attitudes toward intimate partner violence against women

Most studies examining public attitudes toward IPVAW have not included both implicit and explicit measures jointly (Sánchez-Prada et al., 2018). Certainly, implicit measures, such as the IAT, have been used to assess attitudes toward rape (Süssenbach, Albrechet, & Bohner, 2017), sexual violence (Larue et al., 2014), or dating violence (Lee, Begun, DePrince, & Chu, 2016), or to predict violent behaviors of some types of violent perpetrators (Bluemke et al., 2017; Simane-Vigante, Plotka, & Blumenau, 2015).

But only a few previous studies have analyzed attitudes toward IPVAW using implicit measures, such as the IAT: Robertson and Murachver (2007) examined offenders’ attitudes toward violence using an IAT measure in participants that were both incarcerated for intimate partner violence and nonincarcerated. The attitudes toward violence were more similar in both groups when measured explicitly, but if measured by IAT, the incarcerated sample had significantly more positive attitudes toward violence. Eckhardt et al. (2012) used three IAT measures to examine attitudes toward women, violence, and the associations between gender and violence in a sample of men from a batterer intervention program and nonviolent men from the community. Measured by IAT, offenders had significantly more positive attitudes toward violence, and stronger associations between women and violence. But no significant differences were found between groups on the explicit attitude measurement. They hypothesize that the explicit measures to assess attitudes toward IPVAW among batterers may be limited by their tendency to deny or minimize their violent behavior. Cantera and Blanch (2010) and Cantera and Gamero (2012) used the IAT to assess the strength of associations between some gender stereotypes (men as providers and women as caregivers) and violence (violent men and peaceful women), in the context of the debate about the benefits and limitations of a gender approach to understanding IPVAW.

To our knowledge, no previous studies have used the IAT specifically to assess implicit attitudes toward IPVA W, which is why we conducted a preliminary study (Sánchez-Prada et al., 2018) where subjects from two Spanish communities undertook an IAT. The results obtained supported the hypothesis that implicit measures of public attitudes toward IPVAW will enable better evaluations by neutralizing social desirability effects and the response control of subjects. Specifically, as a result of this preliminary study, and assuming that IAT is an implicit measure of the same constructs that are measured with explicit measures (Samayoa & Fazio, 2017), we propose a form of personalized IAT to this aim: the GV-IAT primarily addressed to Spanish-speaking populations where this procedure is scarcely used (Tosi et al., 2018).

Method

The present paper aims to focus on the use of the Implicit Association Test (IAT), developed by Greenwald et al. (1998), to assess social attitudes (public opinion) towards IPVAW and to present an exploratory study with results that permit us to propose a form of personalized IAT to this specific subject: the Gender Violence - Implicit Association Test (GV-IAT).

Participants

In an exploratory study, the GV-IAT was applied to a convenience sample of 89 psychology students from two Spanish universities: 10 men (11.2%) and 79 women (88.8%), with an average age of 19.65 years (SD = 4.53).

Materials

The Inventory of Distorted Thoughts about Women and Violence (IPDMV in the Spanish acronym, Echeburua & Fernández-Montalvo, 1998; adapted version of Ferrer, Bosch, Ramis, Torrens, & Navarro, 2006) is a 24-item scale with a four-point response scale and four dimensions: inferiority of women compared to men (7-items, α = .88), blaming female victims of abuse (8-items, α = .66), violence as an appropriate problem-solving strategy (5-items, α = .70), and minimization of IPVAW as a problem and exoneration of the abuser (4-items, α = .52). Higher scores indicate higher levels of distorted thoughts about women and violence.

The Inventory of Beliefs about Wife Beating (IBWB, Saunders, Lynch, Grayson, & Linz, 1987; Spanish version of Expósito & Ruiz, 2010), a 30-item scale designed to assess participants’ explicit attitudes toward wifebeating, which comprises five dimensions: wife-beating is justified (12 items, α = .86), wife gains from beating (7 items, α = .78), help should be given (5 items, α = .73), offender should be punished (3 items, α = .61), and the offender is responsible (4 items, α = .62).

The Gender Violence Implicit Association Test (GV-IAT. Although “the most common version of the IAT is the one originally introduced by Greenwald et al. (1998), the traditional IAT” (McConnell & Rydell, 2019, p. 151), there are some variants or forms of personalized IAT, with some modifications to the original (see McConnell & Rydell, 2019; or Olson & Fazio, 2004). Hereafter, we present the GV-IAT, an IAT developed and adapted to measure implicit attitudes towards IPVAW.

The GV-IAT, like any form of IAT, consists of asking participants to classify target stimuli, presented in the center of a computer screen, into two response categories (target concepts and attribute concepts). Each of these categories, located on the left and right side of the screen, is represented by two different concepts. Participants have to press a computer key (left or right) as quickly as possible to classify the word in the center (target stimuli) into one of the two categories located on the sides, creating compatible and incompatible pairings.

Specifically, the GV-IAT is a form of personalized IAT, an implicit measure of public attitudes toward IPVAW. That is why the concepts of the target category are Gender violence vs. Non gender violence and the concepts of the attribute category are Good vs. Bad. Six words from each of the aforementioned categories were used as stimuli: (a) Attack, Force, Humiliate, Hit, Torture, and Infringe for the category Gender Violence; (b) Support, Collaborate, Cooperate, Empathize, Respect, and Tolerate for the category Non gender violence; (c) Wonderful, Excellent, Phenomenal, Best, Positive, and Optimum for the category Good; (d) Horrible, Terrible, Disastrous, Worst, Negative, and Appalling for the category Bad. This English translation is shown in order to facilitate comprehension; however, the GV-IAT is mainly addressed to Spanish-speaking populations, which is why the IAT attribute categories are given in Spanish (see ^Appendix)

In the case of the target category (Gender violence vs. Non gender violence), it is necessary to make two remarks: First, it is important to note that under Spanish law (Organic Act 1/2004, of 28 December, on Integrated Protection Measures against Gender Violence 2004), IPVAW is known as gender violence (see Ferrer & Bosch, 2014), which is why GV-IAT uses gender violence to refer to IPVAW and also to define the target category. Secondly, the target stimuli were selected from the Toughness and Tenderness Scale (Cantera & Blanch, 2010), applied by the authors in previous Spanish research using IAT in the study of some aspects of IPVAW. Specifically, ten expert members of the Gender Studies research group of our university individually indicated those words on the scale that best defined the two concepts of the category. The words with the highest level of agreement were selected for the study. The inter-judge reliability of the stimulus matching scores (ranged from 1 to 7) was estimated by an intraclass correlation index (Shrout & Fleiss, 1979). This method is the most appropriate statistical index for estimating the reliability of the evaluations by expert judges when they are expressed on a quantitative scale (Fleiss & Cohen, 1973). This index estimates the agreement or equivalence of the scores given by the judges to the different stimuli, whereby a value ≥ .75 indicates an excellent agreement or reliability (Fleiss, 1986). The value obtained for our stimuli was .999 by the absolute agreement method, which indicates an excellent coincidence in the scores issued by the judges. Additionally, there are different techniques to ensure the reliability of the evaluations issued by the judges. The Aiken V index (Aiken, 1985) has the advantage that it quantifies the relevance of each item or stimulus valued by the judges, taking into account the mean, as well as the range and the lowest value of the evaluation (García-Sedeño & García-Tejera, 2013). An additional advantage of this index is that its interpretation is based on the statistical significance obtained from the tables of critical values (Aiken, 1985). Thus, for a significance level α = .01, the stimuli with Aiken V values lower than .75 should be eliminated (Charter, 2003). The values obtained in our study were optimal for all stimuli (.98 for Tolerate and 1.0 for all others).

Additionally, 588 university students, who volunteered to participate in a previous pilot study, completed the Toughness and Tenderness Scale (Cantera & Blanch, 2010), in which they rated a total of 48 words as a possible expression of gender violence in the context of a heterosexual intimate partner relationship, on a scale from 1 (“it's not gender violence”) to 4 (“it is gender violence”). A subsequent repeated measure ANOVA with data obtained (F (47, 511) = 4858.649, p < .001) confirmed the appropriateness of the stimuli, since there were significant differences between among each of the six words selected for the category Gender violence and each of the six words selected for the category Non gender violence (p < .001 for all of the pairwise comparisons applying Bonferroni's correction).

For the attribute category, we use the concepts Good vs. Bad following previous studies (Eckhardt et al., 2012; Süssenbach et al., 2017), and the stimuli were selected following the proposals of the Spanish version of the Harvard Project Implicit (https://implicit.harvard.edu/implicit/spain/) and the study by Briñol, Horcajo, Becerra, Falces, and Sierra (2002).

In line with the proposal of Greenwald et al. (2003), participants completed the GV-IAT task in seven blocks, each of which came in two versions: Of the seven blocks, three were considered practice trials (B1-B2 included 24 trials; B5 included 48 trials), and four were the critical blocks (B3-B6 included 24 trials; B4-B7 included 48 trials), where a trial is deemed to be the time from when the target appears onscreen until the stimulus is correctly categorized. Regarding the versions, version 1 starts with the compatible critical phase (pairing the categories Gender-Violence + Bad on one response key and Non gender violence + Good on the other) (Table 1), and version 2 with the incompatible critical phase (pairing the categories Gender-Violence + Good on one response key and Non gender violence + Bad on the other) (Table 2).

Table 1
Sequence of stimuli presentation initiating the IAT with the compatible critical phase

Blocks	Trials	Phase	Categories assigned to the left key (S)	Categories assigned to the right key (L)
B1	24	Practice	Non gender violence	Gender violence
B2	24	Practice	Good	Bad
B3	24	Critical compatible	Non gender violence	Gender violence/Bad
B4	48	Critical compatible	Non gender violence	Gender violence/Bad
B5	48	Practice	Gender violence	Non gender violence
B6	24	Critical incompatible	Gender violence/Good	Non gender violence/Bad
B7	48	Critical incompatible	Gender violence/Good	Non gender violence/Bad

Table 2
Sequence of stimuli presentation initiating the IAT with the incompatible critical phase

Blocks	Trials	Phase	Categories assigned to the left key (S)	Categories assigned to the right key (L)
B1	24	Practice	Gender violence	Non gender violence
B2	24	Practice	Good	Bad
B3	24	Critical incompatible	Gender violence/Good	Non gender violence/Bad
B4	48	Critical incompatible	Gender violence/Good	Non gender violence/Bad
B5	48	Practice	Gender violence	Non gender violence
B6	24	Critical compatible	Non gender violence/Good	Gender violence/Bad
B7	48	Critical compatible	Non gender violence /Good	Gender violence/Bad

At the beginning of the GV-IAT, instructions (obtained from the Project Implicit of Harvard University in its Spanish version: https://implicit.harvard.edu/implicit/spain/) are given for participants to complete blocks 1 and 2: subjects must classify words into groups as fast as they can, committing the minimum number of errors; the list of words (stimuli) is displayed onscreen with an explanation to use the letter S (for words that belong to the category on the left of the screen) or L (for the words in the category on the right). Participants are also instructed that if they make an error, a red X will appear and they can then mark the correct answer. Once the first two test blocks have been completed, and before starting the next ones, the following instructions appear onscreen: now the four categories appear together and each word belongs to a single category, press the letter S when the words belong to the category on the left of the screen and letter L when the words belong to the category on the right; green and white labels help to identify the correct category (this is an English summary of the original Spanish instructions).

Procedure

The GV-IAT is designed to be applied in individualized sessions lasting approximately 10 min, where each subject may perform the test by typing on a desktop computer located inside a booth isolated from outside noise (e.g., a lab in the university).

Half of the participants will be randomly assigned to one of the two versions of the GV-IAT (version 1 or version 2). Consequently, the presentation order for stimuli will be randomly controlled across participants, and the position on the screen of target categories will be counterbalanced (half to the left; half to the right). In both cases, each subject will undertake a total of 240 trials.

The counterbalanced stimuli in each block appear onscreen, and in each trial, the participants receive immediate feedback of their response and are forced to enter the correct answer in order to continue (forced-choice task). In this respect, it is necessary to point out that, according to the literature, there are two IAT procedures (Nosek et al., 2014; Nosek, Greenwald, & Banaji, 2007): the typical IAT procedure (Greenwald et al., 1998), which includes the provision of immediate feedback when the participant has made an error, at which point the user is forced to enter the correct choice before advancing to the next trial (with feedback); and the personalized IAT procedure (Olson & Fazio, 2004), which did not include error feedback, allowing the IAT to go on, even after an erroneous response, with no correction required (i.e., without feedback). Preliminary research (Sánchez-Prada et al., 2018) provides evidence that the best way to apply the GV-IAT is the forced-choice task or with feedback.

For this reason, it is very important that the stimulus clearly represents the category, so that it generates little doubt for the subject and the results maintain validity. Therefore, if the choice is incorrect, a red X appears and participants must mark the correct answer (if not, the program does not move on), and if the choice is correct, the program goes on to the next stimulus.

In order to facilitate correct performance of the experiment, it is necessary to clarify that the concepts of the target category (Gender violence vs. Non gender violence), as well as the stimuli that describe that category, appear on the computer screen in white letters, while the concepts of the attribute category (Good vs. Bad) and its associated stimulus words appear on the computer screen in green letters.

The OpenSesame (version 3.1.6, Mathôt, Schreij, & Theeuwes, 2012) computer program was used to design the IAT. Specifically, stimuli were displayed on a 20-in. screen with a PC running OpenSesame on Windows 8.

Data analysis

The fundamental principle of the IAT is that where two concepts are strongly associated, and the response latency (RL) is less than when this is not the case. The IAT scores are calculated using a latency-based response obtained in the trials corresponding to compatible critical phase (RLc), and those obtained in the trials corresponding to incompatible critical phase (RLi), as per the order described. Based on those response latencies, and in order to analyze the IAT effect, a D-score is first calculated for each participant, according to the algorithm proposed by Greenwald et al. (Greenwald et al., 2003; Nosek, Greenwald, & Banaji, 2007), and subsequently optimized in several studies (Blanton, Jaccard, & Burrows, 2015; Fazio & Olson, 2003; Glashouwer, Smulders, de Jong, Roefs, & Wiers, 2013; Nosek et al., 2014; Nosek, Greenwald, & Banaji, 2007):

• –

  Step 1: consider for analysis data from Blocks B3 and B4, and B6 and B7. In version 1, the blocks B3 and B4 correspond to the compatible phase (RLc), and the blocks B6 and B7 to the incompatible phase (RLi). In version 2, the blocks B3 and B4 correspond to the incompatible phase (RLi), and the blocks B6 and B7 to the compatible phase (RLc).

• –

  Step 2: remove trials with latencies greater than 10,000 ms.

• –

  Step 3: discard cases in which more than 10% of trials have latencies lower than 300 ms.

• –

  Step 4: calculate the standard deviation for blocks B3 and B6 taken together, and the standard deviation for blocks B4 and B7.

• –

  Step 5: calculate the means of the trials in each of the blocks B3, B4, B6, and B7.

• –

  Step 6: calculate two difference scores (one between B3 and B6, and the other between B4 and B7), subtracting the means obtained in the compatible phase from their respective means in the incompatible phase (i.e., B6 - B3 and B7 - B4 in version 1; B3 - B6 and B4 - B7 in version 2).

• –

  Step 7: each difference of means is divided by its corresponding standard deviation calculated in step 4.

• –

  Step 8: average the two quotients obtained in step 7.

The theoretical basis behind this algorithm is that a shorter response time (RL) indicates greater automatic association between the categories presented (Banaji, 2001). This means that (a) people with rejection attitudes towards IPVAW will have a lower RL when associating theoretically compatible categories (i.e., Gender violence - Bad) than when associating theoretically incompatible categories (i.e., Gender violence - Good) and (b) people with acceptance attitudes towards IPVAW will not perceive as much cognitive dissonance between theoretically incompatible categories (i.e., Gender violence - Good) and will therefore more easily associate them with lower RLs in incompatible phases. The algorithm used estimates how much the RL of a person in an incompatible phase deviates from his own RL in a compatible phase (Dorantes, Ferrero, & Tortosa, 2014). The magnitude of this difference is considered an indicator of the degree of acceptance or rejection towards IPVAW: the greater the rejection, the greater the difference between the RL of the compatible and incompatible phases. In addition, the algorithm corrects for the effects of familiarity with the technique by not computing previous test blocks, which have the singular function of practicing the technique. Therefore, only the responses of the so-called critical phase are computed, which are recorded after a series of previous tests.

Regarding the topic of error latency treatment, there are two procedures recommended according to the literature: (a) replacing each error latency with the mean of the correct latencies for the respective block, adding a 600-ms error penalty (Nosek, Greenwald, & Banaji, 2007) and (b) integrating a “built-in penalty” in error latencies by computing the accumulated time of the wrong response and the time spent in correcting that first response (Greenwald et al., 2003; Nosek et al., 2014; Richetin, Costantini, Perugini, & Schönbrodt, 2015). Previous research (Sánchez-Prada et al., 2018) provides evidence that the best procedure for estimating the IAT effect in the case of the GV-IAT is the built-in error penalty algorithm.

The D-scores obtained are interpreted in a similar way to Cohen's d. Thus, in GV-IAT, positive D-scores express a longer latency time when gender violence is associated with positive stimuli than when it is associated with negative stimuli. This indicates a perception of incongruence between positive stimuli and gender violence (i.e., RLi greater than RLc), and therefore, implicit rejection of gender violence: the higher the value of D, the stronger the rejection. In turn, values close to zero or negative D-scores express low differences in latency times, depending on whether gender violence appears to be associated with positive or negative stimuli, which indicates a perception of congruence between positive stimuli and gender violence (i.e., RLi similar or less than RLc), and therefore, the absence of rejection or implicit acceptance of gender violence. According to Cohen (1988), and in the same line proposed by Greenwald et al. (2003), we considered the rejection of gender violence (i.e., the intensity of the IAT effect) as null rejection if D < .20, as mild if .20 ≤ D < .50, as moderate if .50 ≤ D < .80; and strong if D ≥ .80.

Results

The internal consistency of the GV-IAT was estimated following the split-half procedure recommended by Kurdi et al. (2019), through an online tool (available at https://bkurdi.shinyapps.io/reliCalc/). The average of the distribution of the 600 split-half correlations calculated by this procedure was .73, once a Spearman-Brown correction was applied for split-half reliability (Carpenter et al., 2019; De Houwer & De Bruycker, 2007).

Taking Cohen's interpretation of the effect size magnitude as a reference (Cohen, 1988), the rejection of gender violence measured by the GV-IAT was distributed in this sample as follows: four cases (4.5%) with null rejection, 13 cases (14.6%) with mild rejection, 40 cases (44.9%) with moderate rejection, and 32 cases (36.0%) with strong rejection.

The explicit measures showed a strong explicit rejection of IPVAW, with scores close to the lower pole on a scale of 1 to 4, where the lower the score, the greater the rejection of GBV (M_IBWB = 1.52, SD_IBWB = 0.21; M_IPDMV = 1.60, SD_IPDMV = 0.18).

To compare the scores obtained with explicit (self-reported) and implicit (GV-IAT) measures of attitudes towards IPVAW, the sample was segmented into four groups with approximately 25% of the subjects in each case, based on the quartile scores on the GV-IAT. The results obtained are shown in Table 3.

Table 3
Preliminary results comparing GV-IAT and explicit measures

Group by D-quartiles	IAT effect (IPVAW rejection level)	IBWBa	IPDMVb
D < Q1 (n = 22)	M = 0.354; SD = 0.173 D range = −0.128-0.523 (null—mild rejection)	M = 1.57; SD = 0.255 (n = 20)	M = 1.65; SD = 0.194 (n = 20)
Q1 < D < Q2 (n = 22)	M = 0.631; SD = 0.057 D range = 0.525—0.700 (mild rejection)	M = 1.47; SD = 0.155 (n = 19)	M = 1.61; SD = 0.230 (n = 20)
Q2 < D < Q3 (n = 23)	M = 0.784; SD = 0.048 D range = 0.716—0.859 (moderate—strong rejection)	M = 1.45; SD = 0.173 (n = 19)	M = 1.56; SD = 0.172 (n = 21)
D > Q3 (n = 22)	M = 0.955; SD = 0.082 D range = 0.862—1.219 (strong rejection)	M = 1.57; SD = 0.223 (n = 21)	M = 1.60; SD = 0.185 (n = 21)

• ^a
  Total score in the IBWB. Only 79 participants completed this scale
• ^b
  Total score in the IPDMV. Only 82 participants completed this scale

As can be seen (Table 3), the four groups formed by segmenting the sample from the quartile scores on the GV-IAT differ in the level of rejection to IPVAW in relation to the cut-off points defined by Cohen (1988) and adapted by Greenwald et al. (2003), from null to strong rejection. Additionally, the scores obtained by these four groups on the two explicit measures were compared through an ANOVA and no statistically significant differences were detected either in the IBWB (F(3, 75) = 1.920, p = .134) or in the IPDMV (F(3, 78) = 0.909, p = .441), despite the fact that the degree of implicit accept- ability/rejection of the IPVAW differed between these four groups (as shown by their GV-IAT punctuation). In fact, it could be noted that both explicit measures remain relatively constant and close to the “rejection of the IPDMV” pole (between M = 1.45 and M = 1.65, depending on the group), regardless of the different levels of acceptance-rejection detected with the GV-IAT (Table 3).

Discussion and conclusions

As Garcia-Moreno et al. (2015) point out, the reduction of violence against women and IPVAW requires interventions from different sectors, and changes in individual and institutional discriminatory behaviors and attitudes. In this sense, a significant decrease in the violence against women and girls is achievable, but it requires sustained action to ensure that political commitments translate into meaningful change and support for coordinated, well-funded, evidence-informed strategies implemented by governments, communities, and civil society partners (Krisch, Eisner, Mikton, & Butch- art, 2015). This support must be provided to activities that challenge discriminatory attitudes and behaviors toward women and girls, the tacit approval of violence against them, male control of female behavior, and constructs of masculinity that encourage male violence.

In this context, and because IPVAW is a sensitive area, there is a possibility that the respondents avoid sharing their real beliefs and provide inaccurate information, or socially desirable answers (Eckhardt et al., 2012; Gracia et al., 2015). As a result, the application, use, and interpretation of implicit measures is a relevant alternative because they have the potential to serve as useful methodological tools for testing hypotheses since they are guided by relevant theory and past literature (Fazio & Olson, 2003).

Indeed, the preliminary data obtained, and shown in this paper, have pointed out some strengths of the GV- IAT as a complementary measure to the explicit measures of attitudes toward IPVAW. Firstly, the main strength is that this is, to our knowledge, the first proposal of a personalized IAT that measures attitudes toward IPVAW and that has been designed specifically for Spanish-speaking people. Their use may allow the design of preventive actions and public policies to reduce this form of violence. Secondly, as occurs with all IAT forms, the GV-IAT does not require direct probing of subjects and may therefore reduce the impact of conscious intention or deliberate processes on responses and, consequently, the impact from desirable social effect (Kim, 2003; Nosek, Greenwald, & Banaji, 2007). Thirdly, despite the small size and homogeneity of the sample studied in this preliminary analysis, the GV-IAT internal consistency obtained is satisfactory, and it is in the range of .70-.90 usually reported in the literature on the IAT, demonstrating superiority in this aspect with regard to other implicit measures (Bar-Anan & Nosek, 2014; Gawronski & De Houwer, 2014; Nosek, Greenwald, & Banaji, 2007; Tosi et al., 2018). Finally, the discrepancies observed between implicit and explicit measures indicate that implicit measures would have a higher sensitivity to detect variability in the measured construct, in this case, attitudes towards IPVAW. Furthermore, according to the MODE model (Fazio, 1990; Fazio & Olson, 2014), these data would support the greater robustness, rather than immunity, to social desirability and deliberate misrepresentation of implicit measures, such as GV-IAT, compared to explicit measures (Gawronski & Hahn, 2019; Greenwald, Poehlman, Uhlmann, & Banaji, 2009; Kurdi et al., 2019).

Despite its strengths, this proposal also comes with a number of limitations and challenges. As aforementioned (Nosek, Greenwald, & Banaji, 2007; Rezaei, 2011; Schimmack, 2019; Tosi et al., 2018), the main limitation of the GV-IAT is the same that affects all implicit measures: the lack of direct procedures to obtain conclusive evidence on the validity of the construct (given the involvement of different sources of variation in the measurements obtained, the measurement artefact [responses before a computer screen], the mental processes involved in the responses, and the evolutionary variables that affect the interference of stimulus incongruence, and consequently, the latency times). Another limitation may be the discrepancy between implicit and explicit measures (shown by the low correlations obtained), normally found in research with both types of measurement tools (Hofmann et al., 2005; Kurdi & Banaji, 2019). This result supports the need for greater empirical evidence to advance the construction of a theoretical interpretative framework for the meaning of IAT measures, and also for the meaning of the GV-IAT. Therefore, we consider that providing results related to IPVAW may be an important contribution not only to prevent or reduce IPVAW, but also to support IAT-related research. Moreover, based on this preliminary proposal, new studies could provide more specific evidence on the suitability of GV-IAT, such as the suitability of the stimuli used for the specific measurement of attitudes towards IPVAW in relation to other forms of violence, given the possibility that some subjects may interpret the stimuli related to the category gender violence as examples of violent acts in general, or the words of the category Non gender violence as examples of general non-violent interaction. These results would be of specific interest not only for exploring multi-method forms of measuring attitudes towards IPVAW, but also for exploring the behavior of IAT scores in a new domain that has not yet been explored.

In any case, the discrepancy between implicit and explicit measures cannot be explained solely by factors of social desirability or deliberate attempts at concealment, but rather by the multiple personal, interpersonal, contextual, and methodological moderating factors that are involved (Gawronski & Bodenhausen, 2017; Gawronski & Hahn, 2019; Hofmann et al., 2005; Kurdi et al., 2019; Nosek, 2005). In fact, the processes involved in IAT measures are complex, and despite the progress made in the last two decades, the fundamental debate on the validity of implicit measures in general is still open (Gawronski & Hahn, 2019). Hence, assuming these limitations, it is of the greatest interest to extend the use of IAT measurements to new domains, such as IPVAW, adapting the inferences made to the validity evidence available so far (AERA, APA, & NCME, 2014).

In this regard, recent research suggests that the IAT has limited utility as a measurement method in applied studies or as a measure of individual differences (Tosi et al., 2018); in fact, their most promising use is in a complementary method using the shared variance between IAT scores and explicit measures to control for measurement error in both methods, incorporating a multimethod approach into the measurement of attitudes (Schimmack, 2019). Further studies will be needed to expand sample size and heterogeneity, as well as validity evidence based on the relationship with other variables and response processes (AERA, APA, & NCME, 2014), in order to reach more robust conclusions. All these recommendations can be applied to the GV-IAT proposal presented in this paper.

• Funding
  This work has been financed by the Ministry of Economy and Competitiveness (Ministerio de Economía y Competitividad, MINECO), the Spanish State Research Agency (Agencia Española de Investigación, AEI), and the European Regional Development Fund (Fondo Europeo de Desarrollo Regional, FEDER) through the Research Project FEM2015-63912-P (MINECO/ AEI/FEDER, UE).
• Availability of data and materials
  The dataset supporting the conclusions of this article is available by request to the corresponding author.
• Ethics approval and consent to participate
  The study materials and consent forms have been developed in accordance with ethical norms and guidelines from all participating countries and universities. The study was approved by the Ethics Research Committee (University of Balearic Islands, Spain).
• Publisher's Note
  Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Acknowledgements

We would like to thank the University of Balearic Islands and the Pontifical University of Salamanca for their support in conducting the Project. Furthermore, we thank the team of experts who participated in the selection of the stimuli and the collaborating psychology students.

Abbreviations
• IAT  Implicit Association Test
• GV-IAT  Gender Violence - Implicit Association Test
• VAW  Violence against women
• IPVAW  Intimate partner violence against women

Appendix

Table 4
Target stimuli linked to target category and attribute category (English and original Spanish version)

Categorías	Estímulos
Gender violence (Violencia de género)	Attack (Agredir), Force (Forzar), Humiliate (Humillar), Hit (Pegar), Torture (Torturar), Infringe (Vulnerar)
Non gender violence (No violencia de género)	Support (Apoyar), Collaborate (Colaborar), Cooperate (Cooperar), Empathize (Empatizar), Respect (Respetar), Tolerate (Tolerar)
Good (Bueno)	Wonderful (Maravilloso), Excellent (Excelente), Phenomenal (Fenomenal), Best (Mejor), Positive (Positivo), Optimum (Óptimo)
Bad (Malo)	Horrible (Horrible), Terrible (Terrible), Disastrous (Nefasto), Worst (Peor), Negative (Negativo), Appalling (Pésimo)

References

• Abrahams, N., Jewkes, R., Laubscher, R., & Hoffman, M. (2006). Intimate partner violence: Prevalence and risk factors for men in Cape Town, South Africa. Violence and Victims, 21(2), 247-264.
• AERA, APA, & NCME (2014). Standards for educational and psychological testing Washington, DC: American Educational Research Association.
• Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131-142. https://doi.org/10.1177/0013164485451012
  » https://doi.org/10.1177/0013164485451012
• Banaji, M. R. (2001). Implicit attitudes can be measured. In H. L. Roediqer, I. N. Nairne, & A. M. Suprenant (Eds.), The nature of remembering: Essays in honor of Robert G. Crowder, (pp. 117-149). Washington, DC: APA.
• Banaji, M. R., & Greenwald, A. G. (2013). Blindspot: Hidden biases of good people New York: Delacorte Press.
• Bar-Anan, Y., & Nosek, B. A. (2014). A comparative investigation of seven implicit measures of social cognition. Behavior Research Methods, 46, 668-688. https://doi.org/10.3758/s13428-013-0410-6
  » https://doi.org/10.3758/s13428-013-0410-6
• Blair, I. V., Dasgupta, N., & Glaser, J. (2015). Implicit attitudes. In M. E. Mikulincer, P. R. Shaver, J. F. Dovidio, & J. A. Simpson (Eds.), Handbook of personality and social psychology, volume 1: Attitudes and social cognition, (pp. 665-691). Washington, DC: American Psychological Association. https://doi.org/10.1037/14341-021
  » https://doi.org/10.1037/14341-021
• Blanton, H., Jaccard, J., & Burrows, C. N. (2015). Implications of the implicit association test D-transformation for psychological assessment. Assessment, 22, 429-440. https://doi.org/10.1177/1073191114551382
  » https://doi.org/10.1177/1073191114551382
• Bluemke, M., Crombach, A., Hecker, T., Schalinski, I., Elbert, T., & Weierstall, R. (2017). Is the implicit association test for aggressive attitudes a measure for attraction to violence or traumatization? Zeitschrift für Psychologie/Journal of Psychology, 225, 54-63. https://doi.org/10.1027/2151-2604/a000281
  » https://doi.org/10.1027/2151-2604/a000281
• Briñol, P., Horcajo, J., Becerra, A., Falces, C., & Sierra, B. (2002). Cambio de actitudes implícitas [Change of implicit attitudes]. Psicothema, 14(4), 771-775.
• Cantera, L., & Gamero, V. (2012). Nuevas metodologías en investigación y prevención de la violencia en la pareja [New methodologies in research and prevention of intimate partner violence]. Global Journal of Community Psychology Practice, 3(4), 1-8.
• Cantera, L. M., & Blanch, J. M. (2010). Percepción Social de la Violencia en la Pareja desde los Estereotipos de Género Social [Social perception through gender stereotypes of partner violence]. Psychosocial Intervention, 19, 121-127. https://doi.org/10.5093/in2010v19n2a3
  » https://doi.org/10.5093/in2010v19n2a3
• Capaldi, D. M., Knoble, N. B., Shortt, J. W., & Kim, H. K. (2012). A systematic review of risk factors for intimate partner violence. Partner Abuse, 3, 231-280. https://doi.org/10.1891/1946-6560.3.2.231
  » https://doi.org/10.1891/1946-6560.3.2.231
• Carpenter, T. P., Pogacar, R., Pullig, C., Kouril, M., Aguilar, S., LaBouff, J., … Chakroff, A. (2019). Survey-software implicit association tests: A methodological and empirical analysis. Behavior Research Methods, 51(5), 2194-2208. https://doi.org/10.3758/s13428-019-01293-3
  » https://doi.org/10.3758/s13428-019-01293-3
• Charter, R. A. (2003). A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability. Journal of General Psychology, 130(3), 290-304. https://doi.org/10.1080/00221300309601160
  » https://doi.org/10.1080/00221300309601160
• Cohen, J. (1988). Statistical power analysis for the behavioural sciences, (2nd ed.,). Hillsdale: Erlbaum.
• Copp, J. E., Giordano, P. C., Longmore, M. A., & Manning, W. D. (2019). The development of attitudes toward intimate partner violence: An examination of key correlates among a sample of young adults. Journal of Interpersonal Violence, 34(7), 1357-1387. https://doi.org/10.1177/0886260516651311
  » https://doi.org/10.1177/0886260516651311
• De Houwer, J., & De Bruycker, E. (2007). The Implicit Association Test outperforms the extrinsic affective Simon task as an implicit measure of inter-individual differences in attitudes. British Journal of Social Psychology, 46, 401-421. https://doi.org/10.1348/014466606X130346
  » https://doi.org/10.1348/014466606X130346
• De Houwer, J., Teige-Mocigemba, S., Spruyt, A., & Moors, A. (2009). Implicit measures: A normative analysis and review. Psychological Bulletin, 135, 347-368. https://doi.org/10.1037/a0014211
  » https://doi.org/10.1037/a0014211
• Devries, K. M., Mak, J. Y. T., Garcia-Moreno, C., Petzold, M., Child, J. C., Felder, G., … Watts, C. H. (2013). The global prevalence of intimate partner violence against women. Science, 340, 1527-1528. https://doi.org/10.1126/science.1240937
  » https://doi.org/10.1126/science.1240937
• Dorantes, G., Ferrero, J., & Tortosa, F. (2014). Preferencias implícitas de una muestra española: una técnica novedosa para determinar preferencias raciales [Implicit preferences in a Spanish sample: A new technique to determine racial preference]. Universitas, Psychologica, 14(2), 487-497. https://doi.org/10.11144/Javeriana.upsy14-2.pime
  » https://doi.org/10.11144/Javeriana.upsy14-2.pime
• Echeburua, E., & Fernández-Montalvo, J. (1998). Hombres maltratadores [Male abusers]. In E. Echeburua, & P. Corral (Eds.), Manual de violencia familiar [Handbook of family violence], (pp. 71-175). Madrid: Siglo XXI.
• Eckhardt, C. I., Samper, R., Suhr, L., & Holtzworth-Munroe, A. (2012). Implicit attitudes toward violence among male perpetrators of intimate partner violence: A preliminary investigation. Journal of Interpersonal Violence, 27, 471-491. https://doi.org/10.1177/0886260511421677
  » https://doi.org/10.1177/0886260511421677
• European Union Agency for Fundamental Rights (2014). Violence against women: An EU-wide survey. Main results Luxembourg: Publications Office of the European Union Retrieved from http://fra.europa.eu/sites/default/files/fra-2014-vaw-survey-main-results_en.pdf
  » http://fra.europa.eu/sites/default/files/fra-2014-vaw-survey-main-results_en.pdf
• Expósito, F., & Ruiz, S. (2010). Reeducación de maltratadores: una experiencia de intervención desde la perspectiva de género [Re-education of perpetrators of gender violence: An intervention program with gender perspective]. Psychosocial Intervention, 19, 145-151. https://doi.org/10.5093/in2010v19n2a6
  » https://doi.org/10.5093/in2010v19n2a6
• Fazio, R. H. (1990). Multiple processes by which attitudes guide behavior: The MODE model as an integrative framework. In M. P. Zanna (Ed.), Advances in experimental social psychology, (vol. 23, pp. 75-109). San Diego: Academic.
• Fazio, R. H., & Olson, M. A. (2003). Implicit measures in social cognition. Annual Review of Psychology, 54, 297-327. https://doi.org/10.1146/annurev.psych.54.101601.145225
  » https://doi.org/10.1146/annurev.psych.54.101601.145225
• Fazio, R. H., & Olson, M. A. (2014). The MODE model: Attitude-behavior processes as a function of motivation and opportunity. In J. W. Sherman, B. Gawronski, & Y. Trope (Eds.), Dual-process theories of the social mind, (pp. 155-171). New York: The Guilford Press.
• Ferrer, V. A., & Bosch, E. (2014). Gender violence as a social problem in Spain: Attitudes and acceptability. Sex Roles, 70, 506-521. https://doi.org/10.1007/s11199-013-0322-z
  » https://doi.org/10.1007/s11199-013-0322-z
• Ferrer, V. A., Bosch, E., Ramis, M. C., Torrens, G., & Navarro, C. (2006). La violencia contra las mujeres en la pareja: creencias y actitudes en estudiantes universitarios/as [Partner violence against women: beliefs and attitudes of university students]. Psicothema, 18(3), 359-366.
• Fleiss, J. L. (1986). The design and analysis of clinical experiments New York: Wiley.
• Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33, 613-619. https://doi.org/10.1177/001316447303300309
  » https://doi.org/10.1177/001316447303300309
• Flood, M., & Pease, B. (2009). Factors influencing attitudes to violence against women. Trauma, Violence, & Abuse, 10, 125-142. https://doi.org/10.1177/1524838009334131
  » https://doi.org/10.1177/1524838009334131
• Fulu, E., Jewkes, R., & Garcia-Moreno, C. (2013). Prevalence of and factors associated with male perpetration of intimate partner violence: Findings from the UN multi-country cross-sectional study on men and violence in Asia and the Pacific. The Lancet Global Health, 1, e187-e207. https://doi.org/10.1016/S2214-109X(13)70074-3
  » https://doi.org/10.1016/S2214-109X(13)70074-3
• Garcia-Moreno, C., Zimmerman, C., Morris-Gehring, A., Heise, L., Amin, A., Abrahams, N., & Watts, C. (2015). Addressing violence against women: a call to action. The Lancet, 385, 1685-1695. https://doi.org/10.1016/S0140-6736(14)61830-4
  » https://doi.org/10.1016/S0140-6736(14)61830-4
• García-Sedeño, M., & García-Tejera, M. C. (2013). Estimación de la Validez de Contenido en una Escala de Valoración del Grado de Violencia de Género Soportado en Adolescentes [Estimate of the content validity on a scale to assess gender violence rating supported in adolescents]. Acción Psicológica, 10(2), 41-58. https://doi.org/10.5944/ap.10.241823
  » https://doi.org/10.5944/ap.10.241823
• Gawronski, B., & Bodenhausen, G. V. (2006). Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change. Psychological Bulletin, 132, 692-731. https://doi.org/10.1037/0033-2909.132.5.692
  » https://doi.org/10.1037/0033-2909.132.5.692
• Gawronski, B., & Bodenhausen, G. V. (2017). Beyond persons and situations: an interactionist approach to understanding implicit bias. Psychological Inquiry, 28(4), 268-272.
• Gawronski, B., & De Houwer, J. (2014). Implicit measures in social and personality psychology. In H. T. Reis, & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology, (2nd ed., pp. 283-310). New York: Cambridge University Press.
• Gawronski, B., & Hahn, A. (2019). Implicit measures. Procedures, use, and interpretation. In H. Blanton, J. M. LaCroix, & G. D. Webster (Eds.), Measurement in social psychology, (pp. 29-55). New York: Taylor & Francis.
• Glashouwer, K. A., Smulders, F. T., de Jong, P. J., Roefs, A., & Wiers, R. W. (2013). Measuring automatic associations: Validation of algorithms for the Implicit Association Test (IAT) in a laboratory setting. Journal of Behavior Therapy and Experimental Psychiatry, 44, 105-113. https://doi.org/10.1016/j.jbtep.2012.07.015
  » https://doi.org/10.1016/j.jbtep.2012.07.015
• Gracia, E., Garcia, F., & Lila, M. (2014). Male police officers’ law enforcement preferences in cases of intimate partner violence versus non-intimate interpersonal violence: Do sexist attitudes and empathy matter? Criminal Justice and Behavior, 41, 1195-1213. https://doi.org/10.1177/0093854814541655
  » https://doi.org/10.1177/0093854814541655
• Gracia, E., & Lila, M. (2015). Attitudes towards violence against women in the EU Luxembourg: European Commission Directorate-General for Justice.
• Gracia, E., Rodríguez, C. M., & Lila, M. (2015). Preliminary evaluation of an analogue procedure to assess acceptability of intimate partner violence against women: The partner violence acceptability movie task. Frontiers in Psychology, 6, 1567. https://doi.org/10.3389/fpsyg.2015.01567
  » https://doi.org/10.3389/fpsyg.2015.01567
• Gracia, E., & Tomás, J. M. (2014). Correlates of victim-blaming attitudes regarding partner violence against women among the Spanish general population. Violence Against Women, 20(1), 26-41. https://doi.org/10.1177/1077801213520577
  » https://doi.org/10.1177/1077801213520577
• Greenwald, A. G., & Banaji, M. R. (2017). The implicit revolution: Reconceiving the relation between conscious and unconscious. American Psychologist, 72, 861-871. https://doi.org/10.1037/amp0000238
  » https://doi.org/10.1037/amp0000238
• Greenwald, A. G., Banaji, M. R., Rudman, L. A., Farnham, S. D., & Nosek, B. A. (2002). A unified theory of implicit attitudes, stereotypes, selfesteem, and self-concept. Psychological Review, 109, 3-25.
• Greenwald, A. G., & Farnham, S. D. (2000). Using the Implicit Association Test to measure self-esteem and self-concept. Journal of Personality and Social Psychology, 79, 1022-1038.
• Greenwald, A. G., McGhee, D. E., & Schwartz, J. K. L. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464-1480.
• Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003). Understanding and using the implicit association test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197-216.
• Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009). Understanding and using implicit association test: III: Meta-analysis of predictive validity. Journal of Personality and Social Psychology, 97, 17-41. https://doi.org/10.1037/a0015575
  » https://doi.org/10.1037/a0015575
• Heise, L., & Kotsadam, A. (2015). Cross-national and multilevel correlates of partner violence: An analysis of data from population-based surveys. The Lancet Global Health, 3, e332-e340. https://doi.org/10.1016/S2214-109X(15)00013-3
  » https://doi.org/10.1016/S2214-109X(15)00013-3
• Hofmann, W., Gawronski, B., Gschwendner, T., Le, H., & Schmitt, M. (2005). A meta-analysis on the correlation between the implicit association test and explicit self-report measures. Personality and Social Psychology Bulletin, 31(10), 1369-1385. https://doi.org/10.1177/0146167205275613
  » https://doi.org/10.1177/0146167205275613
• Jewkes, R., Flood, M., & Lang, J. (2015). From work with men and boys to changes of social norms and reduction of inequities in gender relations: A conceptual shift in prevention of violence against women and girls. The Lancet, 385, 1580-1589. https://doi.org/10.1016/S0140-6736(14)61683-4
  » https://doi.org/10.1016/S0140-6736(14)61683-4
• Kihlstrom, J. F. (2004). Implicit methods in social psychology. In C. C. Sansona, & A. T. Panter (Eds.), The Sage handbook of methods in social psychology, (pp. 195-212). London: SAGE.
• Kim, D. Y. (2003). Voluntary controllability of the implicit association test (IAT). Social Psychology Quarterly, 66(1), 83-96.
• Krisch, M., Eisner, M., Mikton, C., & Butchart, A. (2015). Global strategies to reduce violence by 50% in 30 years: Findings from the WHO and University of Cambridge Global Violence Reduction Conference 2014 Cambridge: University of Cambridge.
• Kurdi, B., & Banaji, M. R. (2019). Relationship between the Implicit Association Test and explicit measures of intergroup cognition: Data from the meta-analysis by Kurdi et al. (2018) https://doi.org/10.31234/osf.io/vpcx8
  » https://doi.org/10.31234/osf.io/vpcx8
• Kurdi, B., Seitchik, A. E., Axt, J. R., Carroll, T. J., Karapetyan, A., Kaushik, N., … Banaji, M. R. (2019). Relationship between the Implicit Association Test and intergroup behavior: A meta-analysis. American Psychologist, 74(5), 569-586. https://doi.org/10.1037/amp0000364
  » https://doi.org/10.1037/amp0000364
• Larue, D., Schmidt, A. F., Imhoff, R., Eggers, K., Schönbrodt, F. D., & Banse, R. (2014). Validation of direct and indirect measures of preference for sexualized violence. Psychological Assessment, 26, 1173-1183. https://doi.org/10.1037/pas0000016
  » https://doi.org/10.1037/pas0000016
• Lee, M. S., Begun, S., DePrince, A. P., & Chu, A. T. (2016). Acceptability of dating violence and expectations of relationship harm among adolescent girls exposed to intimate partner violence. Psychological Trauma: Theory, Research, Practice, and Policy, 8, 487-494. https://doi.org/10.1037/tra0000130
  » https://doi.org/10.1037/tra0000130
• Leitner, J. B., Hehman, E., Ayduk, O., & Mendoza-Denton, R. (2016). Racial bias is associated with ingroup death rate for Blacks and Whites: Insights from Project Implicit. Social Science & Medicine, 170, 220-227. https://doi.org/10.1016/j.socscimed.2016.10.007
  » https://doi.org/10.1016/j.socscimed.2016.10.007
• Mathôt, S., Schreij, D., & Theeuwes, J. (2012). OpenSesame: An open-source, graphical experiment builder for the social sciences. Behavior Research Methods, 44, 314-324. https://doi.org/10.3758/s13428-011-0168-7
  » https://doi.org/10.3758/s13428-011-0168-7
• McConnell, A. R., & Liebold, J. M. (2001). Relations between the Implicit Association Test, explicit racial attitudes, and discriminatory behavior. Journal of Experimental Social Psychology, 37, 435-442.
• McConnell, A. R., & Rydell, R. J. (2019). The Implicit Association Test: Implications for understanding consumer behavior. In F. R. Kardes, P. M. Herr, & N. Schwarz (Eds.), Handbook of research methods in consumer psychology, (pp. 143-159). New York: Routledge.
• Meil, G. (2014). Percepción social de la violencia de género [Social perception of gender violence]. Madrid: Ministerio de Sanidad, Servicios Sociales e Igualdad. Centro de Publicaciones.
• Nosek, B. A. (2005). Moderators of the relationship between implicit and explicit evaluation. Journal of Experimental Psychology: General, 134, 565-584. https://doi.org/10.1037/0096-3445.134.4.565
  » https://doi.org/10.1037/0096-3445.134.4.565
• Nosek, B. A., Bar-Anan, Y., Sriram, N., Axt, J., & Greenwald, A. G. (2014). Understanding and using the brief implicit association test: Recommended scoring procedures. PLoS One, 9(12), e110938. https://doi.org/10.1371/journal.pone.0110938
  » https://doi.org/10.1371/journal.pone.0110938
• Nosek, B. A., Greenwald, A. G., & Banaji, M. R. (2007). The implicit association test at age 7: A methodological and conceptual review. In J. A. Bargh (Ed.), Automatic processes in social thinking and behavior, (pp. 265-292). London: Psychology Press.
• Nosek, B. A., Hawkins, C. B., & Frazier, R. S. (2011). Implicit social cognition: From measures to mechanisms. Trends in Cognitive Sciences, 15, 152-159. https://doi.org/10.1016/j.tics.2011.01.005
  » https://doi.org/10.1016/j.tics.2011.01.005
• Nosek, B. A., Smyth, F. L., Hansen, J. J., Devos, T., Lindner, N. M., Ranganath, K. A., … Banaji, M. R. (2007). Pervasiveness and correlates of implicit attitudes and stereotypes. European Review of Social Psychology, 18, 36-88. https://doi.org/10.1080/10463280701489053
  » https://doi.org/10.1080/10463280701489053
• Nosek, B. A., Smyth, F. L., Sriram, N., Linder, N. M., Devos, T., Ayala, A., & Greenwald, A. G. (2009). National differences in gender-science stereotypes predict national sex differences in science and math achievement. Proceedings of the National Academy of Sciences, 106, 10593-10597. https://doi.org/10.1073/pnas.0809921106
  » https://doi.org/10.1073/pnas.0809921106
• Obeid, N., Chang, D. F., & Ginges, J. (2010). Beliefs about wife beating: An exploratory study with Lebanese students. Violence Against Women, 16, 691-712. https://doi.org/10.1177/1077801210370465
  » https://doi.org/10.1177/1077801210370465
• Olson, M. A., & Fazio, R. H. (2004). Reducing the influence of extra-personal associations on the implicit association test: Personalizing the IAT. Journal of Personality and Social Psychology, 86, 653-667. https://doi.org/10.1037/0022-3514.86.5.653
  » https://doi.org/10.1037/0022-3514.86.5.653
• Organic Act 1/2004, of 28 December, on Integrated Protection Measures against Gender Violence (2004). Boletín Oficial del Estado, núm. 313, 42166-42197. Retrieved from: https://www.boe.es/boe/dias/2004/12/29/
  » https://www.boe.es/boe/dias/2004/12/29/
• Paulhus, D. L., & Vazire, S. (2007). The self-report method. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology, (pp. 224-239). New York: Guilford Press.
• Payne, B. K., & Gawronski, B. (2010). A history of implicit social cognition: Where is it coming from? Where is it now? Where is it going? In B. K. Payne, & B. Gawronski (Eds.), Handbook of implicit social cognition: Measurement, theory, and applications, (pp. 1-15). New York: Guilford Press.
• Payne, B. K., Krosnick, J. A., Pasek, J., Lelkes, Y., Akhtar, O., & Tompson, T. (2010). Implicit and explicit prejudice in the 2008 American presidential election. Journal of Experimental Social Psychology, 46, 367-374. https://doi.org/10.1016/jjesp.2009.11.001
  » https://doi.org/10.1016/jjesp.2009.11.001
• Petty, R. E., Briñol, P., & DeMarree, K. G. (2007). The Meta-Cognitive Model (MCM) of attitudes: Implications for attitude measurement, change, and strength. Social Cognition, 25, 657-686. https://doi.org/10.1521/soco.2007.25.5.657
  » https://doi.org/10.1521/soco.2007.25.5.657
• Puente, A., Ubillos, S., Echeburua, E., & Paez, D. (2016). Risk factors associated with the violence against women in couples: A review of meta-analysis and recent studies. Anales de Psicología, 32(1), 295-306. https://doi.org/10.6018/analesps.32.1.189161
  » https://doi.org/10.6018/analesps.32.1.189161
• Rezaei, A. R. (2011). Validity and reliability of the IAT: Measuring gender and ethnic stereotypes. Computers in human behavior, 27(5), 1937-1941. https://doi.org/10.1016/j.chb.2011.04.018
  » https://doi.org/10.1016/j.chb.2011.04.018
• Richetin, J., Costantini, G., Perugini, M., & Schönbrodt, F. (2015). Should we stop looking for a better scoring algorithm for handling implicit association test data? Test of the role of errors, extreme latencies treatment, scoring formula, and practice trials on reliability and validity. PLoS One, 10(6), e0129601. https://doi.org/10.1371/journal.pone.0129601
  » https://doi.org/10.1371/journal.pone.0129601
• Robertson, K., & Murachver, T. (2007). Correlates of partner violence for incarcerated women and men. Journal of Interpersonal Violence, 22, 639-655. https://doi.org/10.1177/0886260506298835
  » https://doi.org/10.1177/0886260506298835
• Ryan, K. M. (2013). Issues of reliability in measuring intimate partner violence during courtship. Sex Roles, 69, 131-148. https://doi.org/10.1007/s11199-012-0233-4
  » https://doi.org/10.1007/s11199-012-0233-4
• Samayoa, J. A. G., & Fazio, R. H. (2017). Who starts the wave? Let's not forget the role of the individual. Psychological Inquiry, 28, 273-277. https://doi.org/10.1080/1047840X.2017.1373554
  » https://doi.org/10.1080/1047840X.2017.1373554
• Sánchez-Prada, A., Delgado-Álvarez, C., Bosch-Fiol, E., & Ferrer-Pérez, V. A. (2018). Implicit and explicit attitudes toward intimate partner violence against women: An exploratory study. Journal of Interpersonal Violence, 1-21. https://doi.org/10.1177/0886260518789903
  » https://doi.org/10.1177/0886260518789903
• Saunders, D. G., Lynch, A. B., Grayson, M., & Linz, D. (1987). The inventory of beliefs about wife beating: The construction and initial validation of a measure of beliefs and attitudes. Violence and Victims, 2, 39-57.
• Schimmack, U. (2019). The Implicit Association Test: A method in search of a construct. Perspectives on Psychological Science, 1-19. First on line. https://doi.org/10.1177/1745691619863798
  » https://doi.org/10.1177/1745691619863798
• Scott, K., & Straus, M. (2007). Denial, minimization, partner blaming, and intimate aggression in dating partners. Journal of Interpersonal Violence, 22, 851-871. https://doi.org/10.1177/0886260507301227
  » https://doi.org/10.1177/0886260507301227
• Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420-428. https://doi.org/10.1037/0033-2909.86.2.420
  » https://doi.org/10.1037/0033-2909.86.2.420
• Simane-Vigante, L., Plotka, I., & Blumenau, N. (2015). Research of attitudes towards criminal violence with implicit and explicit measures of cognition. Journal of Education, Psychology and Social Sciences, 3(2), 72-77.
• Spanish Government Office for Gender-Based Violence (2014). Análisis de la encuesta sobre percepción social de la violencia de género Madrid: Ministerio de Sanidad, Servicios Sociales e Igualdad.
• Spanish Ministry of Health, Social Services and Equality (2013). Percepción Social de la Violencia de Género. Colección contra la violencia de Género Madrid: Ministerio de Sanidad, Asuntos Sociales e Igualdad. Centro de Publicaciones.
• Spanish Ministry of Health, Social Services and Equality (2015). Macroencuesta de violencia contra la mujer Madrid: Ministerio de Sanidad, Asuntos Sociales e Igualdad. Centro de Publicaciones.
• Stockl, H., Devries, K., Rotstein, A., Abrahams, N., Campbell, J., Watts, C., & Garcia-Moreno, C. (2013). The global prevalence of intimate partner homicide: A systematic review. The Lancet, 382, 859-865. https://doi.org/10.1016/S0140-6736(13)61030-2
  » https://doi.org/10.1016/S0140-6736(13)61030-2
• Süssenbach, P., Albrechet, S., & Bohner, G. (2017). Implicit judgements of rape cases: An experiment on the determinants and consequences of implicit evaluations in a rape case. Psychology, Crime & Law, 23, 291-304. https://doi.org/10.1080/1068316X.2016.1247160
  » https://doi.org/10.1080/1068316X.2016.1247160
• Tosi, J. D., Ledesma, D., Poo, F. M., Montes, S. A., & López, S. S. (2018). The implicit Association Test. A methodological review. Revista Iberoamericana de Diagnóstico y Evaluación Psicológica - e Avaliaçao Psicológica. RIDEP, 46(1), 175-187. https://doi.org/10.21865/RIDEP46.1.13
  » https://doi.org/10.21865/RIDEP46.1.13
• United Nations (2006). In-depth study on all forms of violence against women New York: United Nations.
• Wang, L. (2016). Factors influencing attitude toward intimate partner violence. Aggression and Violent Behavior, 29, 72-78. https://doi.org/10.1016/j.avb.2016.06.005
  » https://doi.org/10.1016/j.avb.2016.06.005
• World Health Organization (2013). Global and regional estimates of violence against women: Prevalence and health effects of intimate partner violence and non-partner sexual violence Geneva: World Health Organization.

Publication Dates

• Publication in this collection
  04 Dec 2020
• Date of issue
  2020

History

• Received
  26 Feb 2020
• Accepted
  01 Nov 2020
• Published
  10 Nov 2020