Designing and Reporting Experiments in Psychology Peter Harris
     
 
 
 
Designing & Reporting Experiments in Psychology 3/e
 
  Buy this Book  
     
  A. Choosing a statistical test  
  B. Reporting specific inferential statistics  
  C. More on main effects, interactions and graphing interactions  
  C1 Main effects of independent variables  
  C2 Interactions between independent variables  
  C3 Interpreting main effects and interactions  
  C4 Interactions qualify main effects  
  C5 Graphing interactions  
  C6 Graphing three-way interactions  
  C7 A list of the possible effects in designs with two, three, or four IVs  
  D. Rules for writers  
  E. Reporting studies that include questionnaires  
  F. Experimental and nonexperimental data: Some things to watch out for  
  G. Some tips for advanced students to improve your experiments yet further  
  H. Some issues to consider in the RESULTS sections of your later reports and your projects  
  I. Final year projects  
     
 
Related Statistics Books
 
  Pallant, SPSS Survival Manual  
     
  Greene & D'Oliveira, Learning to Use Statistical Tests in Psychology  
     
   
More on main effects, interactions and graphing interactions

 

C4 Interactions qualify main effects

Figure C4. No main effects of either IV but “classic” or “cross-over” interaction between alcohol and music.

Interaction effects like those depicted in Figure C3 occur when the variables in combination produce effects that are bigger in magnitude but in the same direction as their effects alone. Interactions between IVs can also occur when the effect of the level of one IV is opposite at the levels of the other – as depicted in Figure C4. Here listening to music counteracts the impact of alcohol. For some reason, music impairs the driving performance of those who have not been drinking alcohol. (Perhaps it distracts them.) However, it improves the driving performance of those who have been drinking alcohol. (Perhaps it calms them down or helps to focus their attention.) Nevertheless, we still have an interaction between the IVs. The effect of music is inconsistent at the levels of the alcohol IV.

However, in this case, because the effects of music are opposite and approximately equal at the levels of the alcohol IV, there are no significant main effects. That is, in this case, the marginal means for alcohol and no alcohol are unlikely to be very different from each other. The same is likely to be true for the marginal means for music and no music. The effects more or less cancel each other out. Thus we have here an interaction but no main effects.

Under these circumstances we would have to be very cautious when talking about the absence of main effects in our data. Why? Because we know from the data that alcohol does affect driving (making it worse when people are not listening to music but better when they are). Likewise, we know from the data that music does affect driving (making it worse when people have not been drinking alcohol but better when they have been drinking alcohol). This illustrates an important point for interpreting data from studies involving more than one IV. Significant interactions qualify main effects of the IVs involved in the interaction. In this case, what we say about the overall effect of alcohol or music is qualified. We know that we can be more accurate if we talk about the effects of alcohol and music in combination. In this case, the interaction represents an improvement in our knowledge over any statements that we make about the main effects. We therefore qualify any statements that we make about the absence of main effects and give precedence to the interaction when discussing the findings. (Note that this is also true if there are significant main effects. The presence of a significant interaction always qualifies a main effect because it provides more specific information about the effects of the IVs involved.)

Several other points I hope are also clear from this discussion. First, when it comes to the analyses, you can find statistically significant main effects, statistically significant interactions, or both. Second, graphing significant interactions can be a very useful aid to interpreting them. This has been clear for even the 2 x 2 design discussed here. It is even more so when you have more levels on your IVs or more IVs involved in the interaction (or both). (For more on when and how to use graphs in your reports see sections 8.5 and 13.7 of the book.)

 

 

 

Open University PressMcGraw-Hill logo