Designing and Reporting Experiments in Psychology Peter Harris
     
 
 
 
Designing & Reporting Experiments in Psychology 3/e
 
  Buy this Book  
     
  A. Choosing a statistical test  
  B. Reporting specific inferential statistics  
  C. More on main effects, interactions and graphing interactions  
  D. Rules for writers  
  E. Reporting studies that include questionnaires  
  E1 Studies involving questionnaire  
  E2 Design  
  E3 Questionnaire development  
  E4 Materials  
  E5 Procedure  
  E6 Computer presentation  
  E7 Results  
  E8 Reporting non experimental studies  
  E9 The reliability and validity of your measures  
  E10 An example to help you report studies using Theory of Planned Behavior (TPB) measures  
  F. Experimental and nonexperimental data: Some things to watch out for  
  G. Some tips for advanced students to improve your experiments yet further  
  H. Some issues to consider in the RESULTS sections of your later reports and your projects  
  I. Final year projects  
     
 
Related Statistics Books
 
  Pallant, SPSS Survival Manual  
     
  Greene & D'Oliveira, Learning to Use Statistical Tests in Psychology  
     
   
Reporting studies that include questionnaires

 

E8 Reporting non experimental studies

Of course, your particular study may not actually be an experiment. To determine whether your study is experimental, ask yourself whether any of the variables that look like IVs have involved the random allocation of participants to conditions or of orders of conditions to participants. If not, then your study is not experimental and you should not describe it as one. (You can find more about variables that are not true IVs in Section 13.8 of the book and also Section F of this Web site.)

A strict approach would bar you from referring to IVs and DVs in the DESIGN of such a study. Instead, you might use terms such as predictor variables and criterion variables. (You can find more about other alternative terms you could use in Section 13.8 of the book.) However, you will come across published papers of nonexperimental studies that refer to independent variables so there is no consensus on this.

The main thing is that you do not describe your study as experimental when it is not. If you elect to include a DESIGN section, describe the type of study clearly. Here is a very broad template that can help you with this:

 

Design

The study employed a nonexperimental approach to investigate the relationship between XXX and YYY. Principal questions/items used to measure XXX were [specify]. Scales used were [describe typical scales]. Exceptions included [describe any exceptions]. Principal questions/items used to measure YYY were [specify]. Scales used were [describe typical scales]. Exceptions included [describe any exceptions].

Here is an example using the above template:

 

Design

The study employed a nonexperimental approach to investigate the relationship between variables in Taylor’s (1983) theory of cognitive adaptation (TCA) and response to contracting venous thrombosis. Items measured the core constructs of the TCA: meaning, mastery, self-esteem and optimism. Outcome variables were measures of anxiety, depression, thrombosis worries and quality of life.

Precise details of the measures developed or used to assess the variables in the TCA and to measure the outcomes would then appear in the MATERIALS or MEASURES section. You can see how this has been done in the above study if you read the original reference:

Moore, T. J., Norman, P., & Harris, P. R. (2006). Cognitive appraisals as predictors of psychological distress following venous thromboembolic disease: An application of the theory of cognitive adaptation. Social Science and Medicine,63, 2395-2406.

Depending on the nature of the study you may nevertheless be able to report it using the typical sections of the report, with a lengthier MATERIALS and shorter PROCEDURE than is the norm for laboratory-based experiments and perhaps with the section on questionnaire development described in Section E3 of this Web site. However, these labels may not be the most appropriate for the material you need to describe, in which case you should consider suitable alternatives, such as QUESTIONNAIRE or MEASURES instead of MATERIALS and ADMINISTRATION instead of PROCEDURE. The important thing is to make sure you report the material clearly and accurately.

With a questionnaire used as a survey, you will need to concern yourself with the details of how you went about sampling and from what population rather more than is the norm for laboratory-based experiments. External validity is central to surveys. (To find out more about external validity see Section 10.8 of the book.) You might consider sections labelled POPULATION and SAMPLE respectively.

Summary

1

Do not describe your study as experimental when it is not.

2 You may be able to report a nonexperimental study using the typical sections of the report. However, depending on the nature of the study, you might consider alternative labels for some of the sections, such as QUESTIONNAIRE instead of MATERIALS and ADMINISTRATION instead of PROCEDURE.
3 With surveys, issues of external validity are central and you will need to provide details of how you sampled and of the population from which you sampled. You may wish to include sections labelled POPULATION and SAMPLE to describe these aspects of your study.

 

 

 

 

Open University PressMcGraw-Hill logo