When we are first confronted with new terminology and new information, it can sometimes be useful to use a set of questions in order to aid understanding.
The following is a list of questions that can be used as a basic tool for assessing the quality of a study. It is only a guideline and readers are encouraged to identify other limitations and identify other questions that can be applied to a study.
- Is the journal in which the article is published peer-reviewed?
- Who funded and conducted the study?
- Does the abstract reflect the overall purpose and findings of the study?
- What type of study design was used?
- How strong is the link between cause and effect in the study design?
- What are the levels of internal/external validity in the study design?
- Is the research question addressed by the study specifically defined?
- Were the instrument(s) used for outcome measures appropriate, accurate and valid?
- Was there a control group in the study design?
- Was randomization used?
- Were blinding procedures used for both the subjects and the personnel taking the measurements?
- What sample size was used?
- Were all groups similar at the beginning of the study?
- Were all groups treated equally?
- Were all of the subjects accounted for at the end of the study?
- Did the study have statistical power?
- Could the study be replicated?
- Are all relevant data presented in a meaningful way?
- Are weaknesses or limitations of the study identified and discussed?
- Do the author's comments and conclusions logically follow from the data?
- Are the conclusions in line with the study objective?
- Were all climically important outcomes considered?
- Will this study have any impact or relevance to your practice or to the practice of other massage therapists?
- How up-to-date and relevant is the referenced material?
- Did the author cover enough referenced material?
If the study is a systematic review or meta-analysis:
- is the pooled data combined correctly?
- is the method used to select studies accurately described, along with inclusion and exclusion criteria?
- are the conclusions backed by the data provided?
