Research Methods: A Comprehensive Guide for Students and Researchers
Research Methods: A Comprehensive Guide
Problem Statement
A well-articulated problem statement clearly defines the research problem and provides an argument that justifies the need for the study.
Purpose Statement
The purpose statement outlines the specific aim or goal of the study.
Variables
Independent Variables
- Presumed cause or influence
- Causes a change in the outcome of interest
- May be an intervention
Dependent Variable
- Presumed effect or outcome variable
- Variable researchers are trying to understand, explain, or predict
Experimental Designs
Randomized Controlled Trial (RCT)
- Best evidence that the intervention caused the outcome
- Gold standard for establishing causation
- Multiple RCTs can be combined in a meta-analysis
Limitations:
- Many research variables cannot be manipulated ethically or realistically
- Randomization may not be possible
- Subject to the Hawthorne Effect
Quasi-Experimental Designs
- Enhanced practicality
- Some control
- Participants may not always be willing to be randomized
Limitations:
- Cause and effect may be difficult to establish
- Non-equivalence between groups
Non-Experimental Designs
- Study problems that cannot be investigated experimentally
- Can gather information on relationships between multiple variables
- Experimental studies often rely on descriptive correlational studies
Limitations:
- No causation can be established
- Self-selection bias
Manipulation, Observation, Randomization, and Control
- Manipulation: Is there an intervention?
- Observation: When and how often are the researchers collecting data?
- Randomization: How many groups are being compared?
- Control: What is done to the control group instead of the intervention?
Counterfactual
The counterfactual describes what is done to the control group instead of the intervention, such as:
- No intervention
- No treatment
- Alternative treatment
- Placebo
- Standard care or usual care
- Modified treatment (lower dose, partial intervention)
- Delayed treatment (waitlisting control group)
Probability Sampling
Probability sampling ensures that each element of an accessible population has an equal chance of being selected for the sample.
- Simple Random Sampling: Requires a sampling frame (list of all available members in the population)
- Stratified Random Sampling: The sampling frame is divided into strata, and random sampling is completed from each stratum separately
- Cluster Sampling: Successive random sampling at multiple stages
- Systematic Sampling: Every kth case is selected
Non-Probability Sampling
Non-probability sampling methods do not ensure equal chances of selection for all elements in the population.
- Convenience Sampling: Uses the most available individuals
- Volunteer Sampling: Recruits participants through newspaper ads or posters
- Snowball Sampling: Participants recruit other participants through word of mouth
- Consecutive Sampling: Recruits all people from an accessible population over time
- Quota Sampling: Ensures proportional representation of population strata
- Purposive Sampling: Selects participants based on specific criteria
Sample Size
Power analysis can be used to determine the appropriate sample size for a study.
Informed Consent
Informed consent is obtained from participants before they participate in a study. This includes providing them with information about the study and their rights.
Confidentiality
Confidentiality procedures are used to protect the privacy of participants. This may include using anonymous numbers instead of names and securing information.
Statistical Tests
T-test
- Used to test the statistical significance of a difference between means of two groups
- Parametric (assumes a normal distribution)
- Independent group t-test (means of different groups)
- Dependent group t-test or paired t-test (means of the same group)
ANOVA (Analysis of Variance)
- Measures significant differences in means of three or more groups
- Parametric (assumes a normal distribution)
- F-ratio
- Multiple comparison procedures (post hoc tests) to identify which group caused the significant difference
- Repeated measures ANOVA (when means are compared at different points in time)
Chi-squared Test (χ2)
- Non-parametric test (does not require a normal distribution)
- Compares differences in proportions in two or more groups
- Nominal or ordinal data
- 2 x 2 crosstab table
Correlation Coefficients (Pearson’s r)
- Parametric
- Measures the magnitude and direction of a relationship between two variables
- Any correlation greater than r = 0.70 is considered strong
Multivariate Analysis
- Deals with comparing three or more variables simultaneously
- Multiple regression uses F tables when squared R2
- ANCOVA (combination of ANOVA and multiple regression)
- MANOVA (multivariate and ANOVA)