Why methods matter
Good research is built on a chain of methodological decisions.
Methodological rigour comes from coherence across the research process. The question, population, measurements, design, analysis and interpretation need to align with the inference the study is intended to support.
What exactly does the research need to answer?
Research should start with the question, not with a preferred method or available dataset. An initial idea needs to be developed into a clear, focused and answerable research question that can guide the rest of the study.
This means clarifying what the research is trying to understand or estimate, why the question matters, and whether its scope is realistic. From there, the question can be translated into specific objectives and, where appropriate, hypotheses and a study plan.
The population, sample and measurements determine what the study can tell us.
Once the question is clear, the next step is to define the population the study is intended to inform and the sample that will actually be studied. Selection criteria, sampling and recruitment all affect how confidently findings can be interpreted and applied.
At the same time, the study needs measurements that capture the concepts of interest with sufficient validity and reliability. Poorly chosen variables or instruments can limit a study even when the design and analysis are otherwise sound.
Different questions require different designs.
Once the question, population and measurements are defined, the study design determines how the evidence will be generated. The choice between observational and experimental approaches — and between designs such as cohort, cross-sectional, case-control or randomised studies — should follow from what the research needs to establish.
A good design creates a credible path from the research question to the result. It should make the comparison, timing and source of evidence explicit, while balancing methodological strength with feasibility.
Random and systematic error affect different aspects of inference.
Every study is affected by error, but not all error is the same. Random error determines how precisely an effect or association can be estimated. Systematic error determines whether that estimate is centred on the truth at all.
Good methodological planning considers both: reducing random variability where possible, identifying potential sources of systematic distortion, and making the remaining uncertainty visible in the interpretation.
Precision
- Sample size
- Sampling variability
- Random measurement error
- Statistical uncertainty
Validity
- Selection bias
- Measurement bias
- Confounding
- Design and analytical assumptions
How much do the conclusions change when plausible assumptions or sources of error are challenged?
Implementation affects study validity and data quality.
Implementation problems in recruitment, measurement or data collection can compromise an otherwise appropriate design. The protocol therefore needs to be translated into procedures that can be applied consistently and as intended in the real setting.
This means thinking in advance about feasibility, ethics, operational processes, data quality and the controls needed to ensure that the study is conducted as intended.
Analysis and interpretation should remain aligned with the research question and design.
Analysis should follow from the research question and study design, not be treated as a separate technical exercise at the end. A clear analytical strategy helps distinguish planned comparisons from exploratory findings, makes assumptions explicit and provides a defensible route from data to conclusions.
Interpretation then requires more than reporting statistical results. It means considering effect size, uncertainty, robustness, possible limitations and whether the findings actually support the claims being made. Communication should make that reasoning transparent to the intended audience.
METHODS95
Methodological coherence
Each methodological decision constrains what follows. Methodological coherence means maintaining a defensible link from the research question through design and analysis to an interpretation supported by the evidence.
Explore methodological services →