STRATA
Skip to study
XLVII

V.08 / DISCOVERY

Replication, reproducibility, and preregistration

What happens when an independent group collects new observations under a preregistered protocol?

A source-led introduction1 source references0 related experiments

Start with the question.

Reproducibility and replication become clearer when the intended repeat is named. Re-running the same analysis, collecting new observations under similar conditions, and testing a related mechanism answer different questions. The Open Science Collaboration's project provides a documented example of organized replication. Preregistration adds a time-stamped plan that helps distinguish intended analyses from decisions made after examining results.

Separate three kinds of repeat.

Take a published plot and ask first whether its shared data and code regenerate the figure. Next ask whether new data under the same protocol support a comparable estimate. Finally change one condition to test the proposed mechanism. Record a separate outcome for each task so that one successful repeat does not stand in for all three.

What would you inspect?

  • Data and code availability, protocol fidelity, and deviations from a dated plan.
  • Effect estimates and uncertainty across original and follow-up studies.

Take the next step.

Choose one study with accessible materials and specify which kind of repeat is feasible before describing what its outcome would establish.

Read the supporting material.

  1. Estimating the reproducibility of psychological science

    Open Science Collaboration / Science · A coordinated replication project and its stated design; supports study-level reproducibility questions.

Continue through the versioned study records.

Follow the comparisons.

Read the neighboring questions.