B10
Bayesian updating and information gain
Which measurement changes the posterior most under each plausible prior?

V.06 / DISCOVERY
How much does a new observation change the odds assigned to two competing explanations?
Bayesian updating expresses how a prior distribution and a likelihood combine into a posterior distribution. Bayes's historical essay provides an early primary text in this lineage. In practical inquiry, the useful discipline is to state the competing possibilities and the probability of the observed evidence under each. This makes a change in belief inspectable instead of leaving it as an impression.
Imagine a condition present in 10 percent of a population. A hypothetical test is positive for 90 percent of cases and 10 percent of noncases. Among 1,000 people, the expected positive counts are 90 and 90, so a positive result corresponds to a 50 percent posterior probability under these assumptions. Changing the base rate changes that answer.
Recalculate the example with a different prior and then with dependent evidence, recording exactly which assumption changes the posterior.
These models isolate a mechanism you can vary. Their assumptions define the part of this topic they can illuminate.
Change one parameter, compare the numerical output, and export the result. The experiment loads when you open it.
Follow a screening result back through the population that produced it.
A hypothetical batch contains 10,000 components. Detection is fixed at 99 percent and false flags at 5 percent.
The defect rate rises from 1 percent toward 20 percent. Orange shows actual defects that are flagged; cream shows sound items that are falsely flagged.
The posterior is true flags divided by all flags. Changing the starting population changes this fraction even when both screening rates stay fixed.
Method. Apply each conditional rate to its own population. True flags equal the defective population multiplied by the detection rate; false flags equal the sound population multiplied by the false-flag rate. Divide true flags by all flags to obtain the posterior probability.
Thomas Bayes, communicated by Richard Price / University of York transcription · The historical essay on inference from observed outcomes; current exercises are explicitly constructed examples.
B10
Which measurement changes the posterior most under each plausible prior?
B25
Which distance between probability distributions does a model use, and how does that choice affect inference?