next up previous contents
Next: Bayesian statistics: learning by Up: Conditional probability and Bayes' Previous: Bayes' theorem   Contents


Conventional use of Bayes' theorem

Bayes' theorem follows directly from the rules of probability, and it can be used in any kind of approach. Let us take an example:
Problem 1:
A particle detector has a $ \mu$ identification efficiency of $ 95\, \%$, and a probability of identifying a $ \pi$ as a $ \mu$ of $ 2\,\%$. If a particle is identified as a $ \mu$, then a trigger is fired. Knowing that the particle beam is a mixture of $ 90\,\%$ $ \pi$ and $ 10\,\%$ $ \mu$, what is the probability that a trigger is really fired by a $ \mu$? What is the signal-to-noise ($ S/N$) ratio?
Solution:
The two hypotheses (causes) which could condition the event (effect) $ T$ (=``trigger fired'') are ``$ \mu$'' and ``$ \pi$''. They are incompatible (clearly) and exhaustive (90% + 10% = 100%). Then:
$\displaystyle P(\mu\,\vert\,T)$ $\displaystyle =$ $\displaystyle \frac{P(T\,\vert\,\mu)P_\circ(\mu)}
{P(T\,\vert\,\mu)P_\circ(\mu) + P(T\,\vert\,\pi)P_\circ(\pi)}$ (3.16)
      (3.17)
  $\displaystyle =$ $\displaystyle \frac{0.95\times 0.1}{0.95\times 0.1 + 0.02\times 0.9}=0.84\,,$  

and $ P(\pi\,\vert\,T)=0.16$.

The S/N ratio is $ P(\mu\,\vert\,T)/P(\pi\,\vert\,T)=5.3$. It is interesting to rewrite the general expression of the S/N ratio if the effect $ E$ is observed as

$\displaystyle S/N = \frac{P(S\,\vert\,E)}{P(N\,\vert\,E)}=\frac{P(E\,\vert\,S)}{P(E\,\vert\,N)}\cdot \frac{P_\circ(S)}{P_\circ(N)}\,.$ (3.18)

This formula explicitly shows that when there are noisy conditions,

$\displaystyle P_\circ(S) \ll P_\circ(N)$

, the experiment must be very selective,

$\displaystyle P(E\,\vert\,S) \gg P(E\,\vert\,N)$

, in order to have a decent $ S/N$ ratio.
(How does $ S/N$ change if the particle has to be identified by two independent detectors in order to give the trigger? Try it yourself, the answer is $ S/N=251$.)
Problem 2:
Three boxes contain two rings each, but in one of them they are both gold, in the second both silver, and in the third one of each type. You have the choice of randomly extracting a ring from one of the boxes, the content of which is unknown to you. You look at the selected ring, and you then have the possibility of extracting a second ring, again from any of the three boxes. Let us assume the first ring you extract is a gold one. Is it then preferable to extract the second one from the same or from a different box?
Solution:
Choosing the same box you have a $ 2/3$ probability of getting a second gold ring. (Try to apply the theorem, or help yourself with intuition; the solution is given in Section [*].)
The difference between the two problems, from the conventional statistics point of view, is that the first is only meaningful in the frequentistic approach, the second only in the combinatorial one. They are, however, both acceptable from the Bayesian point of view. This is simply because in this framework there is no restriction on the definition of probability. In many and important cases of life and science, neither of the two conventional definitions are applicable.


next up previous contents
Next: Bayesian statistics: learning by Up: Conditional probability and Bayes' Previous: Bayes' theorem   Contents
Giulio D'Agostini 2003-05-15