Theory of Stochastic Signals/Poisson Distribution

1. Theory of Stochastic Signals
2. Discrete Random Variables
3. Poisson Distribution

• Previous page
• Next page

• Previous page
• Next page

Probabilities of the Poisson distribution

$\text{Definition:}$  The  Poisson distribution  is a limiting case of the  binomial distribution, where.

• on the one hand, the limit transitions  $I → ∞$  and  $p → 0$  are assumed,
• additionally, it is assumed that the product  $I · p = λ$  has a finite value.

The parameter  $λ$  gives the average number of "ones" in a fixed unit of time and is called the  rate .

Further, it should be noted:

• In contrast to the binomial distribution  $(0 ≤ μ ≤ I)$  here the random quantity can take on arbitrarily large (integer, non-negative) values.
• This means that the set of possible values here is uncountable.
• But since no intermediate values can occur, this is also called a  discrete distribution.

$\text{Calculation rule:}$ 

Considering above limit transitions for the  Probabilities of the binomial distribution,  it follows for the  Probabilities of Poisson Distribution :

$$p_\mu = {\rm Pr} ( z=\mu ) = \lim_{I\to\infty} \cdot \frac{I !}{\mu ! \cdot (I-\mu )!} \cdot (\frac{\lambda}{I} )^\mu \cdot ( 1-\frac{\lambda}{I})^{I-\mu}.$$

From this, after some algebraic transformations, we obtain:

$$p_\mu = \frac{ \lambda^\mu}{\mu!}\cdot {\rm e}^{-\lambda}.$$

Probabilities of the Poisson distribution

$\text{Example 1:}$  The probabilities

• of the binomial distribution with  $I =6$, $p = 0.4$,  and
• of the Poisson distribution with  $λ = 2.4$

can be seen in the graph on the right. One can see:

• Both distributions have the same mean  $m_1 = 2.4$.
• In the Poisson distribution  (red arrows and labels)  the "outer values" are more probable than in the binomial distribution.
• In addition, random variables  $z > 6$  are also possible with the Poisson distribution;  but their probabilities are also rather small at the chosen rate.

Moments of the Poisson distribution

$\text{Calculation rule:}$ 

The mean and rms of the Poisson distribution are obtained directly from the  corresponding equations of the binomial distribution  by twofold limiting:

$$m_1 =\lim_{\left.{I\hspace{0.05cm}\to\hspace{0.05cm}\infty \atop {p\hspace{0.05cm}\to\hspace{0.05cm} 0} }\right.} I \cdot p= \lambda,$$

$$\sigma =\lim_{\left.{I\hspace{0.05cm}\to\hspace{0.05cm}\infty \atop {p\hspace{0.05cm}\to\hspace{0.05cm} 0} }\right.} \sqrt{I \cdot p \cdot (1-p)} = \sqrt {\lambda}.$$

From this it can be seen that in the Poisson distribution it is always  $σ^2 = m_1 = λ$  .

moments of Poisson distribution

$\text{Example 2:}$ 

As in  $\text{Example 1}$ , here we compare:

• the binomial distribution with  $I =6$,  $p = 0.4$,  and
• and the Poisson distribution with  $λ = 2.4$.

One can see from the accompanying sketch:

• Both distributions have exactly the same mean  $m_1 = 2.4$.
• For the Poisson distribution (marked red in the figure), the dispersion  $σ ≈ 1.55$.
• In contrast, for the (blue) binomial distribution, the standard deviation is only  $σ = 1.2$.

With the interactive applet  Binomial– and Poisson Distribution  you can determine the probabilities and means (moments) of the Poisson distribution for any  $λ$-values and visualize the similarities and differences compared to the binomial distribution.

Comparison of binomial distribution vs. Poisson distribution

Now both the similarities and the differences between binomial and poisson distributed random variables shall be worked out again.

The  binomial distribution  is suitable for the description of such stochastic events, which are characterized by a given clock  $T$  .   For example, for  ISDN  (Integrated Services Digital Network)  with  $64 \ \rm kbit/s$  the clock time  $T \approx 15.6 \ \rm µ s$.

• Only in this time grid do binary events occur  Such events are, for example, error-free  $(e_i = 0)$  or errored  $(e_i = 1)$  transmission of individual symbols.
• The binomial distribution now allows statistical statements about the number of transmission errors to be expected in a longer time interval  $T_{\rm I} = I ⋅ T$  according to the upper diagram of the following graph (time marked in blue).

Scheme for binomial distribution and Poisson distribution

Also the  Poisson distribution  makes statements about the number of occurring binary events in a finite time interval:

• If one assumes here the same observation period  $T_{\rm I}$  and increases the number  $I$  of subintervals more and more, then the clock time  $T$, at which in each case a new binary event  ("0" or "1")  can occur, becomes smaller and smaller.  In the limiting case  $T$  goes towards zero.
• This means:  In the Poisson distribution, the binary events are possible not only at discrete points in time given by a time grid, but at any time.  The time diagram below illustrates this fact.
• In order to obtain on average during time  $T_{\rm I}$  exactly as many "ones" as in the binomial distribution  (in the example:  six), however, the characteristic probability  related to the infinitesimally small time interval  $T$  must tend to zero  $p = {\rm Pr}( e_i = 1)$  .

Applications of the Poisson distribution

The Poisson distribution is the result of a so-called  Poisson process.  Such a process is often used as a model for sequences of events that may occur at random times.  Examples of such events include.

• the failure of equipment - an important task in reliability theory,
• the shot noise in optical transmission, and
• the start of telephone calls in a switching center  ("teletraffic engineering").

$\text{Example 3:}$  If ninety switching requests per minute  $($also  $λ = 1.5 \text{ per second})$  are received by answitching center on a long-term average, the probabilities  $p_\mu$ that exactly  $\mu$  occupancies occur in any one-second period are:

$$p_\mu = \frac{1.5^\mu}{\mu!}\cdot {\rm e}^{-1.5}.$$

This gives the numerical values  $p_0 = 0.223$,  $p_1 = 0.335$,  $p_2 = 0.251$, etc.

From this, further characteristics can be derived:

• The distance  $τ$  between two switching desires satisfies the  exponential distribution.
• The mean time interval between two switching desires is  ${\rm E}[\hspace{0.05cm}τ\hspace{0.05cm}] = 1/λ ≈ 0.667 \rm s$.

Exercises for the chapter

Aufgabe 2.5: „Binomial” oder „Poisson”?

Aufgabe 2.5Z: Blumenwiese