Difference between revisions of "Aufgaben:Exercise 3.2Z: Relationship between PDF and CDF"

From LNTwww
 
(3 intermediate revisions by the same user not shown)
Line 3: Line 3:
 
}}
 
}}
  
[[File:P_ID117__Sto_Z_3_2.png|right|frame|Cumulative distribution function  $ F_x(r)$]]
+
[[File:P_ID117__Sto_Z_3_2.png|right|frame|Given CDF  $ F_x(r)$]]
Given is the random variable  $x$  with the distribution function.
+
Given is the random variable  $x$  with the cumulative distribution function  $\rm (CDF)$.
 
:$$ F_x(r)=\left\{\begin{array}{*{4}{c}} 0.25\cdot {\rm e}^{2\it r}  &\rm for\hspace{0.1cm}\it r<\rm 0, \\ 1-0.25\cdot {\rm e}^{-2\it r} & \rm for\hspace{0.1cm}\it r\ge\rm 0.  \\\end{array}\right.$$
 
:$$ F_x(r)=\left\{\begin{array}{*{4}{c}} 0.25\cdot {\rm e}^{2\it r}  &\rm for\hspace{0.1cm}\it r<\rm 0, \\ 1-0.25\cdot {\rm e}^{-2\it r} & \rm for\hspace{0.1cm}\it r\ge\rm 0.  \\\end{array}\right.$$
  
Line 16: Line 16:
  
 
Hints:
 
Hints:
*The exercise belongs to the chapter&nbsp; [[Theory_of_Stochastic_Signals/Cumulative_Distribution_Function|cumulative distribution function]].
+
*The exercise belongs to the chapter&nbsp; [[Theory_of_Stochastic_Signals/Cumulative_Distribution_Function|Cumulative Distribution Function]].
*Reference is made to the chapter&nbsp; [[Theory_of_Stochastic_Signals/Probability_Density_Function]].
+
*Reference is made to the chapter&nbsp; [[Theory_of_Stochastic_Signals/Probability_Density_Function|Probability Density Function]].
*The topic of this chapter is illustrated with examples in the (German language) learning video&nbsp; [[Zusammenhang_zwischen_WDF_und_VTF_(Lernvideo)|Zusammenhang zwischen WDF und VTF]]&nbsp; $\Rightarrow$ relationship between PDF and CDF.
+
*The topic of this chapter is illustrated with examples in the&nbsp; (German language)&nbsp; learning video <br> &nbsp; &nbsp; [[Zusammenhang_zwischen_WDF_und_VTF_(Lernvideo)|"Zusammenhang zwischen WDF und VTF"]] &nbsp; $\Rightarrow$ &nbsp; "Relationship between PDF and CDF".
  
 
   
 
   
Line 27: Line 27:
  
 
<quiz display=simple>
 
<quiz display=simple>
{What properties of a CDF hold when the random variable has no limits?
+
{What properties of the CDF hold when the random variable has no limits?
 
|type="[]"}
 
|type="[]"}
 
+ The CDF increases from&nbsp; $0$&nbsp; to&nbsp; $1$&nbsp; at least weakly monotonically.
 
+ The CDF increases from&nbsp; $0$&nbsp; to&nbsp; $1$&nbsp; at least weakly monotonically.
- The&nbsp; $F_x(r)$&ndash;values&nbsp; $0$&nbsp; and&nbsp; $1$&nbsp; are possible f&uuml;r finite&nbsp; $r$&ndash;values.
+
- The&nbsp; $F_x(r)$&nbsp; values&nbsp; $0$&nbsp; and&nbsp; $1$&nbsp; are possible for finite&nbsp; $r$&nbsp; values.
 
+A horizontal section indicates that in this range the random size has no proportions.
 
+A horizontal section indicates that in this range the random size has no proportions.
 
+Vertical sections are possible.
 
+Vertical sections are possible.
Line 64: Line 64:
 
===Solution===
 
===Solution===
 
{{ML-Kopf}}
 
{{ML-Kopf}}
'''(1)'''&nbsp; The <u>statements 1, 3 and 4</u> are always correct:
+
'''(1)'''&nbsp; The&nbsp; <u>statements 1, 3 and 4</u>&nbsp; are always correct:
*A horizontal intercept in the VTF indicates that the random size has no values in that region.  
+
*A horizontal intercept in the CDF indicates that the random variable has no values in that region.  
*In contrast, a vertical intercept in the VTF indicates a Dirac function in the WDF&nbsp; $($at the same location&nbsp; $x_0)$&nbsp;.  
+
*In contrast,&nbsp; a vertical intercept in the CDF indicates a Dirac delta function in the PDF&nbsp; $($at the same location&nbsp; $x_0)$.  
*This means that the random size takes the value&nbsp; $x_0$&nbsp; very frequently, namely with finite probability.  
+
*This means that the random variable takes the value&nbsp; $x_0$&nbsp; very frequently,&nbsp; namely with finite probability.  
*All other values occur exactly with probability&nbsp; $0$&nbsp;.
+
*All other values occur exactly with probability&nbsp; $0$.
*If, however&nbsp; $x$&nbsp; is limited to the range from&nbsp; $x_{\rm min}$&nbsp; to&nbsp; $x_{\rm max}$&nbsp; then&nbsp; $F_x(r) = 0$ &nbsp;f&uuml;r&nbsp; $r < x_{\rm min}$&nbsp; and&nbsp; $F_x(r) = 1$ &nbsp;f&uuml;r&nbsp; $r > x_{\rm max}$.  
+
*If,&nbsp; however&nbsp; $x$&nbsp; is limited to the range from&nbsp; $x_{\rm min}$&nbsp; to&nbsp; $x_{\rm max}$&nbsp; then&nbsp; $F_x(r) = 0$&nbsp; &nbsp;for&nbsp; $r < x_{\rm min}$&nbsp; and&nbsp; $F_x(r) = 1$ &nbsp;for&nbsp; $r > x_{\rm max}$.  
*In this special case, the second statement would also be true.
+
*In this special case,&nbsp; the second statement would also be true.
  
  
  
'''(2)'''&nbsp; The sought probability can be calculated from the difference of the VTF&ndash;values at the boundaries:
+
'''(2)'''&nbsp; The sought probability can be calculated from the difference of the CDF&nbsp; values at the boundaries:
 
:$${\rm Pr}( x> 0)= F_x(\infty)- F_x(\rm 0)
 
:$${\rm Pr}( x> 0)= F_x(\infty)- F_x(\rm 0)
 
\hspace{0.15cm}\underline{=\rm 0.25}.$$
 
\hspace{0.15cm}\underline{=\rm 0.25}.$$
Line 84: Line 84:
 
\hspace{0.15cm}{\approx0.092}. $$
 
\hspace{0.15cm}{\approx0.092}. $$
  
*For reasons of symmetry ${\rm Pr}(x<- 0.5)$&nbsp; is just as large. From this follows:
+
*For reasons of symmetry:&nbsp; ${\rm Pr}(x<- 0.5)$&nbsp; is just as large.&nbsp; From this follows:
$${\rm Pr}( |\hspace{0.05cm} x\hspace{0.05cm}| >\rm 0.5) \hspace{0.15cm}\underline{= \rm 0.184}.$$
+
:$${\rm Pr}( |\hspace{0.05cm} x\hspace{0.05cm}| >\rm 0.5) \hspace{0.15cm}\underline{= \rm 0.184}.$$
  
  
 
[[File: P_ID116__Sto_Z_3_2_c.png|right|frame|PDF of Laplace distribution]]
 
[[File: P_ID116__Sto_Z_3_2_c.png|right|frame|PDF of Laplace distribution]]
 
'''(4)'''&nbsp; The PDF is obtained from the corresponding CDF by differentiating the two areas.  
 
'''(4)'''&nbsp; The PDF is obtained from the corresponding CDF by differentiating the two areas.  
*The result is a two-sided exponential function as well as a Dirac function at&nbsp; $x = 0$&nbsp;:
+
*The result is a two-sided exponential function as well as a Dirac delta function at&nbsp; $x = 0$:
 
:$$f_x(x)=\rm 0.5\cdot \rm e^{-2\cdot |\hspace{0.05cm}\it x\hspace{0.05cm}|} + \rm 0.5\cdot\delta(\it x).$$
 
:$$f_x(x)=\rm 0.5\cdot \rm e^{-2\cdot |\hspace{0.05cm}\it x\hspace{0.05cm}|} + \rm 0.5\cdot\delta(\it x).$$
 
*The numerical value we are looking for is&nbsp; $f_x(x = 1)\hspace{0.15cm}\underline{= \rm 0.0677}$.
 
*The numerical value we are looking for is&nbsp; $f_x(x = 1)\hspace{0.15cm}\underline{= \rm 0.0677}$.
 +
*Note:&nbsp; The two-sided exponential distribution is also called "Laplace distribution".
  
  
<i>Note:</i> &nbsp; The two-sided exponential distribution is also called "Laplace distribution".
 
  
 
+
'''(5)'''&nbsp; In the range around&nbsp; $1$&nbsp; describes&nbsp; $x$&nbsp; a continuous valued random variable.  
 
 
'''(5)'''&nbsp; In the range around&nbsp; $1$&nbsp; describes&nbsp; $x$&nbsp; a continuous random size.  
 
 
*The probability that&nbsp; $x$&nbsp; has exactly the value&nbsp; $1$&nbsp; is therefore&nbsp; ${\rm Pr}(x = 1)\hspace{0.15cm}\underline{= \rm 0}.$
 
*The probability that&nbsp; $x$&nbsp; has exactly the value&nbsp; $1$&nbsp; is therefore&nbsp; ${\rm Pr}(x = 1)\hspace{0.15cm}\underline{= \rm 0}.$
  
  
'''(6)'''&nbsp; In&nbsp; $50\%$&nbsp; of time will&nbsp; $x = 0$&nbsp; hold: &nbsp; ${\rm Pr}(x = 0)\hspace{0.15cm}\underline{= \rm 0.5}.$
 
  
 +
'''(6)'''&nbsp; In&nbsp; $50\%$&nbsp; of time&nbsp; $x = 0$&nbsp; will hold: &nbsp; ${\rm Pr}(x = 0)\hspace{0.15cm}\underline{= \rm 0.5}.$
  
<i>Notes:</i>
 
 
*The PDF of a speech signal is often described by a two-sided exponential function.  
 
*The PDF of a speech signal is often described by a two-sided exponential function.  
*The Dirac function at&nbsp; $x = 0$&nbsp; mainly takes into account speech pauses &ndash; here in&nbsp; $50\%$&nbsp; all times.
+
*The Dirac delta function at&nbsp; $x = 0$&nbsp; mainly takes into account speech pauses &ndash; here in&nbsp; $50\%$&nbsp; of all times.
 
{{ML-Fuß}}
 
{{ML-Fuß}}
  

Latest revision as of 15:39, 4 January 2022

Given CDF  $ F_x(r)$

Given is the random variable  $x$  with the cumulative distribution function  $\rm (CDF)$.

$$ F_x(r)=\left\{\begin{array}{*{4}{c}} 0.25\cdot {\rm e}^{2\it r} &\rm for\hspace{0.1cm}\it r<\rm 0, \\ 1-0.25\cdot {\rm e}^{-2\it r} & \rm for\hspace{0.1cm}\it r\ge\rm 0. \\\end{array}\right.$$
  • This function is shown on the right.
  • It can be seen that at the unit step point  $r = 0$  the right-hand side limit is valid.




Hints:



Questions

1

What properties of the CDF hold when the random variable has no limits?

The CDF increases from  $0$  to  $1$  at least weakly monotonically.
The  $F_x(r)$  values  $0$  and  $1$  are possible for finite  $r$  values.
A horizontal section indicates that in this range the random size has no proportions.
Vertical sections are possible.

2

What is the probability that  $x$  is positive?

${\rm Pr}(x > 0) \ = \ $

3

What is the probability that  $|\hspace{0.05cm}x\hspace{0.05cm}|$  is larger than  $0.5$?

${\rm Pr}(|\hspace{0.05cm}x\hspace{0.05cm}| > 0.5) \ = \ $

4

Specify the associated PDF  $f_x(x)$  in general and the value for  $x = 1$.

$f_x(x =1)\ = \ $

5

What is the probability that  $x$  is exactly equal to  $1$ ?

${\rm Pr}(x = 1)\ = \ $

6

What is the probability that  $x$  is exactly equal to  $0$ ?

${\rm Pr}(x = 0)\ = \ $


Solution

(1)  The  statements 1, 3 and 4  are always correct:

  • A horizontal intercept in the CDF indicates that the random variable has no values in that region.
  • In contrast,  a vertical intercept in the CDF indicates a Dirac delta function in the PDF  $($at the same location  $x_0)$.
  • This means that the random variable takes the value  $x_0$  very frequently,  namely with finite probability.
  • All other values occur exactly with probability  $0$.
  • If,  however  $x$  is limited to the range from  $x_{\rm min}$  to  $x_{\rm max}$  then  $F_x(r) = 0$   for  $r < x_{\rm min}$  and  $F_x(r) = 1$  for  $r > x_{\rm max}$.
  • In this special case,  the second statement would also be true.


(2)  The sought probability can be calculated from the difference of the CDF  values at the boundaries:

$${\rm Pr}( x> 0)= F_x(\infty)- F_x(\rm 0) \hspace{0.15cm}\underline{=\rm 0.25}.$$


(3)  For the probability that  $x$  is greater than  $0.5$  holds:

$${\rm Pr}(x> 0.5)=1- F_x(0.5)=\rm 0.25\cdot e^{-1} \hspace{0.15cm}{\approx0.092}. $$
  • For reasons of symmetry:  ${\rm Pr}(x<- 0.5)$  is just as large.  From this follows:
$${\rm Pr}( |\hspace{0.05cm} x\hspace{0.05cm}| >\rm 0.5) \hspace{0.15cm}\underline{= \rm 0.184}.$$


PDF of Laplace distribution

(4)  The PDF is obtained from the corresponding CDF by differentiating the two areas.

  • The result is a two-sided exponential function as well as a Dirac delta function at  $x = 0$:
$$f_x(x)=\rm 0.5\cdot \rm e^{-2\cdot |\hspace{0.05cm}\it x\hspace{0.05cm}|} + \rm 0.5\cdot\delta(\it x).$$
  • The numerical value we are looking for is  $f_x(x = 1)\hspace{0.15cm}\underline{= \rm 0.0677}$.
  • Note:  The two-sided exponential distribution is also called "Laplace distribution".


(5)  In the range around  $1$  describes  $x$  a continuous valued random variable.

  • The probability that  $x$  has exactly the value  $1$  is therefore  ${\rm Pr}(x = 1)\hspace{0.15cm}\underline{= \rm 0}.$


(6)  In  $50\%$  of time  $x = 0$  will hold:   ${\rm Pr}(x = 0)\hspace{0.15cm}\underline{= \rm 0.5}.$

  • The PDF of a speech signal is often described by a two-sided exponential function.
  • The Dirac delta function at  $x = 0$  mainly takes into account speech pauses – here in  $50\%$  of all times.