Difference between revisions of "Digital Signal Transmission/Binary Symmetric Channel"

From LNTwww
Line 8: Line 8:
 
== Binary Symmetric Channel – Model and Error Correlation Function==
 
== Binary Symmetric Channel – Model and Error Correlation Function==
 
<br>
 
<br>
The left graph shows the BSC model, the simplest model of a digital transmission system.
+
The left graph shows the BSC model,&nbsp; the simplest model of a digital transmission system.
  
The name stands for&nbsp; '''Binary Symmetric Channel'''&nbsp; and states that this model can only be used for binary systems with symmetrical falsification properties. Further applies:
+
The name stands for&nbsp; "'''Binary Symmetric Channel'''"&nbsp; and states that this model can only be used for binary systems with symmetrical falsification properties.  
 
[[File:EN_Dig_T_5_2_S1.png|right|frame|BSC model and associated error correlation function|class=fit]]
 
[[File:EN_Dig_T_5_2_S1.png|right|frame|BSC model and associated error correlation function|class=fit]]
  
*The BSC model is suitable for the study and generation of a sequence of errors with statistically independent errors. Such a channel is also called <i>memory-free</i> and, unlike the&nbsp; [[Digital_Signal_Transmission/Burst_Error_Channels|"burst error channel models"]],&nbsp; only a single channel state exists.<br>
+
Further applies:
*The two symbols $($for example&nbsp; $\rm L$&nbsp; and &nbsp;$\rm H)$&nbsp; are each falsified with the same probability&nbsp; $p$,&nbsp; so that the mean error probability&nbsp; $p_{\rm M} = p$&nbsp; is also independent of the symbol probabilities&nbsp; $p_{\rm L}$&nbsp; and&nbsp;  $p_{\rm H}$.<br><br>
+
*The BSC model is suitable for the study and generation of an error sequence with statistically independent errors.&nbsp;  
  
The right graph shows the&nbsp; ''error correlation function''&nbsp; (ECF) of the BSC model:
+
*Such a channel is also called&nbsp; "memory-free"&nbsp; and unlike the&nbsp; [[Digital_Signal_Transmission/Burst_Error_Channels|"burst error channel models"]]&nbsp; only a single channel state exists.<br>
 +
 
 +
*The two symbols&nbsp; $($for example&nbsp; $\rm L$&nbsp; and &nbsp;$\rm H)$&nbsp; are each falsified with the same probability&nbsp; $p$,&nbsp; so that the mean error probability&nbsp; $p_{\rm M} = p$&nbsp; is also independent of the symbol probabilities&nbsp; $p_{\rm L}$&nbsp; and&nbsp;  $p_{\rm H}$.<br><br>
 +
 
 +
The right graph shows the&nbsp; "error correlation function"&nbsp; $\rm (ECF)$&nbsp; of the BSC model:
  
 
::<math>\varphi_{e}(k) =  {\rm E}\big[e_{\nu} \cdot e_{\nu + k}\big] =
 
::<math>\varphi_{e}(k) =  {\rm E}\big[e_{\nu} \cdot e_{\nu + k}\big] =
Line 26: Line 30:
 
{{BlaueBox|TEXT=   
 
{{BlaueBox|TEXT=   
 
$\text{Conclusion:}$&nbsp;  
 
$\text{Conclusion:}$&nbsp;  
*In the BSC model, the final ECF value (square of the mean error probability), which in other models is valid only for&nbsp; $k \to \infty$,&nbsp; is reached exactly at&nbsp; $k = 1$&nbsp; and then remains constant.<br>
+
*In the BSC model, the final ECF value&nbsp; $($square of the mean error probability$)$,&nbsp; which in other models is valid only for&nbsp; $k \to \infty$,&nbsp; is reached exactly at&nbsp; $k = 1$&nbsp; and then remains constant.<br>
  
*The BSC model belongs to the class of ''renewal channel models''. In a renewal channel model, the error distances are statistically independent of each other and the error correlation function can be calculated iteratively in a simple way:
+
*The BSC model belongs to the class of&nbsp; "renewal channel models".&nbsp; In a renewal channel model,&nbsp; the error distances are statistically independent of each other and the error correlation function can be calculated iteratively in a simple way:
  
 
::<math>\varphi_{e}(k) = \sum_{\kappa = 1}^{k} {\rm Pr}(a = \kappa) \cdot
 
::<math>\varphi_{e}(k) = \sum_{\kappa = 1}^{k} {\rm Pr}(a = \kappa) \cdot
Line 35: Line 39:
 
== Binary Symmetric Channel &ndash; Error Distance Distribution==
 
== Binary Symmetric Channel &ndash; Error Distance Distribution==
 
<br>
 
<br>
We now consider the&nbsp; <i>error distance distribution</i>&nbsp; (EDD). The probability for the error distance&nbsp; $a=k$&nbsp; is obtained from the condition of&nbsp; $k-1$&nbsp; error-free symbols and one transmission error at time&nbsp; $\nu +k$, assuming that the last error occurred at time&nbsp; $\nu$.&nbsp; One obtains:
+
We now consider the&nbsp; "error distance distribution"&nbsp; $\rm (EDD)$.&nbsp; The probability for the error distance&nbsp; $a=k$&nbsp; is obtained from the condition of&nbsp; $k-1$&nbsp; error-free symbols and one transmission error at time&nbsp; $\nu +k$,&nbsp; assuming that the last error occurred at time&nbsp; $\nu$.&nbsp; One obtains:
  
 
::<math>{\rm Pr}(a = k) = (1-p)^{k-1}\cdot p \hspace{0.05cm}.</math>
 
::<math>{\rm Pr}(a = k) = (1-p)^{k-1}\cdot p \hspace{0.05cm}.</math>
  
 
It follows:
 
It follows:
*The error distance&nbsp; $a = 1$&nbsp; always occurs with the greatest probability in the BSC model, and this for any value of&nbsp; $p$.<br>
+
*The error distance&nbsp; $a = 1$&nbsp; always occurs in the BSC model with the greatest probability,&nbsp; and this for any value of&nbsp; $p$.<br>
*This fact is somewhat surprising at first glance. With&nbsp; $p = 0.01$,&nbsp; for example, the mean error distance is&nbsp; ${\rm E}\big[a\big] = 100$.  
+
 
*Nevertheless, two consecutive errors&nbsp; $(a = 1)$&nbsp; are more probable by a factor of&nbsp; $0.99^{99} \approx 2.7$&nbsp; than the error distance&nbsp; $a = 100$.<br><br>
+
*This fact is somewhat surprising at first glance:&nbsp;
 +
 
 +
:With&nbsp; $p = 0.01$,&nbsp; for example,&nbsp; the mean error distance is&nbsp; ${\rm E}\big[a\big] = 100$.&nbsp; Nevertheless,&nbsp; two consecutive errors&nbsp; $(a = 1)$&nbsp; are more probable by a factor of&nbsp; $0.99^{99} \approx 2.7$&nbsp; than the error distance&nbsp; $a = 100$.<br><br>
  
The error distance distribution is obtained by summation according to the&nbsp; [[Digital_Signal_Transmission/Parameters_of_Digital_Channel_Models#Error_distance_distribution|"general definition"]]:&nbsp;  
+
*The error distance distribution is obtained by summation according to the&nbsp; [[Digital_Signal_Transmission/Parameters_of_Digital_Channel_Models#Error_distance_distribution|"general definition"]]:&nbsp;  
  
 
::<math>V_a(k) =  {\rm Pr}(a \ge k) = 1 - \sum_{\kappa = 1}^{k}  (1-p)^{\kappa-1}\cdot p = (1-p)^{k-1}\hspace{0.05cm}.</math>
 
::<math>V_a(k) =  {\rm Pr}(a \ge k) = 1 - \sum_{\kappa = 1}^{k}  (1-p)^{\kappa-1}\cdot p = (1-p)^{k-1}\hspace{0.05cm}.</math>
Line 56: Line 62:
  
  
The decrease is exponential with increasing&nbsp; $k$&nbsp; and is steeper the smaller&nbsp; $p$&nbsp; is.<br>
+
&rArr; &nbsp; The decrease is exponential with increasing&nbsp; $k$&nbsp; and is steeper the smaller&nbsp; $p$&nbsp; is.<br>
  
The right graph shows the logarithmic representation. Here the drop is linear according to
+
&rArr; &nbsp; The right graph shows the logarithmic representation.&nbsp; Here the drop is linear according to
  
 
::<math>{\rm lg} \hspace{0.15cm}V_a(k) =  (k - 1) \cdot {\rm lg} \hspace{0.15cm}(1-p)\hspace{0.05cm}.</math>}}<br>
 
::<math>{\rm lg} \hspace{0.15cm}V_a(k) =  (k - 1) \cdot {\rm lg} \hspace{0.15cm}(1-p)\hspace{0.05cm}.</math>}}<br>
Line 64: Line 70:
 
== Applications of the BSC model ==
 
== Applications of the BSC model ==
 
<br>
 
<br>
The BSC model is the <i>digital equivalent</i>&nbsp; of the simplest analog model &nbsp; &#8658; &nbsp; [[Digital_Signal_Transmission/Structure_of_the_Optimal_Receiver#Some_properties_of_the_AWGN_channel|"AWGN"]]&nbsp; for a time-invariant digital system corresponding to the following graph. The only degradation is noise; there is no distortion.<br>
+
The BSC model is the&nbsp; "digital equivalent"&nbsp; of the simplest analog model &nbsp; &#8658; &nbsp; [[Digital_Signal_Transmission/Structure_of_the_Optimal_Receiver#Some_properties_of_the_AWGN_channel|"AWGN"]]&nbsp; for a time-invariant digital system corresponding to the following graph.&nbsp; It holds
 +
[[File:P ID1830 Dig T 5 2 S3 version1.png|right|frame|On the use of the BSC model|class=fit]]
 +
#The only degradation is noise.
 +
#There is no distortion.<br>
 +
 
 +
 
 +
To use the BSC model,&nbsp; the digital system must meet the following requirements:
 +
*Redundancy-free binary encoding &nbsp; &#8658; &nbsp; no channel encoding and decoding,<br>
  
[[File:P ID1830 Dig T 5 2 S3 version1.png|right|frame|On the use of the BSC model|class=fit]]
+
*noise according to the AWGN model &nbsp; &#8658; &nbsp; additive,&nbsp; white,&nbsp; Gaussian distributed,<br>
 +
 
 +
*no distortions due to the components of the transmitter and receiver,<br>
  
To use the BSC model, the digital system must meet the following requirements:
 
*redundancy-free binary encoding &nbsp; &#8658; &nbsp; no channel encoding and decoding,<br>
 
*noise according to the AWGN model &nbsp; &#8658; &nbsp; additive, white and Gaussian distributed,<br>
 
*no non-linear or linear distortions due to the components of the <br>transmitter and receiver,<br>
 
 
*threshold decision with symmetric decision threshold,<br>
 
*threshold decision with symmetric decision threshold,<br>
 +
 
*no extraneous influences such as crosstalk, dial pulses or electromagnetic interference fields.<br>
 
*no extraneous influences such as crosstalk, dial pulses or electromagnetic interference fields.<br>
<br clear=all>
+
 
 +
 
 
For a&nbsp; ''radio system''&nbsp; with a direct line-of-sight between transmitter and receiver, the application of the BSC model is often justified, but not if fading influences &nbsp; &#8658; &nbsp;[[Digital_Signal_Transmission/Carrier_Frequency_Systems_with_Non-Coherent_Demodulation#Rayleigh_and_Rice_Distribution|"Rayleigh or Rice"]]&nbsp; play a role or if echoes may occur &nbsp; &#8658; &nbsp;[[Mobile_Communications/Multi-Path_Reception_in_Mobile_Communications|"multi-path reception"]].<br>
 
For a&nbsp; ''radio system''&nbsp; with a direct line-of-sight between transmitter and receiver, the application of the BSC model is often justified, but not if fading influences &nbsp; &#8658; &nbsp;[[Digital_Signal_Transmission/Carrier_Frequency_Systems_with_Non-Coherent_Demodulation#Rayleigh_and_Rice_Distribution|"Rayleigh or Rice"]]&nbsp; play a role or if echoes may occur &nbsp; &#8658; &nbsp;[[Mobile_Communications/Multi-Path_Reception_in_Mobile_Communications|"multi-path reception"]].<br>
  

Revision as of 12:07, 5 September 2022

Binary Symmetric Channel – Model and Error Correlation Function


The left graph shows the BSC model,  the simplest model of a digital transmission system.

The name stands for  "Binary Symmetric Channel"  and states that this model can only be used for binary systems with symmetrical falsification properties.

BSC model and associated error correlation function

Further applies:

  • The BSC model is suitable for the study and generation of an error sequence with statistically independent errors. 
  • The two symbols  $($for example  $\rm L$  and  $\rm H)$  are each falsified with the same probability  $p$,  so that the mean error probability  $p_{\rm M} = p$  is also independent of the symbol probabilities  $p_{\rm L}$  and  $p_{\rm H}$.

The right graph shows the  "error correlation function"  $\rm (ECF)$  of the BSC model:

\[\varphi_{e}(k) = {\rm E}\big[e_{\nu} \cdot e_{\nu + k}\big] = \left\{ \begin{array}{c} p \\ p^2 \end{array} \right.\quad \begin{array}{*{1}c} f{\rm or }\hspace{0.25cm}k = 0 \hspace{0.05cm}, \\ f{\rm or }\hspace{0.25cm} k > 0 \hspace{0.05cm}.\\ \end{array}\]

$\text{Conclusion:}$ 

  • In the BSC model, the final ECF value  $($square of the mean error probability$)$,  which in other models is valid only for  $k \to \infty$,  is reached exactly at  $k = 1$  and then remains constant.
  • The BSC model belongs to the class of  "renewal channel models".  In a renewal channel model,  the error distances are statistically independent of each other and the error correlation function can be calculated iteratively in a simple way:
\[\varphi_{e}(k) = \sum_{\kappa = 1}^{k} {\rm Pr}(a = \kappa) \cdot \varphi_{e}(k - \kappa) \hspace{0.05cm}.\]

Binary Symmetric Channel – Error Distance Distribution


We now consider the  "error distance distribution"  $\rm (EDD)$.  The probability for the error distance  $a=k$  is obtained from the condition of  $k-1$  error-free symbols and one transmission error at time  $\nu +k$,  assuming that the last error occurred at time  $\nu$.  One obtains:

\[{\rm Pr}(a = k) = (1-p)^{k-1}\cdot p \hspace{0.05cm}.\]

It follows:

  • The error distance  $a = 1$  always occurs in the BSC model with the greatest probability,  and this for any value of  $p$.
  • This fact is somewhat surprising at first glance: 
With  $p = 0.01$,  for example,  the mean error distance is  ${\rm E}\big[a\big] = 100$.  Nevertheless,  two consecutive errors  $(a = 1)$  are more probable by a factor of  $0.99^{99} \approx 2.7$  than the error distance  $a = 100$.

\[V_a(k) = {\rm Pr}(a \ge k) = 1 - \sum_{\kappa = 1}^{k} (1-p)^{\kappa-1}\cdot p = (1-p)^{k-1}\hspace{0.05cm}.\]

$\text{Example 1:}$  The left graph shows  $V_a(k)$  in linear representation for

Error distance distribution for the BSC model in linear and logarithmic plots.
  • $p = 0.1$  (blue curve), and 
  • $p = 0.02$  (red curve).


⇒   The decrease is exponential with increasing  $k$  and is steeper the smaller  $p$  is.

⇒   The right graph shows the logarithmic representation.  Here the drop is linear according to

\[{\rm lg} \hspace{0.15cm}V_a(k) = (k - 1) \cdot {\rm lg} \hspace{0.15cm}(1-p)\hspace{0.05cm}.\]


Applications of the BSC model


The BSC model is the  "digital equivalent"  of the simplest analog model   ⇒   "AWGN"  for a time-invariant digital system corresponding to the following graph.  It holds

On the use of the BSC model
  1. The only degradation is noise.
  2. There is no distortion.


To use the BSC model,  the digital system must meet the following requirements:

  • Redundancy-free binary encoding   ⇒   no channel encoding and decoding,
  • noise according to the AWGN model   ⇒   additive,  white,  Gaussian distributed,
  • no distortions due to the components of the transmitter and receiver,
  • threshold decision with symmetric decision threshold,
  • no extraneous influences such as crosstalk, dial pulses or electromagnetic interference fields.


For a  radio system  with a direct line-of-sight between transmitter and receiver, the application of the BSC model is often justified, but not if fading influences   ⇒  "Rayleigh or Rice"  play a role or if echoes may occur   ⇒  "multi-path reception".

In contrast, according to network operators, statistically independent errors tend to be the exception in the case of  wireline transmission  (for example,  "DSL", but also optical transmission). If errors occur during data transmission via the telephone network, they are usually clustered.

In this case, we speak of so-called  burst errors, which will be discussed in the next chapter.

Exercises for the chapter


Exercise 5.3:  AWGN and BSC Model

Exercise 5.3Z:  Analysis of the BSC Model

Exercise 5.4:  Is the BSC Model Renewing?

Exercise 5.5:  Error Sequence and Error Distance Sequence