Difference between revisions of "Digital Signal Transmission/Binary Symmetric Channel"

From LNTwww
 
(6 intermediate revisions by the same user not shown)
Line 8: Line 8:
 
== Binary Symmetric Channel – Model and Error Correlation Function==
 
== Binary Symmetric Channel – Model and Error Correlation Function==
 
<br>
 
<br>
The left graph shows the BSC model, the simplest model of a digital transmission system.
+
The left graph shows the BSC model,&nbsp; the simplest model of a digital transmission system.
  
[[File:EN_Dig_T_5_2_S1.png|center|frame|BSC model and associated error correlation function|class=fit]]
+
The name stands for&nbsp; "'''Binary Symmetric Channel'''"&nbsp; and states that this model can only be used for binary systems with symmetrical falsification properties.
 +
[[File:EN_Dig_T_5_2_S1.png|right|frame|BSC model and associated error correlation function|class=fit]]
  
The name stands for&nbsp; '''Binary Symmetric Channel'''&nbsp; and states that this model can only be used for binary systems with symmetrical falsification properties. Further applies:
+
Further applies:
 +
*The BSC model is suitable for the study and generation of an error sequence with statistically independent errors.&nbsp;  
  
*The BSC model is suitable for the study and generation of a sequence of errors with statistically independent errors. Such a channel is also called <i>memory-free</i> and, unlike the&nbsp; [[Digital_Signal_Transmission/Burst_Error_Channels|"burst error channel models"]],&nbsp; only a single channel state exists.<br>
+
*Such a channel is also called&nbsp; "memory-free"&nbsp; and unlike the&nbsp; [[Digital_Signal_Transmission/Burst_Error_Channels|"burst error channel models"]]&nbsp; only a single channel state exists.<br>
*The two symbols $($for example&nbsp; $\rm L$&nbsp; and &nbsp;$\rm H)$&nbsp; are each falsified with the same probability&nbsp; $p$,&nbsp; so that the mean error probability&nbsp; $p_{\rm M} = p$&nbsp; is also independent of the symbol probabilities&nbsp; $p_{\rm L}$&nbsp; and&nbsp;  $p_{\rm H}$.<br><br>
 
  
The right graph shows the&nbsp; ''error correlation function''&nbsp; (ECF) of the BSC model:
+
*The two symbols&nbsp; $($for example&nbsp; $\rm L$&nbsp; and &nbsp;$\rm H)$&nbsp; are each falsified with the same probability&nbsp; $p$,&nbsp; so that the mean error probability&nbsp; $p_{\rm M} = p$&nbsp; is also independent of the symbol probabilities&nbsp; $p_{\rm L}$&nbsp; and&nbsp;  $p_{\rm H}$.<br><br>
 +
 
 +
The right graph shows the&nbsp; [[Digital_Signal_Transmission/Parameters_of_Digital_Channel_Models#Error_correlation_function|"error correlation function"]]&nbsp; $\rm (ECF)$&nbsp; of the BSC model:
  
 
::<math>\varphi_{e}(k) =  {\rm E}\big[e_{\nu} \cdot e_{\nu + k}\big] =
 
::<math>\varphi_{e}(k) =  {\rm E}\big[e_{\nu} \cdot e_{\nu + k}\big] =
Line 27: Line 30:
 
{{BlaueBox|TEXT=   
 
{{BlaueBox|TEXT=   
 
$\text{Conclusion:}$&nbsp;  
 
$\text{Conclusion:}$&nbsp;  
*In the BSC model, the final ECF value (square of the mean error probability), which in other models is valid only for&nbsp; $k \to \infty$,&nbsp; is reached exactly at&nbsp; $k = 1$&nbsp; and then remains constant.<br>
+
*In the BSC model, the final ECF value&nbsp; $($square of the mean error probability$)$,&nbsp; which in other models is valid only for&nbsp; $k \to \infty$,&nbsp; is reached exactly at&nbsp; $k = 1$&nbsp; and then remains constant.<br>
  
*The BSC model belongs to the class of ''renewal channel models''. In a renewal channel model, the error distances are statistically independent of each other and the error correlation function can be calculated iteratively in a simple way:
+
*The BSC model belongs to the class of&nbsp; "renewal channel models".&nbsp; In a renewal channel model,&nbsp; the error distances are statistically independent of each other and the error correlation function can be calculated iteratively in a simple way:
  
 
::<math>\varphi_{e}(k) = \sum_{\kappa = 1}^{k} {\rm Pr}(a = \kappa) \cdot
 
::<math>\varphi_{e}(k) = \sum_{\kappa = 1}^{k} {\rm Pr}(a = \kappa) \cdot
Line 36: Line 39:
 
== Binary Symmetric Channel &ndash; Error Distance Distribution==
 
== Binary Symmetric Channel &ndash; Error Distance Distribution==
 
<br>
 
<br>
We now consider the&nbsp; <i>error distance distribution</i>&nbsp; (EDD). The probability for the error distance&nbsp; $a=k$&nbsp; is obtained from the condition of&nbsp; $k-1$&nbsp; error-free symbols and one transmission error at time&nbsp; $\nu +k$, assuming that the last error occurred at time&nbsp; $\nu$.&nbsp; One obtains:
+
We now consider the&nbsp; "error distance distribution"&nbsp; $\rm (EDD)$.&nbsp; The probability for the error distance&nbsp; $a=k$&nbsp; is obtained from the condition of&nbsp; $k-1$&nbsp; error-free symbols and one transmission error at time&nbsp; $\nu +k$,&nbsp; assuming that the last error occurred at time&nbsp; $\nu$.&nbsp; One obtains:
  
 
::<math>{\rm Pr}(a = k) = (1-p)^{k-1}\cdot p \hspace{0.05cm}.</math>
 
::<math>{\rm Pr}(a = k) = (1-p)^{k-1}\cdot p \hspace{0.05cm}.</math>
  
 
It follows:
 
It follows:
*The error distance&nbsp; $a = 1$&nbsp; always occurs with the greatest probability in the BSC model, and this for any value of&nbsp; $p$.<br>
+
*The error distance&nbsp; $a = 1$&nbsp; always occurs in the BSC model with the greatest probability,&nbsp; and this for any value of&nbsp; $p$.<br>
*This fact is somewhat surprising at first glance. With&nbsp; $p = 0.01$,&nbsp; for example, the mean error distance is&nbsp; ${\rm E}\big[a\big] = 100$.  
+
 
*Nevertheless, two consecutive errors&nbsp; $(a = 1)$&nbsp; are more probable by a factor of&nbsp; $0.99^{99} \approx 2.7$&nbsp; than the error distance&nbsp; $a = 100$.<br><br>
+
*This fact is somewhat surprising at first glance:&nbsp;
 +
 
 +
:With&nbsp; $p = 0.01$,&nbsp; for example,&nbsp; the mean error distance is&nbsp; ${\rm E}\big[a\big] = 100$.&nbsp; Nevertheless,&nbsp; two consecutive errors&nbsp; $(a = 1)$&nbsp; are more probable by a factor of&nbsp; $0.99^{99} \approx 2.7$&nbsp; than the error distance&nbsp; $a = 100$.<br>
  
The error distance distribution is obtained by summation according to the&nbsp; [[Digital_Signal_Transmission/Parameters_of_Digital_Channel_Models#Error_distance_distribution|"general definition"]]:&nbsp;  
+
*The error distance distribution is obtained by summation according to the&nbsp; [[Digital_Signal_Transmission/Parameters_of_Digital_Channel_Models#Error_distance_distribution|"general definition"]]:&nbsp;  
  
 
::<math>V_a(k) =  {\rm Pr}(a \ge k) = 1 - \sum_{\kappa = 1}^{k}  (1-p)^{\kappa-1}\cdot p = (1-p)^{k-1}\hspace{0.05cm}.</math>
 
::<math>V_a(k) =  {\rm Pr}(a \ge k) = 1 - \sum_{\kappa = 1}^{k}  (1-p)^{\kappa-1}\cdot p = (1-p)^{k-1}\hspace{0.05cm}.</math>
  
[[File:EN_Dig_T_5_2_S2.png|right|Error distance distribution for the BSC model in linear and logarithmic plots.|class=fit]]
 
 
{{GraueBox|TEXT=   
 
{{GraueBox|TEXT=   
 
$\text{Example 1:}$&nbsp; The left graph shows&nbsp; $V_a(k)$&nbsp; in linear representation for
 
$\text{Example 1:}$&nbsp; The left graph shows&nbsp; $V_a(k)$&nbsp; in linear representation for
*$p = 0.1$&nbsp; (blue curve), and&nbsp;  
+
[[File:EN_Dig_T_5_2_S2.png|right|frame||Error distance distribution for the BSC model in linear and logarithmic plots.|class=fit]]
 +
*$p = 0.1$&nbsp; (blue curve), and&nbsp;
 +
 
*$p = 0.02$&nbsp; (red curve).  
 
*$p = 0.02$&nbsp; (red curve).  
  
  
The decrease is exponential with increasing&nbsp; $k$&nbsp; and is steeper the smaller&nbsp; $p$&nbsp; is.<br>
+
&rArr; &nbsp; The decrease is exponential with increasing&nbsp; $k$&nbsp; and is steeper the smaller&nbsp; $p$&nbsp; is.<br>
  
The right graph shows the logarithmic representation. Here the drop is linear according to
+
&rArr; &nbsp; The right graph shows the logarithmic representation.&nbsp; Here the drop is linear according to
  
 
::<math>{\rm lg} \hspace{0.15cm}V_a(k) =  (k - 1) \cdot {\rm lg} \hspace{0.15cm}(1-p)\hspace{0.05cm}.</math>}}<br>
 
::<math>{\rm lg} \hspace{0.15cm}V_a(k) =  (k - 1) \cdot {\rm lg} \hspace{0.15cm}(1-p)\hspace{0.05cm}.</math>}}<br>
Line 64: Line 70:
 
== Applications of the BSC model ==
 
== Applications of the BSC model ==
 
<br>
 
<br>
The BSC model is the <i>digital equivalent</i>&nbsp; of the simplest analog model &nbsp; &#8658; &nbsp; [[Digital_Signal_Transmission/Structure_of_the_Optimal_Receiver#Some_properties_of_the_AWGN_channel|"AWGN"]]&nbsp; for a time-invariant digital system corresponding to the following graph. The only degradation is noise; there is no distortion.<br>
+
The BSC model is the&nbsp; "digital equivalent"&nbsp; of the simplest analog model &nbsp; &#8658; &nbsp; [[Digital_Signal_Transmission/Structure_of_the_Optimal_Receiver#Some_properties_of_the_AWGN_channel|"AWGN"]]&nbsp; for a time-invariant digital system corresponding to the following graph.&nbsp; It holds
 +
[[File:EN_Dig_T_5_2_S2b.png|right|frame|On the use of the BSC model|class=fit]]
 +
#The only degradation is noise.
 +
#There is no distortion.<br>
 +
 
  
[[File:P ID1830 Dig T 5 2 S3 version1.png|right|frame|On the use of the BSC model|class=fit]]
+
To use the BSC model,&nbsp; the digital system must meet the following requirements:
 +
*Redundancy-free binary encoding &nbsp; &#8658; &nbsp; no channel encoding and decoding,<br>
 +
 
 +
*noise according to the AWGN model &nbsp; &#8658; &nbsp; additive,&nbsp; white,&nbsp; Gaussian distributed,<br>
 +
 
 +
*no&nbsp; $($linear & non-linear$)$&nbsp; distortions due to transmitter / receiver components,<br>
  
To use the BSC model, the digital system must meet the following requirements:
 
*redundancy-free binary encoding &nbsp; &#8658; &nbsp; no channel encoding and decoding,<br>
 
*noise according to the AWGN model &nbsp; &#8658; &nbsp; additive, white and Gaussian distributed,<br>
 
*no non-linear or linear distortions due to the components of the <br>transmitter and receiver,<br>
 
 
*threshold decision with symmetric decision threshold,<br>
 
*threshold decision with symmetric decision threshold,<br>
*no extraneous influences such as crosstalk, dial pulses or electromagnetic interference fields.<br>
 
<br clear=all>
 
For a&nbsp; ''radio system''&nbsp; with a direct line-of-sight between transmitter and receiver, the application of the BSC model is often justified, but not if fading influences &nbsp; &#8658; &nbsp;[[Digital_Signal_Transmission/Carrier_Frequency_Systems_with_Non-Coherent_Demodulation#Rayleigh_and_Rice_Distribution|"Rayleigh or Rice"]]&nbsp; play a role or if echoes may occur &nbsp; &#8658; &nbsp;[[Mobile_Communications/Multi-Path_Reception_in_Mobile_Communications|"multi-path reception"]].<br>
 
  
In contrast, according to network operators, statistically independent errors tend to be the exception in the case of&nbsp; ''wireline transmission''&nbsp; (for example,&nbsp; [[Examples_of_Communication_Systems/General_Description_of_DSL|"DSL"]], but also optical transmission). If errors occur during data transmission via the telephone network, they are usually clustered.
+
*no extraneous interference influences such as: <br>crosstalk, dial pulses, electromagnetic fields, ...<br>
 +
 
 +
 
 +
For a&nbsp; "radio system"&nbsp; with a direct line-of-sight between transmitter and receiver,
 +
*the application of the BSC model is often justified,
 +
 
 +
*but not if fading influences &nbsp; $($[[Digital_Signal_Transmission/Carrier_Frequency_Systems_with_Non-Coherent_Demodulation#Rayleigh_and_Rice_Distribution|"Rayleigh or Rice"]]$)$&nbsp; play a role or if echoes may occur &nbsp; <br>&#8658; &nbsp;[[Mobile_Communications/Multi-Path_Reception_in_Mobile_Communications|"multi-path reception"]].<br>
 +
 
 +
 
 +
&rArr; &nbsp; In contrast,&nbsp; according to network operators,&nbsp; statistically independent errors tend to be the exception in the case of&nbsp; "wireline transmission"&nbsp; <br>(e.g.&nbsp; [[Examples_of_Communication_Systems/General_Description_of_DSL|"DSL"]],&nbsp; but also optical transmission$)$.&nbsp;
  
In this case, we speak of so-called&nbsp; <i>burst errors</i>, which will be discussed in the next chapter.<br>
+
&rArr; &nbsp; If errors occur during data transmission via the telephone network,&nbsp; they are usually clustered.&nbsp; In this case,&nbsp;  we speak of so-called&nbsp; "burst errors",&nbsp; which will be discussed in the next chapter.<br>
  
 
==Exercises for the chapter==
 
==Exercises for the chapter==

Latest revision as of 16:23, 6 September 2022

Binary Symmetric Channel – Model and Error Correlation Function


The left graph shows the BSC model,  the simplest model of a digital transmission system.

The name stands for  "Binary Symmetric Channel"  and states that this model can only be used for binary systems with symmetrical falsification properties.

BSC model and associated error correlation function

Further applies:

  • The BSC model is suitable for the study and generation of an error sequence with statistically independent errors. 
  • The two symbols  $($for example  $\rm L$  and  $\rm H)$  are each falsified with the same probability  $p$,  so that the mean error probability  $p_{\rm M} = p$  is also independent of the symbol probabilities  $p_{\rm L}$  and  $p_{\rm H}$.

The right graph shows the  "error correlation function"  $\rm (ECF)$  of the BSC model:

\[\varphi_{e}(k) = {\rm E}\big[e_{\nu} \cdot e_{\nu + k}\big] = \left\{ \begin{array}{c} p \\ p^2 \end{array} \right.\quad \begin{array}{*{1}c} f{\rm or }\hspace{0.25cm}k = 0 \hspace{0.05cm}, \\ f{\rm or }\hspace{0.25cm} k > 0 \hspace{0.05cm}.\\ \end{array}\]

$\text{Conclusion:}$ 

  • In the BSC model, the final ECF value  $($square of the mean error probability$)$,  which in other models is valid only for  $k \to \infty$,  is reached exactly at  $k = 1$  and then remains constant.
  • The BSC model belongs to the class of  "renewal channel models".  In a renewal channel model,  the error distances are statistically independent of each other and the error correlation function can be calculated iteratively in a simple way:
\[\varphi_{e}(k) = \sum_{\kappa = 1}^{k} {\rm Pr}(a = \kappa) \cdot \varphi_{e}(k - \kappa) \hspace{0.05cm}.\]

Binary Symmetric Channel – Error Distance Distribution


We now consider the  "error distance distribution"  $\rm (EDD)$.  The probability for the error distance  $a=k$  is obtained from the condition of  $k-1$  error-free symbols and one transmission error at time  $\nu +k$,  assuming that the last error occurred at time  $\nu$.  One obtains:

\[{\rm Pr}(a = k) = (1-p)^{k-1}\cdot p \hspace{0.05cm}.\]

It follows:

  • The error distance  $a = 1$  always occurs in the BSC model with the greatest probability,  and this for any value of  $p$.
  • This fact is somewhat surprising at first glance: 
With  $p = 0.01$,  for example,  the mean error distance is  ${\rm E}\big[a\big] = 100$.  Nevertheless,  two consecutive errors  $(a = 1)$  are more probable by a factor of  $0.99^{99} \approx 2.7$  than the error distance  $a = 100$.
\[V_a(k) = {\rm Pr}(a \ge k) = 1 - \sum_{\kappa = 1}^{k} (1-p)^{\kappa-1}\cdot p = (1-p)^{k-1}\hspace{0.05cm}.\]

$\text{Example 1:}$  The left graph shows  $V_a(k)$  in linear representation for

Error distance distribution for the BSC model in linear and logarithmic plots.
  • $p = 0.1$  (blue curve), and 
  • $p = 0.02$  (red curve).


⇒   The decrease is exponential with increasing  $k$  and is steeper the smaller  $p$  is.

⇒   The right graph shows the logarithmic representation.  Here the drop is linear according to

\[{\rm lg} \hspace{0.15cm}V_a(k) = (k - 1) \cdot {\rm lg} \hspace{0.15cm}(1-p)\hspace{0.05cm}.\]


Applications of the BSC model


The BSC model is the  "digital equivalent"  of the simplest analog model   ⇒   "AWGN"  for a time-invariant digital system corresponding to the following graph.  It holds

On the use of the BSC model
  1. The only degradation is noise.
  2. There is no distortion.


To use the BSC model,  the digital system must meet the following requirements:

  • Redundancy-free binary encoding   ⇒   no channel encoding and decoding,
  • noise according to the AWGN model   ⇒   additive,  white,  Gaussian distributed,
  • no  $($linear & non-linear$)$  distortions due to transmitter / receiver components,
  • threshold decision with symmetric decision threshold,
  • no extraneous interference influences such as:
    crosstalk, dial pulses, electromagnetic fields, ...


For a  "radio system"  with a direct line-of-sight between transmitter and receiver,

  • the application of the BSC model is often justified,


⇒   In contrast,  according to network operators,  statistically independent errors tend to be the exception in the case of  "wireline transmission" 
(e.g.  "DSL",  but also optical transmission$)$. 

⇒   If errors occur during data transmission via the telephone network,  they are usually clustered.  In this case,  we speak of so-called  "burst errors",  which will be discussed in the next chapter.

Exercises for the chapter


Exercise 5.3:  AWGN and BSC Model

Exercise 5.3Z:  Analysis of the BSC Model

Exercise 5.4:  Is the BSC Model Renewing?

Exercise 5.5:  Error Sequence and Error Distance Sequence