Difference between revisions of "Aufgaben:Exercise 1.2: A Simple Binary Channel Code"

Latest revision as of 15:09, 17 August 2022

Clarification: Channel coding and decoding

The graph illustrates the channel coding $\mathcal{C}$ considered here:

There are four possible information blocks $\underline{u} = (u_{1},\ u_{2},\ \text{...}\hspace{0.05cm} ,\ u_{k})$.

Each information block $\underline{u}$ is uniquely assigned (recognizable by the same color) to the code word $\underline{x}= (x_{1},\ x_{2},\ \text{...}\hspace{0.05cm} ,\ x_{n})$ .

Due to decoding errors $(0 → 1, \ 1 → 0)$ there are more than 4, namely 16 different receive words $\underline{y} = (y_{1},\ y_{2},\ \text{...} \hspace{0.05cm} ,\ y_{n})$.

From subtask (4) we consider the following mapping:

$$\underline{u_0} = (0,\ 0) \leftrightarrow (0,\ 0,\ 0,\ 0) = \underline{x_0}\hspace{0.05cm},$$

$$\underline{u_1} = (0,\ 1) \leftrightarrow (0,\ 1,\ 0,\ 1) = \underline{x_1}\hspace{0.05cm},$$

$$\underline{u_2} = (1,\ 0) \leftrightarrow (1,\ 0,\ 1,\ 0) = \underline{x_2}\hspace{0.05cm},$$

$$\underline{u_3} = (1,\ 1) \leftrightarrow (1,\ 1,\ 1,\ 1) = \underline{x_3}\hspace{0.05cm}.$$

Hints:

This exercise belongs to the chapter "Objective of Channel Coding"

Reference is made in particular to the pages

Questions

$k \ = \ $

$n \ = \ $

$R \ = \ $

	Yes,
	No.

$ w_{\rm H} \ (\underline{x}_0) \ = \ $

$ w_{\rm H} \ (\underline{x}_1) \ = \ $

$ w_{\rm H} \ (\underline{x}_2) \ = \ $

$ w_{\rm H} \ (\underline{x}_3) \ = \ $

$ d_{\rm H} \ (\underline{x}_0,\ \underline{x}_1) \ = \ $

$ d_{\rm H} \ (\underline{x}_0,\ \underline{x}_3) \ = \ $

$ d_{\rm H} \ (\underline{x}_1,\ \underline{x}_2) \ = \ $

$ d_{\rm min} (\mathcal{C}) \ = \ $

Solution

(1) The code size here is given to $|\mathcal{C}| = 4$.

In general, $|\mathcal{C}|= 2^k$.
From this follows $\underline{ k = 2}$.

(2) Each code word $\underline{x}$ is uniquely associated with an information block $\underline{u}$.

By corruptions of a single of the total $n$ bits of a code word $\underline{x}$ the receive words $\underline{y}$ result.
From the number $(16 = 2^4$) of possible receive words follows $\underline{ n = 4}$.

(3) The code rate is by definition $R = k/n$. Using the above results, we obtain $\underline{R = 0.5}$.

(4) Correct is Yes: A systematic code is characterized by the fact that in each case the first $k$ bits of the code words are identical to the information block.

(5) The Hamming weight of a binary code is equal to the algebraic sum $x_1 + x_2 + \text{...} + x_n$ over all code word elements. Thus:

$$w_{\rm H}(\underline{x}_0) \hspace{0.15cm} \underline {= 0} \hspace{0.05cm}, \hspace{0.3cm}w_{\rm H}(\underline{x}_1) \hspace{0.15cm} \underline {= 2} \hspace{0.05cm}, \hspace{0.3cm} w_{\rm H}(\underline{x}_2) \hspace{0.15cm} \underline {= 2}\hspace{0.05cm}, \hspace{0.3cm}w_{\rm H}(\underline{x}_3) \hspace{0.15cm} \underline {= 4}\hspace{0.05cm}.$$

(6) The Hamming distance between two code words here can only take the values $2$ and $4$:

$$d_{\rm H}(\underline{x}_0, \hspace{0.05cm}\underline{x}_1) \hspace{0.15cm} \underline {= 2}\hspace{0.05cm}, \hspace{0.3cm} d_{\rm H}(\underline{x}_0, \hspace{0.05cm}\underline{x}_2) = 2\hspace{0.05cm}, \hspace{0.3cm} d_{\rm H}(\underline{x}_0, \hspace{0.05cm}\underline{x}_3) \hspace{0.15cm} \underline {= 4}\hspace{0.05cm},$$

$$ d_{\rm H}(\underline{x}_1, \hspace{0.05cm}\underline{x}_2) \hspace{0.15cm} \underline {= 4}\hspace{0.05cm}, \hspace{0.3cm} d_{\rm H}(\underline{x}_1, \hspace{0.05cm}\underline{x}_3) = 2\hspace{0.05cm}, \hspace{0.3cm} d_{\rm H}(\underline{x}_2, \hspace{0.05cm}\underline{x}_3) = 2\hspace{0.05cm}.$$

(7) From the result of subtask (6) it follows $d_{\rm min}(\mathcal{C}) \hspace{0.15cm}\underline{= 2}$.

Generally, for this quantity:

$$d_{\rm min}(\mathcal{C}) = \min_{\substack{\underline{x},\hspace{0.05cm}\underline{x}' \hspace{0.05cm}\in \hspace{0.05cm} \mathcal{C} \ {\underline{x}} \hspace{0.05cm}\ne \hspace{0.05cm} \underline{x}'}}\hspace{0.1cm}d_{\rm H}(\underline{x}, \hspace{0.05cm}\underline{x}')\hspace{0.05cm}.$$

@@ Line 1: / Line 1: @@
-{{quiz-Header|Buchseite=Kanalcodierung/Zielsetzung_der_Kanalcodierung
+{{quiz-Header|Buchseite=Channel_Coding/Objective_of_Channel_Coding
 }}
-[[File:P_ID2381__KC_A_1_2.png|right|frame|Zur Verdeutlichung der Kanalcodierung]]
+[[File:EN_KC_A_1_2_bitte.png|right|frame|Clarification:&nbsp; Channel coding and decoding ]]
-Die Grafik verdeutlicht die hier betrachtete Kanalcodierung $\mathcal{C}$:
+The graph illustrates the channel coding&nbsp; $\mathcal{C}$&nbsp; considered here:
-*Es gibt vier mögliche Informationsblöcke $\underline{u} = (u_{1}, u_{2}, \text{...}\hspace{0.05cm} , u_{k})$.
+*There are four possible information blocks&nbsp; $\underline{u} = (u_{1},\ u_{2},\ \text{...}\hspace{0.05cm} ,\ u_{k})$.
-*Jeder Informationsblock $\underline{u}$ wird eindeutig (erkennbar an der gleichen Farbe) dem Codewort $\underline{x}= (x_{1}, x_{2}, \text{...}\hspace{0.05cm}  , x_{n})$ zugeordnet.
-*Aufgrund von Decodierfehlern $(0 → 1, \ 1 → 0)$ gibt es mehr als 4, nämlich 16 verschiedene Empfangsworte $\underline{y} = (y_{1}, y_{2}, \text{...} \hspace{0.05cm} , y_{n})$.
+*Each information block&nbsp; $\underline{u}$&nbsp; is uniquely assigned&nbsp; (recognizable by the same color)&nbsp; to the code word&nbsp; $\underline{x}= (x_{1},\ x_{2},\ \text{...}\hspace{0.05cm} ,\ x_{n})$&nbsp;.
-Ab Teilaufgabe (4) betrachten wir folgende Zuordnung:
+*Due to decoding errors&nbsp; $(0 → 1, \ 1 → 0)$&nbsp; there are more than 4,&nbsp; namely 16 different receive words&nbsp; $\underline{y} = (y_{1},\ y_{2},\ \text{...} \hspace{0.05cm} ,\ y_{n})$.
-:$$\underline{u_0} = (0, 0) \leftrightarrow (0, 0, 0, 0) = \underline{x_0}\hspace{0.05cm},$$
-:$$\underline{u_1} = (0, 1) \leftrightarrow (0, 1, 0, 1) = \underline{x_1}\hspace{0.05cm},$$
-:$$\underline{u_2} = (1, 0) \leftrightarrow (1, 0, 1, 0) = \underline{x_2}\hspace{0.05cm},$$
-:$$\underline{u_3} = (1, 1) \leftrightarrow (1, 1, 1, 1) = \underline{x_3}\hspace{0.05cm}.$$
+From subtask&nbsp; '''(4)'''&nbsp; we consider the following mapping:
+:$$\underline{u_0} = (0,\ 0) \leftrightarrow (0,\ 0,\ 0,\ 0) = \underline{x_0}\hspace{0.05cm},$$
+:$$\underline{u_1} = (0,\ 1) \leftrightarrow (0,\ 1,\ 0,\ 1) = \underline{x_1}\hspace{0.05cm},$$
+:$$\underline{u_2} = (1,\ 0) \leftrightarrow (1,\ 0,\ 1,\ 0) = \underline{x_2}\hspace{0.05cm},$$
+:$$\underline{u_3} = (1,\ 1) \leftrightarrow (1,\ 1,\ 1,\ 1) = \underline{x_3}\hspace{0.05cm}.$$
-''Hinweise'':
-*Die Aufgabe gehört zum Kapitel [[Kanalcodierung/Zielsetzung_der_Kanalcodierung|Zielsetzung der Kanalcodierung]]
-*Bezug genommen wird insbesondere auf die Seiten [[Kanalcodierung/Zielsetzung_der_Kanalcodierung#Blockschaltbild_und_Voraussetzungen|Blockschaltbild und Voraussetzungen]] und  [[Kanalcodierung/Zielsetzung_der_Kanalcodierung#Einige_wichtige_Definitionen_zur_Blockcodierung|Einige wichtige Definitionen zur Blockcodierung]].
+Hints:
+*This exercise belongs to the chapter&nbsp; [[Channel_Coding/Objective_of_Channel_Coding|"Objective of Channel Coding"]]
+*Reference is made in particular to the pages&nbsp;
+:*[[Channel_Coding/Objective_of_Channel_Coding#Block_diagram_and_requirements|"Block diagram and requirements"]],
+:*[[Channel_Coding/Objective_of_Channel_Coding#Important_definitions_for_block_coding|"Important definitions for block coding"]].
-===Fragebogen===
+===Questions===
 <quiz display=simple>
-{Aus wievielen Binärsymbolen besteht ein Informationsblock?
+{How many binary symbols does an information block consist of?
 |type="{}"}
 $k \ = \ $ { 2 }
-{Wie groß ist die Codewortlänge $n$?
+{What is the code word length&nbsp; $n$?
 |type="{}"}
 $n \ = \ $ { 4 }
-{Wie groß ist die Coderate?
+{What is the code rate?
 |type="{}"}
 $R \ = \ $ { 0.5 3% }
-{Ist der hier vorgegebene Code systematisch?
+{Is the code given here systematic?
 |type="()"}
-+ Ja,
++ Yes,
-- Nein.
+- No.
-{Geben Sie die Hamming–Gewichte aller Codeworte an.
+{Give the Hamming weights of all code words.
 |type="{}"}
-$ w_{\rm H} \  (\underline{x}_0) \ = \ $ { 0. }
+$ w_{\rm H} \ (\underline{x}_0) \ = \ $ { 0. }
-$ w_{\rm H} \  (\underline{x}_1) \ = \ $ { 2 }
+$ w_{\rm H} \ (\underline{x}_1) \ = \ $ { 2 }
-$ w_{\rm H} \  (\underline{x}_2) \ = \ $ { 2 }
+$ w_{\rm H} \ (\underline{x}_2) \ = \ $ { 2 }
-$ w_{\rm H} \  (\underline{x}_3) \ = \ $ { 4 }
+$ w_{\rm H} \ (\underline{x}_3) \ = \ $ { 4 }
-{Geben Sie die Hamming–Distanzen zwischen folgenden Codeworten an.
+{Indicate the Hamming distances between the following code words.
 |type="{}"}
-$ d_{\rm H} \  (\underline{x}_0, \underline{x}_1) \ = \ $ { 2 }
+$ d_{\rm H} \ (\underline{x}_0,\ \underline{x}_1) \ = \ $ { 2 }
-$ d_{\rm H} \  (\underline{x}_0, \underline{x}_3) \ = \ $ { 4 }
+$ d_{\rm H} \ (\underline{x}_0,\ \underline{x}_3) \ = \ $ { 4 }
-$ d_{\rm H} \  (\underline{x}_1, \underline{x}_2) \ = \ $ { 4 }
+$ d_{\rm H} \ (\underline{x}_1,\ \underline{x}_2) \ = \ $ { 4 }
-{Wie groß ist die minimale Hamming–Distanz des betrachteten Codes $\mathcal{C}$?
+{What is the minimum Hamming distance of the code&nbsp; $\mathcal{C}$&nbsp; under consideration?
 |type="{}"}
-$ d_{\rm min}  (\mathcal{C}) \ = \ $ { 2 }
+$ d_{\rm min} (\mathcal{C}) \ = \ $ { 2 }
 </quiz>
-===Musterlösung===
+===Solution===
 {{ML-Kopf}}
-'''(1)'''&nbsp; Der Codeumfang ist hier zu $|\mathcal{C}| = 4$ gegeben. Allgemein gilt $|\mathcal{C}|= 2^k$. Daraus folgt $\underline{ k = 2}$.
+'''(1)'''&nbsp; The code size here is given to&nbsp; $|\mathcal{C}| = 4$.
+*In general,&nbsp; $|\mathcal{C}|= 2^k$.
+*From this follows&nbsp; $\underline{ k = 2}$.
+'''(2)'''&nbsp; Each code word&nbsp; $\underline{x}$&nbsp; is uniquely associated with an information block&nbsp; $\underline{u}$.
+*By corruptions of a single of the total&nbsp; $n$&nbsp; bits of a code word&nbsp; $\underline{x}$&nbsp; the receive words&nbsp; $\underline{y}$&nbsp; result.
+*From the number&nbsp; $(16 = 2^4$)&nbsp; of possible receive words follows&nbsp; $\underline{ n = 4}$.
-'''(2)'''&nbsp; Jedes Codewort   $\underline{x}$   ist eineindeutig einem Informationsblock   $\underline{u}$  zugeordnet. Durch Verfälschungen einzelner der insgesamt  $n$   Bit eines Codewortes  $\underline{x}$ ergeben sich die Empfangsworte    $\underline{y}$  . Aus der Anzahl $(16 = 2^4$) der möglichen Empfangsworte folgt $\underline{ n = 4}$.
+'''(3)'''&nbsp; The code rate is by definition&nbsp; $R = k/n$.&nbsp; Using the above results,&nbsp; we obtain $\underline{R = 0.5}$.
-'''(3)'''&nbsp; Die Coderate ist per Definition $R = k/n$. Mit den obigen Ergebnissen erhält man $\underline{R = 0.5}$.
+'''(4)'''&nbsp; Correct is&nbsp; <u>Yes</u>:&nbsp; A systematic code is characterized by the fact that in each case the first&nbsp; $k$&nbsp; bits of the code words are identical to the information block.
-'''(4)'''&nbsp; Richtig ist <u>Ja</u>. Ein systematischer Code zeichnet sich dadurch aus, dass jeweils die ersten $k$ Bit der Codeworte identisch sind mit dem Informationsblock.
-'''(5)'''&nbsp;  Das Hamming–Gewicht eines binären Codes ist gleich der algebraischen Summe $x_1 + x_2 + \text{...} + x_n$ über alle Codewortelemente. Damit gilt:
+'''(5)'''&nbsp; The Hamming weight of a binary code is equal to the algebraic sum&nbsp; $x_1 + x_2 + \text{...} + x_n$&nbsp; over all code word elements.&nbsp; Thus:
 :$$w_{\rm H}(\underline{x}_0) \hspace{0.15cm} \underline {= 0} \hspace{0.05cm}, \hspace{0.3cm}w_{\rm H}(\underline{x}_1) \hspace{0.15cm} \underline {= 2} \hspace{0.05cm}, \hspace{0.3cm} w_{\rm H}(\underline{x}_2) \hspace{0.15cm} \underline {= 2}\hspace{0.05cm}, \hspace{0.3cm}w_{\rm H}(\underline{x}_3) \hspace{0.15cm} \underline {= 4}\hspace{0.05cm}.$$
-'''(6)'''&nbsp; Die Hamming–Distanz zwischen zwei Codeworten kann hier nur die Werte $2$ und $4$ annehmen:
+'''(6)'''&nbsp; The Hamming distance between two code words here can only take the values&nbsp; $2$&nbsp; and&nbsp; $4$:
 :$$d_{\rm H}(\underline{x}_0, \hspace{0.05cm}\underline{x}_1) \hspace{0.15cm} \underline {= 2}\hspace{0.05cm}, \hspace{0.3cm} d_{\rm H}(\underline{x}_0, \hspace{0.05cm}\underline{x}_2) = 2\hspace{0.05cm}, \hspace{0.3cm} d_{\rm H}(\underline{x}_0, \hspace{0.05cm}\underline{x}_3) \hspace{0.15cm} \underline {= 4}\hspace{0.05cm},$$
 :$$ d_{\rm H}(\underline{x}_1, \hspace{0.05cm}\underline{x}_2) \hspace{0.15cm} \underline {= 4}\hspace{0.05cm}, \hspace{0.3cm} d_{\rm H}(\underline{x}_1, \hspace{0.05cm}\underline{x}_3) = 2\hspace{0.05cm}, \hspace{0.3cm} d_{\rm H}(\underline{x}_2, \hspace{0.05cm}\underline{x}_3) = 2\hspace{0.05cm}.$$
-'''(7)'''&nbsp; Aus dem Ergebnis der Teilaufgabe (6) folgt $d_{\rm min}(\mathcal{C}) \hspace{0.15cm}\underline{= 2}$. Allgemein gilt für diese Größe:
-:$$d_{\rm min}(\mathcal{C}) = \min_{\substack{\underline{x},\hspace{0.05cm}\underline{x}' \hspace{0.05cm}\in \hspace{0.05cm} \mathcal{C} \\ {\underline{x}} \hspace{0.05cm}\ne \hspace{0.05cm} \underline{x}'}}\hspace{0.1cm}d_{\rm H}(\underline{x}, \hspace{0.05cm}\underline{x}')\hspace{0.05cm}.$$
+'''(7)'''&nbsp; From the result of subtask&nbsp; '''(6)'''&nbsp; it follows&nbsp; $d_{\rm min}(\mathcal{C}) \hspace{0.15cm}\underline{= 2}$.
+*Generally,&nbsp; for this quantity:
+:$$d_{\rm min}(\mathcal{C}) = \min_{\substack{\underline{x},\hspace{0.05cm}\underline{x}' \hspace{0.05cm}\in \hspace{0.05cm} \mathcal{C} \ {\underline{x}} \hspace{0.05cm}\ne \hspace{0.05cm} \underline{x}'}}\hspace{0.1cm}d_{\rm H}(\underline{x}, \hspace{0.05cm}\underline{x}')\hspace{0.05cm}.$$
@@ Line 96: / Line 111: @@
-[[Category:Aufgaben zu  Kanalcodierung|^1.1 Zielsetzung der Kanalcodierung^]]
+[[Category:Channel Coding: Exercises|^1.1 Objective of Channel Coding^]]