Information Theory - Revision history

Guenter at 16:50, 31 December 2023

2023-12-31T16:50:34Z

Guenter at 11:25, 3 April 2023

2023-04-03T11:25:03Z

Hwang at 19:10, 30 March 2023

2023-03-30T19:10:33Z

Hwang at 19:10, 30 March 2023

2023-03-30T19:10:09Z

Hwang at 19:09, 30 March 2023

2023-03-30T19:09:35Z

Guenter at 15:58, 27 March 2023

2023-03-27T15:58:23Z

Guenter at 15:14, 8 March 2023

2023-03-08T15:14:14Z

Guenter at 14:35, 8 March 2023

2023-03-08T14:35:49Z

Guenter at 14:25, 8 March 2023

2023-03-08T14:25:28Z

Guenter at 14:21, 8 March 2023

2023-03-08T14:21:14Z

@@ Line 2: / Line 2: @@
 {{BlueBox|TEXT=From the earliest beginnings of message transmission as an engineering discipline,&nbsp; it has been the endeavour of many engineers and mathematicians&nbsp; to find a quantitative measure for the
-*contained&nbsp; $\rm information$&nbsp; $($quite generally:&nbsp; "the knowledge about something"$)$
+*contained&nbsp; $\rm information$&nbsp; $($quite generally:&nbsp; &raquo;the knowledge about something&laquo;$)$
-*in a&nbsp; $\rm message$&nbsp; $($here we mean&nbsp; "a collection of symbols and/or states"$)$.
+*in a&nbsp; $\rm message$&nbsp; $($here we mean&nbsp; &raquo;a collection of symbols and/or states&raquo;$)$.
@@ Line 11: / Line 11: @@
 [https://en.wikipedia.org/wiki/Claude_Shannon '''Claude Elwood Shannon''']&nbsp; succeeded in 1948,&nbsp; in establishing a consistent theory about the information content of messages,&nbsp; which was revolutionary in its time and created a new,&nbsp; still highly topical field of science:&nbsp;  &raquo;'''Shannon's information theory&laquo;'''&nbsp; named after him.
-This is what the fourth book in the&nbsp; $\rm LNTww$ series deals with,&nbsp; in particular:
+This is what the fourth book in the&nbsp; $\rm LNTwww$ series deals with,&nbsp; in particular:
 # Entropy of discrete-value sources with and without memory,&nbsp; as well as natural message sources:&nbsp; Definition,&nbsp; meaning and computational possibilities.
-# Source coding and data compression,&nbsp; especially the &nbsp; "Lempel&ndash;Ziv&ndash;Welch method" &nbsp; and &nbsp; "Huffman's entropy encoding".
+# Source coding and data compression,&nbsp; especially the &nbsp; &raquo;Lempel&ndash;Ziv&ndash;Welch method&laquo; &nbsp; and &nbsp; &raquo;Huffman's entropy encoding&laquo;.
 # Various entropies of two-dimensional discrete-value random quantities.&nbsp; Mutual information and channel capacity.&nbsp; Application to digital signal transmission.
 # Discrete-value information theory.&nbsp; Differential entropy.&nbsp; AWGN channel capacity with continuous-valued as well as discrete-valued input.

@@ Line 9: / Line 9: @@
 The&nbsp; $($abstract$)$&nbsp; information is communicated by the&nbsp; $($concrete$)$&nbsp; message and can be conceived as the interpretation of a message.
-[https://en.wikipedia.org/wiki/Claude_Shannon '''Claude Elwood Shannon''']&nbsp; succeeded in 1948,&nbsp; in establishing a consistent theory about the information content of messages,&nbsp; which was revolutionary in its time and created a new,&nbsp; still highly topical field of science:&nbsp;  &raquo;'''Shannon's information theory&laquo;'''&nbsp; named after him.&raquo; '''KORREKTUR: &raquo;?'''
+[https://en.wikipedia.org/wiki/Claude_Shannon '''Claude Elwood Shannon''']&nbsp; succeeded in 1948,&nbsp; in establishing a consistent theory about the information content of messages,&nbsp; which was revolutionary in its time and created a new,&nbsp; still highly topical field of science:&nbsp;  &raquo;'''Shannon's information theory&laquo;'''&nbsp; named after him.
 This is what the fourth book in the&nbsp; $\rm LNTww$ series deals with,&nbsp; in particular:

@@ Line 12: / Line 12: @@
 This is what the fourth book in the&nbsp; $\rm LNTww$ series deals with,&nbsp; in particular:
-# Entropy of discrete-value sources with and withott memory,&nbsp; as well as natural message sources:&nbsp; Definition,&nbsp; meaning and computational possibilities.
+# Entropy of discrete-value sources with and without memory,&nbsp; as well as natural message sources:&nbsp; Definition,&nbsp; meaning and computational possibilities.
 # Source coding and data compression,&nbsp; especially the &nbsp; "Lempel&ndash;Ziv&ndash;Welch method" &nbsp; and &nbsp; "Huffman's entropy encoding".
 # Various entropies of two-dimensional discrete-value random quantities.&nbsp; Mutual information and channel capacity.&nbsp; Application to digital signal transmission.

@@ Line 9: / Line 9: @@
 The&nbsp; $($abstract$)$&nbsp; information is communicated by the&nbsp; $($concrete$)$&nbsp; message and can be conceived as the interpretation of a message.
-[https://en.wikipedia.org/wiki/Claude_Shannon '''Claude Elwood Shannon''']&nbsp; succeeded in 1948,&nbsp; in establishing a consistent theory about the information content of messages,&nbsp; which was revolutionary in its time and created a new,&nbsp; still highly topical field of science:&nbsp;  &raquo;'''Shannon's information theory&laquo;'''&nbsp; named after him.&raquo;
+[https://en.wikipedia.org/wiki/Claude_Shannon '''Claude Elwood Shannon''']&nbsp; succeeded in 1948,&nbsp; in establishing a consistent theory about the information content of messages,&nbsp; which was revolutionary in its time and created a new,&nbsp; still highly topical field of science:&nbsp;  &raquo;'''Shannon's information theory&laquo;'''&nbsp; named after him.&raquo; '''KORREKTUR: &raquo;?'''
 This is what the fourth book in the&nbsp; $\rm LNTww$ series deals with,&nbsp; in particular:

@@ Line 9: / Line 9: @@
 The&nbsp; $($abstract$)$&nbsp; information is communicated by the&nbsp; $($concrete$)$&nbsp; message and can be conceived as the interpretation of a message.
-[https://de.wikipedia.org/wiki/Claude_Shannon '''Claude Elwood Shannon''']&nbsp; succeeded in 1948,&nbsp; in establishing a consistent theory about the information content of messages,&nbsp; which was revolutionary in its time and created a new,&nbsp; still highly topical field of science:&nbsp;  &raquo;'''Shannon's information theory&laquo;'''&nbsp; named after him.&raquo;
+[https://en.wikipedia.org/wiki/Claude_Shannon '''Claude Elwood Shannon''']&nbsp; succeeded in 1948,&nbsp; in establishing a consistent theory about the information content of messages,&nbsp; which was revolutionary in its time and created a new,&nbsp; still highly topical field of science:&nbsp;  &raquo;'''Shannon's information theory&laquo;'''&nbsp; named after him.&raquo;
 This is what the fourth book in the&nbsp; $\rm LNTww$ series deals with,&nbsp; in particular:

← Older revision		Revision as of 15:58, 27 March 2023
Line 73:		Line 73:


−	~~In addition to these theory pages, we also offer exercises and multimedia modules that could help to clarify the teaching material:~~

−	*[https://en.lntwww.de/Category:Information_Theory:_Exercises $\text{Exercises}$]
−	*[[LNTwww:Learning_videos_to_"Information_Theory"\|$\text{Learning videos}$]]
−	*[[LNTwww:Applets_to_"Information_Theory"\|$\text{Applets}$]]
−	~~<br><br>~~
−	~~$\text{Other links:}$~~
−
−	~~$(1)$    [[LNTwww:Bibliography_to_"Information_Theory"\|$\text{Bibliography to the book}$]]~~
−
−	$(2)$    [[LNTwww:General_notes_about_Information_Theory\|$\text{General notes about the book}$]]   (authors,  other participants,  materials as a starting point for the book,  list of sources)
−
−	~~<br><br>~~

	__NOTOC__		__NOTOC__
	__NOEDITSECTION__		__NOEDITSECTION__

@@ Line 69: / Line 69: @@
 $(4)$&nbsp; &nbsp; [[LNTwww:Bibliography_to_"Information_Theory"|$\text{Bibliography}$]]
-$(5)$&nbsp; &nbsp; [[LNTwww:Imprint_for_the_book_"Stochastic_Signal_Theory"|$\text{Impressum}$]]}}
+$(5)$&nbsp; &nbsp; [[LNTwww:Imprint_for_the_book_"Information_Theory"|$\text{Impressum}$]]}}
 <br><br>

@@ Line 67: / Line 67: @@
 {{BlaueBox|TEXT=
-$(4)$&nbsp; &nbsp; [[LNTwww:Bibliography_to_"Theory_of_Stochastic_Signals"|$\text{Bibliography}$]]
+$(4)$&nbsp; &nbsp; [[LNTwww:Bibliography_to_"Information_Theory"|$\text{Bibliography}$]]
 $(5)$&nbsp; &nbsp; [[LNTwww:Imprint_for_the_book_"Stochastic_Signal_Theory"|$\text{Impressum}$]]}}

← Older revision		Revision as of 14:25, 8 March 2023
Line 64:		Line 64:


−	~~LNTwww:Imprint for the book "Stochastic Signal Theory"~~
	===Further links===		===Further links===

← Older revision		Revision as of 14:21, 8 March 2023
Line 61:		Line 61:
	$(2)$    [[LNTwww:Learning_videos_to_"Information_Theory"\|$\text{Learning videos}$]]		$(2)$    [[LNTwww:Learning_videos_to_"Information_Theory"\|$\text{Learning videos}$]]

−	$(3)$    [[Applets_to_"Information_Theory"\|$\text{Applets}$]] }}	+	$(3)$    [[LNTwww:Applets_to_"Information_Theory"\|$\text{Applets}$]] }}