Difference between revisions of "Information Theory"

From LNTwww
Line 44: Line 44:
  
 
*[https://en.lntwww.de/Category:Signal_Representation:_Exercises  $\text{Exercises}$]
 
*[https://en.lntwww.de/Category:Signal_Representation:_Exercises  $\text{Exercises}$]
*[https://en.lntwww.de/Kategorie:Aufgaben_zu_Informationstheorie $\text{Exercises}$]
+
*[https://en.lntwww.de/Category:Information_Theory:_Exercises $\text{Exercises}$]
 
*[[LNTwww:Lernvideos_zu_Informationstheorie|$\text{Learning videos}$]]
 
*[[LNTwww:Lernvideos_zu_Informationstheorie|$\text{Learning videos}$]]
 
*[[LNTwww:HTML5-Applets_zu_Informationstheorie|$\text{redesigned applets}$]], based on HTML5, also executable on smartphones
 
*[[LNTwww:HTML5-Applets_zu_Informationstheorie|$\text{redesigned applets}$]], based on HTML5, also executable on smartphones

Revision as of 13:35, 1 September 2021

Since the early beginnings of communications as an engineering discipline, many engineers and mathematicians have sought to find a quantitative measure of

  • the $\rm Information$  (in general: "the knowledge of something") contained in a  $\rm message$  (here we understand "a collection of symbols and/or states").


The (abstract) information is communicated by the (concrete) message and can be seen as an interpretation of a message.

Claude Elwood Shannon  succeeded in 1948 in establishing a consistent theory of the information content of messages, which was revolutionary in its time and created a new, still highly topical field of science:  the theory named after him  $\text{Shannon's Information Theory}$.

The course material corresponds to a  $\text{lecture with two semester hours per week (SWS) and one SWS exercise}$.

Here is a table of contents based on the  $\text{four main chapters}$  with a total of  $\text{13 individual chapters}$.


Contents

In addition to these theory pages, we also offer Exercises and multimedia modules that could help to clarify the teaching material:



$\text{More links:}$

$(1)$    $\text{Recommended literature for the book}$

$(2)$    $\text{General notes about the book}$   (Authors,  other participants,  materials as a starting point for the book,  list of sources)