Aller au menu Aller au contenu
Academics
Academics
Academics

> Study at Esisar > Engineering degree in Information Technology & Security

Information theory - 3AMMA331

A+Augmenter la taille du texteA-Réduire la taille du texteImprimer le documentEnvoyer cette page par mail cet article Facebook Twitter Linked In
  • Number of hours

    • Lectures : 12.0
    • Tutorials : 10.5
    • Laboratory works : 3.0
    • Projects : -
    • Internship : -
    • Written tests : -
    ECTS : 3.0
  • Officials : Nicolas BARBOT

Goals

At the end of the course, the student should be knowledgeable in the fundamentals of information theory, source coding (data compression) and channel coding (error detection and correction), in order to be able later to grasp the more recent techniques in the field.

Content

  • Information theory
    • Information measure
    • Sources, stateful and stateless sources, Markov sources, source extention, source rate
    • Entropy, mutual entropy, conditional entropy
    • Communication canals, transition matrices
    • Lossless canals, deterministic, noiseless, binary, symetric
    • Mutual information, canal capacity
    • White noise additive canals, capacity
    • Second Shannon theorem - canal coding
  • Introduction to source coding
    • Kraft inequality, Mac-Millan theorem
    • Mean length, efficiency and redundancy of a source code
    • First Shannon theorem
    • Shannon-Fano and Huffman codes
    • Lempel-Ziv codes
  • Linear block codes
    • Generation matrix, control matrix
    • Hamming distance and weight
    • Repetition code, parity code, Hamming code, extended Hamming code
    • Syndrom, decoding
  • Cyclical codes
    • Polynomial representation
    • Generating polynomial, control polynomial, generating matrix
    • Coder and decoder principlse, Meggit decoder
    • Code examples: BCH code, Golay code, Reed-Salomon code

Prerequisites

Basic mathematics. Combinatorics. Probability theory. Signal processing.

Tests



Calendar

The course exists in the following branches:

see the course schedule for 2020-2021

Additional Information

Course ID : 3AMMA331
Course language(s): FR

The course is attached to the following structures:

  • Team

You can find this course among all other courses.

Bibliography

  • "Théorie de l'information : application aux techniques de communication", Battail, G., Masson, 1997
  • "Introduction aux codes correcteurs", Csillag, P., Ellipses, 1990
  • "Communications analogiques et numériques", Hwei Hsu, P., Mc Graw Hill, 2002
  • "Introduction aux communications numériques", Khireddine, A., Dunod, 2006
  • "Digital Communications", Proakis, J.G., 4ème éd., Mc Graw Hill, 2003

A+Augmenter la taille du texteA-Réduire la taille du texteImprimer le documentEnvoyer cette page par mail cet article Facebook Twitter Linked In

Date of update June 25, 2015

Université Grenoble Alpes