# Information theory

# Preface

## Prerequisites

## Learning ethics

# Introduction

## What is Information Theory?

## Why does Information Theory matter to you?

## Research

## Learning Levels

## Ecosystem

Standards, jobs, industry, roles, â€¦

## Story

## FAQ

## Worked examples

**Quantities of information. Entropy.**

## Subsection

### Subsubsection

## Exercises

- Logic. Mathematics. Code. Automatic Verification such as Lean Proven or Frama-C.

- Languages in Anki.

## Projects

## Summary

## FAQ

## Reference Notes

**Coding theory**

Data compression (source coding)

Error control (channel coding)

Cryptographic coding

Line coding

## Applications

**Barcode**

# Data compression

# Noisy-Channel Coding

# Hash codes

# Binary codes

# Code breaking

# Algorithmic complexity theory

**Algorithmic information theory**

# Applications

**Pseudorandom number generation**

# References

https://colah.github.io/posts/2015-09-Visual-Information/

Information theory | Computer science | Computing | Khan Academy. (2022, December 12). Retrieved from https://www.khanacademy.org/computing/computer-science/informationtheory

Information Theory, Inference, and Learning Algorithms by David J.C. MacKay https://www.inference.org.uk/itprnn/book.pdf

https://web.mit.edu/6.933/www/Fall2001/Shannon2.pdf

What are some standard books/papers on Information Theory? (2022, December 12). Retrieved from https://cstheory.stackexchange.com/questions/37123/what-are-some-standard-books-papers-on-information-theory