Information theory
Preface
Prerequisites
Learning ethics
Introduction
What is Information Theory?
Why does Information Theory matter to you?
Research
Learning Levels
Ecosystem
Standards, jobs, industry, roles, …
Story
FAQ
Worked examples
Quantities of information. Entropy.
Subsection
Subsubsection
Exercises
- Logic. Mathematics. Code. Automatic Verification such as Lean Proven or Frama-C.
- Languages in Anki.
Projects
Summary
FAQ
Reference Notes
Coding theory
Data compression
Noisy-Channel Coding
Hash codes
Binary codes
Code breaking
Algorithmic complexity theory
Algorithmic information theory
Applications
Pseudorandom number generation
References
Information theory | Computer science | Computing | Khan Academy. (2022, December 12). Retrieved from https://www.khanacademy.org/computing/computer-science/informationtheory
Information Theory, Inference, and Learning Algorithms by David J.C. MacKay https://www.inference.org.uk/itprnn/book.pdf
https://web.mit.edu/6.933/www/Fall2001/Shannon2.pdf
What are some standard books/papers on Information Theory? (2022, December 12). Retrieved from https://cstheory.stackexchange.com/questions/37123/what-are-some-standard-books-papers-on-information-theory