😲 Quantifying Surprise — A Data Scientist’s Intro To Information Theory — Part 1/4: Foundations

-

Towards Data Science
Surprise! Generated using Gemini.

Through the telecommunication boom, Claude Shannon, in his seminal 1948 paper¹, posed a matter that may revolutionise technology:

How can we quantify communication?

Shannon’s findings remain fundamental to expressing information quantification, storage, and communication. These insights made major contributions to the creation of technologies starting from signal processing, data compression (e.g., Zip files and compact discs) to the Web and artificial intelligence. More broadly, his work has significantly impacted diverse fields akin to neurobiology, statistical physics and computer science (e.g, cybersecurity, cloud computing, and machine learning).

[Shannon’s paper is the]

Magna Carta of the Information Age

— Scientific American

That is the primary article in a series that explores information quantification — a vital tool for data scientists. Its applications range from enhancing statistical analyses to serving as a go-to decision heuristic in cutting-edge machine learning algorithms.

ASK ANA

What are your thoughts on this topic?
Let us know in the comments below.

0 0 votes
Article Rating
guest
0 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

Share this article

Recent posts

0
Would love your thoughts, please comment.x
()
x