Tag

#Information Theory

14 articles

Explore (search, categories, archive)

On Russel's Paradox

Russel's paradox is defining "the set of all sets that don't contain themselves". You can show that such construct leads to a contradiction. Read the wiki link for details. I started this article as a...

2 min read

Life is very compressible

An information representation (or string) s is very compressible if the size of it's smallest possible compression K(s) is very small compared with it's observed size(s). The smallest compression size...

3 min read

Irrational numbers

This article contains my personal reflections on irrational numbers, especially the informational property of their infinite strings of decimal - strings that often look close to random at a shallow l...

9 min read

Kolmogorov complexity - short, informal introduction

I want to give you an intuition about Kolmogorov complexity, without being very formal. Basically, Kolmogorov complexity defines a measure of how small can you compress a certain string of characters....

4 min read

On Intelligent life forms

I define intelligence as the capacity of one entity to create complex internal representations that can be used to predict about it's environment the likely outcome from a particular configuration or...

5 min read

P=NP is undecidable (conjecture)

"P equals NP?" is a million dollars unsolved problem. Introduction "P" is the class of problems where we have algorithms that solves the problem in polynomial time. "NP" is the class of problems havin...

6 min read

Can a computer (or human) simulate itself?

A virtual machine is a common example of simulation. It can take the description of a (virtual) "computer" state and continue the execution from that point on. You can simulate a huge computer given a...

5 min read

We believe in a compressible Universe

"Believe" is often associated with religion. However, even for using the "scientific method", we are forced to assume certain qualities of the Universe that we cannot prove nor fully verify. The most...

2 min read