Information Theory
A discipline is a lens, not an owner — the same idea can be viewed through many.
Concepts viewed through this lens
These numbers describe the current Thinking OS knowledge slice, not the whole field.
Disciplines it bridges to
Each bridge is built by ideas the two fields share, the thinking patterns that recur across both, and a representative relationship that shows how they connect.
Information Theoryconnects toComputer Science
Shared thinking patterns
Why this bridge exists
Data compression depends on Algorithm — data compression depends on Algorithm.
Explore this connection →Information Theoryconnects toSignal Processing
Shared thinking patterns
Why this bridge exists
Quantization causes Noise — Quantization causes Noise.
Explore this connection →Information Theoryconnects toMathematics
Shared concepts
Shared thinking patterns
Why this bridge exists
Data compression depends on Algorithm — data compression depends on Algorithm.
Explore this connection →Information Theoryconnects toPhysics
Shared concepts
Shared thinking patterns
Why this bridge exists
Second law of thermodynamics explains Entropy — second law of thermodynamics explains Entropy.
Explore this connection →Information Theoryconnects toTelecommunications Engineering
Shared thinking patterns
Why this bridge exists
Quantization causes Noise — Quantization causes Noise.
Explore this connection →Information Theoryconnects toAudio Engineering
Shared concepts
Shared thinking patterns
Why this bridge exists
Nyquist–Shannon sampling theorem constrains Sampling rate — Nyquist–Shannon sampling theorem constrains sampling rate.
Explore this connection →Information Theoryconnects toCommunication Science
Shared concepts
Shared thinking patterns
Why this bridge exists
Mass media is part of Information — Media carry information.
Explore this connection →Information Theoryconnects toBiology
Shared concepts
Shared thinking patterns
Why this bridge exists
Neural signal is a Signal — A neural signal is a biological signal.
Explore this connection →
Field shape — representation health
68/100 overall · 17 concepts
The eight dimensions measure Thinking OS coverage of this field, not the quality or importance of the discipline.
What kind of structure is this field?
Interpreted from the current atlas — how this field is represented, not a judgement of the field.
Representation health 68/100 — healthy representation. Strongest: cross-disciplinary, taxonomy. Thinnest: factual depth.
structural · Measures the current Thinking OS representation, not the quality or importance of the field.
Its 68 representation-health is above the 55 median of 208 similarly-sized disciplines (comparable by concept count).
structural · Measures the current Thinking OS representation, not the quality or importance of the field.
12% of its concepts have a single connection (mean internal degree 2.5) — a fairly cohesive internal structure.
structural · Measures the current Thinking OS representation, not the quality or importance of the field.
61% of its relations reach into 40 other disciplines — an outward-facing field in the atlas.
structural · Measures the current Thinking OS representation, not the quality or importance of the field.
65% of its concepts carry a source, 47% a Tier A/B source; 65% of relations carry claim-level evidence.
atlas representation · Measures the current Thinking OS representation, not the quality or importance of the field.
How this lens connects
The kinds of relationship that characterise this discipline lens in the current slice.
Coverage matrix
How these concepts distribute across domains and concept families — real counts, not a score.
Knowledge timeline
Real, sourced key dates of these concepts.
- 1948Shannon entropy · Publication · Information Theory
Ideas that connect this discipline outward
Concepts viewed through this lens that reach disciplines it does not itself carry — concept-level bridges (distinct from the discipline-to-discipline bridges below).
- EntropyreachesChemical EngineeringChemistryEconomicsEngineeringEnvironmental EngineeringMathematicsProbabilityStatisticsSustainability Science
- Information theoryreachesCommunication ScienceElectrical EngineeringHuman-Computer InteractionNeurosciencePhysical ChemistryPhysicsSignal ProcessingStatistical PhysicsThermodynamics
- InformationreachesData ScienceElectrical EngineeringHuman-Computer InteractionInformation ScienceJournalismMedia StudiesMolecular BiologyNeuroscience
- Shannon entropyreachesMathematicsPhysical ChemistryPhysicsProbabilityStatistical PhysicsStatisticsTelecommunications EngineeringThermodynamics
- Signal-to-noise ratioreachesAcousticsAudio EngineeringCommunication ScienceElectrical EngineeringHuman-Computer InteractionNeurosciencePhysicsStatistics
- Data compressionreachesAlgorithmsAudio EngineeringDiscrete MathematicsLogicMathematicsSignal ProcessingSoftware EngineeringTheory of Computation
Mental models that recur here
Information ×7
Anything that reduces uncertainty. It can be encoded into a signal, sent across a channel, and decoded — and noise can corrupt it on the way.
Signal vs noise ×5
Real data mixes a meaningful pattern (signal) with random variation (noise); the skill is telling them apart before you act on either.
Entropy & irreversibility ×2
Left alone, systems drift toward their most probable, most spread-out states — giving processes a direction in time that is hard to reverse.
Constraints ×1
Limits that decide what is possible. Usually one binding constraint — the bottleneck — governs the outcome until it is relieved.
People represented in this atlas
People tagged with this lens who have a recorded contribution. Not exhaustive, and not a ranking.
- Oliver Heaviside
1850–1925
- Harry Nyquist
1889–1976
- Andrey Kolmogorov
1903–1987
- Claude Shannon
1916–2001
- David Donoho
1957–present
- Erdal Arıkan
1958–present
- 17 concepts are viewed through this lens.
- 14 of them bridge into other disciplines.
- Its signature thinking pattern is “Information” (recurs in 7 concepts).
- The most common kind of connection here is “Teaching link”.
- It is most tightly linked to Computer Science.
Derived from the current graph structure — observations, not a judgement of the field.