edVirtus Reference

What is the Shannon-Hartley theorem?

What Is the Shannon-Hartley Limit?

Preview: Learn more about the Shannon-Hartley theorem and the Shannon-Hartley limit.

The Shannon-Hartley theorem is one of the most important results in communications engineering because it establishes the maximum rate at which information can be transmitted reliably over a communications channel in the presence of noise. It demonstrates that every channel has a finite information-carrying capacity and that no amount of clever engineering can exceed this fundamental limit without increasing either the channel bandwidth or the signal-to-noise ratio.

The theorem combines the work of two pioneers separated by more than twenty years. In 1928, the American engineer Ralph V. L. Hartley investigated the relationship between bandwidth and the amount of information that could be transmitted over an ideal, noiseless communications channel. Hartley showed that increasing the bandwidth increased the potential information rate, laying the foundations for a quantitative theory of communications. His work, however, did not account for one unavoidable feature of every practical communications system—noise.

That problem was addressed in 1948 by the American mathematician and engineer Claude Shannon. In his landmark paper A Mathematical Theory of Communication, Shannon developed the modern mathematical framework of information theory and showed how random noise fundamentally limits reliable communication. By combining Hartley's earlier work on bandwidth with his own analysis of noisy channels, Shannon derived what is now known as the Shannon-Hartley theorem.

The theorem states that the maximum achievable information rate depends upon only three quantities: the channel bandwidth, the signal power, and the noise power. Increasing the bandwidth allows more information to be transmitted because a wider range of frequencies is available. Similarly, increasing the signal-to-noise ratio makes it easier for the receiver to distinguish the transmitted signal from the background noise. Conversely, narrow channels or noisy environments reduce the maximum achievable information rate.

One of the most remarkable aspects of the theorem is that it describes an absolute theoretical limit rather than the performance of any particular communications system. Early communication equipment operated well below this limit, leading many engineers to believe that it could never be approached in practice. Over subsequent decades, however, advances in modulation, channel coding, and digital signal processing steadily narrowed the gap. Modern systems employing technologies such as low-density parity-check (LDPC) codes and turbo codes can operate surprisingly close to the Shannon-Hartley limit, often within a fraction of a decibel under favourable conditions.

The theorem also explains many familiar engineering trade-offs. A satellite link, for example, may increase its data rate by using a wider bandwidth, increasing transmitter power, or employing more sophisticated coding techniques that operate closer to the theoretical limit. Similarly, a mobile phone operating in a weak-signal area often reduces its transmission rate to maintain reliable communication as the signal-to-noise ratio decreases. In every case, engineers are working within the constraints established by the Shannon-Hartley theorem.

Today, the Shannon-Hartley theorem underpins the design of virtually every modern communications system. It influences the development of mobile networks, Wi-Fi, optical fiber systems, satellite communications, digital television, radar, and deep-space communications. Whenever engineers evaluate the performance of a communications channel, one of the first questions they ask is how closely the system approaches the Shannon-Hartley limit.

The Shannon-Hartley theorem therefore represents far more than a mathematical equation. It defines one of the fundamental physical limits of communication itself. More than seventy-five years after Claude Shannon published his pioneering work, and nearly a century after Ralph Hartley's original contribution, the theorem continues to guide the design of communications systems throughout the world and remains one of the cornerstones of modern communications engineering.