Victus Spiritus

home

We Swim in a Sea of White Noise

17 Apr 2010

We're all familiar with uncorrelated static. As a kid when a broadcast station failed to tune in, I'd just get static. The image of light and dark accompanied by a fuzzy spectrum of sound.

What is White Noise?

The definition of white noise is one I'm intamitely familiar with as a long time signal processing engineer. Simply stated, the signal is uncorrelated over time (or space). There are no repeating patterns and the frequency response (or power spectral density) of the signal is flat, which means signal energy is evenly distributed between all frequencies.

For folks that are interested in detection and pattern matching it may seem an odd strategy to transform measured signals into white noise. But what you're really working to accomplish is to diminish the correlation in background or dominant sources to improve sensitivity to orthogonal signals of interest. Any residual signal power will stand out with optimized signal to noise power. We use sample or theoretical covariances to accomplish the data transforms, but these are fancy ways of describing signal patterns between intervals in either time or space. If you can make the background statistically look like white noise, even very weak signals can stand out and after integration enable detection due to residual correlation.

Signal to Noise

Consider a random signal that rises and falls over time with a mean of zero. Although the power (energy/time) of the noise won't change with larger integration, a correlated signal will. Integration of signal yields a square root of N improvement in signal to noise ratio where N is the number of frames integrated.

In less technical terms, signal-to-noise ratio compares the level of a desired signal (such as music) to the level of background noise. The higher the ratio, the less obtrusive the background noise is. "Signal-to-noise ratio" is sometimes used informally to refer to the ratio of useful information to false or irrelevant data in a conversation or exchange. For example, in online discussion forums and other online communities, off-topic posts and spam are regarded as "noise" that interferes with the "signal" of appropriate discussion.

If you're a regular reader here, you may see the root of my interest in discussing white noise. A long standing personal infatuation with relevant information and social sharing. Personal relevance engines, filters and virtual assistants are all part of an organic solution to the question:
"what's happening recently, now, or soon that is important and interesting to me?"
The challenge is creating algorithms that improve over time to better adapt to the topics and styles we are interested in.

Because many of our friends may have interests divergent from our own, simple social sharing becomes saturated with noisy or popular mass media content. The most potent information filters will introduce intriguing finds and arouse interests we never knew we had. Serendipity has shown me time and again how little I know about even my own interests. We close ourselves off to so much in the interest of protecting our attention and limited time that our quest for relevance dead ends in local optimas. My goal with a startup is to ensure that doesn't happen.