Wiener filter

Wiener filter

In signal processing, the Wiener filter is a filter proposed by Norbert Wiener during the 1940s and published in 1949.ref|Wiener1949 Its purpose is to reduce the amount of noise present in a signal by comparison with an estimation of the desired noiseless signal.

Description

The goal of the Wiener filter is to filter out noise that has corrupted a signal. It is based on a statistical approach.

Typical filters are designed for a desired frequency response. The Wiener filter approaches filtering from a different angle. One is assumed to have knowledge of the spectral properties of the original signal and the noise, and one seeks the LTI filter whose output would come as close to the original signal as possible. Wiener filters are characterized by the following:ref|Brown1996
# Assumption: signal and (additive) noise are stationary linear stochastic processes with known spectral characteristics or known autocorrelation and cross-correlation
# Requirement: the filter must be physically realizable, i.e. causal (this requirement can be dropped, resulting in a non-causal solution)
# Performance criterion: minimum mean-square error

This filter is frequently used in the process of deconvolution; for this application, see Wiener deconvolution.

Model/problem setup

The input to the Wiener filter is assumed to be a signal, s(t), corrupted by additive noise, n(t). The output, hat{s}(t), is calculated by means of a filter, g(t), using the following convolution::hat{s}(t) = g(t) * (s(t) + n(t))
where
* s(t) is the original signal (to be estimated)
* n(t) is the noise
* hat{s}(t) is the estimated signal (which we hope will equal s(t))
* g(t) is the Wiener filter

The error is e(t) = s(t + alpha) - hat{s}(t) and the squared error is e^2(t) = s^2(t + alpha) - 2s(t + alpha)hat{s}(t) + hat{s}^2(t) where
* s(t + alpha) is the desired output of the filter
* e(t) is the error

Depending on the value of "α" the problem name can be changed:
* If alpha > 0 then the problem is that of prediction
* If alpha = 0 then the problem is that of filtering
* If alpha < 0 then the problem is that of smoothing

Writing hat{s}(t) as a convolution integral: hat{s}(t) = int_{-infty}^{infty}{g( au)left [s(t - au) + n(t - au) ight] ,d au}.

Taking the expected value of the squared error results in:E(e^2) = R_s(0) - 2int_{-infty}^{infty}{g( au)R_{x,s}( au + alpha),d au} + int_{-infty}^{infty}{int_{-infty}^{infty}{g( au)g( heta)R_x( au - heta),d au},d heta}where
* x(t) = s(t) + n(t) is the observed signal
* ,!R_s is the autocorrelation function of s(t)
* ,!R_x is the autocorrelation function of x(t)
* R_{x,s} is the cross-correlation function of x(t) and s(t)

If the signal s(t) and the noise n(t) are uncorrelated (i.e., the cross-correlation ,R_{sn}, is zero) then note the following
* R_{x,s} = R_s
* ,!R_x = R_s + R_nFor most applications, the assumption of uncorrelated signal and noise is reasonable because the source of the noise (e.g. sensor noise or quantization noise) do not depend upon the signal itself.

The goal is to then minimize E(e^2) by finding the optimal g(t).

tationary solution

The Wiener filter has solutions for two possible cases: the case where a causal filter is desired, and the one where a non-causal filter is acceptable. The latter is simpler but is not suited for real-time applications. Wiener's main accomplishment was solving the case where the causality requirement is in effect.

Noncausal solution

:G(s) = frac{S_{x,s}(s)e^{alpha s{S_x(s)}

Provided that g(t) is optimal then the MMSE equation reduces to E(e^2) = R_s(0) - int_{-infty}^{infty}{g( au)R_{x,s}( au + alpha),d au}

And the solution, g(t) is the inverse two-sided Laplace transform of G(s).

Causal solution

:G(s) = frac{H(s)}{S_x^{+}(s)}

Where
*H(s) consists of the causal part of frac{S_{x,s}(s)e^{alpha s{S_x^{-}(s)} (that is, that part of this fraction having a positive time solution under the inverse Laplace transform)
*S_x^{+}(s) is the causal component of S_x(s) (i.e. the inverse Laplace transform of S_x^{+}(s) is non-zero only for tge 0)
*S_x^{-}(s) is the anti-causal component of S_x(s) (i.e. the inverse Laplace transform of S_x^{-}(s) is non-zero only for negative t)

This general formula is complicated and deserves a more detailed explanation. To write down the solution G(s) in a specific case, one should follow these steps (see [http://csi.usc.edu/PDF/wienerhopf.pdf LLoyd R. Welch: Wiener Hopf Theory] ):

1. Start with the spectrum S_x(s) in rational form and factor it into causal and anti-causal components:::S_x(s) = S_x^{+}(s) S_x^{-}(s)where S^{+} contains all the zeros and poles in the left hand plane (LHP) and S^{-} contains the zeroes and poles in the RHP.

2. Divide S_{x,s}(s)e^{alpha s} by {S_x^{-}(s)} and write out the result as a partial fraction expansion.

3. Select only those terms in this expansion having poles in the LHP. Call these terms H(s).

4. Divide H(s) by S_x^{+}(s). The result is the desired filter transfer function G(s)


= FIR Wiener filter for discrete series=

In order to derive the coefficients of the Wiener filter, we consider a signal "w" ["n"] being fed to a Wiener filter of order "N" and with coefficients {a_i}, i=0,ldots, N. The output of the filter is denoted "x" ["n"] which is given by the expression

:x [n] = sum_{i=0}^N a_i w [n-i]

The residual error is denoted "e" ["n"] and is defined as "e" ["n"] = "x" ["n"] − "s" ["n"] (See the corresponding block diagram). The Wiener filter is designed so as to minimize the mean square error (MMSE criteria) which can be stated concisely as follows:

:a_i = arg min ~E{e^2 [n] }

where E{cdot} denote the expectation operator. In the general case, the coefficients a_i may be complex and may be derived for the case where "w" ["n"] and "s" ["n"] are complex as well. For simplicity, we will only consider the case where all these quantities are real. The mean square error may be rewritten as:

:egin{array}{rcl}E{e^2 [n] } &=& E{(x [n] -s [n] )^2} \&=& E{x^2 [n] } + E{s^2 [n] } - 2E{x [n] s [n] }\&=& E{ig( sum_{i=0}^N a_i w [n-i] ig)^2} + E{s^2 [n] } -2 E{ sum_{i=0}^N a_i w [n-i] s [n] }end{array}

To find the vector [a_0,ldots,a_N] which minimizes the expression above, let us now calculate its derivative w.r.t a_i

:egin{array}{rcl}frac{partial}{partial a_i} E{e^2 [n] } &=& 2E{ ig( sum_{j=0}^N a_j w [n-j] ig) w [n-i] } - 2E{s [n] w [n-i] } quad i=0, ldots ,N \&=& 2 sum_{j=0}^N E{w [n-j] w [n-i] } a_j - 2 E{ w [n-i] s [n] }end{array}

If we suppose that "w" ["n"] and "s" ["n] are stationary, we can introduce the following sequences R_w [m] ~ extit{ and }~ R_{ws} [m] known respectively as the autocorrelation of "w" ["n"] and the cross-correlation between "w" ["n"] and "s" ["n"] defined as follows

:egin{align}R_w [m] =& E{w [n] w [n+m] } \R_{ws} [m] =& E{w [n] s [n+m] }end{align}

The derivative of the MSE may therefore be rewritten as (notice that R_{ws} [-i] = R_{sw} [i] )

:frac{partial}{partial a_i} E{e^2 [n] } = 2 sum_{j=0}^{N} R_w [j-i] a_j - 2 R_{sw} [i] quad i=0, ldots ,N

Letting the derivative be equal to zero, we obtain

:sum_{j=0}^N R_w [j-i] a_j = R_{sw} [i] quad i=0, ldots ,N

which can be rewritten in matrix form

:egin{bmatrix}R_w [0] & R_w [1] & cdots & R_w [N] \R_w [1] & R_w [0] & cdots & R_w [N-1] \vdots & vdots & ddots & vdots \R_w [N] & R_w [N-1] & cdots & R_w [0] end{bmatrix}egin{bmatrix}a_0 \ a_1 \ vdots \ a_Nend{bmatrix}=egin{bmatrix}R_{sw} [0] \R_{sw} [1] \ vdots \ R_{sw} [N] end{bmatrix}

These equations are known as the Wiener-Hopf equations. The matrix appearing in the equation is a symmetric Toeplitz matrix. These matrices are known to be positive definite and therefore non-singular yielding a single solution to the determination of the Wiener filter coefficients. Furthermore, there exists an efficient algorithm to solve the Wiener-Hopf equations known as the Levinson-Durbin algorithm.

The FIR Wiener filter is related to the Least mean squares filter, but minimizing its error criterion does not rely on cross-correlations or auto-correlations. Its solution converges to the Wiener filter solution.

ee also

*Norbert Wiener
*Kalman filter
*Wiener deconvolution
*Eberhard Hopf
*Least mean squares filter
*Similarities between Wiener and LMS

References

*Wiener, Norbert (1949), "Extrapolation, Interpolation, and Smoothing of Stationary Time Series". New York: Wiley. ISBN 0-262-73005-7
*Brown, Robert Grover and Patrick Y.C. Hwang (1996) "Introduction to Random Signals and Applied Kalman Filtering". 3 ed. New York: John Wiley & Sons. ISBN 0-471-12839-2


Wikimedia Foundation. 2010.

Игры ⚽ Поможем написать реферат

Look at other dictionaries:

  • Wiener-Filter — Der Wiener Filter oder auch Wiener Kolmogoroff Filter ist ein Filter zur Signalverarbeitung, welcher in den 1940er Jahren von Norbert Wiener und Andrei Nikolajewitsch Kolmogorow unabhängig voneinander entwickelt [1] und 1949 durch Norbert Wiener… …   Deutsch Wikipedia

  • Filter — may refer to: Chemistry, engineering and materials In chemistry, engineering, or household usage, a device to separate mixtures. See: * Filter (chemistry) * Water filter * Air filter * Oil filter * Pneumatic filter Optics and photography In… …   Wikipedia

  • Wiener — is German for Viennese, but may also refer to: * A hot dog, from German Wiener Würstchen , meaning Viennese small sausage * A slang term for penis Wiener is the surname of: * Alexander S. Wiener (1907 76), leader in the fields of forensic… …   Wikipedia

  • Wiener deconvolution — In mathematics, Wiener deconvolution is an application of the Wiener filter to the noise problems inherent in deconvolution. It works in the frequency domain, attempting to minimize the impact of deconvoluted noise at frequencies which have a… …   Wikipedia

  • Wiener — Als Wiener bezeichnet man: einen Bewohner von Wien eine dünne Brühwurst (Wiener Würstchen) oder eine Schnittwurst ein gebackenes Schnitzel, siehe Wiener Schnitzel ein österreichisches Monatsmagazin, siehe Wiener (Zeitschrift) eine Gruppe von… …   Deutsch Wikipedia

  • Wiener–Hopf method — The Wiener–Hopf method is a mathematical technique widely used in applied mathematics. It was initially developed by Norbert Wiener and Eberhard Hopf as a method to solve systems of integral equations, but has found wider use in solving two… …   Wikipedia

  • Wiener Burgtheater — Das Burgtheater an der Wiener Ringstraße Das Burgtheater am Dr. Karl Lueger Ring in Wien ist ein österreichisches Bundestheater. Es gilt als eine der bedeutendsten Bühnen Europas und ist nach der Comédie Française das zweitälteste europäische,… …   Deutsch Wikipedia

  • Wiener Hochquellenleitung — Ehemaliger Wasserturm am Wienerberg in Favoriten Die Wiener Wasserversorgung wird durch zwei Hochquellenwasserleitungen sowie zwei weitere kleinere Quellen, die in Ausnahmefällen in das Leitungssystem eingespeist werden, gewährleistet. Insgesamt… …   Deutsch Wikipedia

  • Wiener Hochquellleitung — Ehemaliger Wasserturm am Wienerberg in Favoriten Die Wiener Wasserversorgung wird durch zwei Hochquellenwasserleitungen sowie zwei weitere kleinere Quellen, die in Ausnahmefällen in das Leitungssystem eingespeist werden, gewährleistet. Insgesamt… …   Deutsch Wikipedia

  • Wiener Hochquellwasserleitung — Ehemaliger Wasserturm am Wienerberg in Favoriten Die Wiener Wasserversorgung wird durch zwei Hochquellenwasserleitungen sowie zwei weitere kleinere Quellen, die in Ausnahmefällen in das Leitungssystem eingespeist werden, gewährleistet. Insgesamt… …   Deutsch Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”