Article View: sci.geo.fluids
Article #47Re: Robust Spectral Estimates of Gappy Series
From: jerry smith
Date: Tue, 06 Oct 1992 22:03
Date: Tue, 06 Oct 1992 22:03
31 lines
1801 bytes
1801 bytes
An excellent and well documented method for forming power spectra from gappy data is to use covariances formed from the existing portions of data. For example, the alternative methods (and the fortran code to execute them) can be found in the book "Digital Spectral Analysis, with applications" by S.L. Marple (Prentice-Hall, 1987). Covariance-based methods are often referred to as "auto-regressive" models (or AR-spectra; I can't say why this name has stuck). Marple reviews the relative advantages of AR versus "periodogram" (fft) and a few others (e.g. Proni's method). As for the spikes, your on your own. A method which has worked less poorly than others for me in the past is based on using a threshold applied to the difference between each value and the median value in its neighborhood. An unsatisfactory aspect of it is that it has two adjustable (subjective) parameters (the size of the neighborhood, and the threshold). A redeeming feature is that there are enough adjustable parameters to make it reject most of the points which you would have chosen by eye, if you had the time. Good luck. -jerry smith
Technical Details
Message-ID:
<1at2faINN9he@network.ucsd.edu>Path:
arc1-ca.pugleaf.net!sparky!uunet!ogicse!network.ucsd.edu!jerry.ucsd.edu!jasmithReferences:
<1992Sep30.132441.10320@netnews.whoi.edu> <1992Oct6.163433.1@kean.ucs.mun.ca>Show Full Headers
Complete Article Headers
Path: arc1-ca.pugleaf.net!sparky!uunet!ogicse!network.ucsd.edu!jerry.ucsd.edu!jasmith From: jasmith@ucsd.edu (jerry smith) Newsgroups: sci.geo.fluids,sci.geo.meteorology Subject: Re: Robust Spectral Estimates of Gappy Series Message-ID: <1at2faINN9he@network.ucsd.edu> Date: 6 Oct 92 22:03:22 GMT Article-I.D.: network.1at2faINN9he References: <1992Sep30.132441.10320@netnews.whoi.edu> <1992Oct6.163433.1@kean.ucs.mun.ca> Distribution: world Organization: Scripps Inst. Oceanogr. Lines: 31 NNTP-Posting-Host: jerry.ucsd.edu X-UserAgent: Nuntius v1.1.1d9 X-XXMessage-ID: <A6F75B92E90115E4@jerry.ucsd.edu> X-XXDate: Tue, 6 Oct 92 23:04:50 GMT