Article View: sci.stat.math
Article #83Re: estimation performance of independant estimators
From: Ray Koopman
Date: Sun, 08 Jun 2003 18:36
Date: Sun, 08 Jun 2003 18:36
37 lines
2713 bytes
2713 bytes
Georg W๏ฟฝtschner <georg.wuetschner@unibw-muenchen.de> wrote in message news:<3EDF7781.4030100@unibw-muenchen.de>... > Hi folk, > I hope you allow me as an engineer a basic question: > a random variable (RV) takes on a certain value, which I have to > estimate. To this end I have a set of values, each of which was produced > by a given function of the RV plus noise. > Now an estimator E1 estimates the value of my RV with a certain variance V1. > An _independant_ second estimator E2 does the same, but has a much worse > set of values and therefore estimates with a bigger variance V2. > > What would interest me is a statement on whether I can improve the > overall performance of my estimation by somehow combining the 2 > estimators or if I allways make it worse. That is, is it possible to > achieve a variance lower than V2 when combining the result of E1 and > that of E2 (say weighted average or something more sophisticated)?? > Can this wanted relation between V1, V2 and Vcomb. be mathematically > expressed? What are the conditions/constrictions? > > [ snip ] > > Thanks a lot, > > Georg To avoid confusion with the expected value operator E, call the estimates X1 and X2. Then we have E(X1|RV) = RV, Var(X1|RV) = V1, E(X2|RV) = RV, Var(X2|RV) = V2, with X1|RV independent of X2|RV. Let Xcomb = P1*X1 + P2*X2, where P1 = (1/V1)/(1/V1 + 1/V2), P2 = (1/V2)/(1/V1 + 1/V2). Then E(Xcomb|RV) = RV, and Var(Xcomb|RV) = V1*V2/(V1+V2), which is less than both V1 and V2. But note that V1 and V2 must be known (as opposed to estimated).
Technical Details
Message-ID:
<242be6f5.0306081036.7e5fcaf1@posting.google.com>Path:
arc1-ca.pugleaf.net!archiver1.google.com!postnews1.google.com!not-for-mailReferences:
<3EDF7781.4030100@unibw-muenchen.de>Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII X-Google-Thread: f6df2,1c85a832432e36a9 X-Google-Attributes: gidf6df2,public X-Google-Thread: 10d632,1c85a832432e36a9 X-Google-Attributes: gid10d632,public X-Google-Thread: f6c01,1c85a832432e36a9 X-Google-Attributes: gidf6c01,public X-Google-Thread: 109d8a,1c85a832432e36a9 X-Google-Attributes: gid109d8a,public X-Google-ArrivalTime: 2003-06-08 11:36:13 PST Path: arc1-ca.pugleaf.net!archiver1.google.com!postnews1.google.com!not-for-mail From: koopman@sfu.ca (Ray Koopman) Newsgroups: sci.stat.math,sci.math,bln.net.statistik,bln.sci.mathematik Subject: Re: estimation performance of independant estimators Date: 8 Jun 2003 11:36:12 -0700 Organization: http://groups.google.com/ Lines: 37 Message-ID: <242be6f5.0306081036.7e5fcaf1@posting.google.com> References: <3EDF7781.4030100@unibw-muenchen.de> NNTP-Posting-Host: 24.81.141.157 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Trace: posting.google.com 1055097373 25346 127.0.0.1 (8 Jun 2003 18:36:13 GMT) X-Complaints-To: groups-abuse@google.com NNTP-Posting-Date: 8 Jun 2003 18:36:13 GMT