๐Ÿš€ go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: sci.stat.math
Article #83

Re: estimation performance of independant estimators

#83
From: Ray Koopman
Date: Sun, 08 Jun 2003 18:36
37 lines
2713 bytes
Georg W๏ฟฝtschner <georg.wuetschner@unibw-muenchen.de> wrote in message news:<3EDF7781.4030100@unibw-muenchen.de>...
> Hi folk,
> I hope you allow me as an engineer a basic question:
> a random variable (RV) takes on a certain value, which I have to
> estimate. To this end I have a set of values, each of which was produced
> by a given function of the RV plus noise.
> Now an estimator E1 estimates the value of my RV with a certain variance V1.
> An _independant_ second estimator E2 does the same, but has a much worse
> set of values and therefore estimates with a bigger variance V2.
> 
> What would interest me is a statement on whether I can improve the
> overall performance of my estimation by somehow combining the 2
> estimators or if I allways make it worse. That is, is it possible to
> achieve a variance lower than V2 when combining the result of E1 and
> that of E2 (say weighted average or something more sophisticated)??
> Can this wanted relation between V1, V2 and Vcomb. be mathematically
> expressed? What are the conditions/constrictions?
> 
> [ snip ]
> 
> Thanks a lot,
> 
> Georg

To avoid confusion with the expected value operator E, 
call the estimates X1 and X2. Then we have 
E(X1|RV) = RV, Var(X1|RV) = V1, 
E(X2|RV) = RV, Var(X2|RV) = V2, 
with X1|RV independent of X2|RV. 
Let Xcomb = P1*X1 + P2*X2, where 
P1 = (1/V1)/(1/V1 + 1/V2), 
P2 = (1/V2)/(1/V1 + 1/V2). 
Then E(Xcomb|RV) = RV, 
and Var(Xcomb|RV) = V1*V2/(V1+V2), 
which is less than both V1 and V2. 
But note that V1 and V2 must be known 
(as opposed to estimated).
Technical Details
Message-ID: <242be6f5.0306081036.7e5fcaf1@posting.google.com>
Path: arc1-ca.pugleaf.net!archiver1.google.com!postnews1.google.com!not-for-mail
References: <3EDF7781.4030100@unibw-muenchen.de>

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII
X-Google-Thread: f6df2,1c85a832432e36a9
X-Google-Attributes: gidf6df2,public
X-Google-Thread: 10d632,1c85a832432e36a9
X-Google-Attributes: gid10d632,public
X-Google-Thread: f6c01,1c85a832432e36a9
X-Google-Attributes: gidf6c01,public
X-Google-Thread: 109d8a,1c85a832432e36a9
X-Google-Attributes: gid109d8a,public
X-Google-ArrivalTime: 2003-06-08 11:36:13 PST
Path: arc1-ca.pugleaf.net!archiver1.google.com!postnews1.google.com!not-for-mail
From: koopman@sfu.ca (Ray Koopman)
Newsgroups: sci.stat.math,sci.math,bln.net.statistik,bln.sci.mathematik
Subject: Re: estimation performance of independant estimators
Date: 8 Jun 2003 11:36:12 -0700
Organization: http://groups.google.com/
Lines: 37
Message-ID: <242be6f5.0306081036.7e5fcaf1@posting.google.com>
References: <3EDF7781.4030100@unibw-muenchen.de>
NNTP-Posting-Host: 24.81.141.157
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-Trace: posting.google.com 1055097373 25346 127.0.0.1 (8 Jun 2003 18:36:13 GMT)
X-Complaints-To: groups-abuse@google.com
NNTP-Posting-Date: 8 Jun 2003 18:36:13 GMT