🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: bit.listserv.stat-l
Article #1230

Re: ill-conditioned matrix

#1230
From: Steve Blinkhorn
Date: Thu, 01 Jul 1993 09:34
64 lines
4052 bytes
In <4795823@mtsg.ubc.ca> John.B.Collins@MTSG.UBC.CA writes:

>The issue of phi coefficients in factoring dichotomous data is a RED HERRING.
>If the data are dichotomous, SAS, SPSS and other packages will yield a matrix
>of PEARSON correlations, NOT phi coefficients.  True, extreme p values will
>skew the data, but that's because of the DATA, not the correlation matrix.
>You'll know if this is a problem in your particular data set if you get
>Heywood cases (loadings greater than 1.00).  But until this becomes an
>actual problem, go ahead and factor.  The issue of scaled loadings reflecting
>differential "skill levels" calls into question when in the research sequence
>the factor analysis is performed. IRT (Hambleton et al) deal effectively with
>this question.   John

>-----------------------------------------------------------------
>John B. Collins                         Voice Tel: (604) 922-4223
>Adult Education Research Centre               Fax: (604) 622-6665
>University of British Columbia        e-mail: USERJBC@MTSG.UBC.CA
>Vancouver, B. C.  CANADA
>      V6T 1W5
>-----------------------------------------------------------------

Phi coefficients are *precisely* Pearson coefficients calculated from
dichotomous data.   They are identical.   There is no difference
between the two.   If you don't believe me, take the same data and
calculate correlations using the various formulae available.
But because the data do not satisfy the `usual'
distributional assumptions, there are all sorts of things you can do
with a Pearson correlation calculated from continuous data that are
approximately bivariate normal that you can't do with phi
coefficients.

Heywood cases are another thing altogether.   A Heywood case arises
when one or more estimates of uniqueness in a fitted factor model is
negative.   Since by uniqueness we mean residual variance, and
variance is necessarily a positive quantity, this constitutes an
improper solution.  (For those whose favoured package does not report
uniquenesses, the equivalent situation is when one or more estimates of
communality exceeds 1.0).   Heywood cases may involve factor
loadings greater than 1.0, but don't always.   On the other hand they
always involve the sum of the squares of factor loadings for one or
more variables exceeding 1.0 (because that is the same as the
communality).

You may, I suppose, get Heywood cases when factoring phi coefficients,
but I never have.   My gut feeling is that, because of the impact of
marginal distributions on the maximum value phi can achieve, Heywood
cases are less likely with phi coefficients than elsewhere, because
they tend to be underestimates of the strength of the relationship
between two dichotomous variables.   Error-free binary test items with
radically different difficulty levels cannot correlate perfectly in
the Pearson/phi sense despite being perfect representatives of the
same underlying variable.

Those who feel they must factor analyse binary data simply need to
watch out for the usual sources of difficulty: large numbers of
variables relative to sample size (the high road to ruin, this one);
small number of variables hypothesised for some factors (doublet
factors are a killer); plus an extra one, viz. factors emerging
related to the mean values of certain variables which are
uninterpretable in terms of the substantive hypothesis under
investigation.

-- 
Steve Blinkhorn <steve@prd.co.uk>
Technical Details
Message-ID: <C9HBwy.MFA@prd.co.uk>
Path: arc1-ca.pugleaf.net!gmd.de!newsserver.jvnc.net!howland.reston.ans.net!spool.mu.edu!uunet!pipex!uknet!prd!steve
References: <4795823@mtsg.ubc.ca>

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: f5efb,a35fa259d6a1f0f5
X-Google-Attributes: gidf5efb,public
X-Google-ArrivalTime: 1993-07-01 03:01:05 PST
Newsgroups: bit.listserv.stat-l
Path: arc1-ca.pugleaf.net!gmd.de!newsserver.jvnc.net!howland.reston.ans.net!spool.mu.edu!uunet!pipex!uknet!prd!steve
From: steve@prd.co.uk (Steve Blinkhorn)
Subject: Re: ill-conditioned matrix
Organization: Psychometric Research & Development Ltd
Date: Thu, 1 Jul 1993 09:34:09 GMT
Message-ID: <C9HBwy.MFA@prd.co.uk>
References: <4795823@mtsg.ubc.ca>
Lines: 64