🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: sci.stat.math
Article #36

Re: How to improve decision tree classification model error rate?

#36
From: Bjarne K Hansen
Date: Fri, 28 Jun 2002 08:42
36 lines
2779 bytes
Have you considered CART? A friend of mine swears by it:

  http://www.google.com/search?q=classification+and+regression+trees+cart

Bjarne

In comp.ai Alexander Sirotkin <demiurg@tau.ac.il> wrote:
: I managed to reduce the error rate by reducing the "minimal node deviance"
: parameter of the partitioning algorithm. But it seems to me that this method 
: is wrong, that it just makes a bigger tree (with more terminal nodes) which 
: just memorizes the whole input.
: But on the other hand, S-plus does use a different test set, so that there 
: can not be generalization problems...

: Very confuzing...

: demiurg@tau.ac.il (Alexander Sirotkin) wrote in message news:<adrouf$h81$1@mulga.cs.mu.OZ.AU>...
:> Question : How to improve (reduce) decision tree 
:> classification model error rate?
:> 
:> I'm trying to build some decision tree classification
:> model (using S-plus) and keep getting extremely bad
:> results (error rate around 0.5). 
:> 
:> The data : 562 real predictor variables and one 
:> independent variable, factor (with 86 types).
:> 
:> Quite a lot of missing values...
:> 
:> Any ideas what should I try (data preprocessing, etc...)
:> to reduce error rate ?
:>

[ comp.ai is moderated.  To submit, just post and be patient, or if ]
[ that fails mail your article to <comp-ai@moderators.isc.org>, and ]
[ ask your news administrator to fix the problems with your system. ]
Technical Details
Message-ID: <afh7hd$792$1@mulga.cs.mu.OZ.AU>
Path: arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!newsfeed.stanford.edu!news-spur1.maxwell.syr.edu!news.maxwell.syr.edu!news1.optus.net.au!optus!news.mel.connect.com.au!news.unimelb.edu.au!mulga.cs.mu.OZ.AU!bounce-back
References: <adrouf$h81$1@mulga.cs.mu.OZ.AU> <adu9ja$o8o$1@mulga.cs.mu.OZ.AU>

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 10d632,777798b8d4d7b811
X-Google-Attributes: gid10d632,public
X-Google-Thread: 112edf,777798b8d4d7b811
X-Google-Attributes: gid112edf,public
X-Google-Thread: fa931,777798b8d4d7b811
X-Google-Attributes: gidfa931,public
X-Google-Thread: 10461e,777798b8d4d7b811
X-Google-Attributes: gid10461e,public
X-Google-ArrivalTime: 2002-06-28 01:47:09 PST
Path: arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!newsfeed.stanford.edu!news-spur1.maxwell.syr.edu!news.maxwell.syr.edu!news1.optus.net.au!optus!news.mel.connect.com.au!news.unimelb.edu.au!mulga.cs.mu.OZ.AU!bounce-back
From: Bjarne K Hansen <forecaster@canada.com>
Newsgroups: sci.stat.math,comp.ai,comp.soft-sys.sas,aus.stats.s
Subject: Re: How to improve decision tree classification model error rate?
Date: 28 Jun 2002 18:42:21 +1000
Organization: ISINet, Nova Scotia
Lines: 36
Approved: ai@cs.mu.oz.au (Moderator comp.ai)
Message-ID: <afh7hd$792$1@mulga.cs.mu.OZ.AU>
References: <adrouf$h81$1@mulga.cs.mu.OZ.AU> <adu9ja$o8o$1@mulga.cs.mu.OZ.AU>
NNTP-Posting-Host: mulga.cs.mu.oz.au
X-Trace: mulga.cs.mu.OZ.AU 1025253742 7459 128.250.37.150 (28 Jun 2002 08:42:22 GMT)
X-Complaints-To: usenet@cs.mu.OZ.AU
NNTP-Posting-Date: 28 Jun 2002 08:42:22 GMT
X-No-Markup: yes
X-Date: Fri, 28 Jun 2002 03:27:50 +0000 (UTC)
X-Mod: ?