Article View: sci.stat.math
Article #28Re: How to improve decision tree classification model error rate?
From: Alexander Sirotkin
Date: Sun, 09 Jun 2002 01:04
Date: Sun, 09 Jun 2002 01:04
29 lines
2499 bytes
2499 bytes
I managed to reduce the error rate by reducing the "minimal node deviance" parameter of the partitioning algorithm. But it seems to me that this method is wrong, that it just makes a bigger tree (with more terminal nodes) which just memorizes the whole input. But on the other hand, S-plus does use a different test set, so that there can not be generalization problems... Very confuzing... demiurg@tau.ac.il (Alexander Sirotkin) wrote in message news:<adrouf$h81$1@mulga.cs.mu.OZ.AU>... > Question : How to improve (reduce) decision tree > classification model error rate? > > I'm trying to build some decision tree classification > model (using S-plus) and keep getting extremely bad > results (error rate around 0.5). > > The data : 562 real predictor variables and one > independent variable, factor (with 86 types). > > Quite a lot of missing values... > > Any ideas what should I try (data preprocessing, etc...) > to reduce error rate ? > [ comp.ai is moderated. To submit, just post and be patient, or if ] [ that fails mail your article to <comp-ai@moderators.isc.org>, and ] [ ask your news administrator to fix the problems with your system. ]
Technical Details
Message-ID:
<adu9ja$o8o$1@mulga.cs.mu.OZ.AU>Path:
arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!newsfeed.stanford.edu!news-spur1.maxwell.syr.edu!news.maxwell.syr.edu!news1.optus.net.au!optus!news.mel.connect.com.au!news.unimelb.edu.au!mulga.cs.mu.OZ.AU!bounce-backReferences:
<adrouf$h81$1@mulga.cs.mu.OZ.AU>Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 10d632,777798b8d4d7b811 X-Google-Attributes: gid10d632,public X-Google-Thread: 112edf,777798b8d4d7b811 X-Google-Attributes: gid112edf,public X-Google-Thread: fa931,777798b8d4d7b811 X-Google-Attributes: gidfa931,public X-Google-Thread: 10461e,777798b8d4d7b811 X-Google-Attributes: gid10461e,public X-Google-ArrivalTime: 2002-06-08 18:07:09 PST Path: arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!newsfeed.stanford.edu!news-spur1.maxwell.syr.edu!news.maxwell.syr.edu!news1.optus.net.au!optus!news.mel.connect.com.au!news.unimelb.edu.au!mulga.cs.mu.OZ.AU!bounce-back From: demiurg@tau.ac.il (Alexander Sirotkin) Newsgroups: sci.stat.math,comp.ai,comp.soft-sys.sas,aus.stats.s Subject: Re: How to improve decision tree classification model error rate? Date: 9 Jun 2002 11:04:42 +1000 Organization: http://groups.google.com/ Lines: 29 Approved: ai@cs.mu.oz.au (Moderator comp.ai) Message-ID: <adu9ja$o8o$1@mulga.cs.mu.OZ.AU> References: <adrouf$h81$1@mulga.cs.mu.OZ.AU> NNTP-Posting-Host: mulga.cs.mu.oz.au X-Trace: mulga.cs.mu.OZ.AU 1023584683 24857 128.250.1.22 (9 Jun 2002 01:04:43 GMT) X-Complaints-To: usenet@cs.mu.OZ.AU NNTP-Posting-Date: 9 Jun 2002 01:04:43 GMT X-No-Markup: yes X-Date: 8 Jun 2002 14:55:03 -0700 X-Mod: ?