Article View: sci.stat.math
Article #36Re: How to improve decision tree classification model error rate?
From: Bjarne K Hansen
Date: Fri, 28 Jun 2002 08:42
Date: Fri, 28 Jun 2002 08:42
36 lines
2779 bytes
2779 bytes
Have you considered CART? A friend of mine swears by it: http://www.google.com/search?q=classification+and+regression+trees+cart Bjarne In comp.ai Alexander Sirotkin <demiurg@tau.ac.il> wrote: : I managed to reduce the error rate by reducing the "minimal node deviance" : parameter of the partitioning algorithm. But it seems to me that this method : is wrong, that it just makes a bigger tree (with more terminal nodes) which : just memorizes the whole input. : But on the other hand, S-plus does use a different test set, so that there : can not be generalization problems... : Very confuzing... : demiurg@tau.ac.il (Alexander Sirotkin) wrote in message news:<adrouf$h81$1@mulga.cs.mu.OZ.AU>... :> Question : How to improve (reduce) decision tree :> classification model error rate? :> :> I'm trying to build some decision tree classification :> model (using S-plus) and keep getting extremely bad :> results (error rate around 0.5). :> :> The data : 562 real predictor variables and one :> independent variable, factor (with 86 types). :> :> Quite a lot of missing values... :> :> Any ideas what should I try (data preprocessing, etc...) :> to reduce error rate ? :> [ comp.ai is moderated. To submit, just post and be patient, or if ] [ that fails mail your article to <comp-ai@moderators.isc.org>, and ] [ ask your news administrator to fix the problems with your system. ]
Technical Details
Message-ID:
<afh7hd$792$1@mulga.cs.mu.OZ.AU>Path:
arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!newsfeed.stanford.edu!news-spur1.maxwell.syr.edu!news.maxwell.syr.edu!news1.optus.net.au!optus!news.mel.connect.com.au!news.unimelb.edu.au!mulga.cs.mu.OZ.AU!bounce-backReferences:
<adrouf$h81$1@mulga.cs.mu.OZ.AU> <adu9ja$o8o$1@mulga.cs.mu.OZ.AU>Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 10d632,777798b8d4d7b811 X-Google-Attributes: gid10d632,public X-Google-Thread: 112edf,777798b8d4d7b811 X-Google-Attributes: gid112edf,public X-Google-Thread: fa931,777798b8d4d7b811 X-Google-Attributes: gidfa931,public X-Google-Thread: 10461e,777798b8d4d7b811 X-Google-Attributes: gid10461e,public X-Google-ArrivalTime: 2002-06-28 01:47:09 PST Path: arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!newsfeed.stanford.edu!news-spur1.maxwell.syr.edu!news.maxwell.syr.edu!news1.optus.net.au!optus!news.mel.connect.com.au!news.unimelb.edu.au!mulga.cs.mu.OZ.AU!bounce-back From: Bjarne K Hansen <forecaster@canada.com> Newsgroups: sci.stat.math,comp.ai,comp.soft-sys.sas,aus.stats.s Subject: Re: How to improve decision tree classification model error rate? Date: 28 Jun 2002 18:42:21 +1000 Organization: ISINet, Nova Scotia Lines: 36 Approved: ai@cs.mu.oz.au (Moderator comp.ai) Message-ID: <afh7hd$792$1@mulga.cs.mu.OZ.AU> References: <adrouf$h81$1@mulga.cs.mu.OZ.AU> <adu9ja$o8o$1@mulga.cs.mu.OZ.AU> NNTP-Posting-Host: mulga.cs.mu.oz.au X-Trace: mulga.cs.mu.OZ.AU 1025253742 7459 128.250.37.150 (28 Jun 2002 08:42:22 GMT) X-Complaints-To: usenet@cs.mu.OZ.AU NNTP-Posting-Date: 28 Jun 2002 08:42:22 GMT X-No-Markup: yes X-Date: Fri, 28 Jun 2002 03:27:50 +0000 (UTC) X-Mod: ?