Article View: comp.text
Article #6941Re: Intelligent Text Search (this is very useful - already been done, surely?)
From: John Carter
Date: Mon, 20 Oct 1997 00:00
Date: Mon, 20 Oct 1997 00:00
50 lines
3240 bytes
3240 bytes
textmaker@hotmail.com (L Metcalfe) wrote: > >Hello all! > >I've searched everywhere on the net for this without success. If you >could help me, I'd be hugely grateful. > >I'm looking for a program that generates an index on a lot of text, >not just searching for all individual words and small phrases (as Alta >Vista does) but large strings of words making up paragraphs and entire >letters. > >It would generate a list ranked according to number of successful hits >and size of the string, preferably not counting hits of small strings >within the body of larger strings which have occurred a decent number >of times (to disallow double counting). > >More intelligent features like similarity of strings (words in a >different order, part of speech or having a good proportion of the >words), and perhaps even ascertaining meaning would be nice, but not >required. > > >Unix would be helpful (it can prolly be able to achieve this on one >command line?) or an MS-DOS or Windows (3.1, 95 or NT) utility would >be fantastic! > > >Thank you, > >textmaker@hotmail.com The last time I needed something to do this kind of text parsing under UNIX, I wound up writing some 600 lines of C code to parse a 64 character "free-form" data entry field. The more sophisticated Web search engines have these capabilities, but there's a LOT of code involved to handle the "word A + word B in the same reference and give points for being close" algorithm. Someone has the source for this type search, but I doubt that it's free ;-) Visit my source code page at http://www.mindspring.com/~johnecarter Visit my favorite school at http://www.mindspring.com/~addison Get PR-Tracker -- tracks problem reports, defects, bugs INFORMATION: http://www.prtracker.com/info.html DOWNLOAD: http://www.prtracker.com/download.html
Technical Details
Message-ID:
<344ad134.6134002@news.mindspring.com>Path:
arc1-ca.pugleaf.net!unknown!not-for-mailReferences:
<34495ddd.11886710@news.zip.com.au>Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 117bd2,7010cf40caf57528 X-Google-Attributes: gid117bd2,public X-Google-Thread: 1164ba,7010cf40caf57528 X-Google-Attributes: gid1164ba,public X-Google-Thread: 108c83,7010cf40caf57528 X-Google-Attributes: gid108c83,public X-Google-Thread: f71eb,7010cf40caf57528 X-Google-Attributes: gidf71eb,public X-Google-Thread: 107393,7010cf40caf57528 X-Google-Attributes: gid107393,public X-Google-Thread: 1027c4,7010cf40caf57528 X-Google-Attributes: gid1027c4,public X-Google-Thread: 10259a,7010cf40caf57528 X-Google-Attributes: gid10259a,public X-Google-Thread: 10bba1,7010cf40caf57528 X-Google-Attributes: gid10bba1,public From: johnecarter@mindspring.com (John Carter) Subject: Re: Intelligent Text Search (this is very useful - already been done, surely?) Date: 1997/10/20 Message-ID: <344ad134.6134002@news.mindspring.com> X-Deja-AN: 281905666 Distribution: inet References: <34495ddd.11886710@news.zip.com.au> X-Server-Date: 20 Oct 1997 03:38:46 GMT Organization: MindSpring Enterprises Reply-To: johnecarter@mindspring.com Newsgroups: comp.text,aus.computers,comp.ai.natlang,comp.editors,comp.infosystems.search,comp.lang.basic,comp.lang.perl,comp.os.msdos.misc,comp.os.ms-windows.apps.utilities.win95,comp.unix,comp.unix.questions,nz.general,alt.lang.basic,alt.os.linux,alt.windows95,aus.ai