🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: comp.text
Article #6941

Re: Intelligent Text Search (this is very useful - already been done, surely?)

#6941
From: John Carter
Date: Mon, 20 Oct 1997 00:00
50 lines
3240 bytes
textmaker@hotmail.com (L Metcalfe) wrote:

>
>Hello all!
>
>I've searched everywhere on the net for this without success. If you
>could help me, I'd be hugely grateful. 
>
>I'm looking for a program that generates an index on a lot of text,
>not just searching for all individual words and small phrases (as Alta
>Vista does) but large strings of words making up paragraphs and entire
>letters. 
>
>It would generate a list ranked according to number of successful hits
>and size of the string, preferably not counting hits of small strings
>within the body of larger strings which have occurred a decent number
>of times (to disallow double counting).
>
>More intelligent features like similarity of strings (words in a
>different order, part of speech or having a good proportion of the
>words), and perhaps even ascertaining meaning would be nice, but not
>required. 
>
>
>Unix would be helpful (it can prolly be able to achieve this on one
>command line?) or an MS-DOS or Windows (3.1, 95 or NT) utility would
>be fantastic! 
>
>
>Thank you,
>
>textmaker@hotmail.com
The last time I needed something to do this kind of text parsing under
UNIX, I wound up writing some 600 lines of C code to parse a 64
character "free-form" data entry field.  

The more sophisticated Web search engines have these capabilities, but
there's a LOT of code involved to handle the "word A + word B in the
same reference and give points for being close" algorithm.

Someone has the source for this type search, but I doubt that it's
free ;-)

Visit my source code page at http://www.mindspring.com/~johnecarter
Visit my favorite school at http://www.mindspring.com/~addison

Get PR-Tracker -- tracks problem reports, defects, bugs
INFORMATION:  http://www.prtracker.com/info.html
DOWNLOAD:     http://www.prtracker.com/download.html
Technical Details
Message-ID: <344ad134.6134002@news.mindspring.com>
Path: arc1-ca.pugleaf.net!unknown!not-for-mail
References: <34495ddd.11886710@news.zip.com.au>

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 117bd2,7010cf40caf57528
X-Google-Attributes: gid117bd2,public
X-Google-Thread: 1164ba,7010cf40caf57528
X-Google-Attributes: gid1164ba,public
X-Google-Thread: 108c83,7010cf40caf57528
X-Google-Attributes: gid108c83,public
X-Google-Thread: f71eb,7010cf40caf57528
X-Google-Attributes: gidf71eb,public
X-Google-Thread: 107393,7010cf40caf57528
X-Google-Attributes: gid107393,public
X-Google-Thread: 1027c4,7010cf40caf57528
X-Google-Attributes: gid1027c4,public
X-Google-Thread: 10259a,7010cf40caf57528
X-Google-Attributes: gid10259a,public
X-Google-Thread: 10bba1,7010cf40caf57528
X-Google-Attributes: gid10bba1,public
From: johnecarter@mindspring.com (John Carter)
Subject: Re: Intelligent Text Search (this is very useful - already been done, surely?)
Date: 1997/10/20
Message-ID: <344ad134.6134002@news.mindspring.com>
X-Deja-AN: 281905666
Distribution: inet
References: <34495ddd.11886710@news.zip.com.au>
X-Server-Date: 20 Oct 1997 03:38:46 GMT
Organization: MindSpring Enterprises
Reply-To: johnecarter@mindspring.com
Newsgroups: comp.text,aus.computers,comp.ai.natlang,comp.editors,comp.infosystems.search,comp.lang.basic,comp.lang.perl,comp.os.msdos.misc,comp.os.ms-windows.apps.utilities.win95,comp.unix,comp.unix.questions,nz.general,alt.lang.basic,alt.os.linux,alt.windows95,aus.ai