Article View: comp.text
Article #6944Re: Intelligent Text Search (this is very useful - already been done, surely?)
From: Bob Stearns
Date: Mon, 20 Oct 1997 00:00
Date: Mon, 20 Oct 1997 00:00
59 lines
3701 bytes
3701 bytes
L Metcalfe wrote: > > Hello all! > > I've searched everywhere on the net for this without success. If you > could help me, I'd be hugely grateful. > > I'm looking for a program that generates an index on a lot of text, > not just searching for all individual words and small phrases (as Alta > Vista does) but large strings of words making up paragraphs and entire > letters. > > It would generate a list ranked according to number of successful hits > and size of the string, preferably not counting hits of small strings > within the body of larger strings which have occurred a decent number > of times (to disallow double counting). > > More intelligent features like similarity of strings (words in a > different order, part of speech or having a good proportion of the > words), and perhaps even ascertaining meaning would be nice, but not > required. > > Unix would be helpful (it can prolly be able to achieve this on one > command line?) or an MS-DOS or Windows (3.1, 95 or NT) utility would > be fantastic! I have implemented a number of search engines/index generators and I don't quite understand what you wish to have as your index terms. Would you take a moment and create the index terms from your request? It would appear long enought to have "interesting" terms, and such a list would illustrate just what you are trying to accomplish. Don't forget, the search engine user must be able to recreate the process or have the search engine do it for him from his input in order to have matches. --------------------------------------------------------------- The remainder of this text is to satisfy the requirement of my news posting program that there be more response text than included text. I personally find this to be an offensive requirement, but I have no choice in the matter since I do not maintain the news reader code. More intelligent features like similarity of strings (words in a different order, part of speech or having a good proportion of the words), and perhaps even ascertaining meaning would be nice, but not required. Unix would be helpful (it can prolly be able to achieve this on one command line?) or an MS-DOS or Windows (3.1, 95 or NT) utility would be fantastic! ---------------------------------------------------------------- -- Bob Stearns University of Georgia is@groucho.dev.uga.edu (706)542-5110
Technical Details
Message-ID:
<344B58D5.2781@groucho.dev.uga.edu>Path:
arc1-ca.pugleaf.net!unknown!not-for-mailReferences:
<34495ddd.11886710@news.zip.com.au>Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 107393,7010cf40caf57528 X-Google-Attributes: gid107393,public X-Google-Thread: 1027c4,7010cf40caf57528 X-Google-Attributes: gid1027c4,public X-Google-Thread: 10259a,7010cf40caf57528 X-Google-Attributes: gid10259a,public X-Google-Thread: 10bba1,7010cf40caf57528 X-Google-Attributes: gid10bba1,public X-Google-Thread: 108c83,7010cf40caf57528 X-Google-Attributes: gid108c83,public X-Google-Thread: f71eb,7010cf40caf57528 X-Google-Attributes: gidf71eb,public X-Google-Thread: 117bd2,7010cf40caf57528 X-Google-Attributes: gid117bd2,public X-Google-Thread: 1164ba,7010cf40caf57528 X-Google-Attributes: gid1164ba,public From: Bob Stearns <is@groucho.dev.uga.edu> Subject: Re: Intelligent Text Search (this is very useful - already been done, surely?) Date: 1997/10/20 Message-ID: <344B58D5.2781@groucho.dev.uga.edu> X-Deja-AN: 282692826 References: <34495ddd.11886710@news.zip.com.au> Distribution: inet Organization: UGa UCNS Newsgroups: comp.text,aus.computers,comp.ai.natlang,comp.editors,comp.infosystems.search,comp.lang.basic,comp.lang.perl,comp.os.msdos.misc,comp.os.ms-windows.apps.utilities.win95,comp.unix,comp.unix.questions,nz.general,alt.lang.basic,alt.os.linux,alt.windows95,aus.ai