Article View: csd.grad
Article #68FW: Cloud Computing Talk (Wed 10/22)---Project ES2: Mining and Analytics for IBM Intranet Search
From: Fatima Bangura
Date: Thu, 16 Oct 2008 17:03
Date: Thu, 16 Oct 2008 17:03
56 lines
4589 bytes
4589 bytes
-----Original Message----- From: Jimmy Lin [mailto:jimmylin@umd.edu] Sent: Thursday, October 16, 2008 11:53 AM To: fatima@cs.umd.edu Subject: Cloud Computing Talk (Wed 10/22)---Project ES2: Mining and Analytics for IBM Intranet Search Hi Fatima, Could you please publicize the following talk? Thanks! -Jimmy --- Project ES2: Mining and Analytics for IBM Intranet Search Shivakumar Vaithyanathan IBM Almaden Research Center 9:30am, October 22, 2008 Hornbake 2119 Abstract The IBM Intranet consists of more than 100M pages and serves a user community of 350,000 people distributed across multiple continents. The goal of Project ES2 is to build a scalable and easily maintainable search engine for this intranet. To tackle this search problem, ES2 employs sophisticated offline analytics combined with intelligent runtime query matching. In the offline phase, pages crawled from the intranet are pushed through a multi-stage pipeline consisting of "local" (page-at-a-time) analysis, "global" (cross-page) analysis, followed by intelligent tokenization and indexing. In addition, the pages are continuously mined to discover new patterns for local and global analysis. In this talk, I will describe the overall ES2 flow providing examples of local / global analysis and associated mining tasks. ES2 was originally deployed as a single-machine solution but to meet growing demands is currently being migrated to a 30-node Hadoop cluster. This leads to several challenging research issues, both in translating the overall flow onto Hadoop, as well as in mapping the analysis and mining algorithms onto the MapReduce paradigm. I will illustrate these challenges by walking through the mapping of a few example algorithms. About the Speaker Shivakumar Vaithyanathan is the Sr. Manager at IBM Almaden responsible for Analytics, Search and Information Integration Research. He is an Associate Editor for the Journal of Statistical Analysis and Data Mining. ---- Jimmy Lin, jimmylin [ at ] umd . edu, is hosting the visitor and arranging his schedule. Please let him know if you would like to meet the guest.
Technical Details
Message-ID:
<mailman.208.1224177152.3779.gradlist@mcfeely.cs.umd.edu>Path:
arc1-ca.pugleaf.net!g2news1.google.com!news4.google.com!goblin2!goblin1!goblin.stu.neva.ru!uio.no!elk.ncren.net!dailyplanet.umd.edu!not-for-mailShow Full Headers
Complete Article Headers
X-Google-Thread: 10f4d5,e3d44dd5aecdd658,start X-Google-Attributes: gid10f4d5,domainid0,public,usenet X-Google-Language: ENGLISH,ASCII-7-bit Path: arc1-ca.pugleaf.net!g2news1.google.com!news4.google.com!goblin2!goblin1!goblin.stu.neva.ru!uio.no!elk.ncren.net!dailyplanet.umd.edu!not-for-mail From: "Fatima Bangura" <fatima@cs.umd.edu> Newsgroups: csd.grad Subject: FW: Cloud Computing Talk (Wed 10/22)---Project ES2: Mining and Analytics for IBM Intranet Search Date: Thu, 16 Oct 2008 13:03:37 -0400 Organization: University of Maryland College Park Lines: 58 Message-ID: <mailman.208.1224177152.3779.gradlist@mcfeely.cs.umd.edu> NNTP-Posting-Host: mcfeely.cs.umd.edu Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Trace: dailyplanet.umd.edu 1224177153 16286 128.8.128.218 (16 Oct 2008 17:12:33 GMT) X-Complaints-To: abuse@umd.edu NNTP-Posting-Date: Thu, 16 Oct 2008 17:12:33 +0000 (UTC) To: "gradlist" <gradlist@cs.umd.edu> X-CSD-MailScanner-Watermark: 1224781428.82912@ptlygRd1Ko5a8UhNeyGS5A X-CSD-MailScanner-Watermark: 1224781417.95101@eO3lwQ0X52NlL3k9xjrAiQ X-Mailer: Microsoft Office Outlook 11 Thread-index: Ackvp0Rg2sBKRmhjSnCckgfbCBssVwACdmHQ X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3350 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.0 (bacon.cs.umd.edu [172.24.3.34]); Thu, 16 Oct 2008 13:03:37 -0400 (EDT) X-CSD-MailScanner-Information: Please email staff@cs.umd.edu for more information X-MailScanner-ID: m9GH3bsv009813 X-CSD-MailScanner: Found to be clean X-CSD-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=0, required 5, autolearn=not spam) X-CSD-MailScanner-From: fatima@cs.umd.edu X-Spam-Status: No X-Mailman-Approved-At: Thu, 16 Oct 2008 13:12:31 -0400 X-BeenThere: gradlist@mcfeely.cs.umd.edu X-Mailman-Version: 2.1.9 Precedence: list List-Id: CS Graduate Students <gradlist.mcfeely.cs.umd.edu> List-Unsubscribe: <https://mailman.cs.umd.edu/mailman/listinfo/gradlist>, <mailto:gradlist-request@mcfeely.cs.umd.edu?subject=unsubscribe> List-Archive: <https://mailman.cs.umd.edu/mailman/private/gradlist> List-Post: <mailto:gradlist@mcfeely.cs.umd.edu> List-Help: <mailto:gradlist-request@mcfeely.cs.umd.edu?subject=help> List-Subscribe: <https://mailman.cs.umd.edu/mailman/listinfo/gradlist>, <mailto:gradlist-request@mcfeely.cs.umd.edu?subject=subscribe>