Article View: cu.cs.ugrads
Article #129CS Colloquium for Baveja for 3/14/02
From: jane obrecht
Date: Fri, 08 Mar 2002 16:55
Date: Fri, 08 Mar 2002 16:55
51 lines
4150 bytes
4150 bytes
University of Colorado at Boulder Department of Computer Science ECOT 717 Engineering Center Campus Box 430 Boulder, Colorado 803090430 (303) 4927514, FAX: (303) 4922844 CS COLLOQUIUM Reinforcement Learning Formulations of the AI Problems: Have they been good for AI or (An Analysis of the Exploitation-Exploration Tradeoff and an Application to Human-Computer Interaction Satinder Singh Baveja Syntek Capital Thursday, March 14, 2002 3:30 4:30 PM Engineering Center Classroom 265 Refreshments will be served afterwards in ECOT 831 The field of reinforcement learning (RL) has introduced into AI many abstract mathematical formulations of the AI problem, mostly by borrowing them from the fields of operations research and adaptive control. Has this been good for AI? I will argue that RL formulations have allowed us to ask and answer precise questions about many important AI issues as well as to bring a (mostly) principled design methodology to many application areas. I will illustrate these twin advantages through examples from my own work. In the first part of the talk I will provide an answer to a formulation of the "exploitation-exploration" tradeoff: should an agent exploit what it already knows or should it explore in the hope of learning something that leads to even greater long-term return? In the second part of the talk, I will describe why and how RL offers a powerful methodology for designing many human-computer interaction systems. I will illustrate this methodology through our design, construction and empirical evaluation of NJFun (a system that provides telephonic access to a database of fun activities in NJ), and show that RL measurably improves NJFun's performance. Host: Clayton Lewis ------------------------------ http://www.cs.colorado.edu/department/events/colloquia/colloquia.html Sign Language Interpreters Available Upon Request. Please contact Jane Obrecht, Department of Computer Science, Engineering ECOT 722, 303-492-6101, at least five days prior to the colloquium. _______________________________________________ cscolloq mailing list cscolloq@cs.colorado.edu http://www.cs.colorado.edu/mailman/listinfo/cscolloq
Technical Details
Message-ID:
<1015606688.7365@csnews.cs.colorado.edu>Path:
arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!sn-xit-02!sn-xit-03!supernews.com!newsswitch.lcs.mit.edu!newsfeed.cwix.com!cpk-news-hub1.bbnplanet.com!nycmny1-snh1.gtei.net!news.gtei.net!priapus.visi.com!news-out.visi.com!hermes.visi.com!dimensional.com!pulsar.dimensional.com!coop.net!cs.colorado.edu!csnews!recnewsShow Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 11534c,faba6fb3c2f113ed,start X-Google-Attributes: gid11534c,public X-Google-ArrivalTime: 2002-03-08 08:58:10 PST Newsgroups: cu.cs.ugrads X-Sender: obrecht@columbine.cs.colorado.edu X-Mailer: QUALCOMM Windows Eudora Pro Version 4.2.2 From: jane obrecht <Jane.Obrecht@colorado.edu> Subject: CS Colloquium for Baveja for 3/14/02 Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Errors-To: cscolloq-admin@cs.colorado.edu X-BeenThere: cscolloq@cs.colorado.edu X-Mailman-Version: 2.0.5 Precedence: bulk Reply-To: Jane.Obrecht@colorado.edu List-Help: <mailto:cscolloq-request@cs.colorado.edu?subject=help> List-Post: <mailto:cscolloq@cs.colorado.edu> List-Subscribe: <http://www.cs.colorado.edu/mailman/listinfo/cscolloq>, <mailto:cscolloq-request@cs.colorado.edu?subject=subscribe> List-Id: CS Colloquium announcements <cscolloq.cs.colorado.edu> List-Unsubscribe: <http://www.cs.colorado.edu/mailman/listinfo/cscolloq>, <mailto:cscolloq-request@cs.colorado.edu?subject=unsubscribe> List-Archive: <http://www.cs.colorado.edu/pipermail/cscolloq/> Date: 08 Mar 2002 09:55:21 -0700 Message-ID: <1015606688.7365@csnews.cs.colorado.edu> Sender: news Distribution: co X-Note1: message-id generated by recnews X-Note2: mail msgid was <4.2.2.20020308095145.013ecab8@columbine.cs.colorado.edu> Originator: daemon@csnews.cs.colorado.edu NNTP-Posting-Host: csnews.cs.colorado.edu X-Trace: cs.colorado.edu!csnews 1015606688 csnews.cs.colorado.edu (8 Mar 2002 09:58:08 -0700) Lines: 51 Path: arc1-ca.pugleaf.net!archiver1.google.com!news1.google.com!sn-xit-02!sn-xit-03!supernews.com!newsswitch.lcs.mit.edu!newsfeed.cwix.com!cpk-news-hub1.bbnplanet.com!nycmny1-snh1.gtei.net!news.gtei.net!priapus.visi.com!news-out.visi.com!hermes.visi.com!dimensional.com!pulsar.dimensional.com!coop.net!cs.colorado.edu!csnews!recnews