🚀 go-pugleaf

From: neal@cs.Buffalo.EDU (Jeannette Neal)
To: mod-ki@unido.informatik.uni-dortmund.de
Date: Wed, 9 Jan 91 15:39:59 EST
Subject: <mod-ki 0621> Call for Participation: Eval.of NL Proc. Systems
Keywords: Workshops, Natural Language

mod-ki message 0621
************************************************************************
                        CALL FOR PARTICIPATION
 
      Workshop on Evaluation of Natural Language Processing Systems
 
                             18 June 1991
                       University of California
                             Berkeley, CA

There has been increased concern with the evaluation of natural language
processing (NLP) systems over the past few years. The evaluation of  NLP
systems is essential in order to measure the capabilities of  individual
systems, to measure technical progress and growth in the field,  and  to
provide a basis for selecting NLP systems to best fit the  communication
requirements of application domain systems.  This  1991  Workshop  is  a
follow on to the workshop on evaluation held in December of 1988 at  the
Wayne Hotel  in  Wayne,  PA.  Technical  report  RADC-TR-89-302  on  the
previous workshop is available from Rome Laboratory.

Important issues for any evaluation effort and relevant to this workshop
include identification of the items or  capabilities  to  be  evaluated,
choosing between "black box" and "glass box" approaches,  definition  of
evaluation  criteria,  development  of   methods   or   procedures   for
evaluation, determination of evaluation metrics,  and  determination  of
the type of output to be produced  by  the  evaluation  procedures.  The
areas of NLP relevant for  this  workshop  include  syntactic  analysis,
semantic analyisis, pragmatic analysis, lexical processing,  morphology,
sharable knowledge  bases  and  ontologies,  speech  understanding,  and
trainable systems.

The purpose of this workshop is to provide  a  forum  for  computational
linguists to report on  and  discuss  current  efforts  and  activities,
research progress, new  approaches,  problems  and  issues;  to  promote
scientific interchange on important evaluation issues; and  to  generate
recommendations  and  directions  for  future  investigations   in   the
evaluation area.

Workshop attendance will be by invitation, limited  to  45  people.  The
workshop will be  held  June  18th  at  the  University  of  California,
Berkeley Campus, in association with the  29th  Annual  Meeting  of  the
Association for Computational Linguistics.

SUBMISSIONS:
Interested participants should submit  a  3-5  page  abstract  of  their
presentation and a  brief  description  of  their  research  activities.
Persons desiring to attend the workshop, but not  make  a  presentation,
should send only a  brief  description  of  their  research  activities.
All persons should include name,  mailing  address,  phone  number,  and
electronic mail address. Submission may be  transmitted  via  electronic
mail, U.S. Postal Service, or FAX.  If  hardcopy  is  submitted,  please
include six  copies  (including  the  original).  Send  submissions  to:

      Jeannette G. Neal, Ph.D.
      Calspan Corporation
      P.O. Box 400, Buffalo, NY 14225
      (716) 631-6844
      FAX: (716) 631-6722
      neal@cs.buffalo.edu

SCHEDULE:
      March 1, 1991   Submissions due
      April 1, 1991   Notification of acceptance/invitation

ORGANIZATION AND PROGRAM COMMITTEE:
      Jeannette G. Neal, Calspan Corporation (Committee Chair)
      Tim Finin, Unisys Center for Advanced Information Technology
      Ralph Grishman, New York University
      Christine Montgomery, Language Systems, Inc.
      Sharon Walter, Rome Laboratory

SUPPORT for this workshop is provided by Rome Laboratory.
************************************************************************