Article View: comp.lang.misc
Article #1021Re: Ideas for time-series manipulation language
From: Robert Bernecky
Date: Tue, 18 Aug 1992 05:18
Date: Tue, 18 Aug 1992 05:18
49 lines
2978 bytes
2978 bytes
In article <Bt3Jt3.3Kn.2@cs.cmu.edu> tgl+@cs.cmu.edu (Tom Lane) writes:
>I'm thinking about designing a language in which discrete time series are a
>fundamental data type. I have vague memories of having seen similar ideas
>before, so I'm hoping someone can point me to prior work.
>
>The data I want to manipulate comes as series of observations taken at
>certain intervals of time (not necessarily the same interval for each series).
>I want to be able to refer to such a series as a single data object;
>to perform operations on such objects (eg, to add corresponding elements
>of two series to deliver a sum series), and to define functions that work
>on such objects (integration and correlation might be examples). I want
>the functions to be able to work incrementally as new values are added to
>each data series (lazy evaluation might help here).
>
>In trying to work out these ideas, I've run into some nasty problems of
>semantics, particularly when combining series having different time bases.
>How to make a reasonably efficient implementation is not obvious either.
a. One of the main reasons that Reuters bought I.P. Sharp Associates
(aside from their blathering about "the worth of the employees",
who they have been butchering in periodic purges), was the
IPSA "historical data bases", which are a large collection of
time series data on energy, economics, transport, finance, etc.
b. These time series were stored as APL arrays, in the SHARP APL File
System. Hmm. Still are. Reuters has not been able to figure out how
to store them in another fashion efficiently.
c. APL has proven to be the most effective tool for manipulating,
maintaining, correcting, and analyzing, these times series.
The functions you describe above sound fairly simple to do in APL
on time series.
d. I recommend you look at either SHARP APL/PC or J. Both are
available free, via FTP from watserv1.waterloo.edu (cd /languages/apl/...)
or with manuals, etc., from Iverson Software Inc, 33 Major St.
Toronto.
e. J is an ascii-based language based on the Good Ideas of APL.
The Waterloo archive also has source code for J available. The APL
code is unfortunately only available in binary form.
Robert Bernecky rbe@yrloc.ipsa.reuter.com bernecky@itrchq.itrc.on.ca
Snake Island Research Inc (416) 368-6944 FAX: (416) 360-4694
18 Fifth Street, Ward's Island
Toronto, Ontario M5J 2B9
Canada
Technical Details
Message-ID:
<1992Aug18.051843.422@yrloc.ipsa.reuter.COM>Path:
arc1-ca.pugleaf.net!sparky!uunet!utcsri!torsqnt!geac!itcyyz!yrloc!rbeReferences:
<Bt3Jt3.3Kn.2@cs.cmu.edu>Show Full Headers
Complete Article Headers
Newsgroups: comp.lang.misc Path: arc1-ca.pugleaf.net!sparky!uunet!utcsri!torsqnt!geac!itcyyz!yrloc!rbe From: rbe@yrloc.ipsa.reuter.COM (Robert Bernecky) Subject: Re: Ideas for time-series manipulation language Message-ID: <1992Aug18.051843.422@yrloc.ipsa.reuter.COM> Keywords: time series, semantics Reply-To: rbe@yrloc.ipsa.reuter.COM (Robert Bernecky) Organization: Snake Island Research Inc, Toronto References: <Bt3Jt3.3Kn.2@cs.cmu.edu> Date: Tue, 18 Aug 92 05:18:43 GMT Lines: 49