🚀 go-pugleaf

> Yes, I'm doing a First and then a while not eof do processing and
> next loop.  I'm wondering why it takes so long. CPU load stays under
> 1% average at all times (peaks are 3 or 4 %) Obviously, the CPU is
> more waiting then running. Is there not a way to make it more CPU
> intensive?  I should think 100 minutes at 1% could be done in 1
> minute at 100%?

I am confused. What does the CPU usage have to do with this? The
process of moving records from the server to the client is I/O bound.
The constraint is how fast data can be moved over the network cable.
The CPU is doing nothing because it is waiting for the I/O to take
place.

> 
> > Either of the following approaches should be faster.
> > 
> > 1) Read the flat file one row at a time and SELECT the matching row
> > from the database using the primary key. Then process the record on
> > the client. To select the row from the database use an IBSQL
> > component with a parameterized SELECT.
> 
> So, you think running 200 000 separate selects should execute faster?

If the flat file contained a subset of the records then yes, I do.
 
> > 2) Convert the flat file to fixed length format. Create an external
> > table in the database that matches the fixed lenght file. INSERT the
> > data from the external table into a table in the database (this
> > would be a good place to use a temporary table if you are using IB
> > 7.5.1).
> 
> I'm using 6.02 (the freeware version).
> Can this file for filling the table come from a stream? I preprocess

No. It must be a fixed length file.

> 
> You mean with a stored procedure?

Yes. The way to improve performance is to drastically reduce the amount
of data moved across the network.

Bill Todd