M
Mike Copeland
I am developing an application that reads and stores data from 2
large text files. One file (5750kb) has ~160,000 records and the other
(23,000kb) has ~330,000 records. The program reads both files and
converts/stores their data into vectors. Also, some indices to unique
records are developed (much like a telephone book), so that searches can
be efficiently done.
The reads at program start take a long time (~2 minutes), and
although I use buffers of 4096 size, I can't see other ways to improve
this aspect of the program's performance. The data this program uses
will continue to grow, so I am concerned about its viability. Any
thoughts? TIA
large text files. One file (5750kb) has ~160,000 records and the other
(23,000kb) has ~330,000 records. The program reads both files and
converts/stores their data into vectors. Also, some indices to unique
records are developed (much like a telephone book), so that searches can
be efficiently done.
The reads at program start take a long time (~2 minutes), and
although I use buffers of 4096 size, I can't see other ways to improve
this aspect of the program's performance. The data this program uses
will continue to grow, so I am concerned about its viability. Any
thoughts? TIA