Clipper - Problem accessing >5000 records.

Author

Problem accessing >5000 records.

CarlH

2007-09-29, 6:55 pm

Hi,

I am accessing a Clipper database with 71000 records, with MFC (c++ 6)
through Odbc (dbase).

My problem is that I cannot do a query to return more than 5000 records on
this particular database file, it will however return less than 5000
records.
The query is a very simple (eg: all for Account='1500').

Even when I try to do this in Visual Studio as a database project, I get the
same problem (so it has nothing to do with the programming).
Yet if I use the same kind of filter with another clipper database file the
same way, I can get >5000 records.

There doesn't seem to be any corruption in the database.

Does anybody know what could be causing this limitation?

Thanks,
Charles.

dlzc

2007-10-02, 6:55 pm

Dear CarlH:

On Sep 29, 8:32 am, "CarlH" <Char...@bscinforma.com> wrote:
> Hi,
>
> I am accessing a Clipper database with 71000
> records, with MFC (c++ 6) through Odbc (dbase).
>
> My problem is that I cannot do a query to
> return more than 5000 records on this
> particular database file, it will however
> return less than 5000 records.
> The query is a very simple (eg: all for
> Account='1500').
>
> Even when I try to do this in Visual
> Studio as a database project, I get the
> same problem (so it has nothing to do
> with the programming). Yet if I use the
> same kind of filter with another clipper
> database file the same way, I can get
>
> There doesn't seem to be any corruption
> in the database.
>
> Does anybody know what could be causing
> this limitation?

Yet another reason not to use a Micro$haft product.

http://www.microsoft.com/communitie...exp=&sloc=en-us
.... someone else with your problem, and no solution in 2 w

s.

Since you are not using Clipper, and the database is likely not
corrupted, then it is something you got with MFC, and you'd need to
poke around in it.... and its settings.

Maybe you will have to amend your query, and process the datafile in
pieces (adding record number limits also). Then all you'd have to do
is merge the bits.

Lastly, if you have Clipper, you could write something that would
accept your ODBC query (or something like it) on the command line or
input file, and output to a file of your choice.

David A. Smith

tom knauf

2007-10-04, 6:55 pm

Hi,

I would create an odbc connection and try with a free product like
ms_manager free (no inst necessary)

If that fails, too : maybe DB corruption
If not : look for properties like fetchsize, there are a lot setings in Odbc
/ Sql which may "block" to get all records.

Hth
Tom

CarlH

2007-10-04, 6:55 pm

The problem is not the database file (dbf) itself, it is the index file and
how ODBC handles it. I have noticed that if I eliminate the .inf file I can
load >5000 records.

Thanks,
Charles.

"dlzc" <dlzc1@cox.net> wrote in message
news:1191358616.671761.139080@k79g2000hse.googlegroups.com...
> Dear CarlH:
>
> On Sep 29, 8:32 am, "CarlH" <Char...@bscinforma.com> wrote:
>
> Yet another reason not to use a Micro$haft product.
>
>
http://www.microsoft.com/communitie...exp=&sloc=en-us
> ... someone else with your problem, and no solution in 2 w

s.
>
> Since you are not using Clipper, and the database is likely not
> corrupted, then it is something you got with MFC, and you'd need to
> poke around in it.... and its settings.
>
> Maybe you will have to amend your query, and process the datafile in
> pieces (adding record number limits also). Then all you'd have to do
> is merge the bits.
>
> Lastly, if you have Clipper, you could write something that would
> accept your ODBC query (or something like it) on the command line or
> input file, and output to a file of your choice.
>
> David A. Smith
>

Scott Burke

2007-10-05, 6:55 pm

Hi

Just an ideal. Could your problem be that while you are accessing the
record
someone else made a change to the DBF with required the indexes to be
updated?
Maybe and automatic function that happens on a timer? That just happens in
the same
amount of time it take to access 5000 records?

OR
If memory servers. I believe that there are registry settings that can
limit you to a curtain number
of records.

I remember trying to make access work with SQL a few years back. My problem
was
at record 50000. Both of the above were responsible. However I gave up on
that and
trashed all my notes.

Scott Burke

"CarlH" <Charles@bscinforma.com> wrote in message
news:lNeNi.5860$qo5.13760@weber.videotron.net...
> The problem is not the database file (dbf) itself, it is the index file
> and
> how ODBC handles it. I have noticed that if I eliminate the .inf file I
> can
> load >5000 records.
>
> Thanks,
> Charles.
>
>
> "dlzc" <dlzc1@cox.net> wrote in message
> news:1191358616.671761.139080@k79g2000hse.googlegroups.com...
> http://www.microsoft.com/communitie...exp=&sloc=en-us
>
>

Rene Flores

2007-10-07, 9:55 pm

Carl:

Microsoft ODBC drivers are not fully compatible with DBF format
(specially in the indexing stuff).

We managed a project about two years ago involving several programming
language working over a set of DBF/CDX Clipper 5.3 tables.

We used ASP, Clipper, FiveWin, Delphi and Visual Basic all working
together and simultaneously, our main problem was that Visual Basic and
ASP didn't update the indexes, so we moved to a standard driver for all
the programming languages, we used Advantage Database Server
(www.advantagedatabase.com), we used the ADS ADO provider for ASP and
Visual Basic, the RDD Clipper client and the xHarbour RDDADS with
FiveWin harbour and the TDataSet descendant for Delphi now this
application works great and all the tables along their indexes are updated.

Regards

Rene Flores
http://www.ciber-tec.com
H escribió:
> Hi,
>
> I am accessing a Clipper database with 71000 records, with MFC (c++ 6)
> through Odbc (dbase).
>
> My problem is that I cannot do a query to return more than 5000 records on
> this particular database file, it will however return less than 5000
> records.
> The query is a very simple (eg: all for Account='1500').
>
> Even when I try to do this in Visual Studio as a database project, I get the
> same problem (so it has nothing to do with the programming).
> Yet if I use the same kind of filter with another clipper database file the
> same way, I can get >5000 records.
>
> There doesn't seem to be any corruption in the database.
>
> Does anybody know what could be causing this limitation?
>
> Thanks,
> Charles.
>
>

Sponsored Links