| Rob Adams 2007-07-19, 6:58 pm |
| I have a query that I run using mysql that returns about 60,000 plus rows.
It's been so large that I've just been testing it with a limit 0, 10000 (ten
thousand) on the query. That used to take about 10 minutes to run,
including processing time in PHP which spits out xml from the query. I
decided to chunk the query down into 1,000 row increments, and tried that.
The script processed 10,000 rows in 23 seconds! I was amazed! But
unfortunately it takes quite a bit longer than 6*23 to process the 60,000
rows that way (1,000 at a time). It takes almost 8 minutes. I can't figure
out why it takes so long, or how to make it faster. The data for 60,000
rows is about 120mb, so I would prefer not to use a temporary table. Any
other suggestions? This is probably more a db issue than a php issue, but I
thought I'd try here first.
|