[svlug] Linux + MySQL w/ very large data sets

Jeremy Zawodny Jeremy at Zawodny.com
Wed Jun 12 15:53:15 PDT 2002


On Wed, Jun 12, 2002 at 03:00:22PM -0700, Drew Bertola wrote:
>
> Can anyone tell me what the best architecture / OS support is
> suggested for handling data with possible table sizes in the 100s of
> GB range?  This would be under MySQL (though I'd consider other DBs)
> and, other than monthly updates, only SELECT transactions need be
> considered.

As long as the OS in question can handle files that big, you shouldn't
have much trouble.  If your query volume isn't substantial, you'll be
looking at a ton of disk space (obviously) and as much ram as is
feasible for the box.  Giving MySQL a large key buffer will be
essential.

CPU isn't much of an issue--this is an I/O bound problem.  So having
some form of RAID and fast disks will certainly help.

Jeremy
-- 
Jeremy D. Zawodny     |  Perl, Web, MySQL, Linux Magazine, Yahoo!
<Jeremy at Zawodny.com>  |  http://jeremy.zawodny.com/



More information about the svlug mailing list