[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: A Data Reduction Proposal
Hey Chris,
I'll work on making my database huge, and see what happens. In the next
week or so (hopefully), I'll get cycles of import/merge/use with random data
and see when/how performance breaks down. I will attempt to use real
looking data (maybe perturbing one data set) so stuff 'makes sense'.
> One "got ya" that I found was that you should _not_ experiment
> with small numbers of records. THere is a big "knee" in the
> performance graph when the data gets to big to cache in RAM.
> I found I needed a random data generator to populate a few
> table million rows.
I like your type idea, as this should get around the problem having 0,15 not
being near to 359.99,15 without doing multiple selects. I'd thought about
this previously, but never did anything.
>
> I think we should just bite the bullet and go with Postgresql.
> It runs on every platform and OS under the sun, is free and
> is fully featured. Doing this allows us to use Postgresql-
> specific extensions such as user defined data type and
> functions. For example I would like to define an RA and DEC
> pair as a type.
>
Rob