Pickle or Mysql

[amaltasb]

Can I use Pickle to store about 500,000 key value pairs.. or should I
use mySql. Which one is best for performance, as the key value pair
increases.

Thanks

 

[Paul Rubin]

Can I use Pickle to store about 500,000 key value pairs.. or should I
use mySql. Which one is best for performance, as the key value pair
increases.

That's an awfully large pickle. Maybe you want shelve. If there
are frequent updates, multiple clients, etc., then yes, use a database
like mysql.

 

[amaltasb]

So, Is Shelve a perfect solution (besides Mysql), to store large
key/value pairs, and which are updated frequently by multiple clients.

Thanks

 

[Paul Rubin]

So, Is Shelve a perfect solution (besides Mysql), to store large
key/value pairs, and which are updated frequently by multiple clients.

No, shelve is for use within a single process. With multiple clients
and frequent updates, you need a real database and some knowledge
about how to use one.

 

[Rene Pijlman]

(e-mail address removed):

Can I use Pickle to store about 500,000 key value pairs..

Performance would be horrible. Use a BTree in ZODB instead:
http://www.zope.org/Wikis/ZODB/guide/node6.html#SECTION000630000000000000000

or should I use mySql.

You should use a relational database, such as PostgreSQL, when you want to
model your data as relations (tables) instead of objects, or when you want
to use SQL, or when another application needs to access the data that only
speaks SQL, or ...

 

[Klaas]

Can I use Pickle to store about 500,000 key value pairs.. or should I

use mySql. Which one is best for performance, as the key value pair
increases.

Pickle: absolutely out of the question.
Mysql: might work, albeit slowly.

Use berkeley DB (bsddb3), or zodb. I have no experience with the
latter, but bdb's scale far beyond that magnitude if necessary.

-Mike

 

[amaltasb]

Can i install berkeley db on BSD, I am having a virtual private server,
so I have privilates to install on it and do we have management tools
like phpmyadmin from berkely db as well, as I am not so good at
database management.

Thanks
Amaltas