Help with large data set and fatal python error

V

Vineet Jain

I'm running a process which uses python numeric arrays extensively and also
does some calculations in c. All objects are created in python or through
the Numeric library and then passed to the c routines. I'm dealing with very
large sets of data.

I'm getting the following exceptions in the early part of the program:

Exception exceptions.AssertionError: <exceptions.AssertionError instance at
0x02639C10> in <function remove at 0x025CF5B0> ignored

....and then after about at the 1060 iteration of the main processing loop I
get the following error:

Fatal Python error: deallocating None

Questions:
1. Is there any way to catch this error and close my database connection so
my uncommitted transactions get saved to the db
2. When I profile the larger dataset the .prof file does not get generated.
Is there any way to incrementally build the .prof file
3. Any ideas what the errors means and how can I debug/catch them?

vinj
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

No members online now.

Forum statistics

Threads
473,982
Messages
2,570,185
Members
46,736
Latest member
AdolphBig6

Latest Threads

Top