mod_python and logging

[Daniel Lichtenberger]

Hi,

I'm looking for a logging module to be used in a mod_python-powered
website. Python 2.3's logging package seems like a good fit, however
I'm not sure if it's completely safe to use it under high load. The
library documentation states that it's thread-safe, but what about
several forked apache processes running different (sub-)interpreters,
logging to the same file?

Other suggestions for logging (I really don't need most of logging.*'s
facilities) are also welcome.

Thanks,
Daniel

 

[qwweeeit]

Hi Daniel,
look at the thread I started ("Modifying a built-in function for
logging purposes").
http://groups.google.it/group/comp..../1c203ffc19cdeaac?hl=it&#doc_56e905ff27462d91
There you can find another approach to logging (limited, but specific)
and you can appreciate the point of view of various experts (I am not
one of them!).
Bye.

 

[Vinay Sajip]

I'm looking for a logging module to be used in a mod_python-powered
website. Python 2.3's logging package seems like a good fit, however
I'm not sure if it's completely safe to use it under high load. The
library documentation states that it's thread-safe, but what about
several forked apache processes running different (sub-)interpreters,
logging to the same file?

If you want to have multiple processes logging to the same file, the standard
Python logging module does not support interprocess synchronisation directly.
However, it is fairly easy to set up the processes to log events to a socket,
and a socket receiver can log received events to file. The online docs have an
example socket receiver:

http://docs.python.org/lib/network-logging.html

Other suggestions for logging (I really don't need most of logging.*'s
facilities) are also welcome.

Are you sure you'll never need them in the future?


Vinay Sajip

 

[Daniel Lichtenberger]

Hi!

If you want to have multiple processes logging to the same file, the
standard Python logging module does not support interprocess
synchronisation directly. However, it is fairly easy to set up the
processes to log events to a socket, and a socket receiver can log
received events to file. The online docs have an example socket
receiver:

http://docs.python.org/lib/network-logging.html

Thanks for the suggestion! Of course it's great to have a powerful and
flexible logging package, and it's still pretty easy to use.

Daniel