Performing tasks in many threads made fun!
The workerpool module is a simple framework for easily distributing jobs into multiple worker threads.
This module facilitates distributing simple operations into jobs that are sent to worker threads, maintained by a pool object.
It consists of these components:
The best place to start for now is to read the code and look at the examples in the unit tests (/test) and the sample uses (/samples). Documentation contributions are welcome! What have you accomplished with the workerpool?
MassDownloader - How to write a simple multi-threaded mass downloader in under 10 lines of code.
There's good work being done on a native Python multiprocessing module. The functionality has a lot of overlap with workerpool. Worth having a look at!
Add more complete usage examples and wiki tutorials. More thorough unit testing Finalize the API for a 1.0 release
Are you using it? Let us know!
This module was originally developed during my work at Idée Inc. Big thanks to Idée for letting me open source it!
Copyright (c) 2008 Andrey Petrov (email@example.com)
Original copyright by Idee Inc. (http://ideeinc.com/)