A work in progress for a priority queue-based URL harvester for further crawling (hub.darcs.net/arpunk/cometin)
The queue operations shall be atomic and concurrent.