hub.darcs.net :: arpunk -> cometin -> files

A work in progress for a priority queue-based URL harvester for further crawling (hub.darcs.net/arpunk/cometin)

* Intro

  A crawler.

  This is a work in progress, don't expect working code until a release.