Does anyone 'crawl' the net?

Miscellaneous Forums/General Discussion/Does anyone 'crawl' the net?

The forum is locked. These are the original blitzbasic.com forums, kept so they can still be read. No new topics, replies or edits can be made here. To join in, head over to the Blitz3D+ forums.

puki
 #1
I'm not after free stuff.

I want a crawler that is going grab what it can find - hunting through directories and archived folders/files of anything connected to the net.

Basically, I want to steal the stuff.