Monthly Archives: November 2010

A very basic erlang Crawler

1.Save the code below as spyder.erl 2.Run as : erl spyder.erl  -s spyder start -s init stop This is a very crude crawler – will crawl all the links in a page, and then further. It doesn’t protect you … Continue reading

Posted in Uncategorized | Tagged , | 1 Comment