webcrawler/robot

[mikkel]

Hi Guys,

Ive been looking for a webcrawler/robot, implemented in ruby...

but I havent found any...can this really be true???

thanks in advance

Mikkel

 

[jfister]

There's one in the Rails Analyzer project that crawls a single domain:

RDoc:
http://rails-analyzer.rubyforge.org/hacks/

Article:
http://groups.google.com/group/comp.lang.ruby/browse_thread/thread/166fa4076defb055

 

[Gene Tani]

http://rubyforge.org/snippet/detail.php?type=snippet&id=49

 

[Eric Hodel]

There's one in the Rails Analyzer project that crawls a single domain:

RDoc:
http://rails-analyzer.rubyforge.org/hacks/

Article:
http://groups.google.com/group/comp.lang.ruby/browse_thread/thread/
166fa4076defb055

It is only useful as a benchmarking tool, it is too stupid to do any
thing useful beyond timing.