Web Crawler

[Sanjay Patra]

Hi,

I am looking for source code of a simple C/ C++ web crawler.
I am looking for minimal crawler that can crawl given a starting url.


Any pointers is welcome.

Thanks.

 

[Victor Bazarov]

I am looking for source code of a simple C/ C++ web crawler.
I am looking for minimal crawler that can crawl given a starting url.


Any pointers is welcome.

www.google.com

 

[B.C.]

Search for wget. It is available on gnu.org website. You could also download
the source code.