Get Source Code of a http://... site?

[Joshua Muheim]

Hi all

I want to download the source code of a website using Ruby? How can I
achieve this? ...when searching with Google, I only get download links
for the Ruby source etc. ;-)

Thanks
Josh

 

[Robert Klemme]

I want to download the source code of a website using Ruby? How can I
achieve this? ...when searching with Google, I only get download links
for the Ruby source etc. ;-)

The source code of a web site is usually not available apart from the
JavaScript you see in pages - for good reasons (security,
copyright...).

Cheers

robert

 

[Joshua Muheim]

The source code of a web site is usually not available apart from the
JavaScript you see in pages - for good reasons (security,
copyright...).

Cheers

robert

Oh, I wasn't clear enough, I just need the XHTML code, no
behind-the-scenes Ruby or PHP or stuff. ;-)

It's because I want to use captchator.com and I need to check the result
(0 or 1) using an URL like this:

http://captchator.com/captcha/check_answer/#{captcha_code}/#{@comment.captcha}

 

[Robert Klemme]

Oh, I wasn't clear enough, I just need the XHTML code, no
behind-the-scenes Ruby or PHP or stuff. ;-)

There are mechanize, hpricot and a few other alternatives that can
help you there.

Cheers

robert

 

[Joshua Muheim]

There are mechanize, hpricot and a few other alternatives that can
help you there.

Cheers

robert

Thanks, but that would be a big overkill I guess. I found the following
site which explains how to do it with just a few original methods:

http://blog.thembid.com/2007/08/06/using-ruby-to-scrape-a-web-page/

 

[Daniel Huckstep]

If you just need to get it, for archive or something, and just chose
ruby, have a look at httrack. Not ruby, just its own app, but it
mirrors pages.

- Daniel

 

[Joshua Muheim]

If you just need to get it, for archive or something, and just chose
ruby, have a look at httrack. Not ruby, just its own app, but it
mirrors pages.

- Daniel

Thanks, I know httrack... had some problems with it lately, though...
;-)