download full sites?

[randomtalk]

hi, does anyone know of any package that will download a full site for
offline viewing? It will change all url to match local urls and follow
a logical structure (the site's structure would be suffice).. Please
tell me if you have heard of such a package.. thanks alot

 

[Paul Rubin]

hi, does anyone know of any package that will download a full site for
offline viewing? It will change all url to match local urls and follow
a logical structure (the site's structure would be suffice).. Please
tell me if you have heard of such a package.. thanks alot

http://www.gnu.org/software/wget/wget.html
http://www.interlog.com/~tcharron/wgetwin.html

 

[Mike Meyer]

hi, does anyone know of any package that will download a full site for
offline viewing? It will change all url to match local urls and follow
a logical structure (the site's structure would be suffice).. Please
tell me if you have heard of such a package.. thanks alot

In the Tools directory of the Python script is webchecker/websucker.py
That should do what you want.

Of course, if you just want a tool to do this, wget works fine, and is
a lot more flexible.

<mike

 

[linuxfreak]

Try curl...its pretty cool.. and also wget...

 

[James]

This isn't a Python question unless you are looking for a Python
implementation.

HTTrack is one that I have used in the past as a general purpose tool.
http://www.httrack.com/

As for Python
http://harvestman.freezope.org/
I have no experience with it. I just searched in the CheeseShop.

 

[Claudio Grondi]

hi, does anyone know of any package that will download a full site for
offline viewing? It will change all url to match local urls and follow
a logical structure (the site's structure would be suffice).. Please
tell me if you have heard of such a package.. thanks alot

I thougt, that HarvestMan
http://cheeseshop.python.org/pypi/HarvestMan/1.4.5 final is THE tool
to do that. Because haven't used it yet, still dowloading with a
commercial OfflineExplorer program I have a license for, I would be glad
to hear how it compares to the other in this thread mentioned tools.

Claudio