Copying Website Contents, esp. Message Boards

[Travis Newbury]

Look at, downloading while browsing. That's fine, but, hey, I pay the
bandwidth, so I get to decide how it can be used....

No you don't .

I don't allow
deeplinking to images, I don't want people to download a random hundred
pages just to look at a dozen of them or so, and throw the rest out.
_Don't_waste_ my bandwidht, _use_ it.

And your assumption is that your content is not a waste of bandwith to
start with...

 

[Andrew Haylett]

On Tue, 07 Feb 2006 20:28:58 -0500, Barry Margolin

wget respects the Robot Exclusion Protocol; curl does not.

Hmm. wget's man page certainly says that it respects robots.txt - but
when I use its '-m' option to mirror my own site, it seems quite happy
to recurse into directories that have been explicitly disallowed in my
robots.txt.

 

[Randy Howard]

ray wrote

As the pages you describe are generated as a result of queries to a
database, I'd say you can't. Without the query the page doesn't exist.

Of course if he had the web page author's permission (instead of
just stealing content from elesewhere), then he should be able
to get a copy of the entire site, including the database.

 

[Randy Howard]

Barbara de Zoete wrote

[1] I'm on a IIS server

ruh roh

 

[cmashieldscapting]

As a followup question, how would one go about transferring the
contents of their email inbox to digital form, presumably CD, for
storage? Would some way of copying a page of emails at a time save the
entire contents of each email, or does each one have to be opened
individually? This is pretty much the same issue as message boards, on
which there's a thread name, to read the posts the thread must be
opened, and there may be more than one page of posts. As with website
contents, I'd like the emails to remain in as much as possible the same
form, to be an exact copy of the original. Thanks.

Cori

 

[Jonathan N. Little]

As a followup question, how would one go about transferring the
contents of their email inbox to digital form, presumably CD, for
storage? Would some way of copying a page of emails at a time save the
entire contents of each email, or does each one have to be opened
individually? This is pretty much the same issue as message boards, on
which there's a thread name, to read the posts the thread must be
opened, and there may be more than one page of posts. As with website
contents, I'd like the emails to remain in as much as possible the same
form, to be an exact copy of the original. Thanks.

Depends on client

 

[cmashieldscapting]

Depends on client

You mean the email provider?

Cori

 

[Calum Benson]

You mean the email provider?

No, he means the mail program you use (Apple Mail, Thunderbird,
Entourage or whatever). They all store your email in different places.

 

[Jonathan N. Little]

No, he means the mail program you use (Apple Mail, Thunderbird,
Entourage or whatever). They all store your email in different places.

Yep thats what I meant, however in retrospect it could be your email
provider, some ISPs do not give you a real POP mail account but are
webmail only like AOL and MSN. With webmail your email is stored on the
remote server not on your system :-(