how to get a http directory listing

[Carlos Diaz]

Hi,

Has anyone ever tried to do something like this? I'm trying to log in
to a url and get a listing of all the files on that url. For example,
with wget I can fetch the files this way:

wget http://username:[email protected]/logs/somelog.log

this would get the individual file and download it to my local machine.
However, I'm trying to automate this script to go out and look at the
contents of this directory and do something for each file in there. For
example, I want to do something like this:

Dir.foreach("http://username:[email protected]/logs") {|x| <do some
logic here>}

However, I'm not sure if there is a simple way to do something like this
in Ruby. Anyone encountered this before?

Thanks in advance,
Carlos
(Ruby Rookie)

 

[Robert Klemme]

Hi,

Has anyone ever tried to do something like this? I'm trying to log in
to a url and get a listing of all the files on that url. For example,
with wget I can fetch the files this way:

wget http://username:[email protected]/logs/somelog.log

this would get the individual file and download it to my local
machine. However, I'm trying to automate this script to go out and
look at the contents of this directory and do something for each file
in there. For example, I want to do something like this:

Dir.foreach("http://username:[email protected]/logs") {|x| <do some
logic here>}

However, I'm not sure if there is a simple way to do something like
this in Ruby. Anyone encountered this before?

Problem is, that there is no standard directory listing mechanism for
HTTP. Most servers even forbid to list directory contents.

Maybe wget does the job already.

Kind regards

robert

 

[daz]

Hi,

Has anyone ever tried to do something like this? I'm trying to log in
to a url and get a listing of all the files on that url. For example,
with wget I can fetch the files this way:

wget http://username:[email protected]/logs/somelog.log

this would get the individual file and download it to my local machine.
However, I'm trying to automate this script to go out and look at the
contents of this directory and do something for each file in there. For
example, I want to do something like this:

Dir.foreach("http://username:[email protected]/logs") {|x| <do some
logic here>}

However, I'm not sure if there is a simple way to do something like this
in Ruby. Anyone encountered this before?

Niklas Frykholm may have tussled with this problem:

http://raa.ruby-lang.org/project/webfetcher/

=> http://www.acc.umu.se/~r2d2/programming/ruby/webfetcher/

Worth a look, for ideas ?


daz