How do i avoid newsreaders and get at the rss myself?

D

digger440uk

I was using http://feeds.feedburner.com/reuters/worldNews/ to obtain
the rss feed of world news from Reuters. I was running a vb.net app
that would grab the file every 15 minutes, do some manipulation and
then thump the data into mysql. Now feedburner have blocked direct
access to the feed and advise me to download a newsreader. I've briefly
played around with newsreaders in the past but couldn't see the use for
them from a developers point of view. Is there a solution where i can
run a newsreader on my server and that dumps the rss to a local source
where my existing application can pick it up and run with it?
 
A

Andy Dingley

digger440uk said:
I was using http://feeds.feedburner.com/reuters/worldNews/ to obtain
the rss feed of world news from Reuters. I was running a vb.net app
that would grab the file every 15 minutes, do some manipulation and
then thump the data into mysql. Now feedburner have blocked direct
access to the feed and advise me to download a newsreader.

http://feeds.feedburner.com/reuters/worldNews/
is still returning the raw RSS to me (Firefox). They've also stuck a
client-side stylesheet on top of it, so that your browser's default
presentation of it will be in HTML, not as raw RSS. However I still
have just as much programmatic "access" to the RSS content as ever.
Is there a solution where i can run a newsreader on my server and that dumps the rss

Try playing with different user-agent strings in your feed reader
client, ones that don't look like well-known web browsers.
 
D

digger440uk

thanks andy

doh. i suddenly feel quite stupid. i should have looked at the source
before posting.

i suppose it's off topic now, but is there a newsreader out there that
does a scheduled rss grab then dumps to a local file?
 
P

Peter Flynn

digger440uk said:
thanks andy

doh. i suddenly feel quite stupid. i should have looked at the source
before posting.

i suppose it's off topic now, but is there a newsreader out there that
does a scheduled rss grab then dumps to a local file?

Add this to your crontab:

5 0,6,12,18 * * * wget -O ~/file.xml http://some.rss.uri >>/tmp/wget.log

Adjust the minutes (here, 5 past the hour) and hours (here, four times a
day) and the file, URI, and log to your requirements.

///Peter
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
474,002
Messages
2,570,258
Members
46,858
Latest member
FlorrieTuf

Latest Threads

Top