Extract data from website

I

I'mLost

Hi! I was wandering if somebody could point me in the right direction.
I need to pull text from a secure site that requires a username and
password. I have the username and password, and checking the stats on
the site everyday (it is a slow site), takes time. I want to automate
the process. I want to write the code myself, useing any existing
libraries that I can get off the net, but googleing it has gotten me
nowhere.
Can anybody point me in the right direction?
 
M

Maxim Yegorushkin

Hi! I was wandering if somebody could point me in the right direction.
I need to pull text from a secure site that requires a username and
password. I have the username and password, and checking the stats on
the site everyday (it is a slow site), takes time. I want to automate
the process. I want to write the code myself, useing any existing
libraries that I can get off the net, but googleing it has gotten me
nowhere.
Can anybody point me in the right direction?

Have you looked at http://curl.haxx.se/ ?
You could script curl command line utility to download the data or use
libcurl in you C/C++ code.
 
P

Puppet_Sock

Hi! I was wandering if somebody could point me in the right direction.
I need to pull text from a secure site that requires a username and
password. I have the username and password, and checking the stats on
the site everyday (it is a slow site), takes time. I want to automate
the process. I want to write the code myself, useing any existing
libraries that I can get off the net, but googleing it has gotten me
nowhere.
Can anybody point me in the right direction?

This is generally outside the standard language. You will
get better, and more help, if you find a news group that
is related to your specific platform. For example, if you
are doing this on a Microsoft computer, then you want to
look in news groups with dos or windows or microsoft in
the name. And you want to check out news groups with the
name of your compiler in the name.

Try searching at google groups first, and see what groups
talk about your specific platform and development tools.

http://groups.google.com

Socks
 
I

I'mLost

This is generally outside the standard language. You will
get better, and more help, if you find a news group that
is related to your specific platform. For example, if you
are doing this on a Microsoft computer, then you want to
look in news groups with dos or windows or microsoft in
the name. And you want to check out news groups with the
name of your compiler in the name.

Try searching at google groups first, and see what groups
talk about your specific platform and development tools.

http://groups.google.com

Socks

Thanks for your replies.
I was looking at curl I was just not sure if I was wasting my time.
At least I feel better about it now
Thanks again
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
474,166
Messages
2,570,907
Members
47,446
Latest member
Pycoder

Latest Threads

Top