How can I get the content of a web site using http library

[silverburgh.meryl]

I am trying to get the content of a web site like this:
But my question is how can I do a 'GET' request without putting the '/
index.html''


h = httplib.HTTP('www.yahoo.com')

# it takes 2 arguments here, but I don't know if the site has
'/index.html' , how can I leave this out?

h.putrequest('GET')
h.endheaders()

errcode, errmsg, headers = h.getreply()

if (errcode == 200):

f = h.getfile()

Thank you for your help.

 

[kyosohma]

I am trying to get the content of a web site like this:
But my question is how can I do a 'GET' request without putting the '/
index.html''

h = httplib.HTTP('www.yahoo.com')

# it takes 2 arguments here, but I don't know if the site has
'/index.html' , how can I leave this out?

h.putrequest('GET')
h.endheaders()

errcode, errmsg, headers = h.getreply()

if (errcode == 200):

f = h.getfile()

Thank you for your help.

You may want to go with the urllib module instead. Check out the how-
to below:

http://www.voidspace.org.uk/python/articles/urllib2.shtml

Mike

 

[silverburgh.meryl]

You may want to go with the urllib module instead. Check out the how-
to below:

http://www.voidspace.org.uk/python/articles/urllib2.shtml

Mike

Thanks. Can you please tell me how can I do a Post form submission
using the urlLib2 library? I look at your link, but i cant find an
example there.

Thank you.

 

[Thorsten Kampe]

* (e-mail address removed) (29 Mar 2007 12:18:19 -0700)

I am trying to get the content of a web site like this:
But my question is how can I do a 'GET' request without putting the '/
index.html''

import urllib
print urllib.urlopen('http://www.yahoo.com/').read()

 

[kyosohma]

* (e-mail address removed) (29 Mar 2007 12:18:19 -0700)


import urllib
print urllib.urlopen('http://www.yahoo.com/').read()

Posting to a form:

urllib:
http://www.thescripts.com/forum/thread23871.html

httplib:
http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/146306
http://www.python.org/infogami-faq/library/how-can-i-mimic-cgi-form-submission-method-post/

Mike

 

[irstas]

Thanks. Can you please tell me how can I do a Post form submission
using the urlLib2 library? I look at your link, but i cant find an
example there.

Thank you.

http://www.python.org/doc/current/lib/module-urllib2.html

Look into urlopen's data parameter.

 

[Lawrence Oluyede]

http://www.python.org/doc/current/lib/module-urllib2.html

Look into urlopen's data parameter.

I add also this tutorial to the plate:
http://www.voidspace.org.uk/python/articles/urllib2.shtml