HTML -> text/plain "clever" formatting

Gilles Lenfant · Oct 6, 2003

Hi,

I make an app where I need to convert HTML to text in a "clever" way (means
it tries to mimic when possible a browser rendering).
Actually I spawn with popen2 a "lynx" that makes a perfect job.

But I need a 100% pythonic stuff to have my app (Zope product) running on
non Unix boxes.

Any hint ?

Thanks in advance.

--Gilles

Karl Scalet · Oct 6, 2003

Gilles said:
Hi,

I make an app where I need to convert HTML to text in a "clever" way (means
it tries to mimic when possible a browser rendering).
Actually I spawn with popen2 a "lynx" that makes a perfect job.

i've seen an example in python cookbook, but do not have the copy with
me right now. If you have that book, look at the example to send HTML
mails. keywords are htmllib and formatter/AbstractFormatter.
IIRC they mention it's not that perfect as doing the same with lynx.
Don't know if the onlineversion at activestate does have this example.

But I need a 100% pythonic stuff to have my app (Zope product) running on
non Unix boxes.

That would be 100% pythonic even w/o external stuff.

Any hint ?

Thanks in advance.

--Gilles

HTH Karl

Gilles Lenfant · Oct 6, 2003

Karl Scalet said:
i've seen an example in python cookbook, but do not have the copy with
me right now. If you have that book, look at the example to send HTML
mails. keywords are htmllib and formatter/AbstractFormatter.
IIRC they mention it's not that perfect as doing the same with lynx.
Don't know if the onlineversion at activestate does have this example.

That would be 100% pythonic even w/o external stuff.

HTH Karl

Thanks Karl, I found what you're talking about

http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/52297

Need to rework that TtyFormatter in depth to mimic lynx

)

Cheers

--Gilles

Michel Claveau/Hamster · Oct 6, 2003

Bonjour !

Tente l'exemple de code "maison" ci-dessous.

@-salutations
--
Michel Claveau
mél : http://cerbermail.com/?6J1TthIa8B

# -*- coding: cp1252 -*-

import cStringIO
import formatter
import urllib
import htmllib

def htdecode(a):
f=cStringIO.StringIO()
z=formatter.AbstractFormatter(formatter.DumbWriter(f))
p=htmllib.HTMLParser(z)
p.feed(urllib.unquote_plus(a))
p.close()
sret=f.getvalue()
f.close()
return(sret)

a="""<HTML><BODY><B> Bonjour%20!%20<BR>
Ligne 2</B></BODY></HTML>"""

print '\n--- en HTML','-'*30
print a

b=htdecode(a)

print '\n\n--- sans HTML','-'*28
print b

Karl Scalet · Oct 6, 2003

Gilles said:
Thanks Karl, I found what you're talking about

http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/52297

Need to rework that TtyFormatter in depth to mimic lynx )

Cheers

Hi Gilles

actually I was talking about a different even similar example.
But could not find it either in the online version. So maybe
this is available only in the printed version, sorry.
But if your recipe is good enough , why bother

Karl

John J. Lee · Oct 6, 2003

Gilles Lenfant said:
But I need a 100% pythonic stuff to have my app (Zope product) running on
non Unix boxes.

Lynx runs on Windows too (and lots of other platforms). It is a big
pile of code, though, possibly containing buffer overflows etc...

John

Karl Scalet · Oct 7, 2003

Karl said:
Hi Gilles

actually I was talking about a different even similar example.
But could not find it either in the online version. So maybe
this is available only in the printed version, sorry.
But if your recipe is good enough , why bother

Karl

finally found the online version under:
http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/67083
but this version deviates from the paper version in exactely
not having the code you're interessted in, so I'll add it here,
hopefully no one's complaining about this few lines:

import htmllib, formatter, cStringIO
textout = cStringIO.StringIO()
formtext = formatter.AbstractFormatter(formatter.DumbWriter(textout))
parser = htmllib.HTMLParser(formtext)
parser.feed(html)
parser.close()
text = textout.getvalue()

(not tested)

Karl

converting html to plain text	18	Apr 16, 2009
Convert HTML to plain text	3	Nov 13, 2006
Printing plain text with exact positioning on Windows	18	Jan 4, 2010
Python plain-text database or library that supports joins?	5	Jun 22, 2007
Best way to convert html to plain text in java?	7	Mar 19, 2006
Perl CGI returning plain text HTML code	4	Mar 23, 2007
How could I convert plain UTF-8 XML to Outlook HTML format ?	1	Oct 14, 2010
HTML to Text renderer	0	Nov 2, 2004

HTML -> text/plain "clever" formatting

Gilles Lenfant

Karl Scalet

Gilles Lenfant

Michel Claveau/Hamster

Karl Scalet

John J. Lee

Karl Scalet

Ask a Question

Similar Threads

Members online

Forum statistics

Latest Threads