URI class bug?

J

Jano Svitok

I am using Ruby 1.8.6. I found URI cannot parse URI with "_" is host.

uri = "http://dr_gabriele.podomatic.com/enclosure/
2006-08-03T15_09_59-07_00.m4v"
URI.parse(uri)

Is there any way to work around that?
thanks
Click to expand...

It seems underscores are not allowed in host part of an URI. So it's
not a bug. See RFC 2396 (URI), and 1035 (DNS). If you really want it,
you can open the class and redefine some of the methods and/or
manually edit URI sources.
 
M

Morgan Cheng

It seems underscores are not allowed in host part of an URI. So it's
not a bug. See RFC 2396 (URI), and 1035 (DNS). If you really want it,
you can open the class and redefine some of the methods and/or
manually edit URI sources.
Click to expand...


In RFC 2396, "_" is taken as "Unreserved Characters".
Unreserved characters can be escaped without changing the semantics
of the URI, but this should not be done unless the URI is being
used
in a context that does not allow the unescaped character to appear.

However, URI.escape doesn't escape "_".

require 'URI'
original_uri = "http://dr_gabriele.podomatic.com/enclosure/"
uri = URI.escape(original_uri)
puts uri == original_uri
 
J

Jano Svitok

In RFC 2396, "_" is taken as "Unreserved Characters".
Unreserved characters can be escaped without changing the semantics
of the URI, but this should not be done unless the URI is being
used
in a context that does not allow the unescaped character to appear.

However, URI.escape doesn't escape "_".

require 'URI'
original_uri = "http://dr_gabriele.podomatic.com/enclosure/"
uri = URI.escape(original_uri)
puts uri == original_uri
Click to expand...

I'm no expert on DNS, this is what I have found in appendix A:

host = hostname | IPv4address
hostname = *( domainlabel "." ) toplabel [ "." ]
domainlabel = alphanum | alphanum *( alphanum | "-" ) alphanum
toplabel = alpha | alpha *( alphanum | "-" ) alphanum
IPv4address = 1*digit "." 1*digit "." 1*digit "." 1*digit

alphanum = alpha | digit
alpha = lowalpha | upalpha

lowalpha = "a" | "b" | "c" | "d" | "e" | "f" | "g" | "h" | "i" |
"j" | "k" | "l" | "m" | "n" | "o" | "p" | "q" | "r" |
"s" | "t" | "u" | "v" | "w" | "x" | "y" | "z"
upalpha = "A" | "B" | "C" | "D" | "E" | "F" | "G" | "H" | "I" |
"J" | "K" | "L" | "M" | "N" | "O" | "P" | "Q" | "R" |
"S" | "T" | "U" | "V" | "W" | "X" | "Y" | "Z"
digit = "0" | "1" | "2" | "3" | "4" | "5" | "6" | "7" |
"8" | "9"

There's no "_" there. YMMV ;-)
 
M

Morgan Cheng

In RFC 2396, "_" is taken as "Unreserved Characters".
Unreserved characters can be escaped without changing the semantics
of the URI, but this should not be done unless the URI is being
used
in a context that does not allow the unescaped character to appear.
Click to expand...
However, URI.escape doesn't escape "_".
Click to expand...
require 'URI'
original_uri = "http://dr_gabriele.podomatic.com/enclosure/"
uri = URI.escape(original_uri)
puts uri == original_uri
Click to expand...

I'm no expert on DNS, this is what I have found in appendix A:

host = hostname | IPv4address
hostname = *( domainlabel "." ) toplabel [ "." ]
domainlabel = alphanum | alphanum *( alphanum | "-" ) alphanum
toplabel = alpha | alpha *( alphanum | "-" ) alphanum
IPv4address = 1*digit "." 1*digit "." 1*digit "." 1*digit

alphanum = alpha | digit
alpha = lowalpha | upalpha

lowalpha = "a" | "b" | "c" | "d" | "e" | "f" | "g" | "h" | "i" |
"j" | "k" | "l" | "m" | "n" | "o" | "p" | "q" | "r" |
"s" | "t" | "u" | "v" | "w" | "x" | "y" | "z"
upalpha = "A" | "B" | "C" | "D" | "E" | "F" | "G" | "H" | "I" |
"J" | "K" | "L" | "M" | "N" | "O" | "P" | "Q" | "R" |
"S" | "T" | "U" | "V" | "W" | "X" | "Y" | "Z"
digit = "0" | "1" | "2" | "3" | "4" | "5" | "6" | "7" |
"8" | "9"

There's no "_" there. YMMV ;-)
Click to expand...

Thanks a lot for your help.

I am just wandering, internet is a wild world. Wierd non-standard
stuff is all around. The non-standard host name is a example. Popular
browser can handle these URLs well.
Perhaps ruby should be more strong to survive better in such wild
world :)
 
A

Alex Young

Morgan said:
On Jun 5, 5:24 pm, "Jano Svitok" <[email protected]> wrote:

Thanks a lot for your help.

I am just wandering, internet is a wild world. Wierd non-standard
stuff is all around. The non-standard host name is a example. Popular
browser can handle these URLs well.
Perhaps ruby should be more strong to survive better in such wild
world :)
Click to expand...
There was mention a few days ago of bringing the URI class up to a more
recent RFC compliance (3986, I think). Would that help in this instance?
 
J

Jano Svitok

On 6/5/07, Morgan Cheng <[email protected]> wrote:
Click to expand...
I am using Ruby 1.8.6. I found URI cannot parse URI with "_" is host.
Click to expand...
uri = "http://dr_gabriele.podomatic.com/enclosure/
2006-08-03T15_09_59-07_00.m4v"
URI.parse(uri)
Click to expand...
Is there any way to work around that?
thanks
Click to expand...
It seems underscores are not allowed in host part of an URI. So it's
not a bug. See RFC 2396 (URI), and 1035 (DNS). If you really want it,
you can open the class and redefine some of the methods and/or
manually edit URI sources.
Click to expand...
In RFC 2396, "_" is taken as "Unreserved Characters".
Unreserved characters can be escaped without changing the semantics
of the URI, but this should not be done unless the URI is being
used
in a context that does not allow the unescaped character to appear.
Click to expand...
However, URI.escape doesn't escape "_".
Click to expand...
require 'URI'
original_uri = "http://dr_gabriele.podomatic.com/enclosure/"
uri = URI.escape(original_uri)
puts uri == original_uri
Click to expand...

I'm no expert on DNS, this is what I have found in appendix A:

host = hostname | IPv4address
hostname = *( domainlabel "." ) toplabel [ "." ]
domainlabel = alphanum | alphanum *( alphanum | "-" ) alphanum
toplabel = alpha | alpha *( alphanum | "-" ) alphanum
IPv4address = 1*digit "." 1*digit "." 1*digit "." 1*digit

alphanum = alpha | digit
alpha = lowalpha | upalpha

lowalpha = "a" | "b" | "c" | "d" | "e" | "f" | "g" | "h" | "i" |
"j" | "k" | "l" | "m" | "n" | "o" | "p" | "q" | "r" |
"s" | "t" | "u" | "v" | "w" | "x" | "y" | "z"
upalpha = "A" | "B" | "C" | "D" | "E" | "F" | "G" | "H" | "I" |
"J" | "K" | "L" | "M" | "N" | "O" | "P" | "Q" | "R" |
"S" | "T" | "U" | "V" | "W" | "X" | "Y" | "Z"
digit = "0" | "1" | "2" | "3" | "4" | "5" | "6" | "7" |
"8" | "9"

There's no "_" there. YMMV ;-)
Click to expand...

Thanks a lot for your help.

I am just wandering, internet is a wild world. Wierd non-standard
stuff is all around. The non-standard host name is a example. Popular
browser can handle these URLs well.
Perhaps ruby should be more strong to survive better in such wild
world :)
Click to expand...

If you want to really use underscores, modify lib/1.8/uri/common.rb:
add the following after line HOSTNAME=... and comment out (prefix with
#) the original HOSTNAME line.

ALPHA_ = "a-zA-Z_"
ALNUM_ = "#{ALPHA_}\\d"
DOMLABEL_ = "(?:[#{ALNUM_}](?:[-#{ALNUM_}]*[#{ALNUM_}])?)"
TOPLABEL_ = "(?:[#{ALPHA_}](?:[-#{ALNUM_}]*[#{ALNUM_}])?)"
HOSTNAME = "(?:#{DOMLABEL_}\\.)*#{TOPLABEL_}\\.?"

J.
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Similar Threads

open-uri bug 5
My http request is working but not doing it correctly 0
Found a ruby bug in the URI class, what do I do? 2
Found a ruby bug in the URI class, what do I do? 4
Need help to understand URI 2
[LONG] java.net.URI encoding weirdness 18
Does this URI.parse http:/ bug has been fixed in Ruby 1.9? 1
open-uri behaviour change 0

Members online

Total: 795 (members: 1, guests: 794)
Robots: 299

Forum statistics

Threads
474,260
Messages
2,571,308
Members
47,962
Latest member
BennettMol

Latest Threads

Top