0003051: UTF-8 / ISO-8859-1 urlencoding issues.

Viewing Issue Simple Details [ Jump to Notes ]

[ View Advanced ] [ Issue History ] [ Print ]

Category

Severity

Reproducibility

Date Submitted

Last Update

0003051

[Resin]

major

always

11-07-08 02:46

03-25-09 15:37

Reporter

bjopet

View Status

public

Assigned To

ferg

Priority

normal

Resolution

fixed

Status

closed

Product Version

3.1.6

Summary

0003051: UTF-8 / ISO-8859-1 urlencoding issues.

Description

We use Apache 2.2.8 with mod_caucho and Resin Professional 3.1.6 (all 64-bit).

resin.conf has:
"<character-encoding>ISO-8859-1</character-encoding>" at <resin> tag.
and using non-ascii characters in URLS messes up URLencoding.

http://my.doma.in/Björn [^] should redirect to
http://my.doma.in/profile.do?alias=Björn [^]

But it does not work, and loggs a message to resin.log:
"The URL contains escaped bytes unsupported by the UTF-8 encoding."

From apache logfiles i can tell that the URL comes to resin from apache
as UTF-8, "Bj%C3%B6rn", but is not translated to "Bj%F6rn" as it should.
Requesting the URL: http://my.doma.in/profile.do?alias=Bj%F6rn [^] works as expected.

Talked to a developer who said the following:

This might be a bug in resin 3.1.6 (and 3.1.7a). I have checked the
modules/resin/src/com/caucho/server/connection/AbstractHttpResponse.java
file from resin source, and the code here will UTF-8 encode all
nonascii characters if the Content-Encoding flag is set (even if it's
set to ISO-8859-1).

Changing the environment and/or the character-encoding tag i resin.conf
does not change this behavior.

The problematic code is here:

for (int i = 0; i < path.length(); i++) {
char ch = path.charAt(i);

if (ch == '<')
cb.append("%3c");
else if (ch < 0x80)
cb.append(ch);
else if (_charEncoding == null) {
addHex(cb, ch);
}
else if (ch < 0x800) {
int d1 = 0xc0 + ((ch >> 6) & 0x1f);
int d2 = 0x80 + (ch & 0x3f);

addHex(cb, d1);
addHex(cb, d2);
}
else if (ch < 0x8000) {
int d1 = 0xe0 + ((ch >> 12) & 0xf);
int d2 = 0x80 + ((ch >> 6) & 0x3f);
int d3 = 0x80 + (ch & 0x3f);

addHex(cb, d1);
addHex(cb, d2);
addHex(cb, d3);
}
}

Additional Information

Attached Files

Relationships

Notes
(0003536) bjopet 11-07-08 02:48	related to http://bugs.caucho.com/view.php?id=3032 [^] ?

(0003930) ferg 03-25-09 15:37	server/0823

Issue History
Date Modified	Username	Field	Change
11-07-08 02:46	bjopet	New Issue
11-07-08 02:48	bjopet	Note Added: 0003536
03-25-09 15:37	ferg	Note Added: 0003930
03-25-09 15:37	ferg	Assigned To	=> ferg
03-25-09 15:37	ferg	Status	new => closed
03-25-09 15:37	ferg	Resolution	open => fixed
03-25-09 15:37	ferg	Fixed in Version	=> 4.0.0

Mantis 1.0.0rc3[^]

31 total queries executed.
27 unique queries executed.