You are viewing a plain text version of this content. The canonical link for it is here.
Posted to slide-user@jakarta.apache.org by Edmund Urbani <em...@liland.org> on 2005/09/13 18:20:40 UTC
non-ASCII chars in resource names (e.g. german umlauts)
hi!
whenever i try to store a file with german umlauts in the webdav
repository, i just get back some garbled filename from the slide server:
eg. "xxxäxxx" becomes "xxx�xx" (actually it's stored as "xxx?xx")
i've tried different clients (konqueror, webfolder, davexplorer). none
with any usable results.
the server is running on a linux system.
i tried different values for the LANG environment variable: no effect.
any ideas? settings? hints?
Edmund
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Hanan Herzog <ha...@mymcsb.com>.
This was my suspicion too, but I found that in my configuration (using
MySQL as store), Chinese characters show up fine in Cadaver and Firefox,
UNTIL I kill my tomcat and restart. After a restart, the Chinese
characters don't show up anymore. This casts my suspicion onto the
server-side.
After restart (Cadaver on Linux).
dav:/slide/files/> ls
Listing collection `/slide/files/': succeeded.
???? 0 Sep 19 18:01
????? 0 Sep 19 17:34
dav:/slide/files/> rm *
[Matching... 2 matches.]
Deleting `%3F%3F%3F%3F%3F': failed:
404 Not Found: No object found at /files/_____
Deleting `%3F%3F%3F%3F': failed:
404 Not Found: No object found at /files/____
Hanan
On Mon, 2005-09-19 at 11:42 +0200, Jacob Lund wrote:
> There are several issues with utf-8 and slide.
>
> The filestore and windows will only support utf-8 if you have the java
> runtime parameter -Dfile.encoding=UTF-8 set.
>
> Windows Explorer in windows 2000 does not support utf-8 by default. In you
> install the latest service pack for office XP then it might work. For
> details have a look at
> http://greenbytes.de/tech/webdav/webfolder-client-list.html
>
> /jacob
>
> ----- Original Message -----
> From: "Lixin Chu" <li...@gmail.com>
> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
> Sent: Monday, September 19, 2005 11:26 AM
> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>
>
> >I have no choice but have to ask again there - I know it had been discussed
> > very much in this forum, and I wen throught the threads but still can not
> > figure out how to support non-ascii file name.
> > Appreciate if someone could share the solution
> > here is my configuration:
> > - Slide 2.1 running on Windows 2000 SP4, Office XP installed
> > - Tomcat 5.5.7
> > - Slide using file store
> > - Copy and paste a file (file name with chinese characters) into Slide
> > from
> > Windows Explorer (I have created a web folder).
> > - The file name becomes unreadble.
> > I then tried in my web application also, traced to my client code:
> > webdavResource.putMethod (filename, filedata);
> > I can see that the filename is still in UTF-8 with correct chinese chars.
> > but after uploading this file and list the file in IE, it shows as
> > something
> > like this:
> > 一个人.jsp<http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp>
> > Other configurations:
> > - both my web application and slide's web.xml has configured:
> > <?xml version="1.0" encoding="UTF-8"?>
> > - slide domain.xml has:
> > <parameter name="encoding">UTF-8</parameter>
> > for the TxXMLFileDescriptorsStore
> > (no difference with or without this setting)
> > what else I need to configure ?
> > really appreciate your help !
> > lixin
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Hanan Herzog <ha...@mymcsb.com>.
Thanks for the tip. I will make sure about the Utf-8 settings tomorrow.
Regards,
Hanan
On Mon, 2005-09-19 at 12:21 +0200, Jacob Lund wrote:
> Make sure that you mysql db is set to utf-8/Unicode and the same for the
> jdbc driver.
>
> /jacob
>
> ----- Original Message -----
> From: "Hanan Herzog" <ha...@mymcsb.com>
> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
> Sent: Monday, September 19, 2005 12:11 PM
> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>
>
> > To add to my last message. In MY case it seems that the filenames are
> > not being preserved in the URI table in MySQL. They filenames are ok
> > while they are still in cache, but once I restart tomcat, the filenames
> > are read from the DB....
> >
> > Hanan
> >
> > On Mon, 2005-09-19 at 11:42 +0200, Jacob Lund wrote:
> >> There are several issues with utf-8 and slide.
> >>
> >> The filestore and windows will only support utf-8 if you have the java
> >> runtime parameter -Dfile.encoding=UTF-8 set.
> >>
> >> Windows Explorer in windows 2000 does not support utf-8 by default. In
> >> you
> >> install the latest service pack for office XP then it might work. For
> >> details have a look at
> >> http://greenbytes.de/tech/webdav/webfolder-client-list.html
> >>
> >> /jacob
> >>
> >> ----- Original Message -----
> >> From: "Lixin Chu" <li...@gmail.com>
> >> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
> >> Sent: Monday, September 19, 2005 11:26 AM
> >> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
> >>
> >>
> >> >I have no choice but have to ask again there - I know it had been
> >> >discussed
> >> > very much in this forum, and I wen throught the threads but still can
> >> > not
> >> > figure out how to support non-ascii file name.
> >> > Appreciate if someone could share the solution
> >> > here is my configuration:
> >> > - Slide 2.1 running on Windows 2000 SP4, Office XP installed
> >> > - Tomcat 5.5.7
> >> > - Slide using file store
> >> > - Copy and paste a file (file name with chinese characters) into Slide
> >> > from
> >> > Windows Explorer (I have created a web folder).
> >> > - The file name becomes unreadble.
> >> > I then tried in my web application also, traced to my client code:
> >> > webdavResource.putMethod (filename, filedata);
> >> > I can see that the filename is still in UTF-8 with correct chinese
> >> > chars.
> >> > but after uploading this file and list the file in IE, it shows as
> >> > something
> >> > like this:
> >> > 一个人.jsp<http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp>
> >> > Other configurations:
> >> > - both my web application and slide's web.xml has configured:
> >> > <?xml version="1.0" encoding="UTF-8"?>
> >> > - slide domain.xml has:
> >> > <parameter name="encoding">UTF-8</parameter>
> >> > for the TxXMLFileDescriptorsStore
> >> > (no difference with or without this setting)
> >> > what else I need to configure ?
> >> > really appreciate your help !
> >> > lixin
> >> >
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> >> For additional commands, e-mail: slide-user-help@jakarta.apache.org
> >>
> >>
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: slide-user-help@jakarta.apache.org
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Jacob Lund <jl...@qualiware.net>.
Make sure that you mysql db is set to utf-8/Unicode and the same for the
jdbc driver.
/jacob
----- Original Message -----
From: "Hanan Herzog" <ha...@mymcsb.com>
To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
Sent: Monday, September 19, 2005 12:11 PM
Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
> To add to my last message. In MY case it seems that the filenames are
> not being preserved in the URI table in MySQL. They filenames are ok
> while they are still in cache, but once I restart tomcat, the filenames
> are read from the DB....
>
> Hanan
>
> On Mon, 2005-09-19 at 11:42 +0200, Jacob Lund wrote:
>> There are several issues with utf-8 and slide.
>>
>> The filestore and windows will only support utf-8 if you have the java
>> runtime parameter -Dfile.encoding=UTF-8 set.
>>
>> Windows Explorer in windows 2000 does not support utf-8 by default. In
>> you
>> install the latest service pack for office XP then it might work. For
>> details have a look at
>> http://greenbytes.de/tech/webdav/webfolder-client-list.html
>>
>> /jacob
>>
>> ----- Original Message -----
>> From: "Lixin Chu" <li...@gmail.com>
>> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
>> Sent: Monday, September 19, 2005 11:26 AM
>> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>>
>>
>> >I have no choice but have to ask again there - I know it had been
>> >discussed
>> > very much in this forum, and I wen throught the threads but still can
>> > not
>> > figure out how to support non-ascii file name.
>> > Appreciate if someone could share the solution
>> > here is my configuration:
>> > - Slide 2.1 running on Windows 2000 SP4, Office XP installed
>> > - Tomcat 5.5.7
>> > - Slide using file store
>> > - Copy and paste a file (file name with chinese characters) into Slide
>> > from
>> > Windows Explorer (I have created a web folder).
>> > - The file name becomes unreadble.
>> > I then tried in my web application also, traced to my client code:
>> > webdavResource.putMethod (filename, filedata);
>> > I can see that the filename is still in UTF-8 with correct chinese
>> > chars.
>> > but after uploading this file and list the file in IE, it shows as
>> > something
>> > like this:
>> > 一个人.jsp<http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp>
>> > Other configurations:
>> > - both my web application and slide's web.xml has configured:
>> > <?xml version="1.0" encoding="UTF-8"?>
>> > - slide domain.xml has:
>> > <parameter name="encoding">UTF-8</parameter>
>> > for the TxXMLFileDescriptorsStore
>> > (no difference with or without this setting)
>> > what else I need to configure ?
>> > really appreciate your help !
>> > lixin
>> >
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>>
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Hanan Herzog <ha...@mymcsb.com>.
To add to my last message. In MY case it seems that the filenames are
not being preserved in the URI table in MySQL. They filenames are ok
while they are still in cache, but once I restart tomcat, the filenames
are read from the DB....
Hanan
On Mon, 2005-09-19 at 11:42 +0200, Jacob Lund wrote:
> There are several issues with utf-8 and slide.
>
> The filestore and windows will only support utf-8 if you have the java
> runtime parameter -Dfile.encoding=UTF-8 set.
>
> Windows Explorer in windows 2000 does not support utf-8 by default. In you
> install the latest service pack for office XP then it might work. For
> details have a look at
> http://greenbytes.de/tech/webdav/webfolder-client-list.html
>
> /jacob
>
> ----- Original Message -----
> From: "Lixin Chu" <li...@gmail.com>
> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
> Sent: Monday, September 19, 2005 11:26 AM
> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>
>
> >I have no choice but have to ask again there - I know it had been discussed
> > very much in this forum, and I wen throught the threads but still can not
> > figure out how to support non-ascii file name.
> > Appreciate if someone could share the solution
> > here is my configuration:
> > - Slide 2.1 running on Windows 2000 SP4, Office XP installed
> > - Tomcat 5.5.7
> > - Slide using file store
> > - Copy and paste a file (file name with chinese characters) into Slide
> > from
> > Windows Explorer (I have created a web folder).
> > - The file name becomes unreadble.
> > I then tried in my web application also, traced to my client code:
> > webdavResource.putMethod (filename, filedata);
> > I can see that the filename is still in UTF-8 with correct chinese chars.
> > but after uploading this file and list the file in IE, it shows as
> > something
> > like this:
> > 一个人.jsp<http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp>
> > Other configurations:
> > - both my web application and slide's web.xml has configured:
> > <?xml version="1.0" encoding="UTF-8"?>
> > - slide domain.xml has:
> > <parameter name="encoding">UTF-8</parameter>
> > for the TxXMLFileDescriptorsStore
> > (no difference with or without this setting)
> > what else I need to configure ?
> > really appreciate your help !
> > lixin
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Jacob Lund <jl...@qualiware.net>.
hi Carlos!
We have that same problem i europe. But that dll's in windows that handles
this encoding are updated when installing other microsoft components like
sharepoint portal server client or Microsoft Office. Therefor the default
Windows installation does not allways work with utf8 encoding but if I
intall microsoft office with latest service pack then the utf8 encoding
suddenly works.
These dll versions and problems are described here:
http://greenbytes.de/tech/webdav/webfolder-client-list.html
/jacob
----- Original Message -----
From: "Carlos Villegas" <ca...@uniscope.jp>
To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
Sent: Friday, September 23, 2005 5:43 PM
Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>I haven't read all the details but if the OS's locale is chinese, then
>Windows runs with a default double-byte character encoding, not UTF-8. File
>names from the file explorer will be sent URL encoded but in this
>double-byte code. Well, the problem is that WebFolders is not consistent
>and sometimes sends UTF-8 (because Slide responds in UTF-8) or the local
>encoding and there's no way to reliably detect which encoding Windows is
>sending. No matter what encoding you set the server to, it won't match all
>the time. Sometimes the xml header in a WebDAV request clearly specifies
>UTF-8, however the data itself is encoded in the local double-byte
>encoding! Well, I'm guessing here for chinese, but the same thing happens
>in Japanese, Slide doesn't work with Japanese Windows clients because of
>the above problem. If the local encoding is UTF-8 or UTF-8 compatible like
>in many European languages then you don't have these problems.
>
> Maybe this explains why.
>
> Carlos
>
>
> Jacob Lund wrote:
>> I do not think it is a OS problem either - it was just to check if slide
>> stored the files correctly.
>>
>> The only difference between you store configuration and mine it that I
>> have not defined any encoding for the store.
>>
>> I am not really sure what is going on. Try to use the TcpTrace program
>> from http://www.pocketsoap.com/tcpTrace/ and upload a new file to the
>> slide server - and use a file with these special character in it. The
>> post the PUT header to this list.
>>
>> Uploading a file called ü.txt from a webfolder should result in a header
>> looking something like this:
>>
>> PUT /files/%C3%BC.txt HTTP/1.1
>> Content-Language: en-us
>> Accept-Language: da, en-us;q=0.2
>> Translate: f
>> Content-Length: 0
>> User-Agent: Microsoft Data Access Internet Publishing Provider DAV
>> Host: localhost:82
>> Connection: Keep-Alive
>> Cookie: JSESSIONID=0E24829787E0D184357F1653ADB8094A
>> Authorization: Basic cm9vdDpyb290
>>
>> /jacob
>>
>> ----- Original Message ----- From: "Lixin Chu" <li...@gmail.com>
>> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
>> Sent: Wednesday, September 21, 2005 3:03 AM
>> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>>
>>
>> I think it is not the OS problem: when I copy and paste a file (filename
>> with chinese chars) directly into slide store folder, Explorer shows
>> correct
>> string.
>> I suspect that it is slide configuration problem but have no idea where.
>> Here is partial Domain.xml, thanks for helping !
>> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>> <store name="tx">
>> <parameter name="tlock-timeout">120</parameter>
>> <nodestore classname="
>> org.apache.slide.store.txfile.TxXMLFileDescriptorsStore">
>> <parameter name="rootpath">store/metadata</parameter>
>> <parameter name="workpath">work/metadata</parameter>
>> <parameter name="defer-saving">true</parameter>
>> <parameter name="timeout">120</parameter>
>> <parameter name="encoding">UTF-8</parameter>
>> </nodestore>
>> <sequencestore
>> classname="org.apache.slide.store.txfile.FileSequenceStore">
>> <parameter name="rootpath">store/sequence</parameter>
>> </sequencestore>
>> <securitystore>
>> <reference store="nodestore"/>
>> </securitystore>
>> <lockstore>
>> <reference store="nodestore"/>
>> </lockstore>
>> <revisiondescriptorsstore>
>> <reference store="nodestore"/>
>> </revisiondescriptorsstore>
>> <revisiondescriptorstore>
>> <reference store="nodestore"/>
>> </revisiondescriptorstore>
>> <contentstore
>> classname="org.apache.slide.store.txfile.TxFileContentStore">
>> <parameter name="rootpath">store/content</parameter>
>> <parameter name="workpath">work/content</parameter>
>> <parameter name="defer-saving">true</parameter>
>> <parameter name="timeout">120</parameter>
>> </contentstore>
>> </store>
>> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>>
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Carlos Villegas <ca...@uniscope.jp>.
I haven't read all the details but if the OS's locale is chinese, then
Windows runs with a default double-byte character encoding, not UTF-8.
File names from the file explorer will be sent URL encoded but in this
double-byte code. Well, the problem is that WebFolders is not consistent
and sometimes sends UTF-8 (because Slide responds in UTF-8) or the local
encoding and there's no way to reliably detect which encoding Windows is
sending. No matter what encoding you set the server to, it won't match
all the time. Sometimes the xml header in a WebDAV request clearly
specifies UTF-8, however the data itself is encoded in the local
double-byte encoding! Well, I'm guessing here for chinese, but the same
thing happens in Japanese, Slide doesn't work with Japanese Windows
clients because of the above problem. If the local encoding is UTF-8 or
UTF-8 compatible like in many European languages then you don't have
these problems.
Maybe this explains why.
Carlos
Jacob Lund wrote:
> I do not think it is a OS problem either - it was just to check if slide
> stored the files correctly.
>
> The only difference between you store configuration and mine it that I
> have not defined any encoding for the store.
>
> I am not really sure what is going on. Try to use the TcpTrace program
> from http://www.pocketsoap.com/tcpTrace/ and upload a new file to the
> slide server - and use a file with these special character in it. The
> post the PUT header to this list.
>
> Uploading a file called ü.txt from a webfolder should result in a header
> looking something like this:
>
> PUT /files/%C3%BC.txt HTTP/1.1
> Content-Language: en-us
> Accept-Language: da, en-us;q=0.2
> Translate: f
> Content-Length: 0
> User-Agent: Microsoft Data Access Internet Publishing Provider DAV
> Host: localhost:82
> Connection: Keep-Alive
> Cookie: JSESSIONID=0E24829787E0D184357F1653ADB8094A
> Authorization: Basic cm9vdDpyb290
>
> /jacob
>
> ----- Original Message ----- From: "Lixin Chu" <li...@gmail.com>
> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
> Sent: Wednesday, September 21, 2005 3:03 AM
> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>
>
> I think it is not the OS problem: when I copy and paste a file (filename
> with chinese chars) directly into slide store folder, Explorer shows
> correct
> string.
> I suspect that it is slide configuration problem but have no idea where.
> Here is partial Domain.xml, thanks for helping !
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> <store name="tx">
> <parameter name="tlock-timeout">120</parameter>
> <nodestore classname="
> org.apache.slide.store.txfile.TxXMLFileDescriptorsStore">
> <parameter name="rootpath">store/metadata</parameter>
> <parameter name="workpath">work/metadata</parameter>
> <parameter name="defer-saving">true</parameter>
> <parameter name="timeout">120</parameter>
> <parameter name="encoding">UTF-8</parameter>
> </nodestore>
> <sequencestore classname="org.apache.slide.store.txfile.FileSequenceStore">
> <parameter name="rootpath">store/sequence</parameter>
> </sequencestore>
> <securitystore>
> <reference store="nodestore"/>
> </securitystore>
> <lockstore>
> <reference store="nodestore"/>
> </lockstore>
> <revisiondescriptorsstore>
> <reference store="nodestore"/>
> </revisiondescriptorsstore>
> <revisiondescriptorstore>
> <reference store="nodestore"/>
> </revisiondescriptorstore>
> <contentstore classname="org.apache.slide.store.txfile.TxFileContentStore">
> <parameter name="rootpath">store/content</parameter>
> <parameter name="workpath">work/content</parameter>
> <parameter name="defer-saving">true</parameter>
> <parameter name="timeout">120</parameter>
> </contentstore>
> </store>
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Jacob Lund <jl...@qualiware.net>.
I do not think it is a OS problem either - it was just to check if slide
stored the files correctly.
The only difference between you store configuration and mine it that I have
not defined any encoding for the store.
I am not really sure what is going on. Try to use the TcpTrace program from
http://www.pocketsoap.com/tcpTrace/ and upload a new file to the slide
server - and use a file with these special character in it. The post the PUT
header to this list.
Uploading a file called ü.txt from a webfolder should result in a header
looking something like this:
PUT /files/%C3%BC.txt HTTP/1.1
Content-Language: en-us
Accept-Language: da, en-us;q=0.2
Translate: f
Content-Length: 0
User-Agent: Microsoft Data Access Internet Publishing Provider DAV
Host: localhost:82
Connection: Keep-Alive
Cookie: JSESSIONID=0E24829787E0D184357F1653ADB8094A
Authorization: Basic cm9vdDpyb290
/jacob
----- Original Message -----
From: "Lixin Chu" <li...@gmail.com>
To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
Sent: Wednesday, September 21, 2005 3:03 AM
Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
I think it is not the OS problem: when I copy and paste a file (filename
with chinese chars) directly into slide store folder, Explorer shows correct
string.
I suspect that it is slide configuration problem but have no idea where.
Here is partial Domain.xml, thanks for helping !
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<store name="tx">
<parameter name="tlock-timeout">120</parameter>
<nodestore classname="
org.apache.slide.store.txfile.TxXMLFileDescriptorsStore">
<parameter name="rootpath">store/metadata</parameter>
<parameter name="workpath">work/metadata</parameter>
<parameter name="defer-saving">true</parameter>
<parameter name="timeout">120</parameter>
<parameter name="encoding">UTF-8</parameter>
</nodestore>
<sequencestore classname="org.apache.slide.store.txfile.FileSequenceStore">
<parameter name="rootpath">store/sequence</parameter>
</sequencestore>
<securitystore>
<reference store="nodestore"/>
</securitystore>
<lockstore>
<reference store="nodestore"/>
</lockstore>
<revisiondescriptorsstore>
<reference store="nodestore"/>
</revisiondescriptorsstore>
<revisiondescriptorstore>
<reference store="nodestore"/>
</revisiondescriptorstore>
<contentstore classname="org.apache.slide.store.txfile.TxFileContentStore">
<parameter name="rootpath">store/content</parameter>
<parameter name="workpath">work/content</parameter>
<parameter name="defer-saving">true</parameter>
<parameter name="timeout">120</parameter>
</contentstore>
</store>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Lixin Chu <li...@gmail.com>.
I think it is not the OS problem: when I copy and paste a file (filename
with chinese chars) directly into slide store folder, Explorer shows correct
string.
I suspect that it is slide configuration problem but have no idea where.
Here is partial Domain.xml, thanks for helping !
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<store name="tx">
<parameter name="tlock-timeout">120</parameter>
<nodestore classname="
org.apache.slide.store.txfile.TxXMLFileDescriptorsStore">
<parameter name="rootpath">store/metadata</parameter>
<parameter name="workpath">work/metadata</parameter>
<parameter name="defer-saving">true</parameter>
<parameter name="timeout">120</parameter>
<parameter name="encoding">UTF-8</parameter>
</nodestore>
<sequencestore classname="org.apache.slide.store.txfile.FileSequenceStore">
<parameter name="rootpath">store/sequence</parameter>
</sequencestore>
<securitystore>
<reference store="nodestore"/>
</securitystore>
<lockstore>
<reference store="nodestore"/>
</lockstore>
<revisiondescriptorsstore>
<reference store="nodestore"/>
</revisiondescriptorsstore>
<revisiondescriptorstore>
<reference store="nodestore"/>
</revisiondescriptorstore>
<contentstore classname="org.apache.slide.store.txfile.TxFileContentStore">
<parameter name="rootpath">store/content</parameter>
<parameter name="workpath">work/content</parameter>
<parameter name="defer-saving">true</parameter>
<parameter name="timeout">120</parameter>
</contentstore>
</store>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Jacob Lund <jl...@qualiware.net>.
Here is a small test.
Upload a file to your slide server with a special character in it like the
german ü.
Now use your windows explorer to browse the filestore directly on you
harddrive (not through webfolders). Does the letter show up as a ü or
something else?
Another thing - I have never tested with TC 5.5 only TC 5. Do you have any
special parameters in the domain.xml with respect to the configuration of
the filestore?
/jacob
----- Original Message -----
From: "Lixin Chu" <li...@gmail.com>
To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
Sent: Tuesday, September 20, 2005 3:47 AM
Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
> thanks. just tried.
> * my MSDAIPP.DLL's version is 11.0.5510.0 (sharePoint Portal Server)
> is it ok ? The web page says it has displayname-1 and displayname-2 issue.
> hope it is fine.
> * added the option in the Tomcat startup
> In tomcat monitor, under Java tab, added this option into 'Java Options'
> box.
> however, the result is still the same. Not sure if what I did is correct.
> On 9/19/05, Jacob Lund <jl...@qualiware.net> wrote:
>>
>> There are several issues with utf-8 and slide.
>>
>> The filestore and windows will only support utf-8 if you have the java
>> runtime parameter -Dfile.encoding=UTF-8 set.
>>
>> Windows Explorer in windows 2000 does not support utf-8 by default. In
>> you
>> install the latest service pack for office XP then it might work. For
>> details have a look at
>> http://greenbytes.de/tech/webdav/webfolder-client-list.html
>>
>> /jacob
>>
>> ----- Original Message -----
>> From: "Lixin Chu" <li...@gmail.com>
>> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
>> Sent: Monday, September 19, 2005 11:26 AM
>> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>>
>>
>> >I have no choice but have to ask again there - I know it had been
>> discussed
>> > very much in this forum, and I wen throught the threads but still can
>> not
>> > figure out how to support non-ascii file name.
>> > Appreciate if someone could share the solution
>> > here is my configuration:
>> > - Slide 2.1 running on Windows 2000 SP4, Office XP installed
>> > - Tomcat 5.5.7
>> > - Slide using file store
>> > - Copy and paste a file (file name with chinese characters) into Slide
>> > from
>> > Windows Explorer (I have created a web folder).
>> > - The file name becomes unreadble.
>> > I then tried in my web application also, traced to my client code:
>> > webdavResource.putMethod (filename, filedata);
>> > I can see that the filename is still in UTF-8 with correct chinese
>> chars.
>> > but after uploading this file and list the file in IE, it shows as
>> > something
>> > like this:
>> > 一个人.jsp<
>> http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp
>> >
>> > Other configurations:
>> > - both my web application and slide's web.xml has configured:
>> > <?xml version="1.0" encoding="UTF-8"?>
>> > - slide domain.xml has:
>> > <parameter name="encoding">UTF-8</parameter>
>> > for the TxXMLFileDescriptorsStore
>> > (no difference with or without this setting)
>> > what else I need to configure ?
>> > really appreciate your help !
>> > lixin
>> >
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Lixin Chu <li...@gmail.com>.
thanks. just tried.
* my MSDAIPP.DLL's version is 11.0.5510.0 (sharePoint Portal Server)
is it ok ? The web page says it has displayname-1 and displayname-2 issue.
hope it is fine.
* added the option in the Tomcat startup
In tomcat monitor, under Java tab, added this option into 'Java Options'
box.
however, the result is still the same. Not sure if what I did is correct.
On 9/19/05, Jacob Lund <jl...@qualiware.net> wrote:
>
> There are several issues with utf-8 and slide.
>
> The filestore and windows will only support utf-8 if you have the java
> runtime parameter -Dfile.encoding=UTF-8 set.
>
> Windows Explorer in windows 2000 does not support utf-8 by default. In you
> install the latest service pack for office XP then it might work. For
> details have a look at
> http://greenbytes.de/tech/webdav/webfolder-client-list.html
>
> /jacob
>
> ----- Original Message -----
> From: "Lixin Chu" <li...@gmail.com>
> To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
> Sent: Monday, September 19, 2005 11:26 AM
> Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>
>
> >I have no choice but have to ask again there - I know it had been
> discussed
> > very much in this forum, and I wen throught the threads but still can
> not
> > figure out how to support non-ascii file name.
> > Appreciate if someone could share the solution
> > here is my configuration:
> > - Slide 2.1 running on Windows 2000 SP4, Office XP installed
> > - Tomcat 5.5.7
> > - Slide using file store
> > - Copy and paste a file (file name with chinese characters) into Slide
> > from
> > Windows Explorer (I have created a web folder).
> > - The file name becomes unreadble.
> > I then tried in my web application also, traced to my client code:
> > webdavResource.putMethod (filename, filedata);
> > I can see that the filename is still in UTF-8 with correct chinese
> chars.
> > but after uploading this file and list the file in IE, it shows as
> > something
> > like this:
> > 一个人.jsp<
> http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp
> >
> > Other configurations:
> > - both my web application and slide's web.xml has configured:
> > <?xml version="1.0" encoding="UTF-8"?>
> > - slide domain.xml has:
> > <parameter name="encoding">UTF-8</parameter>
> > for the TxXMLFileDescriptorsStore
> > (no difference with or without this setting)
> > what else I need to configure ?
> > really appreciate your help !
> > lixin
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>
>
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Jacob Lund <jl...@qualiware.net>.
There are several issues with utf-8 and slide.
The filestore and windows will only support utf-8 if you have the java
runtime parameter -Dfile.encoding=UTF-8 set.
Windows Explorer in windows 2000 does not support utf-8 by default. In you
install the latest service pack for office XP then it might work. For
details have a look at
http://greenbytes.de/tech/webdav/webfolder-client-list.html
/jacob
----- Original Message -----
From: "Lixin Chu" <li...@gmail.com>
To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
Sent: Monday, September 19, 2005 11:26 AM
Subject: Re: non-ASCII chars in resource names (e.g. german umlauts)
>I have no choice but have to ask again there - I know it had been discussed
> very much in this forum, and I wen throught the threads but still can not
> figure out how to support non-ascii file name.
> Appreciate if someone could share the solution
> here is my configuration:
> - Slide 2.1 running on Windows 2000 SP4, Office XP installed
> - Tomcat 5.5.7
> - Slide using file store
> - Copy and paste a file (file name with chinese characters) into Slide
> from
> Windows Explorer (I have created a web folder).
> - The file name becomes unreadble.
> I then tried in my web application also, traced to my client code:
> webdavResource.putMethod (filename, filedata);
> I can see that the filename is still in UTF-8 with correct chinese chars.
> but after uploading this file and list the file in IE, it shows as
> something
> like this:
> 一个人.jsp<http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp>
> Other configurations:
> - both my web application and slide's web.xml has configured:
> <?xml version="1.0" encoding="UTF-8"?>
> - slide domain.xml has:
> <parameter name="encoding">UTF-8</parameter>
> for the TxXMLFileDescriptorsStore
> (no difference with or without this setting)
> what else I need to configure ?
> really appreciate your help !
> lixin
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Hanan Herzog <ha...@mymcsb.com>.
I am using a different configuration, but for whatever it's worth, I
have no problem saving and retrieving Chinese-character-named files. My
files are being stored on a MySQL store. I am using Cadaver
(command-line Webdav client) to upload files. Both Cadaver and Firefox
display the correct filename.
Did you try looking at the filename with a browser other than IE? Maybe
Firefox? Your problem may not be rooted in Slide, but how your browser
is decoding characters.
Hanan
On Mon, 2005-09-19 at 17:26 +0800, Lixin Chu wrote:
> I have no choice but have to ask again there - I know it had been discussed
> very much in this forum, and I wen throught the threads but still can not
> figure out how to support non-ascii file name.
> Appreciate if someone could share the solution
> here is my configuration:
> - Slide 2.1 running on Windows 2000 SP4, Office XP installed
> - Tomcat 5.5.7
> - Slide using file store
> - Copy and paste a file (file name with chinese characters) into Slide from
> Windows Explorer (I have created a web folder).
> - The file name becomes unreadble.
> I then tried in my web application also, traced to my client code:
> webdavResource.putMethod (filename, filedata);
> I can see that the filename is still in UTF-8 with correct chinese chars.
> but after uploading this file and list the file in IE, it shows as something
> like this:
> 一个人.jsp<http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp>
> Other configurations:
> - both my web application and slide's web.xml has configured:
> <?xml version="1.0" encoding="UTF-8"?>
> - slide domain.xml has:
> <parameter name="encoding">UTF-8</parameter>
> for the TxXMLFileDescriptorsStore
> (no difference with or without this setting)
> what else I need to configure ?
> really appreciate your help !
> lixin
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Lixin Chu <li...@gmail.com>.
I have no choice but have to ask again there - I know it had been discussed
very much in this forum, and I wen throught the threads but still can not
figure out how to support non-ascii file name.
Appreciate if someone could share the solution
here is my configuration:
- Slide 2.1 running on Windows 2000 SP4, Office XP installed
- Tomcat 5.5.7
- Slide using file store
- Copy and paste a file (file name with chinese characters) into Slide from
Windows Explorer (I have created a web folder).
- The file name becomes unreadble.
I then tried in my web application also, traced to my client code:
webdavResource.putMethod (filename, filedata);
I can see that the filename is still in UTF-8 with correct chinese chars.
but after uploading this file and list the file in IE, it shows as something
like this:
一个人.jsp<http://localhost:8080/slide/files/Canal.net/pp/%C3%A4%C2%B8%C2%80%C3%A4%C2%B8%C2%AA%C3%A4%C2%BA%C2%BA.jsp>
Other configurations:
- both my web application and slide's web.xml has configured:
<?xml version="1.0" encoding="UTF-8"?>
- slide domain.xml has:
<parameter name="encoding">UTF-8</parameter>
for the TxXMLFileDescriptorsStore
(no difference with or without this setting)
what else I need to configure ?
really appreciate your help !
lixin
Re: non-ASCII chars in resource names (e.g. german umlauts)
Posted by Jacob Lund <jl...@qualiware.net>.
You seem to have an encoding issue.
Make sure that your slide server encoding is the same as the clients.
DAVExplorer uses the local client encoding and webfolders depends on the
windows/office version when it comes to encoding (sometimes it uses the
client encoding and sometimes it uses utf-8).
In general it is recommendable to use utf-8 encoding for compatibility
reasons.
I recommend that you search through the slide mailing lists and search for
encoding. There has been a lot of communication about this issue.
/jacob
----- Original Message -----
From: "Edmund Urbani" <em...@liland.org>
To: "Slide Users Mailing List" <sl...@jakarta.apache.org>
Sent: Tuesday, September 13, 2005 6:20 PM
Subject: non-ASCII chars in resource names (e.g. german umlauts)
>
> hi!
>
> whenever i try to store a file with german umlauts in the webdav
> repository, i just get back some garbled filename from the slide server:
> eg. "xxxäxxx" becomes "xxx�xx" (actually it's stored as "xxx?xx")
> i've tried different clients (konqueror, webfolder, davexplorer). none
> with any usable results.
>
> the server is running on a linux system.
> i tried different values for the LANG environment variable: no effect.
>
> any ideas? settings? hints?
>
> Edmund
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-user-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-user-help@jakarta.apache.org