You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by "Jens M. Kofoed" <jm...@gmail.com> on 2021/02/23 07:02:02 UTC

Issue with GetFTP and arabic letters?

Dear community

I have an issue which I hope some of you might be able to help me with or
point me in the right direction.
We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect with
FileZilla I have no problems with uploading and downloading files with
Arabic letters in the filename.
But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
filenames as ???? instead of the Arabic letters, and is not able to get the
file since that filename does not exist. The GetFTP process is also
configured with utf-8 enabled.
The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi server
to the FTP server I see the same behavior, Arabic letters is showing as ???

But since FileZilla can see Arabic letters correctly, I can't see that the
issue is at the FTP server.
So please help

Kind regards
Jens M. Kofoed

Re: Issue with GetFTP and arabic letters?

Posted by "Jens M. Kofoed" <jm...@gmail.com>.
Sound really good. 
Many thanks 🙏 

Kind regards 
Jens 

> Den 23. feb. 2021 kl. 13.42 skrev Pierre Villard <pi...@gmail.com>:
> 
> Submitted a pull request and confirmed it worked with arabic characters against a public server I was able to test GFF -> PutFTP as well as ListFTP -> FetchFTP.
> We may have a 1.13.1 release coming soon so it would likely be included.
> 
> Thanks,
> Pierre
> 
>> Le mar. 23 févr. 2021 à 15:30, Jens M. Kofoed <jm...@gmail.com> a écrit :
>> Jira bug created: https://issues.apache.org/jira/browse/NIFI-8220
>> 
>> kind regards
>> Jens M. Kofoed
>> 
>>> Den tir. 23. feb. 2021 kl. 12.28 skrev Jens M. Kofoed <jm...@gmail.com>:
>>> no problem,
>>> 
>>> By the way I just tried PutFTP and it also have some issue.
>>> I created a flowfile, used an UpdateAttribute to set the filename to:  امتحان.txt   used a PutFTP (with utf8 enabled) and the filename at the ftp server become: امتحان.txt
>>> 
>>>> Den tir. 23. feb. 2021 kl. 12.20 skrev Pierre Villard <pi...@gmail.com>:
>>>> Do you mind filing a JIRA? I had a quick look and the fix should be fairly straightforward. Will give it a try to confirm.
>>>> 
>>>> Thanks,
>>>> Pierre
>>>> 
>>>>> Le mar. 23 févr. 2021 à 15:09, Jens M. Kofoed <jm...@gmail.com> a écrit :
>>>>> Hi
>>>>> 
>>>>> I have now tried with NiFi version 1.13.0, and there are still issues with non-English characters.
>>>>> The ListFTP process does not have an attribute "Use UTF-8 Encoding" but FetchFTP has.
>>>>> I have created a file with this filename: امتحان.txt
>>>>> ListFTP list the filename as: ??????.txt which does not exist and therefore FetchFTP fails.
>>>>> 
>>>>> I tried to use an UpdateAttribute process to change the filename into  امتحان.txt but FetchFTP give my an error again
>>>>> FetchFTP[id=ce85ca8e-0177-1000-ffff-ffff95e1e5f7] Failed to fetch content for StandardFlowFileRecord[uuid=823c600d-c7fa-406e-ae66-b1ac70f5e212,claim=,offset=0,name=امتحان.txt,size=0] from filename FTP/امتحان.txt on remote host 192.168.1.2:21 due to java.io.IOException: 550 The system cannot find the file specified. 
>>>>> ; routing to comms.failure: java.io.IOException: 550 The system cannot find the file specified.
>>>>> 
>>>>> Kind regards
>>>>> Jens
>>>>> 
>>>>>> Den tir. 23. feb. 2021 kl. 09.14 skrev Pierre Villard <pi...@gmail.com>:
>>>>>> Let us know if this still doesn't work, we will definitely want to look into it!
>>>>>> 
>>>>>>> Le mar. 23 févr. 2021 à 11:47, Jens M. Kofoed <jm...@gmail.com> a écrit :
>>>>>>> Hi Pierre
>>>>>>> 
>>>>>>> Many thanks, I will definitely try the new version 1.13.0. I have already tried the List+Fetch processers in 1.12.1. And these 2 processors can take some non-English characters like Danish and Swedish character which GetFTP can't. But they still can't read my Arabic characters.
>>>>>>> I will try 1.13.0
>>>>>>> 
>>>>>>> Thanks,
>>>>>>> Jens  
>>>>>>> 
>>>>>>>> Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <pi...@gmail.com>:
>>>>>>>> Hi Jens,
>>>>>>>> 
>>>>>>>> You may want to try NiFi 1.13.0 with List+Fetch processors. The addition of https://issues.apache.org/jira/browse/NIFI-7685 may help. Worth a try at least.
>>>>>>>> 
>>>>>>>> Thanks,
>>>>>>>> Pierre
>>>>>>>> 
>>>>>>>>> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <jm...@gmail.com> a écrit :
>>>>>>>>> Dear community
>>>>>>>>> 
>>>>>>>>> I have an issue which I hope some of you might be able to help me with or point me in the right direction.
>>>>>>>>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect with FileZilla I have no problems with uploading and downloading files with Arabic letters in the filename.
>>>>>>>>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the filenames as ???? instead of the Arabic letters, and is not able to get the file since that filename does not exist. The GetFTP process is also configured with utf-8 enabled.
>>>>>>>>> The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi server to the FTP server I see the same behavior, Arabic letters is showing as ???
>>>>>>>>> 
>>>>>>>>> But since FileZilla can see Arabic letters correctly, I can't see that the issue is at the FTP server.
>>>>>>>>> So please help
>>>>>>>>> 
>>>>>>>>> Kind regards
>>>>>>>>> Jens M. Kofoed
>>>>>>>>> 

Re: Issue with GetFTP and arabic letters?

Posted by Pierre Villard <pi...@gmail.com>.
Submitted a pull request and confirmed it worked with arabic characters
against a public server I was able to test GFF -> PutFTP as well as ListFTP
-> FetchFTP.
We may have a 1.13.1 release coming soon so it would likely be included.

Thanks,
Pierre

Le mar. 23 févr. 2021 à 15:30, Jens M. Kofoed <jm...@gmail.com> a
écrit :

> Jira bug created: https://issues.apache.org/jira/browse/NIFI-8220
>
> kind regards
> Jens M. Kofoed
>
> Den tir. 23. feb. 2021 kl. 12.28 skrev Jens M. Kofoed <
> jmkofoed.ube@gmail.com>:
>
>> no problem,
>>
>> By the way I just tried PutFTP and it also have some issue.
>> I created a flowfile, used an UpdateAttribute to set the filename to:
>> امتحان.txt   used a PutFTP (with utf8 enabled) and the filename at the ftp
>> server become: امتحان.txt
>>
>> Den tir. 23. feb. 2021 kl. 12.20 skrev Pierre Villard <
>> pierre.villard.fr@gmail.com>:
>>
>>> Do you mind filing a JIRA? I had a quick look and the fix should be
>>> fairly straightforward. Will give it a try to confirm.
>>>
>>> Thanks,
>>> Pierre
>>>
>>> Le mar. 23 févr. 2021 à 15:09, Jens M. Kofoed <jm...@gmail.com>
>>> a écrit :
>>>
>>>> Hi
>>>>
>>>> I have now tried with NiFi version 1.13.0, and there are still issues
>>>> with non-English characters.
>>>> The ListFTP process does not have an attribute "Use UTF-8 Encoding" but
>>>> FetchFTP has.
>>>> I have created a file with this filename: امتحان.txt
>>>> ListFTP list the filename as: ??????.txt which does not exist and
>>>> therefore FetchFTP fails.
>>>>
>>>> I tried to use an UpdateAttribute process to change the filename into
>>>> امتحان.txt but FetchFTP give my an error again
>>>>
>>>> FetchFTP[id=ce85ca8e-0177-1000-ffff-ffff95e1e5f7] Failed to fetch content for StandardFlowFileRecord[uuid=823c600d-c7fa-406e-ae66-b1ac70f5e212,claim=,offset=0,name=امتحان.txt,size=0] from filename FTP/امتحان.txt on remote host 192.168.1.2:21 due to java.io.IOException: 550 The system cannot find the file specified.
>>>> ; routing to comms.failure: java.io.IOException: 550 The system cannot find the file specified.
>>>>
>>>>
>>>> Kind regards
>>>> Jens
>>>>
>>>> Den tir. 23. feb. 2021 kl. 09.14 skrev Pierre Villard <
>>>> pierre.villard.fr@gmail.com>:
>>>>
>>>>> Let us know if this still doesn't work, we will definitely want to
>>>>> look into it!
>>>>>
>>>>> Le mar. 23 févr. 2021 à 11:47, Jens M. Kofoed <jm...@gmail.com>
>>>>> a écrit :
>>>>>
>>>>>> Hi Pierre
>>>>>>
>>>>>> Many thanks, I will definitely try the new version 1.13.0. I have
>>>>>> already tried the List+Fetch processers in 1.12.1. And these 2 processors
>>>>>> can take some non-English characters like Danish and Swedish character
>>>>>> which GetFTP can't. But they still can't read my Arabic characters.
>>>>>> I will try 1.13.0
>>>>>>
>>>>>> Thanks,
>>>>>> Jens
>>>>>>
>>>>>> Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <
>>>>>> pierre.villard.fr@gmail.com>:
>>>>>>
>>>>>>> Hi Jens,
>>>>>>>
>>>>>>> You may want to try NiFi 1.13.0 with List+Fetch processors. The
>>>>>>> addition of https://issues.apache.org/jira/browse/NIFI-7685 may
>>>>>>> help. Worth a try at least.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Pierre
>>>>>>>
>>>>>>> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <
>>>>>>> jmkofoed.ube@gmail.com> a écrit :
>>>>>>>
>>>>>>>> Dear community
>>>>>>>>
>>>>>>>> I have an issue which I hope some of you might be able to help me
>>>>>>>> with or point me in the right direction.
>>>>>>>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I
>>>>>>>> connect with FileZilla I have no problems with uploading and downloading
>>>>>>>> files with Arabic letters in the filename.
>>>>>>>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
>>>>>>>> filenames as ???? instead of the Arabic letters, and is not able to get the
>>>>>>>> file since that filename does not exist. The GetFTP process is also
>>>>>>>> configured with utf-8 enabled.
>>>>>>>> The NiFi server is using Ubuntu 18.04 and if I connect from the
>>>>>>>> NiFi server to the FTP server I see the same behavior, Arabic letters is
>>>>>>>> showing as ???
>>>>>>>>
>>>>>>>> But since FileZilla can see Arabic letters correctly, I can't see
>>>>>>>> that the issue is at the FTP server.
>>>>>>>> So please help
>>>>>>>>
>>>>>>>> Kind regards
>>>>>>>> Jens M. Kofoed
>>>>>>>>
>>>>>>>>

Re: Issue with GetFTP and arabic letters?

Posted by "Jens M. Kofoed" <jm...@gmail.com>.
Jira bug created: https://issues.apache.org/jira/browse/NIFI-8220

kind regards
Jens M. Kofoed

Den tir. 23. feb. 2021 kl. 12.28 skrev Jens M. Kofoed <
jmkofoed.ube@gmail.com>:

> no problem,
>
> By the way I just tried PutFTP and it also have some issue.
> I created a flowfile, used an UpdateAttribute to set the filename to:
> امتحان.txt   used a PutFTP (with utf8 enabled) and the filename at the ftp
> server become: امتحان.txt
>
> Den tir. 23. feb. 2021 kl. 12.20 skrev Pierre Villard <
> pierre.villard.fr@gmail.com>:
>
>> Do you mind filing a JIRA? I had a quick look and the fix should be
>> fairly straightforward. Will give it a try to confirm.
>>
>> Thanks,
>> Pierre
>>
>> Le mar. 23 févr. 2021 à 15:09, Jens M. Kofoed <jm...@gmail.com> a
>> écrit :
>>
>>> Hi
>>>
>>> I have now tried with NiFi version 1.13.0, and there are still issues
>>> with non-English characters.
>>> The ListFTP process does not have an attribute "Use UTF-8 Encoding" but
>>> FetchFTP has.
>>> I have created a file with this filename: امتحان.txt
>>> ListFTP list the filename as: ??????.txt which does not exist and
>>> therefore FetchFTP fails.
>>>
>>> I tried to use an UpdateAttribute process to change the filename into
>>> امتحان.txt but FetchFTP give my an error again
>>>
>>> FetchFTP[id=ce85ca8e-0177-1000-ffff-ffff95e1e5f7] Failed to fetch content for StandardFlowFileRecord[uuid=823c600d-c7fa-406e-ae66-b1ac70f5e212,claim=,offset=0,name=امتحان.txt,size=0] from filename FTP/امتحان.txt on remote host 192.168.1.2:21 due to java.io.IOException: 550 The system cannot find the file specified.
>>> ; routing to comms.failure: java.io.IOException: 550 The system cannot find the file specified.
>>>
>>>
>>> Kind regards
>>> Jens
>>>
>>> Den tir. 23. feb. 2021 kl. 09.14 skrev Pierre Villard <
>>> pierre.villard.fr@gmail.com>:
>>>
>>>> Let us know if this still doesn't work, we will definitely want to look
>>>> into it!
>>>>
>>>> Le mar. 23 févr. 2021 à 11:47, Jens M. Kofoed <jm...@gmail.com>
>>>> a écrit :
>>>>
>>>>> Hi Pierre
>>>>>
>>>>> Many thanks, I will definitely try the new version 1.13.0. I have
>>>>> already tried the List+Fetch processers in 1.12.1. And these 2 processors
>>>>> can take some non-English characters like Danish and Swedish character
>>>>> which GetFTP can't. But they still can't read my Arabic characters.
>>>>> I will try 1.13.0
>>>>>
>>>>> Thanks,
>>>>> Jens
>>>>>
>>>>> Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <
>>>>> pierre.villard.fr@gmail.com>:
>>>>>
>>>>>> Hi Jens,
>>>>>>
>>>>>> You may want to try NiFi 1.13.0 with List+Fetch processors. The
>>>>>> addition of https://issues.apache.org/jira/browse/NIFI-7685 may
>>>>>> help. Worth a try at least.
>>>>>>
>>>>>> Thanks,
>>>>>> Pierre
>>>>>>
>>>>>> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <jm...@gmail.com>
>>>>>> a écrit :
>>>>>>
>>>>>>> Dear community
>>>>>>>
>>>>>>> I have an issue which I hope some of you might be able to help me
>>>>>>> with or point me in the right direction.
>>>>>>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect
>>>>>>> with FileZilla I have no problems with uploading and downloading files with
>>>>>>> Arabic letters in the filename.
>>>>>>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
>>>>>>> filenames as ???? instead of the Arabic letters, and is not able to get the
>>>>>>> file since that filename does not exist. The GetFTP process is also
>>>>>>> configured with utf-8 enabled.
>>>>>>> The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi
>>>>>>> server to the FTP server I see the same behavior, Arabic letters is showing
>>>>>>> as ???
>>>>>>>
>>>>>>> But since FileZilla can see Arabic letters correctly, I can't see
>>>>>>> that the issue is at the FTP server.
>>>>>>> So please help
>>>>>>>
>>>>>>> Kind regards
>>>>>>> Jens M. Kofoed
>>>>>>>
>>>>>>>

Re: Issue with GetFTP and arabic letters?

Posted by "Jens M. Kofoed" <jm...@gmail.com>.
no problem,

By the way I just tried PutFTP and it also have some issue.
I created a flowfile, used an UpdateAttribute to set the filename to:
امتحان.txt   used a PutFTP (with utf8 enabled) and the filename at the ftp
server become: امتحان.txt

Den tir. 23. feb. 2021 kl. 12.20 skrev Pierre Villard <
pierre.villard.fr@gmail.com>:

> Do you mind filing a JIRA? I had a quick look and the fix should be fairly
> straightforward. Will give it a try to confirm.
>
> Thanks,
> Pierre
>
> Le mar. 23 févr. 2021 à 15:09, Jens M. Kofoed <jm...@gmail.com> a
> écrit :
>
>> Hi
>>
>> I have now tried with NiFi version 1.13.0, and there are still issues
>> with non-English characters.
>> The ListFTP process does not have an attribute "Use UTF-8 Encoding" but
>> FetchFTP has.
>> I have created a file with this filename: امتحان.txt
>> ListFTP list the filename as: ??????.txt which does not exist and
>> therefore FetchFTP fails.
>>
>> I tried to use an UpdateAttribute process to change the filename into
>> امتحان.txt but FetchFTP give my an error again
>>
>> FetchFTP[id=ce85ca8e-0177-1000-ffff-ffff95e1e5f7] Failed to fetch content for StandardFlowFileRecord[uuid=823c600d-c7fa-406e-ae66-b1ac70f5e212,claim=,offset=0,name=امتحان.txt,size=0] from filename FTP/امتحان.txt on remote host 192.168.1.2:21 due to java.io.IOException: 550 The system cannot find the file specified.
>> ; routing to comms.failure: java.io.IOException: 550 The system cannot find the file specified.
>>
>>
>> Kind regards
>> Jens
>>
>> Den tir. 23. feb. 2021 kl. 09.14 skrev Pierre Villard <
>> pierre.villard.fr@gmail.com>:
>>
>>> Let us know if this still doesn't work, we will definitely want to look
>>> into it!
>>>
>>> Le mar. 23 févr. 2021 à 11:47, Jens M. Kofoed <jm...@gmail.com>
>>> a écrit :
>>>
>>>> Hi Pierre
>>>>
>>>> Many thanks, I will definitely try the new version 1.13.0. I have
>>>> already tried the List+Fetch processers in 1.12.1. And these 2 processors
>>>> can take some non-English characters like Danish and Swedish character
>>>> which GetFTP can't. But they still can't read my Arabic characters.
>>>> I will try 1.13.0
>>>>
>>>> Thanks,
>>>> Jens
>>>>
>>>> Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <
>>>> pierre.villard.fr@gmail.com>:
>>>>
>>>>> Hi Jens,
>>>>>
>>>>> You may want to try NiFi 1.13.0 with List+Fetch processors. The
>>>>> addition of https://issues.apache.org/jira/browse/NIFI-7685 may help.
>>>>> Worth a try at least.
>>>>>
>>>>> Thanks,
>>>>> Pierre
>>>>>
>>>>> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <jm...@gmail.com>
>>>>> a écrit :
>>>>>
>>>>>> Dear community
>>>>>>
>>>>>> I have an issue which I hope some of you might be able to help me
>>>>>> with or point me in the right direction.
>>>>>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect
>>>>>> with FileZilla I have no problems with uploading and downloading files with
>>>>>> Arabic letters in the filename.
>>>>>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
>>>>>> filenames as ???? instead of the Arabic letters, and is not able to get the
>>>>>> file since that filename does not exist. The GetFTP process is also
>>>>>> configured with utf-8 enabled.
>>>>>> The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi
>>>>>> server to the FTP server I see the same behavior, Arabic letters is showing
>>>>>> as ???
>>>>>>
>>>>>> But since FileZilla can see Arabic letters correctly, I can't see
>>>>>> that the issue is at the FTP server.
>>>>>> So please help
>>>>>>
>>>>>> Kind regards
>>>>>> Jens M. Kofoed
>>>>>>
>>>>>>

Re: Issue with GetFTP and arabic letters?

Posted by Pierre Villard <pi...@gmail.com>.
Do you mind filing a JIRA? I had a quick look and the fix should be fairly
straightforward. Will give it a try to confirm.

Thanks,
Pierre

Le mar. 23 févr. 2021 à 15:09, Jens M. Kofoed <jm...@gmail.com> a
écrit :

> Hi
>
> I have now tried with NiFi version 1.13.0, and there are still issues with
> non-English characters.
> The ListFTP process does not have an attribute "Use UTF-8 Encoding" but
> FetchFTP has.
> I have created a file with this filename: امتحان.txt
> ListFTP list the filename as: ??????.txt which does not exist and
> therefore FetchFTP fails.
>
> I tried to use an UpdateAttribute process to change the filename into
> امتحان.txt but FetchFTP give my an error again
>
> FetchFTP[id=ce85ca8e-0177-1000-ffff-ffff95e1e5f7] Failed to fetch content for StandardFlowFileRecord[uuid=823c600d-c7fa-406e-ae66-b1ac70f5e212,claim=,offset=0,name=امتحان.txt,size=0] from filename FTP/امتحان.txt on remote host 192.168.1.2:21 due to java.io.IOException: 550 The system cannot find the file specified.
> ; routing to comms.failure: java.io.IOException: 550 The system cannot find the file specified.
>
>
> Kind regards
> Jens
>
> Den tir. 23. feb. 2021 kl. 09.14 skrev Pierre Villard <
> pierre.villard.fr@gmail.com>:
>
>> Let us know if this still doesn't work, we will definitely want to look
>> into it!
>>
>> Le mar. 23 févr. 2021 à 11:47, Jens M. Kofoed <jm...@gmail.com> a
>> écrit :
>>
>>> Hi Pierre
>>>
>>> Many thanks, I will definitely try the new version 1.13.0. I have
>>> already tried the List+Fetch processers in 1.12.1. And these 2 processors
>>> can take some non-English characters like Danish and Swedish character
>>> which GetFTP can't. But they still can't read my Arabic characters.
>>> I will try 1.13.0
>>>
>>> Thanks,
>>> Jens
>>>
>>> Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <
>>> pierre.villard.fr@gmail.com>:
>>>
>>>> Hi Jens,
>>>>
>>>> You may want to try NiFi 1.13.0 with List+Fetch processors. The
>>>> addition of https://issues.apache.org/jira/browse/NIFI-7685 may help.
>>>> Worth a try at least.
>>>>
>>>> Thanks,
>>>> Pierre
>>>>
>>>> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <jm...@gmail.com>
>>>> a écrit :
>>>>
>>>>> Dear community
>>>>>
>>>>> I have an issue which I hope some of you might be able to help me with
>>>>> or point me in the right direction.
>>>>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect
>>>>> with FileZilla I have no problems with uploading and downloading files with
>>>>> Arabic letters in the filename.
>>>>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
>>>>> filenames as ???? instead of the Arabic letters, and is not able to get the
>>>>> file since that filename does not exist. The GetFTP process is also
>>>>> configured with utf-8 enabled.
>>>>> The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi
>>>>> server to the FTP server I see the same behavior, Arabic letters is showing
>>>>> as ???
>>>>>
>>>>> But since FileZilla can see Arabic letters correctly, I can't see that
>>>>> the issue is at the FTP server.
>>>>> So please help
>>>>>
>>>>> Kind regards
>>>>> Jens M. Kofoed
>>>>>
>>>>>

Re: Issue with GetFTP and arabic letters?

Posted by "Jens M. Kofoed" <jm...@gmail.com>.
Hi

I have now tried with NiFi version 1.13.0, and there are still issues with
non-English characters.
The ListFTP process does not have an attribute "Use UTF-8 Encoding" but
FetchFTP has.
I have created a file with this filename: امتحان.txt
ListFTP list the filename as: ??????.txt which does not exist and therefore
FetchFTP fails.

I tried to use an UpdateAttribute process to change the filename into
امتحان.txt but FetchFTP give my an error again

FetchFTP[id=ce85ca8e-0177-1000-ffff-ffff95e1e5f7] Failed to fetch
content for StandardFlowFileRecord[uuid=823c600d-c7fa-406e-ae66-b1ac70f5e212,claim=,offset=0,name=امتحان.txt,size=0]
from filename FTP/امتحان.txt on remote host 192.168.1.2:21 due to
java.io.IOException: 550 The system cannot find the file specified.
; routing to comms.failure: java.io.IOException: 550 The system cannot
find the file specified.


Kind regards
Jens

Den tir. 23. feb. 2021 kl. 09.14 skrev Pierre Villard <
pierre.villard.fr@gmail.com>:

> Let us know if this still doesn't work, we will definitely want to look
> into it!
>
> Le mar. 23 févr. 2021 à 11:47, Jens M. Kofoed <jm...@gmail.com> a
> écrit :
>
>> Hi Pierre
>>
>> Many thanks, I will definitely try the new version 1.13.0. I have already
>> tried the List+Fetch processers in 1.12.1. And these 2 processors can take
>> some non-English characters like Danish and Swedish character which GetFTP
>> can't. But they still can't read my Arabic characters.
>> I will try 1.13.0
>>
>> Thanks,
>> Jens
>>
>> Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <
>> pierre.villard.fr@gmail.com>:
>>
>>> Hi Jens,
>>>
>>> You may want to try NiFi 1.13.0 with List+Fetch processors. The addition
>>> of https://issues.apache.org/jira/browse/NIFI-7685 may help. Worth a
>>> try at least.
>>>
>>> Thanks,
>>> Pierre
>>>
>>> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <jm...@gmail.com>
>>> a écrit :
>>>
>>>> Dear community
>>>>
>>>> I have an issue which I hope some of you might be able to help me with
>>>> or point me in the right direction.
>>>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect
>>>> with FileZilla I have no problems with uploading and downloading files with
>>>> Arabic letters in the filename.
>>>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
>>>> filenames as ???? instead of the Arabic letters, and is not able to get the
>>>> file since that filename does not exist. The GetFTP process is also
>>>> configured with utf-8 enabled.
>>>> The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi
>>>> server to the FTP server I see the same behavior, Arabic letters is showing
>>>> as ???
>>>>
>>>> But since FileZilla can see Arabic letters correctly, I can't see that
>>>> the issue is at the FTP server.
>>>> So please help
>>>>
>>>> Kind regards
>>>> Jens M. Kofoed
>>>>
>>>>

Re: Issue with GetFTP and arabic letters?

Posted by Pierre Villard <pi...@gmail.com>.
Let us know if this still doesn't work, we will definitely want to look
into it!

Le mar. 23 févr. 2021 à 11:47, Jens M. Kofoed <jm...@gmail.com> a
écrit :

> Hi Pierre
>
> Many thanks, I will definitely try the new version 1.13.0. I have already
> tried the List+Fetch processers in 1.12.1. And these 2 processors can take
> some non-English characters like Danish and Swedish character which GetFTP
> can't. But they still can't read my Arabic characters.
> I will try 1.13.0
>
> Thanks,
> Jens
>
> Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <
> pierre.villard.fr@gmail.com>:
>
>> Hi Jens,
>>
>> You may want to try NiFi 1.13.0 with List+Fetch processors. The addition
>> of https://issues.apache.org/jira/browse/NIFI-7685 may help. Worth a try
>> at least.
>>
>> Thanks,
>> Pierre
>>
>> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <jm...@gmail.com> a
>> écrit :
>>
>>> Dear community
>>>
>>> I have an issue which I hope some of you might be able to help me with
>>> or point me in the right direction.
>>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect
>>> with FileZilla I have no problems with uploading and downloading files with
>>> Arabic letters in the filename.
>>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
>>> filenames as ???? instead of the Arabic letters, and is not able to get the
>>> file since that filename does not exist. The GetFTP process is also
>>> configured with utf-8 enabled.
>>> The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi
>>> server to the FTP server I see the same behavior, Arabic letters is showing
>>> as ???
>>>
>>> But since FileZilla can see Arabic letters correctly, I can't see that
>>> the issue is at the FTP server.
>>> So please help
>>>
>>> Kind regards
>>> Jens M. Kofoed
>>>
>>>

Re: Issue with GetFTP and arabic letters?

Posted by "Jens M. Kofoed" <jm...@gmail.com>.
Hi Pierre

Many thanks, I will definitely try the new version 1.13.0. I have already
tried the List+Fetch processers in 1.12.1. And these 2 processors can take
some non-English characters like Danish and Swedish character which GetFTP
can't. But they still can't read my Arabic characters.
I will try 1.13.0

Thanks,
Jens

Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <
pierre.villard.fr@gmail.com>:

> Hi Jens,
>
> You may want to try NiFi 1.13.0 with List+Fetch processors. The addition
> of https://issues.apache.org/jira/browse/NIFI-7685 may help. Worth a try
> at least.
>
> Thanks,
> Pierre
>
> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <jm...@gmail.com> a
> écrit :
>
>> Dear community
>>
>> I have an issue which I hope some of you might be able to help me with or
>> point me in the right direction.
>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect with
>> FileZilla I have no problems with uploading and downloading files with
>> Arabic letters in the filename.
>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
>> filenames as ???? instead of the Arabic letters, and is not able to get the
>> file since that filename does not exist. The GetFTP process is also
>> configured with utf-8 enabled.
>> The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi
>> server to the FTP server I see the same behavior, Arabic letters is showing
>> as ???
>>
>> But since FileZilla can see Arabic letters correctly, I can't see that
>> the issue is at the FTP server.
>> So please help
>>
>> Kind regards
>> Jens M. Kofoed
>>
>>

Re: Issue with GetFTP and arabic letters?

Posted by Pierre Villard <pi...@gmail.com>.
Hi Jens,

You may want to try NiFi 1.13.0 with List+Fetch processors. The addition of
https://issues.apache.org/jira/browse/NIFI-7685 may help. Worth a try at
least.

Thanks,
Pierre

Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <jm...@gmail.com> a
écrit :

> Dear community
>
> I have an issue which I hope some of you might be able to help me with or
> point me in the right direction.
> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I connect with
> FileZilla I have no problems with uploading and downloading files with
> Arabic letters in the filename.
> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
> filenames as ???? instead of the Arabic letters, and is not able to get the
> file since that filename does not exist. The GetFTP process is also
> configured with utf-8 enabled.
> The NiFi server is using Ubuntu 18.04 and if I connect from the NiFi
> server to the FTP server I see the same behavior, Arabic letters is showing
> as ???
>
> But since FileZilla can see Arabic letters correctly, I can't see that the
> issue is at the FTP server.
> So please help
>
> Kind regards
> Jens M. Kofoed
>
>