Issue with the flink version 1.10.1

[Kiran Kumar Kathe <ki...@gmail.com>]

When I submit a job using flink version 1.10.1 ,  it is not upadating the
jobs that are running and completed successfully in the Web UI of YARN
resource manager . But When I use flink version 1.9.3 it is working fine
and I am able to see the jobs that are running and completed in
YARN resource manager Web UI . And to find why this is happening I just
tried with replacing the application folders and in lib folder when I use
the flink_dist jar of version 1.9.3 in place of flink_dist of version
1.10.1 it is running fine and I am able to see the jobs running and
completed. Is it the right way , if not will I face any compatible issues
in future with this change of flink_dist jar in lib folder.

Re: Issue with the flink version 1.10.1

[Matthias Pohl via user <us...@flink.apache.org>]

Hi Kiran,
it's really hard to come up with an answer based on your description.
Usually, it helps to share some logs with the exact error that's appearing
and a clear description on what you're observing and what you're expecting.
A plain "no jobs are running" is too general to come up with a conclusion.
Sorry.

Additionally, let me state that Flink 1.10 and 1.9 are quite old versions.
The community doesn't support those versions anymore. It might be the case
that you're running into issues that are already fixed in newer versions.
Investigating code from years ago can be quite tedious.

Best,
Matthias

On Mon, Mar 27, 2023 at 2:29 PM Kiran Kumar Kathe <
kirankumarkathe123@gmail.com> wrote:

> When I submit a job using flink version 1.10.1 ,  it is not upadating the
> jobs that are running and completed successfully in the Web UI of YARN
> resource manager . But When I use flink version 1.9.3 it is working fine
> and I am able to see the jobs that are running and completed in
> YARN resource manager Web UI . And to find why this is happening I just
> tried with replacing the application folders and in lib folder when I use
> the flink_dist jar of version 1.9.3 in place of flink_dist of version
> 1.10.1 it is running fine and I am able to see the jobs running and
> completed. Is it the right way , if not will I face any compatible issues
> in future with this change of flink_dist jar in lib folder.
>

Re: Issue with the flink version 1.10.1

[Shammon FY <zj...@gmail.com>]

Hi Kiran

According to your description, it sounds like a configuration issue
prevented the job from being submitted successfully. You can check whether
there are any error messages from the submission log of yarn or your
submission system. You can also compare the configuration differences
between the new and old versions.

Best,
Shammon FY


On Mon, Mar 27, 2023 at 10:38 PM Kiran Kumar Kathe <
kirankumarkathe123@gmail.com> wrote:

> Even though when I run with the latest versions I am not able to see the
> jobs running in the flink in resource manager Web UI , but when I use flink
> less than 1.9.3 it is working fine , and if i replace the  1.9.3 flink_dist
> jar file which is in the lib folder of flink application and  in the higher
> version like 1.10.1 and above these are also working good and I am able to
> see the jobs in the Web UI. Can I use it like that or is there another way
> ?  And I am able to see the logs in versions below 1.9.3 like submitting
> application , Submitted application , deploying cluster , yarn application
> has been successfully deployed  but in higher versions it is not showing
> logs like that , i have attached screenshots have a look on that to get
> clear idea , please do suggest if there are any other ways  or if i can use
> flink_dist jar which is in lib for in higher versions.
>
> On Mon, 27 Mar 2023 at 18:06, Leonard Xu <xb...@gmail.com> wrote:
>
>> Hi, Kiran
>>
>> To be honest, both 1.10 and 1.9 are pretty old version, it’s hard to fix
>> and release a bugfix version for 1.10.1 even the community help
>> troubleshoot your issue.
>> So, could you try latest versions like Flink 1.16.1 or 1.17.0?
>>
>> Best,
>> Leonard
>>
>> > On Mar 27, 2023, at 8:28 PM, Kiran Kumar Kathe <
>> kirankumarkathe123@gmail.com> wrote:
>> >
>> > When I submit a job using flink version 1.10.1 ,  it is not upadating
>> the jobs that are running and completed successfully in the Web UI of YARN
>> resource manager . But When I use flink version 1.9.3 it is working fine
>> and I am able to see the jobs that are running and completed in
>> > YARN resource manager Web UI . And to find why this is happening I just
>> tried with replacing the application folders and in lib folder when I use
>> the flink_dist jar of version 1.9.3 in place of flink_dist of version
>> 1.10.1 it is running fine and I am able to see the jobs running and
>> completed. Is it the right way , if not will I face any compatible issues
>> in future with this change of flink_dist jar in lib folder.
>>
>>

Re: Issue with the flink version 1.10.1

[Kiran Kumar Kathe <ki...@gmail.com>]

Even though when I run with the latest versions I am not able to see the
jobs running in the flink in resource manager Web UI , but when I use flink
less than 1.9.3 it is working fine , and if i replace the  1.9.3 flink_dist
jar file which is in the lib folder of flink application and  in the higher
version like 1.10.1 and above these are also working good and I am able to
see the jobs in the Web UI. Can I use it like that or is there another way
?  And I am able to see the logs in versions below 1.9.3 like submitting
application , Submitted application , deploying cluster , yarn application
has been successfully deployed  but in higher versions it is not showing
logs like that , i have attached screenshots have a look on that to get
clear idea , please do suggest if there are any other ways  or if i can use
flink_dist jar which is in lib for in higher versions.

On Mon, 27 Mar 2023 at 18:06, Leonard Xu <xb...@gmail.com> wrote:

> Hi, Kiran
>
> To be honest, both 1.10 and 1.9 are pretty old version, it’s hard to fix
> and release a bugfix version for 1.10.1 even the community help
> troubleshoot your issue.
> So, could you try latest versions like Flink 1.16.1 or 1.17.0?
>
> Best,
> Leonard
>
> > On Mar 27, 2023, at 8:28 PM, Kiran Kumar Kathe <
> kirankumarkathe123@gmail.com> wrote:
> >
> > When I submit a job using flink version 1.10.1 ,  it is not upadating
> the jobs that are running and completed successfully in the Web UI of YARN
> resource manager . But When I use flink version 1.9.3 it is working fine
> and I am able to see the jobs that are running and completed in
> > YARN resource manager Web UI . And to find why this is happening I just
> tried with replacing the application folders and in lib folder when I use
> the flink_dist jar of version 1.9.3 in place of flink_dist of version
> 1.10.1 it is running fine and I am able to see the jobs running and
> completed. Is it the right way , if not will I face any compatible issues
> in future with this change of flink_dist jar in lib folder.
>
>

Re: Issue with the flink version 1.10.1

[Leonard Xu <xb...@gmail.com>]

Hi, Kiran

To be honest, both 1.10 and 1.9 are pretty old version, it’s hard to fix and release a bugfix version for 1.10.1 even the community help troubleshoot your issue. 
So, could you try latest versions like Flink 1.16.1 or 1.17.0?

Best,
Leonard

> On Mar 27, 2023, at 8:28 PM, Kiran Kumar Kathe <ki...@gmail.com> wrote:
> 
> When I submit a job using flink version 1.10.1 ,  it is not upadating the jobs that are running and completed successfully in the Web UI of YARN resource manager . But When I use flink version 1.9.3 it is working fine and I am able to see the jobs that are running and completed in 
> YARN resource manager Web UI . And to find why this is happening I just tried with replacing the application folders and in lib folder when I use the flink_dist jar of version 1.9.3 in place of flink_dist of version 1.10.1 it is running fine and I am able to see the jobs running and completed. Is it the right way , if not will I face any compatible issues in future with this change of flink_dist jar in lib folder.