Issue with running PyFlink Jobs on K8s - Status Logging

[Prabhav Singh <pr...@gmail.com>]

Hi,

I have been using Apache Flink for development in my organization for the
past 6 months and I have recently run into an issue with Flink on K8s.
Below, I have attempted to describe what we are trying to do and exactly
where we are facing an issue:

*Our Setup & Task:*

- The task is a simple windowing operation on data being streamed from a
Kafka Topic in RT. The result is also stored in a Kafka Topic.
- To set up Apache Flink on K8 we followed the following steps:

   - Used the session deployment K8 YAML files described in Apache Flink
   1.13.6 Docs [LINK 1
   <https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/deployment/resource-providers/standalone/kubernetes/#starting-a-kubernetes-cluster-session-mode>]
   - We used the apache/flink:1.13.6-java11 image for the same.
   - Added PyFlink to the jobmanager by following the commands specified
   here [LINK 2
   <https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/deployment/resource-providers/standalone/docker/#enabling-python>
   ]
   - Submit the job to Apache Flink using ./bin/flink run -py JobPath.

*What Runs Correctly:*

- The job is successfully submitted to the taskmanager and the Web UI shows
the job as *RUNNING.*
- All the Flink Operations run perfectly - The data is ingested from Kafka,
processing is done and the data is put into the sink.

[image: image.png]

- Overall, *there is no issue in submitting and running the job.*

*ISSUE FACED:*

- Before the job starts, the command line gives the following error:

*ERROR StatusLogger Reconfiguration failed: No configuration found for
'3d646c37' at 'null' in 'null'
*

- Post this, the job runs normally - However, NO LOGGING IS DONE FOR THE
JOBS. Metrics are also not available. The job keeps running, but as shown
in the screenshot, data is not logged.

*My Possible Reasons:*

- From my limited knowledge, I assume this to be an issue with the
flink-config.map provided in the DOCS in Link 1.
- Apart from that, I am unable to fix this issue.


I would request help from the Flink Community. Thanks for the support
provided by the community and for helping in the development of Flink.

Regards,
Prabhav Singh