You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dian Fu (Jira)" <ji...@apache.org> on 2026/09/18 02:39:00 UTC
[jira] [Closed] (FLINK-39572) Hide sensitive information when pyflink's beam runner is closed
[ https://issues.apache.org/jira/browse/FLINK-39572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dian Fu closed FLINK-39572.
---------------------------
Fix Version/s: 1.20.6
2.3.1
2.4.0
Resolution: Fixed
Merged in:
- master via 3b51b5b3d7a35c937608e6799f13e028de1a1ceb
- release-2.3 via cf7fbd3317dd9524096bf7d97580460935dc2501
- release-1.20 via 2b0b62f899beaa8a5088ea7bbde4795999929ee0
> Hide sensitive information when pyflink's beam runner is closed
> ----------------------------------------------------------------
>
> Key: FLINK-39572
> URL: https://issues.apache.org/jira/browse/FLINK-39572
> Project: Flink
> Issue Type: Improvement
> Reporter: Biao Geng
> Assignee: Martijn Visser
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.20.6, 2.3.1, 2.4.0
>
>
> Currently when pyflink finishes a job execution,
> DefaultJobBundleFactory will be closed, which will unref underlying WrappedSdkHarnessClient.
> Given the current implementation, environment.getEnvironment() would be logged, we may need to use helper method like ConfigurationUtils.hideSensitiveValues to hide the sensitive information
> :
> {code:java}
> private int unref() {
> int refCount = bundleRefCount.decrementAndGet();
> Preconditions.checkState(refCount >= 0, "Reference count must not be negative.");
> if (refCount == 0) {
> // Close environment after it was removed from cache and all bundles finished.
> LOG.info("Closing environment {}", environment.getEnvironment());
> close();
> }
> return refCount;
> } {code}
>
> 2026-04-28 20:44:34,591 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory [] - Closing environment urn: "beam:env:process:v1"
> payload: "\032`/root/multi-modal-benchmark/.venv/lib/python3.11/site-packages/pyflink/bin/pyflink-udf-runner.sh\"\367\001\n\004PATH\022\356\001/usr/lib/jvm/java-11-openj
--
This message was sent by Atlassian Jira
(v8.20.10#820010)