You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "godfrey he (Jira)" <ji...@apache.org> on 2020/01/19 12:33:00 UTC

[jira] [Commented] (FLINK-15669) SQL client can't cancel flink job

    [ https://issues.apache.org/jira/browse/FLINK-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018899#comment-17018899 ] 

godfrey he commented on FLINK-15669:
------------------------------------

I would like to fix it.

my solution is: changes the non-blocking deployment to blocking deployment in {{LocalExecutor#executeQueryInternal}} method, and then we can get jobId from {{JobClient}}, and then use it as resultId. The parameter of {{DynamicResult#startRetrieval}} method should also be changed from {{ProgramDeployer}} to {{JobClient}}, like {{void startRetrieval(JobClient jobClient);}}

> SQL client can't cancel flink job
> ---------------------------------
>
>                 Key: FLINK-15669
>                 URL: https://issues.apache.org/jira/browse/FLINK-15669
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / Client
>    Affects Versions: 1.10.0
>            Reporter: godfrey he
>            Priority: Major
>             Fix For: 1.10.0
>
>
> in sql client, CLI client do cancel query through {{void cancelQuery(String sessionId, String resultId)}} method in {{Executor}}. However, the {{resultId}} is a random UUID, is not the job id. So CLI client can't cancel a running job.
> related code in {{LocalExecutor}}:
> {code:java}
> private <C> ResultDescriptor executeQueryInternal(String sessionId, ExecutionContext<C> context, String query) {
> 	 ......
> 	// store the result with a unique id
> 	final String resultId = UUID.randomUUID().toString();
> 	resultStore.storeResult(resultId, result);
> 	......
> 	// create execution
> 	final ProgramDeployer deployer = new ProgramDeployer(
> 		configuration, jobName, pipeline);
> 	// start result retrieval
> 	result.startRetrieval(deployer);
> 	return new ResultDescriptor(
> 			resultId,
> 			removeTimeAttributes(table.getSchema()),
> 			result.isMaterialized());
> }
> private <T> void cancelQueryInternal(ExecutionContext<T> context, String resultId) {
> 	......
> 	// stop Flink job
> 	try (final ClusterDescriptor<T> clusterDescriptor = context.createClusterDescriptor()) {
> 		ClusterClient<T> clusterClient = null;
> 		try {
> 			// retrieve existing cluster
> 			clusterClient = clusterDescriptor.retrieve(context.getClusterId()).getClusterClient();
> 			try {
> 				// ======== can job through resultId =======
> 				clusterClient.cancel(new JobID(StringUtils.hexStringToByte(resultId))).get();
> 			} catch (Throwable t) {
> 				// the job might has finished earlier
> 			}
> 		} catch (Exception e) {
> 			throw new SqlExecutionException("Could not retrieve or create a cluster.", e);
> 		} finally {
> 			try {
> 				if (clusterClient != null) {
> 					clusterClient.close();
> 				}
> 			} catch (Exception e) {
> 				// ignore
> 			}
> 		}
> 	} catch (SqlExecutionException e) {
> 		throw e;
> 	} catch (Exception e) {
> 		throw new SqlExecutionException("Could not locate a cluster.", e);
> 	}
> }
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)