[jira] [Commented] (AIRFLOW-4515) KubernetesExecutor hangs in the subdag context

["Steven Locke (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844257#comment-16844257 ] 

Steven Locke commented on AIRFLOW-4515:
---------------------------------------

Just a note. It appears that this is currently not an issue in master at least when triggering via the command line. I'm unable to trigger via the ui in master at the moment but that is not an option for our production configuration anyways. I'm currently testing against the branch v1-10-stable and cherry picking commits from master to identify what has fixed this.
Is there any timeline on this at all?

> KubernetesExecutor hangs in the subdag context
> ----------------------------------------------
>
>                 Key: AIRFLOW-4515
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4515
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: executor
>    Affects Versions: 1.10.3
>            Reporter: Steven Locke
>            Priority: Major
>              Labels: kubernetes
>
> The bug is that when using the kubernetes executor in a k8s cluster and running a subdag with `executor=KubernetesExecutor()` the subdag never returns. Just runs infinitely. Here is an example repo https://github.com/slocke716/test_subdags
> This is occurring on 1.10.3 1.10.3post1 and 1.10.3b2 at least
> Not passing `executor=KubernetesExecutor()` into the subdag operator is not an option since it defaults to the SequentialExecutor and changing to the LocalExecutor causes thread errors because we require quite a bit of concurrency



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)