You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/01/27 09:48:41 UTC

[GitHub] [airflow] clumzzey commented on issue #1614: [AIRFLOW-264] Adding workload management for Hive

clumzzey commented on issue #1614: [AIRFLOW-264] Adding workload management for Hive
URL: https://github.com/apache/airflow/pull/1614#issuecomment-578669609
 
 
   Hi, It looks like this this part breaks the hive execution on our HW 3. 
   
   The error we get is the following:
   [2020-01-09 16:14:10,000] {base_task_runner.py:98} INFO - Subtask: [2020-01-09 16:14:10,000] {hive_hooks.py:216} INFO - Error: Could not open client transport for any of the Server URI's in ZooKeeper: Failed to open new session: java.lang.IllegalArgumentException: Cannot modify airflow.ctx.task.task_id at runtime. It is not in list of params that are allowed to be modified at runtime (state=08S01,code=0)
   
   I did ask our Infra team to add the airflow specific hiveconf to the whitelist of variables allowad to be modified on runtime but they seem to be reluctant to do that. Since it is not related to hive itself but an external application, the arguments should be passed as hivevar as hiveconf, so is claimed. 
   
   If so, can this please be fixed? 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services