[GitHub] [kyuubi] lordk911 commented on issue #4591: [Bug] Spark connection level engines didn't be closed after all job finished

["lordk911 (via GitHub)" <gi...@apache.org>]

lordk911 commented on issue #4591:
URL: https://github.com/apache/kyuubi/issues/4591#issuecomment-1482288559

   Thank you for your attention. Actually the ETL task script is very simple , and I can not reproduce this issue too. 
   ETL task script is : 
   `/data/soft/spark3/bin/beeline -n xxx -p xxx -u  'jdbc:hive2://worker-10-0-xxx:2181,worker-10-0-xxx:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=kyuubi;?kyuubi.engine.share.level=connection;' -f '/data/scripts/datax/hdp-doc/scripts/gdwd/01.ods/ods_key_customer_touch_create.sql'`
   
   and the the sql file has only one sql : 
   ```
   create table if not exists ods.ods__touch
   (
       ...
       update_time         timestamp   comment '更新时间',
       etltime             timestamp   comment 'etl时间'
   )
   stored as orc;
   ```
   And from the DolphinScheduler's task history I can see the task's script not be changed for a long time , also the sql file submit to kyuubi not be changed for a long time by seach git history .
   
   ![image](https://user-images.githubusercontent.com/19989300/227433955-9eefdb18-b3fa-4906-8434-0b96a73f81da.png)
   
   from the picture above , the colum '工作流实例' has value like 'ods_key_customer_touch-2-20230324010001985' which 'ods_key_customer_touch' is process name and '2' is  process version. This process runs once a day using version 2 and has been running for a long time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org