You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Teng Huo (Jira)" <ji...@apache.org> on 2022/06/28 07:39:00 UTC

[jira] [Created] (HUDI-4334) Hudi Spark SQL commands won't exist if SparkRDDWriteClient not close

|  ![](cid:jira-generated-image-avatar-32190b4b-abf7-4da9-bac3-addf10b23975) |
[Teng
Huo](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=teng_huo)
**created** an issue  
---|---  
|  
---  
|  [Apache Hudi](https://issues.apache.org/jira/browse/HUDI) /
[![Bug](cid:jira-generated-image-
avatar-b037cd94-39f2-4b27-9106-f13ba0b3344f)](https://issues.apache.org/jira/browse/HUDI-4334)
[HUDI-4334](https://issues.apache.org/jira/browse/HUDI-4334)  
---  
[Hudi Spark SQL commands won't exist if SparkRDDWriteClient not
close](https://issues.apache.org/jira/browse/HUDI-4334)  
| Issue Type: |  ![Bug](cid:jira-generated-image-
avatar-b037cd94-39f2-4b27-9106-f13ba0b3344f) Bug  
---|---  
Assignee: |  Unassigned  
Components: |  spark-sql  
Created: |  28/Jun/22 07:38  
Priority: |  ![Major](cid:jira-generated-image-static-
major-b27b3e47-eca3-4cd2-9342-d95f3c98624c) Major  
Reporter: |  [Teng
Huo](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=teng_huo)  
|

In CreateSavepointsProcedure.scala/DeleteSavepointsProcedure.scala, there is a
SparkRDDWriteClient was created in method call but never close, it won't cause
issue in Spark-SQL command line, but if we run commands like examples showing
below in a Spark application, it won't exist

    
    
    spark.sql(s"""call create_savepoints('$tableName', '$commitTime')""")
      
  
---  
|  |  [ ![Add Comment](cid:jira-generated-image-static-comment-
icon-69270f16-61aa-424e-b833-db6f02dd454d)
](https://issues.apache.org/jira/browse/HUDI-4334#add-comment "Add Comment") |
[Add Comment](https://issues.apache.org/jira/browse/HUDI-4334#add-comment "Add
Comment")  
---|---  
  
|  This message was sent by Atlassian Jira (v8.20.10#820010-sha1:ace47f9) |  |
![Atlassian logo](https://issues.apache.org/jira/images/mail/atlassian-email-
logo.png)  
---