You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amoro.apache.org by "Aireed (via GitHub)" <gi...@apache.org> on 2025/01/02 07:24:49 UTC

[PR] [AMORO-xxx]: fix SparkUnifiedSessionCatalog should support load hive function for hive/mixed-hive table [amoro]

Aireed opened a new pull request, #3385:
URL: https://github.com/apache/amoro/pull/3385

   <!--
   Thanks for sending a pull request!
   
   Here are some tips for you:
     1. If this is your first time, please read our contributor guidelines: https://amoro.apache.org/how-to-contribute/
     2. If the PR is related to an issue in https://github.com/apache/amoro/issues, add '[AMORO-XXXX]' in your PR title, e.g., '[AMORO-XXXX] Your PR title ...'.
     3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][AMORO-XXXX] Your PR title ...'.
   -->
   
   ## Why are the changes needed?
   <!--
   Please clarify why the changes are needed. For instance,
     1. If you add a feature, you can talk about its use case.
     2. If you fix a bug, you can clarify why it is a bug.
     3. Use Fix/Resolve/Close #{ISSUE_NUMBER} to link this PR to its related issue
   -->
   
   **Environment:**
   format: mixed_hive/hive
   Engine: spark 3.3
   Catalog: SparkUnifiedSessionCatalog  with mixed_hive format
   
   **bug:**
   Spark SQL cannot recognize a successfully registered Hive UDF
   
   **description**
   
   ```
   spark-sql> reload jar hdfs:///tmp/spark_udf-1.0-SNAPSHOT.jar;
   spark-sql> create function hive_db.StringUdf as 'org.example.udf.StringUdf' using jar 'hdfs:///tmp/spark_udf-1.0-SNAPSHOT.jar';
   Error in query: Function 'hive_db.StringUdf' already exists in database 'hive_db'
   spark-sql> select id,hive_db.StringUdf(name) from amoro_like;
   Error in query: Undefined function: hive_db.StringUdf; line 1 pos 10
   spark-sql> select id,hive_db.StringUdf(name) from tbl_schema_chg;
   Error in query: Undefined function: hive_db.StringUdf; line 1 pos 10
   spark-sql>
   ```
   
   ## Brief change log
   <!--
   Clearly describe the changes made in modules, classes, methods, etc.
   -->
   
   - fix load_function logic
   
   ## How was this patch tested?
   
   - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
   
   - [ ] Add screenshots for manual tests if appropriate
   
   - [x] Run test locally before making a pull request
   
   ## Documentation
   
   - Does this pull request introduce a new feature? (yes / no)
   - If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [AMORO-3385][bug]fix SparkUnifiedSessionCatalog should support load hive function for hive/mixed-hive table [amoro]

Posted by "zhoujinsong (via GitHub)" <gi...@apache.org>.
zhoujinsong merged PR #3385:
URL: https://github.com/apache/amoro/pull/3385


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org