You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2023/05/02 17:39:00 UTC
[jira] [Assigned] (HUDI-5574) Support auto record key generation with Spark SQL
[ https://issues.apache.org/jira/browse/HUDI-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
sivabalan narayanan reassigned HUDI-5574:
-----------------------------------------
Assignee: sivabalan narayanan
> Support auto record key generation with Spark SQL
> -------------------------------------------------
>
> Key: HUDI-5574
> URL: https://issues.apache.org/jira/browse/HUDI-5574
> Project: Apache Hudi
> Issue Type: Bug
> Components: writer-core
> Reporter: Lokesh Jain
> Assignee: sivabalan narayanan
> Priority: Critical
> Fix For: 0.13.1
>
>
> HUDI-2681 adds support for auto record key generation with spark dataframes. This Jira aims to add support for the same with spark sql.
> One of the changes required here as pointed out by [~kazdy] is that SQL_INSERT_MODE would need to be handled here. In this case if SQL_INSERT_MODE mode is set to strict, the insert should fail.
> cc [~shivnarayan]
> Essentially, based on this patch ([https://github.com/apache/hudi/pull/7681),|https://github.com/apache/hudi/pull/7681,]
> we want to ensure spark-sql writes also supports auto generation of record keys.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)