You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2023/05/02 17:39:00 UTC

[jira] [Assigned] (HUDI-5574) Support auto record key generation with Spark SQL

     [ https://issues.apache.org/jira/browse/HUDI-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan reassigned HUDI-5574:
-----------------------------------------

    Assignee: sivabalan narayanan

> Support auto record key generation with Spark SQL
> -------------------------------------------------
>
>                 Key: HUDI-5574
>                 URL: https://issues.apache.org/jira/browse/HUDI-5574
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: writer-core
>            Reporter: Lokesh Jain
>            Assignee: sivabalan narayanan
>            Priority: Critical
>             Fix For: 0.13.1
>
>
> HUDI-2681 adds support for auto record key generation with spark dataframes. This Jira aims to add support for the same with spark sql.
> One of the changes required here as pointed out by [~kazdy] is that SQL_INSERT_MODE would need to be handled here. In this case if SQL_INSERT_MODE mode is set to strict, the insert should fail.
> cc [~shivnarayan] 
> Essentially, based on this patch ([https://github.com/apache/hudi/pull/7681),|https://github.com/apache/hudi/pull/7681,]
> we want to ensure spark-sql writes also supports auto generation of record keys. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)