You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Rajesh Mahindra (Jira)" <ji...@apache.org> on 2021/08/30 06:09:00 UTC

[jira] [Created] (HUDI-2375) Create common SchemaProvider and RecordPayloads for spark, flink etc.

Rajesh Mahindra created HUDI-2375:
-------------------------------------

             Summary: Create common SchemaProvider and RecordPayloads for spark, flink etc.
                 Key: HUDI-2375
                 URL: https://issues.apache.org/jira/browse/HUDI-2375
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Rajesh Mahindra


Create common SchemaProvider and RecordPayloads for spark, flink etc.

- Currently the class org.apache.hudi.utilities.schema.SchemaProvider takes in input JavaSparkContext, and is specific to Spark Engine. So we have created a separate SchemaProvider for flink. Now for Kafka connect, we can use neither, since its neither spark nor flink. Implement a common class that uses HoodieEngineContext ..



--
This message was sent by Atlassian Jira
(v8.3.4#803005)