You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Kyle Weller (Jira)" <ji...@apache.org> on 2021/10/26 16:44:00 UTC

[jira] [Created] (HUDI-2630) Add undocumented features

Kyle Weller created HUDI-2630:
---------------------------------

             Summary: Add undocumented features
                 Key: HUDI-2630
                 URL: https://issues.apache.org/jira/browse/HUDI-2630
             Project: Apache Hudi
          Issue Type: Sub-task
            Reporter: Kyle Weller
            Assignee: Kyle Weller


Ideas:
 * [ ] Metadata table/table metadata
 * [ ] File sizing
 * [ ] Compaction, configs, strategies (Siva)
 * [ ] Keys
 ** [ ] virtual keys
 ** [ ] meta fields ({{_hoodie_record_key}} and such)
 * [ ] Document every single write operations :
 ** [ ] incremental: {{upsert}}, {{insert}}, {{delete}}
 ** [ ] batch ones : {{insert_overwrite}}, ...
 * [ ] DeltaStreamer
 ** [ ] deployment
 ** [ ] sources
 ** [ ] de-duplication
 ** [ ] checkpoint provider
 * [ ] Marker mechanism
 * [ ] Timeline server and metaserver
 * [ ] Indexing needs a page
 * [ ] Table services - 1 page each
 ** [ ] bootstrap
 * [ ] Document all the different utilities (try them out locally)
 ** [ ] multi/deltastreamer
 ** [ ] snapshotter
 ** [ ] exporter
 ** [ ] SchemaProvider
 ** [ ] Precommit validators {{SparkPreCommitValidator}}
 ** [ ] It’d be _very_ helpful if there was a table of sources + schema providers, along with examples of the input format for the source in the Hudi documentation
 * [ ] Hive sync
 * [ ] Document prometheus reporter
 * [ ] Document all public APIs (keygenerators, payloads, ... )
 * [ ] Commit Notifications
 * [ ] Address stuff from https://issues.apache.org/jira/browse/HUDI-1958



--
This message was sent by Atlassian Jira
(v8.3.4#803005)