You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Kyle Weller (Jira)" <ji...@apache.org> on 2021/10/26 16:44:00 UTC
[jira] [Created] (HUDI-2630) Add undocumented features
Kyle Weller created HUDI-2630:
---------------------------------
Summary: Add undocumented features
Key: HUDI-2630
URL: https://issues.apache.org/jira/browse/HUDI-2630
Project: Apache Hudi
Issue Type: Sub-task
Reporter: Kyle Weller
Assignee: Kyle Weller
Ideas:
* [ ] Metadata table/table metadata
* [ ] File sizing
* [ ] Compaction, configs, strategies (Siva)
* [ ] Keys
** [ ] virtual keys
** [ ] meta fields ({{_hoodie_record_key}} and such)
* [ ] Document every single write operations :
** [ ] incremental: {{upsert}}, {{insert}}, {{delete}}
** [ ] batch ones : {{insert_overwrite}}, ...
* [ ] DeltaStreamer
** [ ] deployment
** [ ] sources
** [ ] de-duplication
** [ ] checkpoint provider
* [ ] Marker mechanism
* [ ] Timeline server and metaserver
* [ ] Indexing needs a page
* [ ] Table services - 1 page each
** [ ] bootstrap
* [ ] Document all the different utilities (try them out locally)
** [ ] multi/deltastreamer
** [ ] snapshotter
** [ ] exporter
** [ ] SchemaProvider
** [ ] Precommit validators {{SparkPreCommitValidator}}
** [ ] It’d be _very_ helpful if there was a table of sources + schema providers, along with examples of the input format for the source in the Hudi documentation
* [ ] Hive sync
* [ ] Document prometheus reporter
* [ ] Document all public APIs (keygenerators, payloads, ... )
* [ ] Commit Notifications
* [ ] Address stuff from https://issues.apache.org/jira/browse/HUDI-1958
--
This message was sent by Atlassian Jira
(v8.3.4#803005)