You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "leesf (Jira)" <ji...@apache.org> on 2020/01/04 15:20:00 UTC
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing
properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
leesf updated HUDI-118:
-----------------------
Status: Closed (was: Patch Available)
> Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
> --------------------------------------------------------------------------------------------
>
> Key: HUDI-118
> URL: https://issues.apache.org/jira/browse/HUDI-118
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Components: CLI, Common Core, newbie
> Reporter: Balaji Varadarajan
> Assignee: Pratyaksh Sharma
> Priority: Minor
> Labels: pull-request-available
> Fix For: 0.5.1
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> For non-trivial CLI operations, we have a standalone script in hudi-utilities that users can call directly using spark-submit (usually). We also have commands in hudi-cli to invoke the commands directly from hudi-cli shell.
> There was an earlier effort to allow users to pass properties directly to the scripts in hudi-utilities but we still need to give the same functionality to the corresponding commands in hudi-cli.
> In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter command does not have option to pass DFS properties file. This is a followup to PRĀ [https://github.com/apache/incubator-hudi/pull/691]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)