You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Lokesh Jain (Jira)" <ji...@apache.org> on 2023/03/08 10:49:00 UTC
[jira] [Commented] (HUDI-5782) Tweak defaults and remove unnecessary configs after config review
[ https://issues.apache.org/jira/browse/HUDI-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17697834#comment-17697834 ]
Lokesh Jain commented on HUDI-5782:
-----------------------------------
First PR didn't handle below configs: Need more clarity on these.
ARCHIVE_BEYOND_SAVEPOINT
BUCKET_INDEX_NUM_BUCKETS
BUCKET_INDEX_MAX_NUM_BUCKETS
BULKINSERT_ARE_PARTITIONER_RECORDS_SORTED
FILESYSTEM_LOCK_EXPIRE
ZK_BASE_PATH
SPILLABLE_MAP_BASE_PATH
WRITE_EXECUTOR_DISRUPTOR_BUFFER_LIMIT_BYTES
ALLOW_MULTI_WRITE_ON_SAME_INSTANT_ENABLE
AUTO_ADJUST_LOCK_CONFIGS
SKIP_DEFAULT_PARTITION_VALIDATION
ROLLBACK_USING_MARKERS_ENABLE - large number of callers for org.apache.hudi.config.HoodieWriteConfig.Builder#withRollbackUsingMarkers
> Tweak defaults and remove unnecessary configs after config review
> -----------------------------------------------------------------
>
> Key: HUDI-5782
> URL: https://issues.apache.org/jira/browse/HUDI-5782
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Ethan Guo
> Assignee: Lokesh Jain
> Priority: Blocker
> Fix For: 0.14.0
>
>
> See [https://github.com/apache/hudi/pull/7912/files] for more details
> Configs in scope:
> DYNAMODB_LOCK_TABLE_NAME
> DYNAMODB_LOCK_TABLE_CREATION_TIMEOUT
> ARCHIVE_BEYOND_SAVEPOINT
> PRESERVE_COMMIT_METADATA (in multiple classes)
> BLOOM_INDEX_UPDATE_PARTITION_PATH_ENABLE
> SIMPLE_INDEX_UPDATE_PARTITION_PATH_ENABLE
> BUCKET_INDEX_NUM_BUCKETS
> BUCKET_INDEX_MAX_NUM_BUCKETS
> BULKINSERT_ARE_PARTITIONER_RECORDS_SORTED
> BULKINSERT_INPUT_DATA_SCHEMA_DDL ?
> Lock Configs: LOCK_ACQUIRE_RETRY_MAX_WAIT_TIME_IN_MILLIS
> FILESYSTEM_LOCK_EXPIRE
> ZK_BASE_PATH
> SPILLABLE_MAP_BASE_PATH
> CALLBACK_HTTP_TIMEOUT_IN_SECONDS
> ROLLBACK_USING_MARKERS_ENABLE
> WRITE_EXECUTOR_DISRUPTOR_BUFFER_LIMIT_BYTES ?
> ALLOW_MULTI_WRITE_ON_SAME_INSTANT_ENABLE ?
> AUTO_ADJUST_LOCK_CONFIGS ?
> SKIP_DEFAULT_PARTITION_VALIDATION
--
This message was sent by Atlassian Jira
(v8.20.10#820010)