You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/10/05 15:21:00 UTC
[jira] [Comment Edited] (HUDI-4982) Make bundle combination testing covered in CI
[ https://issues.apache.org/jira/browse/HUDI-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17613041#comment-17613041 ]
sivabalan narayanan edited comment on HUDI-4982 at 10/5/22 3:20 PM:
--------------------------------------------------------------------
Combinations to be tested:
# hudi-spark bundle: (all spark version)
## writes + read + hive sync
# hudi-spark bundle + hudi-utilities-slim (all diff spark versions)
## writes + read + hive sync
# hudi-hive-sync-bundle
## hive sync
# hudi-utilities-bundle(2.4, 3.1)
## writes + read + hive sync
Test set up prep:
# set up OSS spark
# set up OSS hive
# set up table if required (for eg, to test hive sync bundle)
Data generation for deltastreamer:
Use fixture table stored in some resource dir and use it.
Notes:
1 write/commit would suffice.
was (Author: shivnarayan):
Combinations to be tested:
# hudi-spark bundle: (all spark version)
## writes + read + hive sync
# hudi-spark bundle + hudi-utilities-slim (all diff spark versions)
## writes + read + hive sync
# hudi-hive-sync-bundle
## hive sync
# hudi-utilities-bundle(2.4, 3.1)
## writes + read + hive sync
Test set up prep:
# set up OSS spark
# set up OSS hive
# set up table if required (for eg, to test hive sync bundle)
Data generation for deltastreamer:
Use fixture table stored in some resource dir and use it.
> Make bundle combination testing covered in CI
> ---------------------------------------------
>
> Key: HUDI-4982
> URL: https://issues.apache.org/jira/browse/HUDI-4982
> Project: Apache Hudi
> Issue Type: Test
> Reporter: Raymond Xu
> Assignee: Jonathan Vexler
> Priority: Major
> Fix For: 0.12.2
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)