You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/10/09 01:28:15 UTC
[GitHub] [hudi] test-wangxiaoyu opened a new pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
test-wangxiaoyu opened a new pull request #3771:
URL: https://github.com/apache/hudi/pull/3771
**Previously hudI did not support synchronizing Kerberos-managed Hive. This time, I added two parameters to hudI sync Hive Meta to support synchronizing Kerberos-managed Hive,Supports JDBC and HMS modes**
**The new parameters**:
1) hive_sync.use_kerberos (default false,true: Enables the Kerberos function of Hive Sync)
2) hive_sync.kerberos_principal (Connected to hive Principal, note!Peincipal is not the Principal used by Hive)
**Flink sample**:
CREATE TABLE t1(
uuid VARCHAR(20),
name VARCHAR(10),
age INT,
ts TIMESTAMP(3),
`partition` VARCHAR(20)
)
PARTITIONED BY (`partition`)
with(
'connector' = 'hudi',
'hive_sync.enable'='true',
'hive_sync.db'='test',
'hive_sync.table'='t1',
'hive_sync.mode'='hms',
'path' = 'hdfs://ip:8020/warehouse/hudi/t1',
'hive_sync.metastore.uris'='thrift://ip:9083',
'hive_sync.use_kerberos' = 'true',
'hive_sync.kerberos_principal' = 'hive/_HOST@BIGDATA'
)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-957117077
@test-wangxiaoyu Can you rebase with master? There was an issue which was causing CI failure which has now been fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r754850036
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieWriterUtils.scala
##########
@@ -84,6 +85,46 @@ object HoodieWriterUtils {
HIVE_SYNC_USE_KERBEROS.key -> HIVE_SYNC_USE_KERBEROS.defaultValue,
HIVE_SYNC_KERBEROS_PRINCIPAL.key -> HIVE_SYNC_KERBEROS_PRINCIPAL.defaultValue
) ++ DataSourceOptionsHelper.translateConfigurations(parameters)
+
+ val globalProps = DFSPropertiesConfiguration.getGlobalProps.asScala
Review comment:
Not following this change. Why is L90-L127 needed?
I see that it's in your latest merge commit from master. But I don't see the same change in master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b4808aaf973608255c97e1eb1f46ff04d9bb4bee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976311806
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634)
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976368835
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-959005707
@test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
```
[ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
java.lang.IllegalArgumentException: Can't get Kerberos realm
at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-957117077
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r740865098
##########
File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java
##########
@@ -1017,4 +1019,36 @@ public void testTypeConverter(String syncMode) throws Exception {
.containsValue("BIGINT"), errorMsg);
ddlExecutor.runSQL(dropTableSql);
}
+
+ @Test
+ public void testHiveSyncOfKerberosEnvironment() throws Exception {
+ // Path to the krb5 file
+ String ker5Path = "/krb5.conf";
+ // Path to the user keytab file
+ String principal = "/test.keytab";
+ // User Principal
+ String keytabPath = "test@HADOOP";
+ // Kerberos authentication of the client
+ System.setProperty("java.security.krb5.conf", ker5Path);
+ Configuration conf = new Configuration();
+ conf.set("hadoop.security.authentication", "kerberos");
+ UserGroupInformation.setConfiguration(conf);
+ UserGroupInformation.loginUserFromKeytab(principal, keytabPath);
+ // If flink or Spark is used, you need to use the Kerberos authentication method recommended by Flink or Spark
+
+ // Setting Kerberos Parameters
+ // Hive Principal
+ String hivePrincipal = "hive@HADOOP";
+ HiveTestUtil.hiveSyncConfig.useKerberos = true;
+ HiveTestUtil.hiveSyncConfig.kerberosPrincipal = hivePrincipal;
+ HiveSyncTool hiveSyncTool = new HiveSyncTool(hiveSyncConfig, HiveTestUtil.getHiveConf(), HiveTestUtil.fileSystem);
+ HoodieHiveClient hoodieHiveClient = hiveSyncTool.hoodieHiveClient;
+
+ // Create a database in Hive. If the database is created successfully
+ // the client synchronizes the Kerberos metadata for managing Hive
+ hoodieHiveClient.createDatabase(hiveSyncConfig.databaseName);
+
+ assert !hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName) : "Database creation failed!";
Review comment:
Shouldn't we actually assert that database exists instead of **!** condition? Why not simply write as below?
```
assertTrue(hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName));
```
This is in convention with other tests.
##########
File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java
##########
@@ -1017,4 +1019,36 @@ public void testTypeConverter(String syncMode) throws Exception {
.containsValue("BIGINT"), errorMsg);
ddlExecutor.runSQL(dropTableSql);
}
+
+ @Test
+ public void testHiveSyncOfKerberosEnvironment() throws Exception {
+ // Path to the krb5 file
+ String ker5Path = "/krb5.conf";
+ // Path to the user keytab file
+ String principal = "/test.keytab";
+ // User Principal
+ String keytabPath = "test@HADOOP";
+ // Kerberos authentication of the client
+ System.setProperty("java.security.krb5.conf", ker5Path);
+ Configuration conf = new Configuration();
+ conf.set("hadoop.security.authentication", "kerberos");
+ UserGroupInformation.setConfiguration(conf);
+ UserGroupInformation.loginUserFromKeytab(principal, keytabPath);
+ // If flink or Spark is used, you need to use the Kerberos authentication method recommended by Flink or Spark
+
+ // Setting Kerberos Parameters
+ // Hive Principal
+ String hivePrincipal = "hive@HADOOP";
+ HiveTestUtil.hiveSyncConfig.useKerberos = true;
+ HiveTestUtil.hiveSyncConfig.kerberosPrincipal = hivePrincipal;
+ HiveSyncTool hiveSyncTool = new HiveSyncTool(hiveSyncConfig, HiveTestUtil.getHiveConf(), HiveTestUtil.fileSystem);
+ HoodieHiveClient hoodieHiveClient = hiveSyncTool.hoodieHiveClient;
+
+ // Create a database in Hive. If the database is created successfully
+ // the client synchronizes the Kerberos metadata for managing Hive
+ hoodieHiveClient.createDatabase(hiveSyncConfig.databaseName);
+
+ assert !hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName) : "Database creation failed!";
+ System.out.println("Database created successfully: " + hiveSyncConfig.databaseName);
Review comment:
Please remove the println statement. Consider using logger if necessary.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-957242076
> @test-wangxiaoyu Can you rebase with master? There was an issue which was causing CI failure which has now been fixed.
Okay, I've done what you said
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-957242076
> @test-wangxiaoyu Can you rebase with master? There was an issue which was causing CI failure which has now been fixed.
Okay, I've done what you said
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-959358098
> @test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
>
> ```
> [ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
> java.lang.IllegalArgumentException: Can't get Kerberos realm
> at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
> ```
This error is due to a problem with your KRB5 file. You need to check whether krB5 contains Realms properties and whether realms addresses can be connected
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057803452
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
}, {
"hash" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6493",
"triggerID" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* f4334c1cb9dff69f4fd29998b708e6c9945a008d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6493)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976109823
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-977343731
> >
>
> > > > > > @test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
> > > > > > ```
> > > > > > [ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
> > > > > > java.lang.IllegalArgumentException: Can't get Kerberos realm
> > > > > > at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
> > > > > > ```
> > > > >
> > > > >
> > > > > This error is due to a problem with your KRB5 file. You need to check whether krB5 contains Realms properties and whether realms addresses can be connected
> > > >
> > > >
> > > > @test-wangxiaoyu In that case, I would avoid tests that are dependent on environment. Is there a way to make this independent of env, e.g. using mock for krb realm? Also, if you could resolve the conflicts, that would be great. We would like to take this in the upcoming release.
> > >
> > >
> > > I have resolved the conflict. Sorry, the mock for Krb Realm is too difficult to implement, kerberos is a complex system
> >
> >
> > Is it possible to add the needed files with dummy values under src/tst/resources? From the test it looks like we need krb5.conf and keytab files. If kerberos server is needed then please consider Apache's embedded directory server which supports kerberos protocol. If this is something which is a time-consuming task then please create a JIRA and disable the test here. Can you please share how you have tested the change?
>
> Okay, no problem
>
> The test environment hadoop 3.1.1 hive 3.1.0 Flink 1.13.2 kerbero 1.10.3-30
>
> Hadoop and Hive use Kerberos for permission management The FlinkSQL Client has performed Kerberos permission authentication ,In COW and MOR mode, the hive_sync.mode parameters are JDBC and HMS, and the Hive synchronization metadata and Hudi table data in Hive are normal. The following is the Flink SQL test SQL
>
> CREATE TABLE t1( uuid VARCHAR(20), name VARCHAR(10, age INT, ts TIMESTAMP(3), `partition` VARCHAR(20) ) PARTITIONED BY (`partition`) with( + 'connector' = 'hudi', 'hive_sync.enable'='true', 'hive_sync.db'='test', 'hive_sync.table'='t1', 'hive_sync.mode'='hms', 'path' = 'hdfs://ip/warehouse/hudi/t1', 'hive_sync.metastore.uris'='thrift://ip:9083', 'hive_sync.use_jdbc'='true', 'hive_sync.use_kerberos' = 'true', 'hive_sync.kerberos_principal' = 'hive/_HOST@BIGDATA', 'read.streaming.enabled' = 'true', 'read.streaming.check-interval' = '4' )
>
> INSERT INTO t1 VALUES ('id1','Danny',23,TIMESTAMP '1970-01-01 00:00:01','par1'), ('id2','Stephen',33,TIMESTAMP '1970-01-01 00:00:02','par1'), ('id3','Julian',53,TIMESTAMP '1970-01-01 00:00:03','par2'), ('id4','Fabian',31,TIMESTAMP '1970-01-01 00:00:04','par2'), ('id5','Sophia',18,TIMESTAMP '1970-01-01 00:00:05','par3'), ('id6','Emma',20,TIMESTAMP '1970-01-01 00:00:06','par3'), ('id7','Bob',44,TIMESTAMP '1970-01-01 00:00:07','par4'), ('id8','Han',56,TIMESTAMP '1970-01-01 00:00:08','par4')
Add that the source of this Hive Kerberos parameter is hive2.3.6 source code, I am currently using hive version 3.1.0, that is, hive2.3.6-3.1.0 using this parameter to do kerberos permission authentication is no problem
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976165942
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976236686
>
> > > > > @test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
> > > > > ```
> > > > > [ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
> > > > > java.lang.IllegalArgumentException: Can't get Kerberos realm
> > > > > at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
> > > > > ```
> > > >
> > > >
> > > > This error is due to a problem with your KRB5 file. You need to check whether krB5 contains Realms properties and whether realms addresses can be connected
> > >
> > >
> > > @test-wangxiaoyu In that case, I would avoid tests that are dependent on environment. Is there a way to make this independent of env, e.g. using mock for krb realm? Also, if you could resolve the conflicts, that would be great. We would like to take this in the upcoming release.
> >
> >
> > I have resolved the conflict. Sorry, the mock for Krb Realm is too difficult to implement, kerberos is a complex system
>
> Is it possible to add the needed files with dummy values under src/tst/resources? From the test it looks like we need krb5.conf and keytab files. If kerberos server is needed then please consider Apache's embedded directory server which supports kerberos protocol. If this is something which is a time-consuming task then please create a JIRA and disable the test here. Can you please share how you have tested the change?
Okay, no problem
The test environment
hadoop 3.1.1
hive 3.1.0
Flink 1.13.2
kerbero 1.10.3-30
Hadoop and Hive use Kerberos for permission management
The FlinkSQL Client has performed Kerberos permission authentication
,In COW and MOR mode, the hive_sync.mode parameters are JDBC and HMS, and the Hive synchronization metadata and Hudi table data in Hive are normal. The following is the Flink SQL test SQL
CREATE TABLE t1(
uuid VARCHAR(20),
name VARCHAR(10,
age INT,
ts TIMESTAMP(3),
`partition` VARCHAR(20)
)
PARTITIONED BY (`partition`)
with( +
'connector' = 'hudi',
'hive_sync.enable'='true',
'hive_sync.db'='test',
'hive_sync.table'='t1',
'hive_sync.mode'='hms',
'path' = 'hdfs://ip/warehouse/hudi/t1',
'hive_sync.metastore.uris'='thrift://ip:9083',
'hive_sync.use_jdbc'='true',
'hive_sync.use_kerberos' = 'true',
'hive_sync.kerberos_principal' = 'hive/_HOST@BIGDATA',
'read.streaming.enabled' = 'true',
'read.streaming.check-interval' = '4'
)
INSERT INTO t1 VALUES
('id1','Danny',23,TIMESTAMP '1970-01-01 00:00:01','par1'),
('id2','Stephen',33,TIMESTAMP '1970-01-01 00:00:02','par1'),
('id3','Julian',53,TIMESTAMP '1970-01-01 00:00:03','par2'),
('id4','Fabian',31,TIMESTAMP '1970-01-01 00:00:04','par2'),
('id5','Sophia',18,TIMESTAMP '1970-01-01 00:00:05','par3'),
('id6','Emma',20,TIMESTAMP '1970-01-01 00:00:06','par3'),
('id7','Bob',44,TIMESTAMP '1970-01-01 00:00:07','par4'),
('id8','Han',56,TIMESTAMP '1970-01-01 00:00:08','par4')
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b4808aaf973608255c97e1eb1f46ff04d9bb4bee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556)
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* c2bc8115f70b89dfc31f27645f98cfbff8d79c0f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiaozhch5 commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
xiaozhch5 commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r818259563
##########
File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java
##########
@@ -77,6 +77,10 @@ public HiveSyncTool(HiveSyncConfig cfg, HiveConf configuration, FileSystem fs) {
super(configuration.getAllProperties(), fs);
try {
+ if (cfg.useKerberos) {
+ configuration.set("hive.metastore.sasl.enabled", "true");
+ configuration.set("hive.metastore.kerberos.principal", cfg.kerberosPrincipal);
Review comment:
Well done! After I corrected flink configuration parameters, I successfully synchronized data to Hive using your configuration!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b4808aaf973608255c97e1eb1f46ff04d9bb4bee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b4808aaf973608255c97e1eb1f46ff04d9bb4bee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556)
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b4808aaf973608255c97e1eb1f46ff04d9bb4bee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556)
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* c2bc8115f70b89dfc31f27645f98cfbff8d79c0f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976109823
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976118607
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976256298
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634)
* a08552b966fbb4fddf98ecbe2d94996679f73365 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-957117077
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
danny0405 commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1055017841
Hi @nsivabalan , many users report this issue so i mark this PR as blocker for release-0.11
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057761850
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
}, {
"hash" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490)
* f4334c1cb9dff69f4fd29998b708e6c9945a008d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057747910
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
danny0405 commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-954834444
> > > @test-wangxiaoyu The test you added is failing in CI. Can you please fix that?
> > > CI failed because the variable name I named in test does not meet checkstyle check, I have changed the variable name
>
> I need an administrator with authority to assign a Workflow for my submitted code
done ~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 15a0a763aae6dec5147f8081175d0c995d9a0e5d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704)
* 614de53d1fc7b601fbdc21ffd71bf4a3606f794d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976311806
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634)
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r730753592
##########
File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java
##########
@@ -1017,4 +1019,34 @@ public void testTypeConverter(String syncMode) throws Exception {
.containsValue("BIGINT"), errorMsg);
ddlExecutor.runSQL(dropTableSql);
}
+
+ @Test
+ public void testHiveSyncOfKerberosEnvironment() throws Exception {
+ // Path to the krb5 file
+ String KER5_PATH = "/krb5.conf";
+ // Path to the user keytab file
+ String PRINCIPAL = "/test.keytab";
+ // User Principal
+ String KEYTAB_PATH = "test@HADOOP";
+ // Kerberos authentication of the client
+ System.setProperty("java.security.krb5.conf", KER5_PATH);
+ Configuration conf = new Configuration();
+ conf.set("hadoop.security.authentication", "kerberos");
+ UserGroupInformation.setConfiguration(conf);
+ UserGroupInformation.loginUserFromKeytab(PRINCIPAL, KEYTAB_PATH);
+ // If flink or Spark is used, you need to use the Kerberos authentication method recommended by Flink or Spark
+
+ // Setting Kerberos Parameters
+ // Hive Principal
+ String HIVE_PRINCIPAL = "hive@HADOOP";
+ HiveTestUtil.hiveSyncConfig.useKerberos = true;
+ HiveTestUtil.hiveSyncConfig.kerberosPrincipal = HIVE_PRINCIPAL;
+ HiveSyncTool hiveSyncTool = new HiveSyncTool(hiveSyncConfig, HiveTestUtil.getHiveConf(), HiveTestUtil.fileSystem);
+ HoodieHiveClient hoodieHiveClient = hiveSyncTool.hoodieHiveClient;
+
+ // Create a database in Hive. If the database is created successfully
+ // the client synchronizes the Kerberos metadata for managing Hive
+ hoodieHiveClient.createDatabase(hiveSyncConfig.databaseName);
+
Review comment:
Ok, I added Assert to determine if the database was created
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-957810936
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-961589777
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* c2bc8115f70b89dfc31f27645f98cfbff8d79c0f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646)
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 614de53d1fc7b601fbdc21ffd71bf4a3606f794d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842)
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 15a0a763aae6dec5147f8081175d0c995d9a0e5d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704)
* 614de53d1fc7b601fbdc21ffd71bf4a3606f794d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-954826379
> > @test-wangxiaoyu The test you added is failing in CI. Can you please fix that?
> > CI failed because the variable name I named in test does not meet checkstyle check, I have changed the variable name
I need an administrator with authority to assign a Workflow for my submitted code
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-961589777
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-961589777
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057754873
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976368835
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiaozhch5 commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
xiaozhch5 commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r817901694
##########
File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java
##########
@@ -77,6 +77,10 @@ public HiveSyncTool(HiveSyncConfig cfg, HiveConf configuration, FileSystem fs) {
super(configuration.getAllProperties(), fs);
try {
+ if (cfg.useKerberos) {
+ configuration.set("hive.metastore.sasl.enabled", "true");
+ configuration.set("hive.metastore.kerberos.principal", cfg.kerberosPrincipal);
Review comment:
Hello, I tested the PR and could not sync HUDi to Hive3, but I managed to do so using the following parameters and modifying the configuration.
```java
if (cfg.enableKerberos) {
System.setProperty("java.security.krb5.conf", cfg.krb5Conf);
Configuration conf = new Configuration();
conf.set("hadoop.security.authentication", "kerberos");
conf.set("kerberos.principal", cfg.principal);
UserGroupInformation.setConfiguration(conf);
UserGroupInformation.loginUserFromKeytab(cfg.keytabName, cfg.keytabFile);
configuration.set(HiveConf.ConfVars.METASTORE_USE_THRIFT_SASL.varname, "true");
configuration.set(HiveConf.ConfVars.METASTORE_KERBEROS_PRINCIPAL.varname, cfg.principal);
configuration.set(HiveConf.ConfVars.METASTORE_KERBEROS_KEYTAB_FILE.varname, cfg.keytabFile);
}
```
The following is an explanation of each parameter:
* cfg.krb5Conf: The location of krb5.conf, /etc/krb5.conf, by default.
* cfg.principal: Hive metastore principal, such as hive/_HOST@EXAMPLE.COM
* cfg.keytabFile: Hive MetaStore keytab used to submit tasks to host assigned
* cfg.keytabName: Corresponds to the principal of the keytab above, such as hive/host144
Before starting the flink cluster, I distribute the hive metastore keytab to the cluster of the same location, such as, /home/keydir/hive/hive.service.keytab.
And afterwards, I start a flink cluster with yarn session mode using the hive metastore keytab, and submit the SQLs to the Cluster.
```sql
CREATE TABLE sourceT (
uuid varchar(20),
name varchar(10),
age int,
ts timestamp(3),
`partition` varchar(20)
) WITH (
'connector' = 'datagen',
'rows-per-second' = '1'
);
create table t2(
uuid varchar(20),
name varchar(10),
age int,
ts timestamp(3),
`partition` varchar(20)
)
with (
'connector' = 'hudi',
'path' = 'hdfs://host146:8020/tmp/t2',
'table.type' = 'MERGE_ON_READ',
'write.bucket_assign.tasks' = '2',
'write.tasks' = '2',
'hive_sync.enable' = 'true',
'hive_sync.mode' = 'hms',
'hive_sync.metastore.uris' = 'thrift://host145:9083',
'hive_sync.db' = 'default',
'hive_sync.table' = 't2',
'hive_sync.kerberos.enable' = 'true',
'hive_sync.kerberos.krb5.conf' = '/etc/krb5.conf',
'hive_sync.kerberos.principal' = 'hive/_HOST@HDP.COM',
'hive_sync.kerberos.keytab.file' = '/home/keydir/hive/hive.service.keytab',
'hive_sync.kerberos.keytab.name' = 'hive/host144'
);
insert into t2 select * from sourceT;
```
The result is like below:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
danny0405 commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057606418
@test-wangxiaoyu can you rebase the master code and force push again, i'm planning to review this PR again ~
the `commands`:
`git fetch upstream master`
`git rebase upstream/master`
-- fix and resolve the conflicts
`git push origin ${your_branch} --force`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057761850
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
}, {
"hash" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490)
* f4334c1cb9dff69f4fd29998b708e6c9945a008d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976224673
> > > > @test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
> > > > ```
> > > > [ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
> > > > java.lang.IllegalArgumentException: Can't get Kerberos realm
> > > > at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
> > > > ```
> > >
> > >
> > > This error is due to a problem with your KRB5 file. You need to check whether krB5 contains Realms properties and whether realms addresses can be connected
> >
> >
> > @test-wangxiaoyu In that case, I would avoid tests that are dependent on environment. Is there a way to make this independent of env, e.g. using mock for krb realm? Also, if you could resolve the conflicts, that would be great. We would like to take this in the upcoming release.
>
> I have resolved the conflict. Sorry, the mock for Krb Realm is too difficult to implement, kerberos is a complex system
Is it possible to add the needed files with dummy values under src/tst/resources? From the test it looks like we need krb5.conf and keytab files. If kerberos server is needed then please consider Apache's embedded directory server which supports kerberos protocol. If this is something which is a time-consuming task then please create a JIRA and disable the test here. Can you please share how you have tested the change?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-961589777
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976256298
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634)
* a08552b966fbb4fddf98ecbe2d94996679f73365 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-957242076
> @test-wangxiaoyu Can you rebase with master? There was an issue which was causing CI failure which has now been fixed.
Okay, I've done what you said
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-959358098
> @test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
>
> ```
> [ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
> java.lang.IllegalArgumentException: Can't get Kerberos realm
> at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
> ```
This error is due to a problem with your KRB5 file. You need to check whether krB5 contains Realms properties and whether realms addresses can be connected
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r754856973
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieWriterUtils.scala
##########
@@ -84,6 +85,46 @@ object HoodieWriterUtils {
HIVE_SYNC_USE_KERBEROS.key -> HIVE_SYNC_USE_KERBEROS.defaultValue,
HIVE_SYNC_KERBEROS_PRINCIPAL.key -> HIVE_SYNC_KERBEROS_PRINCIPAL.defaultValue
) ++ DataSourceOptionsHelper.translateConfigurations(parameters)
+
+ val globalProps = DFSPropertiesConfiguration.getGlobalProps.asScala
Review comment:
This is the information that I handled on the github interface, and the information that was written by the code conflict, github, I just resubmitted the code of the master branch and resubmitted it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-975601135
> > @test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
> > ```
> > [ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
> > java.lang.IllegalArgumentException: Can't get Kerberos realm
> > at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
> > ```
>
> This error is due to a problem with your KRB5 file. You need to check whether krB5 contains Realms properties and whether realms addresses can be connected
@test-wangxiaoyu In that case, I would avoid tests that are dependent on environment. Is there a way to make this independent of env, e.g. using mock for krb realm?
Also, if you could resolve the conflicts, that would be great. We would like to take this in the upcoming release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r728752802
##########
File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java
##########
@@ -77,6 +77,10 @@ public HiveSyncTool(HiveSyncConfig cfg, HiveConf configuration, FileSystem fs) {
super(configuration.getAllProperties(), fs);
try {
+ if (cfg.useKerberos) {
+ configuration.set("hive.metastore.sasl.enabled", "true");
+ configuration.set("hive.metastore.kerberos.principal", cfg.kerberosPrincipal);
Review comment:
Let's validate that `cfg.kerberosPrincipal` is not null in this case.
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/DataSourceUtils.java
##########
@@ -307,6 +307,10 @@ public static HiveSyncConfig buildHiveSyncConfig(TypedProperties props, String b
DataSourceWriteOptions.HIVE_SKIP_RO_SUFFIX_FOR_READ_OPTIMIZED_TABLE().defaultValue()));
hiveSyncConfig.supportTimestamp = Boolean.valueOf(props.getString(DataSourceWriteOptions.HIVE_SUPPORT_TIMESTAMP_TYPE().key(),
DataSourceWriteOptions.HIVE_SUPPORT_TIMESTAMP_TYPE().defaultValue()));
+ hiveSyncConfig.useKerberos =
+ Boolean.valueOf(props.getString(DataSourceWriteOptions.HIVE_SYNC_USE_KERBEROS().key(),DataSourceWriteOptions.HIVE_SYNC_USE_KERBEROS().defaultValue()));
+ hiveSyncConfig.kerberosPrincipal =
+ props.getString(DataSourceWriteOptions.HIVE_SYNC_KERBEROS_PRINCIPAL().key(), DataSourceWriteOptions.HIVE_SYNC_KERBEROS_PRINCIPAL().defaultValue());
Review comment:
`HIVE_SYNC_KERBEROS_PRINCIPAL` has null default value. This might throw HoodieException. Maybe, we can set EMPTY_STRING as default and validate in HiveSyncTool that this config is not null or empty when `HIVE_SYNC_USE_KERBEROS` is true.
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/DataSourceUtils.java
##########
@@ -307,6 +307,10 @@ public static HiveSyncConfig buildHiveSyncConfig(TypedProperties props, String b
DataSourceWriteOptions.HIVE_SKIP_RO_SUFFIX_FOR_READ_OPTIMIZED_TABLE().defaultValue()));
hiveSyncConfig.supportTimestamp = Boolean.valueOf(props.getString(DataSourceWriteOptions.HIVE_SUPPORT_TIMESTAMP_TYPE().key(),
DataSourceWriteOptions.HIVE_SUPPORT_TIMESTAMP_TYPE().defaultValue()));
+ hiveSyncConfig.useKerberos =
+ Boolean.valueOf(props.getString(DataSourceWriteOptions.HIVE_SYNC_USE_KERBEROS().key(),DataSourceWriteOptions.HIVE_SYNC_USE_KERBEROS().defaultValue()));
Review comment:
Can we add a unit test in TestDataSourceUtils or TestHiveSyncTool?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r728802039
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/DataSourceUtils.java
##########
@@ -307,6 +307,10 @@ public static HiveSyncConfig buildHiveSyncConfig(TypedProperties props, String b
DataSourceWriteOptions.HIVE_SKIP_RO_SUFFIX_FOR_READ_OPTIMIZED_TABLE().defaultValue()));
hiveSyncConfig.supportTimestamp = Boolean.valueOf(props.getString(DataSourceWriteOptions.HIVE_SUPPORT_TIMESTAMP_TYPE().key(),
DataSourceWriteOptions.HIVE_SUPPORT_TIMESTAMP_TYPE().defaultValue()));
+ hiveSyncConfig.useKerberos =
+ Boolean.valueOf(props.getString(DataSourceWriteOptions.HIVE_SYNC_USE_KERBEROS().key(),DataSourceWriteOptions.HIVE_SYNC_USE_KERBEROS().defaultValue()));
Review comment:
I added in the TestHiveSyncTool testHiveSyncOfKerberosEnvironment method is used to test
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r730745244
##########
File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java
##########
@@ -1017,4 +1019,34 @@ public void testTypeConverter(String syncMode) throws Exception {
.containsValue("BIGINT"), errorMsg);
ddlExecutor.runSQL(dropTableSql);
}
+
+ @Test
+ public void testHiveSyncOfKerberosEnvironment() throws Exception {
+ // Path to the krb5 file
+ String KER5_PATH = "/krb5.conf";
+ // Path to the user keytab file
+ String PRINCIPAL = "/test.keytab";
+ // User Principal
+ String KEYTAB_PATH = "test@HADOOP";
+ // Kerberos authentication of the client
+ System.setProperty("java.security.krb5.conf", KER5_PATH);
+ Configuration conf = new Configuration();
+ conf.set("hadoop.security.authentication", "kerberos");
+ UserGroupInformation.setConfiguration(conf);
+ UserGroupInformation.loginUserFromKeytab(PRINCIPAL, KEYTAB_PATH);
+ // If flink or Spark is used, you need to use the Kerberos authentication method recommended by Flink or Spark
+
+ // Setting Kerberos Parameters
+ // Hive Principal
+ String HIVE_PRINCIPAL = "hive@HADOOP";
+ HiveTestUtil.hiveSyncConfig.useKerberos = true;
+ HiveTestUtil.hiveSyncConfig.kerberosPrincipal = HIVE_PRINCIPAL;
+ HiveSyncTool hiveSyncTool = new HiveSyncTool(hiveSyncConfig, HiveTestUtil.getHiveConf(), HiveTestUtil.fileSystem);
+ HoodieHiveClient hoodieHiveClient = hiveSyncTool.hoodieHiveClient;
+
+ // Create a database in Hive. If the database is created successfully
+ // the client synchronizes the Kerberos metadata for managing Hive
+ hoodieHiveClient.createDatabase(hiveSyncConfig.databaseName);
+
Review comment:
In the end could you also assert that database got created? Something like:
```
assertTrue(hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName));
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 15a0a763aae6dec5147f8081175d0c995d9a0e5d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057801176
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
}, {
"hash" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6493",
"triggerID" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490)
* f4334c1cb9dff69f4fd29998b708e6c9945a008d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6493)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057801176
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
}, {
"hash" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6493",
"triggerID" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490)
* f4334c1cb9dff69f4fd29998b708e6c9945a008d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6493)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 614de53d1fc7b601fbdc21ffd71bf4a3606f794d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r740865098
##########
File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java
##########
@@ -1017,4 +1019,36 @@ public void testTypeConverter(String syncMode) throws Exception {
.containsValue("BIGINT"), errorMsg);
ddlExecutor.runSQL(dropTableSql);
}
+
+ @Test
+ public void testHiveSyncOfKerberosEnvironment() throws Exception {
+ // Path to the krb5 file
+ String ker5Path = "/krb5.conf";
+ // Path to the user keytab file
+ String principal = "/test.keytab";
+ // User Principal
+ String keytabPath = "test@HADOOP";
+ // Kerberos authentication of the client
+ System.setProperty("java.security.krb5.conf", ker5Path);
+ Configuration conf = new Configuration();
+ conf.set("hadoop.security.authentication", "kerberos");
+ UserGroupInformation.setConfiguration(conf);
+ UserGroupInformation.loginUserFromKeytab(principal, keytabPath);
+ // If flink or Spark is used, you need to use the Kerberos authentication method recommended by Flink or Spark
+
+ // Setting Kerberos Parameters
+ // Hive Principal
+ String hivePrincipal = "hive@HADOOP";
+ HiveTestUtil.hiveSyncConfig.useKerberos = true;
+ HiveTestUtil.hiveSyncConfig.kerberosPrincipal = hivePrincipal;
+ HiveSyncTool hiveSyncTool = new HiveSyncTool(hiveSyncConfig, HiveTestUtil.getHiveConf(), HiveTestUtil.fileSystem);
+ HoodieHiveClient hoodieHiveClient = hiveSyncTool.hoodieHiveClient;
+
+ // Create a database in Hive. If the database is created successfully
+ // the client synchronizes the Kerberos metadata for managing Hive
+ hoodieHiveClient.createDatabase(hiveSyncConfig.databaseName);
+
+ assert !hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName) : "Database creation failed!";
Review comment:
Shouldn't we actually assert that database exists instead of **!** condition? Why not simply write as below?
```
assertTrue(hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName));
```
This is in convention with other tests.
##########
File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java
##########
@@ -1017,4 +1019,36 @@ public void testTypeConverter(String syncMode) throws Exception {
.containsValue("BIGINT"), errorMsg);
ddlExecutor.runSQL(dropTableSql);
}
+
+ @Test
+ public void testHiveSyncOfKerberosEnvironment() throws Exception {
+ // Path to the krb5 file
+ String ker5Path = "/krb5.conf";
+ // Path to the user keytab file
+ String principal = "/test.keytab";
+ // User Principal
+ String keytabPath = "test@HADOOP";
+ // Kerberos authentication of the client
+ System.setProperty("java.security.krb5.conf", ker5Path);
+ Configuration conf = new Configuration();
+ conf.set("hadoop.security.authentication", "kerberos");
+ UserGroupInformation.setConfiguration(conf);
+ UserGroupInformation.loginUserFromKeytab(principal, keytabPath);
+ // If flink or Spark is used, you need to use the Kerberos authentication method recommended by Flink or Spark
+
+ // Setting Kerberos Parameters
+ // Hive Principal
+ String hivePrincipal = "hive@HADOOP";
+ HiveTestUtil.hiveSyncConfig.useKerberos = true;
+ HiveTestUtil.hiveSyncConfig.kerberosPrincipal = hivePrincipal;
+ HiveSyncTool hiveSyncTool = new HiveSyncTool(hiveSyncConfig, HiveTestUtil.getHiveConf(), HiveTestUtil.fileSystem);
+ HoodieHiveClient hoodieHiveClient = hiveSyncTool.hoodieHiveClient;
+
+ // Create a database in Hive. If the database is created successfully
+ // the client synchronizes the Kerberos metadata for managing Hive
+ hoodieHiveClient.createDatabase(hiveSyncConfig.databaseName);
+
+ assert !hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName) : "Database creation failed!";
+ System.out.println("Database created successfully: " + hiveSyncConfig.databaseName);
Review comment:
Please remove the println statement. Consider using logger if necessary.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r740865098
##########
File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java
##########
@@ -1017,4 +1019,36 @@ public void testTypeConverter(String syncMode) throws Exception {
.containsValue("BIGINT"), errorMsg);
ddlExecutor.runSQL(dropTableSql);
}
+
+ @Test
+ public void testHiveSyncOfKerberosEnvironment() throws Exception {
+ // Path to the krb5 file
+ String ker5Path = "/krb5.conf";
+ // Path to the user keytab file
+ String principal = "/test.keytab";
+ // User Principal
+ String keytabPath = "test@HADOOP";
+ // Kerberos authentication of the client
+ System.setProperty("java.security.krb5.conf", ker5Path);
+ Configuration conf = new Configuration();
+ conf.set("hadoop.security.authentication", "kerberos");
+ UserGroupInformation.setConfiguration(conf);
+ UserGroupInformation.loginUserFromKeytab(principal, keytabPath);
+ // If flink or Spark is used, you need to use the Kerberos authentication method recommended by Flink or Spark
+
+ // Setting Kerberos Parameters
+ // Hive Principal
+ String hivePrincipal = "hive@HADOOP";
+ HiveTestUtil.hiveSyncConfig.useKerberos = true;
+ HiveTestUtil.hiveSyncConfig.kerberosPrincipal = hivePrincipal;
+ HiveSyncTool hiveSyncTool = new HiveSyncTool(hiveSyncConfig, HiveTestUtil.getHiveConf(), HiveTestUtil.fileSystem);
+ HoodieHiveClient hoodieHiveClient = hiveSyncTool.hoodieHiveClient;
+
+ // Create a database in Hive. If the database is created successfully
+ // the client synchronizes the Kerberos metadata for managing Hive
+ hoodieHiveClient.createDatabase(hiveSyncConfig.databaseName);
+
+ assert !hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName) : "Database creation failed!";
Review comment:
Shouldn't we actually assert that database exists instead of **!** condition? Why not simply write as below?
```
assertTrue(hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName));
```
This is in convention with other tests.
##########
File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java
##########
@@ -1017,4 +1019,36 @@ public void testTypeConverter(String syncMode) throws Exception {
.containsValue("BIGINT"), errorMsg);
ddlExecutor.runSQL(dropTableSql);
}
+
+ @Test
+ public void testHiveSyncOfKerberosEnvironment() throws Exception {
+ // Path to the krb5 file
+ String ker5Path = "/krb5.conf";
+ // Path to the user keytab file
+ String principal = "/test.keytab";
+ // User Principal
+ String keytabPath = "test@HADOOP";
+ // Kerberos authentication of the client
+ System.setProperty("java.security.krb5.conf", ker5Path);
+ Configuration conf = new Configuration();
+ conf.set("hadoop.security.authentication", "kerberos");
+ UserGroupInformation.setConfiguration(conf);
+ UserGroupInformation.loginUserFromKeytab(principal, keytabPath);
+ // If flink or Spark is used, you need to use the Kerberos authentication method recommended by Flink or Spark
+
+ // Setting Kerberos Parameters
+ // Hive Principal
+ String hivePrincipal = "hive@HADOOP";
+ HiveTestUtil.hiveSyncConfig.useKerberos = true;
+ HiveTestUtil.hiveSyncConfig.kerberosPrincipal = hivePrincipal;
+ HiveSyncTool hiveSyncTool = new HiveSyncTool(hiveSyncConfig, HiveTestUtil.getHiveConf(), HiveTestUtil.fileSystem);
+ HoodieHiveClient hoodieHiveClient = hiveSyncTool.hoodieHiveClient;
+
+ // Create a database in Hive. If the database is created successfully
+ // the client synchronizes the Kerberos metadata for managing Hive
+ hoodieHiveClient.createDatabase(hiveSyncConfig.databaseName);
+
+ assert !hoodieHiveClient.doesDataBaseExist(hiveSyncConfig.databaseName) : "Database creation failed!";
+ System.out.println("Database created successfully: " + hiveSyncConfig.databaseName);
Review comment:
Please remove the println statement. Consider using logger if necessary.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-959005707
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b4808aaf973608255c97e1eb1f46ff04d9bb4bee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* c2bc8115f70b89dfc31f27645f98cfbff8d79c0f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r818224037
##########
File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java
##########
@@ -77,6 +77,10 @@ public HiveSyncTool(HiveSyncConfig cfg, HiveConf configuration, FileSystem fs) {
super(configuration.getAllProperties(), fs);
try {
+ if (cfg.useKerberos) {
+ configuration.set("hive.metastore.sasl.enabled", "true");
+ configuration.set("hive.metastore.kerberos.principal", cfg.kerberosPrincipal);
Review comment:
I designed to configure the Fkink permission authentication to the cluster level. Our Flink cluster has already configured Kerberos, so we only need to configure the Meta Client Principal of Hive to connect.If Kerberos permission authentication is not configured for the Flink cluster, authentication must be performed at the Task level.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057754873
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057747910
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1029981058
@codope : may I know whats pending wrt this patch. Can you follow up with author and see if we can drive this home please.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1083653922
Removing from blockers. Discussed offline with @xushiyan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939231215
**To synchronize kerberos-managed Hive metadata, the Flink cluster must perform Kerberos authentication first and then use my new parameters**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on a change in pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#discussion_r728800351
##########
File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java
##########
@@ -77,6 +77,10 @@ public HiveSyncTool(HiveSyncConfig cfg, HiveConf configuration, FileSystem fs) {
super(configuration.getAllProperties(), fs);
try {
+ if (cfg.useKerberos) {
+ configuration.set("hive.metastore.sasl.enabled", "true");
+ configuration.set("hive.metastore.kerberos.principal", cfg.kerberosPrincipal);
Review comment:
Thanks to review
I set it to its initial value
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976165942
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976113439
> > > @test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
> > > ```
> > > [ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
> > > java.lang.IllegalArgumentException: Can't get Kerberos realm
> > > at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
> > > ```
> >
> >
> > This error is due to a problem with your KRB5 file. You need to check whether krB5 contains Realms properties and whether realms addresses can be connected
>
> @test-wangxiaoyu In that case, I would avoid tests that are dependent on environment. Is there a way to make this independent of env, e.g. using mock for krb realm? Also, if you could resolve the conflicts, that would be great. We would like to take this in the upcoming release.
I have resolved the conflict. Sorry, the mock for Krb Realm is too difficult to implement, kerberos is a complex system
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976223058
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976244767
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* c2bc8115f70b89dfc31f27645f98cfbff8d79c0f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646)
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 15a0a763aae6dec5147f8081175d0c995d9a0e5d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 614de53d1fc7b601fbdc21ffd71bf4a3606f794d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842)
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 614de53d1fc7b601fbdc21ffd71bf4a3606f794d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842)
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-954824259
> @test-wangxiaoyu The test you added is failing in CI. Can you please fix that?
CI failed because the variable name I named in test does not meet checkstyle check, I have changed the variable name
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
test-wangxiaoyu commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-959358098
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-941163867
@codope: Can you review this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-941163867
@codope: Can you review this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
danny0405 commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1060242636
Seems still conflicts in the PR and the compile fails, can you fix that @test-wangxiaoyu ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057760060
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
}, {
"hash" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490)
* f4334c1cb9dff69f4fd29998b708e6c9945a008d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-1057760060
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
}, {
"hash" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490",
"triggerID" : "17346d52ac09f5d69b645afcfd2a75a41c1950ff",
"triggerType" : "PUSH"
}, {
"hash" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f4334c1cb9dff69f4fd29998b708e6c9945a008d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* a08552b966fbb4fddf98ecbe2d94996679f73365 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3635)
* 17346d52ac09f5d69b645afcfd2a75a41c1950ff Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6490)
* f4334c1cb9dff69f4fd29998b708e6c9945a008d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* c2bc8115f70b89dfc31f27645f98cfbff8d79c0f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646)
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* c2bc8115f70b89dfc31f27645f98cfbff8d79c0f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646)
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 15a0a763aae6dec5147f8081175d0c995d9a0e5d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
codope commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-959005707
@test-wangxiaoyu All comments are resolved but CI is still failing. Can you please check that?
```
[ERROR] org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment Time elapsed: 0.075 s <<< ERROR!
java.lang.IllegalArgumentException: Can't get Kerberos realm
at org.apache.hudi.hive.TestHiveSyncTool.testHiveSyncOfKerberosEnvironment(TestHiveSyncTool.java:1035)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976118607
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* d4770093012a6e0196fa4bcb3ea0cc55253b284c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073)
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976252596
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634)
* a08552b966fbb4fddf98ecbe2d94996679f73365 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976252596
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
}, {
"hash" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a08552b966fbb4fddf98ecbe2d94996679f73365",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634)
* a08552b966fbb4fddf98ecbe2d94996679f73365 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976244767
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3771:
URL: https://github.com/apache/hudi/pull/3771#issuecomment-976223058
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2556",
"triggerID" : "b4808aaf973608255c97e1eb1f46ff04d9bb4bee",
"triggerType" : "PUSH"
}, {
"hash" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e",
"triggerType" : "PUSH"
}, {
"hash" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2646",
"triggerID" : "c2bc8115f70b89dfc31f27645f98cfbff8d79c0f",
"triggerType" : "PUSH"
}, {
"hash" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e7e7f170612fcecc8b07839d296f2c06972f2f44",
"triggerType" : "PUSH"
}, {
"hash" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "86e65215ff5f069470d732f4dce80cd20426fb5c",
"triggerType" : "PUSH"
}, {
"hash" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2704",
"triggerID" : "15a0a763aae6dec5147f8081175d0c995d9a0e5d",
"triggerType" : "PUSH"
}, {
"hash" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2842",
"triggerID" : "614de53d1fc7b601fbdc21ffd71bf4a3606f794d",
"triggerType" : "PUSH"
}, {
"hash" : "1fee342f94be227928aba463832edc3e2a01c878",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1fee342f94be227928aba463832edc3e2a01c878",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3059",
"triggerID" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"triggerType" : "PUSH"
}, {
"hash" : "d4770093012a6e0196fa4bcb3ea0cc55253b284c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3073",
"triggerID" : "957810936",
"triggerType" : "MANUAL"
}, {
"hash" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613",
"triggerID" : "3fd256ead56fe8dd8aec97e570c83f3dfe32c50b",
"triggerType" : "PUSH"
}, {
"hash" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1443479305e3bbd9e6b3fcd1e659de50a07b7787",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN
* e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN
* 86e65215ff5f069470d732f4dce80cd20426fb5c UNKNOWN
* 1fee342f94be227928aba463832edc3e2a01c878 UNKNOWN
* 3fd256ead56fe8dd8aec97e570c83f3dfe32c50b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3613)
* 1443479305e3bbd9e6b3fcd1e659de50a07b7787 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org