You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/08 17:20:01 UTC
[GitHub] [hudi] fengjian428 opened a new pull request, #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
fengjian428 opened a new pull request, #5797:
URL: https://github.com/apache/hudi/pull/5797
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
In our production environment, since many table's id is auto-increment， if using Hbase index, will cause a data skew issue in HBase regions. it is better to find a way to add random prefixes and also keep ordering in hudi itself.
we may have a small modification to the HBase index. add the prefix on the aspect of query and update HBase. In
this way, the pk in HBase will be different from the one in hudi but such
logic will be transparent to business logic. I have adopted this method in
prod environment. Using withIndexClass config in IndexConfig could specify
the custom index
Another work, driven by uber engineers https://github.com/apache/hudi/pull/3508 could
technically solve the issue by directly reading HFiles, but still in progress, this approach should resolve this issue immediately
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1195273771
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
}, {
"hash" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351",
"triggerID" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"triggerType" : "PUSH"
}, {
"hash" : "db0d490d961b1e981f1d8cbb075333061e8da2c8",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10352",
"triggerID" : "db0d490d961b1e981f1d8cbb075333061e8da2c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* db0d490d961b1e981f1d8cbb075333061e8da2c8 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10352)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1150208366
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f9912f00ed46f5e9a6cf167f631d1743f9654c77 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] fengjian428 commented on a diff in pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
fengjian428 commented on code in PR #5797:
URL: https://github.com/apache/hudi/pull/5797#discussion_r925653077
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -1557,6 +1557,10 @@ public boolean getHbaseIndexUpdatePartitionPath() {
return getBooleanOrDefault(HoodieHBaseIndexConfig.UPDATE_PARTITION_PATH_ENABLE);
}
+ public int getHBaseIndexRegionCount() {
+ return getInt(HoodieHBaseIndexConfig.BUCKET_NUMBER);
+ }
+
Review Comment:
I just follow the old way in other HoodieIndex, seems they all have several getter methods in HoodieWriteConfig and only pass HoodieWriteConfig in the constructor. Do you think we need to refactor them?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yanghua merged pull request #5797: [HUDI-4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
yanghua merged PR #5797:
URL: https://github.com/apache/hudi/pull/5797
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1195073713
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
}, {
"hash" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351",
"triggerID" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f9912f00ed46f5e9a6cf167f631d1743f9654c77 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164)
* db7c09d0b77c5928a38ed90174cd812d748e4493 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1195133356
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
}, {
"hash" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351",
"triggerID" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"triggerType" : "PUSH"
}, {
"hash" : "db0d490d961b1e981f1d8cbb075333061e8da2c8",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10352",
"triggerID" : "db0d490d961b1e981f1d8cbb075333061e8da2c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* db7c09d0b77c5928a38ed90174cd812d748e4493 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351)
* db0d490d961b1e981f1d8cbb075333061e8da2c8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10352)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yanghua commented on a diff in pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
yanghua commented on code in PR #5797:
URL: https://github.com/apache/hudi/pull/5797#discussion_r925708959
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -1557,6 +1557,10 @@ public boolean getHbaseIndexUpdatePartitionPath() {
return getBooleanOrDefault(HoodieHBaseIndexConfig.UPDATE_PARTITION_PATH_ENABLE);
}
+ public int getHBaseIndexRegionCount() {
+ return getInt(HoodieHBaseIndexConfig.BUCKET_NUMBER);
+ }
+
Review Comment:
Yes, I feel like this class is a hodgepodge and is ballooning. It does not demonstrate the benefits of configuration separation that a pluggable architecture should bring. WDYT about it? @xushiyan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yanghua commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
yanghua commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1194849018
Will review this PR soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yanghua commented on a diff in pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
yanghua commented on code in PR #5797:
URL: https://github.com/apache/hudi/pull/5797#discussion_r929508652
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/hbase/SparkHoodieHBaseIndex.java:
##########
@@ -205,14 +205,18 @@ public void close() {
}
private Get generateStatement(String key) throws IOException {
- return new Get(Bytes.toBytes(key)).setMaxVersions(1).addColumn(SYSTEM_COLUMN_FAMILY, COMMIT_TS_COLUMN)
+ return new Get(Bytes.toBytes(transformToHbaseKey(key))).setMaxVersions(1).addColumn(SYSTEM_COLUMN_FAMILY, COMMIT_TS_COLUMN)
.addColumn(SYSTEM_COLUMN_FAMILY, FILE_NAME_COLUMN).addColumn(SYSTEM_COLUMN_FAMILY, PARTITION_PATH_COLUMN);
}
private Get generateStatement(String key, long startTime, long endTime) throws IOException {
return generateStatement(key).setTimeRange(startTime, endTime);
}
+ protected String transformToHbaseKey(String key) {
Review Comment:
ditto
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/hbase/BalanceSparkHoodieHBaseIndex.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.index.hbase;
+
+import org.apache.hudi.config.HoodieWriteConfig;
+
+/**
+ * Extends SparkHoodieHbaseIndex, add random prefix to key for avoiding data skew issue in hbase regions
+ */
+public class BalanceSparkHoodieHBaseIndex extends SparkHoodieHBaseIndex {
Review Comment:
WDYT renaming to `RebalancedSparkHoodieHBaseIndex`?
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/hbase/BalanceSparkHoodieHBaseIndex.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.index.hbase;
+
+import org.apache.hudi.config.HoodieWriteConfig;
+
+/**
+ * Extends SparkHoodieHbaseIndex, add random prefix to key for avoiding data skew issue in hbase regions
Review Comment:
Add `{@link SparkHoodieHbaseIndex}`. And add `.` at the end of this line.
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/hbase/BalanceSparkHoodieHBaseIndex.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.index.hbase;
+
+import org.apache.hudi.config.HoodieWriteConfig;
+
+/**
+ * Extends SparkHoodieHbaseIndex, add random prefix to key for avoiding data skew issue in hbase regions
+ */
+public class BalanceSparkHoodieHBaseIndex extends SparkHoodieHBaseIndex {
+
+ public BalanceSparkHoodieHBaseIndex(HoodieWriteConfig config) {
+ super(config);
+ }
+
+ @Override
+ protected String transformToHbaseKey(String originalKey) {
Review Comment:
what about `getHBaseKey`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] fengjian428 commented on a diff in pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
fengjian428 commented on code in PR #5797:
URL: https://github.com/apache/hudi/pull/5797#discussion_r925653077
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -1557,6 +1557,10 @@ public boolean getHbaseIndexUpdatePartitionPath() {
return getBooleanOrDefault(HoodieHBaseIndexConfig.UPDATE_PARTITION_PATH_ENABLE);
}
+ public int getHBaseIndexRegionCount() {
+ return getInt(HoodieHBaseIndexConfig.BUCKET_NUMBER);
+ }
+
Review Comment:
I just follow the old way in other HoodieIndex, seems they all have several getter methods in HoodieWriteConfig and only pass HoodieWriteConfig in the constructor. Do you think we need to refactor them? @yanghua
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yanghua commented on a diff in pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
yanghua commented on code in PR #5797:
URL: https://github.com/apache/hudi/pull/5797#discussion_r925419076
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -1557,6 +1557,10 @@ public boolean getHbaseIndexUpdatePartitionPath() {
return getBooleanOrDefault(HoodieHBaseIndexConfig.UPDATE_PARTITION_PATH_ENABLE);
}
+ public int getHBaseIndexRegionCount() {
+ return getInt(HoodieHBaseIndexConfig.BUCKET_NUMBER);
+ }
+
Review Comment:
I have a glance at this PR. IMO, the HBase config option should not intrude into the common write config. WDYT?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1195070145
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
}, {
"hash" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f9912f00ed46f5e9a6cf167f631d1743f9654c77 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164)
* db7c09d0b77c5928a38ed90174cd812d748e4493 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1150204630
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f9912f00ed46f5e9a6cf167f631d1743f9654c77 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1150318909
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f9912f00ed46f5e9a6cf167f631d1743f9654c77 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1195128935
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
}, {
"hash" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351",
"triggerID" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"triggerType" : "PUSH"
}, {
"hash" : "db0d490d961b1e981f1d8cbb075333061e8da2c8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "db0d490d961b1e981f1d8cbb075333061e8da2c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* db7c09d0b77c5928a38ed90174cd812d748e4493 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351)
* db0d490d961b1e981f1d8cbb075333061e8da2c8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5797: [HUDI 4210] Create custom hbase index to solve data skew issue on hbase regions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5797:
URL: https://github.com/apache/hudi/pull/5797#issuecomment-1195123799
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9164",
"triggerID" : "f9912f00ed46f5e9a6cf167f631d1743f9654c77",
"triggerType" : "PUSH"
}, {
"hash" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351",
"triggerID" : "db7c09d0b77c5928a38ed90174cd812d748e4493",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* db7c09d0b77c5928a38ed90174cd812d748e4493 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10351)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org