You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "fanshilun (Jira)" <ji...@apache.org> on 2022/10/10 13:34:00 UTC
[jira] [Updated] (HUDI-5002) Improve SparkHoodieHBaseIndex#generateStatement With Hbase Recommend Method
[ https://issues.apache.org/jira/browse/HUDI-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
fanshilun updated HUDI-5002:
----------------------------
Description:
When I read the code, I found that SparkHoodieHBaseIndex#generateStatement uses Hbase's deprecated method(setMaxVersion), I replaced it with new method.
{code:java}
private Get generateStatement(String key) throws IOException {
return new Get(Bytes.toBytes(getHBaseKey(key))).setMaxVersions(1).addColumn(SYSTEM_COLUMN_FAMILY, COMMIT_TS_COLUMN)
.addColumn(SYSTEM_COLUMN_FAMILY, FILE_NAME_COLUMN).addColumn(SYSTEM_COLUMN_FAMILY, PARTITION_PATH_COLUMN);
} {code}
was:
When I read the code, I found that SparkHoodieHBaseIndex#generateStatement uses Hbase's deprecated method(setMaxVersion), I replaced it with new method.
{code:java}
private Get generateStatement(String key) throws IOException {
return new Get(Bytes.toBytes(getHBaseKey(key))).setMaxVersions(1).addColumn(SYSTEM_COLUMN_FAMILY, COMMIT_TS_COLUMN)
.addColumn(SYSTEM_COLUMN_FAMILY, FILE_NAME_COLUMN).addColumn(SYSTEM_COLUMN_FAMILY, PARTITION_PATH_COLUMN);
} {code}
!image-2022-10-10-21-31-10-774.png|width=574,height=202!
> Improve SparkHoodieHBaseIndex#generateStatement With Hbase Recommend Method
> ---------------------------------------------------------------------------
>
> Key: HUDI-5002
> URL: https://issues.apache.org/jira/browse/HUDI-5002
> Project: Apache Hudi
> Issue Type: Improvement
> Components: cli
> Reporter: fanshilun
> Priority: Major
> Attachments: image-2022-10-10-21-31-59-535.png
>
>
> When I read the code, I found that SparkHoodieHBaseIndex#generateStatement uses Hbase's deprecated method(setMaxVersion), I replaced it with new method.
>
> {code:java}
> private Get generateStatement(String key) throws IOException {
> return new Get(Bytes.toBytes(getHBaseKey(key))).setMaxVersions(1).addColumn(SYSTEM_COLUMN_FAMILY, COMMIT_TS_COLUMN)
> .addColumn(SYSTEM_COLUMN_FAMILY, FILE_NAME_COLUMN).addColumn(SYSTEM_COLUMN_FAMILY, PARTITION_PATH_COLUMN);
> } {code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)