You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "caijialiang (Jira)" <ji...@apache.org> on 2023/07/21 09:58:00 UTC
[jira] [Updated] (BIGTOP-3961) Fix hadoop buid script for yarn ui2 support
[ https://issues.apache.org/jira/browse/BIGTOP-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
caijialiang updated BIGTOP-3961:
--------------------------------
Description:
After deploying yarn TimelineService v2, it fails to start because Hadoop 3, by default, includes HBase 1 client in the packaging of hadoop-yarn-server-timelineservice-hbase-client-3.3.4.jar. When the TimelineServiceReader starts and attempts to create an HBase table, it encounters compatibility issues between HBase 1 and 2 APIs, resulting in the failure to find the required method and thus unable to create the table.
Error message:
Caused by: java.lang.NoSuchMethodError:org.apache.hadoop.hbase.client.Admin.createTable
!image-2023-07-21-17-57-31-876.png|width=882,height=496!
The Hadoop documentation also acknowledges this issue, and the relevant excerpt is as follows:
[https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html]
The first part is to set up or pick an Apache HBase cluster to use as the storage cluster. The supported versions of Apache HBase are 1.2.6 (default) and 2.0.0-beta1. The 1.0.x versions do not work with Timeline Service v.2. By default, Hadoop releases are built with HBase 1.2.6. To use HBase 2.0.0-beta1, build from source with option -Dhbase.profile=2.0
> Fix hadoop buid script for yarn ui2 support
> -------------------------------------------
>
> Key: BIGTOP-3961
> URL: https://issues.apache.org/jira/browse/BIGTOP-3961
> Project: Bigtop
> Issue Type: Bug
> Reporter: caijialiang
> Priority: Major
> Attachments: image-2023-07-21-17-57-31-876.png
>
>
> After deploying yarn TimelineService v2, it fails to start because Hadoop 3, by default, includes HBase 1 client in the packaging of hadoop-yarn-server-timelineservice-hbase-client-3.3.4.jar. When the TimelineServiceReader starts and attempts to create an HBase table, it encounters compatibility issues between HBase 1 and 2 APIs, resulting in the failure to find the required method and thus unable to create the table.
> Error message:
> Caused by: java.lang.NoSuchMethodError:org.apache.hadoop.hbase.client.Admin.createTable
> !image-2023-07-21-17-57-31-876.png|width=882,height=496!
>
>
> The Hadoop documentation also acknowledges this issue, and the relevant excerpt is as follows:
> [https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html]
> The first part is to set up or pick an Apache HBase cluster to use as the storage cluster. The supported versions of Apache HBase are 1.2.6 (default) and 2.0.0-beta1. The 1.0.x versions do not work with Timeline Service v.2. By default, Hadoop releases are built with HBase 1.2.6. To use HBase 2.0.0-beta1, build from source with option -Dhbase.profile=2.0
--
This message was sent by Atlassian Jira
(v8.20.10#820010)