[jira] [Resolved] (HBASE-27143) Add hbase-unsafe as a dependency for a MR job triggered by hbase shell

["Tak-Lon (Stephen) Wu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HBASE-27143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tak-Lon (Stephen) Wu resolved HBASE-27143.
------------------------------------------
    Fix Version/s: 2.5.0
                   3.0.0-alpha-3
                   2.4.13
     Hadoop Flags: Reviewed
       Resolution: Fixed

commits pushed to master, branch-2, branch-2.5, branch-2.4

> Add hbase-unsafe as a dependency for a MR job triggered by hbase shell
> ----------------------------------------------------------------------
>
>                 Key: HBASE-27143
>                 URL: https://issues.apache.org/jira/browse/HBASE-27143
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 2.5.0, 3.0.0-alpha-3, 2.4.13
>            Reporter: Tak-Lon (Stephen) Wu
>            Assignee: Tak-Lon (Stephen) Wu
>            Priority: Major
>             Fix For: 2.5.0, 3.0.0-alpha-3, 2.4.13
>
>
> After HBASE-26523, the use of hbase-thirdparty 4.1.0 introduced an new dependency of hbase-unsafe that wasn't added as part of the MR job triggered by hbase-shell. As such, class not found exception was being emitted when executing in distributed mode.
> {code}
> 22/06/21 04:57:15 INFO mapreduce.Job: Task Id : attempt_1655784404826_0011_m_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.unsafe.HBasePlatformDependent
> 	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:583)
> 	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
> 	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
> 	at org.apache.hadoop.hbase.util.Bytes.<clinit>(Bytes.java:129)
> 	at org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList$Generator$GeneratorMapper.setup(IntegrationTestBigLinkedList.java:455)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
> 	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
> 	at java.base/java.security.AccessController.doPrivileged(Native Method)
> 	at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
> {code}
> This task will add it back as part of the job configuration handled by hbase internally in addHBaseDependencyJars



--
This message was sent by Atlassian Jira
(v8.20.7#820007)