[jira] [Created] (HBASE-27143) Add hbase-unsafe as a dependency for a MR job triggered by hbase shell

["Tak-Lon (Stephen) Wu (Jira)" <ji...@apache.org>]

Tak-Lon (Stephen) Wu created HBASE-27143:
--------------------------------------------

             Summary: Add hbase-unsafe as a dependency for a MR job triggered by hbase shell
                 Key: HBASE-27143
                 URL: https://issues.apache.org/jira/browse/HBASE-27143
             Project: HBase
          Issue Type: Bug
    Affects Versions: 2.5.0, 3.0.0-alpha-3, 2.4.13
            Reporter: Tak-Lon (Stephen) Wu
            Assignee: Tak-Lon (Stephen) Wu


After HBASE-26523, the use of hbase-thirdparty 4.1.0 introduced an new dependency of hbase-unsafe that wasn't added as part of the MR job triggered by hbase-shell. As such, class not found exception was being emitted when executing in distributed mode.

{code}
22/06/21 04:57:15 INFO mapreduce.Job: Task Id : attempt_1655784404826_0011_m_000000_0, Status : FAILED
Error: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.unsafe.HBasePlatformDependent
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:583)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
	at org.apache.hadoop.hbase.util.Bytes.<clinit>(Bytes.java:129)
	at org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList$Generator$GeneratorMapper.setup(IntegrationTestBigLinkedList.java:455)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
	at java.base/java.security.AccessController.doPrivileged(Native Method)
	at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
{code}

This task will add it back as part of the job configuration handled by hbase internally in addHBaseDependencyJars



--
This message was sent by Atlassian Jira
(v8.20.7#820007)