You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Andrzej <bo...@wp.pl> on 2018/06/19 14:30:12 UTC
Native client c++
I have written previous my library based on native_client sources in any
branch. Those worked with HBase 1.3 but now not works with HBase 2.0
I again want compile my library with sources of native_client.
I see it in master branch, but its are very old (5 years)
This sources will works with HBase 2.0 or is new version in any branch?
Andrzej
Re: Eclipse and hbase-server version 2.0.1- bad imports
Posted by Andrzej <bo...@wp.pl>.
W dniu 22.06.2018 o 23:13, Andrzej pisze:
> W dniu 22.06.2018 o 22:29, Ted Yu pisze:
> Thanks,
> "mvn eclipse:eclipse" downloaded all needed jars to .m2/repository
> I have in this directory both:
> hadoop-mapreduce-client-jobclient-2.7.4.jar (small 61 KB)
> hadoop-mapreduce-client-jobclient-2.7.4-tests.jar (full 1.4 MB)
OK.
I need additional jars:
hadoop-mapreduce-client-jobclient-2.7.4-tests.jar
hadoop-minikdc-2.7.4.jar
hamcrest-core-1.3.jar
hbase-http-2.0.1-tests.jar
hbase-procedure-2.0.1-tests.jar
mockito-core-2.1.0.jar
It is builded!
U run and have:
2018-06-22 23:30:35,249 INFO [Time-limited test]
hbase.HBaseCommonTestingUtility
(HBaseTestingUtility.java:startMiniCluster(953)) - Starting up
minicluster with 1 master(s) and 8 regionserver(s) and 8 datanode(s)
2018-06-22 23:30:35,257 INFO [Time-limited test]
hbase.HBaseCommonTestingUtility
(HBaseZKTestingUtility.java:setupClusterTestDir(86)) - Created new
mini-cluster data directory:
/home/andrzej/eclipse-workspace/jhbase/target/test-data/20ff2781-1630-4a62-b2f2-023437343046/cluster_b13f5c57-7ddb-47e2-816b-3a590aafedd3,
deleteOnExit=true
2018-06-22 23:30:35,257 INFO [Time-limited test]
hbase.HBaseCommonTestingUtility
(HBaseTestingUtility.java:startMiniCluster(968)) - STARTING DFS
2018-06-22 23:30:35,258 INFO [Time-limited test]
hbase.HBaseCommonTestingUtility
(HBaseTestingUtility.java:createDirAndSetProperty(745)) - Setting
test.cache.data to
/home/andrzej/eclipse-workspace/jhbase/target/test-data/20ff2781-1630-4a62-b2f2-023437343046/cache_data
in system properties and HBase conf
etc...
Re: Eclipse and hbase-server version 2.0.1- bad imports
Posted by Andrzej <bo...@wp.pl>.
W dniu 22.06.2018 o 22:29, Ted Yu pisze:
> Better approach is to let 'mvn eclipse:eclipse' generate the dependencies
> for you.
>
> bq. I don't have in .m2 directory
>
> Have you looked under ~/.m2/repository ?
Thanks,
"mvn eclipse:eclipse" downloaded all needed jars to .m2/repository
I have in this directory both:
hadoop-mapreduce-client-jobclient-2.7.4.jar (small 61 KB)
hadoop-mapreduce-client-jobclient-2.7.4-tests.jar (full 1.4 MB)
Some problems "mvn eclipse:eclipse" at end:
[INFO] Apache HBase - External Block Cache ................ SUCCESS [
6.864 s]
[INFO] Apache HBase - Assembly ............................ FAILURE [
9.885 s]
[INFO] Apache HBase - Shaded .............................. SKIPPED
[INFO] Apache HBase - Shaded - Client ..................... SKIPPED
[INFO] Apache HBase - Shaded - MapReduce .................. SKIPPED
[INFO] Apache HBase Shaded Packaging Invariants ........... SKIPPED
[INFO] Apache HBase - Archetypes .......................... SKIPPED
[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED
[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED
[INFO] Apache HBase - Archetype builder ................... SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
Re: Eclipse and hbase-server version 2.0.1- bad imports
Posted by Ted Yu <yu...@gmail.com>.
If you want to run against hadoop 3.1.x, you would need HBASE-20244.
You can wait for hadoop 3.1.1 to come out which is more stable than 3.1.0
You should add dependency on hadoop-mapreduce-client-jobcli
ent-3.1.0-tests.jar
bq. Similarly "test" for other I can't found classes?
I already explained which jars contain the other two classes.
Better approach is to let 'mvn eclipse:eclipse' generate the dependencies
for you.
bq. I don't have in .m2 directory
Have you looked under ~/.m2/repository ?
Cheers
On Fri, Jun 22, 2018 at 10:27 AM, Andrzej <bo...@wp.pl> wrote:
> W dniu 22.06.2018 o 18:47, Ted Yu pisze:
>
>> $ jar tvf
>> ~/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-
>> jobclient/3.0.0/hadoop-mapreduce-client-jobclient-3.0.0-tests.jar
>> | grep MiniMRCluster
>>
>
> andrzej@andrzej-VirtualBox ~/jars $ jar tvf hadoop-mapreduce-client-jobclient-3.1.0.jar
> | grep MiniMRCluster
>
> <------nothing
>
> andrzej@andrzej-VirtualBox ~/jars $ jar tvf hadoop-mapreduce-client-jobclient-3.1.0-tests.jar
> | grep MiniMRCluster
> 1863 Mon Apr 02 21:08:24 CEST 2018 org/apache/hadoop/mapred/Clust
> erMapReduceTestCase$ConfigurableMiniMRCluster.class
> 573 Mon Apr 02 21:08:24 CEST 2018 org/apache/hadoop/mapred/MiniM
> RCluster$JobTrackerRunner.class
> 576 Mon Apr 02 21:08:24 CEST 2018 org/apache/hadoop/mapred/MiniM
> RCluster$TaskTrackerRunner.class
> 9937 Mon Apr 02 21:08:24 CEST 2018 org/apache/hadoop/mapred/MiniM
> RCluster.class
>
>
> *Solution*: I must hadoop-mapreduce-client-jobclient-3.1.0-tests.jar
> instead of hadoop-mapreduce-client-jobclient-3.1.0.jar ?
> Similarly "test" for other I can't found classes?
>
> Better is 3.1.0 than 3.0.0 for v2.0.1?
> I don't have in .m2 directory, I must run mvn on hbase-server folder?
>
Re: Eclipse and hbase-server version 2.0.1- bad imports
Posted by Andrzej <bo...@wp.pl>.
W dniu 22.06.2018 o 18:47, Ted Yu pisze:
> $ jar tvf
> ~/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/3.0.0/hadoop-mapreduce-client-jobclient-3.0.0-tests.jar
> | grep MiniMRCluster
andrzej@andrzej-VirtualBox ~/jars $ jar tvf
hadoop-mapreduce-client-jobclient-3.1.0.jar | grep MiniMRCluster
<------nothing
andrzej@andrzej-VirtualBox ~/jars $ jar tvf
hadoop-mapreduce-client-jobclient-3.1.0-tests.jar | grep MiniMRCluster
1863 Mon Apr 02 21:08:24 CEST 2018
org/apache/hadoop/mapred/ClusterMapReduceTestCase$ConfigurableMiniMRCluster.class
573 Mon Apr 02 21:08:24 CEST 2018
org/apache/hadoop/mapred/MiniMRCluster$JobTrackerRunner.class
576 Mon Apr 02 21:08:24 CEST 2018
org/apache/hadoop/mapred/MiniMRCluster$TaskTrackerRunner.class
9937 Mon Apr 02 21:08:24 CEST 2018
org/apache/hadoop/mapred/MiniMRCluster.class
*Solution*: I must hadoop-mapreduce-client-jobclient-3.1.0-tests.jar
instead of hadoop-mapreduce-client-jobclient-3.1.0.jar ?
Similarly "test" for other I can't found classes?
Better is 3.1.0 than 3.0.0 for v2.0.1?
I don't have in .m2 directory, I must run mvn on hbase-server folder?
Re: Eclipse and hbase-server version 2.0.1- bad imports
Posted by Ted Yu <yu...@gmail.com>.
$ jar tvf
~/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/3.0.0/hadoop-mapreduce-client-jobclient-3.0.0-tests.jar
| grep MiniMRCluster
1863 Fri Dec 08 11:31:44 PST 2017
org/apache/hadoop/mapred/ClusterMapReduceTestCase$ConfigurableMiniMRCluster.class
9947 Fri Dec 08 11:31:44 PST 2017
org/apache/hadoop/mapred/MiniMRCluster.class
576 Fri Dec 08 11:31:44 PST 2017
org/apache/hadoop/mapred/MiniMRCluster$TaskTrackerRunner.class
573 Fri Dec 08 11:31:44 PST 2017
org/apache/hadoop/mapred/MiniMRCluster$JobTrackerRunner.class
KeyStoreTestUtil is in hbase-http module.
ProcedureTestingUtility is in hbase-procedure module.
You can run the following command prior to importing projects into Eclipse:
mvn clean package -DskipTests eclipse:eclipse
On Fri, Jun 22, 2018 at 8:13 AM, Andrzej <bo...@wp.pl> wrote:
> W dniu 22.06.2018 o 17:02, Andrzej pisze:
>
>> hadoop-mapreduce-client-jobclient-3.1.0.jar
>> import org.apache.hadoop.mapred.MiniMRCluster;
>>
>
> for example :
> fc:org.apache.hadoop.mapred.MiniMRCluster
> give me hadoop-mapreduce-client-jobclient but this jar has package
> org.apache.hadoop.mapred but not have class MiniMRCluster inside this
> package.
>
>
Re: Eclipse and hbase-server version 2.0.1- bad imports
Posted by Andrzej <bo...@wp.pl>.
W dniu 22.06.2018 o 17:02, Andrzej pisze:
> hadoop-mapreduce-client-jobclient-3.1.0.jar
> import org.apache.hadoop.mapred.MiniMRCluster;
for example :
fc:org.apache.hadoop.mapred.MiniMRCluster
give me hadoop-mapreduce-client-jobclient but this jar has package
org.apache.hadoop.mapred but not have class MiniMRCluster inside this
package.
Eclipse and hbase-server version 2.0.1- bad imports
Posted by Andrzej <bo...@wp.pl>.
I have installed
http://mirrors.advancedhosters.com/apache/hbase/2.0.1/hbase-2.0.1-bin.tar.gz
I checkout HBase repository to version 2.0.1RC0 and add to Eclipse whole
hbase-server directory.
I add *.jar’s from /usr/local/HBase/lib/ and additionally newest
versions from http://search.maven.org:
hadoop-mapreduce-client-jobclient-3.1.0.jar
java-hamcrest-2.0.0.0.jar
hadoop-minikdc-3.1.0.jar
mockito-core-2.19.0.jar
hbase-http-2.0.1.jar
But still Eclipse can’t found some classes:
import org.apache.hadoop.mapred.MiniMRCluster;
import org.apache.hadoop.hbase.http.ssl.KeyStoreTestUtil;
import org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility;
...
Re: I am searching Java examples for HBase 2.0.0
Posted by Ted Yu <yu...@gmail.com>.
See code HBaseTestingUtility :
public Connection getConnection() throws IOException {
if (this.connection == null) {
this.connection = ConnectionFactory.createConnection(this.conf);
Once you have the connection, you can call:
this.hbaseAdmin = (HBaseAdmin) getConnection().getAdmin();
Code under hbase-server/src/test would be a good place to start searching.
FYI
On Thu, Jun 21, 2018 at 1:52 PM, Andrzej <bo...@wp.pl> wrote:
> Hi, I am trying use Java with installed HBase 2.0.0.
> I see, Java for HBase has much more possibilities,like creating tables
> (must not using shell)
> I can find many examples, but all are old (for example using HBaseAdmin)
>
> import java.io.IOException;
> import org.apache.hadoop.conf.Configuration;
> import org.apache.hadoop.hbase.HBaseConfiguration;
> import org.apache.hadoop.hbase.HColumnDescriptor;
> import org.apache.hadoop.hbase.HTableDescriptor;
> import org.apache.hadoop.hbase.TableName;
> import org.apache.hadoop.hbase.client.ConnectionFactory;
> import org.apache.hadoop.hbase.client.ConnectionUtils;
> import org.apache.hadoop.hbase.client.HBaseAdmin;
>
> public class Example {
> public static void mk() throws IOException {
> Configuration configuration = HBaseConfiguration.create();
> configuration.set("hbase.zookeeper.quorum", "127.0.0.1");
> configuration.set("hbase.zookeeper.property.clientPort",
> "2181");
> final TableName tableName = TableName.valueOf("testEclipse
> ");
> final HTableDescriptor desc = new
> HTableDescriptor(tableName);
> desc.addFamily(new HColumnDescriptor("Id"));
> desc.addFamily(new HColumnDescriptor("Name"));
> System.out.println( "Connecting..." );
> HBaseAdmin hbase_admin = new HBaseAdmin( configuration );
> System.out.println( "Creating Table..." );
> hbase_admin.createTable( desc );
> System.out.println("Done!");
> }
>
> public static void main(String[] args) throws IOException {
> mk();
> }
> }
>
> HTableDescriptor and HColumnDescriptor are deprecated,
> but more important, that HBaseAdmin not works with configuration
> parameter, but with interface ClusterConnection.
> One implementation of ClusterConnection is ConnectionImplementation,
> but I can't write
> HBaseAdmin hbase_admin = new HBaseAdmin(new ConnectionImplementation());
> nor
> org.apache.hadoop.hbase.client.ConnectionImplementation
>
> Where can I find newer examples for version 2.0.0?
> In
> https://github.com/apache/hbase/tree/master/hbase-client/
> src/test/java/org/apache/hadoop/hbase
> in master branch?
> or version is differ than 2.0? Maybe on other branch will for version 2.0?
> I see there is Admin admin = new HBaseAdmin(mockConnection)
> Admin, not HBaseAdmin.
>
> Thanks in advance!
>
> @Previous post: I am going "mvn package"
>
I am searching Java examples for HBase 2.0.0
Posted by Andrzej <bo...@wp.pl>.
Hi, I am trying use Java with installed HBase 2.0.0.
I see, Java for HBase has much more possibilities,like creating tables
(must not using shell)
I can find many examples, but all are old (for example using HBaseAdmin)
import java.io.IOException;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.hbase.HBaseConfiguration;
import org.apache.hadoop.hbase.HColumnDescriptor;
import org.apache.hadoop.hbase.HTableDescriptor;
import org.apache.hadoop.hbase.TableName;
import org.apache.hadoop.hbase.client.ConnectionFactory;
import org.apache.hadoop.hbase.client.ConnectionUtils;
import org.apache.hadoop.hbase.client.HBaseAdmin;
public class Example {
public static void mk() throws IOException {
Configuration configuration = HBaseConfiguration.create();
configuration.set("hbase.zookeeper.quorum", "127.0.0.1");
configuration.set("hbase.zookeeper.property.clientPort", "2181");
final TableName tableName = TableName.valueOf("testEclipse");
final HTableDescriptor desc = new HTableDescriptor(tableName);
desc.addFamily(new HColumnDescriptor("Id"));
desc.addFamily(new HColumnDescriptor("Name"));
System.out.println( "Connecting..." );
HBaseAdmin hbase_admin = new HBaseAdmin( configuration );
System.out.println( "Creating Table..." );
hbase_admin.createTable( desc );
System.out.println("Done!");
}
public static void main(String[] args) throws IOException {
mk();
}
}
HTableDescriptor and HColumnDescriptor are deprecated,
but more important, that HBaseAdmin not works with configuration
parameter, but with interface ClusterConnection.
One implementation of ClusterConnection is ConnectionImplementation,
but I can't write
HBaseAdmin hbase_admin = new HBaseAdmin(new ConnectionImplementation());
nor
org.apache.hadoop.hbase.client.ConnectionImplementation
Where can I find newer examples for version 2.0.0?
In
https://github.com/apache/hbase/tree/master/hbase-client/src/test/java/org/apache/hadoop/hbase
in master branch?
or version is differ than 2.0? Maybe on other branch will for version 2.0?
I see there is Admin admin = new HBaseAdmin(mockConnection)
Admin, not HBaseAdmin.
Thanks in advance!
@Previous post: I am going "mvn package"
Re: Alternative to native client c++
Posted by Andrzej <bo...@wp.pl>.
W dniu 21.06.2018 o 22:52, Ted Yu pisze:
> Andrzej:
> Can you tell us which mvn / Java versions you use ?
andrzej@andrzej-VirtualBox ~/code/hbase $ mvn -v
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_171, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-oracle/jre
Default locale: pl_PL, platform encoding: UTF-8
OS name: "linux", version: "4.10.0-38-generic", arch: "amd64", family:
"unix"
Re: Alternative to native client c++
Posted by Ted Yu <yu...@gmail.com>.
I executed the following commands:
mvn clean
mvn compile
There was no error.
Andrzej:
Can you tell us which mvn / Java versions you use ?
I use the following:
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
MaxPermSize=812M; support was removed in 8.0
Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d;
2017-10-18T00:58:13-07:00)
Maven home: /Users/tyu/apache-maven-3.5.2
Java version: 1.8.0_151, vendor: Oracle Corporation
Java home:
/Library/Java/JavaVirtualMachines/jdk1.8.0_151.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.11.3", arch: "x86_64", family: "mac"
Cheers
On Thu, Jun 21, 2018 at 1:42 PM, Josh Elser <el...@apache.org> wrote:
> Use `mvn package`, not `compile`.
>
> On 6/21/18 10:41 AM, Andrzej wrote:
>
>> W dniu 21.06.2018 o 19:01, Andrzej pisze:
>>
>>> Is any alternative to fast control HBase from C++ sources?
>>> Or is Java client?
>>> Native Client C++ (HBASE-14850) sources are old and mismatch to folly
>>> library (Futures.h)
>>>
>>>
>> Now I first tried compiling hbase-client in master branch with Maven...
>> next, I try compile whole repository with Maven:
>> command "mvn compile":
>>
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Apache HBase ....................................... SUCCESS
>> [01:41 min]
>> [INFO] Apache HBase - Checkstyle .......................... SUCCESS [
>> 0.753 s]
>> [INFO] Apache HBase - Build Support ....................... SUCCESS [
>> 0.233 s]
>> [INFO] Apache HBase - Error Prone Rules ................... SUCCESS [
>> 11.211 s]
>> [INFO] Apache HBase - Annotations ......................... SUCCESS [
>> 0.327 s]
>> [INFO] Apache HBase - Build Configuration ................. SUCCESS [
>> 0.419 s]
>> [INFO] Apache HBase - Shaded Protocol ..................... SUCCESS [
>> 53.398 s]
>> [INFO] Apache HBase - Common .............................. SUCCESS [
>> 25.850 s]
>> [INFO] Apache HBase - Metrics API ......................... SUCCESS [
>> 2.835 s]
>> [INFO] Apache HBase - Hadoop Compatibility ................ SUCCESS [
>> 3.432 s]
>> [INFO] Apache HBase - Metrics Implementation .............. SUCCESS [
>> 7.296 s]
>> [INFO] Apache HBase - Hadoop Two Compatibility ............ SUCCESS [
>> 12.773 s]
>> [INFO] Apache HBase - Protocol ............................ SUCCESS [
>> 18.311 s]
>> [INFO] Apache HBase - Client .............................. SUCCESS [
>> 10.863 s]
>> [INFO] Apache HBase - Zookeeper ........................... SUCCESS [
>> 4.104 s]
>> [INFO] Apache HBase - Replication ......................... FAILURE [
>> 2.351 s]
>> [INFO] Apache HBase - Resource Bundle ..................... SKIPPED
>> [INFO] Apache HBase - HTTP ................................ SKIPPED
>> [INFO] Apache HBase - Procedure ........................... SKIPPED
>> [INFO] Apache HBase - Server .............................. SKIPPED
>> [INFO] Apache HBase - MapReduce ........................... SKIPPED
>> [INFO] Apache HBase - Testing Util ........................ SKIPPED
>> [INFO] Apache HBase - Thrift .............................. SKIPPED
>> [INFO] Apache HBase - RSGroup ............................. SKIPPED
>> [INFO] Apache HBase - Shell ............................... SKIPPED
>> [INFO] Apache HBase - Coprocessor Endpoint ................ SKIPPED
>> [INFO] Apache HBase - Backup .............................. SKIPPED
>> [INFO] Apache HBase - Integration Tests ................... SKIPPED
>> [INFO] Apache HBase - Rest ................................ SKIPPED
>> [INFO] Apache HBase - Examples ............................ SKIPPED
>> [INFO] Apache HBase - Shaded .............................. SKIPPED
>> [INFO] Apache HBase - Shaded - Client (with Hadoop bundled) SKIPPED
>> [INFO] Apache HBase - Shaded - Client ..................... SKIPPED
>> [INFO] Apache HBase - Shaded - MapReduce .................. SKIPPED
>> [INFO] Apache HBase - External Block Cache ................ SKIPPED
>> [INFO] Apache HBase - Spark ............................... SKIPPED
>> [INFO] Apache HBase - Spark Integration Tests ............. SKIPPED
>> [INFO] Apache HBase - Assembly ............................ SKIPPED
>> [INFO] Apache HBase Shaded Packaging Invariants ........... SKIPPED
>> [INFO] Apache HBase Shaded Packaging Invariants (with Hadoop bundled)
>> SKIPPED
>> [INFO] Apache HBase - Archetypes .......................... SKIPPED
>> [INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED
>> [INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED
>> [INFO] Apache HBase - Archetype builder ................... SKIPPED
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] BUILD FAILURE
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Total time: 04:19 min
>> [INFO] Finished at: 2018-06-21T19:37:37+02:00
>> [INFO] Final Memory: 100M/458M
>> [INFO] ------------------------------------------------------------
>> ------------
>> [ERROR] Failed to execute goal org.apache.maven.plugins:maven
>> -enforcer-plugin:3.0.0-M1:enforce (hadoop-profile-min-maven-min-java-banned-xerces)
>> on project hbase-replication: Execution hadoop-profile-min-maven-min-java-banned-xerces
>> of goal org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
>> failed: org.apache.maven.shared.dependency.graph.DependencyGraphBuilderException:
>> Could not resolve following dependencies: [org.apache.hbase:hbase-zookeeper:jar:tests:3.0.0-SNAPSHOT
>> (test)]: Could not resolve dependencies for project
>> org.apache.hbase:hbase-replication:jar:3.0.0-SNAPSHOT: Could not find
>> artifact org.apache.hbase:hbase-zookeeper:jar:tests:3.0.0-SNAPSHOT in
>> project.local (file:/home/andrzej/code/hbase/hbase-replication/src/site/resources/repo)
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>> ence/display/MAVEN/PluginExecutionException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build with the
>> command
>> [ERROR] mvn <goals> -rf :hbase-replication
>>
>
Re: Alternative to native client c++
Posted by Josh Elser <el...@apache.org>.
Use `mvn package`, not `compile`.
On 6/21/18 10:41 AM, Andrzej wrote:
> W dniu 21.06.2018 o 19:01, Andrzej pisze:
>> Is any alternative to fast control HBase from C++ sources?
>> Or is Java client?
>> Native Client C++ (HBASE-14850) sources are old and mismatch to folly
>> library (Futures.h)
>>
>
> Now I first tried compiling hbase-client in master branch with Maven...
> next, I try compile whole repository with Maven:
> command "mvn compile":
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache HBase ....................................... SUCCESS
> [01:41 min]
> [INFO] Apache HBase - Checkstyle .......................... SUCCESS [
> 0.753 s]
> [INFO] Apache HBase - Build Support ....................... SUCCESS [
> 0.233 s]
> [INFO] Apache HBase - Error Prone Rules ................... SUCCESS [
> 11.211 s]
> [INFO] Apache HBase - Annotations ......................... SUCCESS [
> 0.327 s]
> [INFO] Apache HBase - Build Configuration ................. SUCCESS [
> 0.419 s]
> [INFO] Apache HBase - Shaded Protocol ..................... SUCCESS [
> 53.398 s]
> [INFO] Apache HBase - Common .............................. SUCCESS [
> 25.850 s]
> [INFO] Apache HBase - Metrics API ......................... SUCCESS [
> 2.835 s]
> [INFO] Apache HBase - Hadoop Compatibility ................ SUCCESS [
> 3.432 s]
> [INFO] Apache HBase - Metrics Implementation .............. SUCCESS [
> 7.296 s]
> [INFO] Apache HBase - Hadoop Two Compatibility ............ SUCCESS [
> 12.773 s]
> [INFO] Apache HBase - Protocol ............................ SUCCESS [
> 18.311 s]
> [INFO] Apache HBase - Client .............................. SUCCESS [
> 10.863 s]
> [INFO] Apache HBase - Zookeeper ........................... SUCCESS [
> 4.104 s]
> [INFO] Apache HBase - Replication ......................... FAILURE [
> 2.351 s]
> [INFO] Apache HBase - Resource Bundle ..................... SKIPPED
> [INFO] Apache HBase - HTTP ................................ SKIPPED
> [INFO] Apache HBase - Procedure ........................... SKIPPED
> [INFO] Apache HBase - Server .............................. SKIPPED
> [INFO] Apache HBase - MapReduce ........................... SKIPPED
> [INFO] Apache HBase - Testing Util ........................ SKIPPED
> [INFO] Apache HBase - Thrift .............................. SKIPPED
> [INFO] Apache HBase - RSGroup ............................. SKIPPED
> [INFO] Apache HBase - Shell ............................... SKIPPED
> [INFO] Apache HBase - Coprocessor Endpoint ................ SKIPPED
> [INFO] Apache HBase - Backup .............................. SKIPPED
> [INFO] Apache HBase - Integration Tests ................... SKIPPED
> [INFO] Apache HBase - Rest ................................ SKIPPED
> [INFO] Apache HBase - Examples ............................ SKIPPED
> [INFO] Apache HBase - Shaded .............................. SKIPPED
> [INFO] Apache HBase - Shaded - Client (with Hadoop bundled) SKIPPED
> [INFO] Apache HBase - Shaded - Client ..................... SKIPPED
> [INFO] Apache HBase - Shaded - MapReduce .................. SKIPPED
> [INFO] Apache HBase - External Block Cache ................ SKIPPED
> [INFO] Apache HBase - Spark ............................... SKIPPED
> [INFO] Apache HBase - Spark Integration Tests ............. SKIPPED
> [INFO] Apache HBase - Assembly ............................ SKIPPED
> [INFO] Apache HBase Shaded Packaging Invariants ........... SKIPPED
> [INFO] Apache HBase Shaded Packaging Invariants (with Hadoop bundled)
> SKIPPED
> [INFO] Apache HBase - Archetypes .......................... SKIPPED
> [INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED
> [INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED
> [INFO] Apache HBase - Archetype builder ................... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 04:19 min
> [INFO] Finished at: 2018-06-21T19:37:37+02:00
> [INFO] Final Memory: 100M/458M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (hadoop-profile-min-maven-min-java-banned-xerces) on project
> hbase-replication: Execution
> hadoop-profile-min-maven-min-java-banned-xerces of goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce failed:
> org.apache.maven.shared.dependency.graph.DependencyGraphBuilderException: Could
> not resolve following dependencies:
> [org.apache.hbase:hbase-zookeeper:jar:tests:3.0.0-SNAPSHOT (test)]:
> Could not resolve dependencies for project
> org.apache.hbase:hbase-replication:jar:3.0.0-SNAPSHOT: Could not find
> artifact org.apache.hbase:hbase-zookeeper:jar:tests:3.0.0-SNAPSHOT in
> project.local
> (file:/home/andrzej/code/hbase/hbase-replication/src/site/resources/repo) ->
> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :hbase-replication
Re: Alternative to native client c++
Posted by Andrzej <bo...@wp.pl>.
W dniu 21.06.2018 o 19:01, Andrzej pisze:
> Is any alternative to fast control HBase from C++ sources?
> Or is Java client?
> Native Client C++ (HBASE-14850) sources are old and mismatch to folly
> library (Futures.h)
>
Now I first tried compiling hbase-client in master branch with Maven...
next, I try compile whole repository with Maven:
command "mvn compile":
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache HBase ....................................... SUCCESS
[01:41 min]
[INFO] Apache HBase - Checkstyle .......................... SUCCESS [
0.753 s]
[INFO] Apache HBase - Build Support ....................... SUCCESS [
0.233 s]
[INFO] Apache HBase - Error Prone Rules ................... SUCCESS [
11.211 s]
[INFO] Apache HBase - Annotations ......................... SUCCESS [
0.327 s]
[INFO] Apache HBase - Build Configuration ................. SUCCESS [
0.419 s]
[INFO] Apache HBase - Shaded Protocol ..................... SUCCESS [
53.398 s]
[INFO] Apache HBase - Common .............................. SUCCESS [
25.850 s]
[INFO] Apache HBase - Metrics API ......................... SUCCESS [
2.835 s]
[INFO] Apache HBase - Hadoop Compatibility ................ SUCCESS [
3.432 s]
[INFO] Apache HBase - Metrics Implementation .............. SUCCESS [
7.296 s]
[INFO] Apache HBase - Hadoop Two Compatibility ............ SUCCESS [
12.773 s]
[INFO] Apache HBase - Protocol ............................ SUCCESS [
18.311 s]
[INFO] Apache HBase - Client .............................. SUCCESS [
10.863 s]
[INFO] Apache HBase - Zookeeper ........................... SUCCESS [
4.104 s]
[INFO] Apache HBase - Replication ......................... FAILURE [
2.351 s]
[INFO] Apache HBase - Resource Bundle ..................... SKIPPED
[INFO] Apache HBase - HTTP ................................ SKIPPED
[INFO] Apache HBase - Procedure ........................... SKIPPED
[INFO] Apache HBase - Server .............................. SKIPPED
[INFO] Apache HBase - MapReduce ........................... SKIPPED
[INFO] Apache HBase - Testing Util ........................ SKIPPED
[INFO] Apache HBase - Thrift .............................. SKIPPED
[INFO] Apache HBase - RSGroup ............................. SKIPPED
[INFO] Apache HBase - Shell ............................... SKIPPED
[INFO] Apache HBase - Coprocessor Endpoint ................ SKIPPED
[INFO] Apache HBase - Backup .............................. SKIPPED
[INFO] Apache HBase - Integration Tests ................... SKIPPED
[INFO] Apache HBase - Rest ................................ SKIPPED
[INFO] Apache HBase - Examples ............................ SKIPPED
[INFO] Apache HBase - Shaded .............................. SKIPPED
[INFO] Apache HBase - Shaded - Client (with Hadoop bundled) SKIPPED
[INFO] Apache HBase - Shaded - Client ..................... SKIPPED
[INFO] Apache HBase - Shaded - MapReduce .................. SKIPPED
[INFO] Apache HBase - External Block Cache ................ SKIPPED
[INFO] Apache HBase - Spark ............................... SKIPPED
[INFO] Apache HBase - Spark Integration Tests ............. SKIPPED
[INFO] Apache HBase - Assembly ............................ SKIPPED
[INFO] Apache HBase Shaded Packaging Invariants ........... SKIPPED
[INFO] Apache HBase Shaded Packaging Invariants (with Hadoop bundled)
SKIPPED
[INFO] Apache HBase - Archetypes .......................... SKIPPED
[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED
[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED
[INFO] Apache HBase - Archetype builder ................... SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 04:19 min
[INFO] Finished at: 2018-06-21T19:37:37+02:00
[INFO] Final Memory: 100M/458M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
(hadoop-profile-min-maven-min-java-banned-xerces) on project
hbase-replication: Execution
hadoop-profile-min-maven-min-java-banned-xerces of goal
org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce failed:
org.apache.maven.shared.dependency.graph.DependencyGraphBuilderException:
Could not resolve following dependencies:
[org.apache.hbase:hbase-zookeeper:jar:tests:3.0.0-SNAPSHOT (test)]:
Could not resolve dependencies for project
org.apache.hbase:hbase-replication:jar:3.0.0-SNAPSHOT: Could not find
artifact org.apache.hbase:hbase-zookeeper:jar:tests:3.0.0-SNAPSHOT in
project.local
(file:/home/andrzej/code/hbase/hbase-replication/src/site/resources/repo)
-> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :hbase-replication
Alternative to native client c++
Posted by Andrzej <bo...@wp.pl>.
Is any alternative to fast control HBase from C++ sources?
Or is Java client?
Native Client C++ (HBASE-14850) sources are old and mismatch to folly
library (Futures.h)
Re: Native client c++
Posted by Sean Busbey <bu...@apache.org>.
Please join the dev@hbase list if you wish to talk about how to work
on unreleased code that is still in development.
Please do not use unreleased code directly. Downstream participants on
the user@hbase list should only make use of code that has been
formally released by the PMC.
On Tue, Jun 19, 2018 at 7:33 AM, Ted Yu <yu...@gmail.com> wrote:
> Please use HBASE-14850 branch which works with hbase 2.0
>
> Cheers
>
> On Tue, Jun 19, 2018 at 7:30 AM, Andrzej <bo...@wp.pl> wrote:
>
>> I have written previous my library based on native_client sources in any
>> branch. Those worked with HBase 1.3 but now not works with HBase 2.0
>> I again want compile my library with sources of native_client.
>> I see it in master branch, but its are very old (5 years)
>> This sources will works with HBase 2.0 or is new version in any branch?
>>
>> Andrzej
>>
Re: Native client c++
Posted by Ted Yu <yu...@gmail.com>.
Please use HBASE-14850 branch which works with hbase 2.0
Cheers
On Tue, Jun 19, 2018 at 7:30 AM, Andrzej <bo...@wp.pl> wrote:
> I have written previous my library based on native_client sources in any
> branch. Those worked with HBase 1.3 but now not works with HBase 2.0
> I again want compile my library with sources of native_client.
> I see it in master branch, but its are very old (5 years)
> This sources will works with HBase 2.0 or is new version in any branch?
>
> Andrzej
>