You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by GitBox <gi...@apache.org> on 2021/02/01 13:58:06 UTC

[GitHub] [hbase-connectors] symat commented on pull request #75: [HBASE-25326] Allow running and building hbase-connectors with Apache Spark 3.0

symat commented on pull request #75:
URL: https://github.com/apache/hbase-connectors/pull/75#issuecomment-770875622


   I just tested the hbase-connectors built with this patch on a cluster. I was able to use both Spark2 and Spark3 with the following setup:
   - I added the scala-library-2.11 jar file and the hbase-spark, hbase-spark-protocol files (built with  -Dspark.version=2.4.5 -Dscala.version=2.11.12) to the class-path of the region servers 
   - I was able to start and use a **spark2** job writing and reading to HBase, using the hbase-spark and hbase-spark-protocol files built with  -Dspark.version=2.4.5 -Dscala.version=2.11.12
   -  I was able to start and use a **spark3** job writing and reading to HBase, using the hbase-spark and hbase-spark-protocol files built with  -Dspark.version=3.1.0 -Dscala.version=2.12.10


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org