You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by bo zhaobo <bz...@gmail.com> on 2019/06/10 08:16:02 UTC

DISCUSS: Is there any idea about ARM CI for Hbase?

Hi guys,

My name is ZhaoBo, a member from OpenLab CI Team, I had post a issue [1]
several days ago.
The reason to do this is for the ARM eco-system and make Hbase can be run
on more devices.
So I wish our HBASE core team members can leave some comments or
suggestions on it.

Thank you very much.

Best regards

[1] https://issues.apache.org/jira/browse/HBASE-22468

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by bo zhaobo <bz...@gmail.com>.

Hi Sean,

Thank you very much for the nice suggestions, you showed us a good way to
try, and the goal we should focus on.

I'm so glad to hear that you could help about this if possible. Yeah, "do
it in existing CI for ARM" that's what we want to do. That's very great if
you could give some details about how to add the resources and test into
the existing CI. Thank you, Sean.

Also, that's good if there will also be other contributors want to take
part in this work. ;-)

Thank you

Best Regards,

ZhaoBo



[image: Mailtrack]
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
Sender
notified by
Mailtrack
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
19/06/27
上午10:55:04

Sean Busbey <bu...@apache.org> 于2019年6月26日周三 下午7:16写道：

> Hi ZhaoBo!
>
> As an ASF project HBase is generally a "do-acracy", meaning generally folks
> who are willing to show up and do the work determine the direction we take.
> I'd say so long as you're invested in making ARM work you can push forward
> barring any specific objections.
>
> I'd thus presume the current consensus from this thread is you're good to
> go.
>
> I personally think it'd be best if you could integrate any needed CI
> testing into our existing processes on builds.a.o. To do that you'd have to
> first work with ASF Infra folks to get the appropriate VMs added as Jenkins
> workers. If you like I can give you specific pointers on this.
>
>
>
> On Wed, Jun 26, 2019, 04:14 bo zhaobo <bz...@gmail.com> wrote:
>
> > Hi team,
> >
> > Sorry for disturbing, but we really need your kind suggestion. We want to
> > know the appropriate way that Hbase community can accept. Which I
> mentioned
> > the options in the past email for HBASE ARM support are:
> > 1. Introducing an new ARM CI(3rd party CI), which provided by OpenLab,
> > OpenLab will provide the ARM resources and people resources to develop
> and
> > maintain the CI status.
> >
> > 2. Still using the old CI(Apache Jenkins(https://builds.apache.org)),
> > OpenLab will provide more ARM resources to help test and build hbase on
> > ARM in
> > the old development process. That means we can just provide the ARM
> > resources
> > into your exist ARM test.
> > Notes: the ARM resources provided by OpenLab are Virtual Machines.
> >
> > Also we will provide the human resources(ME- ZhaoBo) to fix the ARM
> related
> > issues for Hbase, and maintain the ARM CI status is good, including
> option
> > 1 and 2. And I'm glad to do this and maintain in the future, if there are
> > some issues break Hbase on ARM, I will also try to report to JIRA and fix
> > in Hbase.
> >
> > We not only aim to just build Hbase success on ARM, but also plan to add
> > more test cases on ARM, such as the same with Hbase already done on X86.
> >
> > So I'm looking forward to get your(Hbase team) choice. Thank you very
> much.
> >
> > Best Regards,
> >
> > ZhaoBo
> >
> >
> > [image: Mailtrack]
> > <
> >
> https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&
> > >
> > Sender
> > notified by
> > Mailtrack
> > <
> >
> https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&
> > >
> > 19/06/26
> > 下午5:12:38
> >
> > bo zhaobo <bz...@gmail.com> 于2019年6月23日周日 下午7:00写道：
> >
> > > Any updates from team?  Thanks you
> > >
> > >>
> > > [image: Mailtrack]
> > > <
> >
> https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&
> >
> > Sender
> > > notified by
> > > Mailtrack
> > > <
> >
> https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&
> >
> > 19/06/21
> > > 下午3:37:23
> > > *×*REMOVE <#m_-6684894170990945484_m_9060835149257889588_>
> > >
> >
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by Sean Busbey <bu...@apache.org>.

Hi ZhaoBo!

As an ASF project HBase is generally a "do-acracy", meaning generally folks
who are willing to show up and do the work determine the direction we take.
I'd say so long as you're invested in making ARM work you can push forward
barring any specific objections.

I'd thus presume the current consensus from this thread is you're good to
go.

I personally think it'd be best if you could integrate any needed CI
testing into our existing processes on builds.a.o. To do that you'd have to
first work with ASF Infra folks to get the appropriate VMs added as Jenkins
workers. If you like I can give you specific pointers on this.



On Wed, Jun 26, 2019, 04:14 bo zhaobo <bz...@gmail.com> wrote:

> Hi team,
>
> Sorry for disturbing, but we really need your kind suggestion. We want to
> know the appropriate way that Hbase community can accept. Which I mentioned
> the options in the past email for HBASE ARM support are:
> 1. Introducing an new ARM CI(3rd party CI), which provided by OpenLab,
> OpenLab will provide the ARM resources and people resources to develop and
> maintain the CI status.
>
> 2. Still using the old CI(Apache Jenkins(https://builds.apache.org)),
> OpenLab will provide more ARM resources to help test and build hbase on
> ARM in
> the old development process. That means we can just provide the ARM
> resources
> into your exist ARM test.
> Notes: the ARM resources provided by OpenLab are Virtual Machines.
>
> Also we will provide the human resources(ME- ZhaoBo) to fix the ARM related
> issues for Hbase, and maintain the ARM CI status is good, including option
> 1 and 2. And I'm glad to do this and maintain in the future, if there are
> some issues break Hbase on ARM, I will also try to report to JIRA and fix
> in Hbase.
>
> We not only aim to just build Hbase success on ARM, but also plan to add
> more test cases on ARM, such as the same with Hbase already done on X86.
>
> So I'm looking forward to get your(Hbase team) choice. Thank you very much.
>
> Best Regards,
>
> ZhaoBo
>
>
> [image: Mailtrack]
> <
> https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&
> >
> Sender
> notified by
> Mailtrack
> <
> https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&
> >
> 19/06/26
> 下午5:12:38
>
> bo zhaobo <bz...@gmail.com> 于2019年6月23日周日 下午7:00写道：
>
> > Any updates from team?  Thanks you
> >
> >>
> > [image: Mailtrack]
> > <
> https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
> Sender
> > notified by
> > Mailtrack
> > <
> https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
> 19/06/21
> > 下午3:37:23
> > *×*REMOVE <#m_-6684894170990945484_m_9060835149257889588_>
> >
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by bo zhaobo <bz...@gmail.com>.

Hi team,

Sorry for disturbing, but we really need your kind suggestion. We want to
know the appropriate way that Hbase community can accept. Which I mentioned
the options in the past email for HBASE ARM support are:
1. Introducing an new ARM CI(3rd party CI), which provided by OpenLab,
OpenLab will provide the ARM resources and people resources to develop and
maintain the CI status.

2. Still using the old CI(Apache Jenkins(https://builds.apache.org)),
OpenLab will provide more ARM resources to help test and build hbase on ARM in
the old development process. That means we can just provide the ARM resources
into your exist ARM test.
Notes: the ARM resources provided by OpenLab are Virtual Machines.

Also we will provide the human resources(ME- ZhaoBo) to fix the ARM related
issues for Hbase, and maintain the ARM CI status is good, including option
1 and 2. And I'm glad to do this and maintain in the future, if there are
some issues break Hbase on ARM, I will also try to report to JIRA and fix
in Hbase.

We not only aim to just build Hbase success on ARM, but also plan to add
more test cases on ARM, such as the same with Hbase already done on X86.

So I'm looking forward to get your(Hbase team) choice. Thank you very much.

Best Regards,

ZhaoBo


[image: Mailtrack]
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
Sender
notified by
Mailtrack
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
19/06/26
下午5:12:38

bo zhaobo <bz...@gmail.com> 于2019年6月23日周日 下午7:00写道：

> Any updates from team?  Thanks you
>
>>
> [image: Mailtrack]
> <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&> Sender
> notified by
> Mailtrack
> <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&> 19/06/21
> 下午3:37:23
> *×*REMOVE <#m_-6684894170990945484_m_9060835149257889588_>
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by bo zhaobo <bz...@gmail.com>.

Any updates from team?  Thanks you

>
[image: Mailtrack]
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
Sender
notified by
Mailtrack
<https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&>
19/06/21
下午3:37:23
*×*REMOVE <#m_9060835149257889588_>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by bo zhaobo <bz...@gmail.com>.

Hi Hbase team,

  At first, I will continue to use this email thread  for clear the
misunderstandings, so I think leave it is OK for description.

  Some of you might see the related proposal in JIRA(
https://issues.apache.org/jira/browse/HBASE-22468) already, but I still
want to raise it
to a wider audience and clarify some potential misunderstandings.

  I’m from OpenLab team(https://openlabtesting.org/ ,a community to do open
source project testing,
this is OpenLab charter:
https://github.com/theopenlab/governance/blob/master/CHARTER.md). One of
our goal is to make more opensource software
to be more compatible for AArch64 platforms. Hbase is the most popular data
store application in BigData area. we would like to propose to work on
AArch64 related works in Hbase. Also, you may saw my other team members
raise this topic on other apache BigData projects, please dont worry about
that.

  Even though OpenLab is a community to do open source project testing,
using OpenLab for testing AArch64 related works is not mandatory,
what we really want to do is to help build the AArch64 eco system in
BigData area. We have a developer team that willing to work on this and
we also have some AArch64 resources that we are willing to provide for
Hbase community to connect to the current CI system to perform related
testings.
If we already have a ARM related test(CI), such as Apache Jenkins(
https://builds.apache.org), but I find only 1 ARM resource(
https://builds.apache.org/computer/arm1/),
so I want to know the hbase community thought about doing AArch64 support,
each way is good, relies on your choice. ;-), now I can show below:
1. Introducing an new ARM CI(3rd party CI), which provided by OpenLab,
OpenLab will provide the ARM resources and people resources to develop and
maintain the CI status.
2. Still using the old CI(Apache Jenkins(https://builds.apache.org)),
OpenLab will provide more ARM resources to help test and build hbase on ARM
in the old development process. That means we can just provide the ARM
resources into your exist ARM test.
Notes: the ARM resources provided by OpenLab are Virtual Machines.

  Then, Rome wasn't built in a day, so we plan to start a simple target to
add AArch64 build job for Hbase, to verify Hbase can be
compiled on ARM successfully, OpenLab's developers will maintain build CI
jobs and address the CI issues, then we can add more complex test cases
on AArch64, like: unit tests and functional tests, step by step, it's a
long term works. Of course, welcome another developers join to maintain the
AArch64 CI.

Thanks for your attention.

bo zhaobo <bz...@gmail.com> 于2019年6月20日周四 上午10:29写道：

>  Hi Youngwoo Kim,
>    Thanks very much for providing so much details about bigtop, it's very
> clear to describe the roadmap of  Bigtop for ARM support, which is full
> stack big data staff support ARM. Am I right? The project won't focus on
> the dev branch(non-stable/non-release), as bigtop focus on the full
> functionality about the full staff, may including hadoop, hbase, spark
> etc..  Here, my thought is about how about introducing a ARM test into
> development process, that may be good and more helpful for the Bigtop
> future ARM works. ;-). Welcome to discuss more.
>
> Thanks,
>
> ZhaoBo
>
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by bo zhaobo <bz...@gmail.com>.

 Hi Youngwoo Kim,
   Thanks very much for providing so much details about bigtop, it's very
clear to describe the roadmap of  Bigtop for ARM support, which is full
stack big data staff support ARM. Am I right? The project won't focus on
the dev branch(non-stable/non-release), as bigtop focus on the full
functionality about the full staff, may including hadoop, hbase, spark
etc..  Here, my thought is about how about introducing a ARM test into
development process, that may be good and more helpful for the Bigtop
future ARM works. ;-). Welcome to discuss more.

Thanks,

ZhaoBo

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by "Youngwoo Kim (김영우)" <yw...@apache.org>.

Zhaobo,

PMC members @Bigtop, they had a talk at the Linaro conf. I hope this helps
you to understand what they have done to support the AArch64[1][2] for
Bigtop.

Thanks,
Youngwoo

1. https://sched.co/LJq5
2. https://www.youtube.com/watch?v=a0acq7zI1wI



On Tue, Jun 11, 2019 at 12:09 PM Youngwoo Kim (김영우) <yw...@apache.org>
wrote:

> Zhaobo,
>
> HBase requires Zookeeper, Hadoop and other libs. As you mentioned,
> integration of each component is important.
> To solve this problem, We are using test infrastructures and containers
> for AArch64[1][2] but Bigtop CI is not for unit test or pre-commit test
> while developing the each component.
>
> If you have AArch64 specific questions, feel free to ask to folks from
> Linaro and Arm @ Bigtop community
>
> Thanks,
> Youngwoo
>
> 1.
> https://cwiki.apache.org/confluence/display/BIGTOP/Running+integration%2C+system%2C+and+package+tests
> 2. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.4.0/
>
> On Tue, Jun 11, 2019 at 11:43 AM bo zhaobo <bz...@gmail.com>
> wrote:
>
>> Hi Youngwoo Kim,
>>
>> Thanks for introducing BitTop, it supports AArch64 ARCH, it contains many
>> big data and data analytics projects with the specific version. So it can
>> not to make sure the master Hbase code support ARM ARCH. The stack will
>> just use the stable project release. That's why I think introduce an ARM
>> CI
>> to test the master/non-stable code directly may be good. The test not only
>> contains "build", but also "UT" "functional test" on ARM in the future.
>>
>> So any ideas about this? Thank you.
>>
>> BR,
>>
>> zhaobo
>>
>> Youngwoo Kim (김영우) <yw...@apache.org> 于2019年6月11日周二 上午10:00写道：
>>
>> > Hi ZhaoBo,
>> >
>> > Apache Bigtop supports the AArch64(arm) architecture since version
>> 1.3.0.
>> > Bigtop is not a CI for the software stack but a distribution of open
>> source
>> > software for big data and data analytics.
>> > Folks from Linaro are contributing to Bigtop to support ARM architecture
>> > for the stack including Apache HBase.
>> > Feel free to contact Bigtop community to get further information:
>> > https://bigtop.apache.org/mail-lists.html
>> >
>> > Regards,
>> > Youngwoo
>> >
>> > On Tue, Jun 11, 2019 at 10:40 AM bo zhaobo <bzhaojyathousandy@gmail.com
>> >
>> > wrote:
>> >
>> > > Hi, Jean
>> > >
>> > > Thanks for reply. I try to compile and build HBASE master on ARM, (not
>> > > success easily as hit protobuf-2.5.0 didn't have a arm release.) And I
>> > test
>> > > HBASE on ARM, it works fine.
>> > >
>> > > The reason I post the issue in JIRA(
>> > > https://issues.apache.org/jira/browse/HBASE-22468) is proposing a ARM
>> > > CI(Openlab|https://openlabtesting.org/) to HBASE to verify each
>> commit
>> > > won't break the HBASE deployment on ARM. Also I found HBASE use Apache
>> > > Jenkins(https://builds.apache.org) to build and test on limit ARM
>> > > resources. So I think HBASE may need a ARM CI and make sure it can
>> run on
>> > > both X86 and ARM arch. Then we(HBASE) can officially support arm
>> release
>> > in
>> > > the future.
>> > >
>> > > Currently, Storm is preparing to add Openlab for ARM CI(
>> > > https://issues.apache.org/jira/projects/STORM/issues/STORM-3401).So
>> any
>> > > ideas from Hbase core team? ;-)
>> > >
>> > > Thank you.
>> > >
>> > > Best Regards
>> > >
>> > > Jean-Marc Spaggiari <je...@spaggiari.org> 于2019年6月10日周一 下午9:45写道：
>> > >
>> > > > Hi,
>> > > >
>> > > > As long as you have a Java VM, it should work, no? Did you give it a
>> > try?
>> > > > If you did, what kind of issues did you face? Were looking to get
>> the
>> > > > client running? Or the entire HBase cluster? I saw on the web
>> someone
>> > > > running an HDFS cluster on Raspberry Pi. So I guess HBase should
>> work
>> > > fine
>> > > > too?
>> > > >
>> > > > Thanks,
>> > > >
>> > > > JMS
>> > > >
>> > > > Le lun. 10 juin 2019 04 h 17, bo zhaobo <
>> bzhaojyathousandy@gmail.com>
>> > a
>> > > > écrit :
>> > > >
>> > > > > Hi guys,
>> > > > >
>> > > > > My name is ZhaoBo, a member from OpenLab CI Team, I had post a
>> issue
>> > > [1]
>> > > > > several days ago.
>> > > > > The reason to do this is for the ARM eco-system and make Hbase
>> can be
>> > > run
>> > > > > on more devices.
>> > > > > So I wish our HBASE core team members can leave some comments or
>> > > > > suggestions on it.
>> > > > >
>> > > > > Thank you very much.
>> > > > >
>> > > > > Best regards
>> > > > >
>> > > > > [1] https://issues.apache.org/jira/browse/HBASE-22468
>> > > > >
>> > > >
>> > >
>> >
>>
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by "Youngwoo Kim (김영우)" <yw...@apache.org>.

Zhaobo,

HBase requires Zookeeper, Hadoop and other libs. As you mentioned,
integration of each component is important.
To solve this problem, We are using test infrastructures and containers for
AArch64[1][2] but Bigtop CI is not for unit test or pre-commit test while
developing the each component.

If you have AArch64 specific questions, feel free to ask to folks from
Linaro and Arm @ Bigtop community

Thanks,
Youngwoo

1.
https://cwiki.apache.org/confluence/display/BIGTOP/Running+integration%2C+system%2C+and+package+tests
2. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.4.0/

On Tue, Jun 11, 2019 at 11:43 AM bo zhaobo <bz...@gmail.com>
wrote:

> Hi Youngwoo Kim,
>
> Thanks for introducing BitTop, it supports AArch64 ARCH, it contains many
> big data and data analytics projects with the specific version. So it can
> not to make sure the master Hbase code support ARM ARCH. The stack will
> just use the stable project release. That's why I think introduce an ARM CI
> to test the master/non-stable code directly may be good. The test not only
> contains "build", but also "UT" "functional test" on ARM in the future.
>
> So any ideas about this? Thank you.
>
> BR,
>
> zhaobo
>
> Youngwoo Kim (김영우) <yw...@apache.org> 于2019年6月11日周二 上午10:00写道：
>
> > Hi ZhaoBo,
> >
> > Apache Bigtop supports the AArch64(arm) architecture since version 1.3.0.
> > Bigtop is not a CI for the software stack but a distribution of open
> source
> > software for big data and data analytics.
> > Folks from Linaro are contributing to Bigtop to support ARM architecture
> > for the stack including Apache HBase.
> > Feel free to contact Bigtop community to get further information:
> > https://bigtop.apache.org/mail-lists.html
> >
> > Regards,
> > Youngwoo
> >
> > On Tue, Jun 11, 2019 at 10:40 AM bo zhaobo <bz...@gmail.com>
> > wrote:
> >
> > > Hi, Jean
> > >
> > > Thanks for reply. I try to compile and build HBASE master on ARM, (not
> > > success easily as hit protobuf-2.5.0 didn't have a arm release.) And I
> > test
> > > HBASE on ARM, it works fine.
> > >
> > > The reason I post the issue in JIRA(
> > > https://issues.apache.org/jira/browse/HBASE-22468) is proposing a ARM
> > > CI(Openlab|https://openlabtesting.org/) to HBASE to verify each commit
> > > won't break the HBASE deployment on ARM. Also I found HBASE use Apache
> > > Jenkins(https://builds.apache.org) to build and test on limit ARM
> > > resources. So I think HBASE may need a ARM CI and make sure it can run
> on
> > > both X86 and ARM arch. Then we(HBASE) can officially support arm
> release
> > in
> > > the future.
> > >
> > > Currently, Storm is preparing to add Openlab for ARM CI(
> > > https://issues.apache.org/jira/projects/STORM/issues/STORM-3401).So
> any
> > > ideas from Hbase core team? ;-)
> > >
> > > Thank you.
> > >
> > > Best Regards
> > >
> > > Jean-Marc Spaggiari <je...@spaggiari.org> 于2019年6月10日周一 下午9:45写道：
> > >
> > > > Hi,
> > > >
> > > > As long as you have a Java VM, it should work, no? Did you give it a
> > try?
> > > > If you did, what kind of issues did you face? Were looking to get the
> > > > client running? Or the entire HBase cluster? I saw on the web someone
> > > > running an HDFS cluster on Raspberry Pi. So I guess HBase should work
> > > fine
> > > > too?
> > > >
> > > > Thanks,
> > > >
> > > > JMS
> > > >
> > > > Le lun. 10 juin 2019 04 h 17, bo zhaobo <bzhaojyathousandy@gmail.com
> >
> > a
> > > > écrit :
> > > >
> > > > > Hi guys,
> > > > >
> > > > > My name is ZhaoBo, a member from OpenLab CI Team, I had post a
> issue
> > > [1]
> > > > > several days ago.
> > > > > The reason to do this is for the ARM eco-system and make Hbase can
> be
> > > run
> > > > > on more devices.
> > > > > So I wish our HBASE core team members can leave some comments or
> > > > > suggestions on it.
> > > > >
> > > > > Thank you very much.
> > > > >
> > > > > Best regards
> > > > >
> > > > > [1] https://issues.apache.org/jira/browse/HBASE-22468
> > > > >
> > > >
> > >
> >
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by bo zhaobo <bz...@gmail.com>.

Hi Youngwoo Kim,

Thanks for introducing BitTop, it supports AArch64 ARCH, it contains many
big data and data analytics projects with the specific version. So it can
not to make sure the master Hbase code support ARM ARCH. The stack will
just use the stable project release. That's why I think introduce an ARM CI
to test the master/non-stable code directly may be good. The test not only
contains "build", but also "UT" "functional test" on ARM in the future.

So any ideas about this? Thank you.

BR,

zhaobo

Youngwoo Kim (김영우) <yw...@apache.org> 于2019年6月11日周二 上午10:00写道：

> Hi ZhaoBo,
>
> Apache Bigtop supports the AArch64(arm) architecture since version 1.3.0.
> Bigtop is not a CI for the software stack but a distribution of open source
> software for big data and data analytics.
> Folks from Linaro are contributing to Bigtop to support ARM architecture
> for the stack including Apache HBase.
> Feel free to contact Bigtop community to get further information:
> https://bigtop.apache.org/mail-lists.html
>
> Regards,
> Youngwoo
>
> On Tue, Jun 11, 2019 at 10:40 AM bo zhaobo <bz...@gmail.com>
> wrote:
>
> > Hi, Jean
> >
> > Thanks for reply. I try to compile and build HBASE master on ARM, (not
> > success easily as hit protobuf-2.5.0 didn't have a arm release.) And I
> test
> > HBASE on ARM, it works fine.
> >
> > The reason I post the issue in JIRA(
> > https://issues.apache.org/jira/browse/HBASE-22468) is proposing a ARM
> > CI(Openlab|https://openlabtesting.org/) to HBASE to verify each commit
> > won't break the HBASE deployment on ARM. Also I found HBASE use Apache
> > Jenkins(https://builds.apache.org) to build and test on limit ARM
> > resources. So I think HBASE may need a ARM CI and make sure it can run on
> > both X86 and ARM arch. Then we(HBASE) can officially support arm release
> in
> > the future.
> >
> > Currently, Storm is preparing to add Openlab for ARM CI(
> > https://issues.apache.org/jira/projects/STORM/issues/STORM-3401).So any
> > ideas from Hbase core team? ;-)
> >
> > Thank you.
> >
> > Best Regards
> >
> > Jean-Marc Spaggiari <je...@spaggiari.org> 于2019年6月10日周一 下午9:45写道：
> >
> > > Hi,
> > >
> > > As long as you have a Java VM, it should work, no? Did you give it a
> try?
> > > If you did, what kind of issues did you face? Were looking to get the
> > > client running? Or the entire HBase cluster? I saw on the web someone
> > > running an HDFS cluster on Raspberry Pi. So I guess HBase should work
> > fine
> > > too?
> > >
> > > Thanks,
> > >
> > > JMS
> > >
> > > Le lun. 10 juin 2019 04 h 17, bo zhaobo <bz...@gmail.com>
> a
> > > écrit :
> > >
> > > > Hi guys,
> > > >
> > > > My name is ZhaoBo, a member from OpenLab CI Team, I had post a issue
> > [1]
> > > > several days ago.
> > > > The reason to do this is for the ARM eco-system and make Hbase can be
> > run
> > > > on more devices.
> > > > So I wish our HBASE core team members can leave some comments or
> > > > suggestions on it.
> > > >
> > > > Thank you very much.
> > > >
> > > > Best regards
> > > >
> > > > [1] https://issues.apache.org/jira/browse/HBASE-22468
> > > >
> > >
> >
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by "Youngwoo Kim (김영우)" <yw...@apache.org>.

Hi ZhaoBo,

Apache Bigtop supports the AArch64(arm) architecture since version 1.3.0.
Bigtop is not a CI for the software stack but a distribution of open source
software for big data and data analytics.
Folks from Linaro are contributing to Bigtop to support ARM architecture
for the stack including Apache HBase.
Feel free to contact Bigtop community to get further information:
https://bigtop.apache.org/mail-lists.html

Regards,
Youngwoo

On Tue, Jun 11, 2019 at 10:40 AM bo zhaobo <bz...@gmail.com>
wrote:

> Hi, Jean
>
> Thanks for reply. I try to compile and build HBASE master on ARM, (not
> success easily as hit protobuf-2.5.0 didn't have a arm release.) And I test
> HBASE on ARM, it works fine.
>
> The reason I post the issue in JIRA(
> https://issues.apache.org/jira/browse/HBASE-22468) is proposing a ARM
> CI(Openlab|https://openlabtesting.org/) to HBASE to verify each commit
> won't break the HBASE deployment on ARM. Also I found HBASE use Apache
> Jenkins(https://builds.apache.org) to build and test on limit ARM
> resources. So I think HBASE may need a ARM CI and make sure it can run on
> both X86 and ARM arch. Then we(HBASE) can officially support arm release in
> the future.
>
> Currently, Storm is preparing to add Openlab for ARM CI(
> https://issues.apache.org/jira/projects/STORM/issues/STORM-3401).So any
> ideas from Hbase core team? ;-)
>
> Thank you.
>
> Best Regards
>
> Jean-Marc Spaggiari <je...@spaggiari.org> 于2019年6月10日周一 下午9:45写道：
>
> > Hi,
> >
> > As long as you have a Java VM, it should work, no? Did you give it a try?
> > If you did, what kind of issues did you face? Were looking to get the
> > client running? Or the entire HBase cluster? I saw on the web someone
> > running an HDFS cluster on Raspberry Pi. So I guess HBase should work
> fine
> > too?
> >
> > Thanks,
> >
> > JMS
> >
> > Le lun. 10 juin 2019 04 h 17, bo zhaobo <bz...@gmail.com> a
> > écrit :
> >
> > > Hi guys,
> > >
> > > My name is ZhaoBo, a member from OpenLab CI Team, I had post a issue
> [1]
> > > several days ago.
> > > The reason to do this is for the ARM eco-system and make Hbase can be
> run
> > > on more devices.
> > > So I wish our HBASE core team members can leave some comments or
> > > suggestions on it.
> > >
> > > Thank you very much.
> > >
> > > Best regards
> > >
> > > [1] https://issues.apache.org/jira/browse/HBASE-22468
> > >
> >
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by bo zhaobo <bz...@gmail.com>.

Hi, Jean

Thanks for reply. I try to compile and build HBASE master on ARM, (not
success easily as hit protobuf-2.5.0 didn't have a arm release.) And I test
HBASE on ARM, it works fine.

The reason I post the issue in JIRA(
https://issues.apache.org/jira/browse/HBASE-22468) is proposing a ARM
CI(Openlab|https://openlabtesting.org/) to HBASE to verify each commit
won't break the HBASE deployment on ARM. Also I found HBASE use Apache
Jenkins(https://builds.apache.org) to build and test on limit ARM
resources. So I think HBASE may need a ARM CI and make sure it can run on
both X86 and ARM arch. Then we(HBASE) can officially support arm release in
the future.

Currently, Storm is preparing to add Openlab for ARM CI(
https://issues.apache.org/jira/projects/STORM/issues/STORM-3401).So any
ideas from Hbase core team? ;-)

Thank you.

Best Regards

Jean-Marc Spaggiari <je...@spaggiari.org> 于2019年6月10日周一 下午9:45写道：

> Hi,
>
> As long as you have a Java VM, it should work, no? Did you give it a try?
> If you did, what kind of issues did you face? Were looking to get the
> client running? Or the entire HBase cluster? I saw on the web someone
> running an HDFS cluster on Raspberry Pi. So I guess HBase should work fine
> too?
>
> Thanks,
>
> JMS
>
> Le lun. 10 juin 2019 04 h 17, bo zhaobo <bz...@gmail.com> a
> écrit :
>
> > Hi guys,
> >
> > My name is ZhaoBo, a member from OpenLab CI Team, I had post a issue [1]
> > several days ago.
> > The reason to do this is for the ARM eco-system and make Hbase can be run
> > on more devices.
> > So I wish our HBASE core team members can leave some comments or
> > suggestions on it.
> >
> > Thank you very much.
> >
> > Best regards
> >
> > [1] https://issues.apache.org/jira/browse/HBASE-22468
> >
>

Re: DISCUSS: Is there any idea about ARM CI for Hbase?

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.

Hi,

As long as you have a Java VM, it should work, no? Did you give it a try?
If you did, what kind of issues did you face? Were looking to get the
client running? Or the entire HBase cluster? I saw on the web someone
running an HDFS cluster on Raspberry Pi. So I guess HBase should work fine
too?

Thanks,

JMS

Le lun. 10 juin 2019 04 h 17, bo zhaobo <bz...@gmail.com> a
écrit :

> Hi guys,
>
> My name is ZhaoBo, a member from OpenLab CI Team, I had post a issue [1]
> several days ago.
> The reason to do this is for the ARM eco-system and make Hbase can be run
> on more devices.
> So I wish our HBASE core team members can leave some comments or
> suggestions on it.
>
> Thank you very much.
>
> Best regards
>
> [1] https://issues.apache.org/jira/browse/HBASE-22468
>