You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@bigtop.apache.org by Taher Koitawala <ta...@gslab.com> on 2018/08/13 11:04:01 UTC
Apache Ranger RPM build failed
Hi All,
I am currently trying to build Apache Ranger's rpm with Bigtop.
However, the build in jenkins fails due to the following error
*./gradlew ranger-srpm*
Command rpmbuild --define _topdir /home/cloud/bigtop/build/ranger/rpm
--define ranger_base_version 0.7.1 --define ranger_version 0.7.1 --define
ranger_release 1%{?dist} -bs --nodeps
--buildroot=/home/cloud/bigtop/build/ranger/rpm/INSTALL
/home/cloud/bigtop/build/ranger/rpm/SPECS/ranger.spec
Command exited with error status 1
When I execute the same command manually I get the following errors:
Error:
Macro %_topdir has empty body
Macro %_topdir has empty body
Macro %_topdir has empty body
Macro %ranger_base_version has empty body
Macro %ranger_base_version has empty body
Macro %ranger_version has empty body
Macro %ranger_version has empty body
Macro %ranger_release has empty body
Macro %ranger_release has empty body
I get the same error when i execute *./graldew zookeeper-srpm *and even
when *./graldew ambari-srpm* to check if native bitgtop defined packaging
works. I am using Bigtop 1.2.1
Regards,
Taher Koitawala
GS Lab Pune
+91 8407979163
Re: Apache Ranger RPM build failed
Posted by Evans Ye <ev...@apache.org>.
Did you tried the one-liner I provide in last email? It works well. If you
hit problem executing that one-liner I provide. Please post error log
directly.
If you use self built centos 7 docker image, we've no way to guarantee your
env is in a good shape cause we can't control all the 3rd party libs.
Taher Koitawala <ta...@gslab.com> 於 2018年8月16日 週四 下午3:35寫道：
> Yes true, bigtop does not involve apache ranger in it. I have added that
> manually and I am not using any third party tool. The setup here is from
> bigtop's git repo. I can understand if ranger fails to build, that may be
> due to my bad configuration, however, zookeeper and ambari should not fail
> as they come preconfigured. My entire setup, when moved to Ubuntu, works
> fine. This fails on the centos 7 docker image which we are using to get the
> build going.
>
>
>
> On Tue 14 Aug, 2018, 11:13 PM Evans Ye, <ev...@apache.org> wrote:
>
>> What confuses me is that you said you have the ranger target. While
>> Bigtop hasn't include ranger as a component yet. I suspect you're using 3rd
>> party tool that is derived from Bigtop. If so, check with your vendor first.
>>
>> To build Bigtop components, please refer to
>> https://cwiki-test.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-trunk
>> and scroll down to "Recommended: Using pre-built Docker images".
>>
>> If you got your env settled, this one-liner should give you what you want:
>> $ docker run --rm -u jenkins -v `pwd`:/ws --workdir /ws
>> bigtop/slaves:1.2.1-centos-7 bash -l -c './gradlew allclean zookeeper-pkg'
>>
>> I tried and it's working. If you found bug. Feel free to report to us.
>>
>>
>>
>>
>>
>>
>> Taher Koitawala <ta...@gslab.com> 於 2018年8月14日 週二 下午3:24寫道：
>>
>>> Using centos 7 and rpmbuild version 4.11.3
>>>
>>> Regards,
>>> Taher Koitawala
>>> GS Lab Pune
>>> +91 8407979163
>>>
>>> On Tue, Aug 14, 2018 at 12:01 PM, Taher Koitawala <
>>> taher.koitawala@gslab.com> wrote:
>>>
>>>> I checkout bigtop release-1.2.1 tag from git. We are using a centos
>>>> docker image and im executing the "./gralde zookeeper-sprm" and "./gradlew
>>>> ranger-srpm" command which fail due to the macros has empty body error
>>>>
>>>> On Mon 13 Aug, 2018, 9:29 PM Evans Ye, <ev...@apache.org> wrote:
>>>>
>>>>> I just tried using centos 7 build image and it looks good to me.
>>>>> Please share your build command and environment. Thanks.
>>>>>
>>>>> ---
>>>>> [root@c72b8cb47c34 ws]# ./gradlew zookeeper-srpm
>>>>> Starting a Gradle Daemon, 1 incompatible Daemon could not be reused,
>>>>> use --status for details
>>>>> Download
>>>>> https://archive.apache.org/dist//zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
>>>>>
>>>>> > Task :zookeeper-tar
>>>>> Copy /ws/dl/zookeeper-3.4.6.tar.gz to
>>>>> /ws/build/zookeeper/tar/zookeeper-3.4.6.tar.gz
>>>>>
>>>>> > Task :zookeeper-srpm
>>>>> Wrote: /ws/build/zookeeper/rpm/SRPMS/zookeeper-3.4.6-1.el7.src.rpm
>>>>>
>>>>>
>>>>> BUILD SUCCESSFUL in 17s
>>>>>
>>>>> Taher Koitawala <ta...@gslab.com> 於 2018年8月13日 週一 下午7:04寫道：
>>>>>
>>>>>> Hi All,
>>>>>> I am currently trying to build Apache Ranger's rpm with
>>>>>> Bigtop. However, the build in jenkins fails due to the following error
>>>>>>
>>>>>>
>>>>>> *./gradlew ranger-srpm*
>>>>>>
>>>>>> Command rpmbuild --define _topdir
>>>>>> /home/cloud/bigtop/build/ranger/rpm --define ranger_base_version 0.7.1
>>>>>> --define ranger_version 0.7.1 --define ranger_release 1%{?dist} -bs
>>>>>> --nodeps --buildroot=/home/cloud/bigtop/build/ranger/rpm/INSTALL
>>>>>> /home/cloud/bigtop/build/ranger/rpm/SPECS/ranger.spec
>>>>>>
>>>>>> Command exited with error status 1
>>>>>>
>>>>>> When I execute the same command manually I get the following errors:
>>>>>>
>>>>>> Error:
>>>>>> Macro %_topdir has empty body
>>>>>> Macro %_topdir has empty body
>>>>>> Macro %_topdir has empty body
>>>>>> Macro %ranger_base_version has empty body
>>>>>> Macro %ranger_base_version has empty body
>>>>>> Macro %ranger_version has empty body
>>>>>> Macro %ranger_version has empty body
>>>>>> Macro %ranger_release has empty body
>>>>>> Macro %ranger_release has empty body
>>>>>>
>>>>>> I get the same error when i execute *./graldew zookeeper-srpm *and
>>>>>> even when *./graldew ambari-srpm* to check if native bitgtop defined
>>>>>> packaging works. I am using Bigtop 1.2.1
>>>>>>
>>>>>> Regards,
>>>>>> Taher Koitawala
>>>>>> GS Lab Pune
>>>>>> +91 8407979163
>>>>>>
>>>>>
>>>
Re: Apache Ranger RPM build failed
Posted by Taher Koitawala <ta...@gslab.com>.
Yes true, bigtop does not involve apache ranger in it. I have added that
manually and I am not using any third party tool. The setup here is from
bigtop's git repo. I can understand if ranger fails to build, that may be
due to my bad configuration, however, zookeeper and ambari should not fail
as they come preconfigured. My entire setup, when moved to Ubuntu, works
fine. This fails on the centos 7 docker image which we are using to get the
build going.
On Tue 14 Aug, 2018, 11:13 PM Evans Ye, <ev...@apache.org> wrote:
> What confuses me is that you said you have the ranger target. While Bigtop
> hasn't include ranger as a component yet. I suspect you're using 3rd party
> tool that is derived from Bigtop. If so, check with your vendor first.
>
> To build Bigtop components, please refer to https://cwiki-test.apache.
> org/confluence/display/BIGTOP/How+to+build+Bigtop-trunk and scroll down
> to "Recommended: Using pre-built Docker images".
>
> If you got your env settled, this one-liner should give you what you want:
> $ docker run --rm -u jenkins -v `pwd`:/ws --workdir /ws
> bigtop/slaves:1.2.1-centos-7 bash -l -c './gradlew allclean zookeeper-pkg'
>
> I tried and it's working. If you found bug. Feel free to report to us.
>
>
>
>
>
>
> Taher Koitawala <ta...@gslab.com> 於 2018年8月14日 週二 下午3:24寫道：
>
>> Using centos 7 and rpmbuild version 4.11.3
>>
>> Regards,
>> Taher Koitawala
>> GS Lab Pune
>> +91 8407979163
>>
>> On Tue, Aug 14, 2018 at 12:01 PM, Taher Koitawala <
>> taher.koitawala@gslab.com> wrote:
>>
>>> I checkout bigtop release-1.2.1 tag from git. We are using a centos
>>> docker image and im executing the "./gralde zookeeper-sprm" and "./gradlew
>>> ranger-srpm" command which fail due to the macros has empty body error
>>>
>>> On Mon 13 Aug, 2018, 9:29 PM Evans Ye, <ev...@apache.org> wrote:
>>>
>>>> I just tried using centos 7 build image and it looks good to me.
>>>> Please share your build command and environment. Thanks.
>>>>
>>>> ---
>>>> [root@c72b8cb47c34 ws]# ./gradlew zookeeper-srpm
>>>> Starting a Gradle Daemon, 1 incompatible Daemon could not be reused,
>>>> use --status for details
>>>> Download https://archive.apache.org/dist//zookeeper/zookeeper-3.4.
>>>> 6/zookeeper-3.4.6.tar.gz
>>>>
>>>> > Task :zookeeper-tar
>>>> Copy /ws/dl/zookeeper-3.4.6.tar.gz to /ws/build/zookeeper/tar/
>>>> zookeeper-3.4.6.tar.gz
>>>>
>>>> > Task :zookeeper-srpm
>>>> Wrote: /ws/build/zookeeper/rpm/SRPMS/zookeeper-3.4.6-1.el7.src.rpm
>>>>
>>>>
>>>> BUILD SUCCESSFUL in 17s
>>>>
>>>> Taher Koitawala <ta...@gslab.com> 於 2018年8月13日 週一 下午7:04寫道：
>>>>
>>>>> Hi All,
>>>>> I am currently trying to build Apache Ranger's rpm with
>>>>> Bigtop. However, the build in jenkins fails due to the following error
>>>>>
>>>>>
>>>>> *./gradlew ranger-srpm*
>>>>>
>>>>> Command rpmbuild --define _topdir /home/cloud/bigtop/build/ranger/rpm
>>>>> --define ranger_base_version 0.7.1 --define ranger_version 0.7.1 --define
>>>>> ranger_release 1%{?dist} -bs --nodeps --buildroot=/home/cloud/
>>>>> bigtop/build/ranger/rpm/INSTALL /home/cloud/bigtop/build/
>>>>> ranger/rpm/SPECS/ranger.spec
>>>>>
>>>>> Command exited with error status 1
>>>>>
>>>>> When I execute the same command manually I get the following errors:
>>>>>
>>>>> Error:
>>>>> Macro %_topdir has empty body
>>>>> Macro %_topdir has empty body
>>>>> Macro %_topdir has empty body
>>>>> Macro %ranger_base_version has empty body
>>>>> Macro %ranger_base_version has empty body
>>>>> Macro %ranger_version has empty body
>>>>> Macro %ranger_version has empty body
>>>>> Macro %ranger_release has empty body
>>>>> Macro %ranger_release has empty body
>>>>>
>>>>> I get the same error when i execute *./graldew zookeeper-srpm *and
>>>>> even when *./graldew ambari-srpm* to check if native bitgtop defined
>>>>> packaging works. I am using Bigtop 1.2.1
>>>>>
>>>>> Regards,
>>>>> Taher Koitawala
>>>>> GS Lab Pune
>>>>> +91 8407979163
>>>>>
>>>>
>>
Re: Apache Ranger RPM build failed
Posted by Evans Ye <ev...@apache.org>.
What confuses me is that you said you have the ranger target. While Bigtop
hasn't include ranger as a component yet. I suspect you're using 3rd party
tool that is derived from Bigtop. If so, check with your vendor first.
To build Bigtop components, please refer to
https://cwiki-test.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-trunk
and scroll down to "Recommended: Using pre-built Docker images".
If you got your env settled, this one-liner should give you what you want:
$ docker run --rm -u jenkins -v `pwd`:/ws --workdir /ws
bigtop/slaves:1.2.1-centos-7 bash -l -c './gradlew allclean zookeeper-pkg'
I tried and it's working. If you found bug. Feel free to report to us.
Taher Koitawala <ta...@gslab.com> 於 2018年8月14日 週二 下午3:24寫道：
> Using centos 7 and rpmbuild version 4.11.3
>
> Regards,
> Taher Koitawala
> GS Lab Pune
> +91 8407979163
>
> On Tue, Aug 14, 2018 at 12:01 PM, Taher Koitawala <
> taher.koitawala@gslab.com> wrote:
>
>> I checkout bigtop release-1.2.1 tag from git. We are using a centos
>> docker image and im executing the "./gralde zookeeper-sprm" and "./gradlew
>> ranger-srpm" command which fail due to the macros has empty body error
>>
>> On Mon 13 Aug, 2018, 9:29 PM Evans Ye, <ev...@apache.org> wrote:
>>
>>> I just tried using centos 7 build image and it looks good to me.
>>> Please share your build command and environment. Thanks.
>>>
>>> ---
>>> [root@c72b8cb47c34 ws]# ./gradlew zookeeper-srpm
>>> Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use
>>> --status for details
>>> Download
>>> https://archive.apache.org/dist//zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
>>>
>>> > Task :zookeeper-tar
>>> Copy /ws/dl/zookeeper-3.4.6.tar.gz to
>>> /ws/build/zookeeper/tar/zookeeper-3.4.6.tar.gz
>>>
>>> > Task :zookeeper-srpm
>>> Wrote: /ws/build/zookeeper/rpm/SRPMS/zookeeper-3.4.6-1.el7.src.rpm
>>>
>>>
>>> BUILD SUCCESSFUL in 17s
>>>
>>> Taher Koitawala <ta...@gslab.com> 於 2018年8月13日 週一 下午7:04寫道：
>>>
>>>> Hi All,
>>>> I am currently trying to build Apache Ranger's rpm with
>>>> Bigtop. However, the build in jenkins fails due to the following error
>>>>
>>>>
>>>> *./gradlew ranger-srpm*
>>>>
>>>> Command rpmbuild --define _topdir /home/cloud/bigtop/build/ranger/rpm
>>>> --define ranger_base_version 0.7.1 --define ranger_version 0.7.1 --define
>>>> ranger_release 1%{?dist} -bs --nodeps
>>>> --buildroot=/home/cloud/bigtop/build/ranger/rpm/INSTALL
>>>> /home/cloud/bigtop/build/ranger/rpm/SPECS/ranger.spec
>>>>
>>>> Command exited with error status 1
>>>>
>>>> When I execute the same command manually I get the following errors:
>>>>
>>>> Error:
>>>> Macro %_topdir has empty body
>>>> Macro %_topdir has empty body
>>>> Macro %_topdir has empty body
>>>> Macro %ranger_base_version has empty body
>>>> Macro %ranger_base_version has empty body
>>>> Macro %ranger_version has empty body
>>>> Macro %ranger_version has empty body
>>>> Macro %ranger_release has empty body
>>>> Macro %ranger_release has empty body
>>>>
>>>> I get the same error when i execute *./graldew zookeeper-srpm *and
>>>> even when *./graldew ambari-srpm* to check if native bitgtop defined
>>>> packaging works. I am using Bigtop 1.2.1
>>>>
>>>> Regards,
>>>> Taher Koitawala
>>>> GS Lab Pune
>>>> +91 8407979163
>>>>
>>>
>
Re: Apache Ranger RPM build failed
Posted by Taher Koitawala <ta...@gslab.com>.
Using centos 7 and rpmbuild version 4.11.3
Regards,
Taher Koitawala
GS Lab Pune
+91 8407979163
On Tue, Aug 14, 2018 at 12:01 PM, Taher Koitawala <taher.koitawala@gslab.com
> wrote:
> I checkout bigtop release-1.2.1 tag from git. We are using a centos docker
> image and im executing the "./gralde zookeeper-sprm" and "./gradlew
> ranger-srpm" command which fail due to the macros has empty body error
>
> On Mon 13 Aug, 2018, 9:29 PM Evans Ye, <ev...@apache.org> wrote:
>
>> I just tried using centos 7 build image and it looks good to me.
>> Please share your build command and environment. Thanks.
>>
>> ---
>> [root@c72b8cb47c34 ws]# ./gradlew zookeeper-srpm
>> Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use
>> --status for details
>> Download https://archive.apache.org/dist//zookeeper/zookeeper-3.4.6/
>> zookeeper-3.4.6.tar.gz
>>
>> > Task :zookeeper-tar
>> Copy /ws/dl/zookeeper-3.4.6.tar.gz to /ws/build/zookeeper/tar/zookee
>> per-3.4.6.tar.gz
>>
>> > Task :zookeeper-srpm
>> Wrote: /ws/build/zookeeper/rpm/SRPMS/zookeeper-3.4.6-1.el7.src.rpm
>>
>>
>> BUILD SUCCESSFUL in 17s
>>
>> Taher Koitawala <ta...@gslab.com> 於 2018年8月13日 週一 下午7:04寫道：
>>
>>> Hi All,
>>> I am currently trying to build Apache Ranger's rpm with Bigtop.
>>> However, the build in jenkins fails due to the following error
>>>
>>>
>>> *./gradlew ranger-srpm*
>>>
>>> Command rpmbuild --define _topdir /home/cloud/bigtop/build/ranger/rpm
>>> --define ranger_base_version 0.7.1 --define ranger_version 0.7.1 --define
>>> ranger_release 1%{?dist} -bs --nodeps --buildroot=/home/cloud/bigtop/build/ranger/rpm/INSTALL
>>> /home/cloud/bigtop/build/ranger/rpm/SPECS/ranger.spec
>>>
>>> Command exited with error status 1
>>>
>>> When I execute the same command manually I get the following errors:
>>>
>>> Error:
>>> Macro %_topdir has empty body
>>> Macro %_topdir has empty body
>>> Macro %_topdir has empty body
>>> Macro %ranger_base_version has empty body
>>> Macro %ranger_base_version has empty body
>>> Macro %ranger_version has empty body
>>> Macro %ranger_version has empty body
>>> Macro %ranger_release has empty body
>>> Macro %ranger_release has empty body
>>>
>>> I get the same error when i execute *./graldew zookeeper-srpm *and even
>>> when *./graldew ambari-srpm* to check if native bitgtop defined
>>> packaging works. I am using Bigtop 1.2.1
>>>
>>> Regards,
>>> Taher Koitawala
>>> GS Lab Pune
>>> +91 8407979163
>>>
>>
Re: Apache Ranger RPM build failed
Posted by Taher Koitawala <ta...@gslab.com>.
I checkout bigtop release-1.2.1 tag from git. We are using a centos docker
image and im executing the "./gralde zookeeper-sprm" and "./gradlew
ranger-srpm" command which fail due to the macros has empty body error
On Mon 13 Aug, 2018, 9:29 PM Evans Ye, <ev...@apache.org> wrote:
> I just tried using centos 7 build image and it looks good to me.
> Please share your build command and environment. Thanks.
>
> ---
> [root@c72b8cb47c34 ws]# ./gradlew zookeeper-srpm
> Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use
> --status for details
> Download https://archive.apache.org/dist//zookeeper/zookeeper-3.4.
> 6/zookeeper-3.4.6.tar.gz
>
> > Task :zookeeper-tar
> Copy /ws/dl/zookeeper-3.4.6.tar.gz to /ws/build/zookeeper/tar/
> zookeeper-3.4.6.tar.gz
>
> > Task :zookeeper-srpm
> Wrote: /ws/build/zookeeper/rpm/SRPMS/zookeeper-3.4.6-1.el7.src.rpm
>
>
> BUILD SUCCESSFUL in 17s
>
> Taher Koitawala <ta...@gslab.com> 於 2018年8月13日 週一 下午7:04寫道：
>
>> Hi All,
>> I am currently trying to build Apache Ranger's rpm with Bigtop.
>> However, the build in jenkins fails due to the following error
>>
>>
>> *./gradlew ranger-srpm*
>>
>> Command rpmbuild --define _topdir /home/cloud/bigtop/build/ranger/rpm
>> --define ranger_base_version 0.7.1 --define ranger_version 0.7.1 --define
>> ranger_release 1%{?dist} -bs --nodeps --buildroot=/home/cloud/
>> bigtop/build/ranger/rpm/INSTALL /home/cloud/bigtop/build/
>> ranger/rpm/SPECS/ranger.spec
>>
>> Command exited with error status 1
>>
>> When I execute the same command manually I get the following errors:
>>
>> Error:
>> Macro %_topdir has empty body
>> Macro %_topdir has empty body
>> Macro %_topdir has empty body
>> Macro %ranger_base_version has empty body
>> Macro %ranger_base_version has empty body
>> Macro %ranger_version has empty body
>> Macro %ranger_version has empty body
>> Macro %ranger_release has empty body
>> Macro %ranger_release has empty body
>>
>> I get the same error when i execute *./graldew zookeeper-srpm *and even
>> when *./graldew ambari-srpm* to check if native bitgtop defined
>> packaging works. I am using Bigtop 1.2.1
>>
>> Regards,
>> Taher Koitawala
>> GS Lab Pune
>> +91 8407979163
>>
>
Re: Apache Ranger RPM build failed
Posted by Evans Ye <ev...@apache.org>.
I just tried using centos 7 build image and it looks good to me.
Please share your build command and environment. Thanks.
---
[root@c72b8cb47c34 ws]# ./gradlew zookeeper-srpm
Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use
--status for details
Download
https://archive.apache.org/dist//zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
> Task :zookeeper-tar
Copy /ws/dl/zookeeper-3.4.6.tar.gz to
/ws/build/zookeeper/tar/zookeeper-3.4.6.tar.gz
> Task :zookeeper-srpm
Wrote: /ws/build/zookeeper/rpm/SRPMS/zookeeper-3.4.6-1.el7.src.rpm
BUILD SUCCESSFUL in 17s
Taher Koitawala <ta...@gslab.com> 於 2018年8月13日 週一 下午7:04寫道：
> Hi All,
> I am currently trying to build Apache Ranger's rpm with Bigtop.
> However, the build in jenkins fails due to the following error
>
>
> *./gradlew ranger-srpm*
>
> Command rpmbuild --define _topdir /home/cloud/bigtop/build/ranger/rpm
> --define ranger_base_version 0.7.1 --define ranger_version 0.7.1 --define
> ranger_release 1%{?dist} -bs --nodeps
> --buildroot=/home/cloud/bigtop/build/ranger/rpm/INSTALL
> /home/cloud/bigtop/build/ranger/rpm/SPECS/ranger.spec
>
> Command exited with error status 1
>
> When I execute the same command manually I get the following errors:
>
> Error:
> Macro %_topdir has empty body
> Macro %_topdir has empty body
> Macro %_topdir has empty body
> Macro %ranger_base_version has empty body
> Macro %ranger_base_version has empty body
> Macro %ranger_version has empty body
> Macro %ranger_version has empty body
> Macro %ranger_release has empty body
> Macro %ranger_release has empty body
>
> I get the same error when i execute *./graldew zookeeper-srpm *and even
> when *./graldew ambari-srpm* to check if native bitgtop defined packaging
> works. I am using Bigtop 1.2.1
>
> Regards,
> Taher Koitawala
> GS Lab Pune
> +91 8407979163
>