You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Luca Toscano <to...@gmail.com> on 2021/03/16 10:35:43 UTC
Re: Problem while building hadoop-pkg
+dev
Hi everybody,
I was able to solve this with:
diff --git a/bigtop-packages/src/deb/hadoop/rules
b/bigtop-packages/src/deb/hadoop/rules
index 17e59874..62e87d5c 100755
--- a/bigtop-packages/src/deb/hadoop/rules
+++ b/bigtop-packages/src/deb/hadoop/rules
@@ -56,7 +56,7 @@ override_dh_auto_install:
bash debian/install_hadoop.sh \
--prefix=debian/tmp/ \
--distro-dir=debian \
- --build-dir=${PWD}/build \
+ --build-dir=${CURDIR}/build \
--system-lib-dir=debian/tmp/usr/lib/ \
--system-libexec-dir=debian/tmp/usr/lib/hadoop/libexec/ \
--system-include-dir=debian/tmp/usr/include \
That seems to follow the guideline of
https://lintian.debian.org/tags/debian-rules-calls-pwd.html, but I am
not familiar enough with the build machinery to be confident whether
it is the right fix or not.
Anybody else with the same issue?
Luca
On Thu, Mar 11, 2021 at 2:26 PM Luca Toscano <to...@gmail.com> wrote:
>
> Hi everybody,
>
> I am trying to build the hadoop-pkg target on the trunk-debian10
> Docker image and I get an error (on the master branch):
>
> docker run --rm -v `pwd`:/ws --workdir /ws
> bigtop/slaves:trunk-debian-10 bash -c '. /etc/profile.d/bigtop.sh;
> ./gradlew allclean hadoop-pkg'
>
> [..]
> + chmod 755 debian/tmp//usr/bin/yarn
> + for component in $HADOOP_DIR/bin/hadoop $HDFS_DIR/bin/hdfs
> $YARN_DIR/bin/yarn $MAPREDUCE_DIR/bin/mapred
> + wrapper=debian/tmp//usr/bin/mapred
> + cat
> + chmod 755 debian/tmp//usr/bin/mapred
> + install -d -m 0755 debian/tmp/usr/lib/hadoop/libexec/
> + cp -r '/build/libexec/*' debian/tmp/usr/lib/hadoop/libexec//
> cp: cannot stat '/build/libexec/*': No such file or directory
> make[1]: *** [debian/rules:55: override_dh_auto_install] Error 1
> make[1]: Leaving directory '/ws/output/hadoop/hadoop-3.2.2'
> make: *** [debian/rules:27: binary] Error 2
> dpkg-buildpackage: error: debian/rules binary subprocess returned exit status 2
> debuild: fatal error at line 1182:
> dpkg-buildpackage -us -uc -ui -b
> failed
>
> I tried to check inside '/ws/output/hadoop/hadoop-3.2.2' (on my local
> path) and I did find a 'build/libexec' dir with files, so I am
> wondering if the / in front of /build/libexec is somehow a problem? I
> see --build-dir=${PWD}/build in the debian rules file, but it wasn't
> touched in ages, so I suspect that I am doing something wrong :D
>
> Luca
Re: Problem while building hadoop-pkg
Posted by Luca Toscano <to...@gmail.com>.
Hi Masatake,
Done! https://issues.apache.org/jira/browse/BIGTOP-3527
I am currently wondering if this issue is Luca-specific (namely I am
doing something wrong, probable cause) or Debian-10 specific :)
Luca
On Tue, Mar 16, 2021 at 1:24 PM Masatake Iwasaki
<iw...@oss.nttdata.co.jp> wrote:
>
> Hi Luca,
>
> > - --build-dir=${PWD}/build \
> > + --build-dir=${CURDIR}/build \
>
> I think it is the right fix based on the description of debian-rules-calls-pwd.
> I got no issue on hadoop-pkg on Ubuntu 18.04 with (or without) the fix.
> Could you file a JIRA issue for this?
>
> Masatake Iwasaki
>
>
> On 2021/03/16 19:35, Luca Toscano wrote:
> > +dev
> >
> > Hi everybody,
> >
> > I was able to solve this with:
> >
> > diff --git a/bigtop-packages/src/deb/hadoop/rules
> > b/bigtop-packages/src/deb/hadoop/rules
> > index 17e59874..62e87d5c 100755
> > --- a/bigtop-packages/src/deb/hadoop/rules
> > +++ b/bigtop-packages/src/deb/hadoop/rules
> > @@ -56,7 +56,7 @@ override_dh_auto_install:
> > bash debian/install_hadoop.sh \
> > --prefix=debian/tmp/ \
> > --distro-dir=debian \
> > - --build-dir=${PWD}/build \
> > + --build-dir=${CURDIR}/build \
> > --system-lib-dir=debian/tmp/usr/lib/ \
> > --system-libexec-dir=debian/tmp/usr/lib/hadoop/libexec/ \
> > --system-include-dir=debian/tmp/usr/include \
> >
> > That seems to follow the guideline of
> > https://lintian.debian.org/tags/debian-rules-calls-pwd.html, but I am
> > not familiar enough with the build machinery to be confident whether
> > it is the right fix or not.
> >
> > Anybody else with the same issue?
> >
> > Luca
> >
> > On Thu, Mar 11, 2021 at 2:26 PM Luca Toscano <to...@gmail.com> wrote:
> >>
> >> Hi everybody,
> >>
> >> I am trying to build the hadoop-pkg target on the trunk-debian10
> >> Docker image and I get an error (on the master branch):
> >>
> >> docker run --rm -v `pwd`:/ws --workdir /ws
> >> bigtop/slaves:trunk-debian-10 bash -c '. /etc/profile.d/bigtop.sh;
> >> ./gradlew allclean hadoop-pkg'
> >>
> >> [..]
> >> + chmod 755 debian/tmp//usr/bin/yarn
> >> + for component in $HADOOP_DIR/bin/hadoop $HDFS_DIR/bin/hdfs
> >> $YARN_DIR/bin/yarn $MAPREDUCE_DIR/bin/mapred
> >> + wrapper=debian/tmp//usr/bin/mapred
> >> + cat
> >> + chmod 755 debian/tmp//usr/bin/mapred
> >> + install -d -m 0755 debian/tmp/usr/lib/hadoop/libexec/
> >> + cp -r '/build/libexec/*' debian/tmp/usr/lib/hadoop/libexec//
> >> cp: cannot stat '/build/libexec/*': No such file or directory
> >> make[1]: *** [debian/rules:55: override_dh_auto_install] Error 1
> >> make[1]: Leaving directory '/ws/output/hadoop/hadoop-3.2.2'
> >> make: *** [debian/rules:27: binary] Error 2
> >> dpkg-buildpackage: error: debian/rules binary subprocess returned exit status 2
> >> debuild: fatal error at line 1182:
> >> dpkg-buildpackage -us -uc -ui -b
> >> failed
> >>
> >> I tried to check inside '/ws/output/hadoop/hadoop-3.2.2' (on my local
> >> path) and I did find a 'build/libexec' dir with files, so I am
> >> wondering if the / in front of /build/libexec is somehow a problem? I
> >> see --build-dir=${PWD}/build in the debian rules file, but it wasn't
> >> touched in ages, so I suspect that I am doing something wrong :D
> >>
> >> Luca
Re: Problem while building hadoop-pkg
Posted by Luca Toscano <to...@gmail.com>.
Hi Masatake,
Done! https://issues.apache.org/jira/browse/BIGTOP-3527
I am currently wondering if this issue is Luca-specific (namely I am
doing something wrong, probable cause) or Debian-10 specific :)
Luca
On Tue, Mar 16, 2021 at 1:24 PM Masatake Iwasaki
<iw...@oss.nttdata.co.jp> wrote:
>
> Hi Luca,
>
> > - --build-dir=${PWD}/build \
> > + --build-dir=${CURDIR}/build \
>
> I think it is the right fix based on the description of debian-rules-calls-pwd.
> I got no issue on hadoop-pkg on Ubuntu 18.04 with (or without) the fix.
> Could you file a JIRA issue for this?
>
> Masatake Iwasaki
>
>
> On 2021/03/16 19:35, Luca Toscano wrote:
> > +dev
> >
> > Hi everybody,
> >
> > I was able to solve this with:
> >
> > diff --git a/bigtop-packages/src/deb/hadoop/rules
> > b/bigtop-packages/src/deb/hadoop/rules
> > index 17e59874..62e87d5c 100755
> > --- a/bigtop-packages/src/deb/hadoop/rules
> > +++ b/bigtop-packages/src/deb/hadoop/rules
> > @@ -56,7 +56,7 @@ override_dh_auto_install:
> > bash debian/install_hadoop.sh \
> > --prefix=debian/tmp/ \
> > --distro-dir=debian \
> > - --build-dir=${PWD}/build \
> > + --build-dir=${CURDIR}/build \
> > --system-lib-dir=debian/tmp/usr/lib/ \
> > --system-libexec-dir=debian/tmp/usr/lib/hadoop/libexec/ \
> > --system-include-dir=debian/tmp/usr/include \
> >
> > That seems to follow the guideline of
> > https://lintian.debian.org/tags/debian-rules-calls-pwd.html, but I am
> > not familiar enough with the build machinery to be confident whether
> > it is the right fix or not.
> >
> > Anybody else with the same issue?
> >
> > Luca
> >
> > On Thu, Mar 11, 2021 at 2:26 PM Luca Toscano <to...@gmail.com> wrote:
> >>
> >> Hi everybody,
> >>
> >> I am trying to build the hadoop-pkg target on the trunk-debian10
> >> Docker image and I get an error (on the master branch):
> >>
> >> docker run --rm -v `pwd`:/ws --workdir /ws
> >> bigtop/slaves:trunk-debian-10 bash -c '. /etc/profile.d/bigtop.sh;
> >> ./gradlew allclean hadoop-pkg'
> >>
> >> [..]
> >> + chmod 755 debian/tmp//usr/bin/yarn
> >> + for component in $HADOOP_DIR/bin/hadoop $HDFS_DIR/bin/hdfs
> >> $YARN_DIR/bin/yarn $MAPREDUCE_DIR/bin/mapred
> >> + wrapper=debian/tmp//usr/bin/mapred
> >> + cat
> >> + chmod 755 debian/tmp//usr/bin/mapred
> >> + install -d -m 0755 debian/tmp/usr/lib/hadoop/libexec/
> >> + cp -r '/build/libexec/*' debian/tmp/usr/lib/hadoop/libexec//
> >> cp: cannot stat '/build/libexec/*': No such file or directory
> >> make[1]: *** [debian/rules:55: override_dh_auto_install] Error 1
> >> make[1]: Leaving directory '/ws/output/hadoop/hadoop-3.2.2'
> >> make: *** [debian/rules:27: binary] Error 2
> >> dpkg-buildpackage: error: debian/rules binary subprocess returned exit status 2
> >> debuild: fatal error at line 1182:
> >> dpkg-buildpackage -us -uc -ui -b
> >> failed
> >>
> >> I tried to check inside '/ws/output/hadoop/hadoop-3.2.2' (on my local
> >> path) and I did find a 'build/libexec' dir with files, so I am
> >> wondering if the / in front of /build/libexec is somehow a problem? I
> >> see --build-dir=${PWD}/build in the debian rules file, but it wasn't
> >> touched in ages, so I suspect that I am doing something wrong :D
> >>
> >> Luca
Re: Problem while building hadoop-pkg
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hi Luca,
> - --build-dir=${PWD}/build \
> + --build-dir=${CURDIR}/build \
I think it is the right fix based on the description of debian-rules-calls-pwd.
I got no issue on hadoop-pkg on Ubuntu 18.04 with (or without) the fix.
Could you file a JIRA issue for this?
Masatake Iwasaki
On 2021/03/16 19:35, Luca Toscano wrote:
> +dev
>
> Hi everybody,
>
> I was able to solve this with:
>
> diff --git a/bigtop-packages/src/deb/hadoop/rules
> b/bigtop-packages/src/deb/hadoop/rules
> index 17e59874..62e87d5c 100755
> --- a/bigtop-packages/src/deb/hadoop/rules
> +++ b/bigtop-packages/src/deb/hadoop/rules
> @@ -56,7 +56,7 @@ override_dh_auto_install:
> bash debian/install_hadoop.sh \
> --prefix=debian/tmp/ \
> --distro-dir=debian \
> - --build-dir=${PWD}/build \
> + --build-dir=${CURDIR}/build \
> --system-lib-dir=debian/tmp/usr/lib/ \
> --system-libexec-dir=debian/tmp/usr/lib/hadoop/libexec/ \
> --system-include-dir=debian/tmp/usr/include \
>
> That seems to follow the guideline of
> https://lintian.debian.org/tags/debian-rules-calls-pwd.html, but I am
> not familiar enough with the build machinery to be confident whether
> it is the right fix or not.
>
> Anybody else with the same issue?
>
> Luca
>
> On Thu, Mar 11, 2021 at 2:26 PM Luca Toscano <to...@gmail.com> wrote:
>>
>> Hi everybody,
>>
>> I am trying to build the hadoop-pkg target on the trunk-debian10
>> Docker image and I get an error (on the master branch):
>>
>> docker run --rm -v `pwd`:/ws --workdir /ws
>> bigtop/slaves:trunk-debian-10 bash -c '. /etc/profile.d/bigtop.sh;
>> ./gradlew allclean hadoop-pkg'
>>
>> [..]
>> + chmod 755 debian/tmp//usr/bin/yarn
>> + for component in $HADOOP_DIR/bin/hadoop $HDFS_DIR/bin/hdfs
>> $YARN_DIR/bin/yarn $MAPREDUCE_DIR/bin/mapred
>> + wrapper=debian/tmp//usr/bin/mapred
>> + cat
>> + chmod 755 debian/tmp//usr/bin/mapred
>> + install -d -m 0755 debian/tmp/usr/lib/hadoop/libexec/
>> + cp -r '/build/libexec/*' debian/tmp/usr/lib/hadoop/libexec//
>> cp: cannot stat '/build/libexec/*': No such file or directory
>> make[1]: *** [debian/rules:55: override_dh_auto_install] Error 1
>> make[1]: Leaving directory '/ws/output/hadoop/hadoop-3.2.2'
>> make: *** [debian/rules:27: binary] Error 2
>> dpkg-buildpackage: error: debian/rules binary subprocess returned exit status 2
>> debuild: fatal error at line 1182:
>> dpkg-buildpackage -us -uc -ui -b
>> failed
>>
>> I tried to check inside '/ws/output/hadoop/hadoop-3.2.2' (on my local
>> path) and I did find a 'build/libexec' dir with files, so I am
>> wondering if the / in front of /build/libexec is somehow a problem? I
>> see --build-dir=${PWD}/build in the debian rules file, but it wasn't
>> touched in ages, so I suspect that I am doing something wrong :D
>>
>> Luca