You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by Yang Su <ya...@gmx.ch> on 2018/04/04 18:33:43 UTC

Error when build with bootstrap_development.sh

Dear all,
 
I try to build impala on a Ubuntu box: 16.04.1-Ubuntu x86_64.
 
I ran bin/bootstrap_development.sh. It failed with the following error message:
 
[ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/protoc-gen-krpc.cc.o
[ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o
In file included from /home/ysu/Impala/be/src/common/kudu_version.cc:20:0:
/home/ysu/Impala/be/src/common/status.h:28:50: fatal error: gen-cpp/Status_types.h: No such file or directory
 #include "gen-cpp/Status_types.h"  // for TStatus
                                                  ^
compilation terminated.
be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/build.make:86: recipe for target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o' failed
make[2]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o] Error 1
CMakeFiles/Makefile2:3261: recipe for target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all' failed
make[1]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all] Error 2
Makefile:94: recipe for target 'all' failed
make: *** [all] Error 2
Error in /home/ysu/Impala/bin/make_impala.sh at line 178: ${MAKE_CMD} ${MAKE_ARGS}
 
 
It seems that gen-cpp directory is not properly populated. Has anyone encountered the same problem and how did you solve it?
 
Thank you and best regards,
Yang

Re: Error when build with bootstrap_development.sh

Posted by .
Hello.

Same error on Ubuntu 16.04.2 LTS x64

But I think I've found a workaround for me:

1. Make sure that ${IMPALA_HOME}/common/thrift/ folder contains CMakeLists.txt and necessary thrift files.
2. Now run a cmake_only build via ${IMPALA_HOME}/buildall.sh -cmake_only
3. In thrift common folder call $ make 
4. Now check ${IMPALA_HOME}/be/generated-sources/gen-cpp folder for code-generated files.
5. Then run noclean build ${IMPALA_HOME}/buildall.sh -noclean -skiptests -format

On 2018/04/04 18:33:43, "Yang Su" <ya...@gmx.ch> wrote: 
> Dear all,
>  
> I try to build impala on a Ubuntu box: 16.04.1-Ubuntu x86_64.
>  
> I ran bin/bootstrap_development.sh. It failed with the following error message:
>  
> [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/protoc-gen-krpc.cc.o
> [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o
> In file included from /home/ysu/Impala/be/src/common/kudu_version.cc:20:0:
> /home/ysu/Impala/be/src/common/status.h:28:50: fatal error: gen-cpp/Status_types.h: No such file or directory
>  #include "gen-cpp/Status_types.h"  // for TStatus
>                                                   ^
> compilation terminated.
> be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/build.make:86: recipe for target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o' failed
> make[2]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o] Error 1
> CMakeFiles/Makefile2:3261: recipe for target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all' failed
> make[1]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all] Error 2
> Makefile:94: recipe for target 'all' failed
> make: *** [all] Error 2
> Error in /home/ysu/Impala/bin/make_impala.sh at line 178: ${MAKE_CMD} ${MAKE_ARGS}
>  
>  
> It seems that gen-cpp directory is not properly populated. Has anyone encountered the same problem and how did you solve it?
>  
> Thank you and best regards,
> Yang
> 

Re: Re: Error when build with bootstrap_development.sh

Posted by Gabor Kaszab <ga...@cloudera.com>.
Hey Yang,

Well, I have no idea why the gen-cpp directory is not populated for you. I
have made a full clean build this week on the latest Impala code with
success.

Could you please give more details how you try to build? e.g:
 - Which dir you use for Impala build?
 - How do you source the configs (and in which dir)?
 - What exact steps you perform and in which order (besides
bootstrap_development.sh)?
 - Which version of Impala are you trying to build?
 - Anything else you find relevant would be great :)

Cheers,
Gabor


On Fri, Apr 6, 2018 at 11:21 PM, Yang Su <ya...@gmx.ch> wrote:

> Hi Gabor, Sailesh,
>
> Thank you for the hints.
>
> I have tried both hints but it still does not work. The build fails with
> the same error.
>
> If I check what are in the gen-cpp directory, I can see that it is kind of
> emty and the 'Status_types.h' file is not generated.
>
> ysu@ysu-VirtualBox:~/Impala$ ls be/generated-sources/gen-cpp/
> CMakeFiles  cmake_install.cmake  common.pb.cc  common.pb.h
> CTestTestfile.cmake  Makefile
>
> Do you know how the gen-cpp directory is populated?
>
> Kind regards,
> Yang
>
>
> Gesendet: Donnerstag, 05. April 2018 um 10:33 Uhr
> Von: "Gabor Kaszab" <ga...@cloudera.com>
> An: dev@impala.apache.org
> Betreff: Re: Error when build with bootstrap_development.sh
> Another thing worth checking: bootstrap_development.sh invokes
> bootstrap_system.sh that in turn does a git clone to ~/Impala and tries to
> build there. My assumption is that you did a git clone to a different
> directory, sourced configs there but then the bootstrap script tried to
> build Impala in ~/Impala. I tend to comment out the git clone part of the
> bootstrap_system.sh script (and the following line "cd ~/Impala"). Let me
> know if this helps.
>
> Cheers,
> Gabor
>
> On Wed, Apr 4, 2018 at 9:21 PM, Sailesh Mukil <sa...@cloudera.com>
> wrote:
>
> > Have you tried deleting the gen-cpp directory and rebuilding with
> > "./buildall" ?
> >
> > On Wed, Apr 4, 2018 at 11:33 AM, Yang Su <ya...@gmx.ch> wrote:
> >
> > > Dear all,
> > >
> > > I try to build impala on a Ubuntu box: 16.04.1-Ubuntu x86_64.
> > >
> > > I ran bin/bootstrap_development.sh. It failed with the following error
> > > message:
> > >
> > > [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/
> > > protoc-gen-krpc.dir/protoc-gen-krpc.cc.o
> > > [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/
> > > protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o
> > > In file included from /home/ysu/Impala/be/src/
> > common/kudu_version.cc:20:0:
> > > /home/ysu/Impala/be/src/common/status.h:28:50: fatal error:
> > > gen-cpp/Status_types.h: No such file or directory
> > > #include "gen-cpp/Status_types.h" // for TStatus
> > > ^
> > > compilation terminated.
> > > be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/build.make:86: recipe
> for
> > > target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/
> > common/kudu_version.cc.o'
> > > failed
> > > make[2]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/
> > common/kudu_version.cc.o]
> > > Error 1
> > > CMakeFiles/Makefile2:3261: recipe for target
> 'be/src/kudu/rpc/CMakeFiles/
> > protoc-gen-krpc.dir/all'
> > > failed
> > > make[1]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all]
> Error
> > 2
> > > Makefile:94: recipe for target 'all' failed
> > > make: *** [all] Error 2
> > > Error in /home/ysu/Impala/bin/make_impala.sh at line 178: ${MAKE_CMD}
> > > ${MAKE_ARGS}
> > >
> > >
> > > It seems that gen-cpp directory is not properly populated. Has anyone
> > > encountered the same problem and how did you solve it?
> > >
> > > Thank you and best regards,
> > > Yang
> > >
> >
>

Aw: Re: Error when build with bootstrap_development.sh

Posted by Yang Su <ya...@gmx.ch>.
Hi Gabor, Sailesh,
 
Thank you for the hints.
 
I have tried both hints but it still does not work. The build fails with the same error.
 
If I check what are in the gen-cpp directory, I can see that it is kind of emty and the 'Status_types.h' file is not generated.
 
ysu@ysu-VirtualBox:~/Impala$ ls be/generated-sources/gen-cpp/
CMakeFiles  cmake_install.cmake  common.pb.cc  common.pb.h  CTestTestfile.cmake  Makefile
 
Do you know how the gen-cpp directory is populated?
 
Kind regards,
Yang
 
 
Gesendet: Donnerstag, 05. April 2018 um 10:33 Uhr
Von: "Gabor Kaszab" <ga...@cloudera.com>
An: dev@impala.apache.org
Betreff: Re: Error when build with bootstrap_development.sh
Another thing worth checking: bootstrap_development.sh invokes
bootstrap_system.sh that in turn does a git clone to ~/Impala and tries to
build there. My assumption is that you did a git clone to a different
directory, sourced configs there but then the bootstrap script tried to
build Impala in ~/Impala. I tend to comment out the git clone part of the
bootstrap_system.sh script (and the following line "cd ~/Impala"). Let me
know if this helps.

Cheers,
Gabor

On Wed, Apr 4, 2018 at 9:21 PM, Sailesh Mukil <sa...@cloudera.com> wrote:

> Have you tried deleting the gen-cpp directory and rebuilding with
> "./buildall" ?
>
> On Wed, Apr 4, 2018 at 11:33 AM, Yang Su <ya...@gmx.ch> wrote:
>
> > Dear all,
> >
> > I try to build impala on a Ubuntu box: 16.04.1-Ubuntu x86_64.
> >
> > I ran bin/bootstrap_development.sh. It failed with the following error
> > message:
> >
> > [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/
> > protoc-gen-krpc.dir/protoc-gen-krpc.cc.o
> > [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/
> > protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o
> > In file included from /home/ysu/Impala/be/src/
> common/kudu_version.cc:20:0:
> > /home/ysu/Impala/be/src/common/status.h:28:50: fatal error:
> > gen-cpp/Status_types.h: No such file or directory
> > #include "gen-cpp/Status_types.h" // for TStatus
> > ^
> > compilation terminated.
> > be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/build.make:86: recipe for
> > target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/
> common/kudu_version.cc.o'
> > failed
> > make[2]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/
> common/kudu_version.cc.o]
> > Error 1
> > CMakeFiles/Makefile2:3261: recipe for target 'be/src/kudu/rpc/CMakeFiles/
> protoc-gen-krpc.dir/all'
> > failed
> > make[1]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all] Error
> 2
> > Makefile:94: recipe for target 'all' failed
> > make: *** [all] Error 2
> > Error in /home/ysu/Impala/bin/make_impala.sh at line 178: ${MAKE_CMD}
> > ${MAKE_ARGS}
> >
> >
> > It seems that gen-cpp directory is not properly populated. Has anyone
> > encountered the same problem and how did you solve it?
> >
> > Thank you and best regards,
> > Yang
> >
>

Re: Error when build with bootstrap_development.sh

Posted by Gabor Kaszab <ga...@cloudera.com>.
Another thing worth checking: bootstrap_development.sh invokes
bootstrap_system.sh that in turn does a git clone to ~/Impala and tries to
build there. My assumption is that you did a git clone to a different
directory, sourced configs there but then the bootstrap script tried to
build Impala in ~/Impala. I tend to comment out the git clone part of the
bootstrap_system.sh script (and the following line "cd ~/Impala"). Let me
know if this helps.

Cheers,
Gabor

On Wed, Apr 4, 2018 at 9:21 PM, Sailesh Mukil <sa...@cloudera.com> wrote:

> Have you tried deleting the gen-cpp directory and rebuilding with
> "./buildall" ?
>
> On Wed, Apr 4, 2018 at 11:33 AM, Yang Su <ya...@gmx.ch> wrote:
>
> > Dear all,
> >
> > I try to build impala on a Ubuntu box: 16.04.1-Ubuntu x86_64.
> >
> > I ran bin/bootstrap_development.sh. It failed with the following error
> > message:
> >
> > [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/
> > protoc-gen-krpc.dir/protoc-gen-krpc.cc.o
> > [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/
> > protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o
> > In file included from /home/ysu/Impala/be/src/
> common/kudu_version.cc:20:0:
> > /home/ysu/Impala/be/src/common/status.h:28:50: fatal error:
> > gen-cpp/Status_types.h: No such file or directory
> >  #include "gen-cpp/Status_types.h"  // for TStatus
> >                                                   ^
> > compilation terminated.
> > be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/build.make:86: recipe for
> > target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/
> common/kudu_version.cc.o'
> > failed
> > make[2]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/
> common/kudu_version.cc.o]
> > Error 1
> > CMakeFiles/Makefile2:3261: recipe for target 'be/src/kudu/rpc/CMakeFiles/
> protoc-gen-krpc.dir/all'
> > failed
> > make[1]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all] Error
> 2
> > Makefile:94: recipe for target 'all' failed
> > make: *** [all] Error 2
> > Error in /home/ysu/Impala/bin/make_impala.sh at line 178: ${MAKE_CMD}
> > ${MAKE_ARGS}
> >
> >
> > It seems that gen-cpp directory is not properly populated. Has anyone
> > encountered the same problem and how did you solve it?
> >
> > Thank you and best regards,
> > Yang
> >
>

Re: Error when build with bootstrap_development.sh

Posted by Sailesh Mukil <sa...@cloudera.com>.
Have you tried deleting the gen-cpp directory and rebuilding with
"./buildall" ?

On Wed, Apr 4, 2018 at 11:33 AM, Yang Su <ya...@gmx.ch> wrote:

> Dear all,
>
> I try to build impala on a Ubuntu box: 16.04.1-Ubuntu x86_64.
>
> I ran bin/bootstrap_development.sh. It failed with the following error
> message:
>
> [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/
> protoc-gen-krpc.dir/protoc-gen-krpc.cc.o
> [ 17%] Building CXX object be/src/kudu/rpc/CMakeFiles/
> protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o
> In file included from /home/ysu/Impala/be/src/common/kudu_version.cc:20:0:
> /home/ysu/Impala/be/src/common/status.h:28:50: fatal error:
> gen-cpp/Status_types.h: No such file or directory
>  #include "gen-cpp/Status_types.h"  // for TStatus
>                                                   ^
> compilation terminated.
> be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/build.make:86: recipe for
> target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o'
> failed
> make[2]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o]
> Error 1
> CMakeFiles/Makefile2:3261: recipe for target 'be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all'
> failed
> make[1]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all] Error 2
> Makefile:94: recipe for target 'all' failed
> make: *** [all] Error 2
> Error in /home/ysu/Impala/bin/make_impala.sh at line 178: ${MAKE_CMD}
> ${MAKE_ARGS}
>
>
> It seems that gen-cpp directory is not properly populated. Has anyone
> encountered the same problem and how did you solve it?
>
> Thank you and best regards,
> Yang
>