You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by hanenchao <ha...@139.com> on 2018/10/09 02:46:02 UTC
apache impala build problem,Please help me
Dear all,
I try to build apache impala on CentOS7
apache impala version: 2.12.0
I ran ${IMPALA_HOME}/buildall.sh -skiptests -so. It failed with the following error message:
Scanning dependencies of target protoc-gen-krpc
[ 15%] Building CXX object be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/protoc-gen-krpc.cc.o
[ 15%] Building CXX object be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o
In file included from /home/hadoop/impala-2.12.0/be/src/common/kudu_version.cc:20:0:
/home/hadoop/impala-2.12.0/be/src/common/status.h:28:50: fatal error: gen-cpp/Status_types.h: No such file or directory
#include "gen-cpp/Status_types.h" // for TStatus
^
compilation terminated.
make[2]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o] error 1
make[1]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all] error 2
make: *** [all] error 2
Error in /home/hadoop/impala-2.12.0/bin/make_impala.sh at line 178: ${MAKE_CMD} ${MAKE_ARGS}
If I check what are in the gen-cpp directory, I can see that it is kind of emty and the 'Status_types.h' file is not generated.
[hadoop@bigdata-senior02] /home/hadoop/impala-2.12.0/be/generated-sources/gen-cpp> ls
CMakeFiles cmake_install.cmake CMakeLists.txt common.pb.cc common.pb.h CTestTestfile.cmake Makefile
Do you know how the gen-cpp directory is populated?
I searched the Internet for a solution,ut infra
but, buildall.sh doesn't have the -cmake_only option, I don't know how to run it
My environment variables are as follows :
IMPALA_HOME = /home/hadoop/impala-2.12.0
HADOOP_HOME = /home/hadoop/hadoop-2.7.7
HADOOP_CONF_DIR = /home/hadoop/hadoop-2.7.7/etc/hadoop
HADOOP_INCLUDE_DIR = /home/hadoop/hadoop-2.7.7/include
HADOOP_LIB_DIR = /home/hadoop/hadoop-2.7.7/lib
MINI_DFS_BASE_DATA_DIR = /home/hadoop/impala-2.12.0/cdh-6-hdfs-data
HIVE_HOME = /home/hadoop/hive-2.3.3
HIVE_CONF_DIR = /home/hadoop/hive-2.3.3/conf
HIVE_SRC_DIR = /home/hadoop/hive-2.3.3/src
HBASE_HOME = /home/hadoop/hbase-2.0.1
HBASE_CONF_DIR = /home/hadoop/hbase-2.0.1/conf
MINIKDC_HOME = /home/hadoop/impala-2.12.0/thirdparty/llama-minikdc-1.0.0
THRIFT_HOME = /home/hadoop/impala-2.12.0/toolchain/thrift-0.9.0-p11
HADOOP_LZO = /home/hadoop/impala-2.12.0/../hadoop-lzo
IMPALA_LZO = /home/hadoop/impala-2.12.0/../Impala-lzo
CLASSPATH = /home/hadoop/impala-2.12.0/../hadoop-lzo/build/hadoop-lzo-0.4.15.jar:/home/hadoop/impala-2.12.0/fe/src/test/resources:/home/hadoop/impala-2.12.0/fe/target/classes:/home/hadoop/impala-2.12.0/fe/target/dependency:/home/hadoop/impala-2.12.0/../hadoop-lzo/build/hadoop-lzo-0.4.15.jar:/home/hadoop/impala-2.12.0/fe/src/test/resources:/home/hadoop/impala-2.12.0/fe/target/classes:/home/hadoop/impala-2.12.0/fe/target/dependency:/home/hadoop/jdk1.8.0_171/lib/tools.jar:/home/hadoop/jdk1.8.0_171/lib/dt.jar
LIBHDFS_OPTS = -Djava.library.path=/home/hadoop/hadoop-2.7.7/lib/native/ -XX:MaxPermSize=128m -Djava.library.path=/home/hadoop/hadoop-2.7.7/lib/native/ -XX:MaxPermSize=128m
PYTHONPATH = /home/hadoop/impala-2.12.0:/home/hadoop/impala-2.12.0/shell/gen-py:/home/hadoop/impala-2.12.0/testdata/:/home/hadoop/hive-2.3.3/lib/py:/home/hadoop/impala-2.12.0/shell/ext-py/*/dist/*.egg
JAVA_HOME = /home/hadoop/jdk1.8.0_171
LD_LIBRARY_PATH = :/home/hadoop/jdk1.8.0_171/jre/lib/amd64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64/server:/home/hadoop/hadoop-2.7.7/lib/native:/home/hadoop/impala-2.12.0/toolchain/snappy-1.1.4/lib:/home/hadoop/impala-2.12.0/../Impala-lzo/build:/home/hadoop/impala-2.12.0/toolchain/gcc-4.9.2/lib64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64/server:/home/hadoop/hadoop-2.7.7/lib/native:/home/hadoop/impala-2.12.0/toolchain/snappy-1.1.4/lib:/home/hadoop/impala-2.12.0/../Impala-lzo/build:/home/hadoop/impala-2.12.0/toolchain/gcc-4.9.2/lib64
LD_PRELOAD = :/home/hadoop/jdk1.8.0_171/jre/lib/amd64/libjsig.so:/home/hadoop/jdk1.8.0_171/jre/lib/amd64/libjsig.so
POSTGRES_JDBC_DRIVER = /home/hadoop/impala-2.12.0/fe/target/dependency/postgresql-9.0-801.jdbc4.jar
IMPALA_TOOLCHAIN = /home/hadoop/impala-2.12.0/toolchain
DOWNLOAD_CDH_COMPONENTS = false
IMPALA_MAVEN_OPTIONS =
I didn't use CDH,I don't know if this configuration is correct,Attached are impala-config.sh and impala-config.sh, as well as build log.
I'm Chinese and my English is poor. I am communicating with you using the translation software. I hope my expression is not too wrong and you can understand it
Looking forward to your reply and help
thanks
hanenchao
Re: apache impala build problem,Please help me
Posted by Quanlong Huang <hu...@gmail.com>.
Hi Hanen,
Maybe the thrift compiler failed to generate codes. You can try "make
thrift-deps" and see if this helps. It should generate thrift compiled
codes.
BTW, your attachments can't be forwarded by apache mailing list so they're
missed. You can try https://pastebin.com/ and share a link about the logs
you see.
HTH,
Quanlong
On Tue, Oct 9, 2018 at 10:47 AM hanenchao <ha...@139.com> wrote:
> Dear all,
>
> I try to build apache impala on CentOS7
> apache impala version: 2.12.0
>
> I ran ${IMPALA_HOME}/buildall.sh -skiptests -so. It failed with the
> following error message:
>
> Scanning dependencies of target protoc-gen-krpc
> [ 15%] Building CXX object
> be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/protoc-gen-krpc.cc.o
> [ 15%] Building CXX object
> be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o
> In file included from
> /home/hadoop/impala-2.12.0/be/src/common/kudu_version.cc:20:0:
> /home/hadoop/impala-2.12.0/be/src/common/status.h:28:50: fatal error:
> gen-cpp/Status_types.h: No such file or directory
> #include "gen-cpp/Status_types.h" // for TStatus
> ^
> compilation terminated.
> make[2]: ***
> [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/__/__/common/kudu_version.cc.o]
> error 1
> make[1]: *** [be/src/kudu/rpc/CMakeFiles/protoc-gen-krpc.dir/all] error 2
> make: *** [all] error 2
> Error in /home/hadoop/impala-2.12.0/bin/make_impala.sh at line 178:
> ${MAKE_CMD} ${MAKE_ARGS}
>
>
> If I check what are in the gen-cpp directory, I can see that it is kind of
> emty and the 'Status_types.h' file is not generated.
>
> [hadoop@bigdata-senior02]
> /home/hadoop/impala-2.12.0/be/generated-sources/gen-cpp> ls
> CMakeFiles cmake_install.cmake CMakeLists.txt common.pb.cc
> common.pb.h CTestTestfile.cmake Makefile
>
> Do you know how the gen-cpp directory is populated?
>
> I searched the Internet for a solution,ut infra
>
> but, buildall.sh doesn't have the -cmake_only option, I don't know how to
> run it
>
> My environment variables are as follows :
>
> IMPALA_HOME = /home/hadoop/impala-2.12.0
> HADOOP_HOME = /home/hadoop/hadoop-2.7.7
> HADOOP_CONF_DIR = /home/hadoop/hadoop-2.7.7/etc/hadoop
> HADOOP_INCLUDE_DIR = /home/hadoop/hadoop-2.7.7/include
> HADOOP_LIB_DIR = /home/hadoop/hadoop-2.7.7/lib
> MINI_DFS_BASE_DATA_DIR = /home/hadoop/impala-2.12.0/cdh-6-hdfs-data
> HIVE_HOME = /home/hadoop/hive-2.3.3
> HIVE_CONF_DIR = /home/hadoop/hive-2.3.3/conf
> HIVE_SRC_DIR = /home/hadoop/hive-2.3.3/src
> HBASE_HOME = /home/hadoop/hbase-2.0.1
> HBASE_CONF_DIR = /home/hadoop/hbase-2.0.1/conf
> MINIKDC_HOME =
> /home/hadoop/impala-2.12.0/thirdparty/llama-minikdc-1.0.0
> THRIFT_HOME =
> /home/hadoop/impala-2.12.0/toolchain/thrift-0.9.0-p11
> HADOOP_LZO = /home/hadoop/impala-2.12.0/../hadoop-lzo
> IMPALA_LZO = /home/hadoop/impala-2.12.0/../Impala-lzo
> CLASSPATH =
> /home/hadoop/impala-2.12.0/../hadoop-lzo/build/hadoop-lzo-0.4.15.jar:/home/hadoop/impala-2.12.0/fe/src/test/resources:/home/hadoop/impala-2.12.0/fe/target/classes:/home/hadoop/impala-2.12.0/fe/target/dependency:/home/hadoop/impala-2.12.0/../hadoop-lzo/build/hadoop-lzo-0.4.15.jar:/home/hadoop/impala-2.12.0/fe/src/test/resources:/home/hadoop/impala-2.12.0/fe/target/classes:/home/hadoop/impala-2.12.0/fe/target/dependency:/home/hadoop/jdk1.8.0_171/lib/tools.jar:/home/hadoop/jdk1.8.0_171/lib/dt.jar
> LIBHDFS_OPTS =
> -Djava.library.path=/home/hadoop/hadoop-2.7.7/lib/native/
> -XX:MaxPermSize=128m
> -Djava.library.path=/home/hadoop/hadoop-2.7.7/lib/native/
> -XX:MaxPermSize=128m
> PYTHONPATH =
> /home/hadoop/impala-2.12.0:/home/hadoop/impala-2.12.0/shell/gen-py:/home/hadoop/impala-2.12.0/testdata/:/home/hadoop/hive-2.3.3/lib/py:/home/hadoop/impala-2.12.0/shell/ext-py/*/dist/*.egg
> JAVA_HOME = /home/hadoop/jdk1.8.0_171
> LD_LIBRARY_PATH =
> :/home/hadoop/jdk1.8.0_171/jre/lib/amd64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64/server:/home/hadoop/hadoop-2.7.7/lib/native:/home/hadoop/impala-2.12.0/toolchain/snappy-1.1.4/lib:/home/hadoop/impala-2.12.0/../Impala-lzo/build:/home/hadoop/impala-2.12.0/toolchain/gcc-4.9.2/lib64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64:/home/hadoop/jdk1.8.0_171/jre/lib/amd64/server:/home/hadoop/hadoop-2.7.7/lib/native:/home/hadoop/impala-2.12.0/toolchain/snappy-1.1.4/lib:/home/hadoop/impala-2.12.0/../Impala-lzo/build:/home/hadoop/impala-2.12.0/toolchain/gcc-4.9.2/lib64
> LD_PRELOAD =
> :/home/hadoop/jdk1.8.0_171/jre/lib/amd64/libjsig.so:/home/hadoop/jdk1.8.0_171/jre/lib/amd64/libjsig.so
> POSTGRES_JDBC_DRIVER =
> /home/hadoop/impala-2.12.0/fe/target/dependency/postgresql-9.0-801.jdbc4.jar
> IMPALA_TOOLCHAIN = /home/hadoop/impala-2.12.0/toolchain
> DOWNLOAD_CDH_COMPONENTS = false
> IMPALA_MAVEN_OPTIONS =
>
> I didn't use CDH,I don't know if this configuration is correct,Attached
> are impala-config.sh and impala-config.sh, as well as build log.
>
>
> I'm Chinese and my English is poor. I am communicating with you using the
> translation software. I hope my expression is not too wrong and you can
> understand it
>
> Looking forward to your reply and help
> thanks
>
> ------------------------------
> hanenchao
>