You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@impala.apache.org by 俊杰陈 <cj...@gmail.com> on 2016/12/15 03:26:06 UTC
impala setup issue
Hi
I’m trying to download impala and compile it but have some problems like
following, can anyone help on this?
./buildall.sh complain no virtualenv**.tag.gz found, I tried download
15.1 version manually, while the impala-shell.sh can’t load sasl lib. (
I’m in Ubuntu 16.04, with GCC5.4 default, and I installed gcc4.9.2)
Traceback (most recent call last):
File "/home/cjj/workspace/incubator-impala/shell/impala_shell.py", line
38, in <module>
from impala_client import (ImpalaClient, DisconnectedException,
QueryStateException,
File "/home/cjj/workspace/incubator-impala/shell/impala_client.py", line
20, in <module>
import sasl
File "/home/cjj/workspace/incubator-impala/infra/python/
env/local/lib/python2.7/site-packages/sasl/__init__.py", line 15, in
<module>
from sasl.saslwrapper import *
ImportError: /home/cjj/workspace/incubator-impala/infra/python/env/local/
lib/python2.7/site-packages/sasl/saslw
--
Thanks & Best Regards
Re: impala setup issue
Posted by 俊杰陈 <cj...@gmail.com>.
Thanks, It is this issue. Now I'm trying the workaround.
2016-12-15 23:10 GMT+08:00 Jim Apple <jb...@cloudera.com>:
> Might be https://issues.cloudera.org/browse/IMPALA-3932
>
> On Thu, Dec 15, 2016 at 7:00 AM, 俊杰陈 <cj...@gmail.com> wrote:
> > The python error also happen in installing hive.
> >
> > --> Starting Hive Server and Metastore Service
> > INFO:bootstrap_virtualenv:Installing Kudu into the virtualenv
> > /home/cjj/workspace/incubator-impala/infra/python/env/local/
> lib/python2.7/site-packages/pkg_resources/__init__.py:1256:
> > UserWarning: /home/cjj/.python-eggs is writable by group/others and
> > vulnerable to attack when used with get_resource_filename. Consider a
> more
> > secure location (set with .set_extraction_path or the PYTHON_EGG_CACHE
> > environment variable).
> > warnings.warn(msg, UserWarning)
> > Traceback (most recent call last):
> > File
> > "/home/cjj/workspace/incubator-impala/testdata/bin/
> wait-for-metastore.py",
> > line 27, in <module>
> > from tests.util.thrift_util import create_transport
> > File "/home/cjj/workspace/incubator-impala/tests/util/thrift_util.py",
> > line 23, in <module>
> > import sasl
> > File "build/bdist.linux-x86_64/egg/sasl/__init__.py", line 1, in
> <module>
> >
> > File "build/bdist.linux-x86_64/egg/sasl/saslwrapper.py", line 7, in
> > <module>
> > File "build/bdist.linux-x86_64/egg/_saslwrapper.py", line 7, in
> <module>
> > File "build/bdist.linux-x86_64/egg/_saslwrapper.py", line 6, in
> > __bootstrap__
> > ImportError:
> > /home/cjj/.python-eggs/sasl-0.1.1-py2.7-linux-x86_64.egg-
> tmp/_saslwrapper.so:
> > undefined symbol:
> > _ZTVNSt7__cxx1118basic_stringstreamIcSt11char_traitsIcESaIcEEE
> > Error in
> > /home/cjj/workspace/incubator-impala/testdata/bin/run-hive-server.sh at
> line
> > 70: ${CLUSTER_BIN}/wait-for-metastore.py --transport=${METASTORE_
> TRANSPORT}
> > Error in /home/cjj/workspace/incubator-impala/testdata/bin/run-all.sh at
> > line 55: tee ${IMPALA_CLUSTER_LOGS_DIR}/run-hive-server.log
> >
> > PYTHONPATH seems a little bit weird.
> >
> > PYTHONPATH=/home/cjj/workspace/incubator-impala:/
> home/cjj/workspace/incubator-impala/shell/gen-py:/home/cjj/
> workspace/incubator-impala/testdata/:/home/cjj/workspace/
> incubator-impala/toolchain/thrift-0.9.0-p8/python/lib/
> python2.7/site-packages/:/home/cjj/workspace/incubator-
> impala/toolchain/cdh_components/hive-1.1.0-cdh5.10.
> 0-SNAPSHOT//lib/py:/home/cjj/workspace/incubator-impala/
> shell/ext-py/prettytable-0.7.1/dist/prettytable-0.7.1-py2.
> 7.egg:/home/cjj/workspace/incubator-impala/shell/ext-py/
> sasl-0.1.1/dist/sasl-0.1.1-py2.7-linux-x86_64.egg:/home/
> cjj/workspace/incubator-impala/shell/ext-py/sqlparse-
> 0.1.14/dist/sqlparse-0.1.14-py2.7.egg
> >
> > It looks like python-sasl is installed by native gcc (5.4 in ubuntu
> 16.04),
> > while it was used in gcc-4.9.2 toolchain, I have tried download
> sasl-0.2.1
> > in ubuntu 16.04, and it also have import error like this.
> >
> >
> > 2016-12-15 11:26 GMT+08:00 俊杰陈 <cj...@gmail.com>:
> >>
> >> Hi
> >>
> >>
> >>
> >> I’m trying to download impala and compile it but have some problems like
> >> following, can anyone help on this?
> >>
> >>
> >>
> >> ./buildall.sh complain no virtualenv**.tag.gz found, I tried download
> >> 15.1 version manually, while the impala-shell.sh can’t load sasl lib.
> ( I’m
> >> in Ubuntu 16.04, with GCC5.4 default, and I installed gcc4.9.2)
> >>
> >>
> >>
> >> Traceback (most recent call last):
> >>
> >> File "/home/cjj/workspace/incubator-impala/shell/impala_shell.py",
> line
> >> 38, in <module>
> >>
> >> from impala_client import (ImpalaClient, DisconnectedException,
> >> QueryStateException,
> >>
> >> File "/home/cjj/workspace/incubator-impala/shell/impala_client.py",
> line
> >> 20, in <module>
> >>
> >> import sasl
> >>
> >> File
> >> "/home/cjj/workspace/incubator-impala/infra/python/
> env/local/lib/python2.7/site-packages/sasl/__init__.py",
> >> line 15, in <module>
> >>
> >> from sasl.saslwrapper import *
> >>
> >> ImportError:
> >> /home/cjj/workspace/incubator-impala/infra/python/env/local/
> lib/python2.7/site-packages/sasl/saslw
> >>
> >>
> >> --
> >> Thanks & Best Regards
> >
> >
> >
> >
> > --
> > Thanks & Best Regards
>
--
Thanks & Best Regards
Re: impala setup issue
Posted by Jim Apple <jb...@cloudera.com>.
Might be https://issues.cloudera.org/browse/IMPALA-3932
On Thu, Dec 15, 2016 at 7:00 AM, 俊杰陈 <cj...@gmail.com> wrote:
> The python error also happen in installing hive.
>
> --> Starting Hive Server and Metastore Service
> INFO:bootstrap_virtualenv:Installing Kudu into the virtualenv
> /home/cjj/workspace/incubator-impala/infra/python/env/local/lib/python2.7/site-packages/pkg_resources/__init__.py:1256:
> UserWarning: /home/cjj/.python-eggs is writable by group/others and
> vulnerable to attack when used with get_resource_filename. Consider a more
> secure location (set with .set_extraction_path or the PYTHON_EGG_CACHE
> environment variable).
> warnings.warn(msg, UserWarning)
> Traceback (most recent call last):
> File
> "/home/cjj/workspace/incubator-impala/testdata/bin/wait-for-metastore.py",
> line 27, in <module>
> from tests.util.thrift_util import create_transport
> File "/home/cjj/workspace/incubator-impala/tests/util/thrift_util.py",
> line 23, in <module>
> import sasl
> File "build/bdist.linux-x86_64/egg/sasl/__init__.py", line 1, in <module>
>
> File "build/bdist.linux-x86_64/egg/sasl/saslwrapper.py", line 7, in
> <module>
> File "build/bdist.linux-x86_64/egg/_saslwrapper.py", line 7, in <module>
> File "build/bdist.linux-x86_64/egg/_saslwrapper.py", line 6, in
> __bootstrap__
> ImportError:
> /home/cjj/.python-eggs/sasl-0.1.1-py2.7-linux-x86_64.egg-tmp/_saslwrapper.so:
> undefined symbol:
> _ZTVNSt7__cxx1118basic_stringstreamIcSt11char_traitsIcESaIcEEE
> Error in
> /home/cjj/workspace/incubator-impala/testdata/bin/run-hive-server.sh at line
> 70: ${CLUSTER_BIN}/wait-for-metastore.py --transport=${METASTORE_TRANSPORT}
> Error in /home/cjj/workspace/incubator-impala/testdata/bin/run-all.sh at
> line 55: tee ${IMPALA_CLUSTER_LOGS_DIR}/run-hive-server.log
>
> PYTHONPATH seems a little bit weird.
>
> PYTHONPATH=/home/cjj/workspace/incubator-impala:/home/cjj/workspace/incubator-impala/shell/gen-py:/home/cjj/workspace/incubator-impala/testdata/:/home/cjj/workspace/incubator-impala/toolchain/thrift-0.9.0-p8/python/lib/python2.7/site-packages/:/home/cjj/workspace/incubator-impala/toolchain/cdh_components/hive-1.1.0-cdh5.10.0-SNAPSHOT//lib/py:/home/cjj/workspace/incubator-impala/shell/ext-py/prettytable-0.7.1/dist/prettytable-0.7.1-py2.7.egg:/home/cjj/workspace/incubator-impala/shell/ext-py/sasl-0.1.1/dist/sasl-0.1.1-py2.7-linux-x86_64.egg:/home/cjj/workspace/incubator-impala/shell/ext-py/sqlparse-0.1.14/dist/sqlparse-0.1.14-py2.7.egg
>
> It looks like python-sasl is installed by native gcc (5.4 in ubuntu 16.04),
> while it was used in gcc-4.9.2 toolchain, I have tried download sasl-0.2.1
> in ubuntu 16.04, and it also have import error like this.
>
>
> 2016-12-15 11:26 GMT+08:00 俊杰陈 <cj...@gmail.com>:
>>
>> Hi
>>
>>
>>
>> I’m trying to download impala and compile it but have some problems like
>> following, can anyone help on this?
>>
>>
>>
>> ./buildall.sh complain no virtualenv**.tag.gz found, I tried download
>> 15.1 version manually, while the impala-shell.sh can’t load sasl lib. ( I’m
>> in Ubuntu 16.04, with GCC5.4 default, and I installed gcc4.9.2)
>>
>>
>>
>> Traceback (most recent call last):
>>
>> File "/home/cjj/workspace/incubator-impala/shell/impala_shell.py", line
>> 38, in <module>
>>
>> from impala_client import (ImpalaClient, DisconnectedException,
>> QueryStateException,
>>
>> File "/home/cjj/workspace/incubator-impala/shell/impala_client.py", line
>> 20, in <module>
>>
>> import sasl
>>
>> File
>> "/home/cjj/workspace/incubator-impala/infra/python/env/local/lib/python2.7/site-packages/sasl/__init__.py",
>> line 15, in <module>
>>
>> from sasl.saslwrapper import *
>>
>> ImportError:
>> /home/cjj/workspace/incubator-impala/infra/python/env/local/lib/python2.7/site-packages/sasl/saslw
>>
>>
>> --
>> Thanks & Best Regards
>
>
>
>
> --
> Thanks & Best Regards
Re: impala setup issue
Posted by 俊杰陈 <cj...@gmail.com>.
The python error also happen in installing hive.
--> Starting Hive Server and Metastore Service
INFO:bootstrap_virtualenv:Installing Kudu into the virtualenv
/home/cjj/workspace/incubator-impala/infra/python/env/local/lib/python2.7/site-packages/pkg_resources/__init__.py:1256:
UserWarning: /home/cjj/.python-eggs is writable by group/others and
vulnerable to attack when used with get_resource_filename. Consider a more
secure location (set with .set_extraction_path or the PYTHON_EGG_CACHE
environment variable).
warnings.warn(msg, UserWarning)
Traceback (most recent call last):
File
"/home/cjj/workspace/incubator-impala/testdata/bin/wait-for-metastore.py",
line 27, in <module>
from tests.util.thrift_util import create_transport
File "/home/cjj/workspace/incubator-impala/tests/util/thrift_util.py",
line 23, in <module>
import sasl
File "build/bdist.linux-x86_64/egg/sasl/__init__.py", line 1, in <module>
File "build/bdist.linux-x86_64/egg/sasl/saslwrapper.py", line 7, in
<module>
File "build/bdist.linux-x86_64/egg/_saslwrapper.py", line 7, in <module>
File "build/bdist.linux-x86_64/egg/_saslwrapper.py", line 6, in
__bootstrap__
ImportError:
/home/cjj/.python-eggs/sasl-0.1.1-py2.7-linux-x86_64.egg-tmp/_saslwrapper.so:
undefined symbol:
_ZTVNSt7__cxx1118basic_stringstreamIcSt11char_traitsIcESaIcEEE
Error in
/home/cjj/workspace/incubator-impala/testdata/bin/run-hive-server.sh at
line 70: ${CLUSTER_BIN}/wait-for-metastore.py
--transport=${METASTORE_TRANSPORT}
Error in /home/cjj/workspace/incubator-impala/testdata/bin/run-all.sh at
line 55: tee ${IMPALA_CLUSTER_LOGS_DIR}/run-hive-server.log
PYTHONPATH seems a little bit weird.
PYTHONPATH=/home/cjj/workspace/incubator-impala:/home/cjj/workspace/incubator-impala/shell/gen-py:/home/cjj/workspace/incubator-impala/testdata/:/home/cjj/workspace/incubator-impala/toolchain/thrift-0.9.0-p8/python/lib/python2.7/site-packages/:/home/cjj/workspace/incubator-impala/toolchain/cdh_components/hive-1.1.0-cdh5.10.0-SNAPSHOT//lib/py:/home/cjj/workspace/incubator-impala/shell/ext-py/prettytable-0.7.1/dist/prettytable-0.7.1-py2.7.egg:/home/cjj/workspace/incubator-impala/shell/ext-py/sasl-0.1.1/dist/sasl-0.1.1-py2.7-linux-x86_64.egg:/home/cjj/workspace/incubator-impala/shell/ext-py/sqlparse-0.1.14/dist/sqlparse-0.1.14-py2.7.egg
It looks like python-sasl is installed by native gcc (5.4 in ubuntu 16.04),
while it was used in gcc-4.9.2 toolchain, I have tried download sasl-0.2.1
in ubuntu 16.04, and it also have import error like this.
2016-12-15 11:26 GMT+08:00 俊杰陈 <cj...@gmail.com>:
> Hi
>
>
>
> I’m trying to download impala and compile it but have some problems like
> following, can anyone help on this?
>
>
>
> ./buildall.sh complain no virtualenv**.tag.gz found, I tried download
> 15.1 version manually, while the impala-shell.sh can’t load sasl lib. (
> I’m in Ubuntu 16.04, with GCC5.4 default, and I installed gcc4.9.2)
>
>
>
> Traceback (most recent call last):
>
> File "/home/cjj/workspace/incubator-impala/shell/impala_shell.py", line
> 38, in <module>
>
> from impala_client import (ImpalaClient, DisconnectedException,
> QueryStateException,
>
> File "/home/cjj/workspace/incubator-impala/shell/impala_client.py",
> line 20, in <module>
>
> import sasl
>
> File "/home/cjj/workspace/incubator-impala/infra/python/env/
> local/lib/python2.7/site-packages/sasl/__init__.py", line 15, in <module>
>
> from sasl.saslwrapper import *
>
> ImportError: /home/cjj/workspace/incubator-impala/infra/python/env/local/
> lib/python2.7/site-packages/sasl/saslw
>
> --
> Thanks & Best Regards
>
--
Thanks & Best Regards
Re: impala setup issue
Posted by 俊杰陈 <cj...@gmail.com>.
Thanks for reply.
buildall.sh doesn't failed after I put virtualenv.tag.gz in deps dir.
It happens when I run bin/start-impala-cluster.py which invoke
bin/impala-shell.sh, also happens when I run bin/impala-shell.sh indecently.
Plus:
I use code from apache/incubating-impala,
2016-12-15 11:47 GMT+08:00 Tim Armstrong <ta...@cloudera.com>:
> So buildall.sh failed? First you need to fix that failure - it means the
> Python environment wasn't set up correctly.
>
> There's probably an earlier warning like "Warning: Unable to download
> Python requirements." - that's the error you need to fix if you want the
> python tooling to work correctly.
>
> On Wed, Dec 14, 2016 at 7:26 PM, 俊杰陈 <cj...@gmail.com> wrote:
>
>> Hi
>>
>>
>>
>> I’m trying to download impala and compile it but have some problems like
>> following, can anyone help on this?
>>
>>
>>
>> ./buildall.sh complain no virtualenv**.tag.gz found, I tried download
>> 15.1 version manually, while the impala-shell.sh can’t load sasl lib. (
>> I’m in Ubuntu 16.04, with GCC5.4 default, and I installed gcc4.9.2)
>>
>>
>>
>> Traceback (most recent call last):
>>
>> File "/home/cjj/workspace/incubator-impala/shell/impala_shell.py",
>> line 38, in <module>
>>
>> from impala_client import (ImpalaClient, DisconnectedException,
>> QueryStateException,
>>
>> File "/home/cjj/workspace/incubator-impala/shell/impala_client.py",
>> line 20, in <module>
>>
>> import sasl
>>
>> File "/home/cjj/workspace/incubator-impala/infra/python/env/local
>> /lib/python2.7/site-packages/sasl/__init__.py", line 15, in <module>
>>
>> from sasl.saslwrapper import *
>>
>> ImportError: /home/cjj/workspace/incubator-impala/infra/python/env/local/
>> lib/python2.7/site-packages/sasl/saslw
>>
>> --
>> Thanks & Best Regards
>>
>
>
--
Thanks & Best Regards
Re: impala setup issue
Posted by Tim Armstrong <ta...@cloudera.com>.
So buildall.sh failed? First you need to fix that failure - it means the
Python environment wasn't set up correctly.
There's probably an earlier warning like "Warning: Unable to download
Python requirements." - that's the error you need to fix if you want the
python tooling to work correctly.
On Wed, Dec 14, 2016 at 7:26 PM, 俊杰陈 <cj...@gmail.com> wrote:
> Hi
>
>
>
> I’m trying to download impala and compile it but have some problems like
> following, can anyone help on this?
>
>
>
> ./buildall.sh complain no virtualenv**.tag.gz found, I tried download
> 15.1 version manually, while the impala-shell.sh can’t load sasl lib. (
> I’m in Ubuntu 16.04, with GCC5.4 default, and I installed gcc4.9.2)
>
>
>
> Traceback (most recent call last):
>
> File "/home/cjj/workspace/incubator-impala/shell/impala_shell.py", line
> 38, in <module>
>
> from impala_client import (ImpalaClient, DisconnectedException,
> QueryStateException,
>
> File "/home/cjj/workspace/incubator-impala/shell/impala_client.py",
> line 20, in <module>
>
> import sasl
>
> File "/home/cjj/workspace/incubator-impala/infra/python/env/
> local/lib/python2.7/site-packages/sasl/__init__.py", line 15, in <module>
>
> from sasl.saslwrapper import *
>
> ImportError: /home/cjj/workspace/incubator-impala/infra/python/env/local/
> lib/python2.7/site-packages/sasl/saslw
>
> --
> Thanks & Best Regards
>