You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by Amos Bird <am...@gmail.com> on 2017/07/04 20:26:47 UTC

encounter errors when doing a fresh build

Dear Impala community,

I just tried out the head commit

```
commit 9f678a74269250bf5c7ae2c5e8afd93c5b3734de (HEAD -> master, origin/master, origin/HEAD)
Author: Alex Behm <al...@cloudera.com>
Date:   Tue Jun 6 16:54:41 2017 -0700
```

in a centos 7 box.

I did `./buildall.sh -notests -noclean -build_shared_libs` then got stuck at this following error:

```
# Generated version information from save-version.sh
VERSION: 2.10.0-SNAPSHOT
GIT_HASH: 9f678a74269250bf5c7ae2c5e8afd93c5b3734de
BUILD_TIME: Tue Jul  4 20:20:29 CST 2017
Deleting all files in /home/amos/softwares/impala/shell/build/impala-shell-2.10.0-SNAPSHOT/{gen-py,lib,ext-py}
Building all external modules into eggs
Cleaning up old build artifacts.
Creating an egg for /home/amos/softwares/impala/shell/ext-py/prettytable-0.7.1
Traceback (most recent call last):
  File "setup.py", line 2, in <module>
    from setuptools import setup
  File "/usr/lib/python2.7/site-packages/setuptools/__init__.py", line 2, in <module>
    from setuptools.extension import Extension, Library
  File "/usr/lib/python2.7/site-packages/setuptools/extension.py", line 5, in <module>
    from setuptools.dist import _get_unpatched
  File "/usr/lib/python2.7/site-packages/setuptools/dist.py", line 7, in <module>
    from setuptools.command.install import install
  File "/usr/lib/python2.7/site-packages/setuptools/command/__init__.py", line 8, in <module>
    from setuptools.command import install_scripts
  File "/usr/lib/python2.7/site-packages/setuptools/command/install_scripts.py", line 3, in <module>
    from pkg_resources import Distribution, PathMetadata, ensure_directory
  File "/usr/lib/python2.7/site-packages/pkg_resources/__init__.py", line 72, in <module>
    import packaging.requirements
  File "/usr/lib/python2.7/site-packages/packaging/requirements.py", line 59, in <module>
    MARKER_EXPR = originalTextFor(MARKER_EXPR())("marker")
TypeError: __call__() takes exactly 2 arguments (1 given)
Error in shell/make_shell_tarball.sh at line 96: python setup.py -q bdist_egg clean
make[3]: *** [CMakeFiles/shell_tarball] Error 1
make[2]: *** [CMakeFiles/shell_tarball.dir/all] Error 2
make[1]: *** [CMakeFiles/tarballs.dir/rule] Error 2
make: *** [tarballs] Error 2
Error in /home/amos/softwares/impala/bin/make_impala.sh at line 179: ${MAKE_CMD} ${MAKE_ARGS} ${MAKE_TARGETS}
```

It seems the script is trying to use system's python. Is that normal?

regards,
Amos

Re: encounter errors when doing a fresh build

Posted by Tim Armstrong <ta...@cloudera.com>.
Yeah that step is actually meant to use the system python - it's mean to
build a standalone tarball for impala-shell that you can use with the
system python. Maybe we shouldn't have it as part of buildall.sh for the
development process... most people don't need it.

On Wed, Jul 5, 2017 at 1:58 AM, Amos Bird <am...@gmail.com> wrote:

>
> Ah, fixed it by updating setuptools and packaging.
>
> sudo pip install --upgrade setuptools
> sudo pip install --upgrade packaging
>
>
> Amos Bird <am...@gmail.com> writes:
>
> > Dear Impala community,
> >
> > I just tried out the head commit
> >
> > ```
> > commit 9f678a74269250bf5c7ae2c5e8afd93c5b3734de (HEAD -> master,
> origin/master, origin/HEAD)
> > Author: Alex Behm <al...@cloudera.com>
> > Date:   Tue Jun 6 16:54:41 2017 -0700
> > ```
> >
> > in a centos 7 box.
> >
> > I did `./buildall.sh -notests -noclean -build_shared_libs` then got
> stuck at this following error:
> >
> > ```
> > # Generated version information from save-version.sh
> > VERSION: 2.10.0-SNAPSHOT
> > GIT_HASH: 9f678a74269250bf5c7ae2c5e8afd93c5b3734de
> > BUILD_TIME: Tue Jul  4 20:20:29 CST 2017
> > Deleting all files in /home/amos/softwares/impala/
> shell/build/impala-shell-2.10.0-SNAPSHOT/{gen-py,lib,ext-py}
> > Building all external modules into eggs
> > Cleaning up old build artifacts.
> > Creating an egg for /home/amos/softwares/impala/
> shell/ext-py/prettytable-0.7.1
> > Traceback (most recent call last):
> >   File "setup.py", line 2, in <module>
> >     from setuptools import setup
> >   File "/usr/lib/python2.7/site-packages/setuptools/__init__.py", line
> 2, in <module>
> >     from setuptools.extension import Extension, Library
> >   File "/usr/lib/python2.7/site-packages/setuptools/extension.py", line
> 5, in <module>
> >     from setuptools.dist import _get_unpatched
> >   File "/usr/lib/python2.7/site-packages/setuptools/dist.py", line 7,
> in <module>
> >     from setuptools.command.install import install
> >   File "/usr/lib/python2.7/site-packages/setuptools/command/__init__.py",
> line 8, in <module>
> >     from setuptools.command import install_scripts
> >   File "/usr/lib/python2.7/site-packages/setuptools/command/install_scripts.py",
> line 3, in <module>
> >     from pkg_resources import Distribution, PathMetadata,
> ensure_directory
> >   File "/usr/lib/python2.7/site-packages/pkg_resources/__init__.py",
> line 72, in <module>
> >     import packaging.requirements
> >   File "/usr/lib/python2.7/site-packages/packaging/requirements.py",
> line 59, in <module>
> >     MARKER_EXPR = originalTextFor(MARKER_EXPR())("marker")
> > TypeError: __call__() takes exactly 2 arguments (1 given)
> > Error in shell/make_shell_tarball.sh at line 96: python setup.py -q
> bdist_egg clean
> > make[3]: *** [CMakeFiles/shell_tarball] Error 1
> > make[2]: *** [CMakeFiles/shell_tarball.dir/all] Error 2
> > make[1]: *** [CMakeFiles/tarballs.dir/rule] Error 2
> > make: *** [tarballs] Error 2
> > Error in /home/amos/softwares/impala/bin/make_impala.sh at line 179:
> ${MAKE_CMD} ${MAKE_ARGS} ${MAKE_TARGETS}
> > ```
> >
> > It seems the script is trying to use system's python. Is that normal?
> >
> > regards,
> > Amos
>
>

Re: encounter errors when doing a fresh build

Posted by Amos Bird <am...@gmail.com>.
Ah, fixed it by updating setuptools and packaging.

sudo pip install --upgrade setuptools
sudo pip install --upgrade packaging


Amos Bird <am...@gmail.com> writes:

> Dear Impala community,
>
> I just tried out the head commit
>
> ```
> commit 9f678a74269250bf5c7ae2c5e8afd93c5b3734de (HEAD -> master, origin/master, origin/HEAD)
> Author: Alex Behm <al...@cloudera.com>
> Date:   Tue Jun 6 16:54:41 2017 -0700
> ```
>
> in a centos 7 box.
>
> I did `./buildall.sh -notests -noclean -build_shared_libs` then got stuck at this following error:
>
> ```
> # Generated version information from save-version.sh
> VERSION: 2.10.0-SNAPSHOT
> GIT_HASH: 9f678a74269250bf5c7ae2c5e8afd93c5b3734de
> BUILD_TIME: Tue Jul  4 20:20:29 CST 2017
> Deleting all files in /home/amos/softwares/impala/shell/build/impala-shell-2.10.0-SNAPSHOT/{gen-py,lib,ext-py}
> Building all external modules into eggs
> Cleaning up old build artifacts.
> Creating an egg for /home/amos/softwares/impala/shell/ext-py/prettytable-0.7.1
> Traceback (most recent call last):
>   File "setup.py", line 2, in <module>
>     from setuptools import setup
>   File "/usr/lib/python2.7/site-packages/setuptools/__init__.py", line 2, in <module>
>     from setuptools.extension import Extension, Library
>   File "/usr/lib/python2.7/site-packages/setuptools/extension.py", line 5, in <module>
>     from setuptools.dist import _get_unpatched
>   File "/usr/lib/python2.7/site-packages/setuptools/dist.py", line 7, in <module>
>     from setuptools.command.install import install
>   File "/usr/lib/python2.7/site-packages/setuptools/command/__init__.py", line 8, in <module>
>     from setuptools.command import install_scripts
>   File "/usr/lib/python2.7/site-packages/setuptools/command/install_scripts.py", line 3, in <module>
>     from pkg_resources import Distribution, PathMetadata, ensure_directory
>   File "/usr/lib/python2.7/site-packages/pkg_resources/__init__.py", line 72, in <module>
>     import packaging.requirements
>   File "/usr/lib/python2.7/site-packages/packaging/requirements.py", line 59, in <module>
>     MARKER_EXPR = originalTextFor(MARKER_EXPR())("marker")
> TypeError: __call__() takes exactly 2 arguments (1 given)
> Error in shell/make_shell_tarball.sh at line 96: python setup.py -q bdist_egg clean
> make[3]: *** [CMakeFiles/shell_tarball] Error 1
> make[2]: *** [CMakeFiles/shell_tarball.dir/all] Error 2
> make[1]: *** [CMakeFiles/tarballs.dir/rule] Error 2
> make: *** [tarballs] Error 2
> Error in /home/amos/softwares/impala/bin/make_impala.sh at line 179: ${MAKE_CMD} ${MAKE_ARGS} ${MAKE_TARGETS}
> ```
>
> It seems the script is trying to use system's python. Is that normal?
>
> regards,
> Amos