You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Mark Olliver <ma...@infectiousmedia.com> on 2013/10/18 14:33:52 UTC
python modules using pig 12.0
Hi,
What do i need to do to use the numpy python module?.
I have built pig 12 and have a udf that 'imports numpy' but i get the error
No module named numpy. I have not tried to use python modules before and am
unsure how to use them from within the newly supported pig 12 python
environment.
(I am using AWS EMR but with a pig 12 not the standard aws pig 11.1)
Regards
Mark
--
*MARK OLLIVER*
DevOPS EngIneer
T. +44(0) 20 7775 5628
3-7 Herbal Hill / London / EC1R 5EJ
www.infectiousmedia.com
Re: python modules using pig 12.0
Posted by nezih yigitbasi <ne...@gmail.com>.
Maybe this blog post may help:
http://blog.mortardata.com/post/62334142398/hadoop-python-pig-trunk
Does your pig script also raise an error in local mode?
Nezih
18 Ekim 2013 Cuma tarihinde Mark Olliver adlı kullanıcı şöyle yazdı:
> When i used a python console i could import numpy installed so i presume it
> was installed on the box and it was just a problem that pig did not know
> where to look for it ?
>
> Mark
>
>
> On 18 October 2013 15:39, j.barrett Strausser <
> j.barrett.strausser@gmail.com <javascript:;>
> > wrote:
>
> > Does the AWS EMR distro come with numpy either installed as a site
> package
> > or in a virtual environment?
> >
> > Otherwise I'd think you'd need to do : apt-get install python-numpy or
> pip
> > install numpy.
> >
> >
> > On Fri, Oct 18, 2013 at 8:33 AM, Mark Olliver <
> > mark.olliver@infectiousmedia.com <javascript:;>> wrote:
> >
> > > Hi,
> > >
> > > What do i need to do to use the numpy python module?.
> > >
> > > I have built pig 12 and have a udf that 'imports numpy' but i get the
> > error
> > > No module named numpy. I have not tried to use python modules before
> and
> > am
> > > unsure how to use them from within the newly supported pig 12 python
> > > environment.
> > >
> > > (I am using AWS EMR but with a pig 12 not the standard aws pig 11.1)
> > >
> > > Regards
> > >
> > > Mark
> > >
> > > --
> > >
> > > *MARK OLLIVER*
> > >
> > > DevOPS EngIneer
> > >
> > > T. +44(0) 20 7775 5628
> > >
> > > 3-7 Herbal Hill / London / EC1R 5EJ
> > >
> > > www.infectiousmedia.com
> > >
> >
> >
> >
> > --
> >
> >
> > https://github.com/bearrito
> > @deepbearrito
> >
>
>
>
> --
>
> *MARK OLLIVER*
>
> DevOPS EngIneer
>
> T. +44(0) 20 7775 5628
>
> 3-7 Herbal Hill / London / EC1R 5EJ
>
> www.infectiousmedia.com
>
--
Nezih Yigitbasi
https://sites.google.com/site/nezihyigitbasi
Re: python modules using pig 12.0
Posted by Mark Olliver <ma...@infectiousmedia.com>.
When i used a python console i could import numpy installed so i presume it
was installed on the box and it was just a problem that pig did not know
where to look for it ?
Mark
On 18 October 2013 15:39, j.barrett Strausser <j.barrett.strausser@gmail.com
> wrote:
> Does the AWS EMR distro come with numpy either installed as a site package
> or in a virtual environment?
>
> Otherwise I'd think you'd need to do : apt-get install python-numpy or pip
> install numpy.
>
>
> On Fri, Oct 18, 2013 at 8:33 AM, Mark Olliver <
> mark.olliver@infectiousmedia.com> wrote:
>
> > Hi,
> >
> > What do i need to do to use the numpy python module?.
> >
> > I have built pig 12 and have a udf that 'imports numpy' but i get the
> error
> > No module named numpy. I have not tried to use python modules before and
> am
> > unsure how to use them from within the newly supported pig 12 python
> > environment.
> >
> > (I am using AWS EMR but with a pig 12 not the standard aws pig 11.1)
> >
> > Regards
> >
> > Mark
> >
> > --
> >
> > *MARK OLLIVER*
> >
> > DevOPS EngIneer
> >
> > T. +44(0) 20 7775 5628
> >
> > 3-7 Herbal Hill / London / EC1R 5EJ
> >
> > www.infectiousmedia.com
> >
>
>
>
> --
>
>
> https://github.com/bearrito
> @deepbearrito
>
--
*MARK OLLIVER*
DevOPS EngIneer
T. +44(0) 20 7775 5628
3-7 Herbal Hill / London / EC1R 5EJ
www.infectiousmedia.com
Re: python modules using pig 12.0
Posted by "j.barrett Strausser" <j....@gmail.com>.
Does the AWS EMR distro come with numpy either installed as a site package
or in a virtual environment?
Otherwise I'd think you'd need to do : apt-get install python-numpy or pip
install numpy.
On Fri, Oct 18, 2013 at 8:33 AM, Mark Olliver <
mark.olliver@infectiousmedia.com> wrote:
> Hi,
>
> What do i need to do to use the numpy python module?.
>
> I have built pig 12 and have a udf that 'imports numpy' but i get the error
> No module named numpy. I have not tried to use python modules before and am
> unsure how to use them from within the newly supported pig 12 python
> environment.
>
> (I am using AWS EMR but with a pig 12 not the standard aws pig 11.1)
>
> Regards
>
> Mark
>
> --
>
> *MARK OLLIVER*
>
> DevOPS EngIneer
>
> T. +44(0) 20 7775 5628
>
> 3-7 Herbal Hill / London / EC1R 5EJ
>
> www.infectiousmedia.com
>
--
https://github.com/bearrito
@deepbearrito