You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Mohit Anchlia <mo...@gmail.com> on 2012/05/17 01:51:49 UTC
Registering *.jar
I have something like this in pig script. But pig doesn't recognize *.jar
regular expression. It seems to be looking for a file name "*.jar" Is there
a way to register using regular expression?
SET mapred.map.tasks.speculative.execution false;
%default ES_JAR_DIR '/root/elasticsearch/lib'
%default INDEX 'testIdx'
%default OBJ 'testType'
register /home/hadoop/pigtest/*.jar;
Re: Registering *.jar
Posted by Prashant Kommireddi <pr...@gmail.com>.
I think 0.10 already supports globbing.
Sent from my iPhone
On May 16, 2012, at 5:05 PM, Ashutosh Chauhan <ha...@apache.org> wrote:
> This I think is a useful feature to have. Another possibility is to let
> user specify dir name and then add all the jars in that directory.
>
> register /home/hadoop/pigtest/
>
> Ashutosh
>
> On Wed, May 16, 2012 at 4:58 PM, Prashant Kommireddi <pr...@gmail.com>wrote:
>
>> What version are you using?
>>
>> Sent from my iPhone
>>
>> On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>>
>>> I have something like this in pig script. But pig doesn't recognize *.jar
>>> regular expression. It seems to be looking for a file name "*.jar" Is
>> there
>>> a way to register using regular expression?
>>>
>>> SET mapred.map.tasks.speculative.execution false;
>>>
>>> %default ES_JAR_DIR '/root/elasticsearch/lib'
>>>
>>> %default INDEX 'testIdx'
>>>
>>> %default OBJ 'testType'
>>>
>>> register /home/hadoop/pigtest/*.jar;
>>
Re: Registering *.jar
Posted by Ashutosh Chauhan <ha...@apache.org>.
This I think is a useful feature to have. Another possibility is to let
user specify dir name and then add all the jars in that directory.
register /home/hadoop/pigtest/
Ashutosh
On Wed, May 16, 2012 at 4:58 PM, Prashant Kommireddi <pr...@gmail.com>wrote:
> What version are you using?
>
> Sent from my iPhone
>
> On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>
> > I have something like this in pig script. But pig doesn't recognize *.jar
> > regular expression. It seems to be looking for a file name "*.jar" Is
> there
> > a way to register using regular expression?
> >
> > SET mapred.map.tasks.speculative.execution false;
> >
> > %default ES_JAR_DIR '/root/elasticsearch/lib'
> >
> > %default INDEX 'testIdx'
> >
> > %default OBJ 'testType'
> >
> > register /home/hadoop/pigtest/*.jar;
>
Re: Registering *.jar
Posted by Prashant Kommireddi <pr...@gmail.com>.
Daniel's blog post talks about it. Try it out.
Sent from my iPhone
On May 16, 2012, at 5:34 PM, Alan Gates <ga...@hortonworks.com> wrote:
> See http://hortonworks.com/blog/new-features-in-apache-pig-0-10/
>
> Alan.
>
> On May 16, 2012, at 5:30 PM, Russell Jurney wrote:
>
>> Does 0.10+ do jar globbing? I need this too!
>>
>> Russell Jurney
>> twitter.com/rjurney
>> russell.jurney@gmail.com
>> datasyndrome.com
>>
>> On May 16, 2012, at 5:16 PM, Prashant Kommireddi <pr...@gmail.com> wrote:
>>
>>> That's a quite old version. You might want to upgrade to 0.10 which
>>> has a bunch of new features, improvements and bug fixes.
>>>
>>> Sent from my iPhone
>>>
>>> On May 16, 2012, at 5:05 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>>>
>>>> .8.1
>>>>
>>>> On Wed, May 16, 2012 at 4:58 PM, Prashant Kommireddi <pr...@gmail.com>wrote:
>>>>
>>>>> What version are you using?
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>> On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>>>>>
>>>>>> I have something like this in pig script. But pig doesn't recognize *.jar
>>>>>> regular expression. It seems to be looking for a file name "*.jar" Is
>>>>> there
>>>>>> a way to register using regular expression?
>>>>>>
>>>>>> SET mapred.map.tasks.speculative.execution false;
>>>>>>
>>>>>> %default ES_JAR_DIR '/root/elasticsearch/lib'
>>>>>>
>>>>>> %default INDEX 'testIdx'
>>>>>>
>>>>>> %default OBJ 'testType'
>>>>>>
>>>>>> register /home/hadoop/pigtest/*.jar;
>>>>>
>
Re: Registering *.jar
Posted by Alan Gates <ga...@hortonworks.com>.
See http://hortonworks.com/blog/new-features-in-apache-pig-0-10/
Alan.
On May 16, 2012, at 5:30 PM, Russell Jurney wrote:
> Does 0.10+ do jar globbing? I need this too!
>
> Russell Jurney
> twitter.com/rjurney
> russell.jurney@gmail.com
> datasyndrome.com
>
> On May 16, 2012, at 5:16 PM, Prashant Kommireddi <pr...@gmail.com> wrote:
>
>> That's a quite old version. You might want to upgrade to 0.10 which
>> has a bunch of new features, improvements and bug fixes.
>>
>> Sent from my iPhone
>>
>> On May 16, 2012, at 5:05 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>>
>>> .8.1
>>>
>>> On Wed, May 16, 2012 at 4:58 PM, Prashant Kommireddi <pr...@gmail.com>wrote:
>>>
>>>> What version are you using?
>>>>
>>>> Sent from my iPhone
>>>>
>>>> On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>>>>
>>>>> I have something like this in pig script. But pig doesn't recognize *.jar
>>>>> regular expression. It seems to be looking for a file name "*.jar" Is
>>>> there
>>>>> a way to register using regular expression?
>>>>>
>>>>> SET mapred.map.tasks.speculative.execution false;
>>>>>
>>>>> %default ES_JAR_DIR '/root/elasticsearch/lib'
>>>>>
>>>>> %default INDEX 'testIdx'
>>>>>
>>>>> %default OBJ 'testType'
>>>>>
>>>>> register /home/hadoop/pigtest/*.jar;
>>>>
Re: Registering *.jar
Posted by Russell Jurney <ru...@gmail.com>.
Does 0.10+ do jar globbing? I need this too!
Russell Jurney
twitter.com/rjurney
russell.jurney@gmail.com
datasyndrome.com
On May 16, 2012, at 5:16 PM, Prashant Kommireddi <pr...@gmail.com> wrote:
> That's a quite old version. You might want to upgrade to 0.10 which
> has a bunch of new features, improvements and bug fixes.
>
> Sent from my iPhone
>
> On May 16, 2012, at 5:05 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>
>> .8.1
>>
>> On Wed, May 16, 2012 at 4:58 PM, Prashant Kommireddi <pr...@gmail.com>wrote:
>>
>>> What version are you using?
>>>
>>> Sent from my iPhone
>>>
>>> On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>>>
>>>> I have something like this in pig script. But pig doesn't recognize *.jar
>>>> regular expression. It seems to be looking for a file name "*.jar" Is
>>> there
>>>> a way to register using regular expression?
>>>>
>>>> SET mapred.map.tasks.speculative.execution false;
>>>>
>>>> %default ES_JAR_DIR '/root/elasticsearch/lib'
>>>>
>>>> %default INDEX 'testIdx'
>>>>
>>>> %default OBJ 'testType'
>>>>
>>>> register /home/hadoop/pigtest/*.jar;
>>>
Re: Registering *.jar
Posted by Prashant Kommireddi <pr...@gmail.com>.
That's a quite old version. You might want to upgrade to 0.10 which
has a bunch of new features, improvements and bug fixes.
Sent from my iPhone
On May 16, 2012, at 5:05 PM, Mohit Anchlia <mo...@gmail.com> wrote:
> .8.1
>
> On Wed, May 16, 2012 at 4:58 PM, Prashant Kommireddi <pr...@gmail.com>wrote:
>
>> What version are you using?
>>
>> Sent from my iPhone
>>
>> On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>>
>>> I have something like this in pig script. But pig doesn't recognize *.jar
>>> regular expression. It seems to be looking for a file name "*.jar" Is
>> there
>>> a way to register using regular expression?
>>>
>>> SET mapred.map.tasks.speculative.execution false;
>>>
>>> %default ES_JAR_DIR '/root/elasticsearch/lib'
>>>
>>> %default INDEX 'testIdx'
>>>
>>> %default OBJ 'testType'
>>>
>>> register /home/hadoop/pigtest/*.jar;
>>
Re: Registering *.jar
Posted by Raghu Angadi <ra...@apache.org>.
if you still want to use 8.1, you can apply 0.8 patch from
https://issues.apache.org/jira/browse/PIG-2142
On Wed, May 16, 2012 at 5:04 PM, Mohit Anchlia <mo...@gmail.com>wrote:
> .8.1
>
> On Wed, May 16, 2012 at 4:58 PM, Prashant Kommireddi <prash1784@gmail.com
> >wrote:
>
> > What version are you using?
> >
> > Sent from my iPhone
> >
> > On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com>
> wrote:
> >
> > > I have something like this in pig script. But pig doesn't recognize
> *.jar
> > > regular expression. It seems to be looking for a file name "*.jar" Is
> > there
> > > a way to register using regular expression?
> > >
> > > SET mapred.map.tasks.speculative.execution false;
> > >
> > > %default ES_JAR_DIR '/root/elasticsearch/lib'
> > >
> > > %default INDEX 'testIdx'
> > >
> > > %default OBJ 'testType'
> > >
> > > register /home/hadoop/pigtest/*.jar;
> >
>
Re: Registering *.jar
Posted by Mohit Anchlia <mo...@gmail.com>.
.8.1
On Wed, May 16, 2012 at 4:58 PM, Prashant Kommireddi <pr...@gmail.com>wrote:
> What version are you using?
>
> Sent from my iPhone
>
> On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com> wrote:
>
> > I have something like this in pig script. But pig doesn't recognize *.jar
> > regular expression. It seems to be looking for a file name "*.jar" Is
> there
> > a way to register using regular expression?
> >
> > SET mapred.map.tasks.speculative.execution false;
> >
> > %default ES_JAR_DIR '/root/elasticsearch/lib'
> >
> > %default INDEX 'testIdx'
> >
> > %default OBJ 'testType'
> >
> > register /home/hadoop/pigtest/*.jar;
>
Re: Registering *.jar
Posted by Prashant Kommireddi <pr...@gmail.com>.
What version are you using?
Sent from my iPhone
On May 16, 2012, at 4:52 PM, Mohit Anchlia <mo...@gmail.com> wrote:
> I have something like this in pig script. But pig doesn't recognize *.jar
> regular expression. It seems to be looking for a file name "*.jar" Is there
> a way to register using regular expression?
>
> SET mapred.map.tasks.speculative.execution false;
>
> %default ES_JAR_DIR '/root/elasticsearch/lib'
>
> %default INDEX 'testIdx'
>
> %default OBJ 'testType'
>
> register /home/hadoop/pigtest/*.jar;