You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@accumulo.apache.org by "A.Khanolkar" <an...@gmail.com> on 2013/12/19 05:56:37 UTC
Accumulo-Pig for Accumulo version 1.5
Folks,
Do any of you have a stable version of Accumulo-Pig working with Accumulo 1.5?
- Anagha Khanolkar
Re: Accumulo-Pig for Accumulo version 1.5
Posted by Josh Elser <jo...@gmail.com>.
I'm hoping to start cutting 1.5.1 almost immediately after 1.6.0 is
released. We had targeted the end of this year for 1.6.0; we're all
trying our best to not let that slip.
On 12/19/13, 6:33 AM, Joe Gresock wrote:
> Just out of curiosity, when is 1.5.1 slated for release? I only ask
> because we're planning on upgrading to 1.5.0 next month, and I wonder if
> we should just wait.
>
>
> On Thu, Dec 19, 2013 at 12:31 AM, Josh Elser <josh.elser@gmail.com
> <ma...@gmail.com>> wrote:
>
> Anagha,
>
> There isn't currently a fully-working version against 1.5.0 due to
> an issue in Accumulo's InputFormat.
>
> There is, however, a working version against 1.5.1-SNAPSHOT if you
> don't have a problem building Accumulo. Take a look at the
> ACCUMULO-1783-1.5 branch in [1]. A walkthrough on some of the things
> you can do can be found at [2].
>
> FWIW, I'm also working to get this included in Pig-0.13 [3] which
> will completely remove the necessity for the accumulo-pig project.
>
> Things will hopefully sync up with "real" releases once we can get
> Accumulo 1.5.1 out the door.
>
> - Josh
>
> [1] https://git-wip-us.apache.org/__repos/asf?p=accumulo-pig.git
> <https://git-wip-us.apache.org/repos/asf?p=accumulo-pig.git>
> [2] http://people.apache.org/~__elserj/accumulo-pig/
> <http://people.apache.org/~elserj/accumulo-pig/>
> [3] https://issues.apache.org/__jira/browse/PIG-3573
> <https://issues.apache.org/jira/browse/PIG-3573>
>
>
> On 12/18/13, 11:56 PM, A.Khanolkar wrote:
>
> Folks,
> Do any of you have a stable version of Accumulo-Pig working with
> Accumulo 1.5?
>
> - Anagha Khanolkar
>
>
>
>
> --
> I know what it is to be in need, and I know what it is to have plenty.
> I have learned the secret of being content in any and every situation,
> whether well fed or hungry,^ whether living in plenty or in want.^^I can
> do all this through him who gives me strength. /*-*Philippians 4:12-13/
Re: Accumulo-Pig for Accumulo version 1.5
Posted by Joe Gresock <jg...@gmail.com>.
Just out of curiosity, when is 1.5.1 slated for release? I only ask
because we're planning on upgrading to 1.5.0 next month, and I wonder if we
should just wait.
On Thu, Dec 19, 2013 at 12:31 AM, Josh Elser <jo...@gmail.com> wrote:
> Anagha,
>
> There isn't currently a fully-working version against 1.5.0 due to an
> issue in Accumulo's InputFormat.
>
> There is, however, a working version against 1.5.1-SNAPSHOT if you don't
> have a problem building Accumulo. Take a look at the ACCUMULO-1783-1.5
> branch in [1]. A walkthrough on some of the things you can do can be found
> at [2].
>
> FWIW, I'm also working to get this included in Pig-0.13 [3] which will
> completely remove the necessity for the accumulo-pig project.
>
> Things will hopefully sync up with "real" releases once we can get
> Accumulo 1.5.1 out the door.
>
> - Josh
>
> [1] https://git-wip-us.apache.org/repos/asf?p=accumulo-pig.git
> [2] http://people.apache.org/~elserj/accumulo-pig/
> [3] https://issues.apache.org/jira/browse/PIG-3573
>
>
> On 12/18/13, 11:56 PM, A.Khanolkar wrote:
>
>> Folks,
>> Do any of you have a stable version of Accumulo-Pig working with Accumulo
>> 1.5?
>>
>> - Anagha Khanolkar
>>
>>
--
I know what it is to be in need, and I know what it is to have plenty. I
have learned the secret of being content in any and every situation,
whether well fed or hungry, whether living in plenty or in want. I can do
all this through him who gives me strength. *-Philippians 4:12-13*
Re: Accumulo-Pig for Accumulo version 1.5
Posted by Josh Elser <jo...@gmail.com>.
Yup, that's right, Bill. Try running multiple loads, Aaron. If Pig
optimizes them into one job, you'll get the same data twice as Accumulo
will overwrite its Accumulo configuration for the first load with that of
the second.
On Dec 19, 2013 8:37 AM, "William Slacum" <wi...@accumulo.net>
wrote:
> @Aaron I believe the issues Josh is talking about are related to
> https://issues.apache.org/jira/browse/ACCUMULO-1854
>
> Specifically I think there were issues with using multiple accumulo
> instances and multiple sets of authorizations because the input splits
> would be initialized with connection information from the configuration
> object when being consumed by a task attempt, versus having that
> information baked in at creation time on client. This caused issues with
> Pig when it would launch MapReduce jobs that used multiple input sources.
>
>
> On Thu, Dec 19, 2013 at 7:52 AM, Aaron <aa...@gmail.com> wrote:
>
>> We are currently using the accumulo-pig 1.5 branch (not the 1783-1.5
>> branch..that did not work) against Accumulo 1.5 and we don't "appear" to be
>> having any issues. I was curious what "issue" exists in order to check our
>> stuff.
>>
>> Cheers,
>> Aaron
>>
>>
>> On Thu, Dec 19, 2013 at 12:31 AM, Josh Elser <jo...@gmail.com>wrote:
>>
>>> Anagha,
>>>
>>> There isn't currently a fully-working version against 1.5.0 due to an
>>> issue in Accumulo's InputFormat.
>>>
>>> There is, however, a working version against 1.5.1-SNAPSHOT if you don't
>>> have a problem building Accumulo. Take a look at the ACCUMULO-1783-1.5
>>> branch in [1]. A walkthrough on some of the things you can do can be found
>>> at [2].
>>>
>>> FWIW, I'm also working to get this included in Pig-0.13 [3] which will
>>> completely remove the necessity for the accumulo-pig project.
>>>
>>> Things will hopefully sync up with "real" releases once we can get
>>> Accumulo 1.5.1 out the door.
>>>
>>> - Josh
>>>
>>> [1] https://git-wip-us.apache.org/repos/asf?p=accumulo-pig.git
>>> [2] http://people.apache.org/~elserj/accumulo-pig/
>>> [3] https://issues.apache.org/jira/browse/PIG-3573
>>>
>>>
>>> On 12/18/13, 11:56 PM, A.Khanolkar wrote:
>>>
>>>> Folks,
>>>> Do any of you have a stable version of Accumulo-Pig working with
>>>> Accumulo 1.5?
>>>>
>>>> - Anagha Khanolkar
>>>>
>>>>
>>
>
Re: Accumulo-Pig for Accumulo version 1.5
Posted by William Slacum <wi...@accumulo.net>.
@Aaron I believe the issues Josh is talking about are related to
https://issues.apache.org/jira/browse/ACCUMULO-1854
Specifically I think there were issues with using multiple accumulo
instances and multiple sets of authorizations because the input splits
would be initialized with connection information from the configuration
object when being consumed by a task attempt, versus having that
information baked in at creation time on client. This caused issues with
Pig when it would launch MapReduce jobs that used multiple input sources.
On Thu, Dec 19, 2013 at 7:52 AM, Aaron <aa...@gmail.com> wrote:
> We are currently using the accumulo-pig 1.5 branch (not the 1783-1.5
> branch..that did not work) against Accumulo 1.5 and we don't "appear" to be
> having any issues. I was curious what "issue" exists in order to check our
> stuff.
>
> Cheers,
> Aaron
>
>
> On Thu, Dec 19, 2013 at 12:31 AM, Josh Elser <jo...@gmail.com> wrote:
>
>> Anagha,
>>
>> There isn't currently a fully-working version against 1.5.0 due to an
>> issue in Accumulo's InputFormat.
>>
>> There is, however, a working version against 1.5.1-SNAPSHOT if you don't
>> have a problem building Accumulo. Take a look at the ACCUMULO-1783-1.5
>> branch in [1]. A walkthrough on some of the things you can do can be found
>> at [2].
>>
>> FWIW, I'm also working to get this included in Pig-0.13 [3] which will
>> completely remove the necessity for the accumulo-pig project.
>>
>> Things will hopefully sync up with "real" releases once we can get
>> Accumulo 1.5.1 out the door.
>>
>> - Josh
>>
>> [1] https://git-wip-us.apache.org/repos/asf?p=accumulo-pig.git
>> [2] http://people.apache.org/~elserj/accumulo-pig/
>> [3] https://issues.apache.org/jira/browse/PIG-3573
>>
>>
>> On 12/18/13, 11:56 PM, A.Khanolkar wrote:
>>
>>> Folks,
>>> Do any of you have a stable version of Accumulo-Pig working with
>>> Accumulo 1.5?
>>>
>>> - Anagha Khanolkar
>>>
>>>
>
Re: Accumulo-Pig for Accumulo version 1.5
Posted by Aaron <aa...@gmail.com>.
We are currently using the accumulo-pig 1.5 branch (not the 1783-1.5
branch..that did not work) against Accumulo 1.5 and we don't "appear" to be
having any issues. I was curious what "issue" exists in order to check our
stuff.
Cheers,
Aaron
On Thu, Dec 19, 2013 at 12:31 AM, Josh Elser <jo...@gmail.com> wrote:
> Anagha,
>
> There isn't currently a fully-working version against 1.5.0 due to an
> issue in Accumulo's InputFormat.
>
> There is, however, a working version against 1.5.1-SNAPSHOT if you don't
> have a problem building Accumulo. Take a look at the ACCUMULO-1783-1.5
> branch in [1]. A walkthrough on some of the things you can do can be found
> at [2].
>
> FWIW, I'm also working to get this included in Pig-0.13 [3] which will
> completely remove the necessity for the accumulo-pig project.
>
> Things will hopefully sync up with "real" releases once we can get
> Accumulo 1.5.1 out the door.
>
> - Josh
>
> [1] https://git-wip-us.apache.org/repos/asf?p=accumulo-pig.git
> [2] http://people.apache.org/~elserj/accumulo-pig/
> [3] https://issues.apache.org/jira/browse/PIG-3573
>
>
> On 12/18/13, 11:56 PM, A.Khanolkar wrote:
>
>> Folks,
>> Do any of you have a stable version of Accumulo-Pig working with Accumulo
>> 1.5?
>>
>> - Anagha Khanolkar
>>
>>
Re: Accumulo-Pig for Accumulo version 1.5
Posted by Josh Elser <jo...@gmail.com>.
Anagha,
There isn't currently a fully-working version against 1.5.0 due to an
issue in Accumulo's InputFormat.
There is, however, a working version against 1.5.1-SNAPSHOT if you don't
have a problem building Accumulo. Take a look at the ACCUMULO-1783-1.5
branch in [1]. A walkthrough on some of the things you can do can be
found at [2].
FWIW, I'm also working to get this included in Pig-0.13 [3] which will
completely remove the necessity for the accumulo-pig project.
Things will hopefully sync up with "real" releases once we can get
Accumulo 1.5.1 out the door.
- Josh
[1] https://git-wip-us.apache.org/repos/asf?p=accumulo-pig.git
[2] http://people.apache.org/~elserj/accumulo-pig/
[3] https://issues.apache.org/jira/browse/PIG-3573
On 12/18/13, 11:56 PM, A.Khanolkar wrote:
> Folks,
> Do any of you have a stable version of Accumulo-Pig working with Accumulo 1.5?
>
> - Anagha Khanolkar
>