You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by sn5 <sn...@gmail.com> on 2017/10/20 20:45:00 UTC
Re: Load HFiles in Apache Phoenix
It would be very helpful to see a complete, working example (preferably with
some comments) of this hfile load technique. Apparently it's a known idiom,
but I've spent most of the afternoon searching Google and cannot find a
single reference other than this thread. In particular I do not understand
what is meant by "
..loading the empty column".
--
Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/
Re: Load HFiles in Apache Phoenix
Posted by "snhirsch@gmail.com" <sn...@gmail.com>.
On 2017-10-20 17:23, James Taylor <ja...@apache.org> wrote:
> If you put together a nice example, we can post a link to it from the FAQ.
> Sorry, but with open source, the answer is often "go look at the source
> code". :-)
Hi, James.
I've been through the tests and cannot find anything close to the body of code I inherited. My hat is off to whomever figured this out! To be sure I have the fundamentals, would it be correct to say that this is simply a shorthand to use the Phoenix query engine to act as a standalone encoding mechanism?
The code I'm looking at does not explicitly set autoCommit to off. Isn't that somewhat essential? Is autoCommit = off the default for Spark JDBC connections?
Re: Load HFiles in Apache Phoenix
Posted by James Taylor <ja...@apache.org>.
If you put together a nice example, we can post a link to it from the FAQ.
Sorry, but with open source, the answer is often "go look at the source
code". :-)
On Fri, Oct 20, 2017 at 2:13 PM, snhirsch@gmail.com <sn...@gmail.com>
wrote:
>
>
> On 2017-10-20 17:07, James Taylor <ja...@apache.org> wrote:
> > Load Phoenix into Eclipse and search for references to
> > PhoenixRuntime.getUncommittedDataIterator(). There's even a unit test
> does
> > this.
> >
>
> Ok, I appreciate the response. But I've already encountered the source
> code during my searches and it really isn't very enlightening in terms of
> how one simply uses it. I'll take your advice and go after the unit test
> next.
>
Re: Load HFiles in Apache Phoenix
Posted by "snhirsch@gmail.com" <sn...@gmail.com>.
On 2017-10-20 17:07, James Taylor <ja...@apache.org> wrote:
> Load Phoenix into Eclipse and search for references to
> PhoenixRuntime.getUncommittedDataIterator(). There's even a unit test does
> this.
>
Ok, I appreciate the response. But I've already encountered the source code during my searches and it really isn't very enlightening in terms of how one simply uses it. I'll take your advice and go after the unit test next.
Re: Load HFiles in Apache Phoenix
Posted by James Taylor <ja...@apache.org>.
Load Phoenix into Eclipse and search for references to
PhoenixRuntime.getUncommittedDataIterator(). There's even a unit test does
this.
On Fri, Oct 20, 2017 at 2:04 PM, snhirsch@gmail.com <sn...@gmail.com>
wrote:
>
>
> On 2017-10-20 16:49, James Taylor <ja...@apache.org> wrote:
> > Here's a little more info:
> > https://phoenix.apache.org/faq.html#Why_empty_key_value
> >
> > Lot's of hits here too:
> > http://search-hadoop.com/?project=Phoenix&q=empty+key+value
> >
> > On Fri, Oct 20, 2017 at 1:45 PM, sn5 <sn...@gmail.com> wrote:
> >
> > > It would be very helpful to see a complete, working example (preferably
> > > with
> > > some comments) of this hfile load technique. Apparently it's a known
> > > idiom,
> > > but I've spent most of the afternoon searching Google and cannot find a
> > > single reference other than this thread. In particular I do not
> understand
> > > what is meant by "
> > > ..loading the empty column".
> > >
> > >
> > >
> > >
> > >
> > > --
> > > Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/
> > >
> >
>
> Thanks, but that answers only a part of my question. I would like to see
> a reference to the entire idiom of using the uncommitted data from a
> transaction that will be subsequently rolled back. I can sort of infer
> what's going on from that original post, but cannot find any further
> references or examples.
>
>
Re: Load HFiles in Apache Phoenix
Posted by "snhirsch@gmail.com" <sn...@gmail.com>.
On 2017-10-20 16:49, James Taylor <ja...@apache.org> wrote:
> Here's a little more info:
> https://phoenix.apache.org/faq.html#Why_empty_key_value
>
> Lot's of hits here too:
> http://search-hadoop.com/?project=Phoenix&q=empty+key+value
>
> On Fri, Oct 20, 2017 at 1:45 PM, sn5 <sn...@gmail.com> wrote:
>
> > It would be very helpful to see a complete, working example (preferably
> > with
> > some comments) of this hfile load technique. Apparently it's a known
> > idiom,
> > but I've spent most of the afternoon searching Google and cannot find a
> > single reference other than this thread. In particular I do not understand
> > what is meant by "
> > ..loading the empty column".
> >
> >
> >
> >
> >
> > --
> > Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/
> >
>
Thanks, but that answers only a part of my question. I would like to see a reference to the entire idiom of using the uncommitted data from a transaction that will be subsequently rolled back. I can sort of infer what's going on from that original post, but cannot find any further references or examples.
Re: Load HFiles in Apache Phoenix
Posted by James Taylor <ja...@apache.org>.
Here's a little more info:
https://phoenix.apache.org/faq.html#Why_empty_key_value
Lot's of hits here too:
http://search-hadoop.com/?project=Phoenix&q=empty+key+value
On Fri, Oct 20, 2017 at 1:45 PM, sn5 <sn...@gmail.com> wrote:
> It would be very helpful to see a complete, working example (preferably
> with
> some comments) of this hfile load technique. Apparently it's a known
> idiom,
> but I've spent most of the afternoon searching Google and cannot find a
> single reference other than this thread. In particular I do not understand
> what is meant by "
> ..loading the empty column".
>
>
>
>
>
> --
> Sent from: http://apache-phoenix-user-list.1124778.n5.nabble.com/
>