You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Vinoth Chandar <vi...@uber.com> on 2016/12/05 22:40:51 UTC
HiveIO
Hi guys,
Saw a post around HiveIO on the users list with a PR followup. I am
interested in this too and can pitch in on developement and testing..
Who & where is this work happening?
Thanks
VInoth
Re: HiveIO
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Tim,
I pushed the HBaseIO on github, I will do the same later today for
HiveIO. I will let you know.
Thanks !
Regards
JB
On 12/15/2016 02:39 AM, Tim Taschke wrote:
> Great to see that there is progress on this!
>
> Like written on the user mailing list, I would also be interested in
> contributing to this.
>
> On Thu, Dec 15, 2016 at 4:44 AM, Isma�l Mej�a <ie...@gmail.com> wrote:
>> For ref, I just created a JIRA so people can track the progress/contribute
>> to the progress of HiveIO.
>>
>> https://issues.apache.org/jira/browse/BEAM-1158
>>
>> On Wed, Dec 7, 2016 at 5:39 PM, Jean-Baptiste Onofr� <jb...@nanthrax.net>
>> wrote:
>>
>>> Yes that's the first idea ;)
>>>
>>> Regards
>>> JB\u2063
>>>
>>> On Dec 7, 2016, 17:27, at 17:27, Vinoth Chandar <vi...@uber.com> wrote:
>>>> Interesting. So all the planning & execution is done by Hive, and Beam
>>>> will
>>>> process the results of the query?
>>>>
>>>> On Wed, Dec 7, 2016 at 8:24 AM, Jean-Baptiste Onofr� <jb...@nanthrax.net>
>>>> wrote:
>>>>
>>>>> Hi\u2063
>>>>>
>>>>> The HiveIO will directly use the native API and HiveQL. That's the
>>>> plan on
>>>>> which we are working right now.
>>>>>
>>>>> Regards
>>>>> JB
>>>>>
>>>>> On Dec 7, 2016, 17:18, at 17:18, Vinoth Chandar <vi...@uber.com>
>>>> wrote:
>>>>>> Hi,
>>>>>>
>>>>>> I am not looking for a way to actually execute the query on Hive. I
>>>>>> would
>>>>>> like to do something similar to Spark SQL/HiveContext, but with
>>>> Beam.
>>>>>> Just
>>>>>> have a HiveIO that reads metadata from Hive metastore, and then
>>>> later
>>>>>> use a
>>>>>> Spark runner to execute the query. So, HiveJDBC is not an option I
>>>>>> would
>>>>>> like to pursue. Thanks for the pointer, though!
>>>>>>
>>>>>> And does the HiveIO that is being planned, work similarly as above?
>>>>>>
>>>>>>
>>>>>> Thanks
>>>>>> Vinoth
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, Dec 6, 2016 at 4:55 AM, Isma�l Mej�a <ie...@gmail.com>
>>>> wrote:
>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> If you really need to read/write via Hive, remember that you can
>>>> use
>>>>>> the
>>>>>>> Hive Jdbc driver, and achieve this with Beam using the JdbcIO
>>>> (this
>>>>>> is
>>>>>>> probably less efficient for the streaming case but still a valid
>>>>>> solution).
>>>>>>>
>>>>>>> Isma�l
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vi...@uber.com>
>>>>>> wrote:
>>>>>>>
>>>>>>>> Great. Thanks!
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Vinoth
>>>>>>>>
>>>>>>>>> On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofr�
>>>>>> <jb...@nanthrax.net>
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> Isma�l and I started HiveIO.
>>>>>>>>>
>>>>>>>>> I have several IOs ready to propose as PR, but, in order to
>>>> limit
>>>>>> the
>>>>>>>> number of open PRs, I would like to merge the pending ones.
>>>>>>>>>
>>>>>>>>> I will let you know when the branches/PRs will be available.
>>>>>>>>>
>>>>>>>>> Regards
>>>>>>>>> JB
>>>>>>>>>
>>>>>>>>>> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
>>>>>>>>>> Hi guys,
>>>>>>>>>>
>>>>>>>>>> Saw a post around HiveIO on the users list with a PR
>>>> followup. I
>>>>>> am
>>>>>>>>>> interested in this too and can pitch in on developement and
>>>>>> testing..
>>>>>>>>>>
>>>>>>>>>> Who & where is this work happening?
>>>>>>>>>>
>>>>>>>>>> Thanks
>>>>>>>>>> VInoth
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Jean-Baptiste Onofr�
>>>>>>>>> jbonofre@apache.org
>>>>>>>>> http://blog.nanthrax.net
>>>>>>>>> Talend - http://www.talend.com
>>>>>>>>
>>>>>>>
>>>>>
>>>
--
Jean-Baptiste Onofr�
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Re: HiveIO
Posted by Tim Taschke <ta...@fout.jp>.
Great to see that there is progress on this!
Like written on the user mailing list, I would also be interested in
contributing to this.
On Thu, Dec 15, 2016 at 4:44 AM, Ismaël Mejía <ie...@gmail.com> wrote:
> For ref, I just created a JIRA so people can track the progress/contribute
> to the progress of HiveIO.
>
> https://issues.apache.org/jira/browse/BEAM-1158
>
> On Wed, Dec 7, 2016 at 5:39 PM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
>
>> Yes that's the first idea ;)
>>
>> Regards
>> JB
>>
>> On Dec 7, 2016, 17:27, at 17:27, Vinoth Chandar <vi...@uber.com> wrote:
>> >Interesting. So all the planning & execution is done by Hive, and Beam
>> >will
>> >process the results of the query?
>> >
>> >On Wed, Dec 7, 2016 at 8:24 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
>> >wrote:
>> >
>> >> Hi
>> >>
>> >> The HiveIO will directly use the native API and HiveQL. That's the
>> >plan on
>> >> which we are working right now.
>> >>
>> >> Regards
>> >> JB
>> >>
>> >> On Dec 7, 2016, 17:18, at 17:18, Vinoth Chandar <vi...@uber.com>
>> >wrote:
>> >> >Hi,
>> >> >
>> >> >I am not looking for a way to actually execute the query on Hive. I
>> >> >would
>> >> >like to do something similar to Spark SQL/HiveContext, but with
>> >Beam.
>> >> >Just
>> >> >have a HiveIO that reads metadata from Hive metastore, and then
>> >later
>> >> >use a
>> >> >Spark runner to execute the query. So, HiveJDBC is not an option I
>> >> >would
>> >> >like to pursue. Thanks for the pointer, though!
>> >> >
>> >> >And does the HiveIO that is being planned, work similarly as above?
>> >> >
>> >> >
>> >> >Thanks
>> >> >Vinoth
>> >> >
>> >> >
>> >> >
>> >> >On Tue, Dec 6, 2016 at 4:55 AM, Ismaël Mejía <ie...@gmail.com>
>> >wrote:
>> >> >
>> >> >> Hello,
>> >> >>
>> >> >> If you really need to read/write via Hive, remember that you can
>> >use
>> >> >the
>> >> >> Hive Jdbc driver, and achieve this with Beam using the JdbcIO
>> >(this
>> >> >is
>> >> >> probably less efficient for the streaming case but still a valid
>> >> >solution).
>> >> >>
>> >> >> Ismaël
>> >> >>
>> >> >>
>> >> >> On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vi...@uber.com>
>> >> >wrote:
>> >> >>
>> >> >> > Great. Thanks!
>> >> >> >
>> >> >> > Thanks,
>> >> >> > Vinoth
>> >> >> >
>> >> >> > > On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofré
>> >> ><jb...@nanthrax.net>
>> >> >> > wrote:
>> >> >> > >
>> >> >> > > Hi,
>> >> >> > >
>> >> >> > > Ismaël and I started HiveIO.
>> >> >> > >
>> >> >> > > I have several IOs ready to propose as PR, but, in order to
>> >limit
>> >> >the
>> >> >> > number of open PRs, I would like to merge the pending ones.
>> >> >> > >
>> >> >> > > I will let you know when the branches/PRs will be available.
>> >> >> > >
>> >> >> > > Regards
>> >> >> > > JB
>> >> >> > >
>> >> >> > >> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
>> >> >> > >> Hi guys,
>> >> >> > >>
>> >> >> > >> Saw a post around HiveIO on the users list with a PR
>> >followup. I
>> >> >am
>> >> >> > >> interested in this too and can pitch in on developement and
>> >> >testing..
>> >> >> > >>
>> >> >> > >> Who & where is this work happening?
>> >> >> > >>
>> >> >> > >> Thanks
>> >> >> > >> VInoth
>> >> >> > >>
>> >> >> > >
>> >> >> > > --
>> >> >> > > Jean-Baptiste Onofré
>> >> >> > > jbonofre@apache.org
>> >> >> > > http://blog.nanthrax.net
>> >> >> > > Talend - http://www.talend.com
>> >> >> >
>> >> >>
>> >>
>>
Re: HiveIO
Posted by Ismaël Mejía <ie...@gmail.com>.
For ref, I just created a JIRA so people can track the progress/contribute
to the progress of HiveIO.
https://issues.apache.org/jira/browse/BEAM-1158
On Wed, Dec 7, 2016 at 5:39 PM, Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Yes that's the first idea ;)
>
> Regards
> JB
>
> On Dec 7, 2016, 17:27, at 17:27, Vinoth Chandar <vi...@uber.com> wrote:
> >Interesting. So all the planning & execution is done by Hive, and Beam
> >will
> >process the results of the query?
> >
> >On Wed, Dec 7, 2016 at 8:24 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> >wrote:
> >
> >> Hi
> >>
> >> The HiveIO will directly use the native API and HiveQL. That's the
> >plan on
> >> which we are working right now.
> >>
> >> Regards
> >> JB
> >>
> >> On Dec 7, 2016, 17:18, at 17:18, Vinoth Chandar <vi...@uber.com>
> >wrote:
> >> >Hi,
> >> >
> >> >I am not looking for a way to actually execute the query on Hive. I
> >> >would
> >> >like to do something similar to Spark SQL/HiveContext, but with
> >Beam.
> >> >Just
> >> >have a HiveIO that reads metadata from Hive metastore, and then
> >later
> >> >use a
> >> >Spark runner to execute the query. So, HiveJDBC is not an option I
> >> >would
> >> >like to pursue. Thanks for the pointer, though!
> >> >
> >> >And does the HiveIO that is being planned, work similarly as above?
> >> >
> >> >
> >> >Thanks
> >> >Vinoth
> >> >
> >> >
> >> >
> >> >On Tue, Dec 6, 2016 at 4:55 AM, Ismaël Mejía <ie...@gmail.com>
> >wrote:
> >> >
> >> >> Hello,
> >> >>
> >> >> If you really need to read/write via Hive, remember that you can
> >use
> >> >the
> >> >> Hive Jdbc driver, and achieve this with Beam using the JdbcIO
> >(this
> >> >is
> >> >> probably less efficient for the streaming case but still a valid
> >> >solution).
> >> >>
> >> >> Ismaël
> >> >>
> >> >>
> >> >> On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vi...@uber.com>
> >> >wrote:
> >> >>
> >> >> > Great. Thanks!
> >> >> >
> >> >> > Thanks,
> >> >> > Vinoth
> >> >> >
> >> >> > > On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofré
> >> ><jb...@nanthrax.net>
> >> >> > wrote:
> >> >> > >
> >> >> > > Hi,
> >> >> > >
> >> >> > > Ismaël and I started HiveIO.
> >> >> > >
> >> >> > > I have several IOs ready to propose as PR, but, in order to
> >limit
> >> >the
> >> >> > number of open PRs, I would like to merge the pending ones.
> >> >> > >
> >> >> > > I will let you know when the branches/PRs will be available.
> >> >> > >
> >> >> > > Regards
> >> >> > > JB
> >> >> > >
> >> >> > >> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
> >> >> > >> Hi guys,
> >> >> > >>
> >> >> > >> Saw a post around HiveIO on the users list with a PR
> >followup. I
> >> >am
> >> >> > >> interested in this too and can pitch in on developement and
> >> >testing..
> >> >> > >>
> >> >> > >> Who & where is this work happening?
> >> >> > >>
> >> >> > >> Thanks
> >> >> > >> VInoth
> >> >> > >>
> >> >> > >
> >> >> > > --
> >> >> > > Jean-Baptiste Onofré
> >> >> > > jbonofre@apache.org
> >> >> > > http://blog.nanthrax.net
> >> >> > > Talend - http://www.talend.com
> >> >> >
> >> >>
> >>
>
Re: HiveIO
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Yes that's the first idea ;)
Regards
JB\u2063\u200b
On Dec 7, 2016, 17:27, at 17:27, Vinoth Chandar <vi...@uber.com> wrote:
>Interesting. So all the planning & execution is done by Hive, and Beam
>will
>process the results of the query?
>
>On Wed, Dec 7, 2016 at 8:24 AM, Jean-Baptiste Onofr� <jb...@nanthrax.net>
>wrote:
>
>> Hi\u2063
>>
>> The HiveIO will directly use the native API and HiveQL. That's the
>plan on
>> which we are working right now.
>>
>> Regards
>> JB
>>
>> On Dec 7, 2016, 17:18, at 17:18, Vinoth Chandar <vi...@uber.com>
>wrote:
>> >Hi,
>> >
>> >I am not looking for a way to actually execute the query on Hive. I
>> >would
>> >like to do something similar to Spark SQL/HiveContext, but with
>Beam.
>> >Just
>> >have a HiveIO that reads metadata from Hive metastore, and then
>later
>> >use a
>> >Spark runner to execute the query. So, HiveJDBC is not an option I
>> >would
>> >like to pursue. Thanks for the pointer, though!
>> >
>> >And does the HiveIO that is being planned, work similarly as above?
>> >
>> >
>> >Thanks
>> >Vinoth
>> >
>> >
>> >
>> >On Tue, Dec 6, 2016 at 4:55 AM, Isma�l Mej�a <ie...@gmail.com>
>wrote:
>> >
>> >> Hello,
>> >>
>> >> If you really need to read/write via Hive, remember that you can
>use
>> >the
>> >> Hive Jdbc driver, and achieve this with Beam using the JdbcIO
>(this
>> >is
>> >> probably less efficient for the streaming case but still a valid
>> >solution).
>> >>
>> >> Isma�l
>> >>
>> >>
>> >> On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vi...@uber.com>
>> >wrote:
>> >>
>> >> > Great. Thanks!
>> >> >
>> >> > Thanks,
>> >> > Vinoth
>> >> >
>> >> > > On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofr�
>> ><jb...@nanthrax.net>
>> >> > wrote:
>> >> > >
>> >> > > Hi,
>> >> > >
>> >> > > Isma�l and I started HiveIO.
>> >> > >
>> >> > > I have several IOs ready to propose as PR, but, in order to
>limit
>> >the
>> >> > number of open PRs, I would like to merge the pending ones.
>> >> > >
>> >> > > I will let you know when the branches/PRs will be available.
>> >> > >
>> >> > > Regards
>> >> > > JB
>> >> > >
>> >> > >> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
>> >> > >> Hi guys,
>> >> > >>
>> >> > >> Saw a post around HiveIO on the users list with a PR
>followup. I
>> >am
>> >> > >> interested in this too and can pitch in on developement and
>> >testing..
>> >> > >>
>> >> > >> Who & where is this work happening?
>> >> > >>
>> >> > >> Thanks
>> >> > >> VInoth
>> >> > >>
>> >> > >
>> >> > > --
>> >> > > Jean-Baptiste Onofr�
>> >> > > jbonofre@apache.org
>> >> > > http://blog.nanthrax.net
>> >> > > Talend - http://www.talend.com
>> >> >
>> >>
>>
Re: HiveIO
Posted by Vinoth Chandar <vi...@uber.com>.
Interesting. So all the planning & execution is done by Hive, and Beam will
process the results of the query?
On Wed, Dec 7, 2016 at 8:24 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Hi
>
> The HiveIO will directly use the native API and HiveQL. That's the plan on
> which we are working right now.
>
> Regards
> JB
>
> On Dec 7, 2016, 17:18, at 17:18, Vinoth Chandar <vi...@uber.com> wrote:
> >Hi,
> >
> >I am not looking for a way to actually execute the query on Hive. I
> >would
> >like to do something similar to Spark SQL/HiveContext, but with Beam.
> >Just
> >have a HiveIO that reads metadata from Hive metastore, and then later
> >use a
> >Spark runner to execute the query. So, HiveJDBC is not an option I
> >would
> >like to pursue. Thanks for the pointer, though!
> >
> >And does the HiveIO that is being planned, work similarly as above?
> >
> >
> >Thanks
> >Vinoth
> >
> >
> >
> >On Tue, Dec 6, 2016 at 4:55 AM, Ismaël Mejía <ie...@gmail.com> wrote:
> >
> >> Hello,
> >>
> >> If you really need to read/write via Hive, remember that you can use
> >the
> >> Hive Jdbc driver, and achieve this with Beam using the JdbcIO (this
> >is
> >> probably less efficient for the streaming case but still a valid
> >solution).
> >>
> >> Ismaël
> >>
> >>
> >> On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vi...@uber.com>
> >wrote:
> >>
> >> > Great. Thanks!
> >> >
> >> > Thanks,
> >> > Vinoth
> >> >
> >> > > On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofré
> ><jb...@nanthrax.net>
> >> > wrote:
> >> > >
> >> > > Hi,
> >> > >
> >> > > Ismaël and I started HiveIO.
> >> > >
> >> > > I have several IOs ready to propose as PR, but, in order to limit
> >the
> >> > number of open PRs, I would like to merge the pending ones.
> >> > >
> >> > > I will let you know when the branches/PRs will be available.
> >> > >
> >> > > Regards
> >> > > JB
> >> > >
> >> > >> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
> >> > >> Hi guys,
> >> > >>
> >> > >> Saw a post around HiveIO on the users list with a PR followup. I
> >am
> >> > >> interested in this too and can pitch in on developement and
> >testing..
> >> > >>
> >> > >> Who & where is this work happening?
> >> > >>
> >> > >> Thanks
> >> > >> VInoth
> >> > >>
> >> > >
> >> > > --
> >> > > Jean-Baptiste Onofré
> >> > > jbonofre@apache.org
> >> > > http://blog.nanthrax.net
> >> > > Talend - http://www.talend.com
> >> >
> >>
>
Re: HiveIO
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi\u2063
The HiveIO will directly use the native API and HiveQL. That's the plan on which we are working right now.
Regards
JB
On Dec 7, 2016, 17:18, at 17:18, Vinoth Chandar <vi...@uber.com> wrote:
>Hi,
>
>I am not looking for a way to actually execute the query on Hive. I
>would
>like to do something similar to Spark SQL/HiveContext, but with Beam.
>Just
>have a HiveIO that reads metadata from Hive metastore, and then later
>use a
>Spark runner to execute the query. So, HiveJDBC is not an option I
>would
>like to pursue. Thanks for the pointer, though!
>
>And does the HiveIO that is being planned, work similarly as above?
>
>
>Thanks
>Vinoth
>
>
>
>On Tue, Dec 6, 2016 at 4:55 AM, Isma�l Mej�a <ie...@gmail.com> wrote:
>
>> Hello,
>>
>> If you really need to read/write via Hive, remember that you can use
>the
>> Hive Jdbc driver, and achieve this with Beam using the JdbcIO (this
>is
>> probably less efficient for the streaming case but still a valid
>solution).
>>
>> Isma�l
>>
>>
>> On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vi...@uber.com>
>wrote:
>>
>> > Great. Thanks!
>> >
>> > Thanks,
>> > Vinoth
>> >
>> > > On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofr�
><jb...@nanthrax.net>
>> > wrote:
>> > >
>> > > Hi,
>> > >
>> > > Isma�l and I started HiveIO.
>> > >
>> > > I have several IOs ready to propose as PR, but, in order to limit
>the
>> > number of open PRs, I would like to merge the pending ones.
>> > >
>> > > I will let you know when the branches/PRs will be available.
>> > >
>> > > Regards
>> > > JB
>> > >
>> > >> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
>> > >> Hi guys,
>> > >>
>> > >> Saw a post around HiveIO on the users list with a PR followup. I
>am
>> > >> interested in this too and can pitch in on developement and
>testing..
>> > >>
>> > >> Who & where is this work happening?
>> > >>
>> > >> Thanks
>> > >> VInoth
>> > >>
>> > >
>> > > --
>> > > Jean-Baptiste Onofr�
>> > > jbonofre@apache.org
>> > > http://blog.nanthrax.net
>> > > Talend - http://www.talend.com
>> >
>>
Re: HiveIO
Posted by Vinoth Chandar <vi...@uber.com>.
Hi,
I am not looking for a way to actually execute the query on Hive. I would
like to do something similar to Spark SQL/HiveContext, but with Beam. Just
have a HiveIO that reads metadata from Hive metastore, and then later use a
Spark runner to execute the query. So, HiveJDBC is not an option I would
like to pursue. Thanks for the pointer, though!
And does the HiveIO that is being planned, work similarly as above?
Thanks
Vinoth
On Tue, Dec 6, 2016 at 4:55 AM, Ismaël Mejía <ie...@gmail.com> wrote:
> Hello,
>
> If you really need to read/write via Hive, remember that you can use the
> Hive Jdbc driver, and achieve this with Beam using the JdbcIO (this is
> probably less efficient for the streaming case but still a valid solution).
>
> Ismaël
>
>
> On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vi...@uber.com> wrote:
>
> > Great. Thanks!
> >
> > Thanks,
> > Vinoth
> >
> > > On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> > wrote:
> > >
> > > Hi,
> > >
> > > Ismaël and I started HiveIO.
> > >
> > > I have several IOs ready to propose as PR, but, in order to limit the
> > number of open PRs, I would like to merge the pending ones.
> > >
> > > I will let you know when the branches/PRs will be available.
> > >
> > > Regards
> > > JB
> > >
> > >> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
> > >> Hi guys,
> > >>
> > >> Saw a post around HiveIO on the users list with a PR followup. I am
> > >> interested in this too and can pitch in on developement and testing..
> > >>
> > >> Who & where is this work happening?
> > >>
> > >> Thanks
> > >> VInoth
> > >>
> > >
> > > --
> > > Jean-Baptiste Onofré
> > > jbonofre@apache.org
> > > http://blog.nanthrax.net
> > > Talend - http://www.talend.com
> >
>
Re: HiveIO
Posted by Ismaël Mejía <ie...@gmail.com>.
Hello,
If you really need to read/write via Hive, remember that you can use the
Hive Jdbc driver, and achieve this with Beam using the JdbcIO (this is
probably less efficient for the streaming case but still a valid solution).
Ismaël
On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vi...@uber.com> wrote:
> Great. Thanks!
>
> Thanks,
> Vinoth
>
> > On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> >
> > Hi,
> >
> > Ismaël and I started HiveIO.
> >
> > I have several IOs ready to propose as PR, but, in order to limit the
> number of open PRs, I would like to merge the pending ones.
> >
> > I will let you know when the branches/PRs will be available.
> >
> > Regards
> > JB
> >
> >> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
> >> Hi guys,
> >>
> >> Saw a post around HiveIO on the users list with a PR followup. I am
> >> interested in this too and can pitch in on developement and testing..
> >>
> >> Who & where is this work happening?
> >>
> >> Thanks
> >> VInoth
> >>
> >
> > --
> > Jean-Baptiste Onofré
> > jbonofre@apache.org
> > http://blog.nanthrax.net
> > Talend - http://www.talend.com
>
Re: HiveIO
Posted by Vinoth Chandar <vi...@uber.com>.
Great. Thanks!
Thanks,
Vinoth
> On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
>
> Hi,
>
> Ismaël and I started HiveIO.
>
> I have several IOs ready to propose as PR, but, in order to limit the number of open PRs, I would like to merge the pending ones.
>
> I will let you know when the branches/PRs will be available.
>
> Regards
> JB
>
>> On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
>> Hi guys,
>>
>> Saw a post around HiveIO on the users list with a PR followup. I am
>> interested in this too and can pitch in on developement and testing..
>>
>> Who & where is this work happening?
>>
>> Thanks
>> VInoth
>>
>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
Re: HiveIO
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi,
Isma�l and I started HiveIO.
I have several IOs ready to propose as PR, but, in order to limit the
number of open PRs, I would like to merge the pending ones.
I will let you know when the branches/PRs will be available.
Regards
JB
On 12/05/2016 11:40 PM, Vinoth Chandar wrote:
> Hi guys,
>
> Saw a post around HiveIO on the users list with a PR followup. I am
> interested in this too and can pitch in on developement and testing..
>
> Who & where is this work happening?
>
> Thanks
> VInoth
>
--
Jean-Baptiste Onofr�
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com