You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tajo.apache.org by Hyunsik Choi <hy...@apache.org> on 2013/05/08 13:35:19 UTC
[DISUCSS] Switching protocol buffers to another one
Dear Henry and folks,
In TAJO-28 (https://issues.apache.org/jira/browse/TAJO-28), there was a
discussion of switching protocol buffers to another one. Henry's suggestion
is to switch protocol buffer to avro. At that time, I said that I'll create
jira issues for it. I'm sorry for late response.
At the first time, I also +1ed for the switching. However, Tajo has heavily
used protocol buffers throughout the project. It will cause many overheads
for us. If you are ok, I would like to postpone this discussion. I think
that there are many important issues to be solved right now.
Best regards,
Hyunsik
Re: [DISUCSS] Switching protocol buffers to another one
Posted by Hyunsik Choi <hy...@apache.org>.
Henry,
Thank you for your understanding. Later, we could have an opportunity to
discuss this issue.
Thanks!
On Thu, May 9, 2013 at 12:42 AM, Henry Saputra <he...@gmail.com>wrote:
> Hi Hyunsik, thanks for revisiting this Avro switch discussion. I agree to
> punt this discussion into the future.
> Even now Hadoop uses protocol buffer for its RPC.
>
> I am ok to not open JIRA for it. I think once we have one or two good
> release then we could revisit this discussion again.
>
> Really appreciate for opening up discussion about this.
>
>
> - Henry
>
>
> On Wed, May 8, 2013 at 4:35 AM, Hyunsik Choi <hy...@apache.org> wrote:
>
> > Dear Henry and folks,
> >
> > In TAJO-28 (https://issues.apache.org/jira/browse/TAJO-28), there was a
> > discussion of switching protocol buffers to another one. Henry's
> suggestion
> > is to switch protocol buffer to avro. At that time, I said that I'll
> create
> > jira issues for it. I'm sorry for late response.
> >
> > At the first time, I also +1ed for the switching. However, Tajo has
> heavily
> > used protocol buffers throughout the project. It will cause many
> overheads
> > for us. If you are ok, I would like to postpone this discussion. I think
> > that there are many important issues to be solved right now.
> >
> > Best regards,
> > Hyunsik
> >
>
Re: [DISUCSS] Switching protocol buffers to another one
Posted by Hyunsik Choi <hy...@apache.org>.
Owen,
Tajo also uses protobuf for rpc and default serialization means. Thank you
for letting me know the worth experience. That lesson is very helpful to us
too.
Best regards,
Hyunsik
On Thu, May 9, 2013 at 12:57 AM, Owen O'Malley <om...@apache.org> wrote:
> Hadoop tried Avro for its RPC, but there were too many challenges. We
> backed out to ProtoBuf, which has worked well for us. In ORC, I used
> ProtoBuf for the metadata (and not the data) and it has also worked well
> for that.
>
> -- Owen
>
>
> On Wed, May 8, 2013 at 8:42 AM, Henry Saputra <henry.saputra@gmail.com
> >wrote:
>
> > Hi Hyunsik, thanks for revisiting this Avro switch discussion. I agree to
> > punt this discussion into the future.
> > Even now Hadoop uses protocol buffer for its RPC.
> >
> > I am ok to not open JIRA for it. I think once we have one or two good
> > release then we could revisit this discussion again.
> >
> > Really appreciate for opening up discussion about this.
> >
> >
> > - Henry
> >
> >
> > On Wed, May 8, 2013 at 4:35 AM, Hyunsik Choi <hy...@apache.org> wrote:
> >
> > > Dear Henry and folks,
> > >
> > > In TAJO-28 (https://issues.apache.org/jira/browse/TAJO-28), there was
> a
> > > discussion of switching protocol buffers to another one. Henry's
> > suggestion
> > > is to switch protocol buffer to avro. At that time, I said that I'll
> > create
> > > jira issues for it. I'm sorry for late response.
> > >
> > > At the first time, I also +1ed for the switching. However, Tajo has
> > heavily
> > > used protocol buffers throughout the project. It will cause many
> > overheads
> > > for us. If you are ok, I would like to postpone this discussion. I
> think
> > > that there are many important issues to be solved right now.
> > >
> > > Best regards,
> > > Hyunsik
> > >
> >
>
Re: [DISUCSS] Switching protocol buffers to another one
Posted by Owen O'Malley <om...@apache.org>.
Hadoop tried Avro for its RPC, but there were too many challenges. We
backed out to ProtoBuf, which has worked well for us. In ORC, I used
ProtoBuf for the metadata (and not the data) and it has also worked well
for that.
-- Owen
On Wed, May 8, 2013 at 8:42 AM, Henry Saputra <he...@gmail.com>wrote:
> Hi Hyunsik, thanks for revisiting this Avro switch discussion. I agree to
> punt this discussion into the future.
> Even now Hadoop uses protocol buffer for its RPC.
>
> I am ok to not open JIRA for it. I think once we have one or two good
> release then we could revisit this discussion again.
>
> Really appreciate for opening up discussion about this.
>
>
> - Henry
>
>
> On Wed, May 8, 2013 at 4:35 AM, Hyunsik Choi <hy...@apache.org> wrote:
>
> > Dear Henry and folks,
> >
> > In TAJO-28 (https://issues.apache.org/jira/browse/TAJO-28), there was a
> > discussion of switching protocol buffers to another one. Henry's
> suggestion
> > is to switch protocol buffer to avro. At that time, I said that I'll
> create
> > jira issues for it. I'm sorry for late response.
> >
> > At the first time, I also +1ed for the switching. However, Tajo has
> heavily
> > used protocol buffers throughout the project. It will cause many
> overheads
> > for us. If you are ok, I would like to postpone this discussion. I think
> > that there are many important issues to be solved right now.
> >
> > Best regards,
> > Hyunsik
> >
>
Re: [DISUCSS] Switching protocol buffers to another one
Posted by Henry Saputra <he...@gmail.com>.
Hi Hyunsik, thanks for revisiting this Avro switch discussion. I agree to
punt this discussion into the future.
Even now Hadoop uses protocol buffer for its RPC.
I am ok to not open JIRA for it. I think once we have one or two good
release then we could revisit this discussion again.
Really appreciate for opening up discussion about this.
- Henry
On Wed, May 8, 2013 at 4:35 AM, Hyunsik Choi <hy...@apache.org> wrote:
> Dear Henry and folks,
>
> In TAJO-28 (https://issues.apache.org/jira/browse/TAJO-28), there was a
> discussion of switching protocol buffers to another one. Henry's suggestion
> is to switch protocol buffer to avro. At that time, I said that I'll create
> jira issues for it. I'm sorry for late response.
>
> At the first time, I also +1ed for the switching. However, Tajo has heavily
> used protocol buffers throughout the project. It will cause many overheads
> for us. If you are ok, I would like to postpone this discussion. I think
> that there are many important issues to be solved right now.
>
> Best regards,
> Hyunsik
>