You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@datafu.apache.org by Josh Wills <jw...@cloudera.com> on 2014/01/15 01:09:50 UTC
Hive/Crunch UDFs?
Is it cool to start working on equivalent Hive/Crunch UDFs for the existing
Pig impls? That's a goal of the project, yes? Is there some project/build
infrastructure that needs to be setup first?
J
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: Hive/Crunch UDFs?
Posted by Matthew Hayes <ma...@gmail.com>.
I was thinking about the build infrastructure lately too. I don't
personally care for Maven though. What about Gradle?
On Wed, Jan 15, 2014 at 8:12 AM, Josh Wills <jw...@cloudera.com> wrote:
> The build infrastructure question leads to another (potentially touchy)
> issue-- do we want to Mavenize the project?
>
>
> On Tue, Jan 14, 2014 at 5:28 PM, Matthew Hayes <
> matthew.terence.hayes@gmail.com> wrote:
>
> > Yea it makes sense to me to start implementing equivalents of the Pig
> > UDFs. I'd say it's a goal of the project. There is no project/build
> > infrastructure set up for it yet though. The artifacts that can
> currently
> > be built from the project are "datafu" for the pig UDFs and
> > "datafu-hourglass" for the incremental MR jobs (under the contrib
> folder).
> > Should we also have artifacts "datafu-crunch" and "datafu-hive"?
> >
> >
> > On Tue, Jan 14, 2014 at 4:09 PM, Josh Wills <jw...@cloudera.com> wrote:
> >
> > > Is it cool to start working on equivalent Hive/Crunch UDFs for the
> > existing
> > > Pig impls? That's a goal of the project, yes? Is there some
> project/build
> > > infrastructure that needs to be setup first?
> > >
> > > J
> > >
> > > --
> > > Director of Data Science
> > > Cloudera <http://www.cloudera.com>
> > > Twitter: @josh_wills <http://twitter.com/josh_wills>
> > >
> >
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>
Re: Hive/Crunch UDFs?
Posted by Josh Wills <jw...@cloudera.com>.
The build infrastructure question leads to another (potentially touchy)
issue-- do we want to Mavenize the project?
On Tue, Jan 14, 2014 at 5:28 PM, Matthew Hayes <
matthew.terence.hayes@gmail.com> wrote:
> Yea it makes sense to me to start implementing equivalents of the Pig
> UDFs. I'd say it's a goal of the project. There is no project/build
> infrastructure set up for it yet though. The artifacts that can currently
> be built from the project are "datafu" for the pig UDFs and
> "datafu-hourglass" for the incremental MR jobs (under the contrib folder).
> Should we also have artifacts "datafu-crunch" and "datafu-hive"?
>
>
> On Tue, Jan 14, 2014 at 4:09 PM, Josh Wills <jw...@cloudera.com> wrote:
>
> > Is it cool to start working on equivalent Hive/Crunch UDFs for the
> existing
> > Pig impls? That's a goal of the project, yes? Is there some project/build
> > infrastructure that needs to be setup first?
> >
> > J
> >
> > --
> > Director of Data Science
> > Cloudera <http://www.cloudera.com>
> > Twitter: @josh_wills <http://twitter.com/josh_wills>
> >
>
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: Hive/Crunch UDFs?
Posted by Matthew Hayes <ma...@gmail.com>.
Yea it makes sense to me to start implementing equivalents of the Pig
UDFs. I'd say it's a goal of the project. There is no project/build
infrastructure set up for it yet though. The artifacts that can currently
be built from the project are "datafu" for the pig UDFs and
"datafu-hourglass" for the incremental MR jobs (under the contrib folder).
Should we also have artifacts "datafu-crunch" and "datafu-hive"?
On Tue, Jan 14, 2014 at 4:09 PM, Josh Wills <jw...@cloudera.com> wrote:
> Is it cool to start working on equivalent Hive/Crunch UDFs for the existing
> Pig impls? That's a goal of the project, yes? Is there some project/build
> infrastructure that needs to be setup first?
>
> J
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>