You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tinkerpop.apache.org by James Thornton <ja...@jamesthornton.com> on 2015/11/10 23:09:49 UTC
[DISCUSS] Add Support for Google Cloud Dataflow SDK (compatible with
Spark & Fink)
Hi All -
Adding support for the Google Cloud Dataflow SDK will help extend reach and
grow the TP community, esp if we can capture part of the swell from
yesterday's announcement of TensorFlow (http://tensorflow.org).
https://cloud.google.com/dataflow/
https://github.com/GoogleCloudPlatform/DataflowJavaSDK
NB: The Cloud Dataflow SDK is compatible with Spark and Flink.
Titan will pair well with this and Cloud BigTable, which uses the HBase 1.0
client -- It's fully managed and integrates with Dataflow so this will give
more people a chance to experience TP at full power , sans the ops.
https://cloud.google.com/bigtable/docs/
- James
--
James Thornton, *http://electricspeed.com <http://electricspeed.com>*
Re: [DISCUSS] Add Support for Google Cloud Dataflow SDK (compatible
with Spark & Fink)
Posted by James Thornton <ja...@jamesthornton.com>.
Yes. similar to Spark (you can use the SDK with Spark as your backend). .
- James
On Wed, Nov 11, 2015 at 7:38 AM, Stephen Mallette <sp...@gmail.com>
wrote:
> I didn't dig too deep into the SDK....Would this be a GraphComputer
> implementation similar to SparkGraphComputer and GiraphGraphComputer?
>
> On Tue, Nov 10, 2015 at 5:09 PM, James Thornton <ja...@jamesthornton.com>
> wrote:
>
> > Hi All -
> >
> > Adding support for the Google Cloud Dataflow SDK will help extend reach
> and
> > grow the TP community, esp if we can capture part of the swell from
> > yesterday's announcement of TensorFlow (http://tensorflow.org).
> >
> > https://cloud.google.com/dataflow/
> > https://github.com/GoogleCloudPlatform/DataflowJavaSDK
> >
> > NB: The Cloud Dataflow SDK is compatible with Spark and Flink.
> >
> > Titan will pair well with this and Cloud BigTable, which uses the HBase
> 1.0
> > client -- It's fully managed and integrates with Dataflow so this will
> give
> > more people a chance to experience TP at full power , sans the ops.
> >
> > https://cloud.google.com/bigtable/docs/
> >
> > - James
> >
> > --
> > James Thornton, *http://electricspeed.com <http://electricspeed.com>*
> >
>
--
James Thornton, *http://electricspeed.com <http://electricspeed.com>*
Re: [DISCUSS] Add Support for Google Cloud Dataflow SDK (compatible
with Spark & Fink)
Posted by Stephen Mallette <sp...@gmail.com>.
I didn't dig too deep into the SDK....Would this be a GraphComputer
implementation similar to SparkGraphComputer and GiraphGraphComputer?
On Tue, Nov 10, 2015 at 5:09 PM, James Thornton <ja...@jamesthornton.com>
wrote:
> Hi All -
>
> Adding support for the Google Cloud Dataflow SDK will help extend reach and
> grow the TP community, esp if we can capture part of the swell from
> yesterday's announcement of TensorFlow (http://tensorflow.org).
>
> https://cloud.google.com/dataflow/
> https://github.com/GoogleCloudPlatform/DataflowJavaSDK
>
> NB: The Cloud Dataflow SDK is compatible with Spark and Flink.
>
> Titan will pair well with this and Cloud BigTable, which uses the HBase 1.0
> client -- It's fully managed and integrates with Dataflow so this will give
> more people a chance to experience TP at full power , sans the ops.
>
> https://cloud.google.com/bigtable/docs/
>
> - James
>
> --
> James Thornton, *http://electricspeed.com <http://electricspeed.com>*
>