You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Stephan Ewen <se...@apache.org> on 2016/05/01 06:35:36 UTC

Re: Flink on Azure HDInsight

Hi!

As far as I know, some people have been using Flink together with Azure,
and we try and do some release validation on Azure as well.

There is even a section in the docs that describes how to use Hadoop's
Azure Table formats with Flink
https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/connectors.html#access-microsoft-azure-table-storage

I am not aware of any Azure specific issues at this point...

Greetings,
Stephan



On Fri, Apr 29, 2016 at 11:18 AM, Brig Lamoreaux <
Brig.Lamoreaux@microsoft.com> wrote:

> Hi All,
>
>
>
> Are there any issues with Flink on Azure HDInsight?
>
>
>
> Thanks,
>
> Brig Lamoreaux
>
> Data Solution Architect
>
> US Desert/Mountain Tempe
>
>
>
>
>
> [image: MSFT_logo_Gray DE sized SIG1.png]
>
>
>
>
>
>
>

Re: Flink on Azure HDInsight

Posted by Kostas Tzoumas <kt...@apache.org>.

As far as I know, Azure HDInsight is based on Hortonworks HDP, on top of
which Flink has been used extensively.

On Mon, May 2, 2016 at 10:42 AM, Brig Lamoreaux <
Brig.Lamoreaux@microsoft.com> wrote:

> Thanks Stephan,
>
>
>
> Turns out Azure Table is slightly different than Azure HDInsight. Both use
> Azure Storage however, HDInsight allows HDFS over Azure Storage.
>
>
>
> I’d be curious if anyone has tried to use Flink on top of Azure HDInsight.
>
>
>
> Thanks,
>
> Brig
>
>
>
> *From:* ewenstephan@gmail.com [mailto:ewenstephan@gmail.com] *On Behalf
> Of *Stephan Ewen
> *Sent:* Saturday, April 30, 2016 9:36 PM
> *To:* user@flink.apache.org
> *Subject:* Re: Flink on Azure HDInsight
>
>
>
> Hi!
>
>
>
> As far as I know, some people have been using Flink together with Azure,
> and we try and do some release validation on Azure as well.
>
>
>
> There is even a section in the docs that describes how to use Hadoop's
> Azure Table formats with Flink
>
>
> https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/connectors.html#access-microsoft-azure-table-storage
> <https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fci.apache.org%2fprojects%2fflink%2fflink-docs-master%2fapis%2fbatch%2fconnectors.html%23access-microsoft-azure-table-storage&data=01%7c01%7cBrig.Lamoreaux%40microsoft.com%7c5abc713e755341d573d808d3717a0cdd%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=LZLI8jS2agIUW92hu4OOaDnl%2by1USN8EhQzc55CDJxM%3d>
>
>
>
> I am not aware of any Azure specific issues at this point...
>
>
>
> Greetings,
>
> Stephan
>
>
>
>
>
>
>
> On Fri, Apr 29, 2016 at 11:18 AM, Brig Lamoreaux <
> Brig.Lamoreaux@microsoft.com> wrote:
>
> Hi All,
>
>
>
> Are there any issues with Flink on Azure HDInsight?
>
>
>
> Thanks,
>
> Brig Lamoreaux
>
> Data Solution Architect
>
> US Desert/Mountain Tempe
>
>
>
>
>
> [image: MSFT_logo_Gray DE sized SIG1.png]
>
>
>
>
>
>
>
>
>

RE: Flink on Azure HDInsight

Posted by Brig Lamoreaux <Br...@microsoft.com>.

Thanks Stephan,

Turns out Azure Table is slightly different than Azure HDInsight. Both use Azure Storage however, HDInsight allows HDFS over Azure Storage.

I’d be curious if anyone has tried to use Flink on top of Azure HDInsight.

Thanks,
Brig

From: ewenstephan@gmail.com [mailto:ewenstephan@gmail.com] On Behalf Of Stephan Ewen
Sent: Saturday, April 30, 2016 9:36 PM
To: user@flink.apache.org
Subject: Re: Flink on Azure HDInsight

Hi!

As far as I know, some people have been using Flink together with Azure, and we try and do some release validation on Azure as well.

There is even a section in the docs that describes how to use Hadoop's Azure Table formats with Flink
https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/connectors.html#access-microsoft-azure-table-storage<https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fci.apache.org%2fprojects%2fflink%2fflink-docs-master%2fapis%2fbatch%2fconnectors.html%23access-microsoft-azure-table-storage&data=01%7c01%7cBrig.Lamoreaux%40microsoft.com%7c5abc713e755341d573d808d3717a0cdd%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=LZLI8jS2agIUW92hu4OOaDnl%2by1USN8EhQzc55CDJxM%3d>

I am not aware of any Azure specific issues at this point...

Greetings,
Stephan



On Fri, Apr 29, 2016 at 11:18 AM, Brig Lamoreaux <Br...@microsoft.com>> wrote:
Hi All,

Are there any issues with Flink on Azure HDInsight?

Thanks,
Brig Lamoreaux

Data Solution Architect
US Desert/Mountain Tempe




[MSFT_logo_Gray DE sized SIG1.png]