You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hawq.apache.org by "Hongxu Ma (JIRA)" <ji...@apache.org> on 2016/12/06 11:11:25 UTC
[jira] [Created] (HAWQ-1193) TDE support in HAWQ
Hongxu Ma created HAWQ-1193:
-------------------------------
Summary: TDE support in HAWQ
Key: HAWQ-1193
URL: https://issues.apache.org/jira/browse/HAWQ-1193
Project: Apache HAWQ
Issue Type: New Feature
Components: libhdfs
Reporter: Hongxu Ma
Assignee: Lei Chang
Fix For: backlog
TDE(transparently data encrypted) has been supported after hadoop 2.6:
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html
https://issues.apache.org/jira/browse/HDFS-6134
Use tde can promise：
1, hdfs file is encrypted.
2, network transfer is encrypted.
So hawq will update libhdfs3 to support it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Ask for advice of [TDE support in HAWQ]
Posted by 马 洪旭 <in...@outlook.com>.
Hi everyone
if have any ideas about TDE, welcome to comment on:
https://issues.apache.org/jira/browse/HAWQ-1193
thanks!
在 06/12/2016 19:11, Hongxu Ma (JIRA) 写道:
> Hongxu Ma created HAWQ-1193:
> -------------------------------
>
> Summary: TDE support in HAWQ
> Key: HAWQ-1193
> URL: https://issues.apache.org/jira/browse/HAWQ-1193
> Project: Apache HAWQ
> Issue Type: New Feature
> Components: libhdfs
> Reporter: Hongxu Ma
> Assignee: Lei Chang
> Fix For: backlog
>
>
> TDE(transparently data encrypted) has been supported after hadoop 2.6:
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html
> https://issues.apache.org/jira/browse/HDFS-6134
>
> Use tde can promise：
> 1, hdfs file is encrypted.
> 2, network transfer is encrypted.
>
> So hawq will update libhdfs3 to support it.
>
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
Re: Design doc of [TDE support in HAWQ]
Posted by Ma Hongxu <in...@outlook.com>.
Thanks, ed.
If anyone can not open the pdf, pls find it on:
https://issues.apache.org/jira/browse/HAWQ-1193
look forward to your proposal！
在 08/12/2016 15:27, Ed Espino 写道:
> Paul,
>
> FYI: I was able to view the TDE design pdf attached to the Jira HAWQ-1193
> <https://issues.apache.org/jira/browse/HAWQ-1193> from several browsers
> whether I was logged into Jira or not.
>
> -=e
>
> On Wed, Dec 7, 2016 at 11:22 PM, Paul Guo <pa...@gmail.com> wrote:
>
>> I'm not able to open the design pdf file. Not sure whether other people saw
>> this.
>> I'm wondering whether it is possible to send the content on email directly?
>> Thanks.
>>
>> 2016-12-08 15:16 GMT+08:00 Ma Hongxu <in...@outlook.com>:
>>
>>> TDE design doc (ver0.1) is here:
>>>
>>> https://issues.apache.org/jira/secure/attachment/
>>> 12842298/HAWQ_TDE_Design_ver0.1.pdf
>>>
>>>
>>> look forward to the proposal and coding together, please comment on:
>>>
>>> https://issues.apache.org/jira/browse/HAWQ-1193
>>>
>>>
>>> thanks!
>>>
>>> 在 07/12/2016 10:40, Hongxu Ma 写道:
>>> Hi everyone
>>>
>>> if have any ideas about TDE, welcome to comment on:
>>>
>>> https://issues.apache.org/jira/browse/HAWQ-1193
>>>
>>> thanks!
>>>
>>> 在 06/12/2016 19:11, Hongxu Ma (JIRA) 写道:
>>> Hongxu Ma created HAWQ-1193:
>>> -------------------------------
>>>
>>> Summary: TDE support in HAWQ
>>> Key: HAWQ-1193
>>> URL:https://issues.apache.org/jira/browse/HAWQ-1193
>>> Project: Apache HAWQ
>>> Issue Type: New Feature
>>> Components: libhdfs
>>> Reporter: Hongxu Ma
>>> Assignee: Lei Chang
>>> Fix For: backlog
>>>
>>>
>>> TDE(transparently data encrypted) has been supported after hadoop 2.6:
>>> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/
>>> TransparentEncryption.html
>>> https://issues.apache.org/jira/browse/HDFS-6134
>>>
>>> Use tde can promise：
>>> 1, hdfs file is encrypted.
>>> 2, network transfer is encrypted.
>>>
>>> So hawq will update libhdfs3 to support it.
>>>
>>>
>>>
>>>
>>> --
>>> This message was sent by Atlassian JIRA
>>> (v6.3.4#6332)
>>>
>>>
>>>
>
>
Re: Design doc of [TDE support in HAWQ]
Posted by Ed Espino <es...@apache.org>.
Paul,
FYI: I was able to view the TDE design pdf attached to the Jira HAWQ-1193
<https://issues.apache.org/jira/browse/HAWQ-1193> from several browsers
whether I was logged into Jira or not.
-=e
On Wed, Dec 7, 2016 at 11:22 PM, Paul Guo <pa...@gmail.com> wrote:
> I'm not able to open the design pdf file. Not sure whether other people saw
> this.
> I'm wondering whether it is possible to send the content on email directly?
> Thanks.
>
> 2016-12-08 15:16 GMT+08:00 Ma Hongxu <in...@outlook.com>:
>
> > TDE design doc (ver0.1) is here:
> >
> > https://issues.apache.org/jira/secure/attachment/
> > 12842298/HAWQ_TDE_Design_ver0.1.pdf
> >
> >
> > look forward to the proposal and coding together, please comment on:
> >
> > https://issues.apache.org/jira/browse/HAWQ-1193
> >
> >
> > thanks!
> >
> > 在 07/12/2016 10:40, Hongxu Ma 写道:
> > Hi everyone
> >
> > if have any ideas about TDE, welcome to comment on:
> >
> > https://issues.apache.org/jira/browse/HAWQ-1193
> >
> > thanks!
> >
> > 在 06/12/2016 19:11, Hongxu Ma (JIRA) 写道:
> > Hongxu Ma created HAWQ-1193:
> > -------------------------------
> >
> > Summary: TDE support in HAWQ
> > Key: HAWQ-1193
> > URL:https://issues.apache.org/jira/browse/HAWQ-1193
> > Project: Apache HAWQ
> > Issue Type: New Feature
> > Components: libhdfs
> > Reporter: Hongxu Ma
> > Assignee: Lei Chang
> > Fix For: backlog
> >
> >
> > TDE(transparently data encrypted) has been supported after hadoop 2.6:
> > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/
> > TransparentEncryption.html
> > https://issues.apache.org/jira/browse/HDFS-6134
> >
> > Use tde can promise：
> > 1, hdfs file is encrypted.
> > 2, network transfer is encrypted.
> >
> > So hawq will update libhdfs3 to support it.
> >
> >
> >
> >
> > --
> > This message was sent by Atlassian JIRA
> > (v6.3.4#6332)
> >
> >
> >
>
--
*Ed Espino*
*espino@apache.org <es...@apache.org>*
Re: Design doc of [TDE support in HAWQ]
Posted by Paul Guo <pa...@gmail.com>.
I'm not able to open the design pdf file. Not sure whether other people saw
this.
I'm wondering whether it is possible to send the content on email directly?
Thanks.
2016-12-08 15:16 GMT+08:00 Ma Hongxu <in...@outlook.com>:
> TDE design doc (ver0.1) is here:
>
> https://issues.apache.org/jira/secure/attachment/
> 12842298/HAWQ_TDE_Design_ver0.1.pdf
>
>
> look forward to the proposal and coding together, please comment on:
>
> https://issues.apache.org/jira/browse/HAWQ-1193
>
>
> thanks!
>
> 在 07/12/2016 10:40, Hongxu Ma 写道:
> Hi everyone
>
> if have any ideas about TDE, welcome to comment on:
>
> https://issues.apache.org/jira/browse/HAWQ-1193
>
> thanks!
>
> 在 06/12/2016 19:11, Hongxu Ma (JIRA) 写道:
> Hongxu Ma created HAWQ-1193:
> -------------------------------
>
> Summary: TDE support in HAWQ
> Key: HAWQ-1193
> URL:https://issues.apache.org/jira/browse/HAWQ-1193
> Project: Apache HAWQ
> Issue Type: New Feature
> Components: libhdfs
> Reporter: Hongxu Ma
> Assignee: Lei Chang
> Fix For: backlog
>
>
> TDE(transparently data encrypted) has been supported after hadoop 2.6:
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/
> TransparentEncryption.html
> https://issues.apache.org/jira/browse/HDFS-6134
>
> Use tde can promise：
> 1, hdfs file is encrypted.
> 2, network transfer is encrypted.
>
> So hawq will update libhdfs3 to support it.
>
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>
>
>
Design doc of [TDE support in HAWQ]
Posted by Ma Hongxu <in...@outlook.com>.
TDE design doc (ver0.1) is here:
https://issues.apache.org/jira/secure/attachment/12842298/HAWQ_TDE_Design_ver0.1.pdf
look forward to the proposal and coding together, please comment on:
https://issues.apache.org/jira/browse/HAWQ-1193
thanks!
在 07/12/2016 10:40, Hongxu Ma 写道:
Hi everyone
if have any ideas about TDE, welcome to comment on:
https://issues.apache.org/jira/browse/HAWQ-1193
thanks!
在 06/12/2016 19:11, Hongxu Ma (JIRA) 写道:
Hongxu Ma created HAWQ-1193:
-------------------------------
Summary: TDE support in HAWQ
Key: HAWQ-1193
URL:https://issues.apache.org/jira/browse/HAWQ-1193
Project: Apache HAWQ
Issue Type: New Feature
Components: libhdfs
Reporter: Hongxu Ma
Assignee: Lei Chang
Fix For: backlog
TDE(transparently data encrypted) has been supported after hadoop 2.6:
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html
https://issues.apache.org/jira/browse/HDFS-6134
Use tde can promise：
1, hdfs file is encrypted.
2, network transfer is encrypted.
So hawq will update libhdfs3 to support it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: Design of HAWQ RPS HA
Posted by Vineet Goel <vv...@apache.org>.
Thank you for posting this design doc. There is a great design discussion
that has started on the JIRA as a result. We could create new JIRAs for
some of the suggestions and take an iterative approach to developing this.
-Vineet
On Tue, Apr 25, 2017 at 6:44 PM Ma Hongxu <in...@outlook.com> wrote:
> Hi all
>
> RPS HA Design doc(ver0.1) is here:
>
> https://issues.apache.org/jira/secure/attachment/12864941/RPSHADesign_v0.1.pdf
>
> We designed two HA strategy: the default strategy with local and standby
> RPS, and also provides a RPS cluster strategy for specific scenario.
>
> It's a draft now, please feel free to comment on:
> https://issues.apache.org/jira/browse/HAWQ-1436
>
> Thanks!
>
>
> --
> Regards,
> Hongxu.
>
Design of HAWQ RPS HA
Posted by Ma Hongxu <in...@outlook.com>.
Hi all
RPS HA Design doc(ver0.1) is here:
https://issues.apache.org/jira/secure/attachment/12864941/RPSHADesign_v0.1.pdf
We designed two HA strategy: the default strategy with local and standby RPS, and also provides a RPS cluster strategy for specific scenario.
It's a draft now, please feel free to comment on:
https://issues.apache.org/jira/browse/HAWQ-1436
Thanks!
--
Regards,
Hongxu.
Ask for advice of [TDE support in HAWQ]
Posted by 马 洪旭 <in...@outlook.com>.
Hi everyone
if have any ideas about TDE, welcome to comment on:
https://issues.apache.org/jira/browse/HAWQ-1193
thanks!
在 06/12/2016 19:11, Hongxu Ma (JIRA) 写道:
> Hongxu Ma created HAWQ-1193:
> -------------------------------
>
> Summary: TDE support in HAWQ
> Key: HAWQ-1193
> URL:https://issues.apache.org/jira/browse/HAWQ-1193
> Project: Apache HAWQ
> Issue Type: New Feature
> Components: libhdfs
> Reporter: Hongxu Ma
> Assignee: Lei Chang
> Fix For: backlog
>
>
> TDE(transparently data encrypted) has been supported after hadoop 2.6:
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html
> https://issues.apache.org/jira/browse/HDFS-6134
>
> Use tde can promise：
> 1, hdfs file is encrypted.
> 2, network transfer is encrypted.
>
> So hawq will update libhdfs3 to support it.
>
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)