You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hudi.apache.org by Gary Li <ya...@gmail.com> on 2021/04/07 14:51:30 UTC

Apache Hudi 0.8.0 Released

Hi All,

We are excited to share that Apache Hudi 0.8.0 was released. Since the
0.7.0 release, we resolved 97 JIRA tickets and made 120 code commits. We
implemented many new features, bugfix, and performance improvement. Thanks
to all the contributors who had made this happened.

*Release Highlights*

*Flink Integration*
Since the initial support for the Hudi Flink Writer in the 0.7.0 release,
the Hudi community made great progress on improving the Flink/Hudi
integration, including redesigning the Flink writer pipeline with better
performance and scalability, state-backed indexing with bootstrap support,
Flink writer for MOR table, batch reader for COW&MOR table, streaming
reader for MOR table, and Flink SQL connector for both source and sink. In
the 0.8.0 release, the user is able to use all those features with Flink
1.11+.

Please see [RFC-24](
https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal)
for more implementation details of the Flink writer and follow this [page](
https://hudi.apache.org/docs/flink-quick-start-guide.html) to get started
with Flink!

*Parallel Writers Support*
As many users requested, now Hudi supports multiple ingestion writers to
the same Hudi Table with optimistic concurrency control. Hudi supports file
level OCC, i.e., for any 2 commits (or writers) happening to the same
table, if they do not have writes to overlapping files being changed, both
writers are allowed to succeed. This feature is currently experimental and
requires either Zookeeper or HiveMetastore to acquire locks.

Please see [RFC-22](
https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers)
for more implementation details and follow this [page](
https://hudi.apache.org/docs/concurrency_control.html) to get started with
concurrency control!

*Writer side improvements*
- InsertOverwrite Support for Flink writer client.
- Support CopyOnWriteTable in Java writer client.

*Query side improvements*
- Support Spark Structured Streaming read from Hudi table.
- Performance improvement of Metadata table.
- Performance improvement of Clustering.

*Raw Release Notes*
The raw release notes are available [here](
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
)

Thanks,
Gary Li
(on behalf of the Hudi community)

Re: Apache Hudi 0.8.0 Released

Posted by Nishith <n3...@gmail.com>.

Thanks Gary, great work with the release!

-Nishith

> On Apr 9, 2021, at 10:47 PM, Bhavani Sudha <bh...@gmail.com> wrote:
> 
> Thanks Gary. Great job!
> 
>> On Fri, Apr 9, 2021 at 10:12 PM vino yang <ya...@gmail.com> wrote:
>> 
>> Thanks Gary, great work!
>> 
>> Best,
>> Vino
>> 
>> Danny Chan <da...@apache.org> 于2021年4月10日周六 上午10:27写道：
>> 
>>> Cheers ~
>>> 
>>> Best,
>>> Danny Chan
>>> 
>>> Vinoth Chandar <vi...@apache.org> 于2021年4月10日周六 上午12:43写道：
>>> 
>>>> Thanks Gary! +1 fantastic job with the release!
>>>> 
>>>> Please also announce on Slack (if not done already)
>>>> 
>>>> I shared some tweets at https://twitter.com/apachehudi
>>>> 
>>>> On Fri, Apr 9, 2021 at 7:44 AM leesf <le...@gmail.com> wrote:
>>>> 
>>>>> Thanks gary for driving the release, great job.
>>>>> 
>>>>> Pratyaksh Sharma <pr...@gmail.com> 于2021年4月9日周五 下午10:40写道：
>>>>> 
>>>>>> Great news!
>>>>>> 
>>>>>> On Fri, Apr 9, 2021 at 11:42 AM Sivabalan <n....@gmail.com>
>>> wrote:
>>>>>> 
>>>>>>> Awesome! Great job Gary on the release work!
>>>>>>> 
>>>>>>> On Fri, Apr 9, 2021 at 1:59 AM Gary Li <yanjia.gary.li@gmail.com
>>> 
>>>>> wrote:
>>>>>>> 
>>>>>>>> Thanks Vinoth.
>>>>>>>> 
>>>>>>>> The page for 0.8.0 is ready
>>>>>>>> 
>> https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
>>>>>>>> The release note could be found here
>>>>>>> https://hudi.apache.org/releases.html
>>>>>>>> 
>>>>>>>> Best,
>>>>>>>> Gary Li
>>>>>>>> 
>>>>>>>> On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <
>>> vinoth@apache.org>
>>>>>>> wrote:
>>>>>>>> 
>>>>>>>>> This is awesome! Thanks for sharing, Gary!
>>>>>>>>> 
>>>>>>>>> Are we waiting for the site to be rendered with 0.8.0 release
>>>> info
>>>>>> and
>>>>>>>>> homepage update?
>>>>>>>>> 
>>>>>>>>> On Wed, Apr 7, 2021 at 7:54 AM Gary Li <
>>> yanjia.gary.li@gmail.com
>>>>> 
>>>>>>> wrote:
>>>>>>>>> 
>>>>>>>>>> Hi All,
>>>>>>>>>> 
>>>>>>>>>> We are excited to share that Apache Hudi 0.8.0 was
>> released.
>>>>> Since
>>>>>>> the
>>>>>>>>>> 0.7.0 release, we resolved 97 JIRA tickets and made 120
>> code
>>>>>> commits.
>>>>>>>> We
>>>>>>>>>> implemented many new features, bugfix, and performance
>>>>> improvement.
>>>>>>>>> Thanks
>>>>>>>>>> to all the contributors who had made this happened.
>>>>>>>>>> 
>>>>>>>>>> *Release Highlights*
>>>>>>>>>> 
>>>>>>>>>> *Flink Integration*
>>>>>>>>>> Since the initial support for the Hudi Flink Writer in the
>>>> 0.7.0
>>>>>>>> release,
>>>>>>>>>> the Hudi community made great progress on improving the
>>>>> Flink/Hudi
>>>>>>>>>> integration, including redesigning the Flink writer
>> pipeline
>>>> with
>>>>>>>> better
>>>>>>>>>> performance and scalability, state-backed indexing with
>>>> bootstrap
>>>>>>>>> support,
>>>>>>>>>> Flink writer for MOR table, batch reader for COW&MOR table,
>>>>>> streaming
>>>>>>>>>> reader for MOR table, and Flink SQL connector for both
>> source
>>>> and
>>>>>>> sink.
>>>>>>>>> In
>>>>>>>>>> the 0.8.0 release, the user is able to use all those
>> features
>>>>> with
>>>>>>>> Flink
>>>>>>>>>> 1.11+.
>>>>>>>>>> 
>>>>>>>>>> Please see [RFC-24](
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>> 
>> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
>>>>>>>>>> )
>>>>>>>>>> for more implementation details of the Flink writer and
>>> follow
>>>>> this
>>>>>>>>> [page](
>>>>>>>>>> https://hudi.apache.org/docs/flink-quick-start-guide.html)
>>> to
>>>>> get
>>>>>>>>> started
>>>>>>>>>> with Flink!
>>>>>>>>>> 
>>>>>>>>>> *Parallel Writers Support*
>>>>>>>>>> As many users requested, now Hudi supports multiple
>> ingestion
>>>>>> writers
>>>>>>>> to
>>>>>>>>>> the same Hudi Table with optimistic concurrency control.
>> Hudi
>>>>>>> supports
>>>>>>>>> file
>>>>>>>>>> level OCC, i.e., for any 2 commits (or writers) happening
>> to
>>>> the
>>>>>> same
>>>>>>>>>> table, if they do not have writes to overlapping files
>> being
>>>>>> changed,
>>>>>>>>> both
>>>>>>>>>> writers are allowed to succeed. This feature is currently
>>>>>>> experimental
>>>>>>>>> and
>>>>>>>>>> requires either Zookeeper or HiveMetastore to acquire
>> locks.
>>>>>>>>>> 
>>>>>>>>>> Please see [RFC-22](
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>> 
>> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
>>>>>>>>>> )
>>>>>>>>>> for more implementation details and follow this [page](
>>>>>>>>>> https://hudi.apache.org/docs/concurrency_control.html) to
>>> get
>>>>>>> started
>>>>>>>>> with
>>>>>>>>>> concurrency control!
>>>>>>>>>> 
>>>>>>>>>> *Writer side improvements*
>>>>>>>>>> - InsertOverwrite Support for Flink writer client.
>>>>>>>>>> - Support CopyOnWriteTable in Java writer client.
>>>>>>>>>> 
>>>>>>>>>> *Query side improvements*
>>>>>>>>>> - Support Spark Structured Streaming read from Hudi table.
>>>>>>>>>> - Performance improvement of Metadata table.
>>>>>>>>>> - Performance improvement of Clustering.
>>>>>>>>>> 
>>>>>>>>>> *Raw Release Notes*
>>>>>>>>>> The raw release notes are available [here](
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>> 
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
>>>>>>>>>> )
>>>>>>>>>> 
>>>>>>>>>> Thanks,
>>>>>>>>>> Gary Li
>>>>>>>>>> (on behalf of the Hudi community)
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> --
>>>>>>> Regards,
>>>>>>> -Sivabalan
>>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>> 
>>

Re: Apache Hudi 0.8.0 Released

Posted by Bhavani Sudha <bh...@gmail.com>.

Thanks Gary. Great job!

On Fri, Apr 9, 2021 at 10:12 PM vino yang <ya...@gmail.com> wrote:

> Thanks Gary, great work!
>
> Best,
> Vino
>
> Danny Chan <da...@apache.org> 于2021年4月10日周六 上午10:27写道：
>
> > Cheers ~
> >
> > Best,
> > Danny Chan
> >
> > Vinoth Chandar <vi...@apache.org> 于2021年4月10日周六 上午12:43写道：
> >
> > > Thanks Gary! +1 fantastic job with the release!
> > >
> > > Please also announce on Slack (if not done already)
> > >
> > > I shared some tweets at https://twitter.com/apachehudi
> > >
> > > On Fri, Apr 9, 2021 at 7:44 AM leesf <le...@gmail.com> wrote:
> > >
> > > > Thanks gary for driving the release, great job.
> > > >
> > > > Pratyaksh Sharma <pr...@gmail.com> 于2021年4月9日周五 下午10:40写道：
> > > >
> > > > > Great news!
> > > > >
> > > > > On Fri, Apr 9, 2021 at 11:42 AM Sivabalan <n....@gmail.com>
> > wrote:
> > > > >
> > > > > > Awesome! Great job Gary on the release work!
> > > > > >
> > > > > > On Fri, Apr 9, 2021 at 1:59 AM Gary Li <yanjia.gary.li@gmail.com
> >
> > > > wrote:
> > > > > >
> > > > > > > Thanks Vinoth.
> > > > > > >
> > > > > > > The page for 0.8.0 is ready
> > > > > > >
> https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
> > > > > > > The release note could be found here
> > > > > > https://hudi.apache.org/releases.html
> > > > > > >
> > > > > > > Best,
> > > > > > > Gary Li
> > > > > > >
> > > > > > > On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <
> > vinoth@apache.org>
> > > > > > wrote:
> > > > > > >
> > > > > > > > This is awesome! Thanks for sharing, Gary!
> > > > > > > >
> > > > > > > > Are we waiting for the site to be rendered with 0.8.0 release
> > > info
> > > > > and
> > > > > > > > homepage update?
> > > > > > > >
> > > > > > > > On Wed, Apr 7, 2021 at 7:54 AM Gary Li <
> > yanjia.gary.li@gmail.com
> > > >
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi All,
> > > > > > > > >
> > > > > > > > > We are excited to share that Apache Hudi 0.8.0 was
> released.
> > > > Since
> > > > > > the
> > > > > > > > > 0.7.0 release, we resolved 97 JIRA tickets and made 120
> code
> > > > > commits.
> > > > > > > We
> > > > > > > > > implemented many new features, bugfix, and performance
> > > > improvement.
> > > > > > > > Thanks
> > > > > > > > > to all the contributors who had made this happened.
> > > > > > > > >
> > > > > > > > > *Release Highlights*
> > > > > > > > >
> > > > > > > > > *Flink Integration*
> > > > > > > > > Since the initial support for the Hudi Flink Writer in the
> > > 0.7.0
> > > > > > > release,
> > > > > > > > > the Hudi community made great progress on improving the
> > > > Flink/Hudi
> > > > > > > > > integration, including redesigning the Flink writer
> pipeline
> > > with
> > > > > > > better
> > > > > > > > > performance and scalability, state-backed indexing with
> > > bootstrap
> > > > > > > > support,
> > > > > > > > > Flink writer for MOR table, batch reader for COW&MOR table,
> > > > > streaming
> > > > > > > > > reader for MOR table, and Flink SQL connector for both
> source
> > > and
> > > > > > sink.
> > > > > > > > In
> > > > > > > > > the 0.8.0 release, the user is able to use all those
> features
> > > > with
> > > > > > > Flink
> > > > > > > > > 1.11+.
> > > > > > > > >
> > > > > > > > > Please see [RFC-24](
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > > > > > > > > )
> > > > > > > > > for more implementation details of the Flink writer and
> > follow
> > > > this
> > > > > > > > [page](
> > > > > > > > > https://hudi.apache.org/docs/flink-quick-start-guide.html)
> > to
> > > > get
> > > > > > > > started
> > > > > > > > > with Flink!
> > > > > > > > >
> > > > > > > > > *Parallel Writers Support*
> > > > > > > > > As many users requested, now Hudi supports multiple
> ingestion
> > > > > writers
> > > > > > > to
> > > > > > > > > the same Hudi Table with optimistic concurrency control.
> Hudi
> > > > > > supports
> > > > > > > > file
> > > > > > > > > level OCC, i.e., for any 2 commits (or writers) happening
> to
> > > the
> > > > > same
> > > > > > > > > table, if they do not have writes to overlapping files
> being
> > > > > changed,
> > > > > > > > both
> > > > > > > > > writers are allowed to succeed. This feature is currently
> > > > > > experimental
> > > > > > > > and
> > > > > > > > > requires either Zookeeper or HiveMetastore to acquire
> locks.
> > > > > > > > >
> > > > > > > > > Please see [RFC-22](
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > > > > > > > > )
> > > > > > > > > for more implementation details and follow this [page](
> > > > > > > > > https://hudi.apache.org/docs/concurrency_control.html) to
> > get
> > > > > > started
> > > > > > > > with
> > > > > > > > > concurrency control!
> > > > > > > > >
> > > > > > > > > *Writer side improvements*
> > > > > > > > > - InsertOverwrite Support for Flink writer client.
> > > > > > > > > - Support CopyOnWriteTable in Java writer client.
> > > > > > > > >
> > > > > > > > > *Query side improvements*
> > > > > > > > > - Support Spark Structured Streaming read from Hudi table.
> > > > > > > > > - Performance improvement of Metadata table.
> > > > > > > > > - Performance improvement of Clustering.
> > > > > > > > >
> > > > > > > > > *Raw Release Notes*
> > > > > > > > > The raw release notes are available [here](
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > > > > > > > > )
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Gary Li
> > > > > > > > > (on behalf of the Hudi community)
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Regards,
> > > > > > -Sivabalan
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Apache Hudi 0.8.0 Released

Posted by vino yang <ya...@gmail.com>.

Thanks Gary, great work!

Best,
Vino

Danny Chan <da...@apache.org> 于2021年4月10日周六 上午10:27写道：

> Cheers ~
>
> Best,
> Danny Chan
>
> Vinoth Chandar <vi...@apache.org> 于2021年4月10日周六 上午12:43写道：
>
> > Thanks Gary! +1 fantastic job with the release!
> >
> > Please also announce on Slack (if not done already)
> >
> > I shared some tweets at https://twitter.com/apachehudi
> >
> > On Fri, Apr 9, 2021 at 7:44 AM leesf <le...@gmail.com> wrote:
> >
> > > Thanks gary for driving the release, great job.
> > >
> > > Pratyaksh Sharma <pr...@gmail.com> 于2021年4月9日周五 下午10:40写道：
> > >
> > > > Great news!
> > > >
> > > > On Fri, Apr 9, 2021 at 11:42 AM Sivabalan <n....@gmail.com>
> wrote:
> > > >
> > > > > Awesome! Great job Gary on the release work!
> > > > >
> > > > > On Fri, Apr 9, 2021 at 1:59 AM Gary Li <ya...@gmail.com>
> > > wrote:
> > > > >
> > > > > > Thanks Vinoth.
> > > > > >
> > > > > > The page for 0.8.0 is ready
> > > > > > https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
> > > > > > The release note could be found here
> > > > > https://hudi.apache.org/releases.html
> > > > > >
> > > > > > Best,
> > > > > > Gary Li
> > > > > >
> > > > > > On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <
> vinoth@apache.org>
> > > > > wrote:
> > > > > >
> > > > > > > This is awesome! Thanks for sharing, Gary!
> > > > > > >
> > > > > > > Are we waiting for the site to be rendered with 0.8.0 release
> > info
> > > > and
> > > > > > > homepage update?
> > > > > > >
> > > > > > > On Wed, Apr 7, 2021 at 7:54 AM Gary Li <
> yanjia.gary.li@gmail.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > > Hi All,
> > > > > > > >
> > > > > > > > We are excited to share that Apache Hudi 0.8.0 was released.
> > > Since
> > > > > the
> > > > > > > > 0.7.0 release, we resolved 97 JIRA tickets and made 120 code
> > > > commits.
> > > > > > We
> > > > > > > > implemented many new features, bugfix, and performance
> > > improvement.
> > > > > > > Thanks
> > > > > > > > to all the contributors who had made this happened.
> > > > > > > >
> > > > > > > > *Release Highlights*
> > > > > > > >
> > > > > > > > *Flink Integration*
> > > > > > > > Since the initial support for the Hudi Flink Writer in the
> > 0.7.0
> > > > > > release,
> > > > > > > > the Hudi community made great progress on improving the
> > > Flink/Hudi
> > > > > > > > integration, including redesigning the Flink writer pipeline
> > with
> > > > > > better
> > > > > > > > performance and scalability, state-backed indexing with
> > bootstrap
> > > > > > > support,
> > > > > > > > Flink writer for MOR table, batch reader for COW&MOR table,
> > > > streaming
> > > > > > > > reader for MOR table, and Flink SQL connector for both source
> > and
> > > > > sink.
> > > > > > > In
> > > > > > > > the 0.8.0 release, the user is able to use all those features
> > > with
> > > > > > Flink
> > > > > > > > 1.11+.
> > > > > > > >
> > > > > > > > Please see [RFC-24](
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > > > > > > > )
> > > > > > > > for more implementation details of the Flink writer and
> follow
> > > this
> > > > > > > [page](
> > > > > > > > https://hudi.apache.org/docs/flink-quick-start-guide.html)
> to
> > > get
> > > > > > > started
> > > > > > > > with Flink!
> > > > > > > >
> > > > > > > > *Parallel Writers Support*
> > > > > > > > As many users requested, now Hudi supports multiple ingestion
> > > > writers
> > > > > > to
> > > > > > > > the same Hudi Table with optimistic concurrency control. Hudi
> > > > > supports
> > > > > > > file
> > > > > > > > level OCC, i.e., for any 2 commits (or writers) happening to
> > the
> > > > same
> > > > > > > > table, if they do not have writes to overlapping files being
> > > > changed,
> > > > > > > both
> > > > > > > > writers are allowed to succeed. This feature is currently
> > > > > experimental
> > > > > > > and
> > > > > > > > requires either Zookeeper or HiveMetastore to acquire locks.
> > > > > > > >
> > > > > > > > Please see [RFC-22](
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > > > > > > > )
> > > > > > > > for more implementation details and follow this [page](
> > > > > > > > https://hudi.apache.org/docs/concurrency_control.html) to
> get
> > > > > started
> > > > > > > with
> > > > > > > > concurrency control!
> > > > > > > >
> > > > > > > > *Writer side improvements*
> > > > > > > > - InsertOverwrite Support for Flink writer client.
> > > > > > > > - Support CopyOnWriteTable in Java writer client.
> > > > > > > >
> > > > > > > > *Query side improvements*
> > > > > > > > - Support Spark Structured Streaming read from Hudi table.
> > > > > > > > - Performance improvement of Metadata table.
> > > > > > > > - Performance improvement of Clustering.
> > > > > > > >
> > > > > > > > *Raw Release Notes*
> > > > > > > > The raw release notes are available [here](
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > > > > > > > )
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Gary Li
> > > > > > > > (on behalf of the Hudi community)
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Regards,
> > > > > -Sivabalan
> > > > >
> > > >
> > >
> >
>

Re: Apache Hudi 0.8.0 Released

Posted by Danny Chan <da...@apache.org>.

Cheers ~

Best,
Danny Chan

Vinoth Chandar <vi...@apache.org> 于2021年4月10日周六 上午12:43写道：

> Thanks Gary! +1 fantastic job with the release!
>
> Please also announce on Slack (if not done already)
>
> I shared some tweets at https://twitter.com/apachehudi
>
> On Fri, Apr 9, 2021 at 7:44 AM leesf <le...@gmail.com> wrote:
>
> > Thanks gary for driving the release, great job.
> >
> > Pratyaksh Sharma <pr...@gmail.com> 于2021年4月9日周五 下午10:40写道：
> >
> > > Great news!
> > >
> > > On Fri, Apr 9, 2021 at 11:42 AM Sivabalan <n....@gmail.com> wrote:
> > >
> > > > Awesome! Great job Gary on the release work!
> > > >
> > > > On Fri, Apr 9, 2021 at 1:59 AM Gary Li <ya...@gmail.com>
> > wrote:
> > > >
> > > > > Thanks Vinoth.
> > > > >
> > > > > The page for 0.8.0 is ready
> > > > > https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
> > > > > The release note could be found here
> > > > https://hudi.apache.org/releases.html
> > > > >
> > > > > Best,
> > > > > Gary Li
> > > > >
> > > > > On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <vi...@apache.org>
> > > > wrote:
> > > > >
> > > > > > This is awesome! Thanks for sharing, Gary!
> > > > > >
> > > > > > Are we waiting for the site to be rendered with 0.8.0 release
> info
> > > and
> > > > > > homepage update?
> > > > > >
> > > > > > On Wed, Apr 7, 2021 at 7:54 AM Gary Li <yanjia.gary.li@gmail.com
> >
> > > > wrote:
> > > > > >
> > > > > > > Hi All,
> > > > > > >
> > > > > > > We are excited to share that Apache Hudi 0.8.0 was released.
> > Since
> > > > the
> > > > > > > 0.7.0 release, we resolved 97 JIRA tickets and made 120 code
> > > commits.
> > > > > We
> > > > > > > implemented many new features, bugfix, and performance
> > improvement.
> > > > > > Thanks
> > > > > > > to all the contributors who had made this happened.
> > > > > > >
> > > > > > > *Release Highlights*
> > > > > > >
> > > > > > > *Flink Integration*
> > > > > > > Since the initial support for the Hudi Flink Writer in the
> 0.7.0
> > > > > release,
> > > > > > > the Hudi community made great progress on improving the
> > Flink/Hudi
> > > > > > > integration, including redesigning the Flink writer pipeline
> with
> > > > > better
> > > > > > > performance and scalability, state-backed indexing with
> bootstrap
> > > > > > support,
> > > > > > > Flink writer for MOR table, batch reader for COW&MOR table,
> > > streaming
> > > > > > > reader for MOR table, and Flink SQL connector for both source
> and
> > > > sink.
> > > > > > In
> > > > > > > the 0.8.0 release, the user is able to use all those features
> > with
> > > > > Flink
> > > > > > > 1.11+.
> > > > > > >
> > > > > > > Please see [RFC-24](
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > > > > > > )
> > > > > > > for more implementation details of the Flink writer and follow
> > this
> > > > > > [page](
> > > > > > > https://hudi.apache.org/docs/flink-quick-start-guide.html) to
> > get
> > > > > > started
> > > > > > > with Flink!
> > > > > > >
> > > > > > > *Parallel Writers Support*
> > > > > > > As many users requested, now Hudi supports multiple ingestion
> > > writers
> > > > > to
> > > > > > > the same Hudi Table with optimistic concurrency control. Hudi
> > > > supports
> > > > > > file
> > > > > > > level OCC, i.e., for any 2 commits (or writers) happening to
> the
> > > same
> > > > > > > table, if they do not have writes to overlapping files being
> > > changed,
> > > > > > both
> > > > > > > writers are allowed to succeed. This feature is currently
> > > > experimental
> > > > > > and
> > > > > > > requires either Zookeeper or HiveMetastore to acquire locks.
> > > > > > >
> > > > > > > Please see [RFC-22](
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > > > > > > )
> > > > > > > for more implementation details and follow this [page](
> > > > > > > https://hudi.apache.org/docs/concurrency_control.html) to get
> > > > started
> > > > > > with
> > > > > > > concurrency control!
> > > > > > >
> > > > > > > *Writer side improvements*
> > > > > > > - InsertOverwrite Support for Flink writer client.
> > > > > > > - Support CopyOnWriteTable in Java writer client.
> > > > > > >
> > > > > > > *Query side improvements*
> > > > > > > - Support Spark Structured Streaming read from Hudi table.
> > > > > > > - Performance improvement of Metadata table.
> > > > > > > - Performance improvement of Clustering.
> > > > > > >
> > > > > > > *Raw Release Notes*
> > > > > > > The raw release notes are available [here](
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > > > > > > )
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Gary Li
> > > > > > > (on behalf of the Hudi community)
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Regards,
> > > > -Sivabalan
> > > >
> > >
> >
>

Re: Apache Hudi 0.8.0 Released

Posted by Vinoth Chandar <vi...@apache.org>.

Thanks Gary! +1 fantastic job with the release!

Please also announce on Slack (if not done already)

I shared some tweets at https://twitter.com/apachehudi

On Fri, Apr 9, 2021 at 7:44 AM leesf <le...@gmail.com> wrote:

> Thanks gary for driving the release, great job.
>
> Pratyaksh Sharma <pr...@gmail.com> 于2021年4月9日周五 下午10:40写道：
>
> > Great news!
> >
> > On Fri, Apr 9, 2021 at 11:42 AM Sivabalan <n....@gmail.com> wrote:
> >
> > > Awesome! Great job Gary on the release work!
> > >
> > > On Fri, Apr 9, 2021 at 1:59 AM Gary Li <ya...@gmail.com>
> wrote:
> > >
> > > > Thanks Vinoth.
> > > >
> > > > The page for 0.8.0 is ready
> > > > https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
> > > > The release note could be found here
> > > https://hudi.apache.org/releases.html
> > > >
> > > > Best,
> > > > Gary Li
> > > >
> > > > On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <vi...@apache.org>
> > > wrote:
> > > >
> > > > > This is awesome! Thanks for sharing, Gary!
> > > > >
> > > > > Are we waiting for the site to be rendered with 0.8.0 release info
> > and
> > > > > homepage update?
> > > > >
> > > > > On Wed, Apr 7, 2021 at 7:54 AM Gary Li <ya...@gmail.com>
> > > wrote:
> > > > >
> > > > > > Hi All,
> > > > > >
> > > > > > We are excited to share that Apache Hudi 0.8.0 was released.
> Since
> > > the
> > > > > > 0.7.0 release, we resolved 97 JIRA tickets and made 120 code
> > commits.
> > > > We
> > > > > > implemented many new features, bugfix, and performance
> improvement.
> > > > > Thanks
> > > > > > to all the contributors who had made this happened.
> > > > > >
> > > > > > *Release Highlights*
> > > > > >
> > > > > > *Flink Integration*
> > > > > > Since the initial support for the Hudi Flink Writer in the 0.7.0
> > > > release,
> > > > > > the Hudi community made great progress on improving the
> Flink/Hudi
> > > > > > integration, including redesigning the Flink writer pipeline with
> > > > better
> > > > > > performance and scalability, state-backed indexing with bootstrap
> > > > > support,
> > > > > > Flink writer for MOR table, batch reader for COW&MOR table,
> > streaming
> > > > > > reader for MOR table, and Flink SQL connector for both source and
> > > sink.
> > > > > In
> > > > > > the 0.8.0 release, the user is able to use all those features
> with
> > > > Flink
> > > > > > 1.11+.
> > > > > >
> > > > > > Please see [RFC-24](
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > > > > > )
> > > > > > for more implementation details of the Flink writer and follow
> this
> > > > > [page](
> > > > > > https://hudi.apache.org/docs/flink-quick-start-guide.html) to
> get
> > > > > started
> > > > > > with Flink!
> > > > > >
> > > > > > *Parallel Writers Support*
> > > > > > As many users requested, now Hudi supports multiple ingestion
> > writers
> > > > to
> > > > > > the same Hudi Table with optimistic concurrency control. Hudi
> > > supports
> > > > > file
> > > > > > level OCC, i.e., for any 2 commits (or writers) happening to the
> > same
> > > > > > table, if they do not have writes to overlapping files being
> > changed,
> > > > > both
> > > > > > writers are allowed to succeed. This feature is currently
> > > experimental
> > > > > and
> > > > > > requires either Zookeeper or HiveMetastore to acquire locks.
> > > > > >
> > > > > > Please see [RFC-22](
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > > > > > )
> > > > > > for more implementation details and follow this [page](
> > > > > > https://hudi.apache.org/docs/concurrency_control.html) to get
> > > started
> > > > > with
> > > > > > concurrency control!
> > > > > >
> > > > > > *Writer side improvements*
> > > > > > - InsertOverwrite Support for Flink writer client.
> > > > > > - Support CopyOnWriteTable in Java writer client.
> > > > > >
> > > > > > *Query side improvements*
> > > > > > - Support Spark Structured Streaming read from Hudi table.
> > > > > > - Performance improvement of Metadata table.
> > > > > > - Performance improvement of Clustering.
> > > > > >
> > > > > > *Raw Release Notes*
> > > > > > The raw release notes are available [here](
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > > > > > )
> > > > > >
> > > > > > Thanks,
> > > > > > Gary Li
> > > > > > (on behalf of the Hudi community)
> > > > > >
> > > > >
> > > >
> > >
> > >
> > > --
> > > Regards,
> > > -Sivabalan
> > >
> >
>

Re: Apache Hudi 0.8.0 Released

Posted by Vinoth Chandar <vi...@apache.org>.

Thanks Gary! +1 fantastic job with the release!

Please also announce on Slack (if not done already)

I shared some tweets at https://twitter.com/apachehudi

On Fri, Apr 9, 2021 at 7:44 AM leesf <le...@gmail.com> wrote:

> Thanks gary for driving the release, great job.
>
> Pratyaksh Sharma <pr...@gmail.com> 于2021年4月9日周五 下午10:40写道：
>
> > Great news!
> >
> > On Fri, Apr 9, 2021 at 11:42 AM Sivabalan <n....@gmail.com> wrote:
> >
> > > Awesome! Great job Gary on the release work!
> > >
> > > On Fri, Apr 9, 2021 at 1:59 AM Gary Li <ya...@gmail.com>
> wrote:
> > >
> > > > Thanks Vinoth.
> > > >
> > > > The page for 0.8.0 is ready
> > > > https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
> > > > The release note could be found here
> > > https://hudi.apache.org/releases.html
> > > >
> > > > Best,
> > > > Gary Li
> > > >
> > > > On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <vi...@apache.org>
> > > wrote:
> > > >
> > > > > This is awesome! Thanks for sharing, Gary!
> > > > >
> > > > > Are we waiting for the site to be rendered with 0.8.0 release info
> > and
> > > > > homepage update?
> > > > >
> > > > > On Wed, Apr 7, 2021 at 7:54 AM Gary Li <ya...@gmail.com>
> > > wrote:
> > > > >
> > > > > > Hi All,
> > > > > >
> > > > > > We are excited to share that Apache Hudi 0.8.0 was released.
> Since
> > > the
> > > > > > 0.7.0 release, we resolved 97 JIRA tickets and made 120 code
> > commits.
> > > > We
> > > > > > implemented many new features, bugfix, and performance
> improvement.
> > > > > Thanks
> > > > > > to all the contributors who had made this happened.
> > > > > >
> > > > > > *Release Highlights*
> > > > > >
> > > > > > *Flink Integration*
> > > > > > Since the initial support for the Hudi Flink Writer in the 0.7.0
> > > > release,
> > > > > > the Hudi community made great progress on improving the
> Flink/Hudi
> > > > > > integration, including redesigning the Flink writer pipeline with
> > > > better
> > > > > > performance and scalability, state-backed indexing with bootstrap
> > > > > support,
> > > > > > Flink writer for MOR table, batch reader for COW&MOR table,
> > streaming
> > > > > > reader for MOR table, and Flink SQL connector for both source and
> > > sink.
> > > > > In
> > > > > > the 0.8.0 release, the user is able to use all those features
> with
> > > > Flink
> > > > > > 1.11+.
> > > > > >
> > > > > > Please see [RFC-24](
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > > > > > )
> > > > > > for more implementation details of the Flink writer and follow
> this
> > > > > [page](
> > > > > > https://hudi.apache.org/docs/flink-quick-start-guide.html) to
> get
> > > > > started
> > > > > > with Flink!
> > > > > >
> > > > > > *Parallel Writers Support*
> > > > > > As many users requested, now Hudi supports multiple ingestion
> > writers
> > > > to
> > > > > > the same Hudi Table with optimistic concurrency control. Hudi
> > > supports
> > > > > file
> > > > > > level OCC, i.e., for any 2 commits (or writers) happening to the
> > same
> > > > > > table, if they do not have writes to overlapping files being
> > changed,
> > > > > both
> > > > > > writers are allowed to succeed. This feature is currently
> > > experimental
> > > > > and
> > > > > > requires either Zookeeper or HiveMetastore to acquire locks.
> > > > > >
> > > > > > Please see [RFC-22](
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > > > > > )
> > > > > > for more implementation details and follow this [page](
> > > > > > https://hudi.apache.org/docs/concurrency_control.html) to get
> > > started
> > > > > with
> > > > > > concurrency control!
> > > > > >
> > > > > > *Writer side improvements*
> > > > > > - InsertOverwrite Support for Flink writer client.
> > > > > > - Support CopyOnWriteTable in Java writer client.
> > > > > >
> > > > > > *Query side improvements*
> > > > > > - Support Spark Structured Streaming read from Hudi table.
> > > > > > - Performance improvement of Metadata table.
> > > > > > - Performance improvement of Clustering.
> > > > > >
> > > > > > *Raw Release Notes*
> > > > > > The raw release notes are available [here](
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > > > > > )
> > > > > >
> > > > > > Thanks,
> > > > > > Gary Li
> > > > > > (on behalf of the Hudi community)
> > > > > >
> > > > >
> > > >
> > >
> > >
> > > --
> > > Regards,
> > > -Sivabalan
> > >
> >
>

Re: Apache Hudi 0.8.0 Released

Posted by leesf <le...@gmail.com>.

Thanks gary for driving the release, great job.

Pratyaksh Sharma <pr...@gmail.com> 于2021年4月9日周五 下午10:40写道：

> Great news!
>
> On Fri, Apr 9, 2021 at 11:42 AM Sivabalan <n....@gmail.com> wrote:
>
> > Awesome! Great job Gary on the release work!
> >
> > On Fri, Apr 9, 2021 at 1:59 AM Gary Li <ya...@gmail.com> wrote:
> >
> > > Thanks Vinoth.
> > >
> > > The page for 0.8.0 is ready
> > > https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
> > > The release note could be found here
> > https://hudi.apache.org/releases.html
> > >
> > > Best,
> > > Gary Li
> > >
> > > On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <vi...@apache.org>
> > wrote:
> > >
> > > > This is awesome! Thanks for sharing, Gary!
> > > >
> > > > Are we waiting for the site to be rendered with 0.8.0 release info
> and
> > > > homepage update?
> > > >
> > > > On Wed, Apr 7, 2021 at 7:54 AM Gary Li <ya...@gmail.com>
> > wrote:
> > > >
> > > > > Hi All,
> > > > >
> > > > > We are excited to share that Apache Hudi 0.8.0 was released. Since
> > the
> > > > > 0.7.0 release, we resolved 97 JIRA tickets and made 120 code
> commits.
> > > We
> > > > > implemented many new features, bugfix, and performance improvement.
> > > > Thanks
> > > > > to all the contributors who had made this happened.
> > > > >
> > > > > *Release Highlights*
> > > > >
> > > > > *Flink Integration*
> > > > > Since the initial support for the Hudi Flink Writer in the 0.7.0
> > > release,
> > > > > the Hudi community made great progress on improving the Flink/Hudi
> > > > > integration, including redesigning the Flink writer pipeline with
> > > better
> > > > > performance and scalability, state-backed indexing with bootstrap
> > > > support,
> > > > > Flink writer for MOR table, batch reader for COW&MOR table,
> streaming
> > > > > reader for MOR table, and Flink SQL connector for both source and
> > sink.
> > > > In
> > > > > the 0.8.0 release, the user is able to use all those features with
> > > Flink
> > > > > 1.11+.
> > > > >
> > > > > Please see [RFC-24](
> > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > > > > )
> > > > > for more implementation details of the Flink writer and follow this
> > > > [page](
> > > > > https://hudi.apache.org/docs/flink-quick-start-guide.html) to get
> > > > started
> > > > > with Flink!
> > > > >
> > > > > *Parallel Writers Support*
> > > > > As many users requested, now Hudi supports multiple ingestion
> writers
> > > to
> > > > > the same Hudi Table with optimistic concurrency control. Hudi
> > supports
> > > > file
> > > > > level OCC, i.e., for any 2 commits (or writers) happening to the
> same
> > > > > table, if they do not have writes to overlapping files being
> changed,
> > > > both
> > > > > writers are allowed to succeed. This feature is currently
> > experimental
> > > > and
> > > > > requires either Zookeeper or HiveMetastore to acquire locks.
> > > > >
> > > > > Please see [RFC-22](
> > > > >
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > > > > )
> > > > > for more implementation details and follow this [page](
> > > > > https://hudi.apache.org/docs/concurrency_control.html) to get
> > started
> > > > with
> > > > > concurrency control!
> > > > >
> > > > > *Writer side improvements*
> > > > > - InsertOverwrite Support for Flink writer client.
> > > > > - Support CopyOnWriteTable in Java writer client.
> > > > >
> > > > > *Query side improvements*
> > > > > - Support Spark Structured Streaming read from Hudi table.
> > > > > - Performance improvement of Metadata table.
> > > > > - Performance improvement of Clustering.
> > > > >
> > > > > *Raw Release Notes*
> > > > > The raw release notes are available [here](
> > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > > > > )
> > > > >
> > > > > Thanks,
> > > > > Gary Li
> > > > > (on behalf of the Hudi community)
> > > > >
> > > >
> > >
> >
> >
> > --
> > Regards,
> > -Sivabalan
> >
>

Re: Apache Hudi 0.8.0 Released

Posted by Pratyaksh Sharma <pr...@gmail.com>.

Great news!

On Fri, Apr 9, 2021 at 11:42 AM Sivabalan <n....@gmail.com> wrote:

> Awesome! Great job Gary on the release work!
>
> On Fri, Apr 9, 2021 at 1:59 AM Gary Li <ya...@gmail.com> wrote:
>
> > Thanks Vinoth.
> >
> > The page for 0.8.0 is ready
> > https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
> > The release note could be found here
> https://hudi.apache.org/releases.html
> >
> > Best,
> > Gary Li
> >
> > On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <vi...@apache.org>
> wrote:
> >
> > > This is awesome! Thanks for sharing, Gary!
> > >
> > > Are we waiting for the site to be rendered with 0.8.0 release info and
> > > homepage update?
> > >
> > > On Wed, Apr 7, 2021 at 7:54 AM Gary Li <ya...@gmail.com>
> wrote:
> > >
> > > > Hi All,
> > > >
> > > > We are excited to share that Apache Hudi 0.8.0 was released. Since
> the
> > > > 0.7.0 release, we resolved 97 JIRA tickets and made 120 code commits.
> > We
> > > > implemented many new features, bugfix, and performance improvement.
> > > Thanks
> > > > to all the contributors who had made this happened.
> > > >
> > > > *Release Highlights*
> > > >
> > > > *Flink Integration*
> > > > Since the initial support for the Hudi Flink Writer in the 0.7.0
> > release,
> > > > the Hudi community made great progress on improving the Flink/Hudi
> > > > integration, including redesigning the Flink writer pipeline with
> > better
> > > > performance and scalability, state-backed indexing with bootstrap
> > > support,
> > > > Flink writer for MOR table, batch reader for COW&MOR table, streaming
> > > > reader for MOR table, and Flink SQL connector for both source and
> sink.
> > > In
> > > > the 0.8.0 release, the user is able to use all those features with
> > Flink
> > > > 1.11+.
> > > >
> > > > Please see [RFC-24](
> > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > > > )
> > > > for more implementation details of the Flink writer and follow this
> > > [page](
> > > > https://hudi.apache.org/docs/flink-quick-start-guide.html) to get
> > > started
> > > > with Flink!
> > > >
> > > > *Parallel Writers Support*
> > > > As many users requested, now Hudi supports multiple ingestion writers
> > to
> > > > the same Hudi Table with optimistic concurrency control. Hudi
> supports
> > > file
> > > > level OCC, i.e., for any 2 commits (or writers) happening to the same
> > > > table, if they do not have writes to overlapping files being changed,
> > > both
> > > > writers are allowed to succeed. This feature is currently
> experimental
> > > and
> > > > requires either Zookeeper or HiveMetastore to acquire locks.
> > > >
> > > > Please see [RFC-22](
> > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > > > )
> > > > for more implementation details and follow this [page](
> > > > https://hudi.apache.org/docs/concurrency_control.html) to get
> started
> > > with
> > > > concurrency control!
> > > >
> > > > *Writer side improvements*
> > > > - InsertOverwrite Support for Flink writer client.
> > > > - Support CopyOnWriteTable in Java writer client.
> > > >
> > > > *Query side improvements*
> > > > - Support Spark Structured Streaming read from Hudi table.
> > > > - Performance improvement of Metadata table.
> > > > - Performance improvement of Clustering.
> > > >
> > > > *Raw Release Notes*
> > > > The raw release notes are available [here](
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > > > )
> > > >
> > > > Thanks,
> > > > Gary Li
> > > > (on behalf of the Hudi community)
> > > >
> > >
> >
>
>
> --
> Regards,
> -Sivabalan
>

Re: Apache Hudi 0.8.0 Released

Posted by Sivabalan <n....@gmail.com>.

Awesome! Great job Gary on the release work!

On Fri, Apr 9, 2021 at 1:59 AM Gary Li <ya...@gmail.com> wrote:

> Thanks Vinoth.
>
> The page for 0.8.0 is ready
> https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
> The release note could be found here https://hudi.apache.org/releases.html
>
> Best,
> Gary Li
>
> On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <vi...@apache.org> wrote:
>
> > This is awesome! Thanks for sharing, Gary!
> >
> > Are we waiting for the site to be rendered with 0.8.0 release info and
> > homepage update?
> >
> > On Wed, Apr 7, 2021 at 7:54 AM Gary Li <ya...@gmail.com> wrote:
> >
> > > Hi All,
> > >
> > > We are excited to share that Apache Hudi 0.8.0 was released. Since the
> > > 0.7.0 release, we resolved 97 JIRA tickets and made 120 code commits.
> We
> > > implemented many new features, bugfix, and performance improvement.
> > Thanks
> > > to all the contributors who had made this happened.
> > >
> > > *Release Highlights*
> > >
> > > *Flink Integration*
> > > Since the initial support for the Hudi Flink Writer in the 0.7.0
> release,
> > > the Hudi community made great progress on improving the Flink/Hudi
> > > integration, including redesigning the Flink writer pipeline with
> better
> > > performance and scalability, state-backed indexing with bootstrap
> > support,
> > > Flink writer for MOR table, batch reader for COW&MOR table, streaming
> > > reader for MOR table, and Flink SQL connector for both source and sink.
> > In
> > > the 0.8.0 release, the user is able to use all those features with
> Flink
> > > 1.11+.
> > >
> > > Please see [RFC-24](
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > > )
> > > for more implementation details of the Flink writer and follow this
> > [page](
> > > https://hudi.apache.org/docs/flink-quick-start-guide.html) to get
> > started
> > > with Flink!
> > >
> > > *Parallel Writers Support*
> > > As many users requested, now Hudi supports multiple ingestion writers
> to
> > > the same Hudi Table with optimistic concurrency control. Hudi supports
> > file
> > > level OCC, i.e., for any 2 commits (or writers) happening to the same
> > > table, if they do not have writes to overlapping files being changed,
> > both
> > > writers are allowed to succeed. This feature is currently experimental
> > and
> > > requires either Zookeeper or HiveMetastore to acquire locks.
> > >
> > > Please see [RFC-22](
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > > )
> > > for more implementation details and follow this [page](
> > > https://hudi.apache.org/docs/concurrency_control.html) to get started
> > with
> > > concurrency control!
> > >
> > > *Writer side improvements*
> > > - InsertOverwrite Support for Flink writer client.
> > > - Support CopyOnWriteTable in Java writer client.
> > >
> > > *Query side improvements*
> > > - Support Spark Structured Streaming read from Hudi table.
> > > - Performance improvement of Metadata table.
> > > - Performance improvement of Clustering.
> > >
> > > *Raw Release Notes*
> > > The raw release notes are available [here](
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > > )
> > >
> > > Thanks,
> > > Gary Li
> > > (on behalf of the Hudi community)
> > >
> >
>


-- 
Regards,
-Sivabalan

Re: Apache Hudi 0.8.0 Released

Posted by Gary Li <ya...@gmail.com>.

Thanks Vinoth.

The page for 0.8.0 is ready
https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html.
The release note could be found here https://hudi.apache.org/releases.html

Best,
Gary Li

On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar <vi...@apache.org> wrote:

> This is awesome! Thanks for sharing, Gary!
>
> Are we waiting for the site to be rendered with 0.8.0 release info and
> homepage update?
>
> On Wed, Apr 7, 2021 at 7:54 AM Gary Li <ya...@gmail.com> wrote:
>
> > Hi All,
> >
> > We are excited to share that Apache Hudi 0.8.0 was released. Since the
> > 0.7.0 release, we resolved 97 JIRA tickets and made 120 code commits. We
> > implemented many new features, bugfix, and performance improvement.
> Thanks
> > to all the contributors who had made this happened.
> >
> > *Release Highlights*
> >
> > *Flink Integration*
> > Since the initial support for the Hudi Flink Writer in the 0.7.0 release,
> > the Hudi community made great progress on improving the Flink/Hudi
> > integration, including redesigning the Flink writer pipeline with better
> > performance and scalability, state-backed indexing with bootstrap
> support,
> > Flink writer for MOR table, batch reader for COW&MOR table, streaming
> > reader for MOR table, and Flink SQL connector for both source and sink.
> In
> > the 0.8.0 release, the user is able to use all those features with Flink
> > 1.11+.
> >
> > Please see [RFC-24](
> >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> > )
> > for more implementation details of the Flink writer and follow this
> [page](
> > https://hudi.apache.org/docs/flink-quick-start-guide.html) to get
> started
> > with Flink!
> >
> > *Parallel Writers Support*
> > As many users requested, now Hudi supports multiple ingestion writers to
> > the same Hudi Table with optimistic concurrency control. Hudi supports
> file
> > level OCC, i.e., for any 2 commits (or writers) happening to the same
> > table, if they do not have writes to overlapping files being changed,
> both
> > writers are allowed to succeed. This feature is currently experimental
> and
> > requires either Zookeeper or HiveMetastore to acquire locks.
> >
> > Please see [RFC-22](
> >
> >
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> > )
> > for more implementation details and follow this [page](
> > https://hudi.apache.org/docs/concurrency_control.html) to get started
> with
> > concurrency control!
> >
> > *Writer side improvements*
> > - InsertOverwrite Support for Flink writer client.
> > - Support CopyOnWriteTable in Java writer client.
> >
> > *Query side improvements*
> > - Support Spark Structured Streaming read from Hudi table.
> > - Performance improvement of Metadata table.
> > - Performance improvement of Clustering.
> >
> > *Raw Release Notes*
> > The raw release notes are available [here](
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> > )
> >
> > Thanks,
> > Gary Li
> > (on behalf of the Hudi community)
> >
>

Re: Apache Hudi 0.8.0 Released

Posted by Vinoth Chandar <vi...@apache.org>.

This is awesome! Thanks for sharing, Gary!

Are we waiting for the site to be rendered with 0.8.0 release info and
homepage update?

On Wed, Apr 7, 2021 at 7:54 AM Gary Li <ya...@gmail.com> wrote:

> Hi All,
>
> We are excited to share that Apache Hudi 0.8.0 was released. Since the
> 0.7.0 release, we resolved 97 JIRA tickets and made 120 code commits. We
> implemented many new features, bugfix, and performance improvement. Thanks
> to all the contributors who had made this happened.
>
> *Release Highlights*
>
> *Flink Integration*
> Since the initial support for the Hudi Flink Writer in the 0.7.0 release,
> the Hudi community made great progress on improving the Flink/Hudi
> integration, including redesigning the Flink writer pipeline with better
> performance and scalability, state-backed indexing with bootstrap support,
> Flink writer for MOR table, batch reader for COW&MOR table, streaming
> reader for MOR table, and Flink SQL connector for both source and sink. In
> the 0.8.0 release, the user is able to use all those features with Flink
> 1.11+.
>
> Please see [RFC-24](
>
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal
> )
> for more implementation details of the Flink writer and follow this [page](
> https://hudi.apache.org/docs/flink-quick-start-guide.html) to get started
> with Flink!
>
> *Parallel Writers Support*
> As many users requested, now Hudi supports multiple ingestion writers to
> the same Hudi Table with optimistic concurrency control. Hudi supports file
> level OCC, i.e., for any 2 commits (or writers) happening to the same
> table, if they do not have writes to overlapping files being changed, both
> writers are allowed to succeed. This feature is currently experimental and
> requires either Zookeeper or HiveMetastore to acquire locks.
>
> Please see [RFC-22](
>
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+22+%3A+Snapshot+Isolation+using+Optimistic+Concurrency+Control+for+multi-writers
> )
> for more implementation details and follow this [page](
> https://hudi.apache.org/docs/concurrency_control.html) to get started with
> concurrency control!
>
> *Writer side improvements*
> - InsertOverwrite Support for Flink writer client.
> - Support CopyOnWriteTable in Java writer client.
>
> *Query side improvements*
> - Support Spark Structured Streaming read from Hudi table.
> - Performance improvement of Metadata table.
> - Performance improvement of Clustering.
>
> *Raw Release Notes*
> The raw release notes are available [here](
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12349423
> )
>
> Thanks,
> Gary Li
> (on behalf of the Hudi community)
>