You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Sungwoo Park <gl...@gmail.com> on 2023/12/09 12:08:17 UTC
MR3 1.8 released
MR3 1.8 released
On behalf of the MR3 team, I am pleased to announce the release of MR3 1.8.
MR3 is an execution engine similar in spirit to MapReduce and Tez which has
been under development since 2015. Its main application is Hive on MR3. You
can run Hive on MR3 on Hadoop, on Kubernetes, in standalone mode (which
does not require Hadoop/Kubernetes), or on a local machine. You can also
test Hive on MR3 in a single Docker container.
From MR3 1.8, we assume Java 17 by default. For running Hive on MR3 on
Hadoop, we continue to support Java 8 as well. For Kubernetes and
standalone mode, we release Hive on MR3 built with Java 17 only.
Please see the release notes for changes new in MR3 1.8. A major new
feature is that Hive on MR3 can use Apache Celeborn for remote shuffle
service.
https://mr3docs.datamonad.com/docs/release/
For the performance of Hive on MR3 1.8, please see a blog article "Hive on
MR3 - from Java 8 to Java 17 (and beating Trino)". On the 10TB TPC-DS
benchmark, Hive on MR3 1.8 finishes all the queries faster than Trino 418.
https://www.datamonad.com/post/2023-12-09-hivemr3-java17-1.8/
Thank you,
--- Sungwoo
Re: MR3 1.8 released
Posted by Sungwoo Park <gl...@gmail.com>.
For Chinese users, MR3 1.8 is now shipped in HiDataPlus (along with
Celeborn).
https://mp.weixin.qq.com/s/65bgrnFpXtORlb4FjlPMWA
--- Sungwoo
On Sat, Dec 9, 2023 at 9:08 PM Sungwoo Park <gl...@gmail.com> wrote:
> MR3 1.8 released
>
> On behalf of the MR3 team, I am pleased to announce the release of MR3 1.8.
>
> MR3 is an execution engine similar in spirit to MapReduce and Tez which
> has been under development since 2015. Its main application is Hive on MR3.
> You can run Hive on MR3 on Hadoop, on Kubernetes, in standalone mode (which
> does not require Hadoop/Kubernetes), or on a local machine. You can also
> test Hive on MR3 in a single Docker container.
>
> From MR3 1.8, we assume Java 17 by default. For running Hive on MR3 on
> Hadoop, we continue to support Java 8 as well. For Kubernetes and
> standalone mode, we release Hive on MR3 built with Java 17 only.
>
> Please see the release notes for changes new in MR3 1.8. A major new
> feature is that Hive on MR3 can use Apache Celeborn for remote shuffle
> service.
>
> https://mr3docs.datamonad.com/docs/release/
>
> For the performance of Hive on MR3 1.8, please see a blog article "Hive on
> MR3 - from Java 8 to Java 17 (and beating Trino)". On the 10TB TPC-DS
> benchmark, Hive on MR3 1.8 finishes all the queries faster than Trino 418.
>
> https://www.datamonad.com/post/2023-12-09-hivemr3-java17-1.8/
>
> Thank you,
>
> --- Sungwoo
>