You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafu.apache.org by ey...@apache.org on 2024/01/16 19:58:07 UTC
svn commit: r1915276 - in /datafu/site/blog/2024: ./ 01/ 01/16/ 01/16/datafu-2-0-0-released.html
Author: eyal
Date: Tue Jan 16 19:58:07 2024
New Revision: 1915276
URL: http://svn.apache.org/viewvc?rev=1915276&view=rev
Log:
Add 2.0.0 release blog
Added:
datafu/site/blog/2024/
datafu/site/blog/2024/01/
datafu/site/blog/2024/01/16/
datafu/site/blog/2024/01/16/datafu-2-0-0-released.html
Added: datafu/site/blog/2024/01/16/datafu-2-0-0-released.html
URL: http://svn.apache.org/viewvc/datafu/site/blog/2024/01/16/datafu-2-0-0-released.html?rev=1915276&view=auto
==============================================================================
--- datafu/site/blog/2024/01/16/datafu-2-0-0-released.html (added)
+++ datafu/site/blog/2024/01/16/datafu-2-0-0-released.html Tue Jan 16 19:58:07 2024
@@ -0,0 +1,121 @@
+
+
+
+<!doctype html>
+<html>
+ <head>
+ <meta charset="utf-8">
+
+ <!-- Always force latest IE rendering engine or request Chrome Frame -->
+ <meta content="IE=edge,chrome=1" http-equiv="X-UA-Compatible">
+ <meta name="google-site-verification" content="9N7qTOUYyX4kYfXYc0OIomWJku3PVvGrf6oTNWg2CHI" />
+
+ <meta name="twitter:card" content="summary" />
+ <meta name="twitter:site" content="@apachedatafu" />
+ <meta name="twitter:title" content="Apache DataFu-Spark 2.0.0 Released" />
+ <meta name="twitter:description" content="I'd like to announce the release of Apache DataFu-Spark 2.0.0. This version is the first to support Spark 3.x. In this release, Spark versions 3.0.0 to 3.1.3 are supported. The four classes in SparkUDAFs - MultiSet, MultiArraySet, MapMerge and CountDistinctUpTo..." />
+ <meta property="og:url" content="http://datafu.apache.org/blog/2024/01/16/datafu-2-0-0-released.html" />
+ <meta property="og:type" content="article" />
+ <meta property="og:title" content="Apache DataFu-Spark 2.0.0 Released" />
+ <meta property="og:description" content="I'd like to announce the release of Apache DataFu-Spark 2.0.0. This version is the first to support Spark 3.x. In this release, Spark versions 3.0.0 to 3.1.3 are supported. The four classes in SparkUDAFs - MultiSet, MultiArraySet, MapMerge and CountDistinctUpTo..." />
+
+
+ <!-- Use title if it's in the page YAML frontmatter -->
+ <title>Apache DataFu-Spark 2.0.0 Released</title>
+
+ <link href="/stylesheets/all.css" rel="stylesheet" /><link href="/stylesheets/highlight.css" rel="stylesheet" />
+ <script src="/javascripts/all.js"></script>
+
+ <script type="text/javascript">
+ var _gaq = _gaq || [];
+ _gaq.push(['_setAccount', 'UA-30533336-2']);
+ _gaq.push(['_trackPageview']);
+
+ (function() {
+ var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
+ ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
+ var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+ })();
+ </script>
+ </head>
+
+ <body class="blog blog_2024 blog_2024_01 blog_2024_01_16 blog_2024_01_16_datafu-2-0-0-released">
+
+ <div class="container">
+
+
+<div class="header">
+
+ <ul class="nav nav-pills pull-right">
+ <li><a href="/blog">Blog</a></li>
+ </ul>
+
+ <h3 class="header-title"><a href="/">Apache DataFu™</a></h3>
+
+</div>
+
+
+ <div class="row">
+ <article class="col-lg-10">
+ <h1>Apache DataFu-Spark 2.0.0 Released</h1>
+ <h5 class="text-muted"><time>Jan 16, 2024</time></h5>
+ <h5 class="text-muted">Eyal Allweil</h5>
+
+ <hr>
+
+ <p>I'd like to announce the release of Apache DataFu-Spark 2.0.0.</p>
+
+<p>This version is the first to support Spark 3.x. In this release, Spark versions 3.0.0 to 3.1.3 are supported.</p>
+
+<p>The four classes in SparkUDAFs - MultiSet, MultiArraySet, MapMerge and CountDistinctUpTo are deprecated. Instead of them, there are new versions which use the Spark Aggregator API. The deprecated versions will be removed in DataFu 2.1.0.</p>
+
+<p><br></p>
+
+<p><strong>Improvements</strong></p>
+
+<ul>
+<li>Spark 3.0.0 - 3.1.3 supported (DATAFU-169)</li>
+<li>New Aggregators replace deprecated UserDefinedAggregateFunction (DATAFU-173)</li>
+</ul>
+
+<p><strong>Breaking changes</strong></p>
+
+<ul>
+<li>Spark 2.x no longer supported</li>
+</ul>
+
+<p><br></p>
+
+<p>The source release can be obtained from:</p>
+
+<p><a href="http://www.apache.org/dyn/closer.cgi/datafu/apache-datafu-2.0.0/apache-datafu-sources-2.0.0.tgz">http://www.apache.org/dyn/closer.cgi/datafu/apache-datafu-2.0.0/apache-datafu-sources-2.0.0.tgz</a></p>
+
+<p>Artifacts for DataFu are published in Apache's Maven Repository:</p>
+
+<p><a href="https://repository.apache.org/content/groups/public/org/apache/datafu/">https://repository.apache.org/content/groups/public/org/apache/datafu/</a></p>
+
+<p>Please visit the <a href="/docs/download.html">Download</a> page for instructions on building from source or retrieving the artifacts in your build system.</p>
+
+
+ </article>
+</div>
+
+
+
+<div class="footer">
+
+<div class="feather">
+<a href="http://www.apache.org/" target="_blank"><img src="/images/feather.png" alt="Apache Feather" title="Apache Feather"/></a>
+</div>
+
+<div class="copyright">
+ Copyright © 2011-2024 The Apache Software Foundation, Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.<br>
+ Apache DataFu, DataFu, Apache Pig, Apache Hadoop, Hadoop, Apache, and the Apache feather logo are either registered trademarks or trademarks of the <a href="http://www.apache.org/">Apache Software Foundation</a> in the United States and other countries.
+</div>
+</div>
+
+
+ </div>
+
+ </body>
+</html>
\ No newline at end of file