Draft ASF board report for November

[Matei Zaharia <ma...@gmail.com>]

Hi all,

It’s time to send in our quarterly ASF board report on Nov 11, so I wanted to include anything notable going on that we want to appear in the board archive. Here is my draft; let me know if you have suggested changes.

===============================================

Apache Spark is a fast and general engine for large-scale data processing. It offers high-level APIs in Java, Scala, Python, R and SQL as well as a rich set of libraries including stream processing, machine learning, and graph analytics.

Project status:

- We releases Apache Spark 3.0.1 on September 8th and Spark 2.4.7 on September 12th as maintenance releases with bug fixes to these two branches.

- The community is working on a number of new features in the Spark 3.x branch, including improved data catalog APIs, a push-based shuffle implementation, and better error messages to make Spark applications easier to debug. The largest changes have are being discussed as SPIPs on our mailing list.

Trademarks:

- One of the two software projects we reached out to July to change its name due to a trademark issue has changed it. We are still waiting for a reply from the other one, but it may be that development there has stopped.

Latest releases:

- Spark 2.4.7 was released on September 12th, 2020.
- Spark 3.0.1 was released on September 8th, 2020.
- Spark 3.0.0 was released on June 18th, 2020.

Committers and PMC:

- The latest committers were added on July 14th, 2020 (Huaxin Gao, Jungtaek Lim and Dilip Biswal).
- The latest PMC member was added on Sept 4th, 2019 (Dongjoon Hyun). The PMC has been discussing some new candidates to add as PMC members.
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org