You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by dz...@apache.org on 2023/02/21 11:45:17 UTC

[drill-site] branch master updated: Update docs for Drill 1.21.0.

This is an automated email from the ASF dual-hosted git repository.

dzamo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/drill-site.git


The following commit(s) were added to refs/heads/master by this push:
     new 3f5ac6dbc Update docs for Drill 1.21.0.
3f5ac6dbc is described below

commit 3f5ac6dbc9e6122a646dbda63738b2a6756957ac
Author: James Turton <ja...@somecomputer.xyz>
AuthorDate: Tue Feb 21 13:45:04 2023 +0200

    Update docs for Drill 1.21.0.
---
 _data/version.json                                 |  10 +-
 _docs/en/rn/042-1.21.0-rn.md                       | 130 +++++++++++++++++++++
 blog/_posts/en/2023-02-21-drill-1.21.0-released.md |  23 ++++
 3 files changed, 158 insertions(+), 5 deletions(-)

diff --git a/_data/version.json b/_data/version.json
index abfcf1c80..5e1e85d0a 100644
--- a/_data/version.json
+++ b/_data/version.json
@@ -1,7 +1,7 @@
 {
-  "display_version": "1.20.3",
-  "full_version": "1.20.3",
-  "release_date": "January 07, 2023",
-  "blog_post":"/blog/2023/01/07/drill-1.20.3-released",
-  "release_notes": "/docs/apache-drill-1-20-3-release-notes/"
+  "display_version": "1.21.0",
+  "full_version": "1.21.0",
+  "release_date": "Febrauary 21, 2023",
+  "blog_post":"/blog/2023/02/21/drill-1.21.0-released",
+  "release_notes": "/docs/apache-drill-1-21-0-release-notes/"
 }
diff --git a/_docs/en/rn/042-1.21.0-rn.md b/_docs/en/rn/042-1.21.0-rn.md
new file mode 100644
index 000000000..aadec0f0c
--- /dev/null
+++ b/_docs/en/rn/042-1.21.0-rn.md
@@ -0,0 +1,130 @@
+---
+title: "Apache Drill 1.21.0 Release Notes"
+slug: "Apache Drill 1.21.0 Release Notes"
+parent: "Release Notes"
+---
+
+##Release date:##  Feb 21, 2023
+
+Today, we're happy to announce the availability of Drill 1.21.0. You can download it [here](https://drill.apache.org/download/).
+
+## Sub-task
+* [[DRILL-8198](https://issues.apache.org/jira/browser/DRILL-8198)] - XML EVF2 reader provideSchema usage
+* [[DRILL-8199](https://issues.apache.org/jira/browser/DRILL-8199)] - Convert Excel EVF1 to EVF2
+* [[DRILL-8208](https://issues.apache.org/jira/browser/DRILL-8208)] - Create builder for SqlSelect
+* [[DRILL-8209](https://issues.apache.org/jira/browser/DRILL-8209)] - Introduce rule for converting join with distinct input to semi-join
+* [[DRILL-8210](https://issues.apache.org/jira/browser/DRILL-8210)] - Add substring convertlet
+* [[DRILL-8211](https://issues.apache.org/jira/browser/DRILL-8211)] - Replace deprecated RelNode.getChildExps with Project.getProjects
+* [[DRILL-8212](https://issues.apache.org/jira/browser/DRILL-8212)] - Join queries fail with StackOverflowError
+* [[DRILL-8213](https://issues.apache.org/jira/browser/DRILL-8213)] - Replace deprecated RelNode.getRows with RelNode.estimateRowCount
+* [[DRILL-8214](https://issues.apache.org/jira/browser/DRILL-8214)] - Replace EnumerableTableScan usage with LogicalTableScan
+* [[DRILL-8216](https://issues.apache.org/jira/browser/DRILL-8216)] - Use EVF-based JSON reader for Values operator
+* [[DRILL-8242](https://issues.apache.org/jira/browser/DRILL-8242)] - Fix output for HttpHelperFunctions
+* [[DRILL-8303](https://issues.apache.org/jira/browser/DRILL-8303)] - Add support for inserts into JDBC storage
+
+## Bug
+* [[DRILL-8086](https://issues.apache.org/jira/browser/DRILL-8086)] - Convert the CSV (AKA "compliant text") reader to EVF V2
+* [[DRILL-8181](https://issues.apache.org/jira/browser/DRILL-8181)] - Accept nullable args in HTTP plugin UDFs, fix HikariCP default parm names
+* [[DRILL-8183](https://issues.apache.org/jira/browser/DRILL-8183)] - Respect the ExecConstant.SSL_HANDSHAKE_TIMEOUT option
+* [[DRILL-8244](https://issues.apache.org/jira/browser/DRILL-8244)] - HTTP_Request Not Passing Down Config Variable
+* [[DRILL-8299](https://issues.apache.org/jira/browser/DRILL-8299)] - HashMap key type mismatch in MetadataContext
+* [[DRILL-8320](https://issues.apache.org/jira/browser/DRILL-8320)] - Prevent Infinite Pagination for Index Paginator
+* [[DRILL-8327](https://issues.apache.org/jira/browser/DRILL-8327)] - GoogleSheets not Reporting Schemata to Info_Schema
+* [[DRILL-8349](https://issues.apache.org/jira/browser/DRILL-8349)] - GoogleSheets Not Registering Schemas with Non Default Name
+* [[DRILL-8351](https://issues.apache.org/jira/browser/DRILL-8351)] -  UserRemoteException : 	SYSTEM ERROR: NullPointerException: Schema is currently null.  You must call buildSchema(SelectionVectorMode) before this container can return a schema.
+* [[DRILL-8372](https://issues.apache.org/jira/browser/DRILL-8372)] - Unfreed buffers when running a LIMIT 0 query over delimited text
+* [[DRILL-8392](https://issues.apache.org/jira/browser/DRILL-8392)] - Empty Tables Causes Index Out of Bounds Exception on PDF Reader
+* [[DRILL-8394](https://issues.apache.org/jira/browser/DRILL-8394)] - ANALYZE TABLE ... COMPUTE STATISTICS fails with a trailing slash
+* [[DRILL-8398](https://issues.apache.org/jira/browser/DRILL-8398)] - Fix GitHub Actions to use proper JDK version
+* [[DRILL-8399](https://issues.apache.org/jira/browser/DRILL-8399)] - MS Access Reader Misinterprets Data Types
+* [[DRILL-8400](https://issues.apache.org/jira/browser/DRILL-8400)] - Fix pruning partitions with pushed transitive predicates
+* [[DRILL-8401](https://issues.apache.org/jira/browser/DRILL-8401)] - Skip nested MAP column without children when creating parquet tables
+
+## New Feature
+* [[DRILL-8287](https://issues.apache.org/jira/browser/DRILL-8287)] - Add Support for Keyset Based Pagination
+* [[DRILL-8289](https://issues.apache.org/jira/browser/DRILL-8289)] - Add Threat Hunting Functions
+
+## Improvement
+* [[DRILL-8117](https://issues.apache.org/jira/browser/DRILL-8117)] - Upgrade unit tests to the cluster fixture framework
+* [[DRILL-8132](https://issues.apache.org/jira/browser/DRILL-8132)] - Improvement of RPC
+* [[DRILL-8136](https://issues.apache.org/jira/browser/DRILL-8136)] - Overhaul implict type casting logic
+* [[DRILL-8140](https://issues.apache.org/jira/browser/DRILL-8140)] - Add JSON Post Body to HTTP Rest Storage Plugin
+* [[DRILL-8149](https://issues.apache.org/jira/browser/DRILL-8149)] - format-excel plugin needs to support POI IOUtils byte array overrides to support big files
+* [[DRILL-8153](https://issues.apache.org/jira/browser/DRILL-8153)] - Convert OAuth REST APIs to JSON
+* [[DRILL-8155](https://issues.apache.org/jira/browser/DRILL-8155)] - Introduce new plugin authentication modes
+* [[DRILL-8161](https://issues.apache.org/jira/browser/DRILL-8161)] - Add Global Credentials to HTTP Storage Plugin
+* [[DRILL-8162](https://issues.apache.org/jira/browser/DRILL-8162)] - Add OpenAPI Specification documentation for Drill's REST API
+* [[DRILL-8167](https://issues.apache.org/jira/browser/DRILL-8167)] - Add JSON Config Options to Format Config
+* [[DRILL-8169](https://issues.apache.org/jira/browser/DRILL-8169)] - Add UDFs to HTTP Plugin to Facilitate Joins
+* [[DRILL-8171](https://issues.apache.org/jira/browser/DRILL-8171)] - Convert SequenceFile to EVF2
+* [[DRILL-8174](https://issues.apache.org/jira/browser/DRILL-8174)] - Convert Avro format to EVF2
+* [[DRILL-8177](https://issues.apache.org/jira/browser/DRILL-8177)] - Bump default TLS version to 1.3
+* [[DRILL-8179](https://issues.apache.org/jira/browser/DRILL-8179)] - Convert LTSV Format Plugin to EVF2
+* [[DRILL-8186](https://issues.apache.org/jira/browser/DRILL-8186)] - Convert XML format to EVF2
+* [[DRILL-8202](https://issues.apache.org/jira/browser/DRILL-8202)] - Add Options to Skip Malformed JSON Records to HTTP Plugin
+* [[DRILL-8204](https://issues.apache.org/jira/browser/DRILL-8204)] - Allow Provided Schema for HTTP Plugin in JSON Mode
+* [[DRILL-8220](https://issues.apache.org/jira/browser/DRILL-8220)] - Add User Translation Support for OAuth Enabled Plugins
+* [[DRILL-8223](https://issues.apache.org/jira/browser/DRILL-8223)] - Refactor auth modes dropping DRILL_PROCESS and allowing credential providers everywhere
+* [[DRILL-8225](https://issues.apache.org/jira/browser/DRILL-8225)] - Update LogParser and Yauaa dependencies
+* [[DRILL-8229](https://issues.apache.org/jira/browser/DRILL-8229)] -  Add Parameter to Skip Malformed Records to HTTP UDF
+* [[DRILL-8232](https://issues.apache.org/jira/browser/DRILL-8232)] - Add support for user credentials to VaultCredentialsProvider
+* [[DRILL-8235](https://issues.apache.org/jira/browser/DRILL-8235)] - Add Storage Plugin for Google Sheets
+* [[DRILL-8236](https://issues.apache.org/jira/browser/DRILL-8236)] - Move HttpHelperFunctions to use JSON2 reader
+* [[DRILL-8243](https://issues.apache.org/jira/browser/DRILL-8243)] - Move JSON Config Options Out of HTTP Plugin
+* [[DRILL-8261](https://issues.apache.org/jira/browser/DRILL-8261)] - Make the XML format plugin's attributes MAP an implicit column
+* [[DRILL-8269](https://issues.apache.org/jira/browser/DRILL-8269)] - Classified metrics for easier maintenance
+* [[DRILL-8277](https://issues.apache.org/jira/browser/DRILL-8277)] - Publish SNAPSHOT artifacts to the Apache snapshots repo from CI
+* [[DRILL-8290](https://issues.apache.org/jira/browser/DRILL-8290)] - Early exit from recursive file listing for LIMIT 0 queries
+* [[DRILL-8301](https://issues.apache.org/jira/browser/DRILL-8301)] - Standardise on UTF-8 encoding for char to byte (and vice versa) conversions
+* [[DRILL-8302](https://issues.apache.org/jira/browser/DRILL-8302)] - tidy up some char conversions
+* [[DRILL-8305](https://issues.apache.org/jira/browser/DRILL-8305)] - Add Implicit Fields to Google Sheets Reader
+* [[DRILL-8309](https://issues.apache.org/jira/browser/DRILL-8309)] - Upgrade slf4j to 2.0.x
+* [[DRILL-8310](https://issues.apache.org/jira/browser/DRILL-8310)] - Convert Syslog Format to EVF V2
+* [[DRILL-8311](https://issues.apache.org/jira/browser/DRILL-8311)] - Convert SPSS Format Plugin to EVF V2
+* [[DRILL-8314](https://issues.apache.org/jira/browser/DRILL-8314)] - Add support for automatically retrying and disabling broken storage plugins
+* [[DRILL-8315](https://issues.apache.org/jira/browser/DRILL-8315)] - Convert SAS Format Plugin to EVF V2
+* [[DRILL-8322](https://issues.apache.org/jira/browser/DRILL-8322)] - Add a list of scanned plugin names to the query profile
+* [[DRILL-8335](https://issues.apache.org/jira/browser/DRILL-8335)] - Add Ability to Query GoogleSheets Tabs by Index
+* [[DRILL-8340](https://issues.apache.org/jira/browser/DRILL-8340)] - Add Additional Date Manipulation Functions (Part 1)
+* [[DRILL-8341](https://issues.apache.org/jira/browser/DRILL-8341)] - Add Scanned Plugin List to Sys Profiles Table
+* [[DRILL-8342](https://issues.apache.org/jira/browser/DRILL-8342)] - Add Automatic Retry for Rate Limited APIs
+* [[DRILL-8354](https://issues.apache.org/jira/browser/DRILL-8354)] - Add IS_EMPTY Function.
+* [[DRILL-8356](https://issues.apache.org/jira/browser/DRILL-8356)] - Add File Name to GoogleSheets Plugin
+* [[DRILL-8357](https://issues.apache.org/jira/browser/DRILL-8357)] - Add new config options to the Splunk storage plugin
+* [[DRILL-8358](https://issues.apache.org/jira/browser/DRILL-8358)] - Storage plugin for querying other Apache Drill clusters
+* [[DRILL-8359](https://issues.apache.org/jira/browser/DRILL-8359)] - Add mount and unmount command support to the filesystem plugin
+* [[DRILL-8360](https://issues.apache.org/jira/browser/DRILL-8360)] - Add Provided Schema for XML Reader
+* [[DRILL-8364](https://issues.apache.org/jira/browser/DRILL-8364)] - Add Support for OAuth Enabled File Systems
+* [[DRILL-8368](https://issues.apache.org/jira/browser/DRILL-8368)] - Update Yauaa to 7.9.0
+* [[DRILL-8370](https://issues.apache.org/jira/browser/DRILL-8370)] - Upgrade splunk-sdk-java to 1.9.3
+* [[DRILL-8371](https://issues.apache.org/jira/browser/DRILL-8371)] - Add Write/Append Capability to Splunk Plugin
+* [[DRILL-8376](https://issues.apache.org/jira/browser/DRILL-8376)] - Add Distribution UDFs
+* [[DRILL-8378](https://issues.apache.org/jira/browser/DRILL-8378)] - Support doing Maven releases using modern JDKs
+* [[DRILL-8381](https://issues.apache.org/jira/browser/DRILL-8381)] - Add support for filtered aggregate calls
+* [[DRILL-8384](https://issues.apache.org/jira/browser/DRILL-8384)] - Add Format Plugin for Microsoft Access
+* [[DRILL-8386](https://issues.apache.org/jira/browser/DRILL-8386)] - Add Support for User Translation for Cassandra
+* [[DRILL-8387](https://issues.apache.org/jira/browser/DRILL-8387)] - Add Support for User Translation to ElasticSearch Plugin
+* [[DRILL-8390](https://issues.apache.org/jira/browser/DRILL-8390)] - Minor Improvements to PDF Reader
+* [[DRILL-8391](https://issues.apache.org/jira/browser/DRILL-8391)] - Set autocomplete="off" on the password field of web UI login forms
+* [[DRILL-8395](https://issues.apache.org/jira/browser/DRILL-8395)] - Add Support for INSERT and Drop Table to GoogleSheets Plugin
+
+
+## Wish
+* [[DRILL-8035](https://issues.apache.org/jira/browser/DRILL-8035)] - Update Janino to 3.1.7 version
+* [[DRILL-8163](https://issues.apache.org/jira/browser/DRILL-8163)] - Increment the Drill version number to 2.0.0-SNAPSHOT
+
+## Task
+* [[DRILL-6076](https://issues.apache.org/jira/browser/DRILL-6076)] - Reduce the default memory from a total of 13GB to 5GB
+* [[DRILL-8270](https://issues.apache.org/jira/browser/DRILL-8270)] - Delete obsolete zookeeper patch (tech debt)
+* [[DRILL-8271](https://issues.apache.org/jira/browser/DRILL-8271)] - Make Storage and Format Config Case Insensitive
+* [[DRILL-8276](https://issues.apache.org/jira/browser/DRILL-8276)] - Add Support for User Translation for Splunk
+* [[DRILL-8304](https://issues.apache.org/jira/browser/DRILL-8304)] - Update Calcite to 1.32
+* [[DRILL-8317](https://issues.apache.org/jira/browser/DRILL-8317)] - Convert LogRegex Format Plugin to EVF V2
+* [[DRILL-8325](https://issues.apache.org/jira/browser/DRILL-8325)] - Convert PDF Format Plugin to EVF V2
+* [[DRILL-8330](https://issues.apache.org/jira/browser/DRILL-8330)] - Convert ESRI Shape File Reader to EVF2
+* [[DRILL-8350](https://issues.apache.org/jira/browser/DRILL-8350)] - Convert PCAP Format Plugin to EVF2
+* [[DRILL-8362](https://issues.apache.org/jira/browser/DRILL-8362)] - upgrade excel-streaming-reader v4.0.5
+* [[DRILL-8363](https://issues.apache.org/jira/browser/DRILL-8363)] - upgrade postgresql to 42.4.3 due to security issue
+* [[DRILL-8379](https://issues.apache.org/jira/browser/DRILL-8379)] - Update Calcite to 1.33.0
+* [[DRILL-8396](https://issues.apache.org/jira/browser/DRILL-8396)] - Update checkstyle version
+
diff --git a/blog/_posts/en/2023-02-21-drill-1.21.0-released.md b/blog/_posts/en/2023-02-21-drill-1.21.0-released.md
new file mode 100644
index 000000000..54a619092
--- /dev/null
+++ b/blog/_posts/en/2023-02-21-drill-1.21.0-released.md
@@ -0,0 +1,23 @@
+---
+layout: post
+title: "Drill 1.21.0 Released"
+code: drill-1.21.0-released
+excerpt: Apache Drill 1.21.0 has been released.
+
+authors: ["jturton"]
+---
+
+Today, we're happy to announce the availability of Drill 1.21.0. You can download it [here](https://drill.apache.org/download/).
+
+## This release provides the following new features:
+
+* A major upgrade of the parsing and planning library Calcite from 1.21 to 1.33 enabled by the elimination of Drill's fork of Calcite.
+* Upgrades of most format plugins to the internal EVF2 reader framework included support for provided schemas.
+* A new native Drill storage plugin enabling "Drill-on-Drill" federated deployments.
+* INSERT support, currently in the JDBC, Splunk and Google Sheets plugins.
+* New SQL syntax including filtered aggregates, PIVOT, UNPIVOT, INTERSECT and EXCEPT.
+* Support for new authentication modes in storage plugins including user translation for using different external credentials for different Drill users.
+* An overhaul of the implicit type casting logic for a more consistent user experience.
+* New functions and storage plugins including Delta Lake, Google Sheets, MS Access, threat hunting functions and statistical distribution functions.
+
+You can find a complete list of improvements and JIRAs resolved in the 1.21.0 release [here]({{site.baseurl}}/docs/apache-drill-1-21-0-release-notes/).