You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by sc...@apache.org on 2019/02/02 18:10:03 UTC

[beam] branch release-2.10.0 updated: [BEAM-6574] Inline description of CSV formats

This is an automated email from the ASF dual-hosted git repository.

scott pushed a commit to branch release-2.10.0
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/release-2.10.0 by this push:
     new b73e12d  [BEAM-6574] Inline description of CSV formats
     new e682cae  Merge pull request #7713: [BEAM-6574] Cherrypick #7697 to release-2.10.0, fixes website precommit
b73e12d is described below

commit b73e12d36271d263535e8b3723c6e5197b7c7049
Author: Kenneth Knowles <ke...@apache.org>
AuthorDate: Thu Jan 31 16:49:19 2019 -0800

    [BEAM-6574] Inline description of CSV formats
---
 .../src/documentation/dsls/sql/create-external-table.md   | 15 +++++++++++++--
 1 file changed, 13 insertions(+), 2 deletions(-)

diff --git a/website/src/documentation/dsls/sql/create-external-table.md b/website/src/documentation/dsls/sql/create-external-table.md
index a6f6e32..f332880 100644
--- a/website/src/documentation/dsls/sql/create-external-table.md
+++ b/website/src/documentation/dsls/sql/create-external-table.md
@@ -323,8 +323,19 @@ TBLPROPERTIES '{"format: "Excel"}'
 
 *   `LOCATION`: The path to the file for Read Mode. The prefix for Write Mode.
 *   `TBLPROPERTIES`:
-    *   `format`: Optional. Allows you to specify the
-        [CSVFormat](https://commons.apache.org/proper/commons-csv/archives/1.5/apidocs/org/apache/commons/csv/CSVFormat.Predefined.html).
+    *   `format`: Optional. Allows you to specify the CSV Format, which controls
+        the field delimeter, quote character, record separator, and other properties.
+        See the following table:
+
+
+| Value for `format` | Field delimiter | Quote | Record separator | Ignore empty lines? | Allow missing column names? |
+|--------------------|-----------------|-------|------------------|---------------------|-----------------------------|
+| `default`          | `,`             | `"`   | `\r\n`           | Yes                 | No                          |
+| `rfc4180`          | `,`             | `"`   | `\r\n`           | No                  | No                          |
+| `excel`            | `,`             | `"`   | `\r\n`           | No                  | Yes                         |
+| `tdf`              | `\t`            | `"`   | `\r\n`           | Yes                 | No                          |
+| `mysql`            | `\t`            | none  | `\n`             | No                  | No                          |
+{:.table-bordered}
 
 ### Read Mode