You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@trafodion.apache.org by db...@apache.org on 2017/12/23 04:33:45 UTC
[1/3] incubator-trafodion git commit: Correct the syntax descriptions
of LOAD Statement for *Trafodion Reference Manual* 2
Repository: incubator-trafodion
Updated Branches:
refs/heads/master a434be0ac -> d54589fd0
Correct the syntax descriptions of LOAD Statement for *Trafodion Reference Manual* 2
Project: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/commit/30f3ea9a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/tree/30f3ea9a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/diff/30f3ea9a
Branch: refs/heads/master
Commit: 30f3ea9a2b3ed6bd52e83227911b46b17dd9c99b
Parents: c0583c9
Author: liu.yu <yu...@esgyn.cn>
Authored: Tue Dec 19 15:42:53 2017 +0800
Committer: liu.yu <yu...@esgyn.cn>
Committed: Tue Dec 19 15:42:53 2017 +0800
----------------------------------------------------------------------
.../src/asciidoc/_chapters/sql_utilities.adoc | 31 +++++++++++++++-----
1 file changed, 23 insertions(+), 8 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/30f3ea9a/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc
----------------------------------------------------------------------
diff --git a/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc b/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc
index 50b080d..ceb0f06 100644
--- a/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc
+++ b/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc
@@ -443,24 +443,39 @@ specify one or more of these options:
** `CONTINUE ON ERROR`
+
-LOAD statement will continue after errors encountered while scanning rows from source table.
+LOAD statement will continue after ignorable errors while scanning rows from source table or loading into the target table. The ignorable errors are usually data conversion errors.
+
Errors during the load or sort phase will cause the LOAD statement to abort.
+
-Error rows will be logged by default in HDFS files in the directory `/user/trafodion/bulkload/logs`. The default name of the error files will be of the form `ERR_<three-part-target-table-name>_<date>_<id>`, where `<id>` is a numeric identifier unique to the process where the error was seen.
-+
-This option is implied if `LOG ERROR ROWS [TO _error-location-name_]` or `STOP AFTER _num_ ERROR ROWS` is specified and it is not enabled by default.
+This option is implied if `LOG ERROR ROWS [TO _error-location-name_]` or `STOP AFTER _num_ ERROR ROWS` is specified.
** `LOG ERROR ROWS [TO _error-location-name_]`
+*** Error rows
+
If error rows must be written to a specified location, then specify TO _error-location-name_, otherwise they will be written to the default location.
+`_error-location-name_` must be a HDFS directory name to which trafodion has write access.
+
-Error logs are written in separate files by the processes involved in the load command under sub-directory representing the load command in the given location.
-The actual log file location is displayed in the load command output.
+Error rows will be logged in HDFS files in the *directory* `/user/trafodion/bulkload/logs` if the error log location is not specified.
++
+The default name of the *subdirectory* is `_ERR_catalog.schema.target_table_date_id_`, where `_id_` is a numeric identifier timestamp (YYYYMMDD_HHMMSS) unique to the process where the error was seen.
++
+The default name of the *error file* is `_loggingFileNamePrefix_catalog.schema.target_table_instanceID_`, where `_loggingFileNamePrefix_` is hive_scan_err or traf_upsert_err depending on the data source table, and `_instanceID_` is the ID of instance starting from 0, generally there is only one instance.
++
+For example, the full path of the table test_load_log is `/user/trafodion/bulkload/logs/test/ERR_TRAFODION.SEABASE.TEST_LOAD_LOG_20171218_035918/traf_upsert_err_TRAFODION.SEABASE.TEST_LOAD_LOG_0`,
++
+where:
++
+1. `/user/trafodion/bulkload/logs/test` is the default name of *directory*.
++
+2. `ERR_TRAFODION.SEABASE.TEST_LOAD_LOG_20171218_035918` is the default name of *subdirectory*.
++
+3. `traf_upsert_err_TRAFODION.SEABASE.TEST_LOAD_LOG_0` is the default name of *error file*.
-*** `_error-location-name_`
+*** Error logs
++
+Error logs are written in separate files by the processes involved in the load command under sub-directory representing the load command in the given location.
+
-must be a HDFS directory name to which trafodion has write access.
+The actual log file location is displayed in the load command output. It is recommended that use the same location for load as it’s easier to find the error logs.
** `STOP AFTER _num_ ERROR ROWS`
+
[3/3] incubator-trafodion git commit: Merge [TRAFODION-2855] PR 1356
Correct LOAD syntax in Trafodion SQL Manual
Posted by db...@apache.org.
Merge [TRAFODION-2855] PR 1356 Correct LOAD syntax in Trafodion SQL Manual
Project: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/commit/d54589fd
Tree: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/tree/d54589fd
Diff: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/diff/d54589fd
Branch: refs/heads/master
Commit: d54589fd015b584ad9da1225a3e12c213aea5cbf
Parents: a434be0 c8080f4
Author: Dave Birdsall <db...@apache.org>
Authored: Sat Dec 23 04:32:54 2017 +0000
Committer: Dave Birdsall <db...@apache.org>
Committed: Sat Dec 23 04:32:54 2017 +0000
----------------------------------------------------------------------
.../src/asciidoc/_chapters/sql_utilities.adoc | 31 +++++++++++++++-----
1 file changed, 23 insertions(+), 8 deletions(-)
----------------------------------------------------------------------
[2/3] incubator-trafodion git commit: Incorporate Comments 1
Posted by db...@apache.org.
Incorporate Comments 1
Project: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/commit/c8080f4e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/tree/c8080f4e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/diff/c8080f4e
Branch: refs/heads/master
Commit: c8080f4ead35042f7d3fe5ec9e3edb125ce2c587
Parents: 30f3ea9
Author: liu.yu <yu...@esgyn.cn>
Authored: Thu Dec 21 14:53:48 2017 +0800
Committer: liu.yu <yu...@esgyn.cn>
Committed: Thu Dec 21 14:53:48 2017 +0800
----------------------------------------------------------------------
docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/c8080f4e/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc
----------------------------------------------------------------------
diff --git a/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc b/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc
index ceb0f06..c0e6b5a 100644
--- a/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc
+++ b/docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc
@@ -459,7 +459,7 @@ Error rows will be logged in HDFS files in the *directory* `/user/trafodion/bulk
+
The default name of the *subdirectory* is `_ERR_catalog.schema.target_table_date_id_`, where `_id_` is a numeric identifier timestamp (YYYYMMDD_HHMMSS) unique to the process where the error was seen.
+
-The default name of the *error file* is `_loggingFileNamePrefix_catalog.schema.target_table_instanceID_`, where `_loggingFileNamePrefix_` is hive_scan_err or traf_upsert_err depending on the data source table, and `_instanceID_` is the ID of instance starting from 0, generally there is only one instance.
+The default name of the *error file* is `_loggingFileNamePrefix_catalog.schema.target_table_instanceID_`, where `_loggingFileNamePrefix_` is hive_scan_err or traf_upsert_err depending on the data source table, and `_instanceID_` is the instance ID starting from 0, generally there is only one instance.
+
For example, the full path of the table test_load_log is `/user/trafodion/bulkload/logs/test/ERR_TRAFODION.SEABASE.TEST_LOAD_LOG_20171218_035918/traf_upsert_err_TRAFODION.SEABASE.TEST_LOAD_LOG_0`,
+
@@ -475,7 +475,7 @@ where:
+
Error logs are written in separate files by the processes involved in the load command under sub-directory representing the load command in the given location.
+
-The actual log file location is displayed in the load command output. It is recommended that use the same location for load as it’s easier to find the error logs.
+The actual log file location is displayed in the load command output. It is recommended that you use the same location for load as it’s easier to find the error logs.
** `STOP AFTER _num_ ERROR ROWS`
+