You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@carbondata.apache.org by ch...@apache.org on 2017/09/04 07:16:26 UTC
[4/4] carbondata-site git commit: Fixed level heading size issue
Fixed level heading size issue
Project: http://git-wip-us.apache.org/repos/asf/carbondata-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/carbondata-site/commit/7e121667
Tree: http://git-wip-us.apache.org/repos/asf/carbondata-site/tree/7e121667
Diff: http://git-wip-us.apache.org/repos/asf/carbondata-site/diff/7e121667
Branch: refs/heads/asf-site
Commit: 7e121667b04cbe46ffdd9ced7486722162789bd0
Parents: e0d368c
Author: chenliang613 <ch...@apache.org>
Authored: Mon Sep 4 15:16:08 2017 +0800
Committer: chenliang613 <ch...@apache.org>
Committed: Mon Sep 4 15:16:08 2017 +0800
----------------------------------------------------------------------
content/configuration-parameters.html | 12 +++++++++
content/css/style.css | 4 +++
content/ddl-operation-on-carbondata.html | 35 ++++++++++++++++++--------
content/dml-operation-on-carbondata.html | 8 +++---
content/installation-guide.html | 2 +-
content/pdf/maven-pdf-plugin.pdf | Bin 233933 -> 235237 bytes
content/quick-start-guide.html | 7 +++---
7 files changed, 49 insertions(+), 19 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/7e121667/content/configuration-parameters.html
----------------------------------------------------------------------
diff --git a/content/configuration-parameters.html b/content/configuration-parameters.html
index d3c96ea..c21d61a 100644
--- a/content/configuration-parameters.html
+++ b/content/configuration-parameters.html
@@ -316,6 +316,12 @@
<td>Specifies the HDFS path where bad records are stored. By default the value is Null. This path must to be configured by the user if bad record logger is enabled or bad record action redirect.</td>
<td></td>
</tr>
+<tr>
+<td>carbon.enable.vector.reader</td>
+<td>true</td>
+<td>This parameter increases the performance of select queries as it fetch columnar batch of size 4*1024 rows instead of fetching data row by row.</td>
+<td></td>
+</tr>
</tbody>
</table>
<ul>
@@ -367,6 +373,12 @@
<td>This property specifies the threshold limit on number of DELETE delta files within a block of a segment. In case the number of delta files goes beyond the threshold, the DELETE delta files for the particular block of the segment becomes eligible for horizontal compaction and compacted into single DELETE delta file.</td>
<td>Values between 1 to 10000.</td>
</tr>
+<tr>
+<td>carbon.update.segment.parallelism</td>
+<td>1</td>
+<td>This property specifies the parallelism for each segment during update. If there are segments that contain too many records to update and the spark job encounter data-spill related errors, it is better to increase this property value. It is recommended to set this value to a multiple of the number of executors for balance.</td>
+<td>Values between 1 to 1000.</td>
+</tr>
</tbody>
</table>
<ul>
http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/7e121667/content/css/style.css
----------------------------------------------------------------------
diff --git a/content/css/style.css b/content/css/style.css
index eb408b8..79bd185 100644
--- a/content/css/style.css
+++ b/content/css/style.css
@@ -1229,6 +1229,10 @@ box-shadow: 0 3px 2px #aaa }
border-bottom: 1px solid #eaecef;
}
+#viewpage h3 {font-size: 1.25em;}
+#viewpage h4 {font-size: 1.125em;}
+#viewpage h5 {font-size: 1em;}
+#viewpage h6 {font-size: .9em;}
#viewpage pre {
padding: 16px;
http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/7e121667/content/ddl-operation-on-carbondata.html
----------------------------------------------------------------------
diff --git a/content/ddl-operation-on-carbondata.html b/content/ddl-operation-on-carbondata.html
index 19cb64d..8f82fbf 100644
--- a/content/ddl-operation-on-carbondata.html
+++ b/content/ddl-operation-on-carbondata.html
@@ -210,27 +210,27 @@
<tr>
<td>db_name</td>
<td>Name of the database. Database name should consist of alphanumeric characters and underscore(_) special character.</td>
-<td>Yes</td>
+<td>YES</td>
</tr>
<tr>
<td>field_list</td>
<td>Comma separated List of fields with data type. The field names should consist of alphanumeric characters and underscore(_) special character.</td>
-<td>No</td>
+<td>NO</td>
</tr>
<tr>
<td>table_name</td>
-<td>The name of the table in Database. Table Name should consist of alphanumeric characters and underscore(_) special character.</td>
-<td>No</td>
+<td>The name of the table in Database. Table name should consist of alphanumeric characters and underscore(_) special character.</td>
+<td>NO</td>
</tr>
<tr>
<td>STORED BY</td>
<td>"org.apache.carbondata.format", identifies and creates a CarbonData table.</td>
-<td>No</td>
+<td>NO</td>
</tr>
<tr>
<td>TBLPROPERTIES</td>
<td>List of CarbonData table properties.</td>
-<td></td>
+<td>YES</td>
</tr>
</tbody>
</table>
@@ -334,7 +334,7 @@ By default inverted index is enabled. The user can disable the inverted index cr
<tr>
<td>IN db_Name</td>
<td>Name of the database. Required only if tables of this specific database are to be listed.</td>
-<td>Yes</td>
+<td>YES</td>
</tr>
</tbody>
</table>
@@ -358,20 +358,24 @@ By default inverted index is enabled. The user can disable the inverted index cr
<tr>
<th>Parameter</th>
<th>Description</th>
+<th>Optional</th>
</tr>
</thead>
<tbody>
<tr>
<td>db_Name</td>
<td>Name of the database. If this parameter is left unspecified, the current database is selected.</td>
+<td>YES</td>
</tr>
<tr>
<td>table_name</td>
<td>Name of the existing table.</td>
+<td>NO</td>
</tr>
<tr>
<td>new_table_name</td>
<td>New table name for the existing table.</td>
+<td>NO</td>
</tr>
</tbody>
</table>
@@ -407,20 +411,24 @@ By default inverted index is enabled. The user can disable the inverted index cr
<tr>
<th>Parameter</th>
<th>Description</th>
+<th>Optional</th>
</tr>
</thead>
<tbody>
<tr>
<td>db_Name</td>
<td>Name of the database. If this parameter is left unspecified, the current database is selected.</td>
+<td>YES</td>
</tr>
<tr>
<td>table_name</td>
<td>Name of the existing table.</td>
+<td>NO</td>
</tr>
<tr>
<td>col_name data_type</td>
<td>Name of comma-separated column with data type. Column names contain letters, digits, and underscores (_).</td>
+<td>NO</td>
</tr>
</tbody>
</table>
@@ -464,20 +472,24 @@ By default inverted index is enabled. The user can disable the inverted index cr
<tr>
<th>Parameter</th>
<th>Description</th>
+<th>Optional</th>
</tr>
</thead>
<tbody>
<tr>
<td>db_Name</td>
<td>Name of the database. If this parameter is left unspecified, the current database is selected.</td>
+<td>YES</td>
</tr>
<tr>
<td>table_name</td>
<td>Name of the existing table.</td>
+<td>NO</td>
</tr>
<tr>
<td>col_name</td>
<td>Name of comma-separated column with data type. Column names contain letters, digits, and underscores (_)</td>
+<td>NO</td>
</tr>
</tbody>
</table>
@@ -504,9 +516,7 @@ By default inverted index is enabled. The user can disable the inverted index cr
<ul>
<li><strong>To delete multiple columns:</strong></li>
</ul>
-<pre><code> ALTER TABLE carbon DROP COLUMNS (b1,c1);
-</code></pre>
-<pre><code> ALTER TABLE carbon DROP COLUMNS (b1,c1);
+<pre><code> ALTER TABLE carbon DROP COLUMNS (c1,d1);
</code></pre>
<h3>
<a id="change-data-type" class="anchor" href="#change-data-type" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a><strong>CHANGE DATA TYPE</strong>
@@ -522,24 +532,29 @@ By default inverted index is enabled. The user can disable the inverted index cr
<tr>
<th>Parameter</th>
<th>Description</th>
+<th>Optional</th>
</tr>
</thead>
<tbody>
<tr>
<td>db_Name</td>
<td>Name of the database. If this parameter is left unspecified, the current database is selected.</td>
+<td>YES</td>
</tr>
<tr>
<td>table_name</td>
<td>Name of the existing table.</td>
+<td>NO</td>
</tr>
<tr>
<td>col_name</td>
<td>Name of comma-separated column with data type. Column names contain letters, digits, and underscores (_).</td>
+<td>NO</td>
</tr>
<tr>
<td>changed_column_type</td>
<td>The change in the data type.</td>
+<td>NO</td>
</tr>
</tbody>
</table>
http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/7e121667/content/dml-operation-on-carbondata.html
----------------------------------------------------------------------
diff --git a/content/dml-operation-on-carbondata.html b/content/dml-operation-on-carbondata.html
index 6e27c75..371e8c8 100644
--- a/content/dml-operation-on-carbondata.html
+++ b/content/dml-operation-on-carbondata.html
@@ -495,7 +495,7 @@ Using this segment ID, you can remove the segment.</p>
<pre><code>SHOW SEGMENTS FOR Table [db_name.]table_name LIMIT number_of_segments
</code></pre>
<p>After you retrieve the segment ID of the segment that you want to delete, execute the following command to delete the selected segment.</p>
-<pre><code>DELETE FROM TABLE [db_name.]table_name WHERE SEGMENT.ID IN (segment_id1, segments_id2, ....)
+<pre><code>DELETE FROM TABLE [db_name.]table_name WHERE SEGMENT.ID IN (segment_id1, segments_id2, ...)
</code></pre>
<h3>
<a id="parameter-description-3" class="anchor" href="#parameter-description-3" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Parameter Description</h3>
@@ -578,12 +578,12 @@ WHERE SEGMENT.STARTTIME BEFORE DATE_VALUE
<a id="syntax-2" class="anchor" href="#syntax-2" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Syntax</h3>
<pre><code> UPDATE <table_name>
SET (column_name1, column_name2, ... column_name n) =
- (column1_expression , column2_expression . .. column n_expression )
+ (column1_expression , column2_expression, ... column n_expression )
[ WHERE { <filter_condition> } ];
</code></pre>
<p>alternatively the following the command can also be used for updating the CarbonData Table :</p>
<pre><code>UPDATE <table_name>
-SET (column_name1, column_name2,) =
+SET (column_name1, column_name2) =
(select sourceColumn1, sourceColumn2 from sourceTable
[ WHERE { <filter_condition> } ] )
[ WHERE { <filter_condition> } ];
@@ -692,7 +692,7 @@ WHERE column1 IN (SELECT column11 FROM sourceTable2);
WHERE column1 IN (SELECT column11 FROM sourceTable2 WHERE
column1 = 'USA');
</code></pre>
-<pre><code>DELETE FROM columncarbonTable1 WHERE column2 >= 4
+<pre><code>DELETE FROM columncarbonTable1 WHERE column2 >= 4;
</code></pre>
<p><strong>The Status Success/Failure shall be captured in the driver log and the client.</strong></p>
</div>
http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/7e121667/content/installation-guide.html
----------------------------------------------------------------------
diff --git a/content/installation-guide.html b/content/installation-guide.html
index e3ea160..8762386 100644
--- a/content/installation-guide.html
+++ b/content/installation-guide.html
@@ -288,7 +288,7 @@
<p>Copy the <code>./conf/carbon.properties.template</code> file from CarbonData repository to <code>$SPARK_HOME/conf/</code> folder and rename the file to <code>carbon.properties</code>.</p>
</li>
<li>
-<p>Create <code>tar,gz</code> file of carbonlib folder and move it inside the carbonlib folder.</p>
+<p>Create <code>tar.gz</code> file of carbonlib folder and move it inside the carbonlib folder.</p>
</li>
</ol>
<pre><code>cd $SPARK_HOME
http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/7e121667/content/pdf/maven-pdf-plugin.pdf
----------------------------------------------------------------------
diff --git a/content/pdf/maven-pdf-plugin.pdf b/content/pdf/maven-pdf-plugin.pdf
index 37389f8..8478fd2 100644
Binary files a/content/pdf/maven-pdf-plugin.pdf and b/content/pdf/maven-pdf-plugin.pdf differ
http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/7e121667/content/quick-start-guide.html
----------------------------------------------------------------------
diff --git a/content/quick-start-guide.html b/content/quick-start-guide.html
index d26b28e..633fb3f 100644
--- a/content/quick-start-guide.html
+++ b/content/quick-start-guide.html
@@ -224,7 +224,7 @@ import org.apache.spark.sql.CarbonSession._
</code></pre>
<h6>
<a id="loading-data-to-a-table" class="anchor" href="#loading-data-to-a-table" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Loading Data to a Table</h6>
-<pre><code>scala>carbon.sql("LOAD DATA INPATH 'sample.csv file path'
+<pre><code>scala>carbon.sql("LOAD DATA INPATH '/path/to/sample.csv'
INTO TABLE test_table")
</code></pre>
<p><strong>NOTE</strong>: Please provide the real file path of <code>sample.csv</code> for the above script.</p>
@@ -243,8 +243,7 @@ scala>carbon.sql("SELECT city, avg(age), sum(age)
<p>Start Spark shell by running the following command in the Spark directory:</p>
<pre><code>./bin/spark-shell --jars <carbondata assembly jar path>
</code></pre>
-<p><strong>NOTE</strong>: Assembly jar will be available after [building CarbonData](<a href="https://github.com/apache/carbondata/" target=_blank>https://github.com/apache/carbondata/</a>
-blob/master/build/README.md) and can be copied from <code>./assembly/target/scala-2.1x/carbondata_xxx.jar</code></p>
+<p><strong>NOTE</strong>: Assembly jar will be available after <a href="https://github.com/apache/carbondata/blob/master/build/README.md" target=_blank>building CarbonData</a> and can be copied from <code>./assembly/target/scala-2.1x/carbondata_xxx.jar</code></p>
<p><strong>NOTE</strong>: In this shell, SparkContext is readily available as <code>sc</code>.</p>
<ul>
<li>In order to execute the Queries we need to import CarbonContext:</li>
@@ -279,7 +278,7 @@ blob/master/build/README.md) and can be copied from <code>./assembly/target/scal
</code></pre>
<p><strong>NOTE</strong>: Please provide the real file path of <code>sample.csv</code> for the above script.</p>
<h6>
-<a id="query-data-from-a-table-1" class="anchor" href="#query-data-from-a-table-1" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Query Data from a Table</h6>
+<a id="querying-data-from-a-table" class="anchor" href="#querying-data-from-a-table" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Querying Data from a Table</h6>
<pre><code>scala>cc.sql("SELECT * FROM test_table").show()
scala>cc.sql("SELECT city, avg(age), sum(age)
FROM test_table