You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Chetan Bhat (JIRA)" <ji...@apache.org> on 2018/08/21 11:10:00 UTC

[jira] [Updated] (CARBONDATA-2871) Formatting issues in http://carbondata.apache.org pages

     [ https://issues.apache.org/jira/browse/CARBONDATA-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chetan Bhat updated CARBONDATA-2871:
------------------------------------
    Description: 
Formatting issues in [http://carbondata.apache.org|http://carbondata.apache.org/] pages.

[http://carbondata.apache.org/data-management-on-carbondata.html]

1. CarbonData supports streaming ingestion for real-time data. You can create the *?streaming?* table using the following table properties.

{{COLUMN_META_CACHE=*??*}}

{{  *  *COLUMN_META_CACHE=*?col1?*}}

{{  *  *COLUMN_META_CACHE=*?col1,col2,col3,??*}}

{{  }}{{CREATE TABLE [dbName].tableName (col1 String, col2 String, col3 int,?) STORED BY ?carbondata? TBLPROPERTIES *(?COLUMN_META_CACHE?=?col1,col2,??)*}}{{}}

{{CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES *(?COLUMN_META_CACHE?=?name?)*}}{{}}

{{ALTER TABLE [dbName].tableName SET TBLPROPERTIES *(?COLUMN_META_CACHE?=?col1,col2,??)*}}{{}}

{{ALTER TABLE employee SET TBLPROPERTIES (*?COLUMN_META_CACHE?=?city?)*}}{{}}

{{CACHE_LEVEL= *?BLOCK?*}}{{}}

{{CACHE_LEVEL= *?BLOCKLET?*}}{{}}

{{CREATE TABLE [dbName].tableName (col1 String, col2 String, col3 int,?) STORED BY ?carbondata? TBLPROPERTIES *(?CACHE_LEVEL?=?Blocklet?)*}}

{{CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}

{{ALTER TABLE [dbName].tableName SET TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}{{}}

{{ALTER TABLE employee SET TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}{{}}

{{CREATE TABLE employee (name String, city String, id int) STORED BY *?carbondata?* TBLPROPERTIES ('flat_folder'='true')}}{{}}

{{CREATE EXTERNAL TABLE [IF NOT EXISTS] [db_name.]table_name STORED BY 'carbondata' LOCATION *?$FilesPath?*}}{{}}

{{CREATE DATABASE carbon LOCATION *?hdfs://name_cluster/dir1/carbonstore?*}}

{{COMMENT *?This is table comment?*}}

2. [http://carbondata.apache.org/file-structure-of-carbondata.html]
 * File Footer : it contains Number of rows, segmentinfo ,all *blocklets?* info and index, you can find the detail from the below diagram.

3. [http://carbondata.apache.org/streaming-guide.html]

The user can use *?SHOW SEGMENTS FOR TABLE tableName?* to check segment status.

4. [http://carbondata.apache.org/faq.html]

Spark executor shows task as failed after the maximum number of retry attempts, but loading the data having bad records and BAD_RECORDS_ACTION (carbon.bad.records.action) is set as *?FAIL?*

 5. [http://carbondata.apache.org/bloomfilter-datamap-guide.html]

Font for the statement is bold and large , different from other statements - "The datamap by default is enabled. To support tuning on query, we can disable a specific datamap during query to observe whether we can gain performance enhancement from it. This will only take effect current session."

 

  was:
Formatting issues in http://carbondata.apache.org pages.

[http://carbondata.apache.org/data-management-on-carbondata.html]

1. CarbonData supports streaming ingestion for real-time data. You can create the *?streaming?* table using the following table properties.

{{COLUMN_META_CACHE=*??*}}

{{  **  COLUMN_META_CACHE=*?col1?*}}

{{  **  COLUMN_META_CACHE=*?col1,col2,col3,??*}}

{{  }}{{CREATE TABLE [dbName].tableName (col1 String, col2 String, col3 int,?) STORED BY ?carbondata? TBLPROPERTIES *(?COLUMN_META_CACHE?=?col1,col2,??)*}}{{}}

{{CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES *(?COLUMN_META_CACHE?=?name?)*}}{{}}

{{ALTER TABLE [dbName].tableName SET TBLPROPERTIES *(?COLUMN_META_CACHE?=?col1,col2,??)*}}{{}}

{{ALTER TABLE employee SET TBLPROPERTIES (*?COLUMN_META_CACHE?=?city?)*}}{{}}

{{CACHE_LEVEL= *?BLOCK?*}}{{}}

{{CACHE_LEVEL= *?BLOCKLET?*}}{{}}

{{CREATE TABLE [dbName].tableName (col1 String, col2 String, col3 int,?) STORED BY ?carbondata? TBLPROPERTIES *(?CACHE_LEVEL?=?Blocklet?)*}}

{{CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}

{{ALTER TABLE [dbName].tableName SET TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}{{}}

{{ALTER TABLE employee SET TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}{{}}

{{CREATE TABLE employee (name String, city String, id int) STORED BY *?carbondata?* TBLPROPERTIES ('flat_folder'='true')}}{{}}

{{CREATE EXTERNAL TABLE [IF NOT EXISTS] [db_name.]table_name STORED BY 'carbondata' LOCATION *?$FilesPath?*}}{{}}

{{CREATE DATABASE carbon LOCATION *?hdfs://name_cluster/dir1/carbonstore?*}}

{{COMMENT *?This is table comment?*}}

2. [http://carbondata.apache.org/file-structure-of-carbondata.html]
 * File Footer : it contains Number of rows, segmentinfo ,all *blocklets?* info and index, you can find the detail from the below diagram.

3. [http://carbondata.apache.org/streaming-guide.html]

The user can use *?SHOW SEGMENTS FOR TABLE tableName?* to check segment status.

4. [http://carbondata.apache.org/faq.html]

Spark executor shows task as failed after the maximum number of retry attempts, but loading the data having bad records and BAD_RECORDS_ACTION (carbon.bad.records.action) is set as *?FAIL?*

 

 


> Formatting issues in http://carbondata.apache.org pages
> -------------------------------------------------------
>
>                 Key: CARBONDATA-2871
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2871
>             Project: CarbonData
>          Issue Type: Bug
>          Components: docs
>    Affects Versions: 1.4.1
>            Reporter: Chetan Bhat
>            Priority: Minor
>
> Formatting issues in [http://carbondata.apache.org|http://carbondata.apache.org/] pages.
> [http://carbondata.apache.org/data-management-on-carbondata.html]
> 1. CarbonData supports streaming ingestion for real-time data. You can create the *?streaming?* table using the following table properties.
> {{COLUMN_META_CACHE=*??*}}
> {{  *  *COLUMN_META_CACHE=*?col1?*}}
> {{  *  *COLUMN_META_CACHE=*?col1,col2,col3,??*}}
> {{  }}{{CREATE TABLE [dbName].tableName (col1 String, col2 String, col3 int,?) STORED BY ?carbondata? TBLPROPERTIES *(?COLUMN_META_CACHE?=?col1,col2,??)*}}{{}}
> {{CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES *(?COLUMN_META_CACHE?=?name?)*}}{{}}
> {{ALTER TABLE [dbName].tableName SET TBLPROPERTIES *(?COLUMN_META_CACHE?=?col1,col2,??)*}}{{}}
> {{ALTER TABLE employee SET TBLPROPERTIES (*?COLUMN_META_CACHE?=?city?)*}}{{}}
> {{CACHE_LEVEL= *?BLOCK?*}}{{}}
> {{CACHE_LEVEL= *?BLOCKLET?*}}{{}}
> {{CREATE TABLE [dbName].tableName (col1 String, col2 String, col3 int,?) STORED BY ?carbondata? TBLPROPERTIES *(?CACHE_LEVEL?=?Blocklet?)*}}
> {{CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}
> {{ALTER TABLE [dbName].tableName SET TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}{{}}
> {{ALTER TABLE employee SET TBLPROPERTIES (*?CACHE_LEVEL?=?Blocklet?*)}}{{}}
> {{CREATE TABLE employee (name String, city String, id int) STORED BY *?carbondata?* TBLPROPERTIES ('flat_folder'='true')}}{{}}
> {{CREATE EXTERNAL TABLE [IF NOT EXISTS] [db_name.]table_name STORED BY 'carbondata' LOCATION *?$FilesPath?*}}{{}}
> {{CREATE DATABASE carbon LOCATION *?hdfs://name_cluster/dir1/carbonstore?*}}
> {{COMMENT *?This is table comment?*}}
> 2. [http://carbondata.apache.org/file-structure-of-carbondata.html]
>  * File Footer : it contains Number of rows, segmentinfo ,all *blocklets?* info and index, you can find the detail from the below diagram.
> 3. [http://carbondata.apache.org/streaming-guide.html]
> The user can use *?SHOW SEGMENTS FOR TABLE tableName?* to check segment status.
> 4. [http://carbondata.apache.org/faq.html]
> Spark executor shows task as failed after the maximum number of retry attempts, but loading the data having bad records and BAD_RECORDS_ACTION (carbon.bad.records.action) is set as *?FAIL?*
>  5. [http://carbondata.apache.org/bloomfilter-datamap-guide.html]
> Font for the statement is bold and large , different from other statements - "The datamap by default is enabled. To support tuning on query, we can disable a specific datamap during query to observe whether we can gain performance enhancement from it. This will only take effect current session."
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)