You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@phoenix.apache.org by td...@apache.org on 2015/04/30 02:35:06 UTC
svn commit: r1676881 - in /phoenix/site: publish/language/index.html
publish/secondary_indexing.html
source/src/site/markdown/secondary_indexing.md
Author: tdsilva
Date: Thu Apr 30 00:35:06 2015
New Revision: 1676881
URL: http://svn.apache.org/r1676881
Log:
Added configs to use high priority queues for Index and Metadata rpc calls. Fixed CREATE TABLE examples.
Modified:
phoenix/site/publish/language/index.html
phoenix/site/publish/secondary_indexing.html
phoenix/site/source/src/site/markdown/secondary_indexing.md
Modified: phoenix/site/publish/language/index.html
URL: http://svn.apache.org/viewvc/phoenix/site/publish/language/index.html?rev=1676881&r1=1676880&r2=1676881&view=diff
==============================================================================
--- phoenix/site/publish/language/index.html (original)
+++ phoenix/site/publish/language/index.html Thu Apr 30 00:35:06 2015
@@ -549,7 +549,7 @@ syntax-end -->
<p>Creates a new table. The <code>HBase</code> table and any column families referenced are created if they don't already exist. All table, column family and column names are uppercased unless they are double quoted in which case they are case sensitive. Column families that exist in the <code>HBase</code> table but are not listed are ignored. At create time, to improve query performance, an empty key value is added to the first column family of any existing rows or the default column family if no column families are explicitly defined. Upserts will also add this empty key value. This improves query performance by having a key value column we can guarantee always being there and thus minimizing the amount of data that must be projected and subsequently returned back to the client. <code>HBase</code> table and column configuration options may be passed through as key/value pairs to configure the <code>HBase</code> table as desired. Note that when using the <code>IF NOT EXISTS</co
de> clause, if a table already exists, then no change will be made to it. Additionally, no validation is done to check whether the existing table metadata matches the proposed table metadata. so it's better to use <code>DROP TABLE</code> followed by <code>CREATE TABLE</code> is the table metadata may be changing.</p>
<p>Example:</p>
<p class="notranslate">
-CREATE TABLE my_schema.my_table ( id BIGINT not null primary key, date DATE not null)<br />CREATE TABLE my_table ( id INTEGER not null primary key desc, date DATE not null,<br /> m.db_utilization DECIMAL, i.db_utilization)<br /> m.DATA_BLOCK_ENCODING='DIFF'<br />CREATE TABLE stats.prod_metrics ( host char(50) not null, created_date date not null,<br /> txn_count bigint CONSTRAINT pk PRIMARY KEY (host, created_date) )<br />CREATE TABLE IF NOT EXISTS "my_case_sensitive_table"<br /> ( "id" char(10) not null primary key, "value" integer)<br /> DATA_BLOCK_ENCODING='NONE',VERSIONS=5,MAX_FILESIZE=2000000 split on (?, ?, ?)<br />CREATE TABLE IF NOT EXISTS my_schema.my_table (<br /> org_id CHAR(15), entity_id CHAR(15), payload binary(1000),<br /> CONSTRAINT pk PRIMARY KEY (org_id, entity_
id) )<br /> TTL=86400</p>
+CREATE TABLE my_schema.my_table ( id BIGINT not null primary key, date DATE)<br />CREATE TABLE my_table ( id INTEGER not null primary key desc, date DATE,<br /> m.db_utilization DECIMAL, i.db_utilization)<br /> m.DATA_BLOCK_ENCODING='DIFF'<br />CREATE TABLE stats.prod_metrics ( host char(50) not null, created_date date not null,<br /> txn_count bigint CONSTRAINT pk PRIMARY KEY (host, created_date) )<br />CREATE TABLE IF NOT EXISTS "my_case_sensitive_table"<br /> ( "id" char(10) not null primary key, "value" integer)<br /> DATA_BLOCK_ENCODING='NONE',VERSIONS=5,MAX_FILESIZE=2000000 split on (?, ?, ?)<br />CREATE TABLE IF NOT EXISTS my_schema.my_table (<br /> org_id CHAR(15), entity_id CHAR(15), payload binary(1000),<br /> CONSTRAINT pk PRIMARY KEY (org_id, entity_id) )<br /> &
nbsp; TTL=86400</p>
<h3 id="drop_table" class="notranslate">DROP TABLE</h3>
<!-- railroad-start -->
Modified: phoenix/site/publish/secondary_indexing.html
URL: http://svn.apache.org/viewvc/phoenix/site/publish/secondary_indexing.html?rev=1676881&r1=1676880&r2=1676881&view=diff
==============================================================================
--- phoenix/site/publish/secondary_indexing.html (original)
+++ phoenix/site/publish/secondary_indexing.html Thu Apr 30 00:35:06 2015
@@ -286,15 +286,23 @@ CREATE LOCAL INDEX my_index ON my_table
<name>hbase.regionserver.wal.codec</name>
<value>org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec</value>
</property>
-<property>
+</pre>
+ </div>
+ <p>The above property enables custom WAL edits to be written, ensuring proper writing/replay of the index updates. This codec supports the usual host of WALEdit options, most notably WALEdit compression.</p>
+ <div class="source">
+ <pre><property>
<name>hbase.region.server.rpc.scheduler.factory.class</name>
- <value>org.apache.phoenix.hbase.index.ipc.PhoenixIndexRpcSchedulerFactory</value>
- <description>Factory to create the Phoenix RPC Scheduler that knows to put index updates into index queues</description>
+ <value>org.apache.hadoop.hbase.ipc.PhoenixRpcSchedulerFactory</value>
+ <description>Factory to create the Phoenix RPC Scheduler that uses separate queues for index and metadata rpc calls</description>
+</property>
+<property>
+ <name>hbase.rpc.controllerfactory.class</name>
+ <value>org.apache.hadoop.hbase.ipc.controller.ServerRpcControllerFactory</value>
+ <description>Factory to create the Phoenix RPC Controller that sets the priority for index and metadata rpc calls</description>
</property>
</pre>
</div>
- <p>The first property enables custom WAL edits to be written, ensuring proper writing/replay of the index updates. This codec supports the usual host of WALEdit options, most notably WALEdit compression.</p>
- <p>The second property prevents deadlocks from occurring during index maintenance for global indexes (HBase 0.98.4+ only) by ensuring index updates are processed with a higher priority than data updates.</p>
+ <p>The above properties prevent deadlocks from occurring during index maintenance for global indexes (HBase 0.98.4+ and Phoenix 4.3.1+ only) by ensuring index updates are processed with a higher priority than data updates. It also prevents deadlocks by ensuring metadata rpc calls are processed with a higher priority than data rpc calls.</p>
<p>Local indexing also requires special configurations in the master to ensure data table and local index regions co-location.</p>
<p>You will need to add the following parameters to <tt>hbase-site.xml</tt> on the master:</p>
<div class="source">
Modified: phoenix/site/source/src/site/markdown/secondary_indexing.md
URL: http://svn.apache.org/viewvc/phoenix/site/source/src/site/markdown/secondary_indexing.md?rev=1676881&r1=1676880&r2=1676881&view=diff
==============================================================================
--- phoenix/site/source/src/site/markdown/secondary_indexing.md (original)
+++ phoenix/site/source/src/site/markdown/secondary_indexing.md Thu Apr 30 00:35:06 2015
@@ -146,16 +146,24 @@ You will need to add the following param
<name>hbase.regionserver.wal.codec</name>
<value>org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec</value>
</property>
+```
+
+The above property enables custom WAL edits to be written, ensuring proper writing/replay of the index updates. This codec supports the usual host of WALEdit options, most notably WALEdit compression.
+
+```
<property>
<name>hbase.region.server.rpc.scheduler.factory.class</name>
- <value>org.apache.phoenix.hbase.index.ipc.PhoenixIndexRpcSchedulerFactory</value>
- <description>Factory to create the Phoenix RPC Scheduler that knows to put index updates into index queues</description>
+ <value>org.apache.hadoop.hbase.ipc.PhoenixRpcSchedulerFactory</value>
+ <description>Factory to create the Phoenix RPC Scheduler that uses separate queues for index and metadata updates</description>
+</property>
+<property>
+ <name>hbase.rpc.controllerfactory.class</name>
+ <value>org.apache.hadoop.hbase.ipc.controller.ServerRpcControllerFactory</value>
+ <description>Factory to create the Phoenix RPC Scheduler that uses separate queues for index and metadata updates</description>
</property>
```
-The first property enables custom WAL edits to be written, ensuring proper writing/replay of the index updates. This codec supports the usual host of WALEdit options, most notably WALEdit compression.
-
-The second property prevents deadlocks from occurring during index maintenance for global indexes (HBase 0.98.4+ only) by ensuring index updates are processed with a higher priority than data updates.
+The above properties prevent deadlocks from occurring during index maintenance for global indexes (HBase 0.98.4+ and Phoenix 4.3.1+ only) by ensuring index updates are processed with a higher priority than data updates. It also prevents deadlocks by ensuring metadata rpc calls are processed with a higher priority than data rpc calls.
Local indexing also requires special configurations in the master to ensure data table and local index regions co-location.