You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@phoenix.apache.org by ch...@apache.org on 2019/11/26 21:49:50 UTC
svn commit: r1870480 - in /phoenix/site/publish: language/datatypes.html language/functions.html language/index.html phoenix_spark.html

Author: chinmayskulkarni
Date: Tue Nov 26 21:49:50 2019
New Revision: 1870480

URL: http://svn.apache.org/viewvc?rev=1870480&view=rev
Log:
PHOENIX-5284: Add documentation for PHOENIX-5197

Modified:
    phoenix/site/publish/language/datatypes.html
    phoenix/site/publish/language/functions.html
    phoenix/site/publish/language/index.html
    phoenix/site/publish/phoenix_spark.html

Modified: phoenix/site/publish/language/datatypes.html
URL: http://svn.apache.org/viewvc/phoenix/site/publish/language/datatypes.html?rev=1870480&r1=1870479&r2=1870480&view=diff
==============================================================================
--- phoenix/site/publish/language/datatypes.html (original)
+++ phoenix/site/publish/language/datatypes.html Tue Nov 26 21:49:50 2019
@@ -1,7 +1,7 @@
 
 <!DOCTYPE html>
 <!--
- Generated by Apache Maven Doxia at 2019-11-25
+ Generated by Apache Maven Doxia at 2019-11-26
  Rendered using Reflow Maven Skin 1.1.0 (http://andriusvelykis.github.io/reflow-maven-skin)
 -->
 <html  xml:lang="en" lang="en">

Modified: phoenix/site/publish/language/functions.html
URL: http://svn.apache.org/viewvc/phoenix/site/publish/language/functions.html?rev=1870480&r1=1870479&r2=1870480&view=diff
==============================================================================
--- phoenix/site/publish/language/functions.html (original)
+++ phoenix/site/publish/language/functions.html Tue Nov 26 21:49:50 2019
@@ -1,7 +1,7 @@
 
 <!DOCTYPE html>
 <!--
- Generated by Apache Maven Doxia at 2019-11-25
+ Generated by Apache Maven Doxia at 2019-11-26
  Rendered using Reflow Maven Skin 1.1.0 (http://andriusvelykis.github.io/reflow-maven-skin)
 -->
 <html  xml:lang="en" lang="en">

Modified: phoenix/site/publish/language/index.html
URL: http://svn.apache.org/viewvc/phoenix/site/publish/language/index.html?rev=1870480&r1=1870479&r2=1870480&view=diff
==============================================================================
--- phoenix/site/publish/language/index.html (original)
+++ phoenix/site/publish/language/index.html Tue Nov 26 21:49:50 2019
@@ -1,7 +1,7 @@
 
 <!DOCTYPE html>
 <!--
- Generated by Apache Maven Doxia at 2019-11-25
+ Generated by Apache Maven Doxia at 2019-11-26
  Rendered using Reflow Maven Skin 1.1.0 (http://andriusvelykis.github.io/reflow-maven-skin)
 -->
 <html  xml:lang="en" lang="en">

Modified: phoenix/site/publish/phoenix_spark.html
URL: http://svn.apache.org/viewvc/phoenix/site/publish/phoenix_spark.html?rev=1870480&r1=1870479&r2=1870480&view=diff
==============================================================================
--- phoenix/site/publish/phoenix_spark.html (original)
+++ phoenix/site/publish/phoenix_spark.html Tue Nov 26 21:49:50 2019
@@ -1,7 +1,7 @@
 
 <!DOCTYPE html>
 <!--
- Generated by Apache Maven Doxia at 2019-11-25
+ Generated by Apache Maven Doxia at 2019-11-26
  Rendered using Reflow Maven Skin 1.1.0 (http://andriusvelykis.github.io/reflow-maven-skin)
 -->
 <html  xml:lang="en" lang="en">
@@ -370,7 +370,19 @@ df.write
    <li>If you want to use DataSourceV1, you can use source type <tt>&quot;org.apache.phoenix.spark&quot;</tt> instead of <tt>&quot;phoenix&quot;</tt>, however this is deprecated as of <tt>connectors-1.0.0</tt>.</li> 
    <li>The (deprecated) functions <tt>phoenixTableAsDataFrame</tt>, <tt>phoenixTableAsRDD</tt> and <tt>saveToPhoenix</tt> all support optionally specifying a <tt>conf</tt> Hadoop configuration parameter with custom Phoenix client settings, as well as an optional <tt>zkUrl</tt> parameter for the Phoenix connection URL.</li> 
    <li>If <tt>zkUrl</tt> isnât specified, itâs assumed that the âhbase.zookeeper.quorumâ property has been set in the <tt>conf</tt> parameter. Similarly, if no configuration is passed in, <tt>zkUrl</tt> must be specified.</li> 
+   <li>As of <a class="externalLink" href="https://issues.apache.org/jira/browse/PHOENIX-5197">PHOENIX-5197</a>, you can pass configurations from the driver to executors as a comma-separated list against the key <tt>phoenixConfigs</tt> i.e (PhoenixDataSource.PHOENIX_CONFIGS), for ex:</li> 
   </ul> 
+  <div class="source"> 
+   <pre>df = spark
+  .sqlContext
+  .read
+  .format(&quot;phoenix&quot;)
+  .options(Map(&quot;table&quot; -&gt; &quot;Table1&quot;, &quot;zkUrl&quot; -&gt; &quot;hosta,hostb,hostc&quot;, 
+    &quot;phoenixConfigs&quot; -&gt; &quot;hbase.client.retries.number=10,hbase.client.pause=10000&quot;))
+  .load;
+</pre> 
+  </div> 
+  <p>This list of properties is parsed and populated into a properties map which is passed to <tt>DriverManager.getConnection(connString, propsMap)</tt>. Note that the same property values will be used for both the driver and all executors and these configurations are used each time a connection is made (both on the driver and executors).</p> 
  </div> 
  <div class="section"> 
   <h3 id="Limitations">Limitations</h3>