You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2019/03/29 14:11:59 UTC
svn commit: r1856540 - in /kylin/site: cn/development/dev_env.html
cn/docs/tutorial/create_cube.html development/dev_env.html feed.xml
Author: lidong
Date: Fri Mar 29 14:11:58 2019
New Revision: 1856540
URL: http://svn.apache.org/viewvc?rev=1856540&view=rev
Log:
Add more detail about "how to setup dev env". Correct wrong Chinese character.
Modified:
kylin/site/cn/development/dev_env.html
kylin/site/cn/docs/tutorial/create_cube.html
kylin/site/development/dev_env.html
kylin/site/feed.xml
Modified: kylin/site/cn/development/dev_env.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/development/dev_env.html?rev=1856540&r1=1856539&r2=1856540&view=diff
==============================================================================
--- kylin/site/cn/development/dev_env.html (original)
+++ kylin/site/cn/development/dev_env.html Fri Mar 29 14:11:58 2019
@@ -173,16 +173,23 @@ var _hmt = _hmt || [];
<h2 id="hadoop-">Hadoop 客æ·ç«¯ç¯å¢</h2>
-<p>Off-Hadoop-CLI å®è£
éè¦æ¨æä¸ä¸ªæ hadoop 客æ·ç«¯çæºå¨ï¼æä¸ä¸ª hadoop æ²ç®±ï¼ä»¥åæ¬å°å¼åæºå¨ã为äºç®åæä½ï¼æ们强ç建议æ¨ä» hadoop æ²ç®±ä¸è¿è¡ Kylin å¼å§ãå¨ä¸é¢çæç¨ä¸ï¼æ们å°ä½¿ç¨ Hortonworks®Sandbox2.4.0.0-169ï¼æ¨å¯ä»¥ä» Hortonworks ä¸è½½é¡µé¢ä¸è½½å®ï¼å±å¼âHortonworks Sandbox Archiveâé¾æ¥ï¼ç¶åæç´¢âHDP® 2.4 on Hortonworks Sandboxâè¿è¡ä¸è½½ã建议æ¨ä¸ºæ²ç®±èææºæä¾è¶³å¤çå
åï¼é¦é 8G ææ´å¤ã</p>
+<p>Off-Hadoop-CLI å®è£
éè¦æ¨æä¸ä¸ªæ hadoop 客æ·ç«¯çæºå¨ï¼æä¸ä¸ª hadoop æ²ç®±ï¼ä»¥åæ¬å°å¼åæºå¨ã为äºç®åæä½ï¼æ们强ç建议æ¨ä» hadoop æ²ç®±ä¸è¿è¡ Kylin å¼å§ãå¨ä¸é¢çæç¨ä¸ï¼æ们å°ä½¿ç¨ Hortonworks®Sandbox2.4.0.0-169ï¼æ¨å¯ä»¥ä» Hortonworks ä¸è½½é¡µé¢ä¸è½½å®ï¼å±å¼âHortonworks Sandbox Archiveâé¾æ¥ï¼ç¶åæç´¢âHDP® 2.4 on Hortonworks Sandboxâè¿è¡ä¸è½½ã建议æ¨ä¸ºæ²ç®±èææºæä¾è¶³å¤çå
åï¼é¦é 8G ææ´å¤ã<br />
+<strong>æ示ï¼</strong>使ç¨HDP-2.4.0.0.169æ²ç®±å¹¶ä½¿ç¨10GBæè
æ´å¤å
åè¿è¡é¨ç½²ä¼æ´å¥½ãä¸äºæ°çæ¬çHDPæ²ç®±ä½¿ç¨dockeré¨ç½²å®ä»¬çé群æå¡å¹¶ä¸å°è£
å¨èææºéé¢ãä½ éè¦ä¸ä¼ ä½ ç项ç®å°docker容å¨ä¸æ¥è¿è¡éææµè¯ï¼è¿ä¸å¤ªæ¹ä¾¿ãæ´é«çå
åå°åå°èææºæææµè¯è¿ç¨çå¯è½æ§ã</p>
<h3 id="hadoop">å¯å¨ Hadoop</h3>
+<p>å¯å¨å®æä¹åï¼ä½ å¯ä»¥ä½¿ç¨rootè´¦æ·ç»éã</p>
+
<p>å¨ Hortonworks sandbox ä¸, ambari ä¼å¸®å©æ¨è¿è¡ hadoopï¼</p>
<div class="highlight"><pre><code class="language-groff" data-lang="groff">ambari-agent start
ambari-server start</code></pre></div>
-<p>ä¸è¿°å½ä»¤æ§è¡æååæ¨å¯ä»¥å° ambari 主页 <a href="http://yoursandboxip:8080">http://yoursandboxip:8080</a> å»æ£æ¥ææç»ä»¶çç¶æãé»è®¤æ
åµä¸ ambari 使 HBase 失æï¼æ¨éè¦æå¨å¯å¨ <code class="highlighter-rouge">HBase</code> æå¡ã<br />
+<p>ç¶åéç½®ambariçadminç¨æ·å¯ç 为<code class="highlighter-rouge">admin</code>:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">ambari-admin-password-reset</code></pre></div>
+
+<p>ä¸è¿°å½ä»¤æ§è¡æååæ¨å¯ä»¥ä»¥adminç身份ç»éå° ambari 主页 <a href="http://yoursandboxip:8080">http://yoursandboxip:8080</a> å»æ£æ¥ææç»ä»¶çç¶æãé»è®¤æ
åµä¸ ambari 使 HBase 失æï¼æ¨éè¦æå¨å¯å¨ <code class="highlighter-rouge">HBase</code> æå¡ã<br />
<img src="https://raw.githubusercontent.com/KylinOLAP/kylinolap.github.io/master/docs/installation/starthbase.png" alt="start hbase in ambari" /></p>
<p>å¯¹äº hadoop åå¸å¼ï¼åºæ¬ä¸å¯å¨ hadoop é群ï¼ç¡®ä¿ HDFSï¼YARNï¼Hiveï¼HBase è¿è¡çå³å¯ã</p>
@@ -191,7 +198,8 @@ ambari-server start</code></pre></div>
<ul>
<li>为YARN resource manager åé
3-4GB å
å.</li>
- <li>å级 Sandbox éç Java å° Java 8 (Kyin 2.5 éè¦ Java 8).</li>
+ <li>å级 Sandbox éç Java å° Java 8 (Kyin 2.5 éè¦ Java 8). é¾æ¥åæ¬çJAVA_HOMEæåæ°çå°æ¹åæ¯ä¸ä¸ªç¨æ·çjdkçæ¬ãå¦åï¼ä½ ä¹è®¸ä¼éå°<code class="highlighter-rouge">UnsupportedClassVersionError</code>å¼å¸¸. è¿éæä¸äºé®ä»¶æ¯å
³äºè¿ä¸ªé®é¢ç: <a href="https://lists.apache.org/thread.html/46eb7e4083fd25a461f09573fc4225689e61c0d8150463a2c0eb65ef@%3Cdev.kylin.apache.org%3E">spark task error occurs when run IT in sanbox</a> <br />
+<strong>Tips:</strong> è¿éæä¸äºå
³äºæ²ç®±çæç¨ä¼æ帮å©ã <a href="https://hortonworks.com/tutorial/learning-the-ropes-of-the-hortonworks-sandbox">Learning the Ropes of the HDP Sandbox</a></li>
</ul>
<h2 id="section">å¼åæºå¨çç¯å¢</h2>
Modified: kylin/site/cn/docs/tutorial/create_cube.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/tutorial/create_cube.html?rev=1856540&r1=1856539&r2=1856540&view=diff
==============================================================================
--- kylin/site/cn/docs/tutorial/create_cube.html (original)
+++ kylin/site/cn/docs/tutorial/create_cube.html Fri Mar 29 14:11:58 2019
@@ -373,7 +373,7 @@ TopN 度éå¨æ¯ä¸ªç»�
<ul>
<li>
<p>EXTENDED_COLUMN<br />
-Extended_Column ä½ä¸ºåº¦éæ¯ä½ä¸ºç»´åº¦æ´èç空é´ãä¸ååé¶ä¸åå¯ä»¥çææ°çåã</p>
+Extended_Column ä½ä¸ºåº¦éæ¯ä½ä¸ºç»´åº¦æ´èç空é´ãä¸ååå¦ä¸åå¯ä»¥çææ°çåã</p>
<p><img src="/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/8 measure-extended_column.PNG" alt="" /></p>
</li>
Modified: kylin/site/development/dev_env.html
URL: http://svn.apache.org/viewvc/kylin/site/development/dev_env.html?rev=1856540&r1=1856539&r2=1856540&view=diff
==============================================================================
--- kylin/site/development/dev_env.html (original)
+++ kylin/site/development/dev_env.html Fri Mar 29 14:11:58 2019
@@ -6350,16 +6350,23 @@ var _hmt = _hmt || [];
<h2 id="environment-on-the-hadoop-cli">Environment on the Hadoop CLI</h2>
-<p>Off-Hadoop-CLI installation requires you having a hadoop CLI machine (or a hadoop sandbox) as well as your local develop machine. To make things easier we strongly recommend you starting with running Kylin on a hadoop sandbox. In the following tutorial weâll go with <strong>Hortonworks® Sandbox 2.4.0.0-169</strong>, you can download it from <a href="https://hortonworks.com/downloads/#sandbox">Hortonworks download page</a>, expand the âHortonworks Sandbox Archiveâ link, and then search âHDP® 2.4 on Hortonworks Sandboxâ to download. It is recommended that you provide enough memory to your sandbox vm, 8G or more is preferred.</p>
+<p>Off-Hadoop-CLI installation requires you having a hadoop CLI machine (or a hadoop sandbox) as well as your local develop machine. To make things easier we strongly recommend you starting with running Kylin on a hadoop sandbox. In the following tutorial weâll go with <strong>Hortonworks® Sandbox 2.4.0.0-169</strong>, you can download it from <a href="https://hortonworks.com/downloads/#sandbox">Hortonworks download page</a>, expand the âHortonworks Sandbox Archiveâ link, and then search âHDP® 2.4 on Hortonworks Sandboxâ to download. It is recommended that you provide enough memory to your sandbox vm, 8G or more is preferred. <br />
+<strong>Tips:</strong> Use HDP-2.4.0.0.169 sandbox and deploy it with 10GB memory or more will be better. Some newer version HDP sandbox use docker deploy their cluster service and wraped in virual machine. You need to upload you project into docker container to run integration test, which doesnât convenient. Higher memory will reduce the possibility that virtual machine kill the test process.</p>
<h3 id="start-hadoop">Start Hadoop</h3>
+<p>After start the virtual machine, you can login as root.</p>
+
<p>In Hortonworks sandbox, ambari helps to launch hadoop:</p>
<div class="highlight"><pre><code class="language-groff" data-lang="groff">ambari-agent start
ambari-server start</code></pre></div>
-<p>With both command successfully run you can go to ambari home page at <a href="http://yoursandboxip:8080">http://yoursandboxip:8080</a> to check everythingâs status. By default ambari disables HBase, you need to manually start the <code class="highlighter-rouge">HBase</code> service.<br />
+<p>And reset the password of ambari user admin to <code class="highlighter-rouge">admin</code>:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">ambari-admin-password-reset</code></pre></div>
+
+<p>With both command successfully run you can login ambari home page as admin at <a href="http://yoursandboxip:8080">http://yoursandboxip:8080</a> to check everythingâs status. By default ambari disables HBase, you need to manually start the <code class="highlighter-rouge">HBase</code> service.<br />
<img src="https://raw.githubusercontent.com/KylinOLAP/kylinolap.github.io/master/docs/installation/starthbase.png" alt="start hbase in ambari" /></p>
<p>For other hadoop distribution, basically start the hadoop cluster, make sure HDFS, YARN, Hive, HBase are running.</p>
@@ -6368,7 +6375,8 @@ ambari-server start</code></pre></div>
<ul>
<li>You may need to adjust the YARN configuration, allocating 3-4GB memory to YARN resource manager.</li>
- <li>The JDK in the sandbox VM might be old, please manually upgrade to Java 8 (Kyin 2.5 requires Java 8).</li>
+ <li>The JDK in the sandbox VM might be old, please manually upgrade to Java 8 (Kyin 2.5 requires Java 8). Relink the orginal JAVA_HOME to an new one will change the jdk version for every user. Otherwise, you may encounter <code class="highlighter-rouge">UnsupportedClassVersionError</code> exception. Here are some mails about this problem: <a href="https://lists.apache.org/thread.html/46eb7e4083fd25a461f09573fc4225689e61c0d8150463a2c0eb65ef@%3Cdev.kylin.apache.org%3E">spark task error occurs when run IT in sanbox</a> <br />
+<strong>Tips:</strong> Here is a tutorial about sandbox will be helpful. <a href="https://hortonworks.com/tutorial/learning-the-ropes-of-the-hortonworks-sandbox">Learning the Ropes of the HDP Sandbox</a></li>
</ul>
<h2 id="environment-on-the-dev-machine">Environment on the dev machine</h2>
@@ -6435,7 +6443,7 @@ chmod 777 /hadoop/hbase/local/jars</code
<h3 id="run-integration-tests">Run integration tests</h3>
<p>Before actually running integration tests, need to run some end-to-end cube building jobs for test data population, in the meantime validating cubing process. Then comes with the integration tests.</p>
-<p>It might take a while (maybe two hours), please keep patient.</p>
+<p>It might take a while (maybe two hours), please keep patient and smooth network.</p>
<div class="highlight"><pre><code class="language-groff" data-lang="groff">mvn verify -fae -Dhdp.version=<hdp-version> -P sandbox</code></pre></div>
Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1856540&r1=1856539&r2=1856540&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Fri Mar 29 14:11:58 2019
@@ -19,8 +19,8 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Mon, 25 Mar 2019 06:59:17 -0700</pubDate>
- <lastBuildDate>Mon, 25 Mar 2019 06:59:17 -0700</lastBuildDate>
+ <pubDate>Fri, 29 Mar 2019 06:59:36 -0700</pubDate>
+ <lastBuildDate>Fri, 29 Mar 2019 06:59:36 -0700</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>