You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@orc.apache.org by om...@apache.org on 2018/05/17 22:13:02 UTC
[08/11] orc git commit: Deploy docs with CVE.
http://git-wip-us.apache.org/repos/asf/orc/blob/e58d3fc4/docs/hive-config.html
----------------------------------------------------------------------
diff --git a/docs/hive-config.html b/docs/hive-config.html
index 159cdf7..5186b7e 100644
--- a/docs/hive-config.html
+++ b/docs/hive-config.html
@@ -4,7 +4,7 @@
<meta charset="UTF-8">
<title>Hive Configuration</title>
<meta name="viewport" content="width=device-width,initial-scale=1">
- <meta name="generator" content="Jekyll v2.4.0">
+ <meta name="generator" content="Jekyll v3.7.3">
<link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
<link rel="stylesheet" href="/css/screen.css">
<link rel="icon" type="image/x-icon" href="/favicon.ico">
@@ -109,7 +109,7 @@
- <option value="/docs/index.html">Background</option>
+ <option value="http://localhost:4000/docs/index.html">Background</option>
@@ -131,7 +131,7 @@
- <option value="/docs/adopters.html">ORC Adopters</option>
+ <option value="http://localhost:4000/docs/adopters.html">ORC Adopters</option>
@@ -193,7 +193,7 @@
- <option value="/docs/types.html">Types</option>
+ <option value="http://localhost:4000/docs/types.html">Types</option>
@@ -219,7 +219,7 @@
- <option value="/docs/indexes.html">Indexes</option>
+ <option value="http://localhost:4000/docs/indexes.html">Indexes</option>
@@ -237,7 +237,7 @@
- <option value="/docs/acid.html">ACID support</option>
+ <option value="http://localhost:4000/docs/acid.html">ACID support</option>
@@ -284,7 +284,7 @@
- <option value="/docs/building.html">Building ORC</option>
+ <option value="http://localhost:4000/docs/building.html">Building ORC</option>
@@ -342,7 +342,7 @@
- <option value="/docs/releases.html">Releases</option>
+ <option value="http://localhost:4000/docs/releases.html">Releases</option>
@@ -373,7 +373,7 @@
- <option value="/docs/hive-ddl.html">Hive DDL</option>
+ <option value="http://localhost:4000/docs/hive-ddl.html">Hive DDL</option>
@@ -407,7 +407,7 @@
- <option value="/docs/hive-config.html">Hive Configuration</option>
+ <option value="http://localhost:4000/docs/hive-config.html">Hive Configuration</option>
@@ -460,7 +460,7 @@
- <option value="/docs/mapred.html">Using in MapRed</option>
+ <option value="http://localhost:4000/docs/mapred.html">Using in MapRed</option>
@@ -498,7 +498,7 @@
- <option value="/docs/mapreduce.html">Using in MapReduce</option>
+ <option value="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</option>
@@ -525,7 +525,7 @@
- <option value="/docs/core-java.html">Using Core Java</option>
+ <option value="http://localhost:4000/docs/core-java.html">Using Core Java</option>
@@ -559,7 +559,7 @@
- <option value="/docs/core-cpp.html">Using Core C++</option>
+ <option value="http://localhost:4000/docs/core-cpp.html">Using Core C++</option>
@@ -606,7 +606,7 @@
- <option value="/docs/cpp-tools.html">C++ Tools</option>
+ <option value="http://localhost:4000/docs/cpp-tools.html">C++ Tools</option>
@@ -652,7 +652,7 @@
- <option value="/docs/java-tools.html">Java Tools</option>
+ <option value="http://localhost:4000/docs/java-tools.html">Java Tools</option>
@@ -729,7 +729,7 @@ with the same options.</p>
<p>For example, to create an ORC table without high level compression:</p>
-<p><code>CREATE TABLE istari (
+<p><code class="highlighter-rouge">CREATE TABLE istari (
name STRING,
color STRING
) STORED AS ORC TBLPROPERTIES ("orc.compress"="NONE");
@@ -815,8 +815,8 @@ with the same options.</p>
available size within the block is more than 3.2Mb, a new
smaller stripe will be inserted to fit within that space. This
will make sure that no stripe written will cross block
- boundaries and cause remote reads within a node local task.
-
+ boundaries and cause remote reads within a node local task.</t>
+</tr>
<tr>
<td>hive.exec.orc.default.compress</td>
<td>ZLIB</td>
@@ -893,7 +893,7 @@ with the same options.</p>
available? If the new stripe would straddle a block, Hadoop is ≥ 2.7,
and this is enabled, it will end the block before the new stripe.</td>
</tr>
-
+</table>
</td></tr></table>
@@ -961,8 +961,6 @@ with the same options.</p>
-
-
@@ -982,29 +980,25 @@ with the same options.</p>
- <li class=""><a href="/docs/index.html">Background</a></li>
+ <li class=""><a href="http://localhost:4000/docs/index.html">Background</a></li>
-
-
- <li class=""><a href="/docs/adopters.html">ORC Adopters</a></li>
+ <li class=""><a href="http://localhost:4000/docs/adopters.html">ORC Adopters</a></li>
-
-
@@ -1036,15 +1030,13 @@ with the same options.</p>
- <li class=""><a href="/docs/types.html">Types</a></li>
+ <li class=""><a href="http://localhost:4000/docs/types.html">Types</a></li>
-
-
@@ -1066,19 +1058,17 @@ with the same options.</p>
- <li class=""><a href="/docs/indexes.html">Indexes</a></li>
+ <li class=""><a href="http://localhost:4000/docs/indexes.html">Indexes</a></li>
-
-
- <li class=""><a href="/docs/acid.html">ACID support</a></li>
+ <li class=""><a href="http://localhost:4000/docs/acid.html">ACID support</a></li>
@@ -1093,8 +1083,6 @@ with the same options.</p>
-
-
@@ -1102,15 +1090,13 @@ with the same options.</p>
- <li class=""><a href="/docs/building.html">Building ORC</a></li>
+ <li class=""><a href="http://localhost:4000/docs/building.html">Building ORC</a></li>
-
-
@@ -1140,7 +1126,7 @@ with the same options.</p>
- <li class=""><a href="/docs/releases.html">Releases</a></li>
+ <li class=""><a href="http://localhost:4000/docs/releases.html">Releases</a></li>
@@ -1155,8 +1141,6 @@ with the same options.</p>
-
-
@@ -1174,15 +1158,13 @@ with the same options.</p>
- <li class=""><a href="/docs/hive-ddl.html">Hive DDL</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-ddl.html">Hive DDL</a></li>
-
-
@@ -1198,7 +1180,7 @@ with the same options.</p>
- <li class="current"><a href="/docs/hive-config.html">Hive Configuration</a></li>
+ <li class="current"><a href="http://localhost:4000/docs/hive-config.html">Hive Configuration</a></li>
@@ -1213,8 +1195,6 @@ with the same options.</p>
-
-
@@ -1240,15 +1220,13 @@ with the same options.</p>
- <li class=""><a href="/docs/mapred.html">Using in MapRed</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapred.html">Using in MapRed</a></li>
-
-
@@ -1276,7 +1254,7 @@ with the same options.</p>
- <li class=""><a href="/docs/mapreduce.html">Using in MapReduce</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</a></li>
@@ -1291,8 +1269,6 @@ with the same options.</p>
-
-
@@ -1304,15 +1280,13 @@ with the same options.</p>
- <li class=""><a href="/docs/core-java.html">Using Core Java</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-java.html">Using Core Java</a></li>
-
-
@@ -1322,7 +1296,7 @@ with the same options.</p>
- <li class=""><a href="/docs/core-cpp.html">Using Core C++</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-cpp.html">Using Core C++</a></li>
@@ -1337,8 +1311,6 @@ with the same options.</p>
-
-
@@ -1352,15 +1324,13 @@ with the same options.</p>
- <li class=""><a href="/docs/cpp-tools.html">C++ Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/cpp-tools.html">C++ Tools</a></li>
-
-
@@ -1384,7 +1354,7 @@ with the same options.</p>
- <li class=""><a href="/docs/java-tools.html">Java Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/java-tools.html">Java Tools</a></li>
http://git-wip-us.apache.org/repos/asf/orc/blob/e58d3fc4/docs/hive-ddl.html
----------------------------------------------------------------------
diff --git a/docs/hive-ddl.html b/docs/hive-ddl.html
index 8c360d3..d2e4f4f 100644
--- a/docs/hive-ddl.html
+++ b/docs/hive-ddl.html
@@ -4,7 +4,7 @@
<meta charset="UTF-8">
<title>Hive DDL</title>
<meta name="viewport" content="width=device-width,initial-scale=1">
- <meta name="generator" content="Jekyll v2.4.0">
+ <meta name="generator" content="Jekyll v3.7.3">
<link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
<link rel="stylesheet" href="/css/screen.css">
<link rel="icon" type="image/x-icon" href="/favicon.ico">
@@ -109,7 +109,7 @@
- <option value="/docs/index.html">Background</option>
+ <option value="http://localhost:4000/docs/index.html">Background</option>
@@ -131,7 +131,7 @@
- <option value="/docs/adopters.html">ORC Adopters</option>
+ <option value="http://localhost:4000/docs/adopters.html">ORC Adopters</option>
@@ -193,7 +193,7 @@
- <option value="/docs/types.html">Types</option>
+ <option value="http://localhost:4000/docs/types.html">Types</option>
@@ -219,7 +219,7 @@
- <option value="/docs/indexes.html">Indexes</option>
+ <option value="http://localhost:4000/docs/indexes.html">Indexes</option>
@@ -237,7 +237,7 @@
- <option value="/docs/acid.html">ACID support</option>
+ <option value="http://localhost:4000/docs/acid.html">ACID support</option>
@@ -284,7 +284,7 @@
- <option value="/docs/building.html">Building ORC</option>
+ <option value="http://localhost:4000/docs/building.html">Building ORC</option>
@@ -342,7 +342,7 @@
- <option value="/docs/releases.html">Releases</option>
+ <option value="http://localhost:4000/docs/releases.html">Releases</option>
@@ -373,7 +373,7 @@
- <option value="/docs/hive-ddl.html">Hive DDL</option>
+ <option value="http://localhost:4000/docs/hive-ddl.html">Hive DDL</option>
@@ -407,7 +407,7 @@
- <option value="/docs/hive-config.html">Hive Configuration</option>
+ <option value="http://localhost:4000/docs/hive-config.html">Hive Configuration</option>
@@ -460,7 +460,7 @@
- <option value="/docs/mapred.html">Using in MapRed</option>
+ <option value="http://localhost:4000/docs/mapred.html">Using in MapRed</option>
@@ -498,7 +498,7 @@
- <option value="/docs/mapreduce.html">Using in MapReduce</option>
+ <option value="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</option>
@@ -525,7 +525,7 @@
- <option value="/docs/core-java.html">Using Core Java</option>
+ <option value="http://localhost:4000/docs/core-java.html">Using Core Java</option>
@@ -559,7 +559,7 @@
- <option value="/docs/core-cpp.html">Using Core C++</option>
+ <option value="http://localhost:4000/docs/core-cpp.html">Using Core C++</option>
@@ -606,7 +606,7 @@
- <option value="/docs/cpp-tools.html">C++ Tools</option>
+ <option value="http://localhost:4000/docs/cpp-tools.html">C++ Tools</option>
@@ -652,7 +652,7 @@
- <option value="/docs/java-tools.html">Java Tools</option>
+ <option value="http://localhost:4000/docs/java-tools.html">Java Tools</option>
@@ -677,33 +677,31 @@
<p>ORC is well integrated into Hive, so storing your istari table as ORC
is done by adding “STORED AS ORC”.</p>
-<p><code>CREATE TABLE istari (
+<p>```CREATE TABLE istari (
name STRING,
color STRING
-) STORED AS ORC;
-</code></p>
-
-<p>To modify a table so that new partitions of the istari table are
-stored as ORC files:</p>
+) STORED AS ORC;</p>
+<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>
+To modify a table so that new partitions of the istari table are
+stored as ORC files:
-<p><code>ALTER TABLE istari SET FILEFORMAT ORC;
-</code></p>
+```ALTER TABLE istari SET FILEFORMAT ORC;
+</code></pre></div></div>
<p>As of Hive 0.14, users can request an efficient merge of small ORC files
together by issuing a CONCATENATE command on their table or partition. The
files will be merged at the stripe level without reserialization.</p>
-<p><code>ALTER TABLE istari [PARTITION partition_spec] CONCATENATE;
-</code></p>
+<p>```ALTER TABLE istari [PARTITION partition_spec] CONCATENATE;</p>
+<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>
+To get information about an ORC file, use the orcfiledump command.
-<p>To get information about an ORC file, use the orcfiledump command.</p>
-
-<p><code>% hive --orcfiledump <path_to_file>
-</code></p>
+```% hive --orcfiledump <path_to_file>
+</code></pre></div></div>
<p>As of Hive 1.1, to display the data in the ORC file, use:</p>
-<p><code>% hive --orcfiledump -d <path_to_file>
+<p><code class="highlighter-rouge">% hive --orcfiledump -d <path_to_file>
</code></p>
@@ -768,8 +766,6 @@ files will be merged at the stripe level without reserialization.</p>
-
-
@@ -789,29 +785,25 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/index.html">Background</a></li>
+ <li class=""><a href="http://localhost:4000/docs/index.html">Background</a></li>
-
-
- <li class=""><a href="/docs/adopters.html">ORC Adopters</a></li>
+ <li class=""><a href="http://localhost:4000/docs/adopters.html">ORC Adopters</a></li>
-
-
@@ -843,15 +835,13 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/types.html">Types</a></li>
+ <li class=""><a href="http://localhost:4000/docs/types.html">Types</a></li>
-
-
@@ -873,19 +863,17 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/indexes.html">Indexes</a></li>
+ <li class=""><a href="http://localhost:4000/docs/indexes.html">Indexes</a></li>
-
-
- <li class=""><a href="/docs/acid.html">ACID support</a></li>
+ <li class=""><a href="http://localhost:4000/docs/acid.html">ACID support</a></li>
@@ -900,8 +888,6 @@ files will be merged at the stripe level without reserialization.</p>
-
-
@@ -909,15 +895,13 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/building.html">Building ORC</a></li>
+ <li class=""><a href="http://localhost:4000/docs/building.html">Building ORC</a></li>
-
-
@@ -947,7 +931,7 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/releases.html">Releases</a></li>
+ <li class=""><a href="http://localhost:4000/docs/releases.html">Releases</a></li>
@@ -962,8 +946,6 @@ files will be merged at the stripe level without reserialization.</p>
-
-
@@ -981,15 +963,13 @@ files will be merged at the stripe level without reserialization.</p>
- <li class="current"><a href="/docs/hive-ddl.html">Hive DDL</a></li>
+ <li class="current"><a href="http://localhost:4000/docs/hive-ddl.html">Hive DDL</a></li>
-
-
@@ -1005,7 +985,7 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/hive-config.html">Hive Configuration</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-config.html">Hive Configuration</a></li>
@@ -1020,8 +1000,6 @@ files will be merged at the stripe level without reserialization.</p>
-
-
@@ -1047,15 +1025,13 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/mapred.html">Using in MapRed</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapred.html">Using in MapRed</a></li>
-
-
@@ -1083,7 +1059,7 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/mapreduce.html">Using in MapReduce</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</a></li>
@@ -1098,8 +1074,6 @@ files will be merged at the stripe level without reserialization.</p>
-
-
@@ -1111,15 +1085,13 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/core-java.html">Using Core Java</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-java.html">Using Core Java</a></li>
-
-
@@ -1129,7 +1101,7 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/core-cpp.html">Using Core C++</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-cpp.html">Using Core C++</a></li>
@@ -1144,8 +1116,6 @@ files will be merged at the stripe level without reserialization.</p>
-
-
@@ -1159,15 +1129,13 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/cpp-tools.html">C++ Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/cpp-tools.html">C++ Tools</a></li>
-
-
@@ -1191,7 +1159,7 @@ files will be merged at the stripe level without reserialization.</p>
- <li class=""><a href="/docs/java-tools.html">Java Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/java-tools.html">Java Tools</a></li>
http://git-wip-us.apache.org/repos/asf/orc/blob/e58d3fc4/docs/index.html
----------------------------------------------------------------------
diff --git a/docs/index.html b/docs/index.html
index bb12c87..73a37c3 100644
--- a/docs/index.html
+++ b/docs/index.html
@@ -4,7 +4,7 @@
<meta charset="UTF-8">
<title>Background</title>
<meta name="viewport" content="width=device-width,initial-scale=1">
- <meta name="generator" content="Jekyll v2.4.0">
+ <meta name="generator" content="Jekyll v3.7.3">
<link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
<link rel="stylesheet" href="/css/screen.css">
<link rel="icon" type="image/x-icon" href="/favicon.ico">
@@ -109,7 +109,7 @@
- <option value="/docs/index.html">Background</option>
+ <option value="http://localhost:4000/docs/index.html">Background</option>
@@ -131,7 +131,7 @@
- <option value="/docs/adopters.html">ORC Adopters</option>
+ <option value="http://localhost:4000/docs/adopters.html">ORC Adopters</option>
@@ -193,7 +193,7 @@
- <option value="/docs/types.html">Types</option>
+ <option value="http://localhost:4000/docs/types.html">Types</option>
@@ -219,7 +219,7 @@
- <option value="/docs/indexes.html">Indexes</option>
+ <option value="http://localhost:4000/docs/indexes.html">Indexes</option>
@@ -237,7 +237,7 @@
- <option value="/docs/acid.html">ACID support</option>
+ <option value="http://localhost:4000/docs/acid.html">ACID support</option>
@@ -284,7 +284,7 @@
- <option value="/docs/building.html">Building ORC</option>
+ <option value="http://localhost:4000/docs/building.html">Building ORC</option>
@@ -342,7 +342,7 @@
- <option value="/docs/releases.html">Releases</option>
+ <option value="http://localhost:4000/docs/releases.html">Releases</option>
@@ -373,7 +373,7 @@
- <option value="/docs/hive-ddl.html">Hive DDL</option>
+ <option value="http://localhost:4000/docs/hive-ddl.html">Hive DDL</option>
@@ -407,7 +407,7 @@
- <option value="/docs/hive-config.html">Hive Configuration</option>
+ <option value="http://localhost:4000/docs/hive-config.html">Hive Configuration</option>
@@ -460,7 +460,7 @@
- <option value="/docs/mapred.html">Using in MapRed</option>
+ <option value="http://localhost:4000/docs/mapred.html">Using in MapRed</option>
@@ -498,7 +498,7 @@
- <option value="/docs/mapreduce.html">Using in MapReduce</option>
+ <option value="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</option>
@@ -525,7 +525,7 @@
- <option value="/docs/core-java.html">Using Core Java</option>
+ <option value="http://localhost:4000/docs/core-java.html">Using Core Java</option>
@@ -559,7 +559,7 @@
- <option value="/docs/core-cpp.html">Using Core C++</option>
+ <option value="http://localhost:4000/docs/core-cpp.html">Using Core C++</option>
@@ -606,7 +606,7 @@
- <option value="/docs/cpp-tools.html">C++ Tools</option>
+ <option value="http://localhost:4000/docs/cpp-tools.html">C++ Tools</option>
@@ -652,7 +652,7 @@
- <option value="/docs/java-tools.html">Java Tools</option>
+ <option value="http://localhost:4000/docs/java-tools.html">Java Tools</option>
@@ -748,8 +748,6 @@ format specification</a>.</p>
-
-
@@ -769,29 +767,25 @@ format specification</a>.</p>
- <li class="current"><a href="/docs/index.html">Background</a></li>
+ <li class="current"><a href="http://localhost:4000/docs/index.html">Background</a></li>
-
-
- <li class=""><a href="/docs/adopters.html">ORC Adopters</a></li>
+ <li class=""><a href="http://localhost:4000/docs/adopters.html">ORC Adopters</a></li>
-
-
@@ -823,15 +817,13 @@ format specification</a>.</p>
- <li class=""><a href="/docs/types.html">Types</a></li>
+ <li class=""><a href="http://localhost:4000/docs/types.html">Types</a></li>
-
-
@@ -853,19 +845,17 @@ format specification</a>.</p>
- <li class=""><a href="/docs/indexes.html">Indexes</a></li>
+ <li class=""><a href="http://localhost:4000/docs/indexes.html">Indexes</a></li>
-
-
- <li class=""><a href="/docs/acid.html">ACID support</a></li>
+ <li class=""><a href="http://localhost:4000/docs/acid.html">ACID support</a></li>
@@ -880,8 +870,6 @@ format specification</a>.</p>
-
-
@@ -889,15 +877,13 @@ format specification</a>.</p>
- <li class=""><a href="/docs/building.html">Building ORC</a></li>
+ <li class=""><a href="http://localhost:4000/docs/building.html">Building ORC</a></li>
-
-
@@ -927,7 +913,7 @@ format specification</a>.</p>
- <li class=""><a href="/docs/releases.html">Releases</a></li>
+ <li class=""><a href="http://localhost:4000/docs/releases.html">Releases</a></li>
@@ -942,8 +928,6 @@ format specification</a>.</p>
-
-
@@ -961,15 +945,13 @@ format specification</a>.</p>
- <li class=""><a href="/docs/hive-ddl.html">Hive DDL</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-ddl.html">Hive DDL</a></li>
-
-
@@ -985,7 +967,7 @@ format specification</a>.</p>
- <li class=""><a href="/docs/hive-config.html">Hive Configuration</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-config.html">Hive Configuration</a></li>
@@ -1000,8 +982,6 @@ format specification</a>.</p>
-
-
@@ -1027,15 +1007,13 @@ format specification</a>.</p>
- <li class=""><a href="/docs/mapred.html">Using in MapRed</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapred.html">Using in MapRed</a></li>
-
-
@@ -1063,7 +1041,7 @@ format specification</a>.</p>
- <li class=""><a href="/docs/mapreduce.html">Using in MapReduce</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</a></li>
@@ -1078,8 +1056,6 @@ format specification</a>.</p>
-
-
@@ -1091,15 +1067,13 @@ format specification</a>.</p>
- <li class=""><a href="/docs/core-java.html">Using Core Java</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-java.html">Using Core Java</a></li>
-
-
@@ -1109,7 +1083,7 @@ format specification</a>.</p>
- <li class=""><a href="/docs/core-cpp.html">Using Core C++</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-cpp.html">Using Core C++</a></li>
@@ -1124,8 +1098,6 @@ format specification</a>.</p>
-
-
@@ -1139,15 +1111,13 @@ format specification</a>.</p>
- <li class=""><a href="/docs/cpp-tools.html">C++ Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/cpp-tools.html">C++ Tools</a></li>
-
-
@@ -1171,7 +1141,7 @@ format specification</a>.</p>
- <li class=""><a href="/docs/java-tools.html">Java Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/java-tools.html">Java Tools</a></li>
http://git-wip-us.apache.org/repos/asf/orc/blob/e58d3fc4/docs/indexes.html
----------------------------------------------------------------------
diff --git a/docs/indexes.html b/docs/indexes.html
index 0a81f43..9cf8abc 100644
--- a/docs/indexes.html
+++ b/docs/indexes.html
@@ -4,7 +4,7 @@
<meta charset="UTF-8">
<title>Indexes</title>
<meta name="viewport" content="width=device-width,initial-scale=1">
- <meta name="generator" content="Jekyll v2.4.0">
+ <meta name="generator" content="Jekyll v3.7.3">
<link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
<link rel="stylesheet" href="/css/screen.css">
<link rel="icon" type="image/x-icon" href="/favicon.ico">
@@ -109,7 +109,7 @@
- <option value="/docs/index.html">Background</option>
+ <option value="http://localhost:4000/docs/index.html">Background</option>
@@ -131,7 +131,7 @@
- <option value="/docs/adopters.html">ORC Adopters</option>
+ <option value="http://localhost:4000/docs/adopters.html">ORC Adopters</option>
@@ -193,7 +193,7 @@
- <option value="/docs/types.html">Types</option>
+ <option value="http://localhost:4000/docs/types.html">Types</option>
@@ -219,7 +219,7 @@
- <option value="/docs/indexes.html">Indexes</option>
+ <option value="http://localhost:4000/docs/indexes.html">Indexes</option>
@@ -237,7 +237,7 @@
- <option value="/docs/acid.html">ACID support</option>
+ <option value="http://localhost:4000/docs/acid.html">ACID support</option>
@@ -284,7 +284,7 @@
- <option value="/docs/building.html">Building ORC</option>
+ <option value="http://localhost:4000/docs/building.html">Building ORC</option>
@@ -342,7 +342,7 @@
- <option value="/docs/releases.html">Releases</option>
+ <option value="http://localhost:4000/docs/releases.html">Releases</option>
@@ -373,7 +373,7 @@
- <option value="/docs/hive-ddl.html">Hive DDL</option>
+ <option value="http://localhost:4000/docs/hive-ddl.html">Hive DDL</option>
@@ -407,7 +407,7 @@
- <option value="/docs/hive-config.html">Hive Configuration</option>
+ <option value="http://localhost:4000/docs/hive-config.html">Hive Configuration</option>
@@ -460,7 +460,7 @@
- <option value="/docs/mapred.html">Using in MapRed</option>
+ <option value="http://localhost:4000/docs/mapred.html">Using in MapRed</option>
@@ -498,7 +498,7 @@
- <option value="/docs/mapreduce.html">Using in MapReduce</option>
+ <option value="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</option>
@@ -525,7 +525,7 @@
- <option value="/docs/core-java.html">Using Core Java</option>
+ <option value="http://localhost:4000/docs/core-java.html">Using Core Java</option>
@@ -559,7 +559,7 @@
- <option value="/docs/core-cpp.html">Using Core C++</option>
+ <option value="http://localhost:4000/docs/core-cpp.html">Using Core C++</option>
@@ -606,7 +606,7 @@
- <option value="/docs/cpp-tools.html">C++ Tools</option>
+ <option value="http://localhost:4000/docs/cpp-tools.html">C++ Tools</option>
@@ -652,7 +652,7 @@
- <option value="/docs/java-tools.html">Java Tools</option>
+ <option value="http://localhost:4000/docs/java-tools.html">Java Tools</option>
@@ -753,8 +753,6 @@ would be read.</p>
-
-
@@ -774,29 +772,25 @@ would be read.</p>
- <li class=""><a href="/docs/index.html">Background</a></li>
+ <li class=""><a href="http://localhost:4000/docs/index.html">Background</a></li>
-
-
- <li class=""><a href="/docs/adopters.html">ORC Adopters</a></li>
+ <li class=""><a href="http://localhost:4000/docs/adopters.html">ORC Adopters</a></li>
-
-
@@ -828,15 +822,13 @@ would be read.</p>
- <li class=""><a href="/docs/types.html">Types</a></li>
+ <li class=""><a href="http://localhost:4000/docs/types.html">Types</a></li>
-
-
@@ -858,19 +850,17 @@ would be read.</p>
- <li class="current"><a href="/docs/indexes.html">Indexes</a></li>
+ <li class="current"><a href="http://localhost:4000/docs/indexes.html">Indexes</a></li>
-
-
- <li class=""><a href="/docs/acid.html">ACID support</a></li>
+ <li class=""><a href="http://localhost:4000/docs/acid.html">ACID support</a></li>
@@ -885,8 +875,6 @@ would be read.</p>
-
-
@@ -894,15 +882,13 @@ would be read.</p>
- <li class=""><a href="/docs/building.html">Building ORC</a></li>
+ <li class=""><a href="http://localhost:4000/docs/building.html">Building ORC</a></li>
-
-
@@ -932,7 +918,7 @@ would be read.</p>
- <li class=""><a href="/docs/releases.html">Releases</a></li>
+ <li class=""><a href="http://localhost:4000/docs/releases.html">Releases</a></li>
@@ -947,8 +933,6 @@ would be read.</p>
-
-
@@ -966,15 +950,13 @@ would be read.</p>
- <li class=""><a href="/docs/hive-ddl.html">Hive DDL</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-ddl.html">Hive DDL</a></li>
-
-
@@ -990,7 +972,7 @@ would be read.</p>
- <li class=""><a href="/docs/hive-config.html">Hive Configuration</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-config.html">Hive Configuration</a></li>
@@ -1005,8 +987,6 @@ would be read.</p>
-
-
@@ -1032,15 +1012,13 @@ would be read.</p>
- <li class=""><a href="/docs/mapred.html">Using in MapRed</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapred.html">Using in MapRed</a></li>
-
-
@@ -1068,7 +1046,7 @@ would be read.</p>
- <li class=""><a href="/docs/mapreduce.html">Using in MapReduce</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</a></li>
@@ -1083,8 +1061,6 @@ would be read.</p>
-
-
@@ -1096,15 +1072,13 @@ would be read.</p>
- <li class=""><a href="/docs/core-java.html">Using Core Java</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-java.html">Using Core Java</a></li>
-
-
@@ -1114,7 +1088,7 @@ would be read.</p>
- <li class=""><a href="/docs/core-cpp.html">Using Core C++</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-cpp.html">Using Core C++</a></li>
@@ -1129,8 +1103,6 @@ would be read.</p>
-
-
@@ -1144,15 +1116,13 @@ would be read.</p>
- <li class=""><a href="/docs/cpp-tools.html">C++ Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/cpp-tools.html">C++ Tools</a></li>
-
-
@@ -1176,7 +1146,7 @@ would be read.</p>
- <li class=""><a href="/docs/java-tools.html">Java Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/java-tools.html">Java Tools</a></li>
http://git-wip-us.apache.org/repos/asf/orc/blob/e58d3fc4/docs/java-tools.html
----------------------------------------------------------------------
diff --git a/docs/java-tools.html b/docs/java-tools.html
index 25efb43..ad6f0b4 100644
--- a/docs/java-tools.html
+++ b/docs/java-tools.html
@@ -4,7 +4,7 @@
<meta charset="UTF-8">
<title>Java Tools</title>
<meta name="viewport" content="width=device-width,initial-scale=1">
- <meta name="generator" content="Jekyll v2.4.0">
+ <meta name="generator" content="Jekyll v3.7.3">
<link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
<link rel="stylesheet" href="/css/screen.css">
<link rel="icon" type="image/x-icon" href="/favicon.ico">
@@ -109,7 +109,7 @@
- <option value="/docs/index.html">Background</option>
+ <option value="http://localhost:4000/docs/index.html">Background</option>
@@ -131,7 +131,7 @@
- <option value="/docs/adopters.html">ORC Adopters</option>
+ <option value="http://localhost:4000/docs/adopters.html">ORC Adopters</option>
@@ -193,7 +193,7 @@
- <option value="/docs/types.html">Types</option>
+ <option value="http://localhost:4000/docs/types.html">Types</option>
@@ -219,7 +219,7 @@
- <option value="/docs/indexes.html">Indexes</option>
+ <option value="http://localhost:4000/docs/indexes.html">Indexes</option>
@@ -237,7 +237,7 @@
- <option value="/docs/acid.html">ACID support</option>
+ <option value="http://localhost:4000/docs/acid.html">ACID support</option>
@@ -284,7 +284,7 @@
- <option value="/docs/building.html">Building ORC</option>
+ <option value="http://localhost:4000/docs/building.html">Building ORC</option>
@@ -342,7 +342,7 @@
- <option value="/docs/releases.html">Releases</option>
+ <option value="http://localhost:4000/docs/releases.html">Releases</option>
@@ -373,7 +373,7 @@
- <option value="/docs/hive-ddl.html">Hive DDL</option>
+ <option value="http://localhost:4000/docs/hive-ddl.html">Hive DDL</option>
@@ -407,7 +407,7 @@
- <option value="/docs/hive-config.html">Hive Configuration</option>
+ <option value="http://localhost:4000/docs/hive-config.html">Hive Configuration</option>
@@ -460,7 +460,7 @@
- <option value="/docs/mapred.html">Using in MapRed</option>
+ <option value="http://localhost:4000/docs/mapred.html">Using in MapRed</option>
@@ -498,7 +498,7 @@
- <option value="/docs/mapreduce.html">Using in MapReduce</option>
+ <option value="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</option>
@@ -525,7 +525,7 @@
- <option value="/docs/core-java.html">Using Core Java</option>
+ <option value="http://localhost:4000/docs/core-java.html">Using Core Java</option>
@@ -559,7 +559,7 @@
- <option value="/docs/core-cpp.html">Using Core C++</option>
+ <option value="http://localhost:4000/docs/core-cpp.html">Using Core C++</option>
@@ -606,7 +606,7 @@
- <option value="/docs/cpp-tools.html">C++ Tools</option>
+ <option value="http://localhost:4000/docs/cpp-tools.html">C++ Tools</option>
@@ -652,7 +652,7 @@
- <option value="/docs/java-tools.html">Java Tools</option>
+ <option value="http://localhost:4000/docs/java-tools.html">Java Tools</option>
@@ -691,8 +691,8 @@ supports both the local file system and HDFS.</p>
<p>The command line looks like:</p>
-<pre><code class="language-shell">% java -jar orc-tools-X.Y.Z-uber.jar <sub-command> <args>
-</code></pre>
+<div class="language-shell highlighter-rouge"><div class="highlight"><pre class="highlight"><code>% java <span class="nt">-jar</span> orc-tools-X.Y.Z-uber.jar <sub-command> <args>
+</code></pre></div></div>
<h2 id="java-meta">Java Meta</h2>
@@ -718,9 +718,9 @@ equivalent to the Hive ORC File Dump command.</p>
<p>An example of the output is given below:</p>
-<pre><code class="language-shell">% java -jar orc-tools-X.Y.Z-uber.jar meta examples/TestOrcFile.test1.orc
-Processing data file examples/TestOrcFile.test1.orc [length: 1711]
-Structure for examples/TestOrcFile.test1.orc
+<div class="language-shell highlighter-rouge"><div class="highlight"><pre class="highlight"><code>% java <span class="nt">-jar</span> orc-tools-X.Y.Z-uber.jar meta examples/TestOrcFile.test1.orc
+Processing data file examples/TestOrcFile.test1.orc <span class="o">[</span>length: 1711]
+Structure <span class="k">for </span>examples/TestOrcFile.test1.orc
File Version: 0.12 with HIVE_8732
Rows: 2
Compression: ZLIB
@@ -733,56 +733,56 @@ string>>>
Stripe Statistics:
Stripe 1:
- Column 0: count: 2 hasNull: false
- Column 1: count: 2 hasNull: false true: 1
- Column 2: count: 2 hasNull: false min: 1 max: 100 sum: 101
- Column 3: count: 2 hasNull: false min: 1024 max: 2048 sum: 3072
- Column 4: count: 2 hasNull: false min: 65536 max: 65536 sum: 131072
- Column 5: count: 2 hasNull: false min: 9223372036854775807 max: 9223372036854775807
- Column 6: count: 2 hasNull: false min: 1.0 max: 2.0 sum: 3.0
- Column 7: count: 2 hasNull: false min: -15.0 max: -5.0 sum: -20.0
- Column 8: count: 2 hasNull: false sum: 5
- Column 9: count: 2 hasNull: false min: bye max: hi sum: 5
- Column 10: count: 2 hasNull: false
- Column 11: count: 2 hasNull: false
- Column 12: count: 4 hasNull: false
- Column 13: count: 4 hasNull: false min: 1 max: 2 sum: 6
- Column 14: count: 4 hasNull: false min: bye max: sigh sum: 14
- Column 15: count: 2 hasNull: false
- Column 16: count: 5 hasNull: false
- Column 17: count: 5 hasNull: false min: -100000 max: 100000000 sum: 99901241
- Column 18: count: 5 hasNull: false min: bad max: in sum: 15
- Column 19: count: 2 hasNull: false
- Column 20: count: 2 hasNull: false min: chani max: mauddib sum: 12
- Column 21: count: 2 hasNull: false
- Column 22: count: 2 hasNull: false min: 1 max: 5 sum: 6
- Column 23: count: 2 hasNull: false min: chani max: mauddib sum: 12
+ Column 0: count: 2 hasNull: <span class="nb">false
+ </span>Column 1: count: 2 hasNull: <span class="nb">false true</span>: 1
+ Column 2: count: 2 hasNull: <span class="nb">false </span>min: 1 max: 100 sum: 101
+ Column 3: count: 2 hasNull: <span class="nb">false </span>min: 1024 max: 2048 sum: 3072
+ Column 4: count: 2 hasNull: <span class="nb">false </span>min: 65536 max: 65536 sum: 131072
+ Column 5: count: 2 hasNull: <span class="nb">false </span>min: 9223372036854775807 max: 9223372036854775807
+ Column 6: count: 2 hasNull: <span class="nb">false </span>min: 1.0 max: 2.0 sum: 3.0
+ Column 7: count: 2 hasNull: <span class="nb">false </span>min: <span class="nt">-15</span>.0 max: <span class="nt">-5</span>.0 sum: <span class="nt">-20</span>.0
+ Column 8: count: 2 hasNull: <span class="nb">false </span>sum: 5
+ Column 9: count: 2 hasNull: <span class="nb">false </span>min: bye max: hi sum: 5
+ Column 10: count: 2 hasNull: <span class="nb">false
+ </span>Column 11: count: 2 hasNull: <span class="nb">false
+ </span>Column 12: count: 4 hasNull: <span class="nb">false
+ </span>Column 13: count: 4 hasNull: <span class="nb">false </span>min: 1 max: 2 sum: 6
+ Column 14: count: 4 hasNull: <span class="nb">false </span>min: bye max: sigh sum: 14
+ Column 15: count: 2 hasNull: <span class="nb">false
+ </span>Column 16: count: 5 hasNull: <span class="nb">false
+ </span>Column 17: count: 5 hasNull: <span class="nb">false </span>min: <span class="nt">-100000</span> max: 100000000 sum: 99901241
+ Column 18: count: 5 hasNull: <span class="nb">false </span>min: bad max: <span class="k">in </span>sum: 15
+ Column 19: count: 2 hasNull: <span class="nb">false
+ </span>Column 20: count: 2 hasNull: <span class="nb">false </span>min: chani max: mauddib sum: 12
+ Column 21: count: 2 hasNull: <span class="nb">false
+ </span>Column 22: count: 2 hasNull: <span class="nb">false </span>min: 1 max: 5 sum: 6
+ Column 23: count: 2 hasNull: <span class="nb">false </span>min: chani max: mauddib sum: 12
File Statistics:
- Column 0: count: 2 hasNull: false
- Column 1: count: 2 hasNull: false true: 1
- Column 2: count: 2 hasNull: false min: 1 max: 100 sum: 101
- Column 3: count: 2 hasNull: false min: 1024 max: 2048 sum: 3072
- Column 4: count: 2 hasNull: false min: 65536 max: 65536 sum: 131072
- Column 5: count: 2 hasNull: false min: 9223372036854775807 max: 9223372036854775807
- Column 6: count: 2 hasNull: false min: 1.0 max: 2.0 sum: 3.0
- Column 7: count: 2 hasNull: false min: -15.0 max: -5.0 sum: -20.0
- Column 8: count: 2 hasNull: false sum: 5
- Column 9: count: 2 hasNull: false min: bye max: hi sum: 5
- Column 10: count: 2 hasNull: false
- Column 11: count: 2 hasNull: false
- Column 12: count: 4 hasNull: false
- Column 13: count: 4 hasNull: false min: 1 max: 2 sum: 6
- Column 14: count: 4 hasNull: false min: bye max: sigh sum: 14
- Column 15: count: 2 hasNull: false
- Column 16: count: 5 hasNull: false
- Column 17: count: 5 hasNull: false min: -100000 max: 100000000 sum: 99901241
- Column 18: count: 5 hasNull: false min: bad max: in sum: 15
- Column 19: count: 2 hasNull: false
- Column 20: count: 2 hasNull: false min: chani max: mauddib sum: 12
- Column 21: count: 2 hasNull: false
- Column 22: count: 2 hasNull: false min: 1 max: 5 sum: 6
- Column 23: count: 2 hasNull: false min: chani max: mauddib sum: 12
+ Column 0: count: 2 hasNull: <span class="nb">false
+ </span>Column 1: count: 2 hasNull: <span class="nb">false true</span>: 1
+ Column 2: count: 2 hasNull: <span class="nb">false </span>min: 1 max: 100 sum: 101
+ Column 3: count: 2 hasNull: <span class="nb">false </span>min: 1024 max: 2048 sum: 3072
+ Column 4: count: 2 hasNull: <span class="nb">false </span>min: 65536 max: 65536 sum: 131072
+ Column 5: count: 2 hasNull: <span class="nb">false </span>min: 9223372036854775807 max: 9223372036854775807
+ Column 6: count: 2 hasNull: <span class="nb">false </span>min: 1.0 max: 2.0 sum: 3.0
+ Column 7: count: 2 hasNull: <span class="nb">false </span>min: <span class="nt">-15</span>.0 max: <span class="nt">-5</span>.0 sum: <span class="nt">-20</span>.0
+ Column 8: count: 2 hasNull: <span class="nb">false </span>sum: 5
+ Column 9: count: 2 hasNull: <span class="nb">false </span>min: bye max: hi sum: 5
+ Column 10: count: 2 hasNull: <span class="nb">false
+ </span>Column 11: count: 2 hasNull: <span class="nb">false
+ </span>Column 12: count: 4 hasNull: <span class="nb">false
+ </span>Column 13: count: 4 hasNull: <span class="nb">false </span>min: 1 max: 2 sum: 6
+ Column 14: count: 4 hasNull: <span class="nb">false </span>min: bye max: sigh sum: 14
+ Column 15: count: 2 hasNull: <span class="nb">false
+ </span>Column 16: count: 5 hasNull: <span class="nb">false
+ </span>Column 17: count: 5 hasNull: <span class="nb">false </span>min: <span class="nt">-100000</span> max: 100000000 sum: 99901241
+ Column 18: count: 5 hasNull: <span class="nb">false </span>min: bad max: <span class="k">in </span>sum: 15
+ Column 19: count: 2 hasNull: <span class="nb">false
+ </span>Column 20: count: 2 hasNull: <span class="nb">false </span>min: chani max: mauddib sum: 12
+ Column 21: count: 2 hasNull: <span class="nb">false
+ </span>Column 22: count: 2 hasNull: <span class="nb">false </span>min: 1 max: 5 sum: 6
+ Column 23: count: 2 hasNull: <span class="nb">false </span>min: chani max: mauddib sum: 12
Stripes:
Stripe: offset: 3 data: 243 rows: 2 tail: 199 index: 570
@@ -865,7 +865,7 @@ File length: 1711 bytes
Padding length: 0 bytes
Padding ratio: 0%
______________________________________________________________________
-</code></pre>
+</code></pre></div></div>
<h2 id="java-data">Java Data</h2>
@@ -993,8 +993,6 @@ to include all of the observed values.</p>
-
-
@@ -1014,29 +1012,25 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/index.html">Background</a></li>
+ <li class=""><a href="http://localhost:4000/docs/index.html">Background</a></li>
-
-
- <li class=""><a href="/docs/adopters.html">ORC Adopters</a></li>
+ <li class=""><a href="http://localhost:4000/docs/adopters.html">ORC Adopters</a></li>
-
-
@@ -1068,15 +1062,13 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/types.html">Types</a></li>
+ <li class=""><a href="http://localhost:4000/docs/types.html">Types</a></li>
-
-
@@ -1098,19 +1090,17 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/indexes.html">Indexes</a></li>
+ <li class=""><a href="http://localhost:4000/docs/indexes.html">Indexes</a></li>
-
-
- <li class=""><a href="/docs/acid.html">ACID support</a></li>
+ <li class=""><a href="http://localhost:4000/docs/acid.html">ACID support</a></li>
@@ -1125,8 +1115,6 @@ to include all of the observed values.</p>
-
-
@@ -1134,15 +1122,13 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/building.html">Building ORC</a></li>
+ <li class=""><a href="http://localhost:4000/docs/building.html">Building ORC</a></li>
-
-
@@ -1172,7 +1158,7 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/releases.html">Releases</a></li>
+ <li class=""><a href="http://localhost:4000/docs/releases.html">Releases</a></li>
@@ -1187,8 +1173,6 @@ to include all of the observed values.</p>
-
-
@@ -1206,15 +1190,13 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/hive-ddl.html">Hive DDL</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-ddl.html">Hive DDL</a></li>
-
-
@@ -1230,7 +1212,7 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/hive-config.html">Hive Configuration</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-config.html">Hive Configuration</a></li>
@@ -1245,8 +1227,6 @@ to include all of the observed values.</p>
-
-
@@ -1272,15 +1252,13 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/mapred.html">Using in MapRed</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapred.html">Using in MapRed</a></li>
-
-
@@ -1308,7 +1286,7 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/mapreduce.html">Using in MapReduce</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</a></li>
@@ -1323,8 +1301,6 @@ to include all of the observed values.</p>
-
-
@@ -1336,15 +1312,13 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/core-java.html">Using Core Java</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-java.html">Using Core Java</a></li>
-
-
@@ -1354,7 +1328,7 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/core-cpp.html">Using Core C++</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-cpp.html">Using Core C++</a></li>
@@ -1369,8 +1343,6 @@ to include all of the observed values.</p>
-
-
@@ -1384,15 +1356,13 @@ to include all of the observed values.</p>
- <li class=""><a href="/docs/cpp-tools.html">C++ Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/cpp-tools.html">C++ Tools</a></li>
-
-
@@ -1416,7 +1386,7 @@ to include all of the observed values.</p>
- <li class="current"><a href="/docs/java-tools.html">Java Tools</a></li>
+ <li class="current"><a href="http://localhost:4000/docs/java-tools.html">Java Tools</a></li>
http://git-wip-us.apache.org/repos/asf/orc/blob/e58d3fc4/docs/mapred.html
----------------------------------------------------------------------
diff --git a/docs/mapred.html b/docs/mapred.html
index ab932db..d23b006 100644
--- a/docs/mapred.html
+++ b/docs/mapred.html
@@ -4,7 +4,7 @@
<meta charset="UTF-8">
<title>Using in MapRed</title>
<meta name="viewport" content="width=device-width,initial-scale=1">
- <meta name="generator" content="Jekyll v2.4.0">
+ <meta name="generator" content="Jekyll v3.7.3">
<link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900">
<link rel="stylesheet" href="/css/screen.css">
<link rel="icon" type="image/x-icon" href="/favicon.ico">
@@ -109,7 +109,7 @@
- <option value="/docs/index.html">Background</option>
+ <option value="http://localhost:4000/docs/index.html">Background</option>
@@ -131,7 +131,7 @@
- <option value="/docs/adopters.html">ORC Adopters</option>
+ <option value="http://localhost:4000/docs/adopters.html">ORC Adopters</option>
@@ -193,7 +193,7 @@
- <option value="/docs/types.html">Types</option>
+ <option value="http://localhost:4000/docs/types.html">Types</option>
@@ -219,7 +219,7 @@
- <option value="/docs/indexes.html">Indexes</option>
+ <option value="http://localhost:4000/docs/indexes.html">Indexes</option>
@@ -237,7 +237,7 @@
- <option value="/docs/acid.html">ACID support</option>
+ <option value="http://localhost:4000/docs/acid.html">ACID support</option>
@@ -284,7 +284,7 @@
- <option value="/docs/building.html">Building ORC</option>
+ <option value="http://localhost:4000/docs/building.html">Building ORC</option>
@@ -342,7 +342,7 @@
- <option value="/docs/releases.html">Releases</option>
+ <option value="http://localhost:4000/docs/releases.html">Releases</option>
@@ -373,7 +373,7 @@
- <option value="/docs/hive-ddl.html">Hive DDL</option>
+ <option value="http://localhost:4000/docs/hive-ddl.html">Hive DDL</option>
@@ -407,7 +407,7 @@
- <option value="/docs/hive-config.html">Hive Configuration</option>
+ <option value="http://localhost:4000/docs/hive-config.html">Hive Configuration</option>
@@ -460,7 +460,7 @@
- <option value="/docs/mapred.html">Using in MapRed</option>
+ <option value="http://localhost:4000/docs/mapred.html">Using in MapRed</option>
@@ -498,7 +498,7 @@
- <option value="/docs/mapreduce.html">Using in MapReduce</option>
+ <option value="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</option>
@@ -525,7 +525,7 @@
- <option value="/docs/core-java.html">Using Core Java</option>
+ <option value="http://localhost:4000/docs/core-java.html">Using Core Java</option>
@@ -559,7 +559,7 @@
- <option value="/docs/core-cpp.html">Using Core C++</option>
+ <option value="http://localhost:4000/docs/core-cpp.html">Using Core C++</option>
@@ -606,7 +606,7 @@
- <option value="/docs/cpp-tools.html">C++ Tools</option>
+ <option value="http://localhost:4000/docs/cpp-tools.html">C++ Tools</option>
@@ -652,7 +652,7 @@
- <option value="/docs/java-tools.html">Java Tools</option>
+ <option value="http://localhost:4000/docs/java-tools.html">Java Tools</option>
@@ -676,31 +676,31 @@
<h1>Using in MapRed</h1>
<p>This page describes how to read and write ORC files from Hadoop’s
older org.apache.hadoop.mapred MapReduce APIs. If you want to use the
-new org.apache.hadoop.mapreduce API, please look at the <a href="/docs/mapreduce.html">next
+new org.apache.hadoop.mapreduce API, please look at the <a href="http://localhost:4000/docs/mapreduce.html">next
page</a>.</p>
<h2 id="reading-orc-files">Reading ORC files</h2>
-<p>Add ORC and your desired version of Hadoop to your <code>pom.xml</code>:</p>
-
-<pre><code class="language-xml"><dependencies>
- <dependency>
- <groupId>org.apache.orc</groupId>
- <artifactId>orc-mapreduce</artifactId>
- <version>1.1.0</version>
- </dependency>
- <dependency>
- <groupId>org.apache.hadoop</groupId>
- <artifactId>hadoop-mapreduce-client-core</artifactId>
- <version>2.7.0</version>
- </dependency>
-</dependencies>
-</code></pre>
+<p>Add ORC and your desired version of Hadoop to your <code class="highlighter-rouge">pom.xml</code>:</p>
+
+<div class="language-xml highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="nt"><dependencies></span>
+ <span class="nt"><dependency></span>
+ <span class="nt"><groupId></span>org.apache.orc<span class="nt"></groupId></span>
+ <span class="nt"><artifactId></span>orc-mapreduce<span class="nt"></artifactId></span>
+ <span class="nt"><version></span>1.1.0<span class="nt"></version></span>
+ <span class="nt"></dependency></span>
+ <span class="nt"><dependency></span>
+ <span class="nt"><groupId></span>org.apache.hadoop<span class="nt"></groupId></span>
+ <span class="nt"><artifactId></span>hadoop-mapreduce-client-core<span class="nt"></artifactId></span>
+ <span class="nt"><version></span>2.7.0<span class="nt"></version></span>
+ <span class="nt"></dependency></span>
+<span class="nt"></dependencies></span>
+</code></pre></div></div>
<p>Set the minimal properties in your JobConf:</p>
<ul>
- <li><strong>mapreduce.job.inputformat.class</strong> = <a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcInputFormat.html">org.apache.orc.mapred.OrcInputFormat</a></li>
+ <li><strong>mapreduce.job.inputformat.class</strong> = <a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcInputFormat.html">org.apache.orc.mapred.OrcInputFormat</a></li>
<li><strong>mapreduce.input.fileinputformat.inputdir</strong> = your input directory</li>
</ul>
@@ -723,7 +723,7 @@ the key and a value based on the table below expanded recursively.</p>
<tbody>
<tr>
<td>array</td>
- <td><a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcStruct.html">org.apache.orc.mapred.OrcList</a></td>
+ <td><a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcStruct.html">org.apache.orc.mapred.OrcList</a></td>
</tr>
<tr>
<td>binary</td>
@@ -743,11 +743,11 @@ the key and a value based on the table below expanded recursively.</p>
</tr>
<tr>
<td>date</td>
- <td><a href="/api/hive-storage-api/index.html?org/apache/hadoop/hive/serde2/io/DateWritable.html">org.apache.hadoop.hive.serde2.io.DateWritable</a></td>
+ <td><a href="http://localhost:4000/api/hive-storage-api/index.html?org/apache/hadoop/hive/serde2/io/DateWritable.html">org.apache.hadoop.hive.serde2.io.DateWritable</a></td>
</tr>
<tr>
<td>decimal</td>
- <td><a href="/api/hive-storage-api/index.html?org/apache/hadoop/hive/serde2/io/HiveDecimalWritable.html">org.apache.hadoop.hive.serde2.io.HiveDecimalWritable</a></td>
+ <td><a href="http://localhost:4000/api/hive-storage-api/index.html?org/apache/hadoop/hive/serde2/io/HiveDecimalWritable.html">org.apache.hadoop.hive.serde2.io.HiveDecimalWritable</a></td>
</tr>
<tr>
<td>double</td>
@@ -763,7 +763,7 @@ the key and a value based on the table below expanded recursively.</p>
</tr>
<tr>
<td>map</td>
- <td><a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcMap.html">org.apache.orc.mapred.OrcMap</a></td>
+ <td><a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcMap.html">org.apache.orc.mapred.OrcMap</a></td>
</tr>
<tr>
<td>smallint</td>
@@ -775,11 +775,11 @@ the key and a value based on the table below expanded recursively.</p>
</tr>
<tr>
<td>struct</td>
- <td><a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcStruct.html">org.apache.orc.mapred.OrcStruct</a></td>
+ <td><a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcStruct.html">org.apache.orc.mapred.OrcStruct</a></td>
</tr>
<tr>
<td>timestamp</td>
- <td><a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcTimestamp.html">org.apache.orc.mapred.OrcTimestamp</a></td>
+ <td><a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcTimestamp.html">org.apache.orc.mapred.OrcTimestamp</a></td>
</tr>
<tr>
<td>tinyint</td>
@@ -787,7 +787,7 @@ the key and a value based on the table below expanded recursively.</p>
</tr>
<tr>
<td>uniontype</td>
- <td><a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcUnion.html">org.apache.orc.mapred.OrcUnion</a></td>
+ <td><a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcUnion.html">org.apache.orc.mapred.OrcUnion</a></td>
</tr>
<tr>
<td>varchar</td>
@@ -797,33 +797,33 @@ the key and a value based on the table below expanded recursively.</p>
</table>
<p>Let’s assume that your input directory contains ORC files with the
-schema <code>struct<s:string,i:int></code> and you want to use the string field
+schema <code class="highlighter-rouge">struct<s:string,i:int></code> and you want to use the string field
as the key to the MapReduce shuffle and the integer as the value. The
mapper code would look like:</p>
-<pre><code class="language-java">public class MyMapper
- implements Mapper<NullWritable,OrcStruct,Text,IntWritable> {
+<div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="kd">public</span> <span class="kd">class</span> <span class="nc">MyMapper</span>
+ <span class="kd">implements</span> <span class="n">Mapper</span><span class="o"><</span><span class="n">NullWritable</span><span class="o">,</span><span class="n">OrcStruct</span><span class="o">,</span><span class="n">Text</span><span class="o">,</span><span class="n">IntWritable</span><span class="o">></span> <span class="o">{</span>
- // Input should be: struct<s:string,i:int>
- public void map(NullWritable key, OrcStruct value,
- OutputCollector<Text,IntWritable> output,
- Reporter reporter) throws IOException {
- output.collect((Text) value.getFieldValue(0),
- (IntWritable) value.getFieldValue(1));
- }
+ <span class="c1">// Input should be: struct<s:string,i:int></span>
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">map</span><span class="o">(</span><span class="n">NullWritable</span> <span class="n">key</span><span class="o">,</span> <span class="n">OrcStruct</span> <span class="n">value</span><span class="o">,</span>
+ <span class="n">OutputCollector</span><span class="o"><</span><span class="n">Text</span><span class="o">,</span><span class="n">IntWritable</span><span class="o">></span> <span class="n">output</span><span class="o">,</span>
+ <span class="n">Reporter</span> <span class="n">reporter</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">IOException</span> <span class="o">{</span>
+ <span class="n">output</span><span class="o">.</span><span class="na">collect</span><span class="o">((</span><span class="n">Text</span><span class="o">)</span> <span class="n">value</span><span class="o">.</span><span class="na">getFieldValue</span><span class="o">(</span><span class="mi">0</span><span class="o">),</span>
+ <span class="o">(</span><span class="n">IntWritable</span><span class="o">)</span> <span class="n">value</span><span class="o">.</span><span class="na">getFieldValue</span><span class="o">(</span><span class="mi">1</span><span class="o">));</span>
+ <span class="o">}</span>
- public void configure(JobConf conf) { }
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">configure</span><span class="o">(</span><span class="n">JobConf</span> <span class="n">conf</span><span class="o">)</span> <span class="o">{</span> <span class="o">}</span>
- public void close() { }
-}
-</code></pre>
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">close</span><span class="o">()</span> <span class="o">{</span> <span class="o">}</span>
+<span class="o">}</span>
+</code></pre></div></div>
<h2 id="writing-orc-files">Writing ORC files</h2>
<p>To write ORC files from your MapReduce job, you’ll need to set</p>
<ul>
- <li><strong>mapreduce.job.outputformat.class</strong> = <a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcOutputFormat.html">org.apache.orc.mapred.OrcOutputFormat</a></li>
+ <li><strong>mapreduce.job.outputformat.class</strong> = <a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcOutputFormat.html">org.apache.orc.mapred.OrcOutputFormat</a></li>
<li><strong>mapreduce.output.fileoutputformat.outputdir</strong> = your output directory</li>
<li><strong>orc.mapred.output.schema</strong> = the schema to write to the ORC file</li>
</ul>
@@ -833,38 +833,38 @@ file and typically uses the OrcStruct.createValue(TypeDescription)
function. For our example, let’s assume that the shuffle types are
(Text, IntWritable) from the previous section and the reduce should
gather the integer for each key together and write them as a list. The
-output schema would be <code>struct<key:string,ints:array<int>></code>. As always
+output schema would be <code class="highlighter-rouge">struct<key:string,ints:array<int>></code>. As always
with MapReduce, if your method stores the values, you need to copy their
value before getting the next.</p>
-<pre><code class="language-java">public static class MyReducer
- implements Reducer<Text,IntWritable,NullWritable,OrcStruct> {
-
- private TypeDescription schema =
- TypeDescription.fromString("struct<key:string,ints:array<int>>");
- // createValue creates the correct value type for the schema
- private OrcStruct pair = (OrcStruct) OrcStruct.createValue(schema);
- // get a handle to the list of ints
- private OrcList<IntWritable> values =
- (OrcList<IntWritable>) pair.getFieldValue(1);
- private final NullWritable nada = NullWritable.get();
-
- public void reduce(Text key, Iterator<IntWritable> iterator,
- OutputCollector<NullWritable, OrcStruct> output,
- Reporter reporter) throws IOException {
- pair.setFieldValue(0, key);
- values.clear();
- while (iterator.hasNext()) {
- values.add(new IntWritable(iterator.next().get()));
- }
- output.collect(nada, pair);
- }
-
- public void configure(JobConf conf) { }
-
- public void close() { }
-}
-</code></pre>
+<div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="kd">public</span> <span class="kd">static</span> <span class="kd">class</span> <span class="nc">MyReducer</span>
+ <span class="kd">implements</span> <span class="n">Reducer</span><span class="o"><</span><span class="n">Text</span><span class="o">,</span><span class="n">IntWritable</span><span class="o">,</span><span class="n">NullWritable</span><span class="o">,</span><span class="n">OrcStruct</span><span class="o">></span> <span class="o">{</span>
+
+ <span class="kd">private</span> <span class="n">TypeDescription</span> <span class="n">schema</span> <span class="o">=</span>
+ <span class="n">TypeDescription</span><span class="o">.</span><span class="na">fromString</span><span class="o">(</span><span class="s">"struct<key:string,ints:array<int>>"</span><span class="o">);</span>
+ <span class="c1">// createValue creates the correct value type for the schema</span>
+ <span class="kd">private</span> <span class="n">OrcStruct</span> <span class="n">pair</span> <span class="o">=</span> <span class="o">(</span><span class="n">OrcStruct</span><span class="o">)</span> <span class="n">OrcStruct</span><span class="o">.</span><span class="na">createValue</span><span class="o">(</span><span class="n">schema</span><span class="o">);</span>
+ <span class="c1">// get a handle to the list of ints</span>
+ <span class="kd">private</span> <span class="n">OrcList</span><span class="o"><</span><span class="n">IntWritable</span><span class="o">></span> <span class="n">values</span> <span class="o">=</span>
+ <span class="o">(</span><span class="n">OrcList</span><span class="o"><</span><span class="n">IntWritable</span><span class="o">>)</span> <span class="n">pair</span><span class="o">.</span><span class="na">getFieldValue</span><span class="o">(</span><span class="mi">1</span><span class="o">);</span>
+ <span class="kd">private</span> <span class="kd">final</span> <span class="n">NullWritable</span> <span class="n">nada</span> <span class="o">=</span> <span class="n">NullWritable</span><span class="o">.</span><span class="na">get</span><span class="o">();</span>
+
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">reduce</span><span class="o">(</span><span class="n">Text</span> <span class="n">key</span><span class="o">,</span> <span class="n">Iterator</span><span class="o"><</span><span class="n">IntWritable</span><span class="o">></span> <span class="n">iterator</span><span class="o">,</span>
+ <span class="n">OutputCollector</span><span class="o"><</span><span class="n">NullWritable</span><span class="o">,</span> <span class="n">OrcStruct</span><span class="o">></span> <span class="n">output</span><span class="o">,</span>
+ <span class="n">Reporter</span> <span class="n">reporter</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">IOException</span> <span class="o">{</span>
+ <span class="n">pair</span><span class="o">.</span><span class="na">setFieldValue</span><span class="o">(</span><span class="mi">0</span><span class="o">,</span> <span class="n">key</span><span class="o">);</span>
+ <span class="n">values</span><span class="o">.</span><span class="na">clear</span><span class="o">();</span>
+ <span class="k">while</span> <span class="o">(</span><span class="n">iterator</span><span class="o">.</span><span class="na">hasNext</span><span class="o">())</span> <span class="o">{</span>
+ <span class="n">values</span><span class="o">.</span><span class="na">add</span><span class="o">(</span><span class="k">new</span> <span class="n">IntWritable</span><span class="o">(</span><span class="n">iterator</span><span class="o">.</span><span class="na">next</span><span class="o">().</span><span class="na">get</span><span class="o">()));</span>
+ <span class="o">}</span>
+ <span class="n">output</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="n">nada</span><span class="o">,</span> <span class="n">pair</span><span class="o">);</span>
+ <span class="o">}</span>
+
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">configure</span><span class="o">(</span><span class="n">JobConf</span> <span class="n">conf</span><span class="o">)</span> <span class="o">{</span> <span class="o">}</span>
+
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">close</span><span class="o">()</span> <span class="o">{</span> <span class="o">}</span>
+<span class="o">}</span>
+</code></pre></div></div>
<h2 id="sending-orcstruct-orclist-orcmap-or-orcunion-through-the-shuffle">Sending OrcStruct, OrcList, OrcMap, or OrcUnion through the Shuffle</h2>
@@ -873,9 +873,9 @@ MapReduce shuffle. The complex ORC types, since they are generic
types, need to have their full type information provided to create the
object. To enable MapReduce to properly instantiate the OrcStruct and
other ORC types, we need to wrap it in either an
-<a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcKey.html">OrcKey</a>
+<a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcKey.html">OrcKey</a>
for the shuffle key or
-<a href="/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcValue.html">OrcValue</a>
+<a href="http://localhost:4000/api/orc-mapreduce/index.html?org/apache/orc/mapred/OrcValue.html">OrcValue</a>
for the shuffle value.</p>
<p>To send two OrcStructs through the shuffle, define the following properties
@@ -892,38 +892,38 @@ in the JobConf:</p>
respectively. These objects should be created once and reused as the mapper
runs.</p>
-<pre><code class="language-java">public static class MyMapperWithShuffle
- implements Mapper<NullWritable,OrcStruct,OrcKey,OrcValue> {
+<div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="kd">public</span> <span class="kd">static</span> <span class="kd">class</span> <span class="nc">MyMapperWithShuffle</span>
+ <span class="kd">implements</span> <span class="n">Mapper</span><span class="o"><</span><span class="n">NullWritable</span><span class="o">,</span><span class="n">OrcStruct</span><span class="o">,</span><span class="n">OrcKey</span><span class="o">,</span><span class="n">OrcValue</span><span class="o">></span> <span class="o">{</span>
- // create wrapper objects
- private OrcKey keyWrapper = new OrcKey();
- private OrcValue valueWrapper = new OrcValue();
+ <span class="c1">// create wrapper objects</span>
+ <span class="kd">private</span> <span class="n">OrcKey</span> <span class="n">keyWrapper</span> <span class="o">=</span> <span class="k">new</span> <span class="n">OrcKey</span><span class="o">();</span>
+ <span class="kd">private</span> <span class="n">OrcValue</span> <span class="n">valueWrapper</span> <span class="o">=</span> <span class="k">new</span> <span class="n">OrcValue</span><span class="o">();</span>
- // create a new structure to pass as the value in the shuffle
- private OrcStruct outStruct = (OrcStruct) OrcStruct.createValue
- (TypeDescription.fromString("struct<i:int,j:int>"));
+ <span class="c1">// create a new structure to pass as the value in the shuffle</span>
+ <span class="kd">private</span> <span class="n">OrcStruct</span> <span class="n">outStruct</span> <span class="o">=</span> <span class="o">(</span><span class="n">OrcStruct</span><span class="o">)</span> <span class="n">OrcStruct</span><span class="o">.</span><span class="na">createValue</span>
+ <span class="o">(</span><span class="n">TypeDescription</span><span class="o">.</span><span class="na">fromString</span><span class="o">(</span><span class="s">"struct<i:int,j:int>"</span><span class="o">));</span>
- // get the two fields of the outStruct
- private IntWritable i = (IntWritable) outStruct.getFieldValue("i");
- private IntWritable j = (IntWritable) outStruct.getFieldValue("j");
+ <span class="c1">// get the two fields of the outStruct</span>
+ <span class="kd">private</span> <span class="n">IntWritable</span> <span class="n">i</span> <span class="o">=</span> <span class="o">(</span><span class="n">IntWritable</span><span class="o">)</span> <span class="n">outStruct</span><span class="o">.</span><span class="na">getFieldValue</span><span class="o">(</span><span class="s">"i"</span><span class="o">);</span>
+ <span class="kd">private</span> <span class="n">IntWritable</span> <span class="n">j</span> <span class="o">=</span> <span class="o">(</span><span class="n">IntWritable</span><span class="o">)</span> <span class="n">outStruct</span><span class="o">.</span><span class="na">getFieldValue</span><span class="o">(</span><span class="s">"j"</span><span class="o">);</span>
- // Assume the input has type: struct<s:string,i:int>
- public void map(NullWritable key, OrcStruct value,
- OutputCollector<OrcKey,OrcValue> output,
- Reporter reporter) throws IOException {
- keyWrapper.key = value;
- valueWrapper.value = outStruct;
- int val = ((IntWritable) value.getFieldValue("i")).get();
- i.set(val * 2);
- j.set(val * val);
- output.collect(keyWrapper, valueWrapper);
- }
+ <span class="c1">// Assume the input has type: struct<s:string,i:int></span>
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">map</span><span class="o">(</span><span class="n">NullWritable</span> <span class="n">key</span><span class="o">,</span> <span class="n">OrcStruct</span> <span class="n">value</span><span class="o">,</span>
+ <span class="n">OutputCollector</span><span class="o"><</span><span class="n">OrcKey</span><span class="o">,</span><span class="n">OrcValue</span><span class="o">></span> <span class="n">output</span><span class="o">,</span>
+ <span class="n">Reporter</span> <span class="n">reporter</span><span class="o">)</span> <span class="kd">throws</span> <span class="n">IOException</span> <span class="o">{</span>
+ <span class="n">keyWrapper</span><span class="o">.</span><span class="na">key</span> <span class="o">=</span> <span class="n">value</span><span class="o">;</span>
+ <span class="n">valueWrapper</span><span class="o">.</span><span class="na">value</span> <span class="o">=</span> <span class="n">outStruct</span><span class="o">;</span>
+ <span class="kt">int</span> <span class="n">val</span> <span class="o">=</span> <span class="o">((</span><span class="n">IntWritable</span><span class="o">)</span> <span class="n">value</span><span class="o">.</span><span class="na">getFieldValue</span><span class="o">(</span><span class="s">"i"</span><span class="o">)).</span><span class="na">get</span><span class="o">();</span>
+ <span class="n">i</span><span class="o">.</span><span class="na">set</span><span class="o">(</span><span class="n">val</span> <span class="o">*</span> <span class="mi">2</span><span class="o">);</span>
+ <span class="n">j</span><span class="o">.</span><span class="na">set</span><span class="o">(</span><span class="n">val</span> <span class="o">*</span> <span class="n">val</span><span class="o">);</span>
+ <span class="n">output</span><span class="o">.</span><span class="na">collect</span><span class="o">(</span><span class="n">keyWrapper</span><span class="o">,</span> <span class="n">valueWrapper</span><span class="o">);</span>
+ <span class="o">}</span>
- public void configure(JobConf conf) { }
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">configure</span><span class="o">(</span><span class="n">JobConf</span> <span class="n">conf</span><span class="o">)</span> <span class="o">{</span> <span class="o">}</span>
- public void close() { }
-}
-</code></pre>
+ <span class="kd">public</span> <span class="kt">void</span> <span class="nf">close</span><span class="o">()</span> <span class="o">{</span> <span class="o">}</span>
+<span class="o">}</span>
+</code></pre></div></div>
<p>The reducer code accesses the underlying OrcStructs by using the
OrcKey.key and OrcValue.value fields.</p>
@@ -996,8 +996,6 @@ OrcKey.key and OrcValue.value fields.</p>
-
-
@@ -1017,29 +1015,25 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/index.html">Background</a></li>
+ <li class=""><a href="http://localhost:4000/docs/index.html">Background</a></li>
-
-
- <li class=""><a href="/docs/adopters.html">ORC Adopters</a></li>
+ <li class=""><a href="http://localhost:4000/docs/adopters.html">ORC Adopters</a></li>
-
-
@@ -1071,15 +1065,13 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/types.html">Types</a></li>
+ <li class=""><a href="http://localhost:4000/docs/types.html">Types</a></li>
-
-
@@ -1101,19 +1093,17 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/indexes.html">Indexes</a></li>
+ <li class=""><a href="http://localhost:4000/docs/indexes.html">Indexes</a></li>
-
-
- <li class=""><a href="/docs/acid.html">ACID support</a></li>
+ <li class=""><a href="http://localhost:4000/docs/acid.html">ACID support</a></li>
@@ -1128,8 +1118,6 @@ OrcKey.key and OrcValue.value fields.</p>
-
-
@@ -1137,15 +1125,13 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/building.html">Building ORC</a></li>
+ <li class=""><a href="http://localhost:4000/docs/building.html">Building ORC</a></li>
-
-
@@ -1175,7 +1161,7 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/releases.html">Releases</a></li>
+ <li class=""><a href="http://localhost:4000/docs/releases.html">Releases</a></li>
@@ -1190,8 +1176,6 @@ OrcKey.key and OrcValue.value fields.</p>
-
-
@@ -1209,15 +1193,13 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/hive-ddl.html">Hive DDL</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-ddl.html">Hive DDL</a></li>
-
-
@@ -1233,7 +1215,7 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/hive-config.html">Hive Configuration</a></li>
+ <li class=""><a href="http://localhost:4000/docs/hive-config.html">Hive Configuration</a></li>
@@ -1248,8 +1230,6 @@ OrcKey.key and OrcValue.value fields.</p>
-
-
@@ -1275,15 +1255,13 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class="current"><a href="/docs/mapred.html">Using in MapRed</a></li>
+ <li class="current"><a href="http://localhost:4000/docs/mapred.html">Using in MapRed</a></li>
-
-
@@ -1311,7 +1289,7 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/mapreduce.html">Using in MapReduce</a></li>
+ <li class=""><a href="http://localhost:4000/docs/mapreduce.html">Using in MapReduce</a></li>
@@ -1326,8 +1304,6 @@ OrcKey.key and OrcValue.value fields.</p>
-
-
@@ -1339,15 +1315,13 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/core-java.html">Using Core Java</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-java.html">Using Core Java</a></li>
-
-
@@ -1357,7 +1331,7 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/core-cpp.html">Using Core C++</a></li>
+ <li class=""><a href="http://localhost:4000/docs/core-cpp.html">Using Core C++</a></li>
@@ -1372,8 +1346,6 @@ OrcKey.key and OrcValue.value fields.</p>
-
-
@@ -1387,15 +1359,13 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/cpp-tools.html">C++ Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/cpp-tools.html">C++ Tools</a></li>
-
-
@@ -1419,7 +1389,7 @@ OrcKey.key and OrcValue.value fields.</p>
- <li class=""><a href="/docs/java-tools.html">Java Tools</a></li>
+ <li class=""><a href="http://localhost:4000/docs/java-tools.html">Java Tools</a></li>