You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by gi...@apache.org on 2025/07/22 07:35:58 UTC
(hive-site) branch asf-site updated: deploy: fd59afb528e81d8c4ad64b7ef2f9eba4b1abd0ea
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hive-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new ea13f63 deploy: fd59afb528e81d8c4ad64b7ef2f9eba4b1abd0ea
ea13f63 is described below
commit ea13f63cb48317602981756fa4c636f4708f500f
Author: zabetak <za...@users.noreply.github.com>
AuthorDate: Tue Jul 22 07:35:52 2025 +0000
deploy: fd59afb528e81d8c4ad64b7ef2f9eba4b1abd0ea
---
community/bylaws/index.html | 13 +-
community/index.xml | 3 +-
css/hive-theme.css | 5 +
development/index.xml | 2 +-
development/qtest/index.html | 4 +
docs/latest/158869886/index.html | 31 +-
docs/latest/27837073/index.html | 8 +
docs/latest/283118453/index.html | 20 +-
docs/latest/283118454/index.html | 11 +-
docs/latest/284790216/index.html | 10 +-
docs/latest/30151323/index.html | 13 +
docs/latest/44302539/index.html | 16 +-
docs/latest/45876173/index.html | 29 +-
docs/latest/50858744/index.html | 9 +
docs/latest/50860526/index.html | 5 +
.../latest/accumulointegration_46633569/index.html | 9 +-
.../adminmanual-configuration_27362070/index.html | 8 +
.../adminmanual-installation_27362077/index.html | 5 +
.../index.html | 22 +-
.../index.html | 26 +-
docs/latest/authdev_27362078/index.html | 9 +-
docs/latest/avroserde_27850707/index.html | 54 +---
.../column-statistics-in-hive_29131019/index.html | 21 +-
.../configuration-properties_27842758/index.html | 141 +++++----
.../index.html | 61 +++-
docs/latest/csv-serde_48202659/index.html | 12 +
.../datasketches-integration_177050456/index.html | 27 +-
docs/latest/design_27362072/index.html | 11 +-
.../latest/developerguide-udtf_27362086/index.html | 8 -
docs/latest/developerguide_27362074/index.html | 4 +
docs/latest/druid-integration_65866491/index.html | 26 +-
docs/latest/dynamicpartitions_27823715/index.html | 7 +-
docs/latest/filterpushdowndev_27362092/index.html | 13 +-
.../genericudafcasestudy_27362093/index.html | 19 +-
docs/latest/gettingstarted_27362090/index.html | 65 ++--
docs/latest/groupbywithrollup_27826238/index.html | 18 +-
docs/latest/hbasebulkload_27362088/index.html | 11 +-
docs/latest/hbaseintegration_27362089/index.html | 34 +-
.../index.html | 6 +-
.../hcatalog-authorization_34014782/index.html | 7 +-
docs/latest/hcatalog-cli_34013932/index.html | 9 +-
.../index.html | 10 +-
.../hcatalog-dynamicpartitions_34014006/index.html | 9 +-
.../hcatalog-inputoutput_34013776/index.html | 11 +-
.../hcatalog-installhcat_34013403/index.html | 9 +-
docs/latest/hcatalog-loadstore_34013511/index.html | 49 +--
.../hcatalog-notification_34014558/index.html | 9 +-
.../hcatalog-readerwriter_34013921/index.html | 9 +-
.../hcatalog-storageformats_34013997/index.html | 13 +-
.../index.html | 11 +-
docs/latest/hcatalog-usinghcat_34013260/index.html | 13 +-
docs/latest/hive-apis-overview_61326349/index.html | 6 +
docs/latest/hive-metatool_55156221/index.html | 10 -
docs/latest/hive-on-spark_42567714/index.html | 5 +
docs/latest/hive-on-tez_33296197/index.html | 9 +
docs/latest/hive-schema-tool_34835119/index.html | 10 +-
docs/latest/hive-transactions_40509723/index.html | 25 +-
docs/latest/hive-udfs_282102277/index.html | 18 +-
docs/latest/hiveclient_27362101/index.html | 9 +-
.../latest/hivederbyservermode_27362068/index.html | 17 +-
docs/latest/hivedeveloperfaq_27823747/index.html | 4 +
docs/latest/hivejdbcinterface_27362100/index.html | 17 +-
docs/latest/hiveodbc_27362099/index.html | 15 +-
docs/latest/hiveplugins_27362098/index.html | 10 +-
.../hivereplicationdevelopment_55155632/index.html | 30 +-
.../index.html | 21 +-
.../latest/hiveserver2-clients_30758725/index.html | 59 ++--
.../hiveserver2-overview_65147648/index.html | 5 +
docs/latest/home_27362069/index.html | 5 +
docs/latest/howtocommit_27362108/index.html | 13 +-
docs/latest/howtocontribute_27362107/index.html | 7 +-
docs/latest/howtorelease_27362106/index.html | 24 +-
docs/latest/index.xml | 340 ++++++++++----------
docs/latest/indexdev-bitmap_27362028/index.html | 11 +-
docs/latest/indexdev_27362104/index.html | 9 +-
.../jdbc-storage-handler_95651916/index.html | 7 +-
docs/latest/kudu-integration_133631955/index.html | 7 +-
.../languagemanual-archiving_27362031/index.html | 12 +-
.../index.html | 22 +-
docs/latest/languagemanual-cli_27362033/index.html | 11 +-
docs/latest/languagemanual-ddl_27362034/index.html | 129 ++++++--
docs/latest/languagemanual-dml_27362036/index.html | 82 +----
.../languagemanual-explain_27362037/index.html | 8 +
.../languagemanual-groupby_27362038/index.html | 8 +
.../index.html | 16 +-
.../languagemanual-indexing_31822176/index.html | 8 +
.../index.html | 44 +--
.../languagemanual-joins_27362039/index.html | 7 +-
.../languagemanual-lateralview_27362040/index.html | 8 +
docs/latest/languagemanual-lzo_33298193/index.html | 11 +-
docs/latest/languagemanual-orc_31818911/index.html | 13 +-
.../languagemanual-sampling_27362042/index.html | 8 +
.../languagemanual-select_27362043/index.html | 9 +-
.../languagemanual-sortby_27362045/index.html | 5 +
.../languagemanual-subqueries_27362044/index.html | 5 +
.../languagemanual-transform_27362047/index.html | 11 +-
.../languagemanual-types_27838462/index.html | 43 +--
docs/latest/languagemanual-udf_27362046/index.html | 43 +--
.../languagemanual-union_27362049/index.html | 15 +-
.../index.html | 7 +-
.../index.html | 8 +
.../index.html | 18 +-
docs/latest/listbucketing_27846854/index.html | 18 +-
docs/latest/llap_62689557/index.html | 13 +-
docs/latest/locking_27362050/index.html | 7 +-
.../manual-installation_283118363/index.html | 5 +
.../index.html | 13 +
.../latest/mapjoinoptimization_27362029/index.html | 6 +-
docs/latest/materialized-views_80447331/index.html | 15 +-
docs/latest/parquet_38570914/index.html | 20 +-
docs/latest/partitionedviews_27362053/index.html | 7 +-
docs/latest/presentations_27362054/index.html | 12 +-
docs/latest/query-reexecution_87298873/index.html | 8 +-
docs/latest/rcfilecat_30748712/index.html | 9 +-
.../index.html | 10 +-
docs/latest/replication_61336919/index.html | 8 +
docs/latest/scheduled-queries_145724128/index.html | 18 +-
docs/latest/serde_27362059/index.html | 11 +-
.../setting-up-hiveserver2_30758712/index.html | 46 +--
.../index.html | 14 +-
.../statisticsanddatamining_27362058/index.html | 15 +-
docs/latest/statsdev_27362062/index.html | 15 +-
.../index.html | 22 +-
.../streaming-data-ingest-v2_85477610/index.html | 15 +-
.../streaming-data-ingest_40509746/index.html | 19 +-
.../latest/teradatabinaryserde_89068127/index.html | 27 +-
docs/latest/theta-join_33293991/index.html | 35 +--
docs/latest/top-k-stats_30150275/index.html | 11 +-
docs/latest/tutorial_27362061/index.html | 56 +++-
.../unit-testing-hive-sql_61328063/index.html | 15 +-
.../index.html | 29 +-
docs/latest/user-faq_27362095/index.html | 9 +-
.../index.html | 10 +-
.../vectorized-query-execution_34838326/index.html | 5 +
docs/latest/viewdev_27362067/index.html | 9 +-
docs/latest/webhcat-configure_34015738/index.html | 9 +-
.../webhcat-installwebhcat_34015585/index.html | 10 +-
.../webhcat-reference-ddl_34015990/index.html | 7 +-
.../webhcat-reference-deletedb_34016281/index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../webhcat-reference-getdb_34016250/index.html | 7 +-
.../webhcat-reference-getdbs_34016238/index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../webhcat-reference-gettable_34016519/index.html | 7 +-
.../index.html | 7 +-
.../webhcat-reference-hive_34017180/index.html | 7 +-
.../webhcat-reference-job_34835065/index.html | 7 +-
.../webhcat-reference-jobids_34017187/index.html | 7 +-
.../webhcat-reference-jobinfo_34017194/index.html | 7 +-
.../webhcat-reference-jobs_34835057/index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../webhcat-reference-pig_34017169/index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../webhcat-reference-putdb_34016273/index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../webhcat-reference-puttable_34016540/index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../webhcat-reference-status_34015941/index.html | 7 +-
.../webhcat-reference-version_34015986/index.html | 7 +-
.../index.html | 7 +-
.../index.html | 7 +-
.../webhcat-usingwebhcat_34015492/index.html | 17 +-
index.json | 2 +-
index.xml | 345 ++++++++++-----------
176 files changed, 1967 insertions(+), 1399 deletions(-)
diff --git a/community/bylaws/index.html b/community/bylaws/index.html
index efba021..281e73e 100644
--- a/community/bylaws/index.html
+++ b/community/bylaws/index.html
@@ -121,9 +121,13 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--bylaws>Apache Hive : Bylaws</h1>
-<h1 id=apache-hive-project-bylaws>Apache Hive Project Bylaws</h1>
+<p>This document defines the bylaws under which the Apache Hive project operates. It defines the roles and responsibilities of the project, who may vote, how voting works, how conflicts are resolved, etc.</p>
+<p>Hive is a project of the <a href=http://www.apache.org/foundation/>Apache Software Foundation</a>. The foundation holds the copyright on Apache code including the code in the Hive codebase. The <a href=http://www.apache.org/foundation/faq.html>foundation FAQ</a> explains the operation and background of the foundation.</p>
+<p>Hive is typical of Apache projects in that it operates under a set of principles, known collectively as the ‘Apache Way’. If you are new to Apache development, please refer to the <a href=http://incubator.apache.org/>Incubator Project</a> for more information on how Apache projects operate.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#apache-hive-project-bylaws>Apache Hive Project Bylaws</a>
+<li><a href=#apache-hive--bylaws>Apache Hive : Bylaws</a>
<ul>
<li><a href=#roles-and-responsibilities>Roles and Responsibilities</a>
<ul>
@@ -144,9 +148,8 @@ ASF
</ul>
</li>
</ul>
-<p>This document defines the bylaws under which the Apache Hive project operates. It defines the roles and responsibilities of the project, who may vote, how voting works, how conflicts are resolved, etc.</p>
-<p>Hive is a project of the <a href=http://www.apache.org/foundation/>Apache Software Foundation</a>. The foundation holds the copyright on Apache code including the code in the Hive codebase. The <a href=http://www.apache.org/foundation/faq.html>foundation FAQ</a> explains the operation and background of the foundation.</p>
-<p>Hive is typical of Apache projects in that it operates under a set of principles, known collectively as the ‘Apache Way’. If you are new to Apache development, please refer to the <a href=http://incubator.apache.org/>Incubator Project</a> for more information on how Apache projects operate.</p>
+</nav>
+</aside>
<h2 id=roles-and-responsibilities>Roles and Responsibilities</h2>
<p>Apache projects define a set of roles with associated rights and responsibilities. These roles govern what tasks an individual may perform within the project. The roles are defined in the following sections.</p>
<h3 id=users>Users</h3>
diff --git a/community/index.xml b/community/index.xml
index 190bb07..35f9e59 100644
--- a/community/index.xml
+++ b/community/index.xml
@@ -1,5 +1,6 @@
<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Communities on Hive Site</title><link>https://hive.apache.org/community/</link><description>Recent content in Communities on Hive Site</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><lastBuildDate>Thu, 12 Dec 2024 00:00:00 +0000</lastBuildDate><atom:link href="https://hive.apache.org/community/index.xml" rel="self" type="applic [...]
-Committer Zen Contributors often ask Hive PMC members the question, &ldquo;What do I need to do in order to become a committer?</description></item><item><title>Apache Hive : Bylaws</title><link>https://hive.apache.org/community/bylaws/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/community/bylaws/</guid><description>Apache Hive : Bylaws Apache Hive Project Bylaws Apache Hive Project Bylaws Roles and Responsibilities Users Committers Submodule [...]
+Committer Zen Contributors often ask Hive PMC members the question, &ldquo;What do I need to do in order to become a committer?</description></item><item><title>Apache Hive : Bylaws</title><link>https://hive.apache.org/community/bylaws/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/community/bylaws/</guid><description>Apache Hive : Bylaws This document defines the bylaws under which the Apache Hive project operates. It defines the roles and res [...]
+Hive is a project of the Apache Software Foundation. The foundation holds the copyright on Apache code including the code in the Hive codebase. The foundation FAQ explains the operation and background of the foundation.</description></item><item><title>People</title><link>https://hive.apache.org/community/people/</link><pubDate>Wed, 14 Sep 2022 01:23:03 +0530</pubDate><guid>https://hive.apache.org/community/people/</guid><description>People Apache Hive is a community developed project. T [...]
Hive PMC Apache username Name Organization Role aihuaxu Aihua Xu Cloudera anishek Anishek Agarwal athusoo Ashish Thusoo Qubole ayushsaxena Ayush Saxena Cloudera brock Brock Noland StreamSets ctang Chaoyu Tang Cloudera cws Carl Steinbach LinkedIn denys Denys Kuzmenko Cloudera daijy Daniel Dai Hortonworks ecapriolo Edward Capriolo gopalv Gopal Vijayaraghavan Hortonworks gunther Gunther Hagleitner Hortonworks hashutosh Ashutosh Chauhan Hortonworks heyongqiang Yongqiang He Dropbox jcamacho J [...]
Search the JIRA database. Check the user mailing list, both by searching the archives and by asking questions.</description></item><item><title>Mailing Lists</title><link>https://hive.apache.org/community/mailinglists/</link><pubDate>Wed, 14 Sep 2022 01:01:04 +0530</pubDate><guid>https://hive.apache.org/community/mailinglists/</guid><description>Mailing Lists We welcome you to join our mailing lists and let us know about your thoughts or ideas about Hive.
User Mailing List The user list is for general discussion or questions on using Hive. Hive developers monitor this list and provide assistance when needed.
diff --git a/css/hive-theme.css b/css/hive-theme.css
index b641834..a70ee9f 100644
--- a/css/hive-theme.css
+++ b/css/hive-theme.css
@@ -352,6 +352,11 @@ li {
font-size: 1.2rem;
}
+/* Hide empty list bullets inside the table of contents */
+.table-of-contents li:not(:has(a)) {
+ display: none;
+}
+
pre,
code {
font-family: 'Segoe UI', Tahoma, Geneva, Verdana, sans-serif;
diff --git a/development/index.xml b/development/index.xml
index f95dfbb..5e4951a 100644
--- a/development/index.xml
+++ b/development/index.xml
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Developments on Hive Site</title><link>https://hive.apache.org/development/</link><description>Recent content in Developments on Hive Site</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><lastBuildDate>Fri, 28 Mar 2025 00:00:00 +0000</lastBuildDate><atom:link href="https://hive.apache.org/development/index.xml" rel="self" type=" [...]
-Tutorial: How to run a specific test case Preparation Run a test case Tutorial: How to add a new test case Add a QFile Generate a result file Verify the new result file Commandline options Test options Test Iceberg, Accumulo, or Kudu QTestOptionHandler: pre/post-processor Using test data Mask non-deterministic outputs Advanced Locations of log files Negative tests How to specify drivers How to use PostgreSQL/MySQL/Oracle as a backend database for Hive Metastore Remote debug Tips for Addi [...]
+Query File Test(qtest) Tutorial: How to run a specific test case Preparation Run a test case Tutorial: How to add a new test case Add a QFile Generate a result file Verify the new result file Commandline options Test options Test Iceberg, Accumulo, or Kudu QTestOptionHandler: pre/post-processor Using test data Mask non-deterministic outputs Advanced Locations of log files Negative tests How to specify drivers How to use PostgreSQL/MySQL/Oracle as a backend database for Hive Metastore Rem [...]
Quickstart STEP 1: Pull the image Pull the image from DockerHub: https://hub.docker.com/r/apache/hive/tags. Here are the latest images: 4.0.0 3.1.3 docker pull apache/hive:4.0.0
STEP 2: Export the Hive version export HIVE_VERSION=4.0.0
STEP 3: Launch the HiveServer2 with an embedded Metastore.</description></item><item><title>Getting Started</title><link>https://hive.apache.org/development/gettingstarted/</link><pubDate>Tue, 10 Jan 2023 12:35:11 +0530</pubDate><guid>https://hive.apache.org/development/gettingstarted/</guid><description>The Apache Hive ™ data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Structure can be projected onto data alread [...]
diff --git a/development/qtest/index.html b/development/qtest/index.html
index 6665fe4..a73f00d 100644
--- a/development/qtest/index.html
+++ b/development/qtest/index.html
@@ -125,6 +125,8 @@ ASF
<aside class=table-of-contents>
<nav id=TableOfContents>
<ul>
+<li><a href=#query-file-testqtest>Query File Test(qtest)</a>
+<ul>
<li><a href=#tutorial-how-to-run-a-specific-test-case>Tutorial: How to run a specific test case</a>
<ul>
<li><a href=#preparation>Preparation</a></li>
@@ -161,6 +163,8 @@ ASF
</li>
<li><a href=#tips-for-adding-new-tests-in-hive>Tips for Adding New Tests in Hive</a></li>
</ul>
+</li>
+</ul>
</nav>
</aside>
<h2 id=tutorial-how-to-run-a-specific-test-case>Tutorial: How to run a specific test case</h2>
diff --git a/docs/latest/158869886/index.html b/docs/latest/158869886/index.html
index 56c8da0..a1fc3f6 100644
--- a/docs/latest/158869886/index.html
+++ b/docs/latest/158869886/index.html
@@ -121,9 +121,14 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--enabling-grpc-in-hivehive-metastore-proposal>Apache Hive : Enabling gRPC in Hive/Hive Metastore (Proposal)</h1>
-<p>Contacts: Cameron Moberg (Google), Zhou Fang (Google), Feng Lu (Google), Thejas Nair (Cloudera), Vihang Karajgaonkar (Cloudera), Naveen Gangam (Cloudera)</p>
-<p>Last upated: 7/31/2020</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--enabling-grpc-in-hivehive-metastore-proposal>Apache Hive : Enabling gRPC in Hive/Hive Metastore (Proposal)</a>
+<ul>
+<li><a href=#contacts>Contacts</a></li>
+</ul>
+</li>
<li><a href=#objective>Objective</a></li>
<li><a href=#background>Background</a></li>
<li><a href=#design>Design</a>
@@ -132,25 +137,23 @@ ASF
<li><a href=#implementation>Implementation</a>
<ul>
<li><a href=#pluggable-grpc-support>Pluggable gRPC Support</a></li>
-<li><a href=#hive-metastore-server>Hive Metastore Server</a>
-<ul>
-<li><a href=#class-change>Class Change</a></li>
-<li><a href=#config-changes>Config Changes</a></li>
-</ul>
-</li>
-<li><a href=#hive-metastore-client>Hive Metastore Client</a>
-<ul>
-<li><a href=#class-change>Class Change</a></li>
-<li><a href=#configuration-changes>Configuration Changes</a></li>
+<li><a href=#hive-metastore-server>Hive Metastore Server</a></li>
+<li><a href=#hive-metastore-client>Hive Metastore Client</a></li>
</ul>
</li>
</ul>
</li>
+<li><a href=#summary>Summary</a></li>
+<li><a href=#future-work>Future Work</a>
+<ul>
+<li><a href=#attachments>Attachments:</a></li>
</ul>
</li>
-<li><a href=#summary>Summary</a></li>
-<li><a href=#future-work>Future Work</a></li>
</ul>
+</nav>
+</aside>
+<h2 id=contacts>Contacts</h2>
+<p>Cameron Moberg (Google), Zhou Fang (Google), Feng Lu (Google), Thejas Nair (Cloudera), Vihang Karajgaonkar (Cloudera), Naveen Gangam (Cloudera)</p>
<h1 id=objective>Objective</h1>
<ul>
<li>To modernize <a href=https://cwiki.apache.org/confluence/display/Hive/AdminManual+Metastore+3.0+Administration>Hive Metastore’s</a> interface with a state-of-the-art serving layer based on gRPC while also keeping it backwards compatible with Thrift for minimal upgrade toil;</li>
diff --git a/docs/latest/27837073/index.html b/docs/latest/27837073/index.html
index 02e95be..a5a4224 100644
--- a/docs/latest/27837073/index.html
+++ b/docs/latest/27837073/index.html
@@ -122,10 +122,18 @@ ASF
<div class=docs>
<h1 id=apache-hive--hive-across-multiple-data-centers-physical-clusters>Apache Hive : Hive across Multiple Data Centers (Physical Clusters)</h1>
<p>This project has been abandoned. We’re leaving the design doc here in case someone decides to attempt this project in the future.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--hive-across-multiple-data-centers-physical-clusters>Apache Hive : Hive across Multiple Data Centers (Physical Clusters)</a>
<ul>
<li><a href=#use-cases>Use Cases</a></li>
<li><a href=#requirements>Requirements</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=use-cases>Use Cases</h2>
<p>Inside facebook, we are running out of power inside a data center (physical cluster), and we have a need to have a bigger cluster.</p>
<p>We can divide the cluster into multiple clusters - multiple hive instances, multiple mr and multiple dfs. This will put a burden on</p>
diff --git a/docs/latest/283118453/index.html b/docs/latest/283118453/index.html
index 7d509d6..60ebdff 100644
--- a/docs/latest/283118453/index.html
+++ b/docs/latest/283118453/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-transactions-hive-acid>Apache Hive : Hive Transactions (Hive ACID)</h1>
-<h1 id=acid-and-transactions-in-hive>ACID and Transactions in Hive</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#acid-and-transactions-in-hive>ACID and Transactions in Hive</a>
+<li><a href=#apache-hive--hive-transactions-hive-acid>Apache Hive : Hive Transactions (Hive ACID)</a>
<ul>
<li><a href=#what-is-acid-and-why-should-you-use-it>What is ACID and why should you use it?</a></li>
<li><a href=#limitations>Limitations</a></li>
@@ -132,23 +133,14 @@ ASF
<li><a href=#basic-design>Basic Design</a>
<ul>
<li><a href=#base-and-delta-directories>Base and Delta Directories</a></li>
-<li><a href=#compactor>Compactor</a>
-<ul>
-<li><a href=#delta-file-compaction>Delta File Compaction</a></li>
-<li><a href=#initiator>Initiator</a></li>
-<li><a href=#worker>Worker</a></li>
-<li><a href=#cleaner>Cleaner</a></li>
-<li><a href=#acidhousekeeperservice>AcidHouseKeeperService</a></li>
-<li><a href=#show-compactions>SHOW COMPACTIONS</a></li>
-</ul>
-</li>
+<li><a href=#compactor>Compactor</a></li>
<li><a href=#transactionlock-manager>Transaction/Lock Manager</a></li>
</ul>
</li>
<li><a href=#configuration>Configuration</a>
<ul>
<li><a href=#new-configuration-parameters-for-transactions>New Configuration Parameters for Transactions</a></li>
-<li><a href=#configuration-values-to-set-for-hive-acid--insert,-update,-delete->Configuration Values to Set for Hive ACID (INSERT, UPDATE, DELETE)</a></li>
+<li><a href=#configuration-values-to-set-for-hive-acid-insert-update-delete>Configuration Values to Set for Hive ACID (<em>INSERT, UPDATE, DELETE)</em></a></li>
<li><a href=#configuration-values-to-set-for-compaction>Configuration Values to Set for Compaction</a></li>
<li><a href=#compaction-pooling>Compaction pooling</a></li>
</ul>
@@ -158,6 +150,8 @@ ASF
</li>
<li><a href=#talks-and-presentations>Talks and Presentations</a></li>
</ul>
+</nav>
+</aside>
<h2 id=what-is-acid-and-why-should-you-use-it>What is ACID and why should you use it?</h2>
<p>ACID stands for four traits of database transactions: Atomicity (an operation either succeeds completely or fails, it does not leave partial data), Consistency (once an application performs an operation the results of that operation are visible to it in every subsequent operation), <a href=https://en.wikipedia.org/wiki/Isolation_(database_systems)>Isolation</a> (an incomplete operation by one user does not cause unexpected side effects for other users), and Durability (once an operat [...]
<p>Transactions with ACID semantics have been added to Hive to address the following use cases:</p>
diff --git a/docs/latest/283118454/index.html b/docs/latest/283118454/index.html
index 7fd9a56..d9d7229 100644
--- a/docs/latest/283118454/index.html
+++ b/docs/latest/283118454/index.html
@@ -122,7 +122,10 @@ ASF
<div class=docs>
<h1 id=apache-hive--hcatalog-streaming-mutation-api-copy>Apache Hive : HCatalog Streaming Mutation API (Copy)</h1>
<p>A Java API focused on mutating (insert/update/delete) records into transactional tables using Hive’s <a href=https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions>ACID</a> feature. It is introduced in Hive 2.0.0 (<a href=https://issues.apache.org/jira/browse/HIVE-10165>HIVE-10165</a>).</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hcatalog-streaming-mutation-api-copy>Apache Hive : HCatalog Streaming Mutation API (Copy)</a></li>
<li><a href=#background>Background</a></li>
<li><a href=#structure>Structure</a></li>
<li><a href=#data-requirements>Data Requirements</a></li>
@@ -135,8 +138,14 @@ ASF
</ul>
</li>
<li><a href=#reading-data>Reading Data</a></li>
-<li><a href=#example>Example</a></li>
+<li><a href=#example>Example</a>
+<ul>
+<li><a href=#attachments>Attachments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
<h1 id=background>Background</h1>
<p>In certain data processing use cases it is necessary to modify existing data when new facts arrive. An example of this is the classic ETL merge where a copy of a data set is kept in sync with a master by the frequent application of deltas. The deltas describe the mutations (inserts, updates, deletes) that have occurred to the master since the previous sync. To implement such a case using Hadoop traditionally demands that the partitions containing records targeted by the mutations be r [...]
<p>The availability of ACID tables in Hive provides a mechanism that both enables concurrent access to data stored in HDFS (so long as it’s in the ORC+ACID format) and also permits row level mutations on records within a table, without the need to rewrite the existing data. But while Hive itself supports <code>INSERT</code>, <code>UPDATE</code> and <code>DELETE</code> commands, and the ORC format can support large batches of mutations in a transaction, Hive’s execution engine [...]
diff --git a/docs/latest/284790216/index.html b/docs/latest/284790216/index.html
index acc1e5a..2120e96 100644
--- a/docs/latest/284790216/index.html
+++ b/docs/latest/284790216/index.html
@@ -121,16 +121,24 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--copy-of-hive-schema-tool---todo-move-it-under-a-40-admin-manual-page-find-a-proper-name>Apache Hive : Copy of Hive Schema Tool - [TODO: move it under a 4.0 admin manual page, find a proper name]</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--copy-of-hive-schema-tool---todo-move-it-under-a-40-admin-manual-page-find-a-proper-name>Apache Hive : Copy of Hive Schema Tool - [TODO: move it under a 4.0 admin manual page, find a proper name]</a>
<ul>
<li><a href=#about>About</a></li>
<li><a href=#metastore-schema-verification>Metastore Schema Verification</a></li>
<li><a href=#the-hive-schema-tool>The Hive Schema Tool</a>
<ul>
-<li><a href=#the-schematool-command>The schematool Command</a></li>
+<li><a href=#the-schematool-command>The <code>schematool</code> Command</a></li>
<li><a href=#usage-examples>Usage Examples</a></li>
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=about>About</h2>
<p>Schema tool helps to initialise and upgrade metastore database and hive sys schema.</p>
<h2 id=metastore-schema-verification>Metastore Schema Verification</h2>
diff --git a/docs/latest/30151323/index.html b/docs/latest/30151323/index.html
index 7ba21ba..5331587 100644
--- a/docs/latest/30151323/index.html
+++ b/docs/latest/30151323/index.html
@@ -122,6 +122,12 @@ ASF
<div class=docs>
<h1 id=apache-hive--enhanced-aggregation-cube-grouping-and-rollup>Apache Hive : Enhanced Aggregation, Cube, Grouping and Rollup</h1>
<p>This document describes enhanced aggregation features for the GROUP BY clause of SELECT statements.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--enhanced-aggregation-cube-grouping-and-rollup>Apache Hive : Enhanced Aggregation, Cube, Grouping and Rollup</a>
+<ul>
+<li>
<ul>
<li><a href=#grouping-sets-clause>GROUPING SETS clause</a></li>
<li><a href=#grouping__id-function>Grouping__ID function</a></li>
@@ -130,6 +136,13 @@ ASF
<li><a href=#hivenewjobgroupingsetcardinality>hive.new.job.grouping.set.cardinality</a></li>
<li><a href=#grouping__id-function-before-hive-230>Grouping__ID function (before Hive 2.3.0)</a></li>
</ul>
+</li>
+<li><a href=#comments>Comments:</a></li>
+</ul>
+</li>
+</ul>
+</nav>
+</aside>
<p>Version</p>
<p>Grouping sets, CUBE and ROLLUP operators, and the GROUPING__ID function were added in Hive 0.10.0.<br>
See <a href=https://issues.apache.org/jira/browse/HIVE-2397>HIVE-2397</a>, <a href=https://issues.apache.org/jira/browse/HIVE-3433>HIVE-3433</a>, <a href=https://issues.apache.org/jira/browse/HIVE-3471>HIVE-3471</a>, and <a href=https://issues.apache.org/jira/browse/HIVE-3613>HIVE-3613</a>.<br>
diff --git a/docs/latest/44302539/index.html b/docs/latest/44302539/index.html
index 110e45d..fbb39ac 100644
--- a/docs/latest/44302539/index.html
+++ b/docs/latest/44302539/index.html
@@ -121,6 +121,13 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-on-spark-getting-started>Apache Hive : Hive on Spark: Getting Started</h1>
+<p>Hive on Spark provides Hive with the ability to utilize <a href=http://spark.apache.org/>Apache Spark</a> as its execution engine.</p>
+<pre tabindex=0><code>set hive.execution.engine=spark;
+</code></pre><p>Hive on Spark was added in <a href=https://issues.apache.org/jira/browse/HIVE-7292>HIVE-7292</a>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--hive-on-spark-getting-started>Apache Hive : Hive on Spark: Getting Started</a>
<ul>
<li><a href=#version-compatibility>Version Compatibility</a></li>
<li><a href=#spark-installation>Spark Installation</a></li>
@@ -138,10 +145,13 @@ ASF
<li><a href=#common-issues-green-are-resolved-will-be-removed-from-this-list>Common Issues (Green are resolved, will be removed from this list)</a></li>
<li><a href=#recommended-configuration>Recommended Configuration</a></li>
<li><a href=#design-documents>Design documents</a></li>
+<li><a href=#attachments>Attachments:</a></li>
+<li><a href=#comments>Comments:</a></li>
</ul>
-<p>Hive on Spark provides Hive with the ability to utilize <a href=http://spark.apache.org/>Apache Spark</a> as its execution engine.</p>
-<pre tabindex=0><code>set hive.execution.engine=spark;
-</code></pre><p>Hive on Spark was added in <a href=https://issues.apache.org/jira/browse/HIVE-7292>HIVE-7292</a>.</p>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=version-compatibility>Version Compatibility</h2>
<p>Hive on Spark is only tested with a specific version of Spark, so a given version of Hive is only guaranteed to work with a specific version of Spark. Other versions of Spark may work with a given version of Hive, but that is not guaranteed. Below is a list of Hive versions and their corresponding compatible Spark versions.</p>
<table>
diff --git a/docs/latest/45876173/index.html b/docs/latest/45876173/index.html
index 5142f20..8a74d6d 100644
--- a/docs/latest/45876173/index.html
+++ b/docs/latest/45876173/index.html
@@ -121,30 +121,27 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-deprecated-authorization-mode--legacy-mode>Apache Hive : Hive deprecated authorization mode / Legacy Mode</h1>
+<p>This document describes Hive security using the basic authorization scheme, which regulates access to Hive metadata on the client side. This was the default authorization mode used when authorization was enabled. The default was changed to <a href=https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928/>SQL Standard authorization</a> in Hive 2.0 (<a href=https://issues.apache.org/jira/browse/HIVE-12429>HIVE-12429</a>).</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#disclaimer>Disclaimer</a></li>
-<li><a href=#prerequisites>Prerequisites</a></li>
-<li><a href=#users-groups-and-roles>Users, Groups, and Roles</a>
+<li><a href=#apache-hive--hive-deprecated-authorization-mode--legacy-mode>Apache Hive : Hive deprecated authorization mode / Legacy Mode</a>
<ul>
-<li><a href=#names-of-users-and-roles>Names of Users and Roles</a></li>
-</ul>
-</li>
-<li><a href=#creatingdroppingusing-roles>Creating/Dropping/Using Roles</a>
+<li>
<ul>
-<li><a href=#createdrop-role>Create/Drop Role</a></li>
-<li><a href=#grantrevoke-roles>Grant/Revoke Roles</a></li>
-<li><a href=#viewing-granted-roles>Viewing Granted Roles</a></li>
+<li><a href=#disclaimer>Disclaimer</a></li>
+<li><a href=#prerequisites>Prerequisites</a></li>
+<li><a href=#users-groups-and-roles>Users, Groups, and Roles</a></li>
+<li><a href=#creatingdroppingusing-roles>Creating/Dropping/Using Roles</a></li>
+<li><a href=#privileges>Privileges</a></li>
+<li><a href=#hive-operations-and-required-privileges>Hive Operations and Required Privileges</a></li>
</ul>
</li>
-<li><a href=#privileges>Privileges</a>
-<ul>
-<li><a href=#grantrevoke-privileges>Grant/Revoke Privileges</a></li>
-<li><a href=#viewing-granted-privileges>Viewing Granted Privileges</a></li>
</ul>
</li>
-<li><a href=#hive-operations-and-required-privileges>Hive Operations and Required Privileges</a></li>
</ul>
-<p>This document describes Hive security using the basic authorization scheme, which regulates access to Hive metadata on the client side. This was the default authorization mode used when authorization was enabled. The default was changed to <a href=https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928/>SQL Standard authorization</a> in Hive 2.0 (<a href=https://issues.apache.org/jira/browse/HIVE-12429>HIVE-12429</a>).</p>
+</nav>
+</aside>
<h3 id=disclaimer>Disclaimer</h3>
<p>Hive authorization is not completely secure. The basic authorization scheme is intended primarily to prevent good users from accidentally doing bad things, but makes no promises about preventing malicious users from doing malicious things. See the <a href=https://hive.apache.org/docs/latest/languagemanual-authorization_27362032/>Hive authorization main page</a> for the secure options.</p>
<h3 id=prerequisites>Prerequisites</h3>
diff --git a/docs/latest/50858744/index.html b/docs/latest/50858744/index.html
index 041dbf7..da79373 100644
--- a/docs/latest/50858744/index.html
+++ b/docs/latest/50858744/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-on-spark-join-design-master>Apache Hive : Hive on Spark: Join Design Master</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--hive-on-spark-join-design-master>Apache Hive : Hive on Spark: Join Design Master</a>
<ul>
<li><a href=#purpose-and-prerequisites>Purpose and Prerequisites</a></li>
<li><a href=#mapreduce-summary>MapReduce Summary</a>
@@ -135,7 +139,12 @@ ASF
<li><a href=#figure-2-join-processors-for-hive-on-spark>Figure 2: Join Processors for Hive on Spark</a></li>
</ul>
</li>
+<li><a href=#attachments>Attachments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
<h2 id=purpose-and-prerequisites>Purpose and Prerequisites</h2>
<p>The purpose of this document is to summarize the findings of all the research of different joins and describe a unified design to attack the problem in Spark. It will identify the optimization processors will be involved and their responsibilities.</p>
<p>It is not the purpose to go in depth for design of the various join implementations in Spark, such as the common-join (<a href=https://issues.apache.org/jira/browse/HIVE-7384>HIVE-7384</a>), or the optimized join variants like mapjoin (<a href=https://issues.apache.org/jira/browse/HIVE-7613>HIVE-7613</a>), skew-join (<a href=https://issues.apache.org/jira/browse/HIVE-8406>HIVE-8406</a>) or SMB mapjoin (<a href=https://issues.apache.org/jira/browse/HIVE-8202>HIVE-8202</a>). It will be [...]
diff --git a/docs/latest/50860526/index.html b/docs/latest/50860526/index.html
index 30e740d..8dd7fe1 100644
--- a/docs/latest/50860526/index.html
+++ b/docs/latest/50860526/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hybrid-hybrid-grace-hash-join-v10>Apache Hive : Hybrid Hybrid Grace Hash Join, v1.0</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hybrid-hybrid-grace-hash-join-v10>Apache Hive : Hybrid Hybrid Grace Hash Join, v1.0</a></li>
<li><a href=#overview>Overview</a></li>
<li><a href=#scope>Scope</a></li>
<li><a href=#notation-and-assumptions>Notation and Assumptions</a></li>
@@ -140,6 +143,8 @@ ASF
<li><a href=#bloom-filter>Bloom Filter</a></li>
<li><a href=#references>References</a></li>
</ul>
+</nav>
+</aside>
<h1 id=overview>Overview</h1>
<p>We are proposing an enhanced hash join algorithm called “hybrid hybrid grace hash join”. We can benefit from this feature as illustrated below:</p>
<ul>
diff --git a/docs/latest/accumulointegration_46633569/index.html b/docs/latest/accumulointegration_46633569/index.html
index c5aa49d..f058d6d 100644
--- a/docs/latest/accumulointegration_46633569/index.html
+++ b/docs/latest/accumulointegration_46633569/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--accumulointegration>Apache Hive : AccumuloIntegration</h1>
-<h1 id=hive-accumulo-integration>Hive Accumulo Integration</h1>
+<h1 id=apache-hive--accumulo-integration>Apache Hive : Accumulo Integration</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-accumulo-integration>Hive Accumulo Integration</a>
+<li><a href=#apache-hive--accumulo-integration>Apache Hive : Accumulo Integration</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#implementation>Implementation</a></li>
@@ -144,6 +145,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p><a href=http://accumulo.apache.org>Apache Accumulo</a> is a sorted, distributed key-value store based on the Google BigTable paper. The API methods that Accumulo provides are in terms of Keys and Values which present the highest level of flexibility in reading and writing data; however, higher-level query abstractions are typically an exercise left to the user. Leveraging Apache Hive as a SQL interface to Accumulo complements its existing high-throughput batch access and low-latency r [...]
<h2 id=implementation>Implementation</h2>
diff --git a/docs/latest/adminmanual-configuration_27362070/index.html b/docs/latest/adminmanual-configuration_27362070/index.html
index 1c85466..ebf123b 100644
--- a/docs/latest/adminmanual-configuration_27362070/index.html
+++ b/docs/latest/adminmanual-configuration_27362070/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--adminmanual-configuration>Apache Hive : AdminManual Configuration</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--adminmanual-configuration>Apache Hive : AdminManual Configuration</a>
<ul>
<li><a href=#configuring-hive>Configuring Hive</a>
<ul>
@@ -139,6 +143,10 @@ ASF
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=configuring-hive>Configuring Hive</h2>
<p>A number of configuration variables in Hive can be used by the administrator to change the behavior for their installations and user sessions. These variables can be configured in any of the following ways, shown in the order of preference:</p>
<ul>
diff --git a/docs/latest/adminmanual-installation_27362077/index.html b/docs/latest/adminmanual-installation_27362077/index.html
index c084360..e1b56dd 100644
--- a/docs/latest/adminmanual-installation_27362077/index.html
+++ b/docs/latest/adminmanual-installation_27362077/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--adminmanual-installation>Apache Hive : AdminManual Installation</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--adminmanual-installation>Apache Hive : AdminManual Installation</a></li>
<li><a href=#installing-hive>Installing Hive</a>
<ul>
<li><a href=#installing-from-a-tarball>Installing from a Tarball</a></li>
@@ -143,6 +146,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h1 id=installing-hive>Installing Hive</h1>
<p>You can install a stable release of Hive by downloading and unpacking a tarball, or you can download the source code and build Hive using Maven (release 0.13 and later) or Ant (release 0.12 and earlier).</p>
<p>Hive installation has these requirements:</p>
diff --git a/docs/latest/adminmanual-metastore-3-0-administration_75978150/index.html b/docs/latest/adminmanual-metastore-3-0-administration_75978150/index.html
index 7e8650f..ccf67f3 100644
--- a/docs/latest/adminmanual-metastore-3-0-administration_75978150/index.html
+++ b/docs/latest/adminmanual-metastore-3-0-administration_75978150/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--adminmanual-metastore-30-administration>Apache Hive : AdminManual Metastore 3.0 Administration</h1>
-<p>Metastore 3.0 Administration</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--adminmanual-metastore-30-administration>Apache Hive : AdminManual Metastore 3.0 Administration</a>
<ul>
<li><a href=#version-note>Version Note</a></li>
<li><a href=#introduction>Introduction</a>
@@ -133,23 +136,14 @@ ASF
<li><a href=#rdbms>RDBMS</a>
<ul>
<li><a href=#option-1-embedding-derby>Option 1: Embedding Derby</a></li>
-<li><a href=#option-2-external-rdbms>Option 2: External RDBMS</a>
-<ul>
-<li><a href=#supported-rdbmss>Supported RDBMSs</a></li>
-</ul>
-</li>
+<li><a href=#option-2-external-rdbms>Option 2: External RDBMS</a></li>
<li><a href=#installing-and-upgrading-the-metastore-schema>Installing and Upgrading the Metastore Schema</a></li>
</ul>
</li>
<li><a href=#running-the-metastore>Running the Metastore</a>
<ul>
<li><a href=#embedded-mode>Embedded Mode</a></li>
-<li><a href=#metastore-server>Metastore Server</a>
-<ul>
-<li><a href=#high-availability>High Availability</a></li>
-<li><a href=#securing-the-service>Securing the Service</a></li>
-</ul>
-</li>
+<li><a href=#metastore-server>Metastore Server</a></li>
</ul>
</li>
<li><a href=#running-the-metastore-without-hive>Running the Metastore Without Hive</a></li>
@@ -160,6 +154,10 @@ ASF
</li>
<li><a href=#less-commonly-changed-configuration-parameters>Less Commonly Changed Configuration Parameters</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=version-note>Version Note</h2>
<p><strong>This document applies only to the Metastore in Hive 3.0 and later releases.</strong> For Hive 0, 1, and 2 releases please see the <a href=https://hive.apache.org/docs/latest/adminmanual-metastore-administration_27362076/>Metastore Administration</a> document.</p>
<h2 id=introduction>Introduction</h2>
diff --git a/docs/latest/adminmanual-metastore-administration_27362076/index.html b/docs/latest/adminmanual-metastore-administration_27362076/index.html
index 9db15d9..3764179 100644
--- a/docs/latest/adminmanual-metastore-administration_27362076/index.html
+++ b/docs/latest/adminmanual-metastore-administration_27362076/index.html
@@ -121,32 +121,28 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--adminmanual-metastore-administration>Apache Hive : AdminManual Metastore Administration</h1>
-<h2 id=hive-metastore-administration>Hive Metastore Administration</h2>
+<p>This page only documents the MetaStore in Hive 2.x and earlier. For 3.x and later releases please see <a href=https://hive.apache.org/docs/latest/adminmanual-metastore-3-0-administration_75978150/>AdminManual Metastore 3.0 Administration</a></p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-metastore-administration>Hive Metastore Administration</a>
+<li><a href=#apache-hive--adminmanual-metastore-administration>Apache Hive : AdminManual Metastore Administration</a>
<ul>
-<li><a href=#introduction>Introduction</a>
+<li>
<ul>
-<li><a href=#basic-configuration-parameters>Basic Configuration Parameters</a></li>
-<li><a href=#additional-configuration-parameters>Additional Configuration Parameters</a></li>
-<li><a href=#data-nucleus-auto-start>Data Nucleus Auto Start</a></li>
-<li><a href=#default-configuration>Default Configuration</a></li>
-</ul>
-</li>
+<li><a href=#introduction>Introduction</a></li>
<li><a href=#localembedded-metastore-database-derby>Local/Embedded Metastore Database (Derby)</a></li>
<li><a href=#remote-metastore-database>Remote Metastore Database</a></li>
<li><a href=#localembedded-metastore-server>Local/Embedded Metastore Server</a></li>
-<li><a href=#remote-metastore-server>Remote Metastore Server</a>
-<ul>
-<li><a href=#client-configuration-parameters>Client Configuration Parameters</a></li>
-</ul>
-</li>
+<li><a href=#remote-metastore-server>Remote Metastore Server</a></li>
<li><a href=#supported-backend-databases-for-metastore>Supported Backend Databases for Metastore</a></li>
<li><a href=#metastore-schema-consistency-and-upgrades>Metastore Schema Consistency and Upgrades</a></li>
</ul>
</li>
</ul>
-<p>This page only documents the MetaStore in Hive 2.x and earlier. For 3.x and later releases please see <a href=https://hive.apache.org/docs/latest/adminmanual-metastore-3-0-administration_75978150/>AdminManual Metastore 3.0 Administration</a></p>
+</li>
+</ul>
+</nav>
+</aside>
<h3 id=introduction>Introduction</h3>
<p>All the metadata for Hive tables and partitions are accessed through the Hive Metastore. Metadata is persisted using <a href=http://www.datanucleus.org/>JPOX</a> ORM solution (Data Nucleus) so any database that is supported by it can be used by Hive. Most of the commercial relational databases and many open source databases are supported. See the list of <a href=#supported-databases>supported databases</a> in section below.</p>
<p>You can find an E/R diagram for the metastore <a href=https://issues.apache.org/jira/secure/attachment/12471108/HiveMetaStore.pdf>here</a>.</p>
diff --git a/docs/latest/authdev_27362078/index.html b/docs/latest/authdev_27362078/index.html
index 705b943..e5179d4 100644
--- a/docs/latest/authdev_27362078/index.html
+++ b/docs/latest/authdev_27362078/index.html
@@ -121,8 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--authdev>Apache Hive : AuthDev</h1>
-<p><strong>Index</strong></p>
+<p>This is the design document for the <a href=https://hive.apache.org/docs/latest/45876173/>original Hive authorization mode</a>. See <a href=https://hive.apache.org/docs/latest/languagemanual-authorization_27362032/>Authorization</a> for an overview of authorization modes, which include <a href=https://hive.apache.org/docs/latest/storage-based-authorization-in-the-metastore-server_45876440/>storage based authorization</a> and <a href=https://hive.apache.org/docs/latest/sql-standard-bas [...]
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--authdev>Apache Hive : AuthDev</a></li>
<li><a href=#1-privilege>1. Privilege</a>
<ul>
<li><a href=#11-access-privilege>1.1 Access Privilege</a></li>
@@ -169,8 +172,8 @@ ASF
<li><a href=#8-metastore-upgrade-script-for-mysql>8. Metastore upgrade script for mysql</a></li>
<li><a href=#hdfs-permission>HDFS Permission</a></li>
</ul>
-<p>Authorization modes</p>
-<p>This is the design document for the <a href=https://hive.apache.org/docs/latest/45876173/>original Hive authorization mode</a>. See <a href=https://hive.apache.org/docs/latest/languagemanual-authorization_27362032/>Authorization</a> for an overview of authorization modes, which include <a href=https://hive.apache.org/docs/latest/storage-based-authorization-in-the-metastore-server_45876440/>storage based authorization</a> and <a href=https://hive.apache.org/docs/latest/sql-standard-bas [...]
+</nav>
+</aside>
<h1 id=1-privilege>1. Privilege</h1>
<h2 id=11-access-privilege>1.1 Access Privilege</h2>
<p>Admin privilege, DB privilege, Table level privilege, column level privilege</p>
diff --git a/docs/latest/avroserde_27850707/index.html b/docs/latest/avroserde_27850707/index.html
index 1f9e67c..4c6ae4c 100644
--- a/docs/latest/avroserde_27850707/index.html
+++ b/docs/latest/avroserde_27850707/index.html
@@ -121,54 +121,30 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--avroserde>Apache Hive : AvroSerDe</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li>
-<p><a href=#availability>Availability</a></p>
-</li>
-<li>
-<p><a href=#overview-–-working-with-avro-from-hive>Overview – Working with Avro from Hive</a></p>
-</li>
-<li>
-<p><a href=#requirements>Requirements</a></p>
-</li>
-<li>
-<p><a href=#avro-to-hive-type-conversion>Avro to Hive type conversion</a></p>
-</li>
-<li>
-<p><a href=#creating-avro-backed-hive-tables>Creating Avro-backed Hive tables</a></p>
+<li><a href=#apache-hive--avroserde>Apache Hive : AvroSerDe</a>
<ul>
-<li><a href=#all-hive-versions>All Hive versions</a></li>
-<li><a href=#hive-014-and-later-versions>Hive 0.14 and later versions</a></li>
-</ul>
-</li>
<li>
-<p><a href=#writing-tables-to-avro-files>Writing tables to Avro files</a></p>
-<pre><code> - [Example](#example)+ [All Hive versions](#all-hive-versions)
-</code></pre>
<ul>
-<li><a href=#hive-014-and-later>Hive 0.14 and later</a></li>
-<li><a href=#avro-file-extension>Avro file extension</a></li>
+<li><a href=#availability>Availability</a></li>
+<li><a href=#overview-working-with-avro-from-hive>Overview – Working with Avro from Hive</a></li>
+<li><a href=#requirements>Requirements</a></li>
+<li><a href=#avro-to-hive-type-conversion>Avro to Hive type conversion</a></li>
+<li><a href=#creating-avro-backed-hive-tables>Creating Avro-backed Hive tables</a></li>
+<li><a href=#writing-tables-to-avro-files>Writing tables to Avro files</a></li>
+<li><a href=#specifying-the-avro-schema-for-a-table>Specifying the Avro schema for a table</a></li>
+<li><a href=#hbase-integration>HBase Integration</a></li>
+<li><a href=#if-something-goes-wrong>If something goes wrong</a></li>
+<li><a href=#faq>FAQ</a></li>
</ul>
</li>
-<li>
-<p><a href=#specifying-the-avro-schema-for-a-table>Specifying the Avro schema for a table</a></p>
-<ul>
-<li><a href=#use-avroschemaurl>Use avro.schema.url</a></li>
-<li><a href=#use-schemaliteral-and-embed-the-schema-in-the-create-statement>Use schema.literal and embed the schema in the create statement</a></li>
-<li><a href=#use-avroschemaliteral-and-pass-the-schema-into-the-script>Use avro.schema.literal and pass the schema into the script</a></li>
-<li><a href=#use-none-to-ignore-either-avroschemaliteral-or-avroschemaurl>Use none to ignore either avro.schema.literal or avro.schema.url</a></li>
</ul>
</li>
-<li>
-<p><a href=#hbase-integration>HBase Integration</a></p>
-</li>
-<li>
-<p><a href=#if-something-goes-wrong>If something goes wrong</a></p>
-</li>
-<li>
-<p><a href=#faq>FAQ</a></p>
-</li>
</ul>
+</nav>
+</aside>
<h3 id=availability>Availability</h3>
<p>Earliest version AvroSerde is available</p>
<p>The AvroSerde is available in Hive 0.9.1 and greater.</p>
diff --git a/docs/latest/column-statistics-in-hive_29131019/index.html b/docs/latest/column-statistics-in-hive_29131019/index.html
index a36cdb4..4d41bc6 100644
--- a/docs/latest/column-statistics-in-hive_29131019/index.html
+++ b/docs/latest/column-statistics-in-hive_29131019/index.html
@@ -121,12 +121,25 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--column-statistics-in-hive>Apache Hive : Column Statistics in Hive</h1>
-<p>*** <a href=#introduction>Introduction</a></p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hiveql-changes>HiveQL changes</a></li>
-<li><a href=#metastore-schema>Metastore Schema</a></li>
-<li><a href=#metastore-thrift-api>Metastore Thrift API</a>**</li>
+<li><a href=#apache-hive--column-statistics-in-hive>Apache Hive : Column Statistics in Hive</a>
+<ul>
+<li>
+<ul>
+<li><a href=#introduction><strong>Introduction</strong></a></li>
+<li><a href=#hiveql-changes><strong>HiveQL changes</strong></a></li>
+<li><a href=#metastore-schema><strong>Metastore Schema</strong></a></li>
+<li><a href=#metastore-thrift-api><strong>Metastore Thrift API</strong></a></li>
+</ul>
+</li>
+<li><a href=#comments>Comments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
<h3 id=introduction><strong>Introduction</strong></h3>
<p>This document describes changes to a) HiveQL, b) metastore schema, and c) metastore Thrift API to support column level statistics in Hive. Please note that the document doesn’t describe the changes needed to persist histograms in the metastore yet.</p>
<p>Version information</p>
diff --git a/docs/latest/configuration-properties_27842758/index.html b/docs/latest/configuration-properties_27842758/index.html
index 06d7589..69c2d0e 100644
--- a/docs/latest/configuration-properties_27842758/index.html
+++ b/docs/latest/configuration-properties_27842758/index.html
@@ -121,57 +121,52 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--configuration-properties>Apache Hive : Configuration Properties</h1>
-<h1 id=hive-configuration-properties>Hive Configuration Properties</h1>
+<p>This document describes the Hive user configuration properties (sometimes called <em>parameters</em>, <em>variables</em>, or <em>options</em>), and notes which releases introduced new properties.</p>
+<p>The canonical list of configuration properties is managed in the <code>HiveConf</code> Java class, so refer to the <code>HiveConf.java</code> file for a complete list of configuration properties available in your Hive release.</p>
+<p>For information about how to use these configuration properties, see <a href=#configuring-hive>Configuring Hive</a>. That document also describes administrative configuration properties for setting up Hive in the <a href=#configuration-variables>Configuration Variables</a> section. <a href=https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin>Hive Metastore Administration</a> describes additional configuration properties for the metastore.</p>
+<p>Version information</p>
+<p>As of Hive 0.14.0 ( <a href=https://issues.apache.org/jira/browse/HIVE-7211>HIVE-7211</a> ), a configuration name that starts with “hive.” is regarded as a Hive system property. With the <a href=#hiveconfvalidation>hive.conf.validation</a> option true (default), any attempts to set a configuration property that starts with “hive.” which is not registered to the Hive system will throw an exception.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-configuration-properties>Hive Configuration Properties</a>
+<li><a href=#apache-hive--configuration-properties>Apache Hive : Configuration Properties</a>
<ul>
<li><a href=#query-and-ddl-execution>Query and DDL Execution</a>
<ul>
+<li></li>
<li><a href=#datetime>Datetime</a></li>
-<li><a href=#serdes-and-io>SerDes and I/O</a>
-<ul>
-<li><a href=#serdes>SerDes</a></li>
-<li><a href=#io>I/O</a></li>
-</ul>
-</li>
-<li><a href=#file-formats>File Formats</a>
-<ul>
-<li><a href=#rcfile-format>RCFile Format</a></li>
-<li><a href=#orc-file-format>ORC File Format</a></li>
-<li><a href=#parquet>Parquet</a></li>
-<li><a href=#avro>Avro</a></li>
-</ul>
-</li>
+<li><a href=#serdes-and-io>SerDes and I/O</a></li>
+<li><a href=#file-formats>File Formats</a></li>
<li><a href=#vectorization>Vectorization</a></li>
</ul>
</li>
<li><a href=#metastore>MetaStore</a>
<ul>
+<li></li>
<li><a href=#hive-metastore-connection-pooling-configuration>Hive Metastore Connection Pooling Configuration</a></li>
<li><a href=#hive-metastore-hbase>Hive Metastore HBase</a></li>
</ul>
</li>
<li><a href=#hiveserver2>HiveServer2</a>
<ul>
+<li></li>
<li><a href=#hiveserver2-web-ui>HiveServer2 Web UI</a></li>
</ul>
</li>
<li><a href=#spark>Spark</a>
<ul>
+<li></li>
<li><a href=#remote-spark-driver>Remote Spark Driver</a></li>
</ul>
</li>
-<li><a href=#tez>Tez</a></li>
+<li><a href=#tez>Tez</a>
+<ul>
+<li></li>
+</ul>
+</li>
<li><a href=#llap>LLAP</a>
<ul>
-<li><a href=#llap-client>LLAP Client</a></li>
-<li><a href=#llap-web-services>LLAP Web Services</a></li>
-<li><a href=#llap-cache>LLAP Cache</a></li>
-<li><a href=#llap-io>LLAP I/O</a></li>
-<li><a href=#llap-cbo>LLAP CBO</a></li>
-<li><a href=#llap-metrics>LLAP Metrics</a></li>
-<li><a href=#llap-udf-security>LLAP UDF Security</a></li>
-<li><a href=#llap-security>LLAP Security</a></li>
+<li></li>
</ul>
</li>
<li><a href=#transactions-and-compactor>Transactions and Compactor</a>
@@ -181,45 +176,82 @@ ASF
<li><a href=#compaction-history>Compaction History</a></li>
</ul>
</li>
-<li><a href=#indexing>Indexing</a></li>
-<li><a href=#statistics>Statistics</a>
+<li><a href=#indexing>Indexing</a>
<ul>
-<li><a href=#runtime-filtering>Runtime Filtering</a></li>
+<li></li>
</ul>
</li>
-<li><a href=#authentication-and-authorization>Authentication and Authorization</a>
-<ul>
-<li><a href=#restrictedhiddeninternal-list-and-whitelist>Restricted/Hidden/Internal List and Whitelist</a>
+<li><a href=#statistics>Statistics</a>
<ul>
-<li><a href=#whitelist-for-sql-standard-based-hive-authorization>Whitelist for SQL Standard Based Hive Authorization</a></li>
+<li></li>
</ul>
</li>
+<li><a href=#authentication-and-authorization>Authentication and Authorization</a>
+<ul>
+<li><a href=#restrictedhiddeninternal-list-and-whitelist>Restricted/Hidden/Internal List and Whitelist</a></li>
<li><a href=#hive-client-security>Hive Client Security</a></li>
<li><a href=#hive-metastore-security>Hive Metastore Security</a></li>
<li><a href=#sql-standard-based-authorization>SQL Standard Based Authorization</a></li>
</ul>
</li>
-<li><a href=#archiving>Archiving</a></li>
-<li><a href=#locking>Locking</a></li>
-<li><a href=#metrics>Metrics</a></li>
-<li><a href=#clustering>Clustering</a></li>
+<li><a href=#archiving>Archiving</a>
+<ul>
+<li></li>
+</ul>
+</li>
+<li><a href=#locking>Locking</a>
+<ul>
+<li></li>
+</ul>
+</li>
+<li><a href=#metrics>Metrics</a>
+<ul>
+<li></li>
+</ul>
+</li>
+<li><a href=#clustering>Clustering</a>
+<ul>
+<li></li>
+</ul>
+</li>
<li><a href=#regions>Regions</a></li>
-<li><a href=#command-line-interface>Command Line Interface</a></li>
-<li><a href=#hbase-storagehandler>HBase StorageHandler</a></li>
-<li><a href=#hive-web-interface--hwi---component-removed-as-of-hive-2-2-0->Hive Web Interface (HWI) (component removed as of Hive 2.2.0)</a></li>
-<li><a href=#replication>Replication</a></li>
-<li><a href=#blobstore-ie-amazon-s3>Blobstore (i.e. Amazon S3)</a></li>
-<li><a href=#test-properties>Test Properties</a></li>
+<li><a href=#command-line-interface>Command Line Interface</a>
+<ul>
+<li></li>
+</ul>
+</li>
+<li><a href=#hbase-storagehandler>HBase StorageHandler</a>
+<ul>
+<li></li>
+</ul>
+</li>
+<li><a href=#hive-web-interface-hwi-component-removed-as-of-hive-220httpsissuesapacheorgjirabrowsehive-15622>Hive Web Interface (HWI) (component removed as of Hive <a href=https://issues.apache.org/jira/browse/HIVE-15622>2.2.0</a>)</a>
+<ul>
+<li></li>
+</ul>
+</li>
+<li><a href=#replication>Replication</a>
+<ul>
+<li></li>
+</ul>
+</li>
+<li><a href=#blobstore-ie-amazon-s3>Blobstore (i.e. Amazon S3)</a>
+<ul>
+<li></li>
+</ul>
+</li>
+<li><a href=#test-properties>Test Properties</a>
+<ul>
+<li></li>
+</ul>
+</li>
</ul>
</li>
<li><a href=#hcatalog-configuration-properties>HCatalog Configuration Properties</a></li>
<li><a href=#webhcat-configuration-properties>WebHCat Configuration Properties</a></li>
</ul>
-<p>This document describes the Hive user configuration properties (sometimes called <em>parameters</em>, <em>variables</em>, or <em>options</em>), and notes which releases introduced new properties.</p>
-<p>The canonical list of configuration properties is managed in the <code>HiveConf</code> Java class, so refer to the <code>HiveConf.java</code> file for a complete list of configuration properties available in your Hive release.</p>
-<p>For information about how to use these configuration properties, see <a href=#configuring-hive>Configuring Hive</a>. That document also describes administrative configuration properties for setting up Hive in the <a href=#configuration-variables>Configuration Variables</a> section. <a href=https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin>Hive Metastore Administration</a> describes additional configuration properties for the metastore.</p>
-<p>Version information</p>
-<p>As of Hive 0.14.0 ( <a href=https://issues.apache.org/jira/browse/HIVE-7211>HIVE-7211</a> ), a configuration name that starts with “hive.” is regarded as a Hive system property. With the <a href=#hiveconfvalidation>hive.conf.validation</a> option true (default), any attempts to set a configuration property that starts with “hive.” which is not registered to the Hive system will throw an exception.</p>
+</nav>
+</aside>
<h2 id=query-and-ddl-execution>Query and DDL Execution</h2>
<h5 id=hiveexecutionengine>hive.execution.engine</h5>
<ul>
@@ -1369,15 +1401,8 @@ Setting to 0.13 gives division behavior in Hive 0.13 and later releases: int / i
<h5 id=hivedatetimeformatter>hive.datetime.formatter</h5>
<ul>
<li>Default Value: <code>DATETIME</code></li>
-<li>Added In: Hive 4.0.0 with</li>
-</ul>
-<h2 id=httpsissuesapacheorgjirasecureviewavatarsizexsmallavatarid21140avatartypeissuetypehive-25576httpsissuesapacheorgjirabrowsehive-25576srcconfmacro><a href="https://issues.apache.org/jira/browse/HIVE-25576?src=confmacro"><img src="https://issues.apache.org/jira/secure/viewavatar?size=xsmall&avatarId=21140&avatarType=issuetype" alt>HIVE-25576</a></h2>
-<p>Configurable datetime formatter for unix_timestamp, from_unixtime
-Closed</p>
-<p>,</p>
-<h2 id=httpsissuesapacheorgjirasecureviewavatarsizexsmallavatarid21140avatartypeissuetypehive-27673httpsissuesapacheorgjirabrowsehive-27673srcconfmacro><a href="https://issues.apache.org/jira/browse/HIVE-27673?src=confmacro"><img src="https://issues.apache.org/jira/secure/viewavatar?size=xsmall&avatarId=21140&avatarType=issuetype" alt>HIVE-27673</a></h2>
-<p>Configurable datetime formatter for date_format
-Closed</p>
+<li>Added In: Hive 4.0.0 with <a href=https://issues.apache.org/jira/browse/HIVE-25576>HIVE-25576</a>, <a href=https://issues.apache.org/jira/browse/HIVE-27673>HIVE-27673</a></li>
+</ul>
<p>The formatter to use for handling datetime values. The possible values are:</p>
<ul>
<li>DATETIME: For using java.time.format.DateTimeFormatter</li>
@@ -3097,10 +3122,10 @@ With negative value, it’s checked for all of the operations regardless of
<ul>
<li><strong><a href=#hiveexecutionengine>hive.execution.engine</a></strong></li>
<li>
-<h5 id=hivemapjoinoptimizedhashtablehahahugoshortcode-s263-hbhb><a href=#hivemapjoinoptimizedhashtable>hive.mapjoin.optimized.hashtable</a></h5>
+<h5 id=hivemapjoinoptimizedhashtablehahahugoshortcode-s209-hbhb><a href=#hivemapjoinoptimizedhashtable>hive.mapjoin.optimized.hashtable</a></h5>
</li>
<li>
-<h5 id=hivemapjoinoptimizedhashtablewbsizehahahugoshortcode-s264-hbhb><a href=#hivemapjoinoptimizedhashtablewbsize>hive.mapjoin.optimized.hashtable.wbsize</a></h5>
+<h5 id=hivemapjoinoptimizedhashtablewbsizehahahugoshortcode-s210-hbhb><a href=#hivemapjoinoptimizedhashtablewbsize>hive.mapjoin.optimized.hashtable.wbsize</a></h5>
</li>
<li><strong><a href=#hiveserver2tezdefaultqueues>hive.server2.tez.default.queues</a></strong></li>
<li><strong><a href=#hiveserver2tezsessionsperdefaultqueue>hive.server2.tez.sessions.per.default.queue</a></strong></li>
diff --git a/docs/latest/cost-based-optimization-in-hive_42566775/index.html b/docs/latest/cost-based-optimization-in-hive_42566775/index.html
index f94a78f..f7522da 100644
--- a/docs/latest/cost-based-optimization-in-hive_42566775/index.html
+++ b/docs/latest/cost-based-optimization-in-hive_42566775/index.html
@@ -121,16 +121,69 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--cost-based-optimization-in-hive>Apache Hive : Cost-based optimization in Hive</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--cost-based-optimization-in-hive>Apache Hive : Cost-based optimization in Hive</a></li>
<li><a href=#abstract>Abstract</a></li>
<li><a href=#1-introduction>1. INTRODUCTION</a></li>
-<li><a href=#2-related-work>2. RELATED WORK</a></li>
-<li><a href=#3-background>3. BACKGROUND</a></li>
-<li><a href=#4-implementation-details>4. Implementation details</a></li>
+<li><a href=#2-related-work>2. RELATED WORK</a>
+<ul>
+<li><a href=#stats>STATS</a></li>
+<li><a href=#papers>PAPERS</a></li>
+</ul>
+</li>
+<li><a href=#3-background>3. BACKGROUND</a>
+<ul>
+<li><a href=#hive-query-optimization-issues>Hive Query optimization issues</a></li>
+<li><a href=#tez>TEZ</a></li>
+<li><a href=#join-algorithms-in-hive>Join algorithms in Hive</a>
+<ul>
+<li><a href=#multi-way-join>Multi way Join</a></li>
+<li><a href=#common-join>Common Join</a></li>
+<li><a href=#map-join>Map Join</a></li>
+<li><a href=#bucket-map-join>Bucket Map Join</a></li>
+<li><a href=#smb-join>SMB Join</a></li>
+<li><a href=#skew-join>Skew Join</a></li>
+</ul>
+</li>
+</ul>
+</li>
+<li><a href=#4-implementation-details>4. Implementation details</a>
+<ul>
+<li><a href=#phase-1>Phase 1</a></li>
+<li><a href=#phase-2>Phase 2</a></li>
+<li><a href=#phase-3>Phase 3</a></li>
+<li><a href=#configuration>Configuration</a></li>
+<li><a href=#proposed-cost-model>Proposed Cost Model</a>
+<ul>
+<li><a href=#table-scan>Table Scan</a></li>
+<li><a href=#common-join-1>Common Join</a></li>
+<li><a href=#map-join-1>Map Join</a></li>
+<li><a href=#bucket-map-join-1>Bucket Map Join</a></li>
+<li><a href=#smb-join-1>SMB Join</a></li>
+<li><a href=#skew-join-1>Skew Join</a></li>
+<li><a href=#distinctgroup-by>Distinct/Group By</a></li>
+<li><a href=#union-all>Union All</a></li>
+<li><a href=#filterhaving>Filter/Having</a></li>
+<li><a href=#select>Select</a></li>
+<li><a href=#filter-selectivity>Filter Selectivity</a></li>
+<li><a href=#join-cardinality-without-histogram>Join Cardinality (without Histogram)</a></li>
+<li><a href=#distinct-estimation>Distinct Estimation</a></li>
+</ul>
+</li>
+</ul>
+</li>
<li><a href=#5-phase-1--work-items>5. Phase 1 – Work Items</a></li>
<li><a href=#open-issues>Open Issues</a></li>
-<li><a href=#reference>Reference</a></li>
+<li><a href=#reference>Reference</a>
+<ul>
+<li><a href=#attachments>Attachments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
<h1 id=abstract>Abstract</h1>
<p>Apache Hadoop is a framework for the distributed processing of large data sets using clusters of computers typically composed of commodity hardware. Over last few years Apache Hadoop has become the de facto platform for distributed data processing using commodity hardware. Apache Hive is a popular SQL interface for data processing using Apache Hadoop.</p>
<p> </p>
diff --git a/docs/latest/csv-serde_48202659/index.html b/docs/latest/csv-serde_48202659/index.html
index 1441b26..0f14b1c 100644
--- a/docs/latest/csv-serde_48202659/index.html
+++ b/docs/latest/csv-serde_48202659/index.html
@@ -121,12 +121,24 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--csv-serde>Apache Hive : CSV Serde</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--csv-serde>Apache Hive : CSV Serde</a>
+<ul>
+<li>
<ul>
<li><a href=#availability>Availability</a></li>
<li><a href=#background>Background</a></li>
<li><a href=#usage>Usage</a></li>
<li><a href=#versions>Versions</a></li>
</ul>
+</li>
+</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h3 id=availability>Availability</h3>
<p>Earliest version CSVSerde is available</p>
<p>The CSVSerde is available in <a href=https://issues.apache.org/jira/browse/HIVE-7777>Hive 0.14</a> and greater.</p>
diff --git a/docs/latest/datasketches-integration_177050456/index.html b/docs/latest/datasketches-integration_177050456/index.html
index 7834941..f374be8 100644
--- a/docs/latest/datasketches-integration_177050456/index.html
+++ b/docs/latest/datasketches-integration_177050456/index.html
@@ -121,10 +121,20 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--datasketches-integration>Apache Hive : Datasketches Integration</h1>
+<p>Apache DataSketches (<a href=https://datasketches.apache.org/>https://datasketches.apache.org/</a>) is integrated into Hive via <a href=https://issues.apache.org/jira/browse/HIVE-22939>HIVE-22939</a>.<br>
+This enables various kind of sketch operations thru regular sql statement.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--datasketches-integration>Apache Hive : Datasketches Integration</a></li>
<li><a href=#sketch-functions>Sketch functions</a>
<ul>
-<li><a href=#naming-convention>Naming convention</a></li>
+<li><a href=#naming-convention>Naming convention</a>
+<ul>
+<li><a href=#sketchtype>sketchType</a></li>
+<li><a href=#functionname>functionName</a></li>
+</ul>
+</li>
<li><a href=#list-declared-sketch-functions>List declared sketch functions</a></li>
</ul>
</li>
@@ -133,19 +143,26 @@ ASF
<ul>
<li><a href=#rewrite-countdistinctx>Rewrite COUNT(DISTINCT(X))</a></li>
<li><a href=#rewrite-percentile_discp-withing-grouporder-by-x>Rewrite percentile_disc(p) withing group(order by x)</a></li>
-<li><a href=#rewrite-cume_dist---over--order-by-id->Rewrite cume_dist() over (order by id)</a></li>
+<li><a href=#rewritecume_dist-over-order-by-id>Rewrite cume_dist() over (order by id)</a></li>
<li><a href=#rewrite-ntile>Rewrite NTILE</a></li>
<li><a href=#rewrite-rank>Rewrite RANK</a></li>
</ul>
</li>
<li><a href=#examples>Examples</a>
<ul>
-<li><a href=#simple-distinct-counting-examples-using-hll>Simple distinct counting examples using HLL</a></li>
+<li><a href=#simple-distinct-counting-examples-using-hll>Simple distinct counting examples using HLL</a>
+<ul>
+<li><a href=#use-hll-to-compute-distinct-values-using-an-intermediate-table>Use HLL to compute distinct values using an intermediate table</a></li>
+<li><a href=#use-hll-to-compute-distinct-values-without-intermediate-table>Use HLL to compute distinct values without intermediate table</a></li>
+<li><a href=#use-hll-to-compute-distinct-values-transparently-thru-bi-mode>Use HLL to compute distinct values transparently thru BI mode</a></li>
+<li><a href=#use-hll-to-compute-distinct-values-transparently-thru-bi-mode---while-utilizing-a-materialized-view-to-store-the-intermediate-sketches>Use HLL to compute distinct values transparently thru BI mode - while utilizing a Materialized View to store the intermediate sketches.</a></li>
</ul>
</li>
</ul>
-<p>Apache DataSketches (<a href=https://datasketches.apache.org/>https://datasketches.apache.org/</a>) is integrated into Hive via <a href=https://issues.apache.org/jira/browse/HIVE-22939>HIVE-22939</a>.<br>
-This enables various kind of sketch operations thru regular sql statement.</p>
+</li>
+</ul>
+</nav>
+</aside>
<h1 id=sketch-functions>Sketch functions</h1>
<h2 id=naming-convention>Naming convention</h2>
<p>All sketch functions are registered using the following naming convention:</p>
diff --git a/docs/latest/design_27362072/index.html b/docs/latest/design_27362072/index.html
index be3e81c..0d97389 100644
--- a/docs/latest/design_27362072/index.html
+++ b/docs/latest/design_27362072/index.html
@@ -122,6 +122,10 @@ ASF
<div class=docs>
<h1 id=apache-hive--design>Apache Hive : Design</h1>
<p>This page contains details about the Hive design and architecture. A brief technical report about Hive is available at <a href=#hive-pdf>hive.pdf</a>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--design>Apache Hive : Design</a>
<ul>
<li><a href=#hive-architecture>Hive Architecture</a></li>
<li><a href=#hive-data-model>Hive Data Model</a></li>
@@ -137,10 +141,15 @@ ASF
<li><a href=#compiler>Compiler</a></li>
<li><a href=#optimizer>Optimizer</a></li>
<li><a href=#hive-apis>Hive APIs</a></li>
+<li><a href=#attachments>Attachments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
+<h2 id=hive-architecture>Hive Architecture</h2>
<p>Figure 1<br>
<img src=/attachments/27362072/47743299.png alt></p>
-<h2 id=hive-architecture>Hive Architecture</h2>
<p>Figure 1 shows the major components of Hive and its interactions with Hadoop. As shown in that figure, the main components of Hive are:</p>
<ul>
<li>UI – The user interface for users to submit queries and other operations to the system. As of 2011 the system had a command line interface and a web based GUI was being developed.</li>
diff --git a/docs/latest/developerguide-udtf_27362086/index.html b/docs/latest/developerguide-udtf_27362086/index.html
index ed4bdb9..7775a8a 100644
--- a/docs/latest/developerguide-udtf_27362086/index.html
+++ b/docs/latest/developerguide-udtf_27362086/index.html
@@ -121,14 +121,6 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--developerguide-udtf>Apache Hive : DeveloperGuide UDTF</h1>
-<h1 id=writing-udtfs>Writing UDTF’s</h1>
-<ul>
-<li><a href=#writing-udtfs>Writing UDTF’s</a>
-<ul>
-<li><a href=#genericudtf-interface>GenericUDTF Interface</a></li>
-</ul>
-</li>
-</ul>
<h2 id=genericudtf-interface>GenericUDTF Interface</h2>
<p>A custom UDTF can be created by extending the GenericUDTF abstract class and then implementing the <code>initialize</code>, <code>process</code>, and possibly <code>close</code> methods. The <code>initialize</code> method is called by Hive to notify the UDTF the argument types to expect. The UDTF must then return an object inspector corresponding to the row objects that the UDTF will generate. Once <code>initialize()</code> has been called, Hive will give rows to the UDTF using the <c [...]
<p>UDTF Example:</p>
diff --git a/docs/latest/developerguide_27362074/index.html b/docs/latest/developerguide_27362074/index.html
index c82d1d2..0739163 100644
--- a/docs/latest/developerguide_27362074/index.html
+++ b/docs/latest/developerguide_27362074/index.html
@@ -124,6 +124,8 @@ ASF
<aside class=table-of-contents>
<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--developerguide>Apache Hive : DeveloperGuide</a>
+<ul>
<li><a href=#code-organization-and-a-brief-architecture>Code Organization and a Brief Architecture</a>
<ul>
<li><a href=#introduction>Introduction</a></li>
@@ -154,6 +156,8 @@ ASF
</ul>
</li>
</ul>
+</li>
+</ul>
</nav>
</aside>
<h2 id=code-organization-and-a-brief-architecture>Code Organization and a Brief Architecture</h2>
diff --git a/docs/latest/druid-integration_65866491/index.html b/docs/latest/druid-integration_65866491/index.html
index 68369ca..3653abd 100644
--- a/docs/latest/druid-integration_65866491/index.html
+++ b/docs/latest/druid-integration_65866491/index.html
@@ -121,8 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--druid-integration>Apache Hive : Druid Integration</h1>
+<p>This page documents the work done for the integration between Druid and Hive introduced in Hive 2.2.0 (<a href=https://issues.apache.org/jira/browse/HIVE-14217>HIVE-14217</a>). Initially it was compatible with Druid 0.9.1.1, the latest stable release of Druid to that date.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#introduction>Introduction</a>
+<li><a href=#apache-hive--druid-integration>Apache Hive : Druid Integration</a>
<ul>
<li><a href=#objectives>Objectives</a></li>
</ul>
@@ -139,19 +142,9 @@ ASF
<ul>
<li><a href=#create-tables-linked-to-existing-druid-datasources>Create tables linked to existing Druid datasources</a></li>
<li><a href=#create-druid-datasources-from-hive>Create Druid datasources from Hive</a></li>
-<li><a href=#druid-kafka-ingestion-from-hive>Druid kafka ingestion from Hive</a>
-<ul>
-<li><a href=#startstopreset-druid-kafka-ingestion>Start/Stop/Reset Druid Kafka ingestion</a></li>
-</ul>
-</li>
+<li><a href=#druid-kafka-ingestion-from-hive>Druid kafka ingestion from Hive</a></li>
<li><a href=#insert-insert-overwrite-and-drop-statements>INSERT, INSERT OVERWRITE and DROP statements</a></li>
-<li><a href=#queries-completely-executed-in-druid>Queries completely executed in Druid</a>
-<ul>
-<li><a href=#select-queries>Select queries</a></li>
-<li><a href=#timeseries-queries>Timeseries queries</a></li>
-<li><a href=#groupby-queries>GroupBy queries</a></li>
-</ul>
-</li>
+<li><a href=#queries-completely-executed-in-druid>Queries completely executed in Druid</a></li>
<li><a href=#queries-across-druid-and-hive>Queries across Druid and Hive</a></li>
</ul>
</li>
@@ -159,11 +152,8 @@ ASF
</li>
<li><a href=#open-issues-jira>Open Issues (JIRA)</a></li>
</ul>
-<p> </p>
-<p>Version information</p>
-<p>Druid integration is introduced in Hive 2.2.0 (<a href=https://issues.apache.org/jira/browse/HIVE-14217>HIVE-14217</a>). Initially it was compatible with Druid 0.9.1.1, the latest stable release of Druid to that date.</p>
-<h1 id=introduction>Introduction</h1>
-<p>This page documents the work done for the integration between Druid and Hive, which was started in <a href=https://issues.apache.org/jira/browse/HIVE-14217>HIVE-14217</a>.</p>
+</nav>
+</aside>
<h2 id=objectives>Objectives</h2>
<p>Our main <strong>goal</strong> is to be able to index data from Hive into Druid, and to be able to query Druid datasources from Hive. Completing this work will bring benefits to the Druid and Hive systems alike:</p>
<ul>
diff --git a/docs/latest/dynamicpartitions_27823715/index.html b/docs/latest/dynamicpartitions_27823715/index.html
index ed64236..cde027d 100644
--- a/docs/latest/dynamicpartitions_27823715/index.html
+++ b/docs/latest/dynamicpartitions_27823715/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--dynamicpartitions>Apache Hive : DynamicPartitions</h1>
-<h1 id=dynamic-partitions>Dynamic Partitions</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#dynamic-partitions>Dynamic Partitions</a>
+<li><a href=#apache-hive--dynamicpartitions>Apache Hive : DynamicPartitions</a>
<ul>
<li><a href=#documentation>Documentation</a></li>
<li><a href=#terminology>Terminology</a></li>
@@ -133,6 +134,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=documentation>Documentation</h2>
<p>This is the <a href=https://hive.apache.org/docs/latest/designdocs_27362075/>design</a> document for dynamic partitions in Hive. Usage information is also available:</p>
<ul>
diff --git a/docs/latest/filterpushdowndev_27362092/index.html b/docs/latest/filterpushdowndev_27362092/index.html
index 2d9604e..90f20df 100644
--- a/docs/latest/filterpushdowndev_27362092/index.html
+++ b/docs/latest/filterpushdowndev_27362092/index.html
@@ -120,12 +120,13 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--filterpushdowndev>Apache Hive : FilterPushdownDev</h1>
-<h1 id=filter-pushdown>Filter Pushdown</h1>
+<h1 id=apache-hive--filter-pushdown>Apache Hive : Filter Pushdown</h1>
+<p>This document explains how we are planning to add support in Hive’s optimizer for pushing filters down into physical access methods. This is an important optimization for minimizing the amount of data scanned and processed by an access method (e.g. for an indexed key lookup), as well as reducing the amount of data passed into Hive for further query evaluation.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#filter-pushdown>Filter Pushdown</a>
+<li><a href=#apache-hive--filter-pushdown>Apache Hive : Filter Pushdown</a>
<ul>
-<li><a href=#introduction>Introduction</a></li>
<li><a href=#use-cases>Use Cases</a></li>
<li><a href=#components-involved>Components Involved</a></li>
<li><a href=#primary-filter-representation>Primary Filter Representation</a></li>
@@ -136,8 +137,8 @@ ASF
</ul>
</li>
</ul>
-<h2 id=introduction>Introduction</h2>
-<p>This document explains how we are planning to add support in Hive’s optimizer for pushing filters down into physical access methods. This is an important optimization for minimizing the amount of data scanned and processed by an access method (e.g. for an indexed key lookup), as well as reducing the amount of data passed into Hive for further query evaluation.</p>
+</nav>
+</aside>
<h2 id=use-cases>Use Cases</h2>
<p>Below are the main use cases we are targeting.</p>
<ul>
diff --git a/docs/latest/genericudafcasestudy_27362093/index.html b/docs/latest/genericudafcasestudy_27362093/index.html
index e60741c..db38890 100644
--- a/docs/latest/genericudafcasestudy_27362093/index.html
+++ b/docs/latest/genericudafcasestudy_27362093/index.html
@@ -120,28 +120,21 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--genericudafcasestudy>Apache Hive : GenericUDAFCaseStudy</h1>
-<h1 id=writing-genericudafs-a-tutorial>Writing GenericUDAFs: A Tutorial</h1>
+<h1 id=apache-hive--tutorial-to-write-a-genericudaf>Apache Hive : Tutorial to write a GenericUDAF</h1>
<p>User-Defined Aggregation Functions (UDAFs) are an excellent way to integrate advanced data-processing into Hive. Hive allows two varieties of UDAFs: simple and generic. Simple UDAFs, as the name implies, are rather simple to write, but incur performance penalties because of the use of <a href=http://java.sun.com/docs/books/tutorial/reflect/index.html>Java Reflection</a>, and do not allow features such as variable-length argument lists. Generic UDAFs allow all these features, but are p [...]
<p>This tutorial walks through the development of the <code>histogram()</code> UDAF, which computes a histogram with a fixed, user-specified number of bins, using a constant amount of memory and time linear in the input size. It demonstrates a number of features of Generic UDAFs, such as a complex return type (an array of structures), and type checking on the input. The assumption is that the reader wants to write a UDAF for eventual submission to the Hive open-source project, so steps s [...]
<p><strong>NOTE:</strong> In this tutorial, we walk through the creation of a <code>histogram()</code> function. Starting with the 0.6.0 release of Hive, this appears as the built-in function <code>histogram_numeric()</code>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#writing-genericudafs-a-tutorial>Writing GenericUDAFs: A Tutorial</a>
+<li><a href=#apache-hive--tutorial-to-write-a-genericudaf>Apache Hive : Tutorial to write a GenericUDAF</a>
<ul>
<li><a href=#preliminaries>Preliminaries</a></li>
<li><a href=#writing-the-source>Writing the source</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#writing-the-resolver>Writing the resolver</a></li>
-<li><a href=#writing-the-evaluator>Writing the evaluator</a>
-<ul>
-<li><a href=#getnewaggregationbuffer>getNewAggregationBuffer</a></li>
-<li><a href=#iterate>iterate</a></li>
-<li><a href=#terminatepartial>terminatePartial</a></li>
-<li><a href=#merge>merge</a></li>
-<li><a href=#terminate>terminate</a></li>
-</ul>
-</li>
+<li><a href=#writing-the-evaluator>Writing the evaluator</a></li>
</ul>
</li>
<li><a href=#modifying-the-function-registry>Modifying the function registry</a></li>
@@ -156,6 +149,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=preliminaries>Preliminaries</h2>
<p>Make sure you have the latest Hive trunk by running <code>svn up</code> in your Hive directory. More detailed instructions on downloading and setting up Hive can be found at <a href=http://wiki.apache.org/hadoop/Hive/GettingStarted>Getting Started</a> . Your local copy of Hive should work by running <code>build/dist/bin/hive</code> from the Hive root directory, and you should have some tables of data loaded into your local instance for testing whatever UDAF you have in mind. For this [...]
<p>The files we will be editing or creating are as follows, relative to the Hive root:</p>
diff --git a/docs/latest/gettingstarted_27362090/index.html b/docs/latest/gettingstarted_27362090/index.html
index 9b48209..b5c2f0d 100644
--- a/docs/latest/gettingstarted_27362090/index.html
+++ b/docs/latest/gettingstarted_27362090/index.html
@@ -121,44 +121,25 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--gettingstarted>Apache Hive : GettingStarted</h1>
-<p>Table of Contents</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li>
-<p><a href=#installation-and-configuration>Installation and Configuration</a></p>
-<pre><code> - [Running HiveServer2 and Beeline](#running-hiveserver2-and-beeline)+ [Requirements](#requirements)
-</code></pre>
-<ul>
-<li><a href=#installing-hive-from-a-stable-release>Installing Hive from a Stable Release</a></li>
-<li><a href=#building-hive-from-source>Building Hive from Source</a>
+<li><a href=#apache-hive--gettingstarted>Apache Hive : GettingStarted</a>
<ul>
-<li><a href=#compile-hive-on-master>Compile Hive on master</a></li>
-<li><a href=#compile-hive-on-branch-1>Compile Hive on branch-1</a></li>
-<li><a href=#compile-hive-prior-to-013-on-hadoop-020>Compile Hive Prior to 0.13 on Hadoop 0.20</a></li>
-<li><a href=#compile-hive-prior-to-013-on-hadoop-023>Compile Hive Prior to 0.13 on Hadoop 0.23</a></li>
-</ul>
-</li>
-<li><a href=#running-hive>Running Hive</a>
+<li><a href=#installation-and-configuration>Installation and Configuration</a>
<ul>
-<li><a href=#running-hive-cli>Running Hive CLI</a></li>
-<li><a href=#running-hiveserver2-and-beeline>Running HiveServer2 and Beeline</a></li>
-<li><a href=#running-hcatalog>Running HCatalog</a></li>
-<li><a href=#running-webhcat-templeton>Running WebHCat (Templeton)</a></li>
-</ul>
-</li>
+<li></li>
+<li><a href=#requirements>Requirements</a></li>
+<li><a href=#installing-hive-from-a-stable-release>Installing Hive from a Stable Release</a></li>
+<li><a href=#building-hive-from-source>Building Hive from Source</a></li>
+<li><a href=#running-hive>Running Hive</a></li>
<li><a href=#configuration-management-overview>Configuration Management Overview</a></li>
<li><a href=#runtime-configuration>Runtime Configuration</a></li>
<li><a href=#hive-map-reduce-and-local-mode>Hive, Map-Reduce and Local-Mode</a></li>
-<li><a href=#hive-logging>Hive Logging</a>
-<ul>
-<li><a href=#hiveserver2-logs>HiveServer2 Logs</a></li>
-<li><a href=#audit-logs>Audit Logs</a></li>
-<li><a href=#perf-logger>Perf Logger</a></li>
-</ul>
-</li>
+<li><a href=#hive-logging>Hive Logging</a></li>
</ul>
</li>
-<li>
-<p><a href=#ddl-operations>DDL Operations</a></p>
+<li><a href=#ddl-operations>DDL Operations</a>
<ul>
<li><a href=#creating-hive-tables>Creating Hive Tables</a></li>
<li><a href=#browsing-through-tables>Browsing through Tables</a></li>
@@ -166,31 +147,23 @@ ASF
<li><a href=#metadata-store>Metadata Store</a></li>
</ul>
</li>
-<li>
-<p><a href=#dml-operations>DML Operations</a></p>
-</li>
-<li>
-<p><a href=#sql-operations>SQL Operations</a></p>
-<ul>
-<li><a href=#example-queries>Example Queries</a>
+<li><a href=#dml-operations>DML Operations</a></li>
+<li><a href=#sql-operations>SQL Operations</a>
<ul>
-<li><a href=#selects-and-filters>SELECTS and FILTERS</a></li>
-<li><a href=#group-by>GROUP BY</a></li>
-<li><a href=#join>JOIN</a></li>
-<li><a href=#multitable-insert>MULTITABLE INSERT</a></li>
-<li><a href=#streaming>STREAMING</a></li>
+<li><a href=#example-queries>Example Queries</a></li>
</ul>
</li>
-</ul>
-</li>
-<li>
-<p><a href=#simple-example-use-cases>Simple Example Use Cases</a></p>
+<li><a href=#simple-example-use-cases>Simple Example Use Cases</a>
<ul>
<li><a href=#movielens-user-ratings>MovieLens User Ratings</a></li>
<li><a href=#apache-weblog-data>Apache Weblog Data</a></li>
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=installation-and-configuration>Installation and Configuration</h2>
<p>You can install a stable release of Hive by downloading a tarball, or you can download the source code and build Hive from that.</p>
<h4 id=running-hiveserver2-and-beeline>Running HiveServer2 and Beeline</h4>
diff --git a/docs/latest/groupbywithrollup_27826238/index.html b/docs/latest/groupbywithrollup_27826238/index.html
index 4f0b63e..7d182e3 100644
--- a/docs/latest/groupbywithrollup_27826238/index.html
+++ b/docs/latest/groupbywithrollup_27826238/index.html
@@ -120,13 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--groupbywithrollup>Apache Hive : GroupByWithRollup</h1>
-<h1 id=group-by-with-rollup>Group By With Rollup</h1>
-<p>References:</p>
-<p><a href=https://issues.apache.org/jira/secure/attachment/12437909/dp_design.txt>Original design doc</a></p>
-<p><a href=https://issues.apache.org/jira/browse/HIVE-2397>HIVE-2397</a></p>
+<h1 id=apache-hive--group-by-with-rollup>Apache Hive : Group By With Rollup</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#group-by-with-rollup>Group By With Rollup</a>
+<li><a href=#apache-hive--group-by-with-rollup>Apache Hive : Group By With Rollup</a>
<ul>
<li><a href=#terminology>Terminology</a></li>
<li><a href=#design>Design</a>
@@ -139,9 +137,12 @@ ASF
<li><a href=#no-map-aggr--skew--distinct--rollup>No Map Aggr & Skew & Distinct & Rollup</a></li>
</ul>
</li>
+<li><a href=#references>References</a></li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=terminology>Terminology</h2>
<ul>
<li>(No) Map Aggr: Shorthand for whether the configuration variable hive.map.aggr is set to true or false, meaning mapside aggregation is allowed or not respectively.</li>
@@ -209,6 +210,11 @@ ASF
<p>Reducer 3:</p>
<p>*Final (list-based) group by operator to perform final aggregations</p>
<p>Note that if there are no group by keys or distinct keys, Reducer 2 and Mapper 3 are removed from the plan and the reduce sink operator in Mapper 2 does not spray. Also, note that the reason for Mapper 2 spraying is that if the skew in the data existed in a column that is not immediately nulled by the rollup (e.g. if we the group by keys are columns g1, g2, g3 in that order, we are concerned with the case where the skew exists in column g1 or g2) the skew may continue to exist after t [...]
+<h2 id=references>References</h2>
+<ul>
+<li><a href=https://issues.apache.org/jira/secure/attachment/12437909/dp_design.txt>Original design doc</a></li>
+<li><a href=https://issues.apache.org/jira/browse/HIVE-2397>HIVE-2397</a></li>
+</ul>
</div>
</div>
<footer class="black-background static-bottom" style=padding:30px>
diff --git a/docs/latest/hbasebulkload_27362088/index.html b/docs/latest/hbasebulkload_27362088/index.html
index b277f4d..64fcd28 100644
--- a/docs/latest/hbasebulkload_27362088/index.html
+++ b/docs/latest/hbasebulkload_27362088/index.html
@@ -120,10 +120,12 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hbasebulkload>Apache Hive : HBaseBulkLoad</h1>
-<h1 id=hive-hbase-bulk-load>Hive HBase Bulk Load</h1>
+<h1 id=apache-hive--hbase-bulk-load>Apache Hive : HBase Bulk Load</h1>
+<p>This page explains how to use Hive to bulk load data into a new (empty) HBase table per <a href=https://issues.apache.org/jira/browse/HIVE-1295>HIVE-1295</a>. (If you’re not using a build which contains this functionality yet, you’ll need to build from source and make sure this patch and HIVE-1321 are both applied.)</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-hbase-bulk-load>Hive HBase Bulk Load</a>
+<li><a href=#apache-hive--hbase-bulk-load>Apache Hive : HBase Bulk Load</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#decide-on-target-hbase-schema>Decide on Target HBase Schema</a></li>
@@ -138,7 +140,8 @@ ASF
</ul>
</li>
</ul>
-<p>This page explains how to use Hive to bulk load data into a new (empty) HBase table per <a href=https://issues.apache.org/jira/browse/HIVE-1295>HIVE-1295</a>. (If you’re not using a build which contains this functionality yet, you’ll need to build from source and make sure this patch and HIVE-1321 are both applied.)</p>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p>Ideally, bulk load from Hive into HBase would be part of <a href=https://hive.apache.org/docs/latest/hbaseintegration_27362089/>HBaseIntegration</a>, making it as simple as this:</p>
<pre tabindex=0><code>CREATE TABLE new_hbase_table(rowkey string, x int, y int)
diff --git a/docs/latest/hbaseintegration_27362089/index.html b/docs/latest/hbaseintegration_27362089/index.html
index b103744..c5c8cc8 100644
--- a/docs/latest/hbaseintegration_27362089/index.html
+++ b/docs/latest/hbaseintegration_27362089/index.html
@@ -120,30 +120,32 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hbaseintegration>Apache Hive : HBaseIntegration</h1>
-<h1 id=hive-hbase-integration>Hive HBase Integration</h1>
+<h1 id=apache-hive--hbase-integration>Apache Hive : HBase Integration</h1>
+<p>This page documents the Hive/HBase integration support originally introduced in <a href=https://issues.apache.org/jira/browse/HIVE-705>HIVE-705</a>. This feature allows Hive QL statements to access <a href=http://hadoop.apache.org/hbase>HBase</a> tables for both read (SELECT) and write (INSERT). It is even possible to combine access to HBase tables with native Hive tables via joins and unions.</p>
+<p>A presentation is available from the <a href="http://wiki.apache.org/hadoop/Hive/Presentations?action=AttachFile&do=get&target=HiveHBase-HUG10.ppt">HBase HUG10 Meetup</a></p>
+<p>This feature is a work in progress, and suggestions for its improvement are very welcome.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li>
-<p><a href=#hive-hbase-integration>Hive HBase Integration</a></p>
-<pre><code> - [Avro Data Stored in HBase Columns](#avro-data-stored-in-hbase-columns)+ [Introduction](#introduction)
-</code></pre>
+<li><a href=#apache-hive--hbase-integration>Apache Hive : HBase Integration</a>
+<ul>
+<li><a href=#version-information>Version Information</a>
<ul>
+<li><a href=#avro-data-stored-in-hbase-columns>Avro Data Stored in HBase Columns</a></li>
+</ul>
+</li>
<li><a href=#storage-handlers>Storage Handlers</a></li>
<li><a href=#usage>Usage</a></li>
<li><a href=#column-mapping>Column Mapping</a>
<ul>
<li><a href=#multiple-columns-and-families>Multiple Columns and Families</a></li>
<li><a href=#hive-map-to-hbase-column-family>Hive MAP to HBase Column Family</a></li>
-<li><a href=#hive-map-to-hbase-column-prefix>Hive MAP to HBase Column Prefix</a>
-<ul>
-<li><a href=#hiding-column-prefixes>Hiding Column Prefixes</a></li>
-</ul>
-</li>
+<li><a href=#hive-map-to-hbase-column-prefix>Hive MAP to HBase Column Prefix</a></li>
<li><a href=#illegal-hive-primitive-to-hbase-column-family>Illegal: Hive Primitive to HBase Column Family</a></li>
<li><a href=#example-with-binary-columns>Example with Binary Columns</a></li>
<li><a href=#simple-composite-row-keys>Simple Composite Row Keys</a></li>
<li><a href=#complex-composite-row-keys-and-hbasekeyfactory>Complex Composite Row Keys and HBaseKeyFactory</a></li>
-<li><a href=#avro-data-stored-in-hbase-columns>Avro Data Stored in HBase Columns</a></li>
+<li><a href=#avro-data-stored-in-hbase-columns-1>Avro Data Stored in HBase Columns</a></li>
</ul>
</li>
<li><a href=#put-timestamps>Put Timestamps</a></li>
@@ -158,15 +160,13 @@ ASF
</ul>
</li>
</ul>
-<p>Version information</p>
+</nav>
+</aside>
+<h2 id=version-information>Version Information</h2>
<h3 id=avro-data-stored-in-hbase-columns>Avro Data Stored in HBase Columns</h3>
<p>As of Hive 0.9.0 the HBase integration requires at least HBase 0.92, earlier versions of Hive were working with HBase 0.89/0.90</p>
<p>Version information</p>
<p>Hive 1.x will remain compatible with HBase 0.98.x and lower versions. Hive 2.x will be compatible with HBase 1.x and higher. (See <a href=https://issues.apache.org/jira/browse/HIVE-10990>HIVE-10990</a> for details.) Consumers wanting to work with HBase 1.x using Hive 1.x will need to compile Hive 1.x stream code themselves.</p>
-<h2 id=introduction>Introduction</h2>
-<p>This page documents the Hive/HBase integration support originally introduced in <a href=https://issues.apache.org/jira/browse/HIVE-705>HIVE-705</a>. This feature allows Hive QL statements to access <a href=http://hadoop.apache.org/hbase>HBase</a> tables for both read (SELECT) and write (INSERT). It is even possible to combine access to HBase tables with native Hive tables via joins and unions.</p>
-<p>A presentation is available from the <a href="http://wiki.apache.org/hadoop/Hive/Presentations?action=AttachFile&do=get&target=HiveHBase-HUG10.ppt">HBase HUG10 Meetup</a></p>
-<p>This feature is a work in progress, and suggestions for its improvement are very welcome.</p>
<h2 id=storage-handlers>Storage Handlers</h2>
<p>Before proceeding, please read <a href=https://hive.apache.org/docs/latest/storagehandlers_27362063/>StorageHandlers</a> for an overview of the generic storage handler framework on which HBase integration depends.</p>
<h2 id=usage>Usage</h2>
diff --git a/docs/latest/hbasemetastoredevelopmentguide_55151960/index.html b/docs/latest/hbasemetastoredevelopmentguide_55151960/index.html
index c79499e..568775c 100644
--- a/docs/latest/hbasemetastoredevelopmentguide_55151960/index.html
+++ b/docs/latest/hbasemetastoredevelopmentguide_55151960/index.html
@@ -124,13 +124,17 @@ ASF
<p> </p>
<p>Guide for contributors to the metastore on hbase development work. Umbrella JIRA - <a href=https://issues.apache.org/jira/browse/HIVE-9452>HIVE-9452</a></p>
<p>This work is discontinued and the code is removed in release 3.0.0 (<a href=https://issues.apache.org/jira/browse/HIVE-17234>HIVE-17234</a>).</p>
-<p> </p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hbasemetastoredevelopmentguide>Apache Hive : HBaseMetastoreDevelopmentGuide</a></li>
<li><a href=#building>Building</a></li>
<li><a href=#setup-for-running-hive-against-hbase-metastore-->Setup for running hive against hbase metastore -</a></li>
<li><a href=#importing-metadata-from-rdbms-to-hbase>Importing metadata from rdbms to hbase</a></li>
<li><a href=#design-docs>Design Docs</a></li>
</ul>
+</nav>
+</aside>
<h1 id=building>Building</h1>
<p>You will need to download the source for Tephra and build it from the develop branch. You need Tephra 0.5.1-SNAPSHOT. You can get Tephra from <a href=https://github.com/caskdata/tephra>Cask’s github</a>. Switch to the branch develop and doing ‘mvn install’ will build the version you need.</p>
<h1 id=setup-for-running-hive-against-hbase-metastore-->Setup for running hive against hbase metastore -</h1>
diff --git a/docs/latest/hcatalog-authorization_34014782/index.html b/docs/latest/hcatalog-authorization_34014782/index.html
index 2284c59..4de4541 100644
--- a/docs/latest/hcatalog-authorization_34014782/index.html
+++ b/docs/latest/hcatalog-authorization_34014782/index.html
@@ -121,8 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hcatalog-authorization>Apache Hive : HCatalog Authorization</h1>
-<h1 id=storage-based-authorization>Storage Based Authorization</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hcatalog-authorization>Apache Hive : HCatalog Authorization</a></li>
<li><a href=#storage-based-authorization>Storage Based Authorization</a>
<ul>
<li><a href=#default-authorization-model-of-hive>Default Authorization Model of Hive</a></li>
@@ -138,6 +140,9 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
+<h1 id=storage-based-authorization>Storage Based Authorization</h1>
<h2 id=default-authorization-model-of-hive>Default Authorization Model of Hive</h2>
<p>The default authorization model of Hive supports a traditional RDBMS style of authorization based on users, groups and roles and granting them permissions to do operations on database or table. It is described in more detail in <a href=https://hive.apache.org/docs/latest/languagemanual-authorization_27362032/>Hive Authorization</a> and <a href=https://hive.apache.org/docs/latest/45876173/>Hive deprecated authorization mode / Legacy Mode</a>.</p>
<p>This RDBMS style of authorization is not very suitable for the typical use cases in Hadoop because of the following differences in implementation:</p>
diff --git a/docs/latest/hcatalog-cli_34013932/index.html b/docs/latest/hcatalog-cli_34013932/index.html
index 45dd881..dd85371 100644
--- a/docs/latest/hcatalog-cli_34013932/index.html
+++ b/docs/latest/hcatalog-cli_34013932/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hcatalog-cli>Apache Hive : HCatalog CLI</h1>
-<h1 id=command-line-interface>Command Line Interface</h1>
+<h1 id=apache-hive--hcatalog-command-line-interface>Apache Hive : HCatalog Command Line Interface</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#command-line-interface>Command Line Interface</a>
+<li><a href=#apache-hive--hcatalog-command-line-interface>Apache Hive : HCatalog Command Line Interface</a>
<ul>
<li><a href=#set-up>Set Up</a></li>
<li><a href=#hcatalog-cli>HCatalog CLI</a>
@@ -152,6 +153,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=set-up>Set Up</h2>
<p>The HCatalog command line interface (CLI) can be invoked as <code>HIVE_HOME=</code><em>hive_home hcat_home</em><code>/bin/hcat</code> where <em>hive_home</em> is the directory where Hive has been installed and <em>hcat_home</em> is the directory where HCatalog has been installed.</p>
<p>If you are using BigTop’s rpms or debs you can invoke the CLI by doing <code>/usr/bin/hcat</code>.</p>
diff --git a/docs/latest/hcatalog-configuration-properties_39622369/index.html b/docs/latest/hcatalog-configuration-properties_39622369/index.html
index 9c39ee1..99d7bbc 100644
--- a/docs/latest/hcatalog-configuration-properties_39622369/index.html
+++ b/docs/latest/hcatalog-configuration-properties_39622369/index.html
@@ -121,6 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hcatalog-configuration-properties>Apache Hive : HCatalog Configuration Properties</h1>
+<p>Apache HCatalog’s behaviour can be modified through the use of a few configuration parameters specified in jobs submitted to it. This document details all the various knobs that users have available to them, and what they accomplish. </p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--hcatalog-configuration-properties>Apache Hive : HCatalog Configuration Properties</a>
<ul>
<li><a href=#setup>Setup</a></li>
<li><a href=#storage-directives>Storage Directives</a></li>
@@ -129,7 +134,10 @@ ASF
<li><a href=#data-promotion-behaviour>Data Promotion Behaviour</a></li>
<li><a href=#hcatrecordreader-error-tolerance-behaviour>HCatRecordReader Error Tolerance Behaviour</a></li>
</ul>
-<p>Apache HCatalog’s behaviour can be modified through the use of a few configuration parameters specified in jobs submitted to it. This document details all the various knobs that users have available to them, and what they accomplish. </p>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=setup>Setup</h2>
<p>The properties described in this page are meant to be job-level properties set on HCatalog through the jobConf passed into it. This means that this page is relevant for Pig users of <a href=https://hive.apache.org/docs/latest/hcatalog-loadstore_34013511/>HCatLoader/HCatStorer</a>, or MapReduce users of <a href=https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/>HCatInputFormat/HCatOutputFormat</a>. For a MapReduce user of HCatalog, these must be present as key-values in [...]
<h2 id=storage-directives>Storage Directives</h2>
diff --git a/docs/latest/hcatalog-dynamicpartitions_34014006/index.html b/docs/latest/hcatalog-dynamicpartitions_34014006/index.html
index 9dd3027..2b526d5 100644
--- a/docs/latest/hcatalog-dynamicpartitions_34014006/index.html
+++ b/docs/latest/hcatalog-dynamicpartitions_34014006/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hcatalog-dynamicpartitions>Apache Hive : HCatalog DynamicPartitions</h1>
-<h1 id=dynamic-partitioning>Dynamic Partitioning</h1>
+<h1 id=apache-hive--hcatalog-dynamic-partitioning>Apache Hive : HCatalog Dynamic Partitioning</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#dynamic-partitioning>Dynamic Partitioning</a>
+<li><a href=#apache-hive--hcatalog-dynamic-partitioning>Apache Hive : HCatalog Dynamic Partitioning</a>
<ul>
<li><a href=#overview>Overview</a>
<ul>
@@ -136,6 +137,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p>When writing data in HCatalog it is possible to write all records to a single partition. In this case the partition column(s) need not be in the output data.</p>
<p>The following Pig script illustrates this:</p>
diff --git a/docs/latest/hcatalog-inputoutput_34013776/index.html b/docs/latest/hcatalog-inputoutput_34013776/index.html
index a2f216d..9a71b9b 100644
--- a/docs/latest/hcatalog-inputoutput_34013776/index.html
+++ b/docs/latest/hcatalog-inputoutput_34013776/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hcatalog-inputoutput>Apache Hive : HCatalog InputOutput</h1>
-<h1 id=input-and-output-interfaces>Input and Output Interfaces</h1>
+<h1 id=apache-hive--hcatalog-input-and-output-interfaces>Apache Hive : HCatalog Input and Output Interfaces</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#input-and-output-interfaces>Input and Output Interfaces</a>
+<li><a href=#apache-hive--hcatalog-input-and-output-interfaces>Apache Hive : HCatalog Input and Output Interfaces</a>
<ul>
<li><a href=#set-up>Set Up</a></li>
<li><a href=#hcatinputformat>HCatInputFormat</a>
@@ -133,7 +134,7 @@ ASF
</li>
<li><a href=#hcatoutputformat>HCatOutputFormat</a>
<ul>
-<li><a href=#api>API</a></li>
+<li><a href=#api-1>API</a></li>
</ul>
</li>
<li><a href=#hcatrecord>HCatRecord</a></li>
@@ -149,6 +150,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=set-up>Set Up</h2>
<p>No HCatalog-specific setup is required for the HCatInputFormat and HCatOutputFormat interfaces.</p>
<p><strong>Note</strong>: HCatalog is not thread safe.</p>
diff --git a/docs/latest/hcatalog-installhcat_34013403/index.html b/docs/latest/hcatalog-installhcat_34013403/index.html
index b6a5104..68026c3 100644
--- a/docs/latest/hcatalog-installhcat_34013403/index.html
+++ b/docs/latest/hcatalog-installhcat_34013403/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hcatalog-installhcat>Apache Hive : HCatalog InstallHCat</h1>
-<h1 id=installation-from-tarball>Installation from Tarball</h1>
+<h1 id=apache-hive--hcatalog-installation-from-tarball>Apache Hive : HCatalog Installation from Tarball</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#installation-from-tarball>Installation from Tarball</a>
+<li><a href=#apache-hive--hcatalog-installation-from-tarball>Apache Hive : HCatalog Installation from Tarball</a>
<ul>
<li><a href=#hcatalog-installed-with-hive>HCatalog Installed with Hive</a></li>
<li><a href=#hcatalog-command-line>HCatalog Command Line</a></li>
@@ -132,6 +133,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=hcatalog-installed-with-hive>HCatalog Installed with Hive</h2>
<p>Version</p>
<p>HCatalog is installed with Hive, starting with Hive release 0.11.0.<br>
diff --git a/docs/latest/hcatalog-loadstore_34013511/index.html b/docs/latest/hcatalog-loadstore_34013511/index.html
index cf9fff6..abcc517 100644
--- a/docs/latest/hcatalog-loadstore_34013511/index.html
+++ b/docs/latest/hcatalog-loadstore_34013511/index.html
@@ -120,54 +120,27 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hcatalog-loadstore>Apache Hive : HCatalog LoadStore</h1>
-<h1 id=load-and-store-interfaces>Load and Store Interfaces</h1>
+<h1 id=apache-hive--hcatalog-load-and-store-interfaces>Apache Hive : HCatalog Load and Store Interfaces</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#load-and-store-interfaces>Load and Store Interfaces</a>
+<li><a href=#apache-hive--hcatalog-load-and-store-interfaces>Apache Hive : HCatalog Load and Store Interfaces</a>
<ul>
<li><a href=#set-up>Set Up</a></li>
<li><a href=#running-pig>Running Pig</a></li>
<li><a href=#hcatloader>HCatLoader</a>
<ul>
-<li><a href=#usage>Usage</a>
-<ul>
-<li><a href=#assumptions>Assumptions</a></li>
-</ul>
-</li>
-<li><a href=#hcatloader-data-types>HCatLoader Data Types</a>
-<ul>
-<li><a href=#types-in-hive-0120-and-earlier>Types in Hive 0.12.0 and Earlier</a></li>
-<li><a href=#types-in-hive-0130-and-later>Types in Hive 0.13.0 and Later</a></li>
-</ul>
-</li>
-<li><a href=#running-pig-with-hcatalog>Running Pig with HCatalog</a>
-<ul>
-<li><a href=#the--usehcatalog-flag>The -useHCatalog Flag</a></li>
-<li><a href=#jars-and-configuration-files>Jars and Configuration Files</a></li>
-<li><a href=#authentication>Authentication</a></li>
-</ul>
-</li>
-<li><a href=#load-examples>Load Examples</a>
-<ul>
-<li><a href=#filter-operators>Filter Operators</a></li>
-</ul>
-</li>
+<li><a href=#usage>Usage</a></li>
+<li><a href=#hcatloader-data-types>HCatLoader Data Types</a></li>
+<li><a href=#running-pig-with-hcatalog>Running Pig with HCatalog</a></li>
+<li><a href=#load-examples>Load Examples</a></li>
</ul>
</li>
<li><a href=#hcatstorer>HCatStorer</a>
<ul>
-<li><a href=#usage>Usage</a>
-<ul>
-<li><a href=#assumptions>Assumptions</a></li>
-</ul>
-</li>
+<li><a href=#usage-1>Usage</a></li>
<li><a href=#store-examples>Store Examples</a></li>
-<li><a href=#hcatstorer-data-types>HCatStorer Data Types</a>
-<ul>
-<li><a href=#types-in-hive-0120-and-earlier>Types in Hive 0.12.0 and Earlier</a></li>
-<li><a href=#types-in-hive-0130-and-later>Types in Hive 0.13.0 and Later</a></li>
-</ul>
-</li>
+<li><a href=#hcatstorer-data-types>HCatStorer Data Types</a></li>
</ul>
</li>
<li><a href=#data-type-mappings>Data Type Mappings</a>
@@ -179,6 +152,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=set-up>Set Up</h2>
<p>The HCatLoader and HCatStorer interfaces are used with Pig scripts to read and write data in HCatalog-managed tables. No HCatalog-specific setup is required for these interfaces.</p>
<p><strong>Note</strong>: HCatalog is not thread safe.</p>
diff --git a/docs/latest/hcatalog-notification_34014558/index.html b/docs/latest/hcatalog-notification_34014558/index.html
index f2f8159..20d782c 100644
--- a/docs/latest/hcatalog-notification_34014558/index.html
+++ b/docs/latest/hcatalog-notification_34014558/index.html
@@ -121,10 +121,12 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hcatalog-notification>Apache Hive : HCatalog Notification</h1>
-<h1 id=notification>Notification</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#notification>Notification</a>
+<li><a href=#apache-hive--hcatalog-notification>Apache Hive : HCatalog Notification</a>
<ul>
+<li><a href=#overview>Overview</a></li>
<li><a href=#notification-for-a-new-partition>Notification for a New Partition</a></li>
<li><a href=#notification-for-a-set-of-partitions>Notification for a Set of Partitions</a></li>
<li><a href=#server-configuration>Server Configuration</a>
@@ -136,6 +138,9 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
+<h2 id=overview>Overview</h2>
<p>Since version 0.2, HCatalog provides notifications for certain events happening in the system. This way applications such as Oozie can wait for those events and schedule the work that depends on them. The current version of HCatalog supports two kinds of events:</p>
<ul>
<li>Notification when a new partition is added</li>
diff --git a/docs/latest/hcatalog-readerwriter_34013921/index.html b/docs/latest/hcatalog-readerwriter_34013921/index.html
index 7647ed0..7bbd2d8 100644
--- a/docs/latest/hcatalog-readerwriter_34013921/index.html
+++ b/docs/latest/hcatalog-readerwriter_34013921/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hcatalog-readerwriter>Apache Hive : HCatalog ReaderWriter</h1>
-<h1 id=reader-and-writer-interfaces>Reader and Writer Interfaces</h1>
+<h1 id=apache-hive--hcatalog-reader-and-writer-interfaces>Apache Hive : HCatalog Reader and Writer Interfaces</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#reader-and-writer-interfaces>Reader and Writer Interfaces</a>
+<li><a href=#apache-hive--hcatalog-reader-and-writer-interfaces>Apache Hive : HCatalog Reader and Writer Interfaces</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#hcatreader>HCatReader</a></li>
@@ -132,6 +133,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p>HCatalog provides a data transfer API for parallel input and output without using MapReduce. This API provides a way to read data from a Hadoop cluster or write data into a Hadoop cluster, using a basic storage abstraction of tables and rows.</p>
<p>The data transfer API has three essential classes:</p>
diff --git a/docs/latest/hcatalog-storageformats_34013997/index.html b/docs/latest/hcatalog-storageformats_34013997/index.html
index 327557f..5c005ea 100644
--- a/docs/latest/hcatalog-storageformats_34013997/index.html
+++ b/docs/latest/hcatalog-storageformats_34013997/index.html
@@ -120,10 +120,13 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hcatalog-storageformats>Apache Hive : HCatalog StorageFormats</h1>
-<h1 id=storage-formats>Storage Formats</h1>
+<h1 id=apache-hive--hcatalog-storage-formats>Apache Hive : HCatalog Storage Formats</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#storage-formats>Storage Formats</a>
+<li><a href=#apache-hive--hcatalog-storage-formats>Apache Hive : HCatalog Storage Formats</a>
+<ul>
+<li>
<ul>
<li><a href=#serdes-and-storage-formats>SerDes and Storage Formats</a></li>
<li><a href=#usage-from-hive>Usage from Hive</a></li>
@@ -131,6 +134,10 @@ ASF
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h3 id=serdes-and-storage-formats>SerDes and Storage Formats</h3>
<p>HCatalog uses Hive’s SerDe class to serialize and deserialize data. SerDes are provided for RCFile, CSV text, JSON text, and SequenceFile formats. Check the <a href=https://hive.apache.org/docs/latest/serde_27362059/>SerDe documentation</a> for additional SerDes that might be included in new versions. For example, the <a href=https://hive.apache.org/docs/latest/avroserde_27850707/>Avro SerDe</a> was added in Hive 0.9.1, the <a href=https://hive.apache.org/docs/latest/languageman [...]
<p>Users can write SerDes for custom formats using these instructions:</p>
diff --git a/docs/latest/hcatalog-streaming-mutation-api_61337025/index.html b/docs/latest/hcatalog-streaming-mutation-api_61337025/index.html
index e0c5038..3c09ac8 100644
--- a/docs/latest/hcatalog-streaming-mutation-api_61337025/index.html
+++ b/docs/latest/hcatalog-streaming-mutation-api_61337025/index.html
@@ -122,7 +122,10 @@ ASF
<div class=docs>
<h1 id=apache-hive--hcatalog-streaming-mutation-api>Apache Hive : HCatalog Streaming Mutation API</h1>
<p>A Java API focused on mutating (insert/update/delete) records into transactional tables using Hive’s <a href=https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions>ACID</a> feature. It is introduced in Hive 2.0.0 (<a href=https://issues.apache.org/jira/browse/HIVE-10165>HIVE-10165</a>).</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hcatalog-streaming-mutation-api>Apache Hive : HCatalog Streaming Mutation API</a></li>
<li><a href=#background>Background</a></li>
<li><a href=#structure>Structure</a></li>
<li><a href=#data-requirements>Data Requirements</a></li>
@@ -135,8 +138,14 @@ ASF
</ul>
</li>
<li><a href=#reading-data>Reading Data</a></li>
-<li><a href=#example>Example</a></li>
+<li><a href=#example>Example</a>
+<ul>
+<li><a href=#attachments>Attachments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
<h1 id=background>Background</h1>
<p>In certain data processing use cases it is necessary to modify existing data when new facts arrive. An example of this is the classic ETL merge where a copy of a data set is kept in sync with a master by the frequent application of deltas. The deltas describe the mutations (inserts, updates, deletes) that have occurred to the master since the previous sync. To implement such a case using Hadoop traditionally demands that the partitions containing records targeted by the mutations be r [...]
<p>The availability of ACID tables in Hive provides a mechanism that both enables concurrent access to data stored in HDFS (so long as it’s in the ORC+ACID format) and also permits row level mutations on records within a table, without the need to rewrite the existing data. But while Hive itself supports <code>INSERT</code>, <code>UPDATE</code> and <code>DELETE</code> commands, and the ORC format can support large batches of mutations in a transaction, Hive’s execution engine [...]
diff --git a/docs/latest/hcatalog-usinghcat_34013260/index.html b/docs/latest/hcatalog-usinghcat_34013260/index.html
index 428d390..95cb66b 100644
--- a/docs/latest/hcatalog-usinghcat_34013260/index.html
+++ b/docs/latest/hcatalog-usinghcat_34013260/index.html
@@ -120,11 +120,13 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hcatalog-usinghcat>Apache Hive : HCatalog UsingHCat</h1>
-<h1 id=using-hcatalog>Using HCatalog</h1>
+<h1 id=apache-hive--hcatalog-usage>Apache Hive : HCatalog Usage</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#using-hcatalog>Using HCatalog</a>
+<li><a href=#apache-hive--hcatalog-usage>Apache Hive : HCatalog Usage</a>
<ul>
+<li><a href=#version-information>Version information</a></li>
<li><a href=#overview>Overview</a></li>
<li><a href=#hcatalog-architecture>HCatalog Architecture</a>
<ul>
@@ -140,10 +142,13 @@ ASF
</ul>
</li>
<li><a href=#hcatalog-web-api>HCatalog Web API</a></li>
+<li><a href=#attachments>Attachments:</a></li>
</ul>
</li>
</ul>
-<p>Version information</p>
+</nav>
+</aside>
+<h2 id=version-information>Version information</h2>
<p>HCatalog graduated from the Apache incubator and merged with the Hive project on March 26, 2013.<br>
Hive version 0.11.0 is the first release that includes HCatalog.</p>
<h2 id=overview>Overview</h2>
diff --git a/docs/latest/hive-apis-overview_61326349/index.html b/docs/latest/hive-apis-overview_61326349/index.html
index f98d2de..74736e9 100644
--- a/docs/latest/hive-apis-overview_61326349/index.html
+++ b/docs/latest/hive-apis-overview_61326349/index.html
@@ -122,7 +122,10 @@ ASF
<div class=docs>
<h1 id=apache-hive--hive-apis-overview>Apache Hive : Hive APIs Overview</h1>
<p>This page aims to catalogue and describe the various public facing APIs exposed by Hive in order to inform developers wishing to integrate their applications and frameworks with the Hive ecosystem. To date the following APIs have been identified in the Hive project that are either considered public, or widely used in the public domain:</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hive-apis-overview>Apache Hive : Hive APIs Overview</a></li>
<li><a href=#api-categories>API categories</a>
<ul>
<li><a href=#operation-based-apis>Operation based APIs</a></li>
@@ -139,9 +142,12 @@ ASF
<li><a href=#streaming-data-ingest-java>Streaming Data Ingest (Java)</a></li>
<li><a href=#streaming-mutation-java>Streaming Mutation (Java)</a></li>
<li><a href=#hive-jdbc-jdbc>hive-jdbc (JDBC)</a></li>
+<li><a href=#comments>Comments:</a></li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h1 id=api-categories>API categories</h1>
<p>The APIs can be segmented into two conceptual categories: operation based APIs and query based APIs.</p>
<h2 id=operation-based-apis>Operation based APIs</h2>
diff --git a/docs/latest/hive-metatool_55156221/index.html b/docs/latest/hive-metatool_55156221/index.html
index 1e7397f..f647817 100644
--- a/docs/latest/hive-metatool_55156221/index.html
+++ b/docs/latest/hive-metatool_55156221/index.html
@@ -121,16 +121,6 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-metatool>Apache Hive : Hive MetaTool</h1>
-<ul>
-<li><a href=#hive-metatool>Hive MetaTool</a>
-<ul>
-<li><a href=#the-metatool-command>The metatool Command</a></li>
-<li><a href=#usage-example>Usage Example</a></li>
-</ul>
-</li>
-</ul>
-<h2 id=hive-metatool>Hive MetaTool</h2>
-<p>Version 0.10.0 and later</p>
<p>Introduced in Hive 0.10.0. See <a href=https://issues.apache.org/jira/browse/HIVE-3056>HIVE-3056</a> and <a href=https://issues.apache.org/jira/browse/HIVE-3443>HIVE-3443</a>.</p>
<p>The Hive MetaTool enables administrators to do bulk updates on the location fields in database, table, and partition records in the metastore. It provides the following functionality:</p>
<ul>
diff --git a/docs/latest/hive-on-spark_42567714/index.html b/docs/latest/hive-on-spark_42567714/index.html
index a50872e..872452a 100644
--- a/docs/latest/hive-on-spark_42567714/index.html
+++ b/docs/latest/hive-on-spark_42567714/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-on-spark>Apache Hive : Hive on Spark</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hive-on-spark>Apache Hive : Hive on Spark</a></li>
<li><a href=#1-introduction>1. Introduction</a>
<ul>
<li><a href=#11-motivation>1.1 Motivation</a></li>
@@ -167,6 +170,8 @@ ASF
</li>
<li><a href=#4-summary>4. Summary</a></li>
</ul>
+</nav>
+</aside>
<h1 id=1-introduction>1. Introduction</h1>
<p>We propose modifying Hive to add Spark as a third execution backend(<a href=https://issues.apache.org/jira/browse/HIVE-7292>HIVE-7292</a>), parallel to MapReduce and Tez.</p>
<p>Spark is an open-source data analytics cluster computing framework that’s built outside of Hadoop’s two-stage MapReduce paradigm but on top of HDFS. Spark’s primary abstraction is a distributed collection of items called a Resilient Distributed Dataset (RDD). RDDs can be created from Hadoop InputFormats (such as HDFS files) or by transforming other RDDs. By being applied by a series of transformations such as groupBy and filter, or actions such as count and save that are provide [...]
diff --git a/docs/latest/hive-on-tez_33296197/index.html b/docs/latest/hive-on-tez_33296197/index.html
index 2168891..f9c0c38 100644
--- a/docs/latest/hive-on-tez_33296197/index.html
+++ b/docs/latest/hive-on-tez_33296197/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-on-tez>Apache Hive : Hive on Tez</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hive-on-tez>Apache Hive : Hive on Tez</a></li>
<li><a href=#overview>Overview</a>
<ul>
<li><a href=#multiple-reduce-stages>Multiple reduce stages</a></li>
@@ -176,10 +179,16 @@ ASF
</li>
<li><a href=#installation-and-configuration>Installation and Configuration</a>
<ul>
+<li>
+<ul>
<li><a href=#hive-tez-compatibility>Hive-Tez Compatibility</a></li>
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h1 id=overview>Overview</h1>
<p><a href=http://tez.apache.org/>Tez</a> is a new application framework built on Hadoop Yarn that can execute complex directed acyclic graphs of general data processing tasks. In many ways it can be thought of as a more flexible and powerful successor of the map-reduce framework.</p>
<p>It generalizes map and reduce tasks by exposing interfaces for generic data processing tasks, which consist of a triplet of interfaces: input, output and processor. These tasks are the vertices in the execution graph. Edges (i.e.: data connections between tasks) are first class citizens in Tez and together with the input/output interfaces greatly increase the flexibility of how data is transferred between tasks.</p>
diff --git a/docs/latest/hive-schema-tool_34835119/index.html b/docs/latest/hive-schema-tool_34835119/index.html
index e1b8d20..8461805 100644
--- a/docs/latest/hive-schema-tool_34835119/index.html
+++ b/docs/latest/hive-schema-tool_34835119/index.html
@@ -121,15 +121,23 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-schema-tool>Apache Hive : Hive Schema Tool</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--hive-schema-tool>Apache Hive : Hive Schema Tool</a>
<ul>
<li><a href=#metastore-schema-verification>Metastore Schema Verification</a></li>
<li><a href=#the-hive-schema-tool>The Hive Schema Tool</a>
<ul>
-<li><a href=#the-schematool-command>The schematool Command</a></li>
+<li><a href=#the-schematool-command>The <code>schematool</code> Command</a></li>
<li><a href=#usage-examples>Usage Examples</a></li>
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=metastore-schema-verification>Metastore Schema Verification</h2>
<p>Version</p>
<p>Introduced in Hive 0.12.0. See <a href=https://issues.apache.org/jira/browse/HIVE-3764>HIVE-3764</a>.</p>
diff --git a/docs/latest/hive-transactions_40509723/index.html b/docs/latest/hive-transactions_40509723/index.html
index c2d9844..1473c6e 100644
--- a/docs/latest/hive-transactions_40509723/index.html
+++ b/docs/latest/hive-transactions_40509723/index.html
@@ -120,11 +120,13 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hive-transactions>Apache Hive : Hive Transactions</h1>
-<h1 id=acid-and-transactions-in-hive>ACID and Transactions in Hive</h1>
+<h1 id=apache-hive--acid-transactions>Apache Hive : ACID Transactions</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#acid-and-transactions-in-hive>ACID and Transactions in Hive</a>
+<li><a href=#apache-hive--acid-transactions>Apache Hive : ACID Transactions</a>
<ul>
+<li><a href=#upgrade-to-hive-3>Upgrade to Hive 3+</a></li>
<li><a href=#what-is-acid-and-why-should-you-use-it>What is ACID and why should you use it?</a></li>
<li><a href=#limitations>Limitations</a></li>
<li><a href=#streaming-apis>Streaming APIs</a></li>
@@ -132,23 +134,14 @@ ASF
<li><a href=#basic-design>Basic Design</a>
<ul>
<li><a href=#base-and-delta-directories>Base and Delta Directories</a></li>
-<li><a href=#compactor>Compactor</a>
-<ul>
-<li><a href=#delta-file-compaction>Delta File Compaction</a></li>
-<li><a href=#initiator>Initiator</a></li>
-<li><a href=#worker>Worker</a></li>
-<li><a href=#cleaner>Cleaner</a></li>
-<li><a href=#acidhousekeeperservice>AcidHouseKeeperService</a></li>
-<li><a href=#show-compactions>SHOW COMPACTIONS</a></li>
-</ul>
-</li>
+<li><a href=#compactor>Compactor</a></li>
<li><a href=#transactionlock-manager>Transaction/Lock Manager</a></li>
</ul>
</li>
<li><a href=#configuration>Configuration</a>
<ul>
<li><a href=#new-configuration-parameters-for-transactions>New Configuration Parameters for Transactions</a></li>
-<li><a href=#configuration-values-to-set-for-insert,-update,-delete>Configuration Values to Set for INSERT, UPDATE, DELETE</a></li>
+<li><a href=#configuration-values-to-set-forinsert-update-delete>Configuration Values to Set for <em>INSERT, UPDATE, DELETE</em></a></li>
<li><a href=#configuration-values-to-set-for-compaction>Configuration Values to Set for Compaction</a></li>
<li><a href=#compaction-pooling>Compaction pooling</a></li>
</ul>
@@ -158,7 +151,9 @@ ASF
</li>
<li><a href=#talks-and-presentations>Talks and Presentations</a></li>
</ul>
-<p>Hive 3 Warning</p>
+</nav>
+</aside>
+<h2 id=upgrade-to-hive-3>Upgrade to Hive 3+</h2>
<p>Any transactional tables created by a Hive version prior to Hive 3 require Major Compaction to be run on every partition before upgrading to 3.0. More precisely, any partition which has had any update/delete/merge statements executed on it since the last Major Compaction, has to undergo another Major Compaction. No more update/delete/merge may happen on this partition until after Hive is upgraded to Hive 3.</p>
<h2 id=what-is-acid-and-why-should-you-use-it>What is ACID and why should you use it?</h2>
<p>ACID stands for four traits of database transactions: Atomicity (an operation either succeeds completely or fails, it does not leave partial data), Consistency (once an application performs an operation the results of that operation are visible to it in every subsequent operation), <a href=https://en.wikipedia.org/wiki/Isolation_(database_systems)>Isolation</a> (an incomplete operation by one user does not cause unexpected side effects for other users), and Durability (once an operat [...]
diff --git a/docs/latest/hive-udfs_282102277/index.html b/docs/latest/hive-udfs_282102277/index.html
index 3931f9a..8a19993 100644
--- a/docs/latest/hive-udfs_282102277/index.html
+++ b/docs/latest/hive-udfs_282102277/index.html
@@ -121,6 +121,14 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hive-udfs>Apache Hive : Hive UDFs</h1>
+<p>Hive User-Defined Functions (UDFs) are custom functions developed in Java and seamlessly integrated with Apache Hive. UDFs are routines designed to accept parameters, execute a specific action, and return the resulting value. The return value can either be a single scalar row or a complete result set, depending on the UDF’s code and the implemented interface. UDFs represent a powerful capability that enhances classical SQL functionality by allowing the integration of custom code [...]
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--hive-udfs>Apache Hive : Hive UDFs</a>
+<ul>
+<li><a href=#overview>Overview</a></li>
+<li><a href=#available-function>Available function</a>
<ul>
<li><a href=#built-in-aggregate-functions-udaf>Built-in Aggregate Functions (UDAF)</a></li>
<li><a href=#built-in-table-generating-functions-udtf>Built-in Table-Generating Functions (UDTF)</a></li>
@@ -135,8 +143,13 @@ ASF
<li><a href=#geospatial>Geospatial</a></li>
<li><a href=#creating-custom-udfs>Creating Custom UDF’s</a></li>
</ul>
-<p>Hive User-Defined Functions (UDFs) are custom functions developed in Java and seamlessly integrated with Apache Hive. UDFs are routines designed to accept parameters, execute a specific action, and return the resulting value. The return value can either be a single scalar row or a complete result set, depending on the UDF’s code and the implemented interface. UDFs represent a powerful capability that enhances classical SQL functionality by allowing the integration of custom code [...]
-<p>Important</p>
+</li>
+</ul>
+</li>
+</ul>
+</nav>
+</aside>
+<h2 id=overview>Overview</h2>
<p>Every UDF’s evaluate method is one row at a time! This means if your UDFs has complex code, it could introduce performance issue in execution time.</p>
<p>To gain an understanding of UDFs, let’s begin with an example to comprehend their execution pattern.</p>
<p><strong>UDF’s in action</strong></p>
@@ -145,6 +158,7 @@ ASF
<p>As we see how a built-in UDF works let’s see what kind of built-in UDFs the Apache Hive has.</p>
<p>Tipp</p>
<p>All Hive keywords are <strong>case-insensitive</strong>, including the names of Hive operators and functions. I.e: length and LENGTH are also accepted by the Hive.</p>
+<h2 id=available-function>Available function</h2>
<h3 id=built-in-aggregate-functions-udaf>Built-in Aggregate Functions (UDAF)</h3>
<p>Hive Aggregate Functions (UDAF) take multiple rows as input and return a single row as output. Depending on the functionality it mostly aggregates the values and returns a single result. These functions are mainly used in the GROUP BY statements.</p>
<p>These functions can be used without GROUP BY as well. </p>
diff --git a/docs/latest/hiveclient_27362101/index.html b/docs/latest/hiveclient_27362101/index.html
index 36b9288..eef1d48 100644
--- a/docs/latest/hiveclient_27362101/index.html
+++ b/docs/latest/hiveclient_27362101/index.html
@@ -121,7 +121,12 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hiveclient>Apache Hive : HiveClient</h1>
+<p>This page describes the different clients supported by Hive. The command line client currently only supports an embedded server. The JDBC and Thrift-Java clients support both embedded and standalone servers. Clients in other languages only support standalone servers.</p>
+<p>For details about the standalone server see <a href=https://hive.apache.org/docs/latest/hiveserver_27362111/>Hive Server</a> or <a href=https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/>HiveServer2</a>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hiveclient>Apache Hive : HiveClient</a></li>
<li><a href=#command-line>Command Line</a></li>
<li><a href=#jdbc>JDBC</a>
<ul>
@@ -145,8 +150,8 @@ ASF
</ul>
</li>
</ul>
-<p>This page describes the different clients supported by Hive. The command line client currently only supports an embedded server. The JDBC and Thrift-Java clients support both embedded and standalone servers. Clients in other languages only support standalone servers.</p>
-<p>For details about the standalone server see <a href=https://hive.apache.org/docs/latest/hiveserver_27362111/>Hive Server</a> or <a href=https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/>HiveServer2</a>.</p>
+</nav>
+</aside>
<h1 id=command-line>Command Line</h1>
<p>Operates in embedded mode only, that is, it needs to have access to the Hive libraries. For more details see <a href=https://hive.apache.org/docs/latest/gettingstarted_27362090/>Getting Started</a> and <a href=https://hive.apache.org/docs/latest/languagemanual-cli_27362033/>Hive CLI</a>.</p>
<h1 id=jdbc>JDBC</h1>
diff --git a/docs/latest/hivederbyservermode_27362068/index.html b/docs/latest/hivederbyservermode_27362068/index.html
index 4eba5b5..644487c 100644
--- a/docs/latest/hivederbyservermode_27362068/index.html
+++ b/docs/latest/hivederbyservermode_27362068/index.html
@@ -120,10 +120,15 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hivederbyservermode>Apache Hive : HiveDerbyServerMode</h1>
-<h1 id=hive-using-derby-in-server-mode>Hive Using Derby in Server Mode</h1>
+<h1 id=apache-hive--using-derby-in-server-mode>Apache Hive : Using Derby in Server Mode</h1>
+<p>Hive in embedded mode has a limitation of one active user at a time. You may want to run <a href=http://db.apache.org/derby/>Derby</a> as a Network Server, this way multiple users can access it simultaneously from different systems.</p>
+<p>See <a href=#metadata-store>Metadata Store</a> and <a href=#embedded-metastore>Embedded Metastore</a> for more information.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-using-derby-in-server-mode>Hive Using Derby in Server Mode</a>
+<li><a href=#apache-hive--using-derby-in-server-mode>Apache Hive : Using Derby in Server Mode</a>
+<ul>
+<li>
<ul>
<li><a href=#download-derby>Download Derby</a></li>
<li><a href=#set-environment>Set Environment</a></li>
@@ -135,8 +140,10 @@ ASF
</ul>
</li>
</ul>
-<p>Hive in embedded mode has a limitation of one active user at a time. You may want to run <a href=http://db.apache.org/derby/>Derby</a> as a Network Server, this way multiple users can access it simultaneously from different systems.</p>
-<p>See <a href=#metadata-store>Metadata Store</a> and <a href=#embedded-metastore>Embedded Metastore</a> for more information.</p>
+</li>
+</ul>
+</nav>
+</aside>
<h3 id=download-derby>Download Derby</h3>
<p>It is suggested you download the version of Derby that ships with Hive. If you have already run Hive in embedded mode, the first line of <code>derby.log</code> contains the version.</p>
<p>My structure looks like this:</p>
diff --git a/docs/latest/hivedeveloperfaq_27823747/index.html b/docs/latest/hivedeveloperfaq_27823747/index.html
index 06f76cc..908382d 100644
--- a/docs/latest/hivedeveloperfaq_27823747/index.html
+++ b/docs/latest/hivedeveloperfaq_27823747/index.html
@@ -124,6 +124,8 @@ ASF
<aside class=table-of-contents>
<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hivedeveloperfaq>Apache Hive : HiveDeveloperFAQ</a>
+<ul>
<li><a href=#developing>Developing</a>
<ul>
<li><a href=#how-do-i-move-some-files>How do I move some files?</a></li>
@@ -164,6 +166,8 @@ ASF
</ul>
</li>
</ul>
+</li>
+</ul>
</nav>
</aside>
<h2 id=developing>Developing</h2>
diff --git a/docs/latest/hivejdbcinterface_27362100/index.html b/docs/latest/hivejdbcinterface_27362100/index.html
index 8ed8802..53a3917 100644
--- a/docs/latest/hivejdbcinterface_27362100/index.html
+++ b/docs/latest/hivejdbcinterface_27362100/index.html
@@ -120,18 +120,25 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hivejdbcinterface>Apache Hive : HiveJDBCInterface</h1>
-<h1 id=hive-jdbc-driver>Hive JDBC Driver</h1>
+<h1 id=apache-hive--jdbc-driver>Apache Hive : JDBC Driver</h1>
+<p>The current JDBC interface for Hive only supports running queries and fetching results. Only a small subset of the metadata calls are supported.</p>
+<p>To see how the JDBC interface can be used, see <a href=https://hive.apache.org/docs/latest/hiveclient_27362101/>sample code</a>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-jdbc-driver>Hive JDBC Driver</a>
+<li><a href=#apache-hive--jdbc-driver>Apache Hive : JDBC Driver</a>
+<ul>
+<li>
<ul>
<li><a href=#integration-with-pentaho>Integration with Pentaho</a></li>
<li><a href=#integration-with-squirrel-sql-client>Integration with SQuirrel SQL Client</a></li>
</ul>
</li>
</ul>
-<p>The current JDBC interface for Hive only supports running queries and fetching results. Only a small subset of the metadata calls are supported.</p>
-<p>To see how the JDBC interface can be used, see <a href=https://hive.apache.org/docs/latest/hiveclient_27362101/>sample code</a>.</p>
+</li>
+</ul>
+</nav>
+</aside>
<h3 id=integration-with-pentaho>Integration with Pentaho</h3>
<ol>
<li>Download pentaho report designer from the <a href="http://sourceforge.net/project/showfiles.php?group_id=140317&package_id=192362">pentaho website</a>.</li>
diff --git a/docs/latest/hiveodbc_27362099/index.html b/docs/latest/hiveodbc_27362099/index.html
index 96503c9..7559cce 100644
--- a/docs/latest/hiveodbc_27362099/index.html
+++ b/docs/latest/hiveodbc_27362099/index.html
@@ -120,10 +120,13 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hiveodbc>Apache Hive : HiveODBC</h1>
-<h1 id=hive-odbc-driver>Hive ODBC Driver</h1>
+<h1 id=apache-hive--odbc-driver>Apache Hive : ODBC Driver</h1>
+<p>These instructions are for the Hive ODBC driver available in Hive for <a href=https://hive.apache.org/docs/latest/hiveserver_27362111/>HiveServer1</a>.<br>
+There is no ODBC driver available for <a href=https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/>HiveServer2</a> as part of Apache Hive. There are third party ODBC drivers available from different vendors, and most of them seem to be free.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-odbc-driver>Hive ODBC Driver</a>
+<li><a href=#apache-hive--odbc-driver>Apache Hive : ODBC Driver</a>
<ul>
<li><a href=#introduction>Introduction</a>
<ul>
@@ -146,11 +149,11 @@ ASF
</ul>
</li>
</ul>
-<p>These instructions are for the Hive ODBC driver available in Hive for <a href=https://hive.apache.org/docs/latest/hiveserver_27362111/>HiveServer1</a>.<br>
-There is no ODBC driver available for <a href=https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/>HiveServer2</a> as part of Apache Hive. There are third party ODBC drivers available from different vendors, and most of them seem to be free.</p>
-<p><strong>HiveServer was removed from Hive releases starting with Hive 1.0.0. See <a href=https://issues.apache.org/jira/browse/HIVE-6977>HIVE-6977</a>. Please switch over to HiveServer2.</strong></p>
+</nav>
+</aside>
<h2 id=introduction>Introduction</h2>
<p>The Hive ODBC Driver is a software library that implements the Open Database Connectivity (ODBC) API standard for the Hive database management system, enabling ODBC compliant applications to interact seamlessly (ideally) with Hive through a standard interface. This driver will NOT be built as a part of the typical Hive build process and will need to be compiled and built separately according to the instructions below.</p>
+<p><strong>HiveServer was removed from Hive releases starting with Hive 1.0.0. See <a href=https://issues.apache.org/jira/browse/HIVE-6977>HIVE-6977</a>. Please switch over to HiveServer2.</strong></p>
<h3 id=suggested-reading>Suggested Reading</h3>
<p>This guide assumes you are already familiar with the following:</p>
<ul>
diff --git a/docs/latest/hiveplugins_27362098/index.html b/docs/latest/hiveplugins_27362098/index.html
index 22810d5..7a64ff2 100644
--- a/docs/latest/hiveplugins_27362098/index.html
+++ b/docs/latest/hiveplugins_27362098/index.html
@@ -120,11 +120,19 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--hiveplugins>Apache Hive : HivePlugins</h1>
+<h1 id=apache-hive--plugins>Apache Hive : Plugins</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--plugins>Apache Hive : Plugins</a>
<ul>
<li><a href=#creating-custom-udfs>Creating Custom UDFs</a></li>
<li><a href=#deploying-jars-for-user-defined-functions-and-user-defined-serdes>Deploying Jars for User Defined Functions and User Defined SerDes</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=creating-custom-udfs>Creating Custom UDFs</h2>
<p>First, you need to create a new class that extends UDF, with one or more methods named evaluate.</p>
<pre tabindex=0><code>package com.example.hive.udf;
diff --git a/docs/latest/hivereplicationdevelopment_55155632/index.html b/docs/latest/hivereplicationdevelopment_55155632/index.html
index 1316532..9eaee00 100644
--- a/docs/latest/hivereplicationdevelopment_55155632/index.html
+++ b/docs/latest/hivereplicationdevelopment_55155632/index.html
@@ -121,9 +121,17 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hivereplicationdevelopment>Apache Hive : HiveReplicationDevelopment</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hivereplicationdevelopment>Apache Hive : HiveReplicationDevelopment</a></li>
<li><a href=#introduction>Introduction</a>
<ul>
+<li>
+<ul>
+<li></li>
+</ul>
+</li>
<li><a href=#purposes-of-replication>Purposes of Replication</a>
<ul>
<li><a href=#disaster-recovery>Disaster Recovery</a></li>
@@ -132,18 +140,8 @@ ASF
</li>
<li><a href=#replication-taxonomy>Replication Taxonomy</a>
<ul>
-<li><a href=#transaction-source>Transaction Source</a>
-<ul>
-<li><a href=#primary-copy>Primary-Copy</a></li>
-<li><a href=#update-anywhere>Update-Anywhere</a></li>
-</ul>
-</li>
-<li><a href=#synchronization-strategy>Synchronization Strategy</a>
-<ul>
-<li><a href=#eager>Eager</a></li>
-<li><a href=#lazy>Lazy</a></li>
-</ul>
-</li>
+<li><a href=#transaction-source>Transaction Source</a></li>
+<li><a href=#synchronization-strategy>Synchronization Strategy</a></li>
</ul>
</li>
</ul>
@@ -164,12 +162,18 @@ ASF
<ul>
<li><a href=#events>Events</a></li>
<li><a href=#event-ids-state-ids-and-sequencing-of-exportsimports>Event IDs, State IDs, and Sequencing of Exports/Imports</a></li>
-<li><a href=#handling-of-events>Handling of Events</a></li>
+<li><a href=#handling-of-events>Handling of Events</a>
+<ul>
+<li></li>
+</ul>
+</li>
</ul>
</li>
<li><a href=#future-features>Future Features</a></li>
<li><a href=#references>References</a></li>
</ul>
+</nav>
+</aside>
<h1 id=introduction>Introduction</h1>
<p>Replication in the context of databases and warehouses is the process of duplication of entities from one warehouse to another. This can be at the broader level of an entire database, or at a smaller level such as a table or partition. The goal of replication is to have a replica which changes whenever the base entity changes.</p>
<p>In Hive, replication (introduced in <a href=https://issues.apache.org/jira/browse/HIVE-7973>Hive 1.2.0</a>) focuses on disaster recovery, using a lazy, primary-copy model. It uses notifications and export/import statements to implement an API for replication that can then be executed by other tools such as <a href=https://falcon.apache.org/>Falcon</a>.</p>
diff --git a/docs/latest/hivereplicationv2development_66850051/index.html b/docs/latest/hivereplicationv2development_66850051/index.html
index fa0fb1e..3a65414 100644
--- a/docs/latest/hivereplicationv2development_66850051/index.html
+++ b/docs/latest/hivereplicationv2development_66850051/index.html
@@ -121,7 +121,13 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hivereplicationv2development>Apache Hive : HiveReplicationv2Development</h1>
+<p>This document describes the second version of Hive Replication. Please refer to the <a href=https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/>first version of Hive Replication</a> for details on prior implementation.</p>
+<p>This work is under development and interfaces are subject to change. This has been designed for use in conjunction with external orchestration tools, which would be responsible for co-ordinating the right sequence of commands between source and target clusters, fault tolerance/failure handling, and also providing correct configuration options that are necessary to be able to do cross cluster replication.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hivereplicationv2development>Apache Hive : HiveReplicationv2Development</a></li>
+<li><a href=#version-information>Version information</a></li>
<li><a href=#issues-with-the-current-replication-system>Issues with the Current Replication System</a>
<ul>
<li><a href=#slowness>Slowness</a></li>
@@ -145,19 +151,17 @@ ASF
<ul>
<li><a href=#repl-dump>REPL DUMP</a>
<ul>
-<li><a href=#syntax>Syntax:</a></li>
-<li><a href=#return-values>Return values:</a></li>
-<li><a href=#note>Note:</a></li>
+<li></li>
</ul>
</li>
<li><a href=#repl-load>REPL LOAD</a>
<ul>
-<li><a href=#return-values>Return values:</a></li>
+<li></li>
</ul>
</li>
<li><a href=#repl-status>REPL STATUS</a>
<ul>
-<li><a href=#return-values>Return values:</a></li>
+<li></li>
</ul>
</li>
</ul>
@@ -166,9 +170,10 @@ ASF
<li><a href=#metastore-notification-api-security>Metastore notification API security</a></li>
<li><a href=#setupconfiguration>Setup/Configuration</a></li>
</ul>
-<p>This document describes the second version of Hive Replication. Please refer to the <a href=https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/>first version of Hive Replication</a> for details on prior implementation.</p>
-<p>This work is under development and interfaces are subject to change. This has been designed for use in conjunction with external orchestration tools, which would be responsible for co-ordinating the right sequence of commands between source and target clusters, fault tolerance/failure handling, and also providing correct configuration options that are necessary to be able to do cross cluster replication.</p>
-<p><strong>As of Hive 3.0.0 release : only managed table replication where Hive user owns the table contents is supported. External tables, ACID tables, statistics and constraint replication are not supported.</strong></p>
+</nav>
+</aside>
+<h1 id=version-information>Version information</h1>
+<p>As of Hive 3.0.0 release : only managed table replication where Hive user owns the table contents is supported. External tables, ACID tables, statistics and constraint replication are not supported.</p>
<h1 id=issues-with-the-current-replication-system>Issues with the Current Replication System</h1>
<p>Some of the observed issues with the <a href=https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/>current replication implementation</a> are as follows:</p>
<ol>
diff --git a/docs/latest/hiveserver2-clients_30758725/index.html b/docs/latest/hiveserver2-clients_30758725/index.html
index 5170c51..9265ed6 100644
--- a/docs/latest/hiveserver2-clients_30758725/index.html
+++ b/docs/latest/hiveserver2-clients_30758725/index.html
@@ -121,39 +121,29 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hiveserver2-clients>Apache Hive : HiveServer2 Clients</h1>
+<p>This page describes the different clients supported by <a href=https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/>HiveServer2</a>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hiveserver2-clients>Apache Hive : HiveServer2 Clients</a></li>
+<li><a href=#version-information>Version information</a></li>
<li><a href=#beeline--command-line-shell>Beeline – Command Line Shell</a>
<ul>
+<li>
+<ul>
<li><a href=#beeline-example>Beeline Example</a></li>
<li><a href=#beeline-commands>Beeline Commands</a></li>
<li><a href=#beeline-properties>Beeline Properties</a></li>
<li><a href=#beeline-hive-commands>Beeline Hive Commands</a></li>
<li><a href=#beeline-command-options>Beeline Command Options</a></li>
-<li><a href=#output-formats>Output Formats</a>
-<ul>
-<li><a href=#table>table</a></li>
-<li><a href=#vertical>vertical</a></li>
-<li><a href=#xmlattr>xmlattr</a></li>
-<li><a href=#xmlelements>xmlelements</a></li>
-<li><a href=#json>json</a></li>
-<li><a href=#jsonfile>jsonfile</a></li>
-<li><a href=#separated-value-output-formats>Separated-Value Output Formats</a>
-<ul>
-<li><a href=#csv2-tsv2-dsv>csv2, tsv2, dsv</a>
-<ul>
-<li><a href=#quoting-in-csv2,-tsv2-and-dsv-formats>Quoting in csv2, tsv2 and dsv Formats</a></li>
-</ul>
-</li>
-<li><a href=#csv,-tsv>csv, tsv</a></li>
-</ul>
-</li>
-</ul>
-</li>
+<li><a href=#output-formats>Output Formats</a></li>
<li><a href=#hiveserver2-logging>HiveServer2 Logging</a></li>
<li><a href=#cancelling-the-query>Cancelling the Query</a></li>
<li><a href=#background-query-in-terminal-script>Background Query in Terminal Script</a></li>
</ul>
</li>
+</ul>
+</li>
<li><a href=#jdbc>JDBC</a>
<ul>
<li><a href=#connection-urls>Connection URLs</a>
@@ -163,26 +153,17 @@ ASF
<li><a href=#connection-url-when-hiveserver2-is-running-in-http-mode>Connection URL When HiveServer2 Is Running in HTTP Mode</a></li>
<li><a href=#connection-url-when-ssl-is-enabled-in-hiveserver2>Connection URL When SSL Is Enabled in HiveServer2</a></li>
<li><a href=#connection-url-when-zookeeper-service-discovery-is-enabled>Connection URL When ZooKeeper Service Discovery Is Enabled</a></li>
-<li><a href=#named-connection-urls>Named Connection URLs</a></li>
-<li><a href=#reconnecting>Reconnecting</a></li>
+<li><a href=#named-connection-urls><strong>Named Connection URLs</strong></a></li>
+<li><a href=#reconnecting><strong>Reconnecting</strong></a></li>
<li><a href=#using-hive-sitexml-to-automatically-connect-to-hiveserver2>Using hive-site.xml to automatically connect to HiveServer2</a></li>
<li><a href=#using-beeline-sitexml-to-automatically-connect-to-hiveserver2>Using beeline-site.xml to automatically connect to HiveServer2</a></li>
-<li><a href=#using-jdbc>Using JDBC</a>
-<ul>
-<li><a href=#jdbc-client-sample-code>JDBC Client Sample Code</a></li>
-<li><a href=#running-the-jdbc-sample-code>Running the JDBC Sample Code</a></li>
-</ul>
-</li>
+<li><a href=#using-jdbc>Using JDBC</a></li>
</ul>
</li>
<li><a href=#jdbc-data-types>JDBC Data Types</a></li>
<li><a href=#jdbc-client-setup-for-a-secure-cluster>JDBC Client Setup for a Secure Cluster</a>
<ul>
-<li><a href=#multi-user-scenarios-and-programmatic-login-to-kerberos-kdc>Multi-User Scenarios and Programmatic Login to Kerberos KDC</a>
-<ul>
-<li><a href=#using-kerberos-with-a-pre-authenticated-subject>Using Kerberos with a Pre-Authenticated Subject</a></li>
-</ul>
-</li>
+<li><a href=#multi-user-scenarios-and-programmatic-login-to-kerberos-kdc>Multi-User Scenarios and Programmatic Login to Kerberos KDC</a></li>
</ul>
</li>
<li><a href=#jdbc-fetch-size>JDBC Fetch Size</a></li>
@@ -195,6 +176,8 @@ ASF
<li><a href=#integration-with-dbvissoftwares-dbvisualizer>Integration with DbVisSoftware’s DbVisualizer</a></li>
<li><a href=#advanced-features-for-integration-with-other-tools>Advanced Features for Integration with Other Tools</a>
<ul>
+<li>
+<ul>
<li><a href=#supporting-cookie-replay-in-http-mode>Supporting Cookie Replay in HTTP Mode</a></li>
<li><a href=#using-2-way-ssl-in-http-mode>Using 2-way SSL in HTTP Mode</a></li>
<li><a href=#passing-http-header-keyvalue-pairs-via-jdbc-driver>Passing HTTP Header Key/Value Pairs via JDBC Driver</a></li>
@@ -202,13 +185,11 @@ ASF
</ul>
</li>
</ul>
-<p>This page describes the different clients supported by <a href=https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/>HiveServer2</a>. Other documentation for HiveServer2 includes:</p>
-<ul>
-<li><a href=https://hive.apache.org/docs/latest/hiveserver2-overview_65147648/>HiveServer2 Overview</a></li>
-<li><a href=https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/>Setting Up HiveServer2</a></li>
-<li><a href=#hive-configuration-properties:- hiveserver2>Hive Configuration Properties: HiveServer2</a></li>
+</li>
</ul>
-<p>Version</p>
+</nav>
+</aside>
+<h1 id=version-information>Version information</h1>
<p>Introduced in Hive version 0.11. See <a href=https://issues.apache.org/jira/browse/HIVE-2935>HIVE-2935</a>.</p>
<h1 id=beeline--command-line-shell>Beeline – Command Line Shell</h1>
<p>HiveServer2 supports a command shell Beeline that works with HiveServer2. It’s a JDBC client that is based on the SQLLine CLI (<a href=http://sqlline.sourceforge.net/>http://sqlline.sourceforge.net/</a>). There’s detailed <a href=http://sqlline.sourceforge.net/#manual>documentation</a> of SQLLine which is applicable to Beeline as well.</p>
diff --git a/docs/latest/hiveserver2-overview_65147648/index.html b/docs/latest/hiveserver2-overview_65147648/index.html
index 7edc8ee..f58a57c 100644
--- a/docs/latest/hiveserver2-overview_65147648/index.html
+++ b/docs/latest/hiveserver2-overview_65147648/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--hiveserver2-overview>Apache Hive : HiveServer2 Overview</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--hiveserver2-overview>Apache Hive : HiveServer2 Overview</a></li>
<li><a href=#introduction>Introduction</a></li>
<li><a href=#hs2-architecture>HS2 Architecture</a>
<ul>
@@ -142,6 +145,8 @@ ASF
</li>
<li><a href=#resources>Resources</a></li>
</ul>
+</nav>
+</aside>
<h1 id=introduction>Introduction</h1>
<p>HiveServer2 (HS2) is a service that enables clients to execute queries against Hive. HiveServer2 is the successor to <a href=https://cwiki.apache.org/confluence/display/Hive/HiveServer>HiveServer1</a> which has been deprecated. HS2 supports multi-client concurrency and authentication. It is designed to provide better support for open API clients like JDBC and ODBC.</p>
<p>HS2 is a single process running as a composite service, which includes the Thrift-based Hive service (TCP or HTTP) and a <a href=http://www.eclipse.org/jetty/>Jetty</a> web server for web UI. </p>
diff --git a/docs/latest/home_27362069/index.html b/docs/latest/home_27362069/index.html
index 34f1c33..5d09a0f 100644
--- a/docs/latest/home_27362069/index.html
+++ b/docs/latest/home_27362069/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--home>Apache Hive : Home</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--home>Apache Hive : Home</a></li>
<li><a href=#apache-hive>Apache Hive</a></li>
<li><a href=#hive-documentation>Hive Documentation</a>
<ul>
@@ -134,6 +137,8 @@ ASF
</li>
<li><a href=#hive-versions-and-branches>Hive Versions and Branches</a></li>
</ul>
+</nav>
+</aside>
<h1 id=apache-hive>Apache Hive</h1>
<p>The <strong><a href=http://hive.apache.org>Apache Hive™</a></strong> data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage and queried using SQL syntax.</p>
<p>Built on top of <strong><a href=http://hadoop.apache.org>Apache Hadoop™</a></strong>, Hive provides the following features:</p>
diff --git a/docs/latest/howtocommit_27362108/index.html b/docs/latest/howtocommit_27362108/index.html
index dbb3ed2..1a5c9de 100644
--- a/docs/latest/howtocommit_27362108/index.html
+++ b/docs/latest/howtocommit_27362108/index.html
@@ -120,10 +120,12 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--howtocommit>Apache Hive : HowToCommit</h1>
-<h1 id=guide-for-hive-committers>Guide for Hive Committers</h1>
+<h1 id=apache-hive--guide-for-committers>Apache Hive : Guide for Committers</h1>
+<p>This page contains guidelines for committers of the Apache Hive project. (If you’re currently a contributor, and are interested in how we add new committers, read <a href=https://hive.apache.org/community/becomingcommitter/>BecomingACommitter</a>)</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#guide-for-hive-committers>Guide for Hive Committers</a>
+<li><a href=#apache-hive--guide-for-committers>Apache Hive : Guide for Committers</a>
<ul>
<li><a href=#new-committers>New committers</a></li>
<li><a href=#review>Review</a></li>
@@ -131,7 +133,7 @@ ASF
<li><a href=#precommit-runs-and-committing-patches>PreCommit runs, and committing patches</a></li>
<li><a href=#commit>Commit</a>
<ul>
-<li><a href=#committing-documentation>Committing Documentation</a></li>
+<li></li>
</ul>
</li>
<li><a href=#backporting-commits-to-previous-branches>Backporting commits to previous branches</a></li>
@@ -139,7 +141,8 @@ ASF
</ul>
</li>
</ul>
-<p>This page contains guidelines for committers of the Apache Hive project. (If you’re currently a contributor, and are interested in how we add new committers, read <a href=https://hive.apache.org/community/becomingcommitter/>BecomingACommitter</a>)</p>
+</nav>
+</aside>
<h2 id=new-committers>New committers</h2>
<p>New committers are encouraged to first read Apache’s generic committer documentation:</p>
<ul>
diff --git a/docs/latest/howtocontribute_27362107/index.html b/docs/latest/howtocontribute_27362107/index.html
index 6709d20..36c0720 100644
--- a/docs/latest/howtocontribute_27362107/index.html
+++ b/docs/latest/howtocontribute_27362107/index.html
@@ -120,12 +120,13 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--howtocontribute>Apache Hive : HowToContribute</h1>
-<h1 id=how-to-contribute-to-apache-hive>How to Contribute to Apache Hive</h1>
+<h1 id=apache-hive--how-to-contribute>Apache Hive : How to Contribute</h1>
<p>This page describes the mechanics of <em>how</em> to contribute software to Apache Hive. For ideas about <em>what</em> you might contribute, please see open tickets in <a href=https://issues.apache.org/jira/browse/HIVE>Jira</a>.</p>
<aside class=table-of-contents>
<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--how-to-contribute>Apache Hive : How to Contribute</a>
+<ul>
<li><a href=#getting-the-source-code>Getting the Source Code</a></li>
<li><a href=#becoming-a-contributor>Becoming a Contributor</a></li>
<li><a href=#making-changes>Making Changes</a>
@@ -149,6 +150,8 @@ ASF
<li><a href=#generating-thrift-code>Generating Thrift Code</a></li>
<li><a href=#see-also>See Also</a></li>
</ul>
+</li>
+</ul>
</nav>
</aside>
<h2 id=getting-the-source-code>Getting the Source Code</h2>
diff --git a/docs/latest/howtorelease_27362106/index.html b/docs/latest/howtorelease_27362106/index.html
index d881c9a..ba45a39 100644
--- a/docs/latest/howtorelease_27362106/index.html
+++ b/docs/latest/howtorelease_27362106/index.html
@@ -121,9 +121,12 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--howtorelease>Apache Hive : HowToRelease</h1>
-<p><em>This page is prepared for Hive committers. You need committer rights to create a new Hive release.</em></p>
-<h2 id=heading></h2>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--howtorelease>Apache Hive : HowToRelease</a>
+<ul>
+<li><a href=#introduction>Introduction</a></li>
<li><a href=#storage-api-release>Storage API Release</a>
<ul>
<li><a href=#storage-api-prepare-master-branch>Storage API Prepare Master Branch</a></li>
@@ -149,7 +152,12 @@ ASF
</li>
<li><a href=#see-also>See Also</a></li>
</ul>
-<p>Hadoop Version Warning</p>
+</li>
+</ul>
+</nav>
+</aside>
+<h2 id=introduction>Introduction</h2>
+<p>This page is prepared for Hive committers. You need committer rights to create a new Hive release.</p>
<p>This page assumes you are releasing from the master branch, and thus omits the use of Maven profiles to determine which version of Hadoop you are building against. If you are releasing from branch-1, you will need to add <code>-Phadoop-2</code> to most of your Maven commands.</p>
<h2 id=storage-api-release>Storage API Release</h2>
<p>The Hive projects has two products that are released separately:</p>
@@ -252,11 +260,9 @@ sftp> quit
% git tag -s rel/storage-release-X.Y.Z -m "Hive Storage API X.Y.Z"
% git push origin rel/storage-release-X.Y.Z
</code></pre><ol start=4>
-<li>Add the artifacts to Hive’s dist area. There might be a problem with the size of the artifact.</li>
+<li>Add the artifacts to Hive’s dist area. There might be a problem with the size of the artifact.
+<a href=https://issues.apache.org/jira/browse/INFRA-23055>INFRA-23055</a> solved the issue.</li>
</ol>
-<h2 id=infra-23055httpsissuesapacheorgjirabrowseinfra-23055srcconfmacro><a href="https://issues.apache.org/jira/browse/INFRA-23055?src=confmacro">INFRA-23055</a></h2>
-<p><a href="https://cwiki.apache.org/confluence/plugins/servlet/applinks/oauth/login-dance/authorize?applicationLinkID=5aa69414-a9e9-3523-82ec-879b028fb15b">Authenticate</a> to see issue details</p>
-<p>solved the issue.</p>
<pre tabindex=0><code>% svn checkout https://dist.apache.org/repos/dist/release/hive hive-dist
% cd hive-dist
% mkdir hive-storage-X.Y.Z
@@ -469,9 +475,7 @@ git push origin rel/release-X.Y.Z
git tag -d release-X.Y.Z-rcR
git push origin :release-X.Y.Z-rcR
</code></pre><p>If errors happen while “git tag -s”, try to configure the git signing key by “git config user.signingkey your_gpg_key_id” then rerun the command.
-2. Move the release artifacts to the release area of the project (<a href=https://dist.apache.org/repos/dist/release/hive/>https://dist.apache.org/repos/dist/release/hive/</a>). Using svn mv command is important otherwise you may hit size limitations applying to artifacts(</p>
-<h2 id=infra-23055httpsissuesapacheorgjirabrowseinfra-23055srcconfmacro-1><a href="https://issues.apache.org/jira/browse/INFRA-23055?src=confmacro">INFRA-23055</a></h2>
-<p><a href="https://cwiki.apache.org/confluence/plugins/servlet/applinks/oauth/login-dance/authorize?applicationLinkID=5aa69414-a9e9-3523-82ec-879b028fb15b">Authenticate</a> to see issue details</p>
+2. Move the release artifacts to the release area of the project (<a href=https://dist.apache.org/repos/dist/release/hive/>https://dist.apache.org/repos/dist/release/hive/</a>). Using svn mv command is important otherwise you may hit size limitations applying to artifacts(<a href=https://issues.apache.org/jira/browse/INFRA-23055>INFRA-23055</a>)</p>
<pre tabindex=0><code>svn mv https://dist.apache.org/repos/dist/dev/hive/hive-X.Y.Z https://dist.apache.org/repos/dist/release/hive/hive-X.Y.Z -m "Move hive-X.Y.Z release from dev to release"
</code></pre><ol start=3>
<li>Wait till the release propagates to the mirrors and appears under: <a href=https://dlcdn.apache.org/hive/>https://dlcdn.apache.org/hive/</a></li>
diff --git a/docs/latest/index.xml b/docs/latest/index.xml
index 677a2b7..0bb7a28 100644
--- a/docs/latest/index.xml
+++ b/docs/latest/index.xml
@@ -1,21 +1,15 @@
<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Space Details: on Hive Site</title><link>https://hive.apache.org/docs/latest/</link><description>Recent content in Space Details: on Hive Site</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><lastBuildDate>Thu, 12 Dec 2024 00:00:00 +0000</lastBuildDate><atom:link href="https://hive.apache.org/docs/latest/index.xml" rel="self" ty [...]
-Make Apache Hive’s data model and metadata services accessible to users of the Apache Pig dataflow programming language as well as other Hadoop language runtimes. Make it possible for Hive users and users of other Hadoop language runtimes to share data stored in Hive’s HDFS data warehouse.</description></item><item><title>Apache Hive : AccumuloIntegration</title><link>https://hive.apache.org/docs/latest/accumulointegration_46633569/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate [...]
-Version Note Introduction Changes From Hive 2 to Hive 3 General Configuration RDBMS Option 1: Embedding Derby Option 2: External RDBMS Supported RDBMSs Installing and Upgrading the Metastore Schema Running the Metastore Embedded Mode Metastore Server High Availability Securing the Service Running the Metastore Without Hive Performance Optimizations CachedStore Less Commonly Changed Configuration Parameters Version Note This document applies only to the Metastore in Hive 3.</description>< [...]
+Make Apache Hive’s data model and metadata services accessible to users of the Apache Pig dataflow programming language as well as other Hadoop language runtimes. Make it possible for Hive users and users of other Hadoop language runtimes to share data stored in Hive’s HDFS data warehouse.</description></item><item><title>Apache Hive : AccumuloIntegration</title><link>https://hive.apache.org/docs/latest/accumulointegration_46633569/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate [...]
+Apache Hive : AdminManual Metastore Administration Introduction Local/Embedded Metastore Database (Derby) Remote Metastore Database Local/Embedded Metastore Server Remote Metastore Server Supported Backend Databases for Metastore Metastore Schema Consistency and Upgrades Introduction All the metadata for Hive tables and partitions are accessed through the Hive Metastore.</description></item><item><title>Apache Hive : AdminManual SettingUpHiveServer</title><link>https://hive.apache.org/do [...]
This information is versioned by Hive release version, allowing a user to quickly identify features available to them.
-The formal name of the current SQL standard is ISO/IEC 9075 &ldquo;Database Language SQL&rdquo;.</description></item><item><title>Apache Hive : AuthDev</title><link>https://hive.apache.org/docs/latest/authdev_27362078/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/authdev_27362078/</guid><description>Apache Hive : AuthDev Index
-1. Privilege 1.1 Access Privilege 2. Hive Operations 3. Metadata 3.1 user, group, and roles 3.1.1 Role management 3.1.2 role metadata 3.1.3 hive role user membership table 3.2 Privileges to be supported by Hive 3.2.1 metadata 4. grant/revoke access privilege 4.1 Privilege names/types: 4.2 show grant 4.3 grant/revoke statement 5.</description></item><item><title>Apache Hive : AvroSerDe</title><link>https://hive.apache.org/docs/latest/avroserde_27850707/</link><pubDate>Thu, 12 Dec 2024 00: [...]
-Overview – Working with Avro from Hive
-Requirements
-Avro to Hive type conversion
-Creating Avro-backed Hive tables
-All Hive versions Hive 0.14 and later versions Writing tables to Avro files
-- [Example](#example)+ [All Hive versions](#all-hive-versions) Hive 0.14 and later Avro file extension Specifying the Avro schema for a table</description></item><item><title>Apache Hive : Binary DataType Proposal</title><link>https://hive.apache.org/docs/latest/binary-datatype-proposal_27826614/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/binary-datatype-proposal_27826614/</guid><description>Apache Hive : Binary DataType Proposal Bin [...]
-Patterns are case-insensitive, except AM/PM and T/Z. See these sections for more details. For string to datetime conversion, no duplicate format tokens are allowed, including tokens</description></item><item><title>Apache Hive : ChangeLog</title><link>https://hive.apache.org/docs/latest/changelog_283118275/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/changelog_283118275/</guid><description>Apache Hive : ChangeLog Release 4.0.0 - 2024- [...]
-HiveQL changes Metastore Schema Metastore Thrift API** Introduction This document describes changes to a) HiveQL, b) metastore schema, and c) metastore Thrift API to support column level statistics in Hive. Please note that the document doesn’t describe the changes needed to persist histograms in the metastore yet.
-Version information
-Column statistics are introduced in Hive 0.10.0 by HIVE-1362. This is the design document.</description></item><item><title>Apache Hive : Common Table Expression</title><link>https://hive.apache.org/docs/latest/common-table-expression_38572242/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/common-table-expression_38572242/</guid><description>Apache Hive : Common Table Expression A Common Table Expression (CTE) is a temporary result set [...]
+The formal name of the current SQL standard is ISO/IEC 9075 &ldquo;Database Language SQL&rdquo;.</description></item><item><title>Apache Hive : AuthDev</title><link>https://hive.apache.org/docs/latest/authdev_27362078/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/authdev_27362078/</guid><description>Apache Hive : AuthDev This is the design document for the original Hive authorization mode. See Authorization for an overview of a [...]
+Apache Hive : AuthDev 1. Privilege 1.1 Access Privilege 2. Hive Operations 3. Metadata 3.1 user, group, and roles 3.1.1 Role management 3.1.2 role metadata 3.1.3 hive role user membership table 3.</description></item><item><title>Apache Hive : AvroSerDe</title><link>https://hive.apache.org/docs/latest/avroserde_27850707/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/avroserde_27850707/</guid><description>Apache Hive : AvroSerDe Apache H [...]
+The AvroSerde is available in Hive 0.9.1 and greater.</description></item><item><title>Apache Hive : Binary DataType Proposal</title><link>https://hive.apache.org/docs/latest/binary-datatype-proposal_27826614/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/binary-datatype-proposal_27826614/</guid><description>Apache Hive : Binary DataType Proposal Binary Type in Hive Motivation: Hive is designed to work with big data. Often in such cases [...]
+Patterns are case-insensitive, except AM/PM and T/Z. See these sections for more details. For string to datetime conversion, no duplicate format tokens are allowed, including tokens</description></item><item><title>Apache Hive : ChangeLog</title><link>https://hive.apache.org/docs/latest/changelog_283118275/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/changelog_283118275/</guid><description>Apache Hive : ChangeLog Release 4.0.0 - 2024- [...]
Version</description></item><item><title>Apache Hive : Compaction pooling</title><link>https://hive.apache.org/docs/latest/compaction-pooling_240884493/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/compaction-pooling_240884493/</guid><description>Apache Hive : Compaction pooling Concept: Compaction requests and workers can be assigned to pools. A worker assigned to a specific pool will only process compaction requests in that pool. Wor [...]
-You can import text files compressed with Gzip or Bzip2 directly into a table stored as TextFile. The compression will be detected automatically and the file will be decompressed on-the-fly during query execution. For example:</description></item><item><title>Apache Hive : Configuration Properties</title><link>https://hive.apache.org/docs/latest/configuration-properties_27842758/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/configurati [...]
+You can import text files compressed with Gzip or Bzip2 directly into a table stored as TextFile. The compression will be detected automatically and the file will be decompressed on-the-fly during query execution. For example:</description></item><item><title>Apache Hive : Configuration Properties</title><link>https://hive.apache.org/docs/latest/configuration-properties_27842758/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/configurati [...]
+The canonical list of configuration properties is managed in the HiveConf Java class, so refer to the HiveConf.java file for a complete list of configuration properties available in your Hive release.
+For information about how to use these configuration properties, see Configuring Hive. That document also describes administrative configuration properties for setting up Hive in the Configuration Variables section.</description></item><item><title>Apache Hive : ContributorDay2011</title><link>https://hive.apache.org/docs/latest/contributorday2011_27820725/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/contributorday2011_27820725/</guid [...]
Resources for mini-hackathon:
PluginDeveloperKit has info on the new pdk; download this snapshot build of Hive which includes it you&rsquo;ll need a Mac or Linux development environment with Hive+Hadoop already installed on it per these instructions; for Hive, use the snapshot you&rsquo;ll also need Apache ant installed. HIVE-1545 has the UDF libraries we&rsquo;d like to get cleaned up for inclusion in Hive or extension libraries (download core.</description></item><item><title>Apache Hive : ContributorMi [...]
Attendees: http://www.meetup.com/Hive-Contributors-Group/events/30620561/
@@ -30,24 +24,24 @@ Carl asked for more details about the impact of HIVE-2795 on the upgrade process
Location: Cloudera (Palo Alto)
Attendees: http://www.meetup.com/Hive-Contributors-Group/events/26345541/
Carl proposed end of August as target for 0.8 release, with branch cut in a couple of weeks. Work is still underway for publishing release artifacts in Maven for 0.7.1 and 0.8 (development snapshots are already being published).
-Ashutosh gave an update on HCatalog development status; no blocking issues from Hive for the 0.2 release; some ideas are being discussed for the 0.</description></item><item><title>Apache Hive : Copy of Hive Schema Tool - [TODO: move it under a 4.0 admin manual page, find a proper name]</title><link>https://hive.apache.org/docs/latest/284790216/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/284790216/</guid><description>Apache Hive : Co [...]
-Metastore Schema Verification Hive records the schema version in the metastore database and verifies that the metastore schema version is compatible with Hive binaries that are going to access the metastore.</description></item><item><title>Apache Hive : Correlation Optimizer</title><link>https://hive.apache.org/docs/latest/correlation-optimizer_34019487/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/correlation-optimizer_34019487/</gui [...]
-set hive.optimize.correlation=true; 1. Overview In Hadoop environments, an SQL query submitted to Hive will be evaluated in distributed systems. Thus, after generating a query operator tree representing the submitted SQL query, Hive needs to determine what operations can be executed in a task which will be evalauted in a single node.</description></item><item><title>Apache Hive : Cost-based optimization in Hive</title><link>https://hive.apache.org/docs/latest/cost-based-optimization-in-h [...]
+Ashutosh gave an update on HCatalog development status; no blocking issues from Hive for the 0.2 release; some ideas are being discussed for the 0.</description></item><item><title>Apache Hive : Copy of Hive Schema Tool - [TODO: move it under a 4.0 admin manual page, find a proper name]</title><link>https://hive.apache.org/docs/latest/284790216/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/284790216/</guid><description>Apache Hive : Co [...]
+set hive.optimize.correlation=true; 1. Overview In Hadoop environments, an SQL query submitted to Hive will be evaluated in distributed systems. Thus, after generating a query operator tree representing the submitted SQL query, Hive needs to determine what operations can be executed in a task which will be evalauted in a single node.</description></item><item><title>Apache Hive : Cost-based optimization in Hive</title><link>https://hive.apache.org/docs/latest/cost-based-optimization-in-h [...]
The CSVSerde is available in Hive 0.14 and greater.
Background The CSV SerDe is based on https://github.com/ogrodnek/csv-serde, and was added to the Hive distribution in HIVE-7777.
Limitation
-This SerDe treats all columns to be of type String. Even if you create a table with non-string column types using this SerDe, the DESCRIBE TABLE output would show string column type.</description></item><item><title>Apache Hive : Data Connector for Hive and Hive-like engines</title><link>https://hive.apache.org/docs/latest/data-connector-for-hive-and-hive-like-engines_288885794/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/data-connect [...]
-This enables various kind of sketch operations thru regular sql statement.</description></item><item><title>Apache Hive : Default Constraint (HIVE-18726)</title><link>https://hive.apache.org/docs/latest/75969407/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/75969407/</guid><description>Apache Hive : Default Constraint (HIVE-18726) Introduction This document proposes the addition of DEFAULT clause to Hive. DEFAULT clause is a domain con [...]
+This SerDe treats all columns to be of type String. Even if you create a table with non-string column types using this SerDe, the DESCRIBE TABLE output would show string column type.</description></item><item><title>Apache Hive : Data Connector for Hive and Hive-like engines</title><link>https://hive.apache.org/docs/latest/data-connector-for-hive-and-hive-like-engines_288885794/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/data-connect [...]
+This enables various kind of sketch operations thru regular sql statement.
+Apache Hive : Datasketches Integration Sketch functions Naming convention sketchType functionName List declared sketch functions Integration with materialized views BI mode Rewrite COUNT(DISTINCT(X)) Rewrite percentile_disc(p) withing group(order by x) Rewrite cume_dist() over (order by id) Rewrite NTILE Rewrite RANK Examples Simple distinct counting examples using HLL Use HLL to compute distinct values using an intermediate table Use HLL to compute distinct values without intermediate t [...]
Background With the addition of DEFAULT constraint (HIVE-18726) user can define columns to have default value which will be used in case user doesn’t explicitly specify it while INSERTING data. For DEFAULT constraint to kick in user has to explicitly specify column schema leaving out the column name for which user would like the sytem to use DEFAULT value.</description></item><item><title>Apache Hive : Dependent Tables</title><link>https://hive.apache.org/docs/latest/dependent-tables_301 [...]
create table T (key string, value string) partitioned by (ds string, hr string);
insert overwrite table T partition (ds=&lsquo;1&rsquo;, hr=&lsquo;1&rsquo;) &hellip;;
..
insert overwrite table T partition (ds=&lsquo;1&rsquo;, hr=&lsquo;24&rsquo;) &hellip;;
T is a partitioned table by date and hour, and Tsignal is an external table which conceptually denotes the creation of the signal table.</description></item><item><title>Apache Hive : Design</title><link>https://hive.apache.org/docs/latest/design_27362072/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/design_27362072/</guid><description>Apache Hive : Design This page contains details about the Hive design and architecture. A brief techn [...]
-Hive Architecture Hive Data Model Metastore Motivation Metadata Objects Metastore Architecture Metastore Interface Hive Query Language Compiler Optimizer Hive APIs Figure 1
-Hive Architecture Figure 1 shows the major components of Hive and its interactions with Hadoop. As shown in that figure, the main components of Hive are:</description></item><item><title>Apache Hive : DesignDocs</title><link>https://hive.apache.org/docs/latest/designdocs_27362075/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/designdocs_27362075/</guid><description>Apache Hive : DesignDocs Hive Design Documents Proposals that appear in [...]
+Apache Hive : Design Hive Architecture Hive Data Model Metastore Motivation Metadata Objects Metastore Architecture Metastore Interface Hive Query Language Compiler Optimizer Hive APIs Attachments: Hive Architecture Figure 1
+Figure 1 shows the major components of Hive and its interactions with Hadoop.</description></item><item><title>Apache Hive : DesignDocs</title><link>https://hive.apache.org/docs/latest/designdocs_27362075/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/designdocs_27362075/</guid><description>Apache Hive : DesignDocs Hive Design Documents Proposals that appear in the &ldquo;Completed&rdquo; and &ldquo;In Progress&rdquo; se [...]
Completed Views (HIVE-1143) Partitioned Views (HIVE-1941) Storage Handlers (HIVE-705) HBase Integration HBase Bulk Load Locking (HIVE-1293) Indexes (HIVE-417) Bitmap Indexes (HIVE-1803) Filter Pushdown (HIVE-279) Table-level Statistics (HIVE-1361) Dynamic Partitions Binary Data Type (HIVE-2380) Decimal Precision and Scale Support HCatalog (formerly Howl) HiveServer2 (HIVE-2935) Column Statistics in Hive (HIVE-1362) List Bucketing (HIVE-3026) Group By With Rollup (HIVE-2397) Enhanced Aggr [...]
-Hive Developer Guide Code organization and architecture Compiling and running Hive Unit tests Debugging Hive code Pluggable interfaces Hive Developer FAQ Moving files Building Hive Testing Hive Plugin Developer Kit Writing UDTFs Hive on Spark: Getting Started</description></item><item><title>Apache Hive : DeveloperGuide</title><link>https://hive.apache.org/docs/latest/developerguide_27362074/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/lates [...]
+Hive Developer Guide Code organization and architecture Compiling and running Hive Unit tests Debugging Hive code Pluggable interfaces Hive Developer FAQ Moving files Building Hive Testing Hive Plugin Developer Kit Writing UDTFs Hive on Spark: Getting Started</description></item><item><title>Apache Hive : DeveloperGuide</title><link>https://hive.apache.org/docs/latest/developerguide_27362074/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/lates [...]
Meeting Minutes April 18, 2012 December 5, 2011 September 7, 2011 July 26, 2011 June 30, 2011 April 25, 2011 January 11, 2011 (forgot to take notes) October 25, 2010 September 13, 2010 August 8, 2010 July 6, 2010 June 1, 2010</description></item><item><title>Apache Hive : Development ContributorsMeetings HiveContributorsMinutes100601</title><link>https://hive.apache.org/docs/latest/development-contributorsmeetings-hivecontributorsminutes100601_27362084/</link><pubDate>Thu, 12 Dec 2024 00 [...]
The following people were present:
Facebook (Paul Yang; Ning Zhang; Yongqiang He; Ahmed Aly; John Sichi; Ashish Thusoo; Namit Jain) Netflix (Eva Tse; Jerome Boulon) Cloudera (Arvind Prabhakar; Vinithra Varadharajan; Carl Steinbach) Yahoo (Alan Gates) The following were the main meeting minutes:
@@ -64,27 +58,20 @@ website (now at hive.apache.org) svn (new trunk location is http://svn.apache.or
Location: Facebook Palo Alto
Attendees: http://www.meetup.com/Hive-Contributors-Group/events/17272914/
The 0.7 release is out, and Carl proposed an 0.7.1 release for items such as PostgreSQL metastore upgrade scripts and Maven artifact publication. Rules for a point release were discussed: no metastore changes, and no changes to API&rsquo;s such as Thrift and extension interfaces. Everyone was fine with this; Carl will manage the release.</description></item><item><title>Apache Hive : Different TIMESTAMP types</title><link>https://hive.apache.org/docs/latest/different-timestamp-types_ [...]
-TIMESTAMP and TIMESTAMP WITHOUT TIME ZONE The TIMESTAMP and TIMESTAMP WITHOUT TIME ZONE types shall behave like the LocalDateTime class of Java, i.e., each value is a recording of what can be seen on a calendar and a clock hanging on the wall, for example &ldquo;1969-07-20 16:17:39&rdquo;.</description></item><item><title>Apache Hive : Druid Integration</title><link>https://hive.apache.org/docs/latest/druid-integration_65866491/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pub [...]
+TIMESTAMP and TIMESTAMP WITHOUT TIME ZONE The TIMESTAMP and TIMESTAMP WITHOUT TIME ZONE types shall behave like the LocalDateTime class of Java, i.e., each value is a recording of what can be seen on a calendar and a clock hanging on the wall, for example &ldquo;1969-07-20 16:17:39&rdquo;.</description></item><item><title>Apache Hive : Druid Integration</title><link>https://hive.apache.org/docs/latest/druid-integration_65866491/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pub [...]
+Apache Hive : Druid Integration Objectives Preliminaries Druid Storage Handlers Usage Discovery and management of Druid datasources from Hive Create tables linked to existing Druid datasources Create Druid datasources from Hive Druid kafka ingestion from Hive INSERT, INSERT OVERWRITE and DROP statements Queries completely executed in Druid Queries across Druid and Hive Open Issues (JIRA) Objectives Our main goal is to be able to index data from Hive into Druid, and to be able to query Dr [...]
Tutorial: Dynamic-Partition Insert Hive DML: Dynamic Partition Inserts HCatalog Dynamic Partitioning Usage with Pig Usage from MapReduce References:
-Original design doc HIVE-936 Terminology Static Partition (SP) columns: in DML/DDL involving multiple partitioning columns, the columns whose values are known at COMPILE TIME (given by user).</description></item><item><title>Apache Hive : Enabling gRPC in Hive/Hive Metastore (Proposal)</title><link>https://hive.apache.org/docs/latest/158869886/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/158869886/</guid><description>Apache Hive : Ena [...]
-Last upated: 7/31/2020
-Objective Background Design Overview Implementation Pluggable gRPC Support Hive Metastore Server Class Change Config Changes Hive Metastore Client Class Change Configuration Changes Summary Future Work Objective To modernize Hive Metastore’s interface with a state-of-the-art serving layer based on gRPC while also keeping it backwards compatible with Thrift for minimal upgrade toil; To achieve this the proposed design is to add support for a proxy-layer between the Thrift interface and a [...]
-GROUPING SETS clause Grouping__ID function Grouping function Cubes and Rollups hive.new.job.grouping.set.cardinality Grouping__ID function (before Hive 2.3.0) Version
-Grouping sets, CUBE and ROLLUP operators, and the GROUPING__ID function were added in Hive 0.10.0.
-See HIVE-2397, HIVE-3433, HIVE-3471, and HIVE-3613.
-Also see HIVE-3552 for an improvement added in Hive 0.</description></item><item><title>Apache Hive : Exchange Partition</title><link>https://hive.apache.org/docs/latest/exchange-partition_30755801/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/exchange-partition_30755801/</guid><description>Apache Hive : Exchange Partition The EXCHANGE PARTITION command will move a partition from a source table to target table and alter each table& [...]
+Original design doc HIVE-936 Terminology Static Partition (SP) columns: in DML/DDL involving multiple partitioning columns, the columns whose values are known at COMPILE TIME (given by user).</description></item><item><title>Apache Hive : Enabling gRPC in Hive/Hive Metastore (Proposal)</title><link>https://hive.apache.org/docs/latest/158869886/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/158869886/</guid><description>Apache Hive : Ena [...]
+Apache Hive : Enhanced Aggregation, Cube, Grouping and Rollup GROUPING SETS clause Grouping__ID function Grouping function Cubes and Rollups hive.new.job.grouping.set.cardinality Grouping__ID function (before Hive 2.3.0) Comments: Version
+Grouping sets, CUBE and ROLLUP operators, and the GROUPING__ID function were added in Hive 0.</description></item><item><title>Apache Hive : Exchange Partition</title><link>https://hive.apache.org/docs/latest/exchange-partition_30755801/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/exchange-partition_30755801/</guid><description>Apache Hive : Exchange Partition The EXCHANGE PARTITION command will move a partition from a source table to [...]
When the command is executed, the source table&rsquo;s partition folder in HDFS will be renamed to move it to the destination table&rsquo;s partition folder.</description></item><item><title>Apache Hive : FileFormats</title><link>https://hive.apache.org/docs/latest/fileformats_47384180/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/fileformats_47384180/</guid><description>Apache Hive : FileFormats File Formats and Compression Fi [...]
Text File SequenceFile RCFile Avro Files ORC Files Parquet Custom INPUTFORMAT and OUTPUTFORMAT The hive.default.fileformat configuration parameter determines the format to use if it is not specified in a CREATE TABLE or ALTER TABLE statement. Text file is the parameter&rsquo;s default value.
-For more information, see the sections Storage Formats and Row Formats &amp; SerDe on the DDL page.</description></item><item><title>Apache Hive : FilterPushdownDev</title><link>https://hive.apache.org/docs/latest/filterpushdowndev_27362092/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/filterpushdowndev_27362092/</guid><description>Apache Hive : FilterPushdownDev Filter Pushdown Filter Pushdown Introduction Use Cases Components Inv [...]
-Installation and Configuration
-- [Running HiveServer2 and Beeline](#running-hiveserver2-and-beeline)+ [Requirements](#requirements) Installing Hive from a Stable Release Building Hive from Source Compile Hive on master Compile Hive on branch-1 Compile Hive Prior to 0.13 on Hadoop 0.20 Compile Hive Prior to 0.13 on Hadoop 0.23 Running Hive Running Hive CLI Running HiveServer2 and Beeline Running HCatalog Running WebHCat (Templeton) Configuration Management Overview Runtime Configuration Hive, Map-Reduce and Local-Mode [...]
+For more information, see the sections Storage Formats and Row Formats &amp; SerDe on the DDL page.</description></item><item><title>Apache Hive : FilterPushdownDev</title><link>https://hive.apache.org/docs/latest/filterpushdowndev_27362092/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/filterpushdowndev_27362092/</guid><description>Apache Hive : Filter Pushdown This document explains how we are planning to add support in Hive&r [...]
+Apache Hive : Filter Pushdown Use Cases Components Involved Primary Filter Representation Other Filter Representations Filter Passing Filter Collection Filter Decomposition Use Cases Below are the main use cases we are targeting.</description></item><item><title>Apache Hive : GenericUDAFCaseStudy</title><link>https://hive.apache.org/docs/latest/genericudafcasestudy_27362093/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/genericudafcases [...]
The following page only applies to branch-0.12 and earlier. For trunk see HiveDeveloperFAQ
After checking out the source code run the following command from the top-level directory:
$ ant clean package eclipse-files Now open up Eclipse and do the following:
-File-&gt;Import-&gt;General-&gt;Existing Projects Into Workspace-&gt;Select root directory (point to ) Make sure that Eclipse Java Compiler is in 1.</description></item><item><title>Apache Hive : GroupByWithRollup</title><link>https://hive.apache.org/docs/latest/groupbywithrollup_27826238/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/groupbywithrollup_27826238/</guid><description>Apache Hive : GroupByWithRollup Group By [...]
-Original design doc
-HIVE-2397
-Group By With Rollup Terminology Design Map Aggr &amp; No Skew: Map Aggr &amp; Skew No Map Aggr &amp; No Skew &amp; No Rollup No Map Aggr &amp; No Skew &amp; With Rollup No Map Aggr &amp; Skew &amp; (No Distinct or No Rollup) No Map Aggr &amp; Skew &amp; Distinct &amp; Rollup Terminology (No) Map Aggr: Shorthand for whether the configuration variable hive.</description></item><item><title>Apache Hive : Hadoop-compatible Input-Output Format for [...]
+File-&gt;Import-&gt;General-&gt;Existing Projects Into Workspace-&gt;Select root directory (point to ) Make sure that Eclipse Java Compiler is in 1.</description></item><item><title>Apache Hive : GroupByWithRollup</title><link>https://hive.apache.org/docs/latest/groupbywithrollup_27826238/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/groupbywithrollup_27826238/</guid><description>Apache Hive : Group By With Rollup Apach [...]
InputFormat: http://hadoop.apache.org/docs/mapreduce/r0.21.0/api/org/apache/hadoop/mapreduce/InputFormat.html OutputFormat: http://hadoop.apache.org/docs/mapreduce/r0.21.0/api/org/apache/hadoop/mapreduce/OutputFormat.html The classes will be named HiveApiInputFormat and HiveApiOutputFormat.
See HIVE-3752 for discussion of this proposal.
InputFormat (reading from Hive) Usage:
@@ -92,39 +79,35 @@ Create a HiveInputDescription object. Fill it with information about the table t
This is part of metastore on hbase work - HIVE-9452 Use HBase to store Hive metadata Open
Functionality needed
RawStore functions that support partition filtering are the following -
-getPartitionsByExpr getPartitionsByFilter (takes filter string as argument, used from hcatalog) We need to generate a query execution plan in terms of Hbase scan api calls for a given filter condition.</description></item><item><title>Apache Hive : HBaseBulkLoad</title><link>https://hive.apache.org/docs/latest/hbasebulkload_27362088/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hbasebulkload_27362088/</guid><description>Apache Hive : H [...]
-- [Avro Data Stored in HBase Columns](#avro-data-stored-in-hbase-columns)+ [Introduction](#introduction) Storage Handlers Usage Column Mapping Multiple Columns and Families Hive MAP to HBase Column Family Hive MAP to HBase Column Prefix Hiding Column Prefixes Illegal: Hive Primitive to HBase Column Family Example with Binary Columns Simple Composite Row Keys Complex Composite Row Keys and HBaseKeyFactory Avro Data Stored in HBase Columns Put Timestamps Key Uniqueness Overwrite Potential [...]
+getPartitionsByExpr getPartitionsByFilter (takes filter string as argument, used from hcatalog) We need to generate a query execution plan in terms of Hbase scan api calls for a given filter condition.</description></item><item><title>Apache Hive : HBaseBulkLoad</title><link>https://hive.apache.org/docs/latest/hbasebulkload_27362088/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hbasebulkload_27362088/</guid><description>Apache Hive : H [...]
+Apache Hive : HBase Bulk Load Overview Decide on Target HBase Schema Estimate Resources Needed Add necessary JARs Prepare Range Partitioning Prepare Staging Location Sort Data Run HBase Script Map New Table Back Into Hive Followups Needed Overview Ideally, bulk load from Hive into HBase would be part of HBaseIntegration, making it as simple as this:</description></item><item><title>Apache Hive : HBaseIntegration</title><link>https://hive.apache.org/docs/latest/hbaseintegration_27362089/< [...]
+A presentation is available from the HBase HUG10 Meetup
+This feature is a work in progress, and suggestions for its improvement are very welcome.</description></item><item><title>Apache Hive : HBaseMetastoreDevelopmentGuide</title><link>https://hive.apache.org/docs/latest/hbasemetastoredevelopmentguide_55151960/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hbasemetastoredevelopmentguide_55151960/</guid><description>Apache Hive : HBaseMetastoreDevelopmentGuide Guide for contributors to the [...]
This work is discontinued and the code is removed in release 3.0.0 (HIVE-17234).
- Building Setup for running hive against hbase metastore - Importing metadata from rdbms to hbase Design Docs Building You will need to download the source for Tephra and build it from the develop branch. You need Tephra 0.</description></item><item><title>Apache Hive : HCatalog</title><link>https://hive.apache.org/docs/latest/hcatalog_33299065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog_33299065/</guid><description>Apache [...]
-This is the HCatalog manual. Using HCatalog Installation from Tarball HCatalog Configuration Properties Load and Store Interfaces Input and Output Interfaces Reader and Writer Interfaces Command Line Interface Storage Formats Dynamic Partitioning Notification Storage Based Authorization The old HCatalog wiki page has many other documents including additional user documentation, further information on HBase integration, and resources for contributors.</description></item><item><title>Apac [...]
-The following Pig script illustrates this:
-A = load 'raw' using HCatLoader(); .</description></item><item><title>Apache Hive : HCatalog InputOutput</title><link>https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/</guid><description>Apache Hive : HCatalog InputOutput Input and Output Interfaces Input and Output Interfaces Set Up HCatInputFormat API HCatOutputFormat API HCatRecord Running M [...]
-Note: HCatalog is not thread safe.
-HCatInputFormat The HCatInputFormat is used with MapReduce jobs to read data from HCatalog-managed tables.</description></item><item><title>Apache Hive : HCatalog InstallHCat</title><link>https://hive.apache.org/docs/latest/hcatalog-installhcat_34013403/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-installhcat_34013403/</guid><description>Apache Hive : HCatalog InstallHCat Installation from Tarball Installation from Tarball HC [...]
+Apache Hive : HBaseMetastoreDevelopmentGuide Building Setup for running hive against hbase metastore - Importing metadata from rdbms to hbase Design Docs Building You will need to download the source for Tephra and build it from the develop branch.</description></item><item><title>Apache Hive : HCatalog</title><link>https://hive.apache.org/docs/latest/hcatalog_33299065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog_33299065/</g [...]
+This is the HCatalog manual. Using HCatalog Installation from Tarball HCatalog Configuration Properties Load and Store Interfaces Input and Output Interfaces Reader and Writer Interfaces Command Line Interface Storage Formats Dynamic Partitioning Notification Storage Based Authorization The old HCatalog wiki page has many other documents including additional user documentation, further information on HBase integration, and resources for contributors.</description></item><item><title>Apac [...]
+The following Pig script illustrates this:</description></item><item><title>Apache Hive : HCatalog InputOutput</title><link>https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/</guid><description>Apache Hive : HCatalog Input and Output Interfaces Apache Hive : HCatalog Input and Output Interfaces Set Up HCatInputFormat API HCatOutputFormat API HCa [...]
+Note: HCatalog is not thread safe.</description></item><item><title>Apache Hive : HCatalog InstallHCat</title><link>https://hive.apache.org/docs/latest/hcatalog-installhcat_34013403/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-installhcat_34013403/</guid><description>Apache Hive : HCatalog Installation from Tarball Apache Hive : HCatalog Installation from Tarball HCatalog Installed with Hive HCatalog Command Line HCatalog Cli [...]
HCatalog is installed with Hive, starting with Hive release 0.11.0.
Hive installation is documented here.
-HCatalog Command Line If you install Hive from the binary tarball, the hcat command is available in the hcatalog/bin directory.
-The hcat command line is similar to the hive command line; the main difference is that it restricts the queries that can be run to metadata-only operations such as DDL and DML queries used to read metadata (for example, &ldquo;show tables&rdquo;).</description></item><item><title>Apache Hive : HCatalog LoadStore</title><link>https://hive.apache.org/docs/latest/hcatalog-loadstore_34013511/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/l [...]
-The data transfer API has three essential classes:</description></item><item><title>Apache Hive : HCatalog StorageFormats</title><link>https://hive.apache.org/docs/latest/hcatalog-storageformats_34013997/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-storageformats_34013997/</guid><description>Apache Hive : HCatalog StorageFormats Storage Formats Storage Formats SerDes and Storage Formats Usage from Hive CTAS Issue with JSON Se [...]
-Background Structure Data Requirements Streaming Requirements Record Layout Connection and Transaction Management Writing Data Dynamic Partition Creation Reading Data Example Background In certain data processing use cases it is necessary to modify existing data when new facts arrive.</description></item><item><title>Apache Hive : HCatalog Streaming Mutation API (Copy)</title><link>https://hive.apache.org/docs/latest/283118454/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><gui [...]
-Background Structure Data Requirements Streaming Requirements Record Layout Connection and Transaction Management Writing Data Dynamic Partition Creation Reading Data Example Background In certain data processing use cases it is necessary to modify existing data when new facts arrive.</description></item><item><title>Apache Hive : HCatalog UsingHCat</title><link>https://hive.apache.org/docs/latest/hcatalog-usinghcat_34013260/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid> [...]
-HCatalog graduated from the Apache incubator and merged with the Hive project on March 26, 2013.
-Hive version 0.11.0 is the first release that includes HCatalog.</description></item><item><title>Apache Hive : Hive across Multiple Data Centers (Physical Clusters)</title><link>https://hive.apache.org/docs/latest/27837073/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/27837073/</guid><description>Apache Hive : Hive across Multiple Data Centers (Physical Clusters) This project has been abandoned. We&rsquo;re leaving the design doc [...]
-Use Cases Requirements Use Cases Inside facebook, we are running out of power inside a data center (physical cluster), and we have a need to have a bigger cluster.
-We can divide the cluster into multiple clusters - multiple hive instances, multiple mr and multiple dfs.</description></item><item><title>Apache Hive : Hive APIs Overview</title><link>https://hive.apache.org/docs/latest/hive-apis-overview_61326349/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-apis-overview_61326349/</guid><description>Apache Hive : Hive APIs Overview This page aims to catalogue and describe the various public fac [...]
-API categories Operation based APIs Query based APIs Available APIs HCatClient (Java) HCatalog Storage Handlers (Java) HCatalog CLI (Command Line) Metastore (Java) WebHCat (REST) Streaming Data Ingest (Java) Streaming Mutation (Java) hive-jdbc (JDBC) API categories The APIs can be segmented into two conceptual categories: operation based APIs and query based APIs.</description></item><item><title>Apache Hive : Hive Aws EMR</title><link>https://hive.apache.org/docs/latest/hive-aws-emr_278 [...]
+HCatalog Command Line If you install Hive from the binary tarball, the hcat command is available in the hcatalog/bin directory.</description></item><item><title>Apache Hive : HCatalog LoadStore</title><link>https://hive.apache.org/docs/latest/hcatalog-loadstore_34013511/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-loadstore_34013511/</guid><description>Apache Hive : HCatalog Load and Store Interfaces Apache Hive : HCatalog Lo [...]
+Apache Hive : HCatalog Streaming Mutation API Background Structure Data Requirements Streaming Requirements Record Layout Connection and Transaction Management Writing Data Dynamic Partition Creation Reading Data Example Attachments: Background In certain data processing use cases it is necessary to modify existing data when new facts arrive.</description></item><item><title>Apache Hive : HCatalog Streaming Mutation API (Copy)</title><link>https://hive.apache.org/docs/latest/283118454/</ [...]
+Apache Hive : HCatalog Streaming Mutation API (Copy) Background Structure Data Requirements Streaming Requirements Record Layout Connection and Transaction Management Writing Data Dynamic Partition Creation Reading Data Example Attachments: Background In certain data processing use cases it is necessary to modify existing data when new facts arrive.</description></item><item><title>Apache Hive : HCatalog UsingHCat</title><link>https://hive.apache.org/docs/latest/hcatalog-usinghcat_340132 [...]
+Apache Hive : Hive across Multiple Data Centers (Physical Clusters) Use Cases Requirements Use Cases Inside facebook, we are running out of power inside a data center (physical cluster), and we have a need to have a bigger cluster.</description></item><item><title>Apache Hive : Hive APIs Overview</title><link>https://hive.apache.org/docs/latest/hive-apis-overview_61326349/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-apis-overview [...]
+Apache Hive : Hive APIs Overview API categories Operation based APIs Query based APIs Available APIs HCatClient (Java) HCatalog Storage Handlers (Java) HCatalog CLI (Command Line) Metastore (Java) WebHCat (REST) Streaming Data Ingest (Java) Streaming Mutation (Java) hive-jdbc (JDBC) Comments: API categories The APIs can be segmented into two conceptual categories: operation based APIs and query based APIs.</description></item><item><title>Apache Hive : Hive Aws EMR</title><link>https://h [...]
Here you can find the most important configurations and default values.
-Config Name Default Value Description Config file hive.metastore.client.cache.v2.enabled true This property enabled a Caffaine Cache for Metastore client MetastoreConf More configs are in MetastoreConf.</description></item><item><title>Apache Hive : Hive deprecated authorization mode / Legacy Mode</title><link>https://hive.apache.org/docs/latest/45876173/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/45876173/</guid><description>Apache [...]
+Config Name Default Value Description Config file hive.metastore.client.cache.v2.enabled true This property enabled a Caffaine Cache for Metastore client MetastoreConf More configs are in MetastoreConf.</description></item><item><title>Apache Hive : Hive deprecated authorization mode / Legacy Mode</title><link>https://hive.apache.org/docs/latest/45876173/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/45876173/</guid><description>Apache [...]
+Apache Hive : Hive deprecated authorization mode / Legacy Mode Disclaimer Prerequisites Users, Groups, and Roles Creating/Dropping/Using Roles Privileges Hive Operations and Required Privileges Disclaimer Hive authorization is not completely secure.</description></item><item><title>Apache Hive : Hive HPL/SQL</title><link>https://hive.apache.org/docs/latest/59690156/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/59690156/</guid><descript [...]
HPL/SQL is an open source tool (Apache License 2.0) that implements procedural SQL language for Apache Hive, SparkSQL, Impala as well as any other SQL-on-Hadoop implementation, any NoSQL and any RDBMS.
-HPL/SQL is a hybrid and heterogeneous language that understands syntaxes and semantics of almost any existing procedural SQL dialect, and you can use with any database, for example, running existing Oracle PL/SQL code on Apache Hive and Microsoft SQL Server, or running Transact-SQL on Oracle, Cloudera Impala or Amazon Redshift.</description></item><item><title>Apache Hive : Hive Metadata Caching Proposal</title><link>https://hive.apache.org/docs/latest/hive-metadata-caching-proposal_6940 [...]
-Introduced in Hive 0.10.0. See HIVE-3056 and HIVE-3443.
+HPL/SQL is a hybrid and heterogeneous language that understands syntaxes and semantics of almost any existing procedural SQL dialect, and you can use with any database, for example, running existing Oracle PL/SQL code on Apache Hive and Microsoft SQL Server, or running Transact-SQL on Oracle, Cloudera Impala or Amazon Redshift.</description></item><item><title>Apache Hive : Hive Metadata Caching Proposal</title><link>https://hive.apache.org/docs/latest/hive-metadata-caching-proposal_6940 [...]
The Hive MetaTool enables administrators to do bulk updates on the location fields in database, table, and partition records in the metastore. It provides the following functionality:
-Ability to search and replace the HDFS NN (NameNode) location in metastore records that reference the NN.</description></item><item><title>Apache Hive : Hive Metrics</title><link>https://hive.apache.org/docs/latest/hive-metrics_65872987/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-metrics_65872987/</guid><description>Apache Hive : Hive Metrics The metrics that Hive collects can be viewed in the HiveServer2 Web UI by using the &am [...]
-The metrics dump will display any metric available over JMX encoded in JSON: Alternatively the metrics can be written directly into HDFS, a JSON file on the local file system where the HS2 instance is running or to the console by enabling the corresponding metric reporters. By default only the JMX and the JSON file reporter are enabled.</description></item><item><title>Apache Hive : Hive on Spark</title><link>https://hive.apache.org/docs/latest/hive-on-spark_42567714/</link><pubDate>Thu, [...]
-set hive.execution.engine=spark; Hive on Spark was added in HIVE-7292.</description></item><item><title>Apache Hive : Hive on Spark: Join Design Master</title><link>https://hive.apache.org/docs/latest/50858744/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/50858744/</guid><description>Apache Hive : Hive on Spark: Join Design Master Purpose and Prerequisites MapReduce Summary Figure 1. Join Processors for Hive on MapReduce Tez Comparison [...]
-We believe that this type of functionality will be of increasing importance as Hadoop and Hive workloads migrate to the cloud.</description></item><item><title>Apache Hive : Hive Schema Tool</title><link>https://hive.apache.org/docs/latest/hive-schema-tool_34835119/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-schema-tool_34835119/</guid><description>Apache Hive : Hive Schema Tool Metastore Schema Verification The Hive Schema Tool [...]
+Ability to search and replace the HDFS NN (NameNode) location in metastore records that reference the NN. One use is to transition a Hive deployment to HDFS HA NN (HDFS High Availability NameNode).</description></item><item><title>Apache Hive : Hive Metrics</title><link>https://hive.apache.org/docs/latest/hive-metrics_65872987/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-metrics_65872987/</guid><description>Apache Hive : Hive Met [...]
+The metrics dump will display any metric available over JMX encoded in JSON: Alternatively the metrics can be written directly into HDFS, a JSON file on the local file system where the HS2 instance is running or to the console by enabling the corresponding metric reporters. By default only the JMX and the JSON file reporter are enabled.</description></item><item><title>Apache Hive : Hive on Spark</title><link>https://hive.apache.org/docs/latest/hive-on-spark_42567714/</link><pubDate>Thu, [...]
+set hive.execution.engine=spark; Hive on Spark was added in HIVE-7292.
+Apache Hive : Hive on Spark: Getting Started Version Compatibility Spark Installation Configuring YARN Configuring Hive Configuration property details Configuring Spark Tuning Details Common Issues (Green are resolved, will be removed from this list) Recommended Configuration Design documents Attachments: Comments: Version Compatibility Hive on Spark is only tested with a specific version of Spark, so a given version of Hive is only guaranteed to work with a specific version of Spark.</d [...]
+We believe that this type of functionality will be of increasing importance as Hadoop and Hive workloads migrate to the cloud.</description></item><item><title>Apache Hive : Hive Schema Tool</title><link>https://hive.apache.org/docs/latest/hive-schema-tool_34835119/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-schema-tool_34835119/</guid><description>Apache Hive : Hive Schema Tool Apache Hive : Hive Schema Tool Metastore Schema Ve [...]
Introduced in Hive 0.12.0. See HIVE-3764.
-Hive now records the schema version in the metastore database and verifies that the metastore schema version is compatible with Hive binaries that are going to accesss the metastore. Note that the Hive properties to implicitly create or alter the existing schema are disabled by default.</description></item><item><title>Apache Hive : Hive Transactions</title><link>https://hive.apache.org/docs/latest/hive-transactions_40509723/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid> [...]
+Hive now records the schema version in the metastore database and verifies that the metastore schema version is compatible with Hive binaries that are going to accesss the metastore.</description></item><item><title>Apache Hive : Hive Transactions</title><link>https://hive.apache.org/docs/latest/hive-transactions_40509723/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-transactions_40509723/</guid><description>Apache Hive : ACID Tra [...]
Creating an Iceberg Table
An iceberg table can be created using STORED BY ICEBERG keywords while creating a table.
Creating an Iceberg table using normal create command CREATE TABLE TBL_ICE (ID INT) STORED BY ICEBERG; The above creates an iceberg table named &lsquo;TBL_ICE&rsquo;</description></item><item><title>Apache Hive : Hive-Tez Compatibility</title><link>https://hive.apache.org/docs/latest/hive-tez-compatibility_59689974/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-tez-compatibility_59689974/</guid><description>Apache Hive : Hi [...]
@@ -133,71 +116,66 @@ Background This document explores the different ways of leveraging Hive on Amazo
Hadoop already has a long tradition of being run on EC2 and S3. These are well documented in the links below which are a must read:
Hadoop and S3 Amazon and EC2 The second document also has pointers on how to get started using EC2 and S3.</description></item><item><title>Apache Hive : HiveAws HivingS3nRemotely</title><link>https://hive.apache.org/docs/latest/hiveaws-hivings3nremotely_27362102/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hiveaws-hivings3nremotely_27362102/</guid><description>Apache Hive : HiveAws HivingS3nRemotely = Querying S3 files from your PC ( [...]
Usage Scenario The scenario being covered here goes as follows:
-A user has data stored in S3 - for example Apache log files archived in the cloud, or databases backed up into S3. The user would like to declare tables over the data sets here and issue SQL queries against them These SQL queries should be executed using computed resources provisioned from EC2.</description></item><item><title>Apache Hive : HiveClient</title><link>https://hive.apache.org/docs/latest/hiveclient_27362101/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https: [...]
+A user has data stored in S3 - for example Apache log files archived in the cloud, or databases backed up into S3. The user would like to declare tables over the data sets here and issue SQL queries against them These SQL queries should be executed using computed resources provisioned from EC2.</description></item><item><title>Apache Hive : HiveClient</title><link>https://hive.apache.org/docs/latest/hiveclient_27362101/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https: [...]
+For details about the standalone server see Hive Server or HiveServer2.
+Apache Hive : HiveClient Command Line JDBC JDBC Client Sample Code Running the JDBC Sample Code JDBC Client Setup for a Secure Cluster Python PHP ODBC Thrift Thrift Java Client Thrift C++ Client Thrift Node Clients Thrift Ruby Client Command Line Operates in embedded mode only, that is, it needs to have access to the Hive libraries.</description></item><item><title>Apache Hive : HiveContributorsMinutes100601</title><link>https://hive.apache.org/docs/latest/hivecontributorsminutes100601_2 [...]
The following people were present:
Facebook (Paul Yang; Ning Zhang; Yongqiang He; Ahmed Aly; John Sichi; Ashish Thusoo; Namit Jain) Netflix (Eva Tse; Jerome Boulon) Cloudera (Arvind Prabhakar; Vinithra Varadharajan; Carl Steinbach) Yahoo (Alan Gates) The following were the main meeting minutes:
We should have these meetings more often, say every month. Cloudera will host the next meeting.</description></item><item><title>Apache Hive : HiveContributorsMinutes100706</title><link>https://hive.apache.org/docs/latest/hivecontributorsminutes100706_27362065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hivecontributorsminutes100706_27362065/</guid><description>Apache Hive : HiveContributorsMinutes100706 Attendees: Amr Awadallah, Joh [...]
bc Wong gave a live demo of Cloudera&rsquo;s Hue framework and the Beeswax Hive web interface. Slides from this talk are available here: http://www.slideshare.net/cwsteinbach/cloudera-huebeeswax Hue was recently released as open source. The code is available on Github here: http://github.com/cloudera/hue Olga Natkovich gave a whiteboard talk on HOwl.</description></item><item><title>Apache Hive : HiveCounters</title><link>https://hive.apache.org/docs/latest/hivecounters_67636835/</li [...]
For Tez execution, %context is set to the mapper/reducer name. For other execution engines it is not included in the counter name.
-Counter Name Description RECORDS_IN[_%context] Input records read RECORDS_OUT[_%context] Output records written RECORDS_OUT_INTERMEDIATE[_%context] Records written as intermediate records to ReduceSink (which become input records to other tasks) CREATED_FILES Number of files created DESERIALIZE_ERRORS Deserialization errors encountered while reading data</description></item><item><title>Apache Hive : HiveDerbyServerMode</title><link>https://hive.apache.org/docs/latest/hivederbyservermode [...]
+Counter Name Description RECORDS_IN[_%context] Input records read RECORDS_OUT[_%context] Output records written RECORDS_OUT_INTERMEDIATE[_%context] Records written as intermediate records to ReduceSink (which become input records to other tasks) CREATED_FILES Number of files created DESERIALIZE_ERRORS Deserialization errors encountered while reading data</description></item><item><title>Apache Hive : HiveDerbyServerMode</title><link>https://hive.apache.org/docs/latest/hivederbyservermode [...]
+See Metadata Store and Embedded Metastore for more information.
+Apache Hive : Using Derby in Server Mode Download Derby Set Environment Starting Derby Configure Hive to Use Network Derby Copy Derby Jar Files Start Up Hive The Result Download Derby It is suggested you download the version of Derby that ships with Hive.</description></item><item><title>Apache Hive : HiveDeveloperFAQ</title><link>https://hive.apache.org/docs/latest/hivedeveloperfaq_27823747/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/lates [...]
To see how the JDBC interface can be used, see sample code.
-Integration with Pentaho Download pentaho report designer from the pentaho website. Overwrite report-designer.</description></item><item><title>Apache Hive : HiveODBC</title><link>https://hive.apache.org/docs/latest/hiveodbc_27362099/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hiveodbc_27362099/</guid><description>Apache Hive : HiveODBC Hive ODBC Driver Hive ODBC Driver Introduction Suggested Reading Software Requirements Driver Arch [...]
-package com.example.hive.udf; import org.apache.hadoop.hive.ql.exec.UDF; import org.apache.hadoop.io.Text; public final class Lower extends UDF { public Text evaluate(final Text s) { if (s == null) { return null; } return new Text(s.toString().toLowerCase()); } } (Note that there&rsquo;s already a built-in function for this, it&rsquo;s just an easy example).</description></item><item><title>Apache Hive : HiveQL</title><link>https://hive.apache.org/docs/latest/hiveql_27362097/</li [...]
-Please see the HiveQL Language Manual</description></item><item><title>Apache Hive : HiveReplicationDevelopment</title><link>https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/</guid><description>Apache Hive : HiveReplicationDevelopment Introduction Purposes of Replication Disaster Recovery Load Balancing Replication Taxonomy Transact [...]
-Motivations Concurrency Many users have reported that the current HiveServer implementation has concurrency bugs (for example, see HIVE-80). In fact, it&rsquo;s impossible for HiveServer to support concurrent connections using the current Thrift API, a result of the fact that Thrift doesn&rsquo;t provide server-side access to connection handles. Since the current API does not provide explicit support for sessions or connections, HiveServer has no way of mapping incoming requests [...]
-Built on top of Apache Hadoop™, Hive provides the following features:
-Tools to enable easy access to data via SQL, thus enabling data warehousing tasks such as extract/transform/load (ETL), reporting, and data analysis.</description></item><item><title>Apache Hive : Howl</title><link>https://hive.apache.org/docs/latest/howl_27362109/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howl_27362109/</guid><description>Apache Hive : Howl This page collects some pointers to resources about Howl (an effort to crea [...]
-Howl wiki Yahoo group for Howl developers (including mailing list archive) Howl source code at github Howl CLI functional spec Original plans for Owl (predecessor to Howl)</description></item><item><title>Apache Hive : HowToCommit</title><link>https://hive.apache.org/docs/latest/howtocommit_27362108/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howtocommit_27362108/</guid><description>Apache Hive : HowToCommit Guide for Hive Committers [...]
-New committers New committers are encouraged to first read Apache&rsquo;s generic committer documentation:</description></item><item><title>Apache Hive : HowToContribute</title><link>https://hive.apache.org/docs/latest/howtocontribute_27362107/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howtocontribute_27362107/</guid><description>Apache Hive : HowToContribute How to Contribute to Apache Hive This page describes the mechanics of [...]
-Getting the Source Code Becoming a Contributor Making Changes Coding Conventions Understanding Maven Understanding Hive Branches Hadoop Dependencies Unit Tests Add a Unit Test Submitting a PR Fetching a PR from Github Contributing Your Work JIRA Guidelines Generating Thrift Code See Also Getting the Source Code First of all, you need the Hive source code.</description></item><item><title>Apache Hive : HowToRelease</title><link>https://hive.apache.org/docs/latest/howtorelease_27362106/</l [...]
-Storage API Release Storage API Prepare Master Branch Storage API Branching Making Storage API Release Artifacts Publishing the Storage API Artifacts Preparing Branch for further development Cleaning Up Storage API Artifacts Hive Release Preparation Branching Updating Release Branch Building Voting Verifying the Release Candidate Publishing Archive old releases Preparing Branch for Future Maintenance Release See Also Hadoop Version Warning</description></item><item><title>Apache Hive : H [...]
-Materialized views with automatic rewriting can result in very similar results. Hive 2.3.0 adds support for materialzed views. Using columnar file formats (Parquet, ORC) – they can do selective scanning; they may even skip entire files/blocks.</description></item><item><title>Apache Hive : IndexDev Bitmap</title><link>https://hive.apache.org/docs/latest/indexdev-bitmap_27362028/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/indexdev-bit [...]
-Introduction Approach Proposal First implementation Second iteration Example Introduction This document explains the proposed design for adding a bitmap index handler (https://issues.apache.org/jira/browse/HIVE-1803).
+Apache Hive : JDBC Driver Integration with Pentaho Integration with SQuirrel SQL Client Integration with Pentaho Download pentaho report designer from the pentaho website.</description></item><item><title>Apache Hive : HiveODBC</title><link>https://hive.apache.org/docs/latest/hiveodbc_27362099/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hiveodbc_27362099/</guid><description>Apache Hive : ODBC Driver These instructions are for the Hiv [...]
+There is no ODBC driver available for HiveServer2 as part of Apache Hive. There are third party ODBC drivers available from different vendors, and most of them seem to be free.
+Apache Hive : ODBC Driver Introduction Suggested Reading Software Requirements Driver Architecture Building and Setting Up ODBC Components Hive Client Build/Setup unixODBC API Wrapper Build/Setup Connecting the Driver to a Driver Manager Testing with ISQL Build libodbchive.</description></item><item><title>Apache Hive : HivePlugins</title><link>https://hive.apache.org/docs/latest/hiveplugins_27362098/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/d [...]
+package com.example.hive.udf; import org.apache.hadoop.hive.ql.exec.UDF; import org.apache.hadoop.io.Text; public final class Lower extends UDF { public Text evaluate(final Text s) { if (s == null) { return null; } return new Text(s.</description></item><item><title>Apache Hive : HiveQL</title><link>https://hive.apache.org/docs/latest/hiveql_27362097/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hiveql_27362097/</guid><description>Apac [...]
+Please see the HiveQL Language Manual</description></item><item><title>Apache Hive : HiveReplicationDevelopment</title><link>https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/</guid><description>Apache Hive : HiveReplicationDevelopment Apache Hive : HiveReplicationDevelopment Introduction Purposes of Replication Disaster Recovery Loa [...]
+This work is under development and interfaces are subject to change. This has been designed for use in conjunction with external orchestration tools, which would be responsible for co-ordinating the right sequence of commands between source and target clusters, fault tolerance/failure handling, and also providing correct configuration options that are necessary to be able to do cross cluster replication.</description></item><item><title>Apache Hive : HiveServer</title><link>https://hive. [...]
+Apache Hive : HiveServer2 Clients Version information Beeline – Command Line Shell Beeline Example Beeline Commands Beeline Properties Beeline Hive Commands Beeline Command Options Output Formats HiveServer2 Logging Cancelling the Query Background Query in Terminal Script JDBC Connection URLs Connection URL Format Connection URL for Remote or Embedded Mode Connection URL When HiveServer2 Is Running in HTTP Mode Connection URL When SSL Is Enabled in HiveServer2 Connection URL When ZooKeep [...]
+Motivations Concurrency Many users have reported that the current HiveServer implementation has concurrency bugs (for example, see HIVE-80). In fact, it&rsquo;s impossible for HiveServer to support concurrent connections using the current Thrift API, a result of the fact that Thrift doesn&rsquo;t provide server-side access to connection handles. Since the current API does not provide explicit support for sessions or connections, HiveServer has no way of mapping incoming requests [...]
+Built on top of Apache Hadoop™, Hive provides the following features:</description></item><item><title>Apache Hive : Howl</title><link>https://hive.apache.org/docs/latest/howl_27362109/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howl_27362109/</guid><description>Apache Hive : Howl This page collects some pointers to resources about Howl (an effort to create a metastore for all of Hadoop) and how its first incarnation is being built b [...]
+Howl wiki Yahoo group for Howl developers (including mailing list archive) Howl source code at github Howl CLI functional spec Original plans for Owl (predecessor to Howl)</description></item><item><title>Apache Hive : HowToCommit</title><link>https://hive.apache.org/docs/latest/howtocommit_27362108/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howtocommit_27362108/</guid><description>Apache Hive : Guide for Committers This page contai [...]
+Apache Hive : Guide for Committers New committers Review Reject PreCommit runs, and committing patches Commit Backporting commits to previous branches Dialog New committers New committers are encouraged to first read Apache&rsquo;s generic committer documentation:</description></item><item><title>Apache Hive : HowToContribute</title><link>https://hive.apache.org/docs/latest/howtocontribute_27362107/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org [...]
+Apache Hive : How to Contribute Getting the Source Code Becoming a Contributor Making Changes Coding Conventions Understanding Maven Understanding Hive Branches Hadoop Dependencies Unit Tests Add a Unit Test Submitting a PR Fetching a PR from Github Contributing Your Work JIRA Guidelines Generating Thrift Code See Also Getting the Source Code First of all, you need the Hive source code.</description></item><item><title>Apache Hive : HowToRelease</title><link>https://hive.apache.org/docs/ [...]
+Materialized views with automatic rewriting can result in very similar results. Hive 2.3.0 adds support for materialzed views.</description></item><item><title>Apache Hive : IndexDev Bitmap</title><link>https://hive.apache.org/docs/latest/indexdev-bitmap_27362028/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/indexdev-bitmap_27362028/</guid><description>Apache Hive : Bitmap Indexing Apache Hive : Bitmap Indexing Introduction Approach Pr [...]
Bitmap indexing (http://en.wikipedia.org/wiki/Bitmap_index) is a standard technique for indexing columns with few distinct
values, such as gender.
Approach We want to develop a bitmap index that can reuse as much of the existing Compact Index code as possible.</description></item><item><title>Apache Hive : Introduction to Apache Hive</title><link>https://hive.apache.org/docs/latest/introduction-to-apache-hive_283118337/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/introduction-to-apache-hive_283118337/</guid><description>Apache Hive : Introduction to Apache Hive The Apache Hive™ [...]
Built on top of Apache Hadoop™, Hive provides the following features:
-Tools to enable easy access to data via SQL, thus enabling data warehousing tasks such as extract/transform/load (ETL), reporting, and data analysis. A mechanism to impose structure on a variety of data formats Access to files stored either directly in Apache HDFS™ or in other data storage systems such as Apache HBase™ Query execution via Apache Tez™ or MapReduce Procedural language with HPL-SQL Sub-second query retrieval via Hive LLAP, Apache YARN and Apache Slider.</description></item> [...]
+Tools to enable easy access to data via SQL, thus enabling data warehousing tasks such as extract/transform/load (ETL), reporting, and data analysis. A mechanism to impose structure on a variety of data formats Access to files stored either directly in Apache HDFS™ or in other data storage systems such as Apache HBase™ Query execution via Apache Tez™ or MapReduce Procedural language with HPL-SQL Sub-second query retrieval via Hive LLAP, Apache YARN and Apache Slider.</description></item> [...]
Commands and CLIs
Commands Hive CLI (old) Beeline CLI (new) Variable Substitution HCatalog CLI File Formats
Avro Files ORC Files Parquet Compressed Data Storage LZO Compression Data Types
Data Definition Statements
-DDL Statements Bucketed Tables Statistics (Analyze and Describe) Indexes Archiving Data Manipulation Statements</description></item><item><title>Apache Hive : LanguageManual Archiving</title><link>https://hive.apache.org/docs/latest/languagemanual-archiving_27362031/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-archiving_27362031/</guid><description>Apache Hive : LanguageManual Archiving Archiving for File Count Reductio [...]
-Archiving for File Count Reduction Overview Settings Usage Archive Unarchive Cautions and Limitations Under the Hood Overview Due to the design of HDFS, the number of files in the filesystem directly affects the memory consumption in the namenode. While normally not a problem for small clusters, memory usage may hit the limits of accessible memory on a single machine when there are &gt;50-100 million files.</description></item><item><title>Apache Hive : LanguageManual Authorization</ [...]
-Introduction Hive Authorization Options Use Cases Overview of Authorization Modes 1 Storage Based Authorization in the Metastore Server Fall Back Authorizer 2 SQL Standards Based Authorization in HiveServer2 3 Authorization using Apache Ranger &amp; Sentry 4 Old default Hive Authorization (Legacy Mode) Addressing Authorization Needs of Multiple Use Cases Explain Authorization More Information Introduction Note that this documentation is referring to Authorization which is verifying i [...]
-Command Description quit exit Use quit or exit to leave the interactive shell. reset Resets the configuration to the default values (as of Hive 0.10: see HIVE-3202). Any configuration parameters that were set using the set command or -hiveconf parameter in hive commandline will get reset to default value.</description></item><item><title>Apache Hive : LanguageManual DDL</title><link>https://hive.apache.org/docs/latest/languagemanual-ddl_27362034/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
-Overview Keywords, Non-reserved Keywords and Reserved Keywords Create/Drop/Alter/Use Database Create/Drop/Alter Connector Create/Drop/Truncate Table Alter Table/Partition/Column Create/Drop/Alter View Create/Drop/Alter Materialized View Create/Drop/Alter Index Create/Drop Macro Create/Drop/Reload Function Create/Drop/Grant/Revoke Roles and Privileges Show Describe Abort Scheduled queries
-Datasketches integration
-HCatalog and WebHCat DDL
-Overview HiveQL DDL statements are documented here, including:
-CREATE DATABASE/SCHEMA, TABLE, VIEW, FUNCTION, INDEX DROP DATABASE/SCHEMA, TABLE, VIEW, INDEX TRUNCATE TABLE ALTER DATABASE/SCHEMA, TABLE, VIEW MSCK REPAIR TABLE (or ALTER TABLE RECOVER PARTITIONS) SHOW DATABASES/SCHEMAS, TABLES, TBLPROPERTIES, VIEWS, PARTITIONS, FUNCTIONS, INDEX[ES], COLUMNS, CREATE TABLE DESCRIBE DATABASE/SCHEMA, table_name, view_name, materialized_view_name PARTITION statements are usually options of TABLE statements, except for SHOW PARTITIONS.</description></item><i [...]
-Bucketed tables are fantastic in that they allow much more efficient sampling than do non-bucketed tables, and they may later allow for time saving operations such as mapside joins. However, the bucketing specified at table creation is not enforced when the table is written to, and so it is possible for the table&rsquo;s metadata to advertise properties which are not upheld by the table&rsquo;s actual layout.</description></item><item><title>Apache Hive : LanguageManual DML</titl [...]
-EXPLAIN [EXTENDED|CBO|AST|DEPENDENCY|AUTHORIZATION|LOCKS|VECTORIZATION|ANALYZE] query AUTHORIZATION is supported from HIVE 0.14.0 via HIVE-5961.</description></item><item><title>Apache Hive : LanguageManual GroupBy</title><link>https://hive.apache.org/docs/latest/languagemanual-groupby_27362038/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-groupby_27362038/</guid><description>Apache Hive : LanguageManual GroupBy Group By [...]
-The EXPORT and IMPORT commands were added in Hive 0.8.0 (see HIVE-1918).
+DDL Statements Bucketed Tables Statistics (Analyze and Describe) Indexes Archiving Data Manipulation Statements</description></item><item><title>Apache Hive : LanguageManual Archiving</title><link>https://hive.apache.org/docs/latest/languagemanual-archiving_27362031/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-archiving_27362031/</guid><description>Apache Hive : LanguageManual Archiving Archiving for File Count Reduction.
+Apache Hive : LanguageManual Archiving Overview Settings Usage Archive Unarchive Cautions and Limitations Under the Hood Overview Due to the design of HDFS, the number of files in the filesystem directly affects the memory consumption in the namenode. While normally not a problem for small clusters, memory usage may hit the limits of accessible memory on a single machine when there are &gt;50-100 million files.</description></item><item><title>Apache Hive : LanguageManual Authorizati [...]
+Apache Hive : LanguageManual Hive CLI Deprecation in favor of Beeline CLI Hive Command Line Options Examples The hiverc File Logging Tool to Clear Dangling Scratch Directories Hive Batch Mode Commands Hive Interactive Shell Commands Hive Resources HCatalog CLI Deprecation in favor of Beeline CLI HiveServer2 (introduced in Hive 0.</description></item><item><title>Apache Hive : LanguageManual Commands</title><link>https://hive.apache.org/docs/latest/languagemanual-commands_34838882/</link> [...]
+Command Description quit exit Use quit or exit to leave the interactive shell. reset Resets the configuration to the default values (as of Hive 0.10: see HIVE-3202). Any configuration parameters that were set using the set command or -hiveconf parameter in hive commandline will get reset to default value.</description></item><item><title>Apache Hive : LanguageManual DDL</title><link>https://hive.apache.org/docs/latest/languagemanual-ddl_27362034/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
+Bucketed tables are fantastic in that they allow much more efficient sampling than do non-bucketed tables, and they may later allow for time saving operations such as mapside joins. However, the bucketing specified at table creation is not enforced when the table is written to, and so it is possible for the table&rsquo;s metadata to advertise properties which are not upheld by the table&rsquo;s actual layout.</description></item><item><title>Apache Hive : LanguageManual DML</titl [...]
Replication extensions to the EXPORT and IMPORT commands were added in Hive 1.2.0 (see HIVE-7973 and Hive Replication Development).
-Overview The EXPORT command exports the data of a table or partition, along with the metadata, into a specified output location.</description></item><item><title>Apache Hive : LanguageManual Indexing</title><link>https://hive.apache.org/docs/latest/languagemanual-indexing_31822176/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-indexing_31822176/</guid><description>Apache Hive : LanguageManual Indexing Indexing Is Removed [...]
-Materialized views with automatic rewriting can result in very similar results. Hive 2.3.0 adds support for materialzed views. Using columnar file formats (Parquet, ORC) – they can do selective scanning; they may even skip entire files/blocks.</description></item><item><title>Apache Hive : LanguageManual JoinOptimization</title><link>https://hive.apache.org/docs/latest/languagemanual-joinoptimization_33293167/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apa [...]
-Current and Future Optimizations Optimize Auto Join Conversion
-- [Current Optimization](#current-optimization)+ [Auto Conversion to SMB Map Join](#auto-conversion-to-smb-map-join) - [SMB Join across Tables with Different Keys](#smb-join-across-tables-with-different-keys) Generate Hash Tables on the Task Side</description></item><item><title>Apache Hive : LanguageManual Joins</title><link>https://hive.apache.org/docs/latest/languagemanual-joins_27362039/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest [...]
-join_table: table_reference [INNER] JOIN table_factor [join_condition] | table_reference {LEFT|RIGHT|FULL} [OUTER] JOIN table_reference join_condition | table_reference LEFT SEMI JOIN table_reference join_condition | table_reference CROSS JOIN table_reference [join_condition] (as of Hive 0.</description></item><item><title>Apache Hive : LanguageManual LateralView</title><link>https://hive.apache.org/docs/latest/languagemanual-lateralview_27362040/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
+Overview The EXPORT command exports the data of a table or partition, along with the metadata, into a specified output location.</description></item><item><title>Apache Hive : LanguageManual Indexing</title><link>https://hive.apache.org/docs/latest/languagemanual-indexing_31822176/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-indexing_31822176/</guid><description>Apache Hive : LanguageManual Indexing Apache Hive : Langua [...]
+Materialized views with automatic rewriting can result in very similar results. Hive 2.3.0 adds support for materialzed views.</description></item><item><title>Apache Hive : LanguageManual JoinOptimization</title><link>https://hive.apache.org/docs/latest/languagemanual-joinoptimization_33293167/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-joinoptimization_33293167/</guid><description>Apache Hive : LanguageManual Join Op [...]
+The join optimizations described here were added in Hive version 0.11.0. See HIVE-3784 and related JIRAs.
+This document describes optimizations of Hive&rsquo;s query execution planning to improve the efficiency of joins and reduce the need for user hints.</description></item><item><title>Apache Hive : LanguageManual Joins</title><link>https://hive.apache.org/docs/latest/languagemanual-joins_27362039/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-joins_27362039/</guid><description>Apache Hive : LanguageManual Joins Apache [...]
+join_table: table_reference [INNER] JOIN table_factor [join_condition] | table_reference {LEFT|RIGHT|FULL} [OUTER] JOIN table_reference join_condition | table_reference LEFT SEMI JOIN table_reference join_condition | table_reference CROSS JOIN table_reference [join_condition] (as of Hive 0.</description></item><item><title>Apache Hive : LanguageManual LateralView</title><link>https://hive.apache.org/docs/latest/languagemanual-lateralview_27362040/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
Introduced in Hive version 0.11.0.
-The Optimized Row Columnar (ORC) file format provides a highly efficient way to store Hive data.</description></item><item><title>Apache Hive : LanguageManual Sampling</title><link>https://hive.apache.org/docs/latest/languagemanual-sampling_27362042/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-sampling_27362042/</guid><description>Apache Hive : LanguageManual Sampling Sampling Syntax Sampling Bucketized Table Block Samp [...]
-Select Syntax [WITH CommonTableExpression (, CommonTableExpression)*] (Note: Only available starting with Hive 0.</description></item><item><title>Apache Hive : LanguageManual SortBy</title><link>https://hive.apache.org/docs/latest/languagemanual-sortby_27362045/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-sortby_27362045/</guid><description>Apache Hive : LanguageManual SortBy Order, Sort, Cluster, and Distribute By Syn [...]
-Hive versions prior to 1.</description></item><item><title>Apache Hive : LanguageManual VariableSubstitution</title><link>https://hive.apache.org/docs/latest/languagemanual-variablesubstitution_30754722/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-variablesubstitution_30754722/</guid><description>Apache Hive : LanguageManual VariableSubstitution Introduction Using Variables Substitution During Query Construction Disabli [...]
-The Hive variable substitution mechanism was designed to avoid some of the code that was getting baked into the scripting language on top of Hive.
-Examples such as the following shell commands may (inefficiently) be used to set variables within a script:</description></item><item><title>Apache Hive : LanguageManual VirtualColumns</title><link>https://hive.apache.org/docs/latest/languagemanual-virtualcolumns_27362048/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-virtualcolumns_27362048/</guid><description>Apache Hive : LanguageManual VirtualColumns Virtual Columns S [...]
+The Optimized Row Columnar (ORC) file format provides a highly efficient way to store Hive data.</description></item><item><title>Apache Hive : LanguageManual Sampling</title><link>https://hive.apache.org/docs/latest/languagemanual-sampling_27362042/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-sampling_27362042/</guid><description>Apache Hive : LanguageManual Sampling Apache Hive : LanguageManual Sampling Sampling Synta [...]
+Hive versions prior to 1.2.0 only support UNION ALL (bag union), in which duplicate rows are not eliminated.</description></item><item><title>Apache Hive : LanguageManual VariableSubstitution</title><link>https://hive.apache.org/docs/latest/languagemanual-variablesubstitution_30754722/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-variablesubstitution_30754722/</guid><description>Apache Hive : LanguageManual VariableSubst [...]
+The Hive variable substitution mechanism was designed to avoid some of the code that was getting baked into the scripting language on top of Hive.</description></item><item><title>Apache Hive : LanguageManual VirtualColumns</title><link>https://hive.apache.org/docs/latest/languagemanual-virtualcolumns_27362048/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-virtualcolumns_27362048/</guid><description>Apache Hive : Language [...]
One is INPUT__FILE__NAME, which is the input file&rsquo;s name for a mapper task.
the other is BLOCK__OFFSET__INSIDE__FILE, which is the current global file position.
-For block compressed file, it is the current block&rsquo;s file offset, which is the current block&rsquo;s first byte&rsquo;s file offset.
-Since Hive 0.</description></item><item><title>Apache Hive : LanguageManual WindowingAndAnalytics</title><link>https://hive.apache.org/docs/latest/languagemanual-windowingandanalytics_31819589/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-windowingandanalytics_31819589/</guid><description>Apache Hive : LanguageManual WindowingAndAnalytics Windowing and Analytics Functions Windowing and Analytics Functions Enhancements to [...]
-UDFs xpath, xpath_short, xpath_int, xpath_long, xpath_float, xpath_double, xpath_number, xpath_string Functions for parsing XML data using XPath expressions. Since version: 0.6.0 Overview The xpath family of UDFs are wrappers around the Java XPath library javax.xml.xpath provided by the JDK. The library is based on the XPath 1.0 specification. Please refer to http://java.sun.com/javase/6/docs/api/javax/xml/xpath/package-summary.html for detailed information on the Java XPath library.</de [...]
-Type Postfix Example TINYINT Y 100Y SMALLINT S 100S BIGINT L 100L String types String literals can be expressed with either single quotes (') or double quotes (&quot;).</description></item><item><title>Apache Hive : LLAP</title><link>https://hive.apache.org/docs/latest/llap_62689557/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/llap_62689557/</guid><description>Apache Hive : LLAP Overview Persistent Daemon Execution Engine Query Fr [...]
-For configuration of LLAP, see the LLAP Section of Configuration Properties.
-Overview Hive has become significantly faster thanks to various features and improvements that were built by the community in recent years, including Tez and Cost-based-optimization.</description></item><item><title>Apache Hive : Locking</title><link>https://hive.apache.org/docs/latest/locking_27362050/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/locking_27362050/</guid><description>Apache Hive : Locking Hive Concurrency Model Hive Co [...]
-Managed (Internal) External Introduction This document lists some of the differences between the two but the fundamental difference is that Hive assumes that it owns the data for managed tables. That means that the data, its properties and data layout will and can only be changed via Hive command. The data still lives in a normal file system and nothing is stopping you from changing it without telling Hive about it.</description></item><item><title>Apache Hive : Manual Installation</titl [...]
-1. Map Join Optimization 1.1 Using Distributed Cache to Propagate Hashtable File 1.2 Removing JDBM 1.3 Performance Evaluation 2. Converting Join into Map Join Automatically 2.1 New Join Execution Flow 2.2 Resolving the Join Operation at Run Time 2.3 Backup Task 2.4 Performance Evaluation 1. Map Join Optimization 1.1 Using Distributed Cache to Propagate Hashtable File Previously, when 2 large data tables need to do a join, there will be 2 different Mappers to sort these tables based on th [...]
-Materialized views support is introduced in Hive 3.0.0.
-Introduction This page documents the work done for the supporting materialized views in Apache Hive.</description></item><item><title>Apache Hive : Materialized views in Hive</title><link>https://hive.apache.org/docs/latest/materialized-views-in-hive_283118346/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/materialized-views-in-hive_283118346/</guid><description>Apache Hive : Materialized views in Hive Objectives Traditionally, one of t [...]
+For block compressed file, it is the current block&rsquo;s file offset, which is the current block&rsquo;s first byte&rsquo;s file offset.</description></item><item><title>Apache Hive : LanguageManual WindowingAndAnalytics</title><link>https://hive.apache.org/docs/latest/languagemanual-windowingandanalytics_31819589/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-windowingandanalytics_31819589/</guid><descripti [...]
+This section introduces the Hive QL enhancements for windowing and analytics functions. See &ldquo;Windowing Specifications in HQL&rdquo; (attached to HIVE-4197) for details. HIVE-896 has more information, including links to earlier documentation in the initial comments.</description></item><item><title>Apache Hive : LanguageManual XPathUDF</title><link>https://hive.apache.org/docs/latest/languagemanual-xpathudf_27362051/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><g [...]
+UDFs xpath, xpath_short, xpath_int, xpath_long, xpath_float, xpath_double, xpath_number, xpath_string Functions for parsing XML data using XPath expressions. Since version: 0.6.0 Overview The xpath family of UDFs are wrappers around the Java XPath library javax.xml.xpath provided by the JDK. The library is based on the XPath 1.0 specification. Please refer to http://java.sun.com/javase/6/docs/api/javax/xml/xpath/package-summary.html for detailed information on the Java XPath library.</de [...]
+There are many tables of the following format:
+create table T(a, b, c, .</description></item><item><title>Apache Hive : Literals</title><link>https://hive.apache.org/docs/latest/literals_27829682/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/literals_27829682/</guid><description>Apache Hive : Literals Literals Integral types Integral literals are assumed to be INT by default, unless the number exceeds the range of INT in which case it is interpreted as a BIGINT, or if one of the fo [...]
+Type Postfix Example TINYINT Y 100Y SMALLINT S 100S BIGINT L 100L String types String literals can be expressed with either single quotes (') or double quotes (&quot;).</description></item><item><title>Apache Hive : LLAP</title><link>https://hive.apache.org/docs/latest/llap_62689557/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/llap_62689557/</guid><description>Apache Hive : LLAP Live Long And Process (LLAP) functionality was added [...]
+Apache Hive : LLAP Overview Persistent Daemon Execution Engine Query Fragment Execution I/O Caching Workload Management ACID Support Security Monitoring Web Services SLIDER on YARN Deployment LLAP Status Resources Attachments: Overview Hive has become significantly faster thanks to various features and improvements that were built by the community in recent years, including Tez and Cost-based-optimization.</description></item><item><title>Apache Hive : Locking</title><link>https://hive.a [...]
+Managed (Internal) External Introduction This document lists some of the differences between the two but the fundamental difference is that Hive assumes that it owns the data for managed tables. That means that the data, its properties and data layout will and can only be changed via Hive command. The data still lives in a normal file system and nothing is stopping you from changing it without telling Hive about it.</description></item><item><title>Apache Hive : Manual Installation</titl [...]
+Apache Hive : Materialized views Version information Objectives Management of materialized views in Hive Materialized views creation Other operations for materialized view management Materialized view-based query rewriting Example 1 Example 2 Example 3 Materialized view maintenance Materialized view lifecycle Open issues (JIRA) Version information Materialized views support is introduced in Hive 3.</description></item><item><title>Apache Hive : Materialized views in Hive</title><link>htt [...]
The initial implementation focuses on introducing materialized views and automatic query rewriting based on those materializations in the project. In particular, materialized views can be stored natively in Hive or in other systems such as Druid using custom storage handlers, and they can seamlessly exploit new exciting Hive features such as LLAP acceleration.</description></item><item><title>Apache Hive : MetaStore API Tests</title><link>https://hive.apache.org/docs/latest/metastore-api [...]
To ensure that the IMetaStoreClient implementations provide the same API we created a set of tests to validate their workings.
Currently the following implementations are tested:
@@ -207,14 +185,13 @@ Version Hive 0.14.0 and later.
Hive QL Syntax You can use MultiDelimitSerDe in a create table statement like this:
CREATE TABLE test ( id string, hivearray array&lt;binary&gt;, hivemap map&lt;string,int&gt;) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe' WITH SERDEPROPERTIES (&quot;field.delim&quot;=&quot;[,]&quot;,&quot;collection.delim&quot;=&quot;:&quot;,&quot;mapkey.delim&quot;=&quot;@&quot;); where field.delim is the field delimiter, collection.delim and mapkey.delim is the delimiter for collection items and key [...]
Guide to Hive Operators and Functions
-Reflect UDF Generic UDAF Case Study Functions for Statistics and Data Mining</description></item><item><title>Apache Hive : OuterJoinBehavior</title><link>https://hive.apache.org/docs/latest/outerjoinbehavior_35749927/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/outerjoinbehavior_35749927/</guid><description>Apache Hive : OuterJoinBehavior Hive Outer Join Behavior Hive Outer Join Behavior Definitions Predicate Pushdown Rules Hive Impl [...]
-Parquet is supported by a plugin in Hive 0.10, 0.11, and 0.12 and natively in Hive 0.13 and later.
- Introduction Native Parquet Support Hive 0.10, 0.11, and 0.12 Hive 0.13 HiveQL Syntax Hive 0.10 - 0.12 Hive 0.13 and later Versions and Limitations Hive 0.13.0 Hive 0.14.0 Hive 1.1.0 Hive 1.2.0 Resources Introduction Parquet (http://parquet.</description></item><item><title>Apache Hive : Partition Filter Syntax</title><link>https://hive.apache.org/docs/latest/partition-filter-syntax_103092177/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/la [...]
+Reflect UDF Generic UDAF Case Study Functions for Statistics and Data Mining</description></item><item><title>Apache Hive : OuterJoinBehavior</title><link>https://hive.apache.org/docs/latest/outerjoinbehavior_35749927/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/outerjoinbehavior_35749927/</guid><description>Apache Hive : OuterJoinBehavior Hive Outer Join Behavior Hive Outer Join Behavior Definitions Predicate Pushdown Rules Hive Impl [...]
+Apache Hive : Parquet Introduction Native Parquet Support Hive 0.10, 0.11, and 0.12 Hive 0.13 HiveQL Syntax Hive 0.10 - 0.12 Hive 0.13 and later Versions and Limitations Hive 0.13.0 Hive 0.14.0 Hive 1.1.0 Hive 1.2.0 Resources Introduction Parquet (http://parquet.</description></item><item><title>Apache Hive : Partition Filter Syntax</title><link>https://hive.apache.org/docs/latest/partition-filter-syntax_103092177/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hiv [...]
country = &quot;USA&quot; AND (state = &quot;CA&quot; OR state = &quot;AZ&quot;)
In particular notice that it is possible to nest sub-expressions within parentheses.
The following operators are supported when constructing filters for partition columns (derived from HIVE-1862):
-= &lt; &lt;= &gt; &gt;= &lt;&gt; AND OR LIKE (on keys of type string only, supports literal string template with &lsquo;.</description></item><item><title>Apache Hive : PartitionedViews</title><link>https://hive.apache.org/docs/latest/partitionedviews_27362053/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/partitionedviews_27362053/</guid><description>Apache Hive : PartitionedViews Use Cases Approaches Syntax [...]
-Use Cases An administrator wants to create a set of views as a table/column renaming layer on top of an existing set of base tables, without breaking any existing dependencies on those tables. To read-only users, the views should behave exactly the same as the underlying tables in every way.</description></item><item><title>Apache Hive : Performance</title><link>https://hive.apache.org/docs/latest/performance_27362052/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https:/ [...]
+= &lt; &lt;= &gt; &gt;= &lt;&gt; AND OR LIKE (on keys of type string only, supports literal string template with &lsquo;.</description></item><item><title>Apache Hive : PartitionedViews</title><link>https://hive.apache.org/docs/latest/partitionedviews_27362053/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/partitionedviews_27362053/</guid><description>Apache Hive : PartitionedViews This is a followup to ViewD [...]
+Apache Hive : PartitionedViews Use Cases Approaches Syntax Metastore Strict Mode View Definition Changes Hook Information Use Cases An administrator wants to create a set of views as a table/column renaming layer on top of an existing set of base tables, without breaking any existing dependencies on those tables.</description></item><item><title>Apache Hive : Performance</title><link>https://hive.apache.org/docs/latest/performance_27362052/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000< [...]
Benchmarks Here are some JIRA issues about benchmarks for Hive:</description></item><item><title>Apache Hive : Permission Inheritance in Hive</title><link>https://hive.apache.org/docs/latest/permission-inheritance-in-hive_48203008/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/permission-inheritance-in-hive_48203008/</guid><description>Apache Hive : Permission Inheritance in Hive This document describes how attributes (permission, grou [...]
HDFS Background When a file or directory is created, its owner is the user identity of the client process, and its group is inherited from parent (the BSD rule). Permissions are taken from default umask. Extended Acl&rsquo;s are taken from parent unless they are set explicitly. Goals To reduce need to set fine-grain file security props after every operation, users may want the following Hive warehouse file/dir to auto-inherit security properties from their directory parents:</descrip [...]
The PDK is planned for inclusion in the Hive 0.8.0 release; until that is available, please download a recent snapshot build from Jenkins; make sure it includes HIVE-2244.</description></item><item><title>Apache Hive : PoweredBy</title><link>https://hive.apache.org/docs/latest/poweredby_27362055/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/poweredby_27362055/</guid><description>Apache Hive : PoweredBy Applications and organizations us [...]
@@ -222,138 +199,139 @@ Bizo We use Hive for reporting and ad hoc queries.
Chitika We use Hive for data mining and analysis on our 435M monthly global users.
CNET We use Hive for data mining, internal log analysis and ad hoc queries.
Digg We use Hive for data mining, internal log analysis, R&amp;D, and reporting/analytics.
-eHarmony We use Hadoop to store copies of internal log and dimension data sources and use it as a source for reporting/analytics and machine learning.</description></item><item><title>Apache Hive : Presentations</title><link>https://hive.apache.org/docs/latest/presentations_27362054/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/presentations_27362054/</guid><description>Apache Hive : Presentations Hive Meetups January 2016 Hive User [...]
-ReExecition strategies Overlay Reoptimize Operator Matching Configuration Introduced in Hive 3.0 (HIVE-17626)
-ReExecition strategies Overlay Enables to change the hive settings for all reexecutions which will be happening. It works by adding a configuration subtree as an overlay to the actual hive settings(reexec.</description></item><item><title>Apache Hive : Query Results Caching (HIVE-18513)</title><link>https://hive.apache.org/docs/latest/75963441/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/75963441/</guid><description>Apache Hive : Quer [...]
+eHarmony We use Hadoop to store copies of internal log and dimension data sources and use it as a source for reporting/analytics and machine learning.</description></item><item><title>Apache Hive : Presentations</title><link>https://hive.apache.org/docs/latest/presentations_27362054/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/presentations_27362054/</guid><description>Apache Hive : Presentations Apache Hive : Presentations Hive Meetu [...]
+Apache Hive : Query ReExecution ReExecition strategies Overlay Reoptimize Operator Matching Configuration ReExecition strategies Overlay Enables to change the hive settings for all reexecutions which will be happening. It works by adding a configuration subtree as an overlay to the actual hive settings(reexec.</description></item><item><title>Apache Hive : Query Results Caching (HIVE-18513)</title><link>https://hive.apache.org/docs/latest/75963441/</link><pubDate>Thu, 12 Dec 2024 00:00:0 [...]
Background Existing behavior for Hive query processing (very simplified):
Hive query compilation takes the query string and produces a QueryPlan.</description></item><item><title>Apache Hive : RCFile</title><link>https://hive.apache.org/docs/latest/rcfile_58851803/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/rcfile_58851803/</guid><description>Apache Hive : RCFile RCFile (Record Columnar File) is a data placement structure designed for MapReduce-based data warehouse systems. Hive added the RCFile format in [...]
-RCFile stores table data in a flat file consisting of binary key/value pairs. It first partitions rows horizontally into row splits, and then it vertically partitions each row split in a columnar way. RCFile stores the metadata of a row split as the key part of a record, and all the data of a row split as the value part.</description></item><item><title>Apache Hive : RCFileCat</title><link>https://hive.apache.org/docs/latest/rcfilecat_30748712/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0 [...]
-Data Prints out the rows stored in an RCFile, columns are tab separated and rows are newline separated.
+RCFile stores table data in a flat file consisting of binary key/value pairs. It first partitions rows horizontally into row splits, and then it vertically partitions each row split in a columnar way. RCFile stores the metadata of a row split as the key part of a record, and all the data of a row split as the value part.</description></item><item><title>Apache Hive : RCFileCat</title><link>https://hive.apache.org/docs/latest/rcfilecat_30748712/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0 [...]
+Apache Hive : RCFileCat Data Metadata Data Prints out the rows stored in an RCFile, columns are tab separated and rows are newline separated.
Usage:
hive --rcfilecat [--start=start_offset] [--length=len] [--verbose] fileName --start=start_offset Start offset to begin reading in the file --length=len Length of data to read from the file --verbose Prints periodic stats about the data read, how many records, how many bytes, scan rate Metadata New in 0.</description></item><item><title>Apache Hive : Rebalance compaction</title><link>https://hive.apache.org/docs/latest/rebalance-compaction_240884502/</link><pubDate>Thu, 12 Dec 2024 00:00: [...]
Apache Hivemall (incubating) Apache Hivemall is a scalable machine learning library for Apache Hive, Apache Spark, and Apache Pig.
-Apache Sentry (incubating) Sentry is a role-based authorization system for Apache Hive.</description></item><item><title>Apache Hive : Replacing the Implementation of Hive CLI Using Beeline</title><link>https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/</guid><description>Apache [...]
+Apache Sentry (incubating) Sentry is a role-based authorization system for Apache Hive.</description></item><item><title>Apache Hive : Replacing the Implementation of Hive CLI Using Beeline</title><link>https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/</guid><description>Apache [...]
Features to be added Major Recent Changes Table Statistics Archiving Indexing First Cut Concurrency Conversion to Map-Join at Runtime Support for Multiple Distincts Remove Partition Filtering Conditions INSERT INTO statement Block-level merge HAVING clause support Cross-database queries Bitmap Index Use Filter Pushdown for Automatically Accessing Indexes Remove Duplicate Filters Authentication Authorization Current Projects Bloom Filters TIMESTAMP data type Up For Grabs Priorities are de [...]
There are several rules already defined by the community, but most of them are not enforced.
-Yetus helps us by checking these rules for newly introduced errors. Note that Yetus checks only the changed part of the code. If any unchanged code contains errors, then Yetus will not report them, but all of the new code should conform to the rules.</description></item><item><title>Apache Hive : Scheduled Queries</title><link>https://hive.apache.org/docs/latest/scheduled-queries_145724128/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/ [...]
+Yetus helps us by checking these rules for newly introduced errors. Note that Yetus checks only the changed part of the code. If any unchanged code contains errors, then Yetus will not report them, but all of the new code should conform to the rules.</description></item><item><title>Apache Hive : Scheduled Queries</title><link>https://hive.apache.org/docs/latest/scheduled-queries_145724128/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/ [...]
Authorization modes
The links below refer to the original Hive authorization mode. See Authorization for an overview of authorization modes, which include storage based authorization and SQL standards based authorization.
-Thoughts on security from Venkatesh Howl&rsquo;s approach for persisting and validating DDL authorization via HDFS permissions HIVE-1264: Hadoop security integration THRIFT-889: allow Kerberos authentication over Thrift HTTP THRIFT-876: SASL integration Howl Authorization Proposal Hive Authorization Proposal Note that Howl was the precursor to HCatalog.</description></item><item><title>Apache Hive : SerDe</title><link>https://hive.apache.org/docs/latest/serde_27362059/</link><pubDate [...]
-A SerDe allows Hive to read in data from a table, and write it back out to HDFS in any custom format.</description></item><item><title>Apache Hive : Setting Up Hive with Docker</title><link>https://hive.apache.org/docs/latest/setting-up-hive-with-docker_282102281/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/setting-up-hive-with-docker_282102281/</guid><description>Apache Hive : Setting Up Hive with Docker Introduction Run Apache Hive [...]
+Thoughts on security from Venkatesh Howl&rsquo;s approach for persisting and validating DDL authorization via HDFS permissions HIVE-1264: Hadoop security integration THRIFT-889: allow Kerberos authentication over Thrift HTTP THRIFT-876: SASL integration Howl Authorization Proposal Hive Authorization Proposal Note that Howl was the precursor to HCatalog.</description></item><item><title>Apache Hive : SerDe</title><link>https://hive.apache.org/docs/latest/serde_27362059/</link><pubDate [...]
STEP 1: Pull the image Pull the 4.0.0 image from Hive DockerHub docker pull apache/hive:4.0.0 STEP 2: Export the Hive version export HIVE_VERSION=4.0.0 STEP 3: Launch the HiveServer2 with an embedded Metastore. This is lightweight and for a quick setup, it uses Derby as metastore db.
-docker run -d -p 10000:10000 -p 10002:10002 --env SERVICE_NAME=hiveserver2 --name hive4 apache/hive:${HIVE_VERSION} STEP 4: Connect to beeline docker exec -it hiveserver2 beeline -u 'jdbc:hive2://hiveserver2:10000/' Note: Launch Standalone Metastore To use standalone Metastore with Derby,</description></item><item><title>Apache Hive : Setting Up HiveServer2</title><link>https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pu [...]
+docker run -d -p 10000:10000 -p 10002:10002 --env SERVICE_NAME=hiveserver2 --name hive4 apache/hive:${HIVE_VERSION} STEP 4: Connect to beeline docker exec -it hiveserver2 beeline -u 'jdbc:hive2://hiveserver2:10000/' Note: Launch Standalone Metastore To use standalone Metastore with Derby,</description></item><item><title>Apache Hive : Setting Up HiveServer2</title><link>https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pu [...]
+The Thrift interface definition language (IDL) for HiveServer2 is available at https://github.</description></item><item><title>Apache Hive : Skewed Join Optimization</title><link>https://hive.apache.org/docs/latest/skewed-join-optimization_27847852/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/skewed-join-optimization_27847852/</guid><description>Apache Hive : Skewed Join Optimization Optimizing Skewed Joins The Problem A join of 2 la [...]
e.g., Suppose we have table A with a key column, &ldquo;id&rdquo; which has values 1, 2, 3 and 4, and table B with a similar column, which has values 1, 2 and 3.</description></item><item><title>Apache Hive : Spatial queries</title><link>https://hive.apache.org/docs/latest/spatial-queries_34022710/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/spatial-queries_34022710/</guid><description>Apache Hive : Spatial queries Overview Ha [...]
-Hive****SP: we integrate Hadoop-GIS with Hive, to support both structured queries and spatial queries with a unified query language (HQL) and interface (Hive Shell).</description></item><item><title>Apache Hive : SQL Standard Based Hive Authorization</title><link>https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928 [...]
-Statistics and Data Mining in Hive ngrams() and context_ngrams(): N-gram frequency estimation Use Cases Usage Example histogram_numeric(): Estimating frequency distributions Use Cases Usage Example ngrams() and context_ngrams(): N-gram frequency estimation N-grams are subsequences of length N drawn from a longer sequence.</description></item><item><title>Apache Hive : StatsDev</title><link>https://hive.apache.org/docs/latest/statsdev_27362062/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +00 [...]
-Motivation Statistics such as the number of rows of a table or partition and the histograms of a particular interesting column are important in many ways.</description></item><item><title>Apache Hive : Storage API Release Proposal</title><link>https://hive.apache.org/docs/latest/storage-api-release-proposal_67635447/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/storage-api-release-proposal_67635447/</guid><description>Apache Hive : Sto [...]
-Besides HBase, a storage handler implementation is also available for Hypertable, and others are being developed for Cassandra, Azure Table, JDBC (MySQL and others), MongoDB, ElasticSearch, Phoenix HBase, VoltDB and Google Spreadsheets.</description></item><item><title>Apache Hive : Streaming Data Ingest</title><link>https://hive.apache.org/docs/latest/streaming-data-ingest_40509746/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/streami [...]
+Hive****SP: we integrate Hadoop-GIS with Hive, to support both structured queries and spatial queries with a unified query language (HQL) and interface (Hive Shell).</description></item><item><title>Apache Hive : SQL Standard Based Hive Authorization</title><link>https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928 [...]
+Apache Hive : Statistics and Data Mining ngrams() and context_ngrams(): N-gram frequency estimation Use Cases Usage Example histogram_numeric(): Estimating frequency distributions Use Cases Usage Example ngrams() and context_ngrams(): N-gram frequency estimation N-grams are subsequences of length N drawn from a longer sequence.</description></item><item><title>Apache Hive : StatsDev</title><link>https://hive.apache.org/docs/latest/statsdev_27362062/</link><pubDate>Thu, 12 Dec 2024 00:00: [...]
+Apache Hive : Statistics Motivation Scope Table and Partition Statistics Column Statistics Top K Statistics Quick overview Implementation Usage Configuration Variables Newly Created Tables Existing Tables – ANALYZE Examples ANALYZE TABLE &lt;table1&gt; CACHE METADATA Current Status (JIRA) Motivation Statistics such as the number of rows of a table or partition and the histograms of a particular interesting column are important in many ways.</description></item><item><title>Apache [...]
+HIVE-3705 added metastore server security to Hive in release 0.10.0.
+For additional information about storage based authorization in the metastore server, see the HCatalog document Storage Based Authorization. For an overview of Hive authorization models and other security options, see the Authorization document.</description></item><item><title>Apache Hive : StorageHandlers</title><link>https://hive.apache.org/docs/latest/storagehandlers_27362063/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/storagehan [...]
+Besides HBase, a storage handler implementation is also available for Hypertable, and others are being developed for Cassandra, Azure Table, JDBC (MySQL and others), MongoDB, ElasticSearch, Phoenix HBase, VoltDB and Google Spreadsheets.</description></item><item><title>Apache Hive : Streaming Data Ingest</title><link>https://hive.apache.org/docs/latest/streaming-data-ingest_40509746/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/streami [...]
SELECT customer.customer_num, (SELECT SUM(ship_charge) FROM orders WHERE customer.customer_num = orders.customer_num ) AS total_ship_chg FROM customer Recently a lot of work has been done to extend support for subqueries (HIVE-15456). But this work primarily targeted extending subquery support in WHERE and HAVING clauses. We plan to continue the work done in HIVE-15456 to support subqueries in a select list (see HIVE-16091).</description></item><item><title>Apache Hive : Suggestion for D [...]
Feature ID Feature Name Implemented Mandatory Comments E011 Numeric data types Yes Mandatory E011-01 INTEGER and SMALLINT data types (including all spellings) Yes Mandatory E011-02 REAL, DOUBLE PRECISON, and FLOAT data types Yes Mandatory E011-03 DECIMAL and NUMERIC data types Yes Mandatory E011-04 Arithmetic operators Yes Mandatory E011-05 Numeric comparison Yes Mandatory E011-06 Implicit casting among the numeric data types Yes Mandatory E021 Character string types Yes Mandatory E021-0 [...]
-The problem we try to solve here is the cache consistency issue.</description></item><item><title>Apache Hive : TeradataBinarySerde</title><link>https://hive.apache.org/docs/latest/teradatabinaryserde_89068127/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/teradatabinaryserde_89068127/</guid><description>Apache Hive : TeradataBinarySerde Availability Overview How to export Using TPT FastExport Using BTEQ How to import Using BTEQ Using T [...]
+The problem we try to solve here is the cache consistency issue.</description></item><item><title>Apache Hive : TeradataBinarySerde</title><link>https://hive.apache.org/docs/latest/teradatabinaryserde_89068127/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/teradatabinaryserde_89068127/</guid><description>Apache Hive : TeradataBinarySerde Apache Hive : TeradataBinarySerde Availability Overview How to export How to import Usage Availabili [...]
The TeradataBinarySerDe is available in Hive 2.4 or greater.
-Overview Teradata can use TPT(Teradata Parallel Transporter) or BTEQ(Basic Teradata Query) to export and import data files compressed by gzip in very high speed.</description></item><item><title>Apache Hive : TestingDocs</title><link>https://hive.apache.org/docs/latest/testingdocs_42567126/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/testingdocs_42567126/</guid><description>Apache Hive : TestingDocs Hive Testing Documents The followin [...]
-Hive Developer FAQ: Testing Developer Guide: Unit Tests Unit Testing Hive SQL Running Yetus MetaStore API Tests Query File Test(qtest)</description></item><item><title>Apache Hive : Theta Join</title><link>https://hive.apache.org/docs/latest/theta-join_33293991/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/theta-join_33293991/</guid><description>Apache Hive : Theta Join Preliminaries Overview Specific Use Cases Geo-Location Side-Table [...]
-Scope In addition to the partition statistics, column level top K values can also be estimated for Hive tables.</description></item><item><title>Apache Hive : Transitivity on predicate pushdown</title><link>https://hive.apache.org/docs/latest/transitivity-on-predicate-pushdown_27823388/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/transitivity-on-predicate-pushdown_27823388/</guid><description>Apache Hive : Transitivity on predicate pu [...]
+Overview Teradata can use TPT(Teradata Parallel Transporter) or BTEQ(Basic Teradata Query) to export and import data files compressed by gzip in very high speed. However such binary files are encoded in Teradata’s proprietary format and can’t be directly consumed by Hive without a customized SerDe.</description></item><item><title>Apache Hive : TestingDocs</title><link>https://hive.apache.org/docs/latest/testingdocs_42567126/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid> [...]
+Hive Developer FAQ: Testing Developer Guide: Unit Tests Unit Testing Hive SQL Running Yetus MetaStore API Tests Query File Test(qtest)</description></item><item><title>Apache Hive : Theta Join</title><link>https://hive.apache.org/docs/latest/theta-join_33293991/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/theta-join_33293991/</guid><description>Apache Hive : Theta Join Apache Hive : Theta Join Preliminaries Overview Specific Use Cases [...]
+Apache Hive : Column Level Top K Statistics Scope Implementation Usage Example Newly Created Tables Existing Tables Current Status (JIRA) Scope In addition to the partition statistics, column level top K values can also be estimated for Hive tables.</description></item><item><title>Apache Hive : Transitivity on predicate pushdown</title><link>https://hive.apache.org/docs/latest/transitivity-on-predicate-pushdown_27823388/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>http [...]
set hive.mapred.mode=strict; create table invites (foo int, bar string) partitioned by (ds string); create table invites2 (foo int, bar string) partitioned by (ds string); select count(*) from invites join invites2 on invites.ds=invites2.ds where invites.ds='2011-01-01'; would give the error
-Error in semantic analysis: No Partition Predicate Found for Alias &quot;invites2&quot; Table &quot;invites2&quot; Here, the filter is applied to the table invites as invites.</description></item><item><title>Apache Hive : Tutorial</title><link>https://hive.apache.org/docs/latest/tutorial_27362061/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/tutorial_27362061/</guid><description>Apache Hive : Tutorial Hive Tutorial Hiv [...]
-Hive is designed to enable easy data summarization, ad-hoc querying and analysis of large volumes of data.</description></item><item><title>Apache Hive : Type Qualifiers in Hive</title><link>https://hive.apache.org/docs/latest/type-qualifiers-in-hive_33298524/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/type-qualifiers-in-hive_33298524/</guid><description>Apache Hive : Type Qualifiers in Hive Intro Hive will need to support some kind [...]
+Error in semantic analysis: No Partition Predicate Found for Alias &quot;invites2&quot; Table &quot;invites2&quot; Here, the filter is applied to the table invites as invites.</description></item><item><title>Apache Hive : Tutorial</title><link>https://hive.apache.org/docs/latest/tutorial_27362061/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/tutorial_27362061/</guid><description>Apache Hive : Tutorial Apache Hive : Tut [...]
My impression is that the actual enforcement of the type qualifiers should be done by the ObjectInspectors/Converters/casts operations. It should be ok to do col * col when col is a decimal(2) value of 99, it would fail if you try to cast the result to decimal(2) or try to insert it to a decimal(2) column.</description></item><item><title>Apache Hive : Union Optimization</title><link>https://hive.apache.org/docs/latest/union-optimization_29688910/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
select * from
(subq1
UNION ALL
sub2) u;
-If the parents to union were map reduce jobs, they will write the output to temporary files. The Union will then read the rows from these temporary files and write to a final directory. In effect, the results are read and written twice unnecessarily. We can avoid this by directly writing to the final directory.</description></item><item><title>Apache Hive : Unit Testing Hive SQL</title><link>https://hive.apache.org/docs/latest/unit-testing-hive-sql_61328063/</link><pubDate>Thu, 12 Dec 20 [...]
+If the parents to union were map reduce jobs, they will write the output to temporary files. The Union will then read the rows from these temporary files and write to a final directory. In effect, the results are read and written twice unnecessarily. We can avoid this by directly writing to the final directory.</description></item><item><title>Apache Hive : Unit Testing Hive SQL</title><link>https://hive.apache.org/docs/latest/unit-testing-hive-sql_61328063/</link><pubDate>Thu, 12 Dec 20 [...]
The view refers to exactly one base table or updatable view in the FROM clause without a WHERE clause. Each column in the view is a column in the underlying table/updatable view with no underlying columns duplicated. Views must have the same partition columns as the underlying table/updatable view. When inserting into a view:
-If a view does not specify all underlying columns, NULL will be inserted for each column not specified.</description></item><item><title>Apache Hive : User and Group Filter Support with LDAP Atn Provider in HiveServer2</title><link>https://hive.apache.org/docs/latest/user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2_58852417/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/user-and-group-filter-support-with-ldap-atn-prov [...]
+If a view does not specify all underlying columns, NULL will be inserted for each column not specified.</description></item><item><title>Apache Hive : User and Group Filter Support with LDAP Atn Provider in HiveServer2</title><link>https://hive.apache.org/docs/latest/user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2_58852417/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/user-and-group-filter-support-with-ldap-atn-prov [...]
User Guide The query language specification is available at LanguageManual. Also see, GettingStarted for setup instructions.
-Supported Features Usage Examples Creating tables MovieLens User Ratings CREATE TABLE u_data ( userid INT, movieid INT, rating INT, unixtime STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS TEXTFILE; Apache Access Log Tables add jar ../build/contrib/hive_contrib.jar; CREATE TABLE apachelog ( host STRING, identity STRING, user STRING, time STRING, request STRING, status STRING, size STRING, referer STRING, agent STRING) ROW FORMAT SERDE 'org.</description></item><item><tit [...]
+Supported Features Usage Examples Creating tables MovieLens User Ratings CREATE TABLE u_data ( userid INT, movieid INT, rating INT, unixtime STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS TEXTFILE; Apache Access Log Tables add jar ../build/contrib/hive_contrib.jar; CREATE TABLE apachelog ( host STRING, identity STRING, user STRING, time STRING, request STRING, status STRING, size STRING, referer STRING, agent STRING) ROW FORMAT SERDE 'org.</description></item><item><tit [...]
Navigation Links Next: Using WebHCat
-General: HCatalog Manual – Hive Wiki Home – Hive Project Site</description></item><item><title>Apache Hive : WebHCat Configure</title><link>https://hive.apache.org/docs/latest/webhcat-configure_34015738/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-configure_34015738/</guid><description>Apache Hive : WebHCat Configure WebHCat Configuration WebHCat Configuration Configuration Files Configuration Variables Default Values Configur [...]
-The WebHCat-specific configuration is split into two layers:
-webhcat-default.xml – All the configuration variables that WebHCat needs.</description></item><item><title>Apache Hive : WebHCat InstallWebHCat</title><link>https://hive.apache.org/docs/latest/webhcat-installwebhcat_34015585/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-installwebhcat_34015585/</guid><description>Apache Hive : WebHCat InstallWebHCat WebHCat Installation WebHCat Installation WebHCat Installed with Hive WebHCat I [...]
-WebHCat and HCatalog are installed with Hive, starting with Hive release 0.11.0.
-If you install Hive from the binary tarball, the WebHCat server command webhcat_server.sh is in the hcatalog/sbin directory.
-Hive installation is documented here.</description></item><item><title>Apache Hive : WebHCat Reference</title><link>https://hive.apache.org/docs/latest/webhcat-reference_34015762/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference_34015762/</guid><description>Apache Hive : WebHCat Reference Reference: WebHCat Resources This overview page lists all of the WebHCat resources. (DDL resources are listed here and on another overv [...]
+General: HCatalog Manual – Hive Wiki Home – Hive Project Site</description></item><item><title>Apache Hive : WebHCat Configure</title><link>https://hive.apache.org/docs/latest/webhcat-configure_34015738/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-configure_34015738/</guid><description>Apache Hive : WebHCat Configure Apache Hive : WebHCat Configure Configuration Files Configuration Variables Configuration Files The configurati [...]
+The WebHCat-specific configuration is split into two layers:</description></item><item><title>Apache Hive : WebHCat InstallWebHCat</title><link>https://hive.apache.org/docs/latest/webhcat-installwebhcat_34015585/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-installwebhcat_34015585/</guid><description>Apache Hive : WebHCat Installation Apache Hive : WebHCat Installation WebHCat Installed with Hive WebHCat Installation Procedure [...]
+If you install Hive from the binary tarball, the WebHCat server command webhcat_server.sh is in the hcatalog/sbin directory.</description></item><item><title>Apache Hive : WebHCat Reference</title><link>https://hive.apache.org/docs/latest/webhcat-reference_34015762/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference_34015762/</guid><description>Apache Hive : WebHCat Reference Reference: WebHCat Resources This overview page [...]
Category Resource (Type) Description General :version (GET) Return a list of supported response types. status (GET) Return the WebHCat server status.</description></item><item><title>Apache Hive : WebHCat Reference AllDDL</title><link>https://hive.apache.org/docs/latest/webhcat-reference-allddl_34016001/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-allddl_34016001/</guid><description>Apache Hive : WebHCat Referenc [...]
-For information about HCatalog DDL commands, see HCatalog DDL. For information about Hive DDL commands, see Hive Data Definition Language. Object Resource (Type) Description DDL Command ddl (POST) Perform an HCatalog DDL command.</description></item><item><title>Apache Hive : WebHCat Reference DDL</title><link>https://hive.apache.org/docs/latest/webhcat-reference-ddl_34015990/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-refere [...]
+For information about HCatalog DDL commands, see HCatalog DDL. For information about Hive DDL commands, see Hive Data Definition Language. Object Resource (Type) Description DDL Command ddl (POST) Perform an HCatalog DDL command.</description></item><item><title>Apache Hive : WebHCat Reference DDL</title><link>https://hive.apache.org/docs/latest/webhcat-reference-ddl_34015990/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-refere [...]
+URL http://www.myserver.com/templeton/ddl</description></item><item><title>Apache Hive : WebHCat Reference DeleteDB</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletedb_34016281/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletedb_34016281/</guid><description>Apache Hive : WebHCat Reference DeleteDB Apache Hive : WebHCat Reference DeleteDB Description URL Parameters Results Example Curl Comman [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db
-Parameters Name Description Required? Default :db The database name Required None ifExists Hive returns an error if the database specified does not exist, unless ifExists is set to true.</description></item><item><title>Apache Hive : WebHCat Reference DeleteJob</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/</guid>< [...]
+Parameters Name Description Required? Default :db The database name Required None ifExists Hive returns an error if the database specified does not exist, unless ifExists is set to true.</description></item><item><title>Apache Hive : WebHCat Reference DeleteJob</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/</guid>< [...]
Version: Deprecated in 0.12.0
-DELETE queue/:jobid is deprecated starting in Hive release 0.12.0. Users are encouraged to use DELETE jobs/:jobid instead.</description></item><item><title>Apache Hive : WebHCat Reference DeleteJobID</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletejobid_34835045/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletejobid_34835045/</guid><description>Apache Hive : WebHCat Reference DeleteJobID De [...]
+DELETE queue/:jobid is deprecated starting in Hive release 0.12.0. Users are encouraged to use DELETE jobs/:jobid instead.</description></item><item><title>Apache Hive : WebHCat Reference DeleteJobID</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletejobid_34835045/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletejobid_34835045/</guid><description>Apache Hive : WebHCat Reference DeleteJobID Ap [...]
Version: Hive 0.12.0 and later
-DELETE jobs/:jobid is introduced in Hive release 0.12.0. It is equivalent to [DELETE queue/:jobid](https://hive.</description></item><item><title>Apache Hive : WebHCat Reference DeletePartition</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletepartition_34016611/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletepartition_34016611/</guid><description>Apache Hive : WebHCat Reference DeletePartit [...]
+DELETE jobs/:jobid is introduced in Hive release 0.12.0. It is equivalent to [DELETE queue/:jobid](https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/) in prior releases.</description></item><item><title>Apache Hive : WebHCat Reference DeletePartition</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletepartition_34016611/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletepar [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/partition/:partition
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference DeleteTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletetable_34016561/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletetable_340165 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference DeleteTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletetable_34016561/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletetable_340165 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None ifExists Hive 0.</description></item><item><title>Apache Hive : WebHCat Reference GetColumn</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getcolumn_34016979/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getcolumn_34016979/</guid><description>Apache Hive : WebHCat Reference GetColum [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None ifExists Hive 0.70 and later returns an error if the table specified does not exist, unless ifExists is set to true.</description></item><item><title>Apache Hive : WebHCat Reference GetColumn</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getcolumn_34016979/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/late [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/column/:column
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :column The column name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetColumns</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getcolumns_34016970/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getcolumns_3 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :column The column name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetColumns</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getcolumns_34016970/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getcolumns_3 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/column
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetDB</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getdb_34016250/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getdb_34016250/</guid><description>Apache Hive : WebHCat Ref [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetDB</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getdb_34016250/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getdb_34016250/</guid><description>Apache Hive : WebHCat Ref [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db
-Parameters Name Description Required? Default :db The database name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetDBs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getdbs_34016238/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getdbs_34016238/</guid><description>Apache Hive : WebHCat Reference GetDBs List Databases — GE [...]
+Parameters Name Description Required? Default :db The database name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetDBs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getdbs_34016238/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getdbs_34016238/</guid><description>Apache Hive : WebHCat Reference GetDBs Apache Hive : WebHC [...]
URL http://www.myserver.com/templeton/v1/ddl/database
-Parameters Name Description Required? Default like List only databases whose names match the specified pattern. Optional &ldquo;*&rdquo; (List all) The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetPartition</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getpartition_34016592/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getparti [...]
+Parameters Name Description Required? Default like List only databases whose names match the specified pattern. Optional &ldquo;*&rdquo; (List all) The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetPartition</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getpartition_34016592/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getparti [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/partition/:partition
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference GetPartitions</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getpartitions_34016583/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getpartitions_ [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference GetPartitions</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getpartitions_34016583/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getpartitions_ [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/partition
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetProperties</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getproperties_34016995/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getproperties_34016995/</guid><description>A [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetProperties</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getproperties_34016995/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getproperties_34016995/</guid><description>A [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/property
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetProperty</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getproperty_34017004/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getproperty_34017004/</guid><description>Apache [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetProperty</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getproperty_34017004/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getproperty_34017004/</guid><description>Apache [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/property/:property
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :property The property name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-gettable_34016519/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-gettable_340 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :property The property name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-gettable_34016519/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-gettable_340 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table
-Parameters Name Description Required? Default :db The database name Required None like List only tables whose names match the specified pattern Optional &ldquo;*&rdquo; (List all tables) The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference Hive</title><link>https://hive.apache.org/docs/latest/webhcat-reference-hive_34017180/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/web [...]
+Parameters Name Description Required? Default :db The database name Required None like List only tables whose names match the specified pattern Optional &ldquo;*&rdquo; (List all tables) The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference Hive</title><link>https://hive.apache.org/docs/latest/webhcat-reference-hive_34017180/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/web [...]
Version: Hive 0.13.0 and later
As of Hive 0.13.0, GET version/hive displays the Hive version used for the query or commands.
URL http://www.myserver.com/templeton/v1/hive
-Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference Job</title><link>https://hive.apache.org/docs/latest/webhcat-reference-job_34835065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-job_34835065/</guid><description>Apache Hive : WebHCat Reference Job Job Information — GET jobs/:jobid Job Information — GET jobs/:jobid Description URL Parameters Results Example Curl Com [...]
+Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference Job</title><link>https://hive.apache.org/docs/latest/webhcat-reference-job_34835065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-job_34835065/</guid><description>Apache Hive : WebHCat Reference Job Apache Hive : WebHCat Reference Job Description URL Parameters Results Example Curl Command JSON Output Description Che [...]
Version: Hive 0.12.0 and later
-GET jobs/:jobid is introduced in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference JobIDs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/</guid><description>Apache Hive : WebHCat Reference JobIDs List JobIDs — GET queue List JobIDs — GET queue Description URL Parameters Results Example Curl [...]
+GET jobs/:jobid is introduced in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference JobIDs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/</guid><description>Apache Hive : WebHCat Reference JobIDs Apache Hive : WebHCat Reference JobIDs Description URL Parameters Results Example Curl Command J [...]
Version: Deprecated in 0.12.0
GET queue is deprecated starting in Hive release 0.12.0. (See HIVE-4443.) Users are encouraged to use [GET jobs](https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/) instead.
Version: Obsolete in 0.14.0
-GET queue will be removed in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference JobInfo</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobinfo_34017194/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobinfo_34017194/</guid><description>Apache Hive : WebHCat Reference JobInfo Job Information — GET queue/:jobid Job Information — GET queue/:jobid Description URL Parameters [...]
-Version: Deprecated in 0.</description></item><item><title>Apache Hive : WebHCat Reference Jobs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/</guid><description>Apache Hive : WebHCat Reference Jobs List JobIDs — GET jobs List JobIDs — GET jobs Description URL Parameters Results Examples Curl Command JSON Output Curl Command [...]
+GET queue will be removed in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference JobInfo</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobinfo_34017194/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobinfo_34017194/</guid><description>Apache Hive : WebHCat Reference JobInfo Apache Hive : WebHCat Reference JobInfo Description URL Parameters Results Example Curl Command [...]
+Version: Deprecated in 0.12.0
+GET queue/:jobid is deprecated starting in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference Jobs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/</guid><description>Apache Hive : WebHCat Reference Jobs Apache Hive : WebHCat Reference Jobs Description URL Parameters Results Examples Curl Command [...]
Version: Hive 0.12.0 and later
-GET jobs is introduced in Hive release 0.12.0. It is equivalent to [GET queue](https://hive.</description></item><item><title>Apache Hive : WebHCat Reference MapReduceJar</title><link>https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/</guid><description>Apache Hive : WebHCat Reference MapReduceJar MapReduce Job — POST mapredu [...]
+GET jobs is introduced in Hive release 0.12.0. It is equivalent to [GET queue](https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/) in prior releases.</description></item><item><title>Apache Hive : WebHCat Reference MapReduceJar</title><link>https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/</guid><descript [...]
Version: Hive 0.13.0 and later
As of Hive 0.13.0, GET version/hadoop displays the Hadoop version used for the MapReduce job.
URL http://www.myserver.com/templeton/v1/mapreduce/jar
-Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference MapReduceStream</title><link>https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/</guid><description>Apache Hive : WebHCat Reference MapReduceStream MapReduce Streaming Job — POST mapreduce/streaming MapReduce Streaming [...]
+Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference MapReduceStream</title><link>https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/</guid><description>Apache Hive : WebHCat Reference MapReduceStream Apache Hive : WebHCat Reference MapReduceStream Description URL Paramet [...]
Version: Hive 0.13.0 and later
-As of Hive 0.13.0, GET version/hadoop displays the Hadoop version used for the MapReduce job.</description></item><item><title>Apache Hive : WebHCat Reference Pig</title><link>https://hive.apache.org/docs/latest/webhcat-reference-pig_34017169/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-pig_34017169/</guid><description>Apache Hive : WebHCat Reference Pig Pig Job — POST pig Pig Job — POST pig Description URL Parameter [...]
+As of Hive 0.13.0, GET version/hadoop displays the Hadoop version used for the MapReduce job.
+URL http://www.myserver.com/templeton/v1/mapreduce/streaming
+Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference Pig</title><link>https://hive.apache.org/docs/latest/webhcat-reference-pig_34017169/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-pig_34017169/</guid><description>Apache Hive : WebHCat Reference Pig Apache Hive : WebHCat Reference Pig Description URL Parameters Results Example Code and Data Setup Curl Command JSON Ou [...]
URL http://www.myserver.com/templeton/v1/pig
-Parameters Name Description Required? Default execute String containing an entire, short Pig program to run. One of either &ldquo;execute&rdquo; or &ldquo;file&rdquo; is required.</description></item><item><title>Apache Hive : WebHCat Reference PostTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-posttable_34016548/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-posttable_34016548 [...]
+Parameters Name Description Required? Default execute String containing an entire, short Pig program to run. One of either &ldquo;execute&rdquo; or &ldquo;file&rdquo; is required.</description></item><item><title>Apache Hive : WebHCat Reference PostTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-posttable_34016548/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-posttable_34016548 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table
-Parameters Name Description Required? Default :db The database name Required None :table The existing (old) table name Required None rename The new table name Required None group The user group to use Optional None permissions The permissions string to use.</description></item><item><title>Apache Hive : WebHCat Reference PutColumn</title><link>https://hive.apache.org/docs/latest/webhcat-reference-putcolumn_34016987/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hi [...]
+Parameters Name Description Required? Default :db The database name Required None :table The existing (old) table name Required None rename The new table name Required None group The user group to use Optional None permissions The permissions string to use.</description></item><item><title>Apache Hive : WebHCat Reference PutColumn</title><link>https://hive.apache.org/docs/latest/webhcat-reference-putcolumn_34016987/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hi [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/column/:column
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :column The column name Required None group The user group to use Optional None permissions The permissions string to use Optional None type The type of column to add, like &ldquo;string&rdquo; or &ldquo;int&rdquo; Required None comment The column comment, like a description Optional None The standard parameters are also supported.</description></item><ite [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :column The column name Required None group The user group to use Optional None permissions The permissions string to use Optional None type The type of column to add, like &ldquo;string&rdquo; or &ldquo;int&rdquo; Required None comment The column comment, like a description Optional None The standard parameters are also supported.</description></item><ite [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db
-Parameters Name Description Required? Default :db The database name Required None group The user group to use Optional None permissions The permissions string to use Optional None location The database location Optional None comment A comment for the database, like a description Optional None properties The database properties Optional None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference PutPartition</title><link>https://hive.a [...]
+Parameters Name Description Required? Default :db The database name Required None group The user group to use Optional None permissions The permissions string to use Optional None location The database location Optional None comment A comment for the database, like a description Optional None properties The database properties Optional None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference PutPartition</title><link>https://hive.a [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/partition/:partition
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference PutProperty</title><link>https://hive.apache.org/docs/latest/webhcat-reference-putproperty_34017012/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-putproperty_340170 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference PutProperty</title><link>https://hive.apache.org/docs/latest/webhcat-reference-putproperty_34017012/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-putproperty_340170 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/property/:property
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :property The property name Required None group The user group to use Optional None permissions The permissions string to use Optional None value The property value Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference PutTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-puttable_3 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :property The property name Required None group The user group to use Optional None permissions The permissions string to use Optional None value The property value Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference PutTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-puttable_3 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table
-Parameters Name Description Required? Default :db The database name.</description></item><item><title>Apache Hive : WebHCat Reference PutTableLike</title><link>https://hive.apache.org/docs/latest/webhcat-reference-puttablelike_34016572/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-puttablelike_34016572/</guid><description>Apache Hive : WebHCat Reference PutTableLike Create Table Like — PUT ddl/database/:db/table/:exis [...]
+Parameters Name Description Required? Default :db The database name.</description></item><item><title>Apache Hive : WebHCat Reference PutTableLike</title><link>https://hive.apache.org/docs/latest/webhcat-reference-puttablelike_34016572/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-puttablelike_34016572/</guid><description>Apache Hive : WebHCat Reference PutTableLike Apache Hive : WebHCat Reference PutTableLike Descrip [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:existingtable/like/:newtable
-Parameters Name Description Required? Default :db The database name Required None :existingtable The existing table name Required None :newtable The new table name Required None group The user group to use when creating a table Optional None permissions The permissions string to use when creating a table Optional None external Allows you to specify a location so that Hive does not use the default location for this table.</description></item><item><title>Apache Hive : WebHCat Reference Re [...]
+Parameters Name Description Required? Default :db The database name Required None :existingtable The existing table name Required None :newtable The new table name Required None group The user group to use when creating a table Optional None permissions The permissions string to use when creating a table Optional None external Allows you to specify a location so that Hive does not use the default location for this table.</description></item><item><title>Apache Hive : WebHCat Reference Re [...]
URL http://www.myserver.com/templeton/:version
-Parameters Name Description Required? Default :version The WebHCat version number. (Currently this must be &ldquo;v1&rdquo;.</description></item><item><title>Apache Hive : WebHCat Reference Status</title><link>https://hive.apache.org/docs/latest/webhcat-reference-status_34015941/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-status_34015941/</guid><description>Apache Hive : WebHCat Reference Status Current Stat [...]
+Parameters Name Description Required? Default :version The WebHCat version number. (Currently this must be &ldquo;v1&rdquo;.) Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference Status</title><link>https://hive.apache.org/docs/latest/webhcat-reference-status_34015941/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-status_34015941/</guid><desc [...]
URL http://www.myserver.com/templeton/v1/status
Parameters Only the standard parameters are accepted.
-Results Name Description status &ldquo;ok&rdquo; if the WebHCat server was contacted.</description></item><item><title>Apache Hive : WebHCat Reference Version</title><link>https://hive.apache.org/docs/latest/webhcat-reference-version_34015986/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-version_34015986/</guid><description>Apache Hive : WebHCat Reference Version List Versions — GET version List Versions — GET [...]
+Results Name Description status &ldquo;ok&rdquo; if the WebHCat server was contacted.</description></item><item><title>Apache Hive : WebHCat Reference Version</title><link>https://hive.apache.org/docs/latest/webhcat-reference-version_34015986/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-version_34015986/</guid><description>Apache Hive : WebHCat Reference Version Apache Hive : WebHCat Reference Version Descrip [...]
URL http://www.myserver.com/templeton/v1/version
Parameters Only the standard parameters are accepted.
-Results Name Description supportedVersions A list of all supported versions. version The current version.</description></item><item><title>Apache Hive : WebHCat Reference VersionHadoop</title><link>https://hive.apache.org/docs/latest/webhcat-reference-versionhadoop_44303410/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-versionhadoop_44303410/</guid><description>Apache Hive : WebHCat Reference VersionHadoop Hadoop Vers [...]
+Results Name Description supportedVersions A list of all supported versions. version The current version.</description></item><item><title>Apache Hive : WebHCat Reference VersionHadoop</title><link>https://hive.apache.org/docs/latest/webhcat-reference-versionhadoop_44303410/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-versionhadoop_44303410/</guid><description>Apache Hive : WebHCat Reference VersionHadoop Apache Hive [...]
Version: Hive 0.13.0 and later
GET version/hadoop is introduced in Hive release 0.13.0 (HIVE-6226).
URL http://www.myserver.com/templeton/v1/version/hadoop
-Parameters Only the standard parameters are accepted.</description></item><item><title>Apache Hive : WebHCat Reference VersionHive</title><link>https://hive.apache.org/docs/latest/webhcat-reference-versionhive_44303406/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-versionhive_44303406/</guid><description>Apache Hive : WebHCat Reference VersionHive Hive Version — GET version/hive Hive Version — GET version/hive Descrip [...]
+Parameters Only the standard parameters are accepted.</description></item><item><title>Apache Hive : WebHCat Reference VersionHive</title><link>https://hive.apache.org/docs/latest/webhcat-reference-versionhive_44303406/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-versionhive_44303406/</guid><description>Apache Hive : WebHCat Reference VersionHive Apache Hive : WebHCat Reference VersionHive Description URL Parameters [...]
Version: Hive 0.13.0 and later
GET version/hive is introduced in Hive release 0.13.0 (HIVE-6226).
URL http://www.myserver.com/templeton/v1/version/hive
-Parameters Only the standard parameters are accepted.</description></item><item><title>Apache Hive : WebHCat UsingWebHCat</title><link>https://hive.apache.org/docs/latest/webhcat-usingwebhcat_34015492/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-usingwebhcat_34015492/</guid><description>Apache Hive : WebHCat UsingWebHCat Using the HCatalog REST API (WebHCat) Using the HCatalog REST API (WebHCat) Introduction to WebHCat URL For [...]
-The HCatalog project graduated from the Apache incubator and merged with the Hive project on March 26, 2013.</description></item><item><title/><link>https://hive.apache.org/docs/latest/capture-lineage-info/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/capture-lineage-info/</guid><description>Capture Lineage Information In Hive Hooks Background In Hive, lineage information is captured in the form of LineageInfo object. This object is cr [...]
+Parameters Only the standard parameters are accepted.</description></item><item><title>Apache Hive : WebHCat UsingWebHCat</title><link>https://hive.apache.org/docs/latest/webhcat-usingwebhcat_34015492/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-usingwebhcat_34015492/</guid><description>Apache Hive : WebHCat UsingWebHCat Apache Hive : WebHCat UsingWebHCat Version information Introduction to WebHCat URL Format Security Standard [...]
+Hive version 0.11.0 is the first release that includes HCatalog and its REST API, WebHCat.</description></item><item><title/><link>https://hive.apache.org/docs/latest/capture-lineage-info/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/capture-lineage-info/</guid><description>Capture Lineage Information In Hive Hooks Background In Hive, lineage information is captured in the form of LineageInfo object. This object is created in the Seman [...]
Existing Hooks org.apache.hadoop.hive.ql.hooks.PostExecutePrinter org.apache.hadoop.hive.ql.hooks.LineageLogger org.apache.atlas.hive.hook.HiveHook To facilitate the capture of lineage information in a custom hook or in a use case where the existing hooks are not set in hive.</description></item></channel></rss>
\ No newline at end of file
diff --git a/docs/latest/indexdev-bitmap_27362028/index.html b/docs/latest/indexdev-bitmap_27362028/index.html
index 0462362..ce8eec9 100644
--- a/docs/latest/indexdev-bitmap_27362028/index.html
+++ b/docs/latest/indexdev-bitmap_27362028/index.html
@@ -120,8 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--indexdev-bitmap>Apache Hive : IndexDev Bitmap</h1>
-<p>= Bitmap Indexing =</p>
+<h1 id=apache-hive--bitmap-indexing>Apache Hive : Bitmap Indexing</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--bitmap-indexing>Apache Hive : Bitmap Indexing</a>
<ul>
<li><a href=#introduction>Introduction</a></li>
<li><a href=#approach>Approach</a></li>
@@ -133,6 +136,10 @@ ASF
</li>
<li><a href=#example>Example</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=introduction>Introduction</h2>
<p>This document explains the proposed design for adding a bitmap index handler (<a href=https://issues.apache.org/jira/browse/HIVE-1803>https://issues.apache.org/jira/browse/HIVE-1803</a>).</p>
<p>Bitmap indexing (<a href=http://en.wikipedia.org/wiki/Bitmap_index>http://en.wikipedia.org/wiki/Bitmap_index</a>) is a standard technique for indexing columns with few distinct</p>
diff --git a/docs/latest/indexdev_27362104/index.html b/docs/latest/indexdev_27362104/index.html
index a3422cc..8c2eb66 100644
--- a/docs/latest/indexdev_27362104/index.html
+++ b/docs/latest/indexdev_27362104/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--indexdev>Apache Hive : IndexDev</h1>
-<h1 id=indexes>Indexes</h1>
+<h1 id=apache-hive--indexes>Apache Hive : Indexes</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#indexes>Indexes</a>
+<li><a href=#apache-hive--indexes>Apache Hive : Indexes</a>
<ul>
<li><a href=#indexing-is-removed-since-30>Indexing Is Removed since 3.0</a></li>
<li><a href=#introduction>Introduction</a></li>
@@ -140,6 +141,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=indexing-is-removed-since-30>Indexing Is Removed since 3.0</h2>
<p>There are alternate options which might work similarily to indexing:</p>
<ul>
diff --git a/docs/latest/jdbc-storage-handler_95651916/index.html b/docs/latest/jdbc-storage-handler_95651916/index.html
index 49cb77d..04abf83 100644
--- a/docs/latest/jdbc-storage-handler_95651916/index.html
+++ b/docs/latest/jdbc-storage-handler_95651916/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--jdbc-storage-handler>Apache Hive : JDBC Storage Handler</h1>
-<h1 id=heading></h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li></li>
+<li><a href=#apache-hive--jdbc-storage-handler>Apache Hive : JDBC Storage Handler</a></li>
<li><a href=#syntax>Syntax</a>
<ul>
<li><a href=#table-properties>Table Properties</a></li>
@@ -144,6 +145,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h1 id=syntax>Syntax</h1>
<p>JdbcStorageHandler supports reading from jdbc data source in Hive. Currently writing to a jdbc data source is not supported. To use JdbcStorageHandler, you need to create an external table using JdbcStorageHandler. Here is a simple example:</p>
<pre tabindex=0><code>CREATE EXTERNAL TABLE student_jdbc
diff --git a/docs/latest/kudu-integration_133631955/index.html b/docs/latest/kudu-integration_133631955/index.html
index 3504463..cf9cc78 100644
--- a/docs/latest/kudu-integration_133631955/index.html
+++ b/docs/latest/kudu-integration_133631955/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--kudu-integration>Apache Hive : Kudu Integration</h1>
-<h1 id=hive-kudu-integration>Hive Kudu Integration</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-kudu-integration>Hive Kudu Integration</a>
+<li><a href=#apache-hive--kudu-integration>Apache Hive : Kudu Integration</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#implementation>Implementation</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p><a href=https://kudu.apache.org>Apache Kudu</a> is a an Open Source data storage engine that makes fast analytics on fast and changing data easy. </p>
<h2 id=implementation>Implementation</h2>
diff --git a/docs/latest/languagemanual-archiving_27362031/index.html b/docs/latest/languagemanual-archiving_27362031/index.html
index a5d0dfc..a9e9c2c 100644
--- a/docs/latest/languagemanual-archiving_27362031/index.html
+++ b/docs/latest/languagemanual-archiving_27362031/index.html
@@ -121,10 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-archiving>Apache Hive : LanguageManual Archiving</h1>
-<h1 id=archiving-for-file-count-reduction>Archiving for File Count Reduction</h1>
-<p>Note: Archiving should be considered an advanced command due to the caveats involved.</p>
+<p>Archiving for File Count Reduction.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#archiving-for-file-count-reduction>Archiving for File Count Reduction</a>
+<li><a href=#apache-hive--languagemanual-archiving>Apache Hive : LanguageManual Archiving</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#settings>Settings</a></li>
@@ -139,10 +140,13 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p>Due to the design of HDFS, the number of files in the filesystem directly affects the memory consumption in the namenode. While normally not a problem for small clusters, memory usage may hit the limits of accessible memory on a single machine when there are >50-100 million files. In such situations, it is advantageous to have as few files as possible.</p>
<p>The use of <a href=http://hadoop.apache.org/docs/stable1/hadoop_archives.html>Hadoop Archives</a> is one approach to reducing the number of files in partitions. Hive has built-in support to convert files in existing partitions to a Hadoop Archive (HAR) so that a partition that may once have consisted of 100’s of files can occupy just ~3 files (depending on settings). However, the trade-off is that queries may be slower due to the additional overhead in reading from the HAR.</p>
-<p>Note that archiving does NOT compress the files – HAR is analogous to the Unix tar command.</p>
+<p>Note: Archiving does NOT compress the files – HAR is analogous to the Unix tar command.
+Note: Archiving should be considered an advanced command due to the caveats involved.</p>
<h2 id=settings>Settings</h2>
<p>There are 3 settings that should be configured before archiving is used. (Example values are shown.)</p>
<pre tabindex=0><code>hive> set hive.archive.enabled=true;
diff --git a/docs/latest/languagemanual-authorization_27362032/index.html b/docs/latest/languagemanual-authorization_27362032/index.html
index 88422cb..58c33f8 100644
--- a/docs/latest/languagemanual-authorization_27362032/index.html
+++ b/docs/latest/languagemanual-authorization_27362032/index.html
@@ -121,30 +121,26 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-authorization>Apache Hive : LanguageManual Authorization</h1>
-<p>Hive Authorization</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-authorization>Apache Hive : LanguageManual Authorization</a>
<ul>
<li><a href=#introduction>Introduction</a></li>
<li><a href=#hive-authorization-options>Hive Authorization Options</a>
<ul>
<li><a href=#use-cases>Use Cases</a></li>
-<li><a href=#overview-of-authorization-modes>Overview of Authorization Modes</a>
-<ul>
-<li><a href=#1-storage-based-authorization-in-the-metastore-server>1 Storage Based Authorization in the Metastore Server</a>
-<ul>
-<li><a href=#fall-back-authorizer>Fall Back Authorizer</a></li>
-</ul>
-</li>
-<li><a href=#2-sql-standards-based-authorization-in-hiveserver2>2 SQL Standards Based Authorization in HiveServer2</a></li>
-<li><a href=#3-authorization-using-apache-ranger--sentry>3 Authorization using Apache Ranger & Sentry</a></li>
-<li><a href=#4-old-default-hive-authorization-legacy-mode>4 Old default Hive Authorization (Legacy Mode)</a></li>
-</ul>
-</li>
+<li><a href=#overview-of-authorization-modes>Overview of Authorization Modes</a></li>
<li><a href=#addressing-authorization-needs-of-multiple-use-cases>Addressing Authorization Needs of Multiple Use Cases</a></li>
</ul>
</li>
<li><a href=#explain-authorization>Explain Authorization</a></li>
<li><a href=#more-information>More Information</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=introduction>Introduction</h2>
<p>Note that this documentation is referring to Authorization which is verifying if a user has permission to perform a certain action, and not about Authentication (verifying the identity of the user). Strong authentication for tools like the <a href=https://hive.apache.org/docs/latest/languagemanual-cli_27362033/>Hive command line</a> is provided through the use of Kerberos. There are additional authentication options for users of <a href=https://hive.apache.org/docs/latest/setting-up-h [...]
<h2 id=hive-authorization-options>Hive Authorization Options</h2>
diff --git a/docs/latest/languagemanual-cli_27362033/index.html b/docs/latest/languagemanual-cli_27362033/index.html
index c40c119..2fb6980 100644
--- a/docs/latest/languagemanual-cli_27362033/index.html
+++ b/docs/latest/languagemanual-cli_27362033/index.html
@@ -120,10 +120,12 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--languagemanual-cli>Apache Hive : LanguageManual Cli</h1>
-<h1 id=hive-cli>Hive CLI</h1>
+<h1 id=apache-hive--languagemanual-hive-cli>Apache Hive : LanguageManual Hive CLI</h1>
+<p>$HIVE_HOME/bin/hive is a shell utility which can be used to run Hive queries in either interactive or batch mode.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-cli>Hive CLI</a></li>
+<li><a href=#apache-hive--languagemanual-hive-cli>Apache Hive : LanguageManual Hive CLI</a></li>
<li><a href=#deprecation-in-favor-of-beeline-cli>Deprecation in favor of Beeline CLI</a>
<ul>
<li><a href=#hive-command-line-options>Hive Command Line Options</a>
@@ -144,7 +146,8 @@ ASF
</li>
<li><a href=#hcatalog-cli>HCatalog CLI</a></li>
</ul>
-<p>$HIVE_HOME/bin/hive is a shell utility which can be used to run Hive queries in either interactive or batch mode.</p>
+</nav>
+</aside>
<h1 id=deprecation-in-favor-of-beeline-cli>Deprecation in favor of Beeline CLI</h1>
<p>HiveServer2 (introduced in Hive 0.11) has its own CLI called <a href=#beeline>Beeline</a>, which is a JDBC client based on SQLLine. Due to new development being focused on HiveServer2, <a href=https://issues.apache.org/jira/browse/HIVE-10304>Hive CLI will soon be deprecated</a> in favor of Beeline (<a href=https://issues.apache.org/jira/browse/HIVE-10511>HIVE-10511</a>).</p>
<p>See <a href=https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/>Replacing the Implementation of Hive CLI Using Beeline</a> and <a href=#beeline-–-new-command-line-shell>Beeline – New Command Line Shell</a> in the HiveServer2 documentation.</p>
diff --git a/docs/latest/languagemanual-ddl_27362034/index.html b/docs/latest/languagemanual-ddl_27362034/index.html
index a174891..8104c8e 100644
--- a/docs/latest/languagemanual-ddl_27362034/index.html
+++ b/docs/latest/languagemanual-ddl_27362034/index.html
@@ -121,35 +121,114 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-ddl>Apache Hive : LanguageManual DDL</h1>
-<p>Hive Data Definition Language</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-ddl>Apache Hive : LanguageManual DDL</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#keywords-non-reserved-keywords-and-reserved-keywords>Keywords, Non-reserved Keywords and Reserved Keywords</a></li>
-<li><a href=#createdropalteruse-database>Create/Drop/Alter/Use Database</a></li>
-<li><a href=#createdropalter-connector>Create/Drop/Alter Connector</a></li>
-<li><a href=#createdroptruncate-table>Create/Drop/Truncate Table</a></li>
-<li><a href=#alter-tablepartitioncolumn>Alter Table/Partition/Column</a></li>
-<li><a href=#createdropalter-view>Create/Drop/Alter View</a></li>
-<li><a href=#createdropalter-materialized-view>Create/Drop/Alter Materialized View</a></li>
-<li><a href=#create/drop/alter-index>Create/Drop/Alter Index</a></li>
-<li><a href=#createdrop-macro>Create/Drop Macro</a></li>
-<li><a href=#createdropreload-function>Create/Drop/Reload Function</a></li>
+<li><a href=#createdropalteruse-database>Create/Drop/Alter/Use Database</a>
+<ul>
+<li><a href=#create-database>Create Database</a></li>
+<li><a href=#drop-database>Drop Database</a></li>
+<li><a href=#alter-database>Alter Database</a></li>
+<li><a href=#use-database>Use Database</a></li>
+</ul>
+</li>
+<li><a href=#createdropalter-connector>Create/Drop/Alter Connector</a>
+<ul>
+<li><a href=#create-connector>Create Connector</a></li>
+<li><a href=#drop-connector>Drop Connector</a></li>
+<li><a href=#alter-connector>Alter Connector</a></li>
+</ul>
+</li>
+<li><a href=#createdroptruncate-table>Create/Drop/Truncate Table</a>
+<ul>
+<li><a href=#create-table>Create Table</a></li>
+<li><a href=#drop-table>Drop Table</a></li>
+<li><a href=#truncate-table>Truncate Table</a></li>
+</ul>
+</li>
+<li><a href=#alter-tablepartitioncolumn>Alter Table/Partition/Column</a>
+<ul>
+<li><a href=#alter-table>Alter Table</a></li>
+<li><a href=#alter-partition>Alter Partition</a></li>
+<li><a href=#alter-either-table-or-partition>Alter Either Table or Partition</a></li>
+<li><a href=#alter-column>Alter Column</a></li>
+</ul>
+</li>
+<li><a href=#createdropalter-view>Create/Drop/Alter View</a>
+<ul>
+<li><a href=#create-view>Create View</a></li>
+<li><a href=#drop-view>Drop View</a></li>
+<li><a href=#alter-view-properties>Alter View Properties</a></li>
+<li><a href=#alter-view-as-select>Alter View As Select</a></li>
+</ul>
+</li>
+<li><a href=#createdropalter-materialized-view>Create/Drop/Alter Materialized View</a>
+<ul>
+<li><a href=#create-materialized-view>Create Materialized View</a></li>
+<li><a href=#drop-materialized-view>Drop Materialized View</a></li>
+<li><a href=#alter-materialized-view>Alter Materialized View</a></li>
+</ul>
+</li>
+<li><a href=#createdropalterindex>Create/Drop/Alter Index</a>
+<ul>
+<li><a href=#create-index>Create Index</a></li>
+<li><a href=#drop-index>Drop Index</a></li>
+<li><a href=#alter-index>Alter Index</a></li>
+</ul>
+</li>
+<li><a href=#createdrop-macro>Create/Drop Macro</a>
+<ul>
+<li><a href=#create-temporary-macro>Create Temporary Macro</a></li>
+<li><a href=#drop-temporary-macro>Drop Temporary Macro</a></li>
+</ul>
+</li>
+<li><a href=#createdropreload-function>Create/Drop/Reload Function</a>
+<ul>
+<li><a href=#temporary-functions>Temporary Functions</a></li>
+<li><a href=#permanent-functions>Permanent Functions</a></li>
+</ul>
+</li>
<li><a href=#createdropgrantrevoke-roles-and-privileges>Create/Drop/Grant/Revoke Roles and Privileges</a></li>
-<li><a href=#show>Show</a></li>
-<li><a href=#describe>Describe</a></li>
-<li><a href=#abort>Abort</a></li>
+<li><a href=#show>Show</a>
+<ul>
+<li><a href=#show-databases>Show Databases</a></li>
+<li><a href=#show-connectors>Show Connectors</a></li>
+<li><a href=#show-tablesviewsmaterialized-viewspartitionsindexes>Show Tables/Views/Materialized Views/Partitions/Indexes</a></li>
+<li><a href=#show-columns>Show Columns</a></li>
+<li><a href=#show-functions>Show Functions</a></li>
+<li><a href=#show-granted-roles-and-privileges>Show Granted Roles and Privileges</a></li>
+<li><a href=#show-locks>Show Locks</a></li>
+<li><a href=#show-conf>Show Conf</a></li>
+<li><a href=#show-transactions>Show Transactions</a></li>
+<li><a href=#show-compactions>Show Compactions</a></li>
</ul>
+</li>
+<li><a href=#describe>Describe</a>
<ul>
-<li>
-<p><a href=#scheduled-queries>Scheduled queries</a></p>
+<li><a href=#describe-database>Describe Database</a></li>
+<li><a href=#describe-dataconnector>Describe Dataconnector</a></li>
+<li><a href=#describe-tableviewmaterialized-viewcolumn>Describe Table/View/Materialized View/Column</a></li>
+<li><a href=#describe-partition>Describe Partition</a></li>
+<li><a href=#hive-20-syntax-change>Hive 2.0+: Syntax Change</a></li>
+</ul>
</li>
-<li>
-<p><a href=#datasketches-integration>Datasketches integration</a></p>
+<li><a href=#abort>Abort</a>
+<ul>
+<li><a href=#abort-transactions>Abort Transactions</a></li>
+</ul>
</li>
-<li>
-<p><a href=#hcatalog-and-webhcat-ddl>HCatalog and WebHCat DDL</a></p>
+</ul>
</li>
+<li><a href=#scheduled-queries>Scheduled queries</a></li>
+<li><a href=#datasketches-integration>Datasketches integration</a></li>
+<li><a href=#hcatalog-and-webhcat-ddl>HCatalog and WebHCat DDL</a></li>
</ul>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p>HiveQL DDL statements are documented here, including:</p>
<ul>
@@ -545,9 +624,9 @@ STORED AS SEQUENCEFILE;
</code></pre><p>The above statement lets you create the same table as the previous table.</p>
<p>In the previous examples the data is stored in <hive.metastore.warehouse.dir>/page_view. Specify a value for the key <code>[hive.metastore.warehouse.dir](#hive-metastore-warehouse-dir)</code> in the Hive config file hive-site.xml.</p>
<h4 id=external-tables>External Tables</h4>
-<p>The EXTERNAL keyword lets you create a table and provide a LOCATION so that Hive does not use a default location for this table. This comes in handy if you already have data generated. When dropping an EXTERNAL table, data in the table is <em>NOT</em> deleted from the file system. Starting Hive 4.0.0 (</p>
-<h2 id=httpsissuesapacheorgjirasecureviewavatarsizexsmallavatarid21146avatartypeissuetypehive-19981httpsissuesapacheorgjirabrowsehive-19981srcconfmacro><a href="https://issues.apache.org/jira/browse/HIVE-19981?src=confmacro"><img src="https://issues.apache.org/jira/secure/viewavatar?size=xsmall&avatarId=21146&avatarType=issuetype" alt>HIVE-19981</a></h2>
-<p>Managed tables converted to external tables by the HiveStrictManagedMigration utility should be set to delete data when the table is dropped
+<p>The EXTERNAL keyword lets you create a table and provide a LOCATION so that Hive does not use a default location for this table. This comes in handy if you already have data generated. When dropping an EXTERNAL table, data in the table is <em>NOT</em> deleted from the file system. Starting Hive 4.0.0 (
+<a href=https://issues.apache.org/jira/browse/HIVE-19981>HIVE-19981</a>)
+Managed tables converted to external tables by the HiveStrictManagedMigration utility should be set to delete data when the table is dropped
Closed</p>
<p> ) setting table property external.table.purge=true, will also delete the data.</p>
<p>An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property <code>[hive.metastore.warehouse.dir](#hive-metastore-warehouse-dir)</code>.</p>
@@ -674,9 +753,9 @@ create table constraints3(id1 integer, id2 integer,
<pre tabindex=0><code>DROP TABLE [IF EXISTS] table_name [PURGE]; -- (Note: PURGE available in Hive 0.14.0 and later)
</code></pre><p>DROP TABLE removes metadata and data for this table. The data is actually moved to the .Trash/Current directory if Trash is configured (and PURGE is not specified). The metadata is completely lost.</p>
-<p>When dropping an EXTERNAL table, data in the table will <em>NOT</em> be deleted from the file system. Starting Hive 4.0.0 (</p>
-<h2 id=httpsissuesapacheorgjirasecureviewavatarsizexsmallavatarid21146avatartypeissuetypehive-19981httpsissuesapacheorgjirabrowsehive-19981srcconfmacro-1><a href="https://issues.apache.org/jira/browse/HIVE-19981?src=confmacro"><img src="https://issues.apache.org/jira/secure/viewavatar?size=xsmall&avatarId=21146&avatarType=issuetype" alt>HIVE-19981</a></h2>
-<p>Managed tables converted to external tables by the HiveStrictManagedMigration utility should be set to delete data when the table is dropped
+<p>When dropping an EXTERNAL table, data in the table will <em>NOT</em> be deleted from the file system. Starting Hive 4.0.0 (
+<a href=https://issues.apache.org/jira/browse/HIVE-19981>HIVE-19981</a>)
+Managed tables converted to external tables by the HiveStrictManagedMigration utility should be set to delete data when the table is dropped
Closed</p>
<p> ) setting table property external.table.purge=true, will also delete the data.</p>
<p>When dropping a table referenced by views, no warning is given (the views are left dangling as invalid and must be dropped or recreated by the user).</p>
diff --git a/docs/latest/languagemanual-dml_27362036/index.html b/docs/latest/languagemanual-dml_27362036/index.html
index 5b173fe..0b85369 100644
--- a/docs/latest/languagemanual-dml_27362036/index.html
+++ b/docs/latest/languagemanual-dml_27362036/index.html
@@ -122,84 +122,28 @@ ASF
<div class=docs>
<h1 id=apache-hive--languagemanual-dml>Apache Hive : LanguageManual DML</h1>
<h1 id=hive-data-manipulation-language>Hive Data Manipulation Language</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--languagemanual-dml>Apache Hive : LanguageManual DML</a></li>
<li><a href=#hive-data-manipulation-language>Hive Data Manipulation Language</a>
<ul>
-<li><a href=#loading-files-into-tables>Loading files into tables</a>
-<ul>
-<li><a href=#syntax>Syntax</a></li>
-<li><a href=#synopsis>Synopsis</a></li>
-<li><a href=#notes>Notes</a></li>
-</ul>
-</li>
-<li><a href=#inserting-data-into-hive-tables-from-queries>Inserting data into Hive Tables from queries</a>
-<ul>
-<li><a href=#syntax>Syntax</a></li>
-<li><a href=#synopsis>Synopsis</a></li>
-<li><a href=#notes>Notes</a></li>
-<li><a href=#dynamic-partition-inserts>Dynamic Partition Inserts</a>
-<ul>
-<li><a href=#example>Example</a></li>
-<li><a href=#additional-documentation>Additional Documentation</a></li>
-</ul>
-</li>
-</ul>
-</li>
-<li><a href=#writing-data-into-the-filesystem-from-queries>Writing data into the filesystem from queries</a>
-<ul>
-<li><a href=#syntax>Syntax</a></li>
-<li><a href=#synopsis>Synopsis</a></li>
-<li><a href=#notes>Notes</a></li>
-</ul>
-</li>
-<li><a href=#inserting-values-into-tables-from-sql>Inserting values into tables from SQL</a>
-<ul>
-<li><a href=#syntax>Syntax</a></li>
-<li><a href=#synopsis>Synopsis</a></li>
-<li><a href=#examples>Examples</a></li>
-</ul>
-</li>
-<li><a href=#update>Update</a>
-<ul>
-<li><a href=#syntax>Syntax</a></li>
-<li><a href=#synopsis>Synopsis</a></li>
-<li><a href=#notes>Notes</a></li>
-</ul>
-</li>
-<li><a href=#delete>Delete</a>
-<ul>
-<li><a href=#syntax>Syntax</a></li>
-<li><a href=#synopsis>Synopsis</a></li>
-<li><a href=#notes>Notes</a></li>
-</ul>
-</li>
-<li><a href=#merge>Merge</a>
+<li>
<ul>
-<li><a href=#syntax>Syntax</a></li>
-<li><a href=#synopsis>Synopsis</a></li>
-<li><a href=#performance-note>Performance Note</a></li>
-<li><a href=#notes>Notes</a></li>
-<li><a href=#examples>Examples</a></li>
+<li><a href=#loading-files-into-tables>Loading files into tables</a></li>
+<li><a href=#inserting-data-into-hive-tables-from-queries>Inserting data into Hive Tables from queries</a></li>
+<li><a href=#writing-data-into-the-filesystem-from-queries>Writing data into the filesystem from queries</a></li>
+<li><a href=#inserting-values-into-tables-from-sql>Inserting values into tables from SQL</a></li>
+<li><a href=#update>Update</a></li>
+<li><a href=#delete>Delete</a></li>
+<li><a href=#merge>Merge</a></li>
</ul>
</li>
</ul>
</li>
</ul>
-<p>There are multiple ways to modify data in Hive:</p>
-<ul>
-<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=82903069#LanguageManualDML-Loadingfilesintotables">LOAD</a></li>
-<li>INSERT
-<ul>
-<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=82903069#LanguageManualDML-InsertingdataintoHiveTablesfromqueries">into Hive tables from queries</a></li>
-<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=82903069#LanguageManualDML-Writingdataintothefilesystemfromqueries">into directories from queries</a></li>
-<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=82903069#LanguageManualDML-InsertingintotablesfromSQL">into Hive tables from SQL</a></li>
-</ul>
-</li>
-<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=82903069#LanguageManualDML-Update">UPDATE</a></li>
-<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=82903069#LanguageManualDML-Delete">DELETE</a></li>
-<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=82903069#LanguageManualDML-Merge">MERGE</a></li>
-</ul>
-<p><a href=https://hive.apache.org/docs/latest/languagemanual-importexport_27837968/>EXPORT and IMPORT</a> commands are also available (as of <a href=https://issues.apache.org/jira/browse/HIVE-1918>Hive 0.8</a>).</p>
+</nav>
+</aside>
<h3 id=loading-files-into-tables>Loading files into tables</h3>
<p>Hive does not do any transformation while loading data into tables. Load operations are currently pure copy/move operations that move datafiles into locations corresponding to Hive tables.</p>
<h5 id=syntax>Syntax</h5>
diff --git a/docs/latest/languagemanual-explain_27362037/index.html b/docs/latest/languagemanual-explain_27362037/index.html
index a32f7e9..ffb5572 100644
--- a/docs/latest/languagemanual-explain_27362037/index.html
+++ b/docs/latest/languagemanual-explain_27362037/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-explain>Apache Hive : LanguageManual Explain</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-explain>Apache Hive : LanguageManual Explain</a>
<ul>
<li><a href=#explain-syntax>EXPLAIN Syntax</a>
<ul>
@@ -136,6 +140,10 @@ ASF
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=explain-syntax>EXPLAIN Syntax</h2>
<p>Hive provides an <code>EXPLAIN</code> command that shows the execution plan for a query. The syntax for this statement is as follows:</p>
<pre tabindex=0><code>EXPLAIN [EXTENDED|CBO|AST|DEPENDENCY|AUTHORIZATION|LOCKS|VECTORIZATION|ANALYZE] query
diff --git a/docs/latest/languagemanual-groupby_27362038/index.html b/docs/latest/languagemanual-groupby_27362038/index.html
index 0ee733f..cfbfa9c 100644
--- a/docs/latest/languagemanual-groupby_27362038/index.html
+++ b/docs/latest/languagemanual-groupby_27362038/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-groupby>Apache Hive : LanguageManual GroupBy</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-groupby>Apache Hive : LanguageManual GroupBy</a>
<ul>
<li><a href=#group-by-syntax>Group By Syntax</a>
<ul>
@@ -136,6 +140,10 @@ ASF
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=group-by-syntax>Group By Syntax</h2>
<pre tabindex=0><code>groupByClause: GROUP BY groupByExpression (, groupByExpression)*
diff --git a/docs/latest/languagemanual-importexport_27837968/index.html b/docs/latest/languagemanual-importexport_27837968/index.html
index 72331c8..aa53df7 100644
--- a/docs/latest/languagemanual-importexport_27837968/index.html
+++ b/docs/latest/languagemanual-importexport_27837968/index.html
@@ -120,11 +120,15 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--languagemanual-importexport>Apache Hive : LanguageManual ImportExport</h1>
-<h1 id=importexport>Import/Export</h1>
+<h1 id=apache-hive--languagemanual-importexport>Apache Hive : LanguageManual Import/Export</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#importexport>Import/Export</a>
+<li><a href=#apache-hive--languagemanual-importexport>Apache Hive : LanguageManual Import/Export</a>
<ul>
+<li>
+<ul>
+<li><a href=#version-information>Version information</a></li>
<li><a href=#overview>Overview</a></li>
<li><a href=#export-syntax>Export Syntax</a></li>
<li><a href=#import-syntax>Import Syntax</a></li>
@@ -133,7 +137,11 @@ ASF
</ul>
</li>
</ul>
-<p>Version</p>
+</li>
+</ul>
+</nav>
+</aside>
+<h3 id=version-information>Version information</h3>
<p>The <code>EXPORT</code> and <code>IMPORT</code> commands were added in Hive 0.8.0 (see <a href=https://issues.apache.org/jira/browse/HIVE-1918>HIVE-1918</a>).</p>
<p>Replication extensions to the <code>EXPORT</code> and <code>IMPORT</code> commands were added in Hive 1.2.0 (see <a href=https://issues.apache.org/jira/browse/HIVE-7973>HIVE-7973</a> and <a href=https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/>Hive Replication Development</a>).</p>
<h3 id=overview>Overview</h3>
diff --git a/docs/latest/languagemanual-indexing_31822176/index.html b/docs/latest/languagemanual-indexing_31822176/index.html
index c1d775d..ac96491 100644
--- a/docs/latest/languagemanual-indexing_31822176/index.html
+++ b/docs/latest/languagemanual-indexing_31822176/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-indexing>Apache Hive : LanguageManual Indexing</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-indexing>Apache Hive : LanguageManual Indexing</a>
<ul>
<li><a href=#indexing-is-removed-since-30>Indexing Is Removed since 3.0</a></li>
<li><a href=#overview-of-hive-indexes>Overview of Hive Indexes</a></li>
@@ -131,6 +135,10 @@ ASF
</li>
<li><a href=#simple-examples>Simple Examples</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=indexing-is-removed-since-30>Indexing Is Removed since 3.0</h2>
<p>There are alternate options which might work similarily to indexing:</p>
<ul>
diff --git a/docs/latest/languagemanual-joinoptimization_33293167/index.html b/docs/latest/languagemanual-joinoptimization_33293167/index.html
index 3d4b78d..df4a1e1 100644
--- a/docs/latest/languagemanual-joinoptimization_33293167/index.html
+++ b/docs/latest/languagemanual-joinoptimization_33293167/index.html
@@ -120,53 +120,25 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--languagemanual-joinoptimization>Apache Hive : LanguageManual JoinOptimization</h1>
-<h1 id=join-optimization>Join Optimization</h1>
+<h1 id=apache-hive--languagemanual-join-optimization>Apache Hive : LanguageManual Join Optimization</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#join-optimization>Join Optimization</a>
+<li><a href=#apache-hive--languagemanual-join-optimization>Apache Hive : LanguageManual Join Optimization</a>
<ul>
<li><a href=#improvements-to-the-hive-optimizer>Improvements to the Hive Optimizer</a></li>
<li><a href=#star-join-optimization>Star Join Optimization</a>
<ul>
<li><a href=#star-schema-example>Star Schema Example</a></li>
-<li><a href=#prior-support-for-mapjoin>Prior Support for MAPJOIN</a>
-<ul>
-<li><a href=#limitations-of-prior-implementation>Limitations of Prior Implementation</a></li>
-</ul>
-</li>
-<li><a href=#enhancements-for-star-joins>Enhancements for Star Joins</a>
-<ul>
-<li>
-<p><a href=#optimize-chains-of-map-joins>Optimize Chains of Map Joins</a></p>
-<ul>
-<li><a href=#current-and-future-optimizations>Current and Future Optimizations</a></li>
-</ul>
-</li>
-<li>
-<p><a href=#optimize-auto-join-conversion>Optimize Auto Join Conversion</a></p>
-<pre><code> - [Current Optimization](#current-optimization)+ [Auto Conversion to SMB Map Join](#auto-conversion-to-smb-map-join)
- - [SMB Join across Tables with Different Keys](#smb-join-across-tables-with-different-keys)
-</code></pre>
-</li>
-<li>
-<p><a href=#generate-hash-tables-on-the-task-side>Generate Hash Tables on the Task Side</a></p>
-<ul>
-<li><a href=#pros-and-cons-of-client-side-hash-tables>Pros and Cons of Client-Side Hash Tables</a></li>
-<li><a href=#task-side-generation-of-hash-tables>Task-Side Generation of Hash Tables</a>
-<ul>
-<li><a href=#further-options-for-optimization>Further Options for Optimization</a></li>
-</ul>
-</li>
+<li><a href=#prior-support-for-mapjoin>Prior Support for MAPJOIN</a></li>
+<li><a href=#enhancements-for-star-joins>Enhancements for Star Joins</a></li>
</ul>
</li>
</ul>
</li>
</ul>
-</li>
-</ul>
-</li>
-</ul>
-<p>For a general discussion of Hive joins including syntax, examples, and restrictions, see the <a href=https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Joins>Joins</a> wiki doc.</p>
+</nav>
+</aside>
<h2 id=improvements-to-the-hive-optimizer>Improvements to the Hive Optimizer</h2>
<p>Version</p>
<p>The join optimizations described here were added in Hive version 0.11.0. See <a href=https://issues.apache.org/jira/browse/HIVE-3784>HIVE-3784</a> and related JIRAs.</p>
diff --git a/docs/latest/languagemanual-joins_27362039/index.html b/docs/latest/languagemanual-joins_27362039/index.html
index 8ae87a7..026ba52 100644
--- a/docs/latest/languagemanual-joins_27362039/index.html
+++ b/docs/latest/languagemanual-joins_27362039/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-joins>Apache Hive : LanguageManual Joins</h1>
-<h1 id=hive-joins>Hive Joins</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-joins>Hive Joins</a>
+<li><a href=#apache-hive--languagemanual-joins>Apache Hive : LanguageManual Joins</a>
<ul>
<li><a href=#join-syntax>Join Syntax</a></li>
<li><a href=#examples>Examples</a></li>
@@ -137,6 +138,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=join-syntax>Join Syntax</h2>
<p>Hive supports the following syntax for joining tables:</p>
<pre tabindex=0><code>join_table:
diff --git a/docs/latest/languagemanual-lateralview_27362040/index.html b/docs/latest/languagemanual-lateralview_27362040/index.html
index 7788dc6..1e53316 100644
--- a/docs/latest/languagemanual-lateralview_27362040/index.html
+++ b/docs/latest/languagemanual-lateralview_27362040/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-lateralview>Apache Hive : LanguageManual LateralView</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-lateralview>Apache Hive : LanguageManual LateralView</a>
<ul>
<li><a href=#lateral-view-syntax>Lateral View Syntax</a></li>
<li><a href=#description>Description</a></li>
@@ -128,6 +132,10 @@ ASF
<li><a href=#multiple-lateral-views>Multiple Lateral Views</a></li>
<li><a href=#outer-lateral-views>Outer Lateral Views</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=lateral-view-syntax>Lateral View Syntax</h2>
<pre tabindex=0><code>lateralView: LATERAL VIEW udtf(expression) tableAlias AS columnAlias (',' columnAlias)*
fromClause: FROM baseTable (lateralView)*
diff --git a/docs/latest/languagemanual-lzo_33298193/index.html b/docs/latest/languagemanual-lzo_33298193/index.html
index bd7aa77..57b1ed5 100644
--- a/docs/latest/languagemanual-lzo_33298193/index.html
+++ b/docs/latest/languagemanual-lzo_33298193/index.html
@@ -120,16 +120,17 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--languagemanual-lzo>Apache Hive : LanguageManual LZO</h1>
-<h1 id=lzo-compression>LZO Compression</h1>
+<h1 id=apache-hive--languagemanual-lzo-compression>Apache Hive : LanguageManual LZO Compression</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#lzo-compression>LZO Compression</a>
+<li><a href=#apache-hive--languagemanual-lzo-compression>Apache Hive : LanguageManual LZO Compression</a>
<ul>
<li><a href=#general-lzo-concepts>General LZO Concepts</a></li>
<li><a href=#prerequisites>Prerequisites</a>
<ul>
<li><a href=#lzolzop-installations>Lzo/Lzop Installations</a></li>
-<li><a href=#core-site-xml>core-site.xml</a></li>
+<li><a href=#core-sitexml><code>core-site.xml</code></a></li>
<li><a href=#table-definition>Table Definition</a></li>
</ul>
</li>
@@ -142,6 +143,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=general-lzo-concepts>General LZO Concepts</h2>
<p>LZO is a lossless data compression library that favors speed over compression ratio. See <a href=http://www.oberhumer.com/opensource/lzo>http://www.oberhumer.com/opensource/lzo</a> and <a href=http://www.lzop.org>http://www.lzop.org</a> for general information about LZO and see <a href=https://hive.apache.org/docs/latest/compressedstorage_27362073/>Compressed Data Storage</a> for information about compression in Hive.</p>
<p>Imagine a simple data file that has three columns</p>
diff --git a/docs/latest/languagemanual-orc_31818911/index.html b/docs/latest/languagemanual-orc_31818911/index.html
index ebcc5a4..cedb2a3 100644
--- a/docs/latest/languagemanual-orc_31818911/index.html
+++ b/docs/latest/languagemanual-orc_31818911/index.html
@@ -121,8 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-orc>Apache Hive : LanguageManual ORC</h1>
-<h1 id=orc-files>ORC Files</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--languagemanual-orc>Apache Hive : LanguageManual ORC</a></li>
<li><a href=#orc-files>ORC Files</a>
<ul>
<li><a href=#orc-file-format>ORC File Format</a>
@@ -143,8 +145,15 @@ ASF
<li><a href=#orc-configuration-parameters>ORC Configuration Parameters</a></li>
</ul>
</li>
-<li><a href=#orc-format-specification>ORC Format Specification</a></li>
+<li><a href=#orc-format-specification>ORC Format Specification</a>
+<ul>
+<li><a href=#attachments>Attachments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
+<h1 id=orc-files>ORC Files</h1>
<h2 id=orc-file-format>ORC File Format</h2>
<p>Version</p>
<p>Introduced in Hive version <a href=https://issues.apache.org/jira/browse/HIVE-3874>0.11.0</a>.</p>
diff --git a/docs/latest/languagemanual-sampling_27362042/index.html b/docs/latest/languagemanual-sampling_27362042/index.html
index 8b435c1..e245ede 100644
--- a/docs/latest/languagemanual-sampling_27362042/index.html
+++ b/docs/latest/languagemanual-sampling_27362042/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-sampling>Apache Hive : LanguageManual Sampling</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-sampling>Apache Hive : LanguageManual Sampling</a>
<ul>
<li><a href=#sampling-syntax>Sampling Syntax</a>
<ul>
@@ -129,6 +133,10 @@ ASF
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=sampling-syntax>Sampling Syntax</h2>
<h3 id=sampling-bucketized-table>Sampling Bucketized Table</h3>
<pre tabindex=0><code>
diff --git a/docs/latest/languagemanual-select_27362043/index.html b/docs/latest/languagemanual-select_27362043/index.html
index 31796e1..1a5e591 100644
--- a/docs/latest/languagemanual-select_27362043/index.html
+++ b/docs/latest/languagemanual-select_27362043/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-select>Apache Hive : LanguageManual Select</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-select>Apache Hive : LanguageManual Select</a>
<ul>
<li><a href=#select-syntax>Select Syntax</a>
<ul>
@@ -134,7 +138,10 @@ ASF
</ul>
</li>
</ul>
-<p><a href=https://hive.apache.org/docs/latest/languagemanual-groupby_27362038/>GROUP BY</a>; <a href=https://hive.apache.org/docs/latest/languagemanual-sortby_27362045/>SORT/ORDER/CLUSTER/DISTRIBUTE BY</a>; <a href=https://hive.apache.org/docs/latest/languagemanual-joins_27362039/>JOIN</a> (<a href=https://hive.apache.org/docs/latest/languagemanual-joins_27362039/>Hive Joins</a>, <a href=https://hive.apache.org/docs/latest/languagemanual-joinoptimization_33293167/>Join Optimization</a>, [...]
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=select-syntax>Select Syntax</h2>
<pre tabindex=0><code>[WITH CommonTableExpression (, CommonTableExpression)*] (Note: Only available starting with Hive 0.13.0)
SELECT [ALL | DISTINCT] select_expr, select_expr, ...
diff --git a/docs/latest/languagemanual-sortby_27362045/index.html b/docs/latest/languagemanual-sortby_27362045/index.html
index 8d9f7cd..0545a63 100644
--- a/docs/latest/languagemanual-sortby_27362045/index.html
+++ b/docs/latest/languagemanual-sortby_27362045/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-sortby>Apache Hive : LanguageManual SortBy</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--languagemanual-sortby>Apache Hive : LanguageManual SortBy</a></li>
<li><a href=#order-sort-cluster-and-distribute-by>Order, Sort, Cluster, and Distribute By</a>
<ul>
<li><a href=#syntax-of-order-by>Syntax of Order By</a></li>
@@ -135,6 +138,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h1 id=order-sort-cluster-and-distribute-by>Order, Sort, Cluster, and Distribute By</h1>
<p>This describes the syntax of SELECT clauses ORDER BY, SORT BY, CLUSTER BY, and DISTRIBUTE BY. See <a href=#select-syntax>Select Syntax</a> for general information.</p>
<h2 id=syntax-of-order-by>Syntax of Order By</h2>
diff --git a/docs/latest/languagemanual-subqueries_27362044/index.html b/docs/latest/languagemanual-subqueries_27362044/index.html
index f61e150..8c25c05 100644
--- a/docs/latest/languagemanual-subqueries_27362044/index.html
+++ b/docs/latest/languagemanual-subqueries_27362044/index.html
@@ -121,10 +121,15 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-subqueries>Apache Hive : LanguageManual SubQueries</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--languagemanual-subqueries>Apache Hive : LanguageManual SubQueries</a></li>
<li><a href=#subqueries-in-the-from-clause>Subqueries in the FROM Clause</a></li>
<li><a href=#subqueries-in-the-where-clause>Subqueries in the WHERE Clause</a></li>
</ul>
+</nav>
+</aside>
<h1 id=subqueries-in-the-from-clause>Subqueries in the FROM Clause</h1>
<pre tabindex=0><code>SELECT ... FROM (subquery) name ...
SELECT ... FROM (subquery) AS name ... (Note: Only valid starting with Hive 0.13.0)
diff --git a/docs/latest/languagemanual-transform_27362047/index.html b/docs/latest/languagemanual-transform_27362047/index.html
index 2d8e75c..d154190 100644
--- a/docs/latest/languagemanual-transform_27362047/index.html
+++ b/docs/latest/languagemanual-transform_27362047/index.html
@@ -121,16 +121,23 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-transform>Apache Hive : LanguageManual Transform</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-transform>Apache Hive : LanguageManual Transform</a>
<ul>
<li><a href=#transformmap-reduce-syntax>Transform/Map-Reduce Syntax</a>
<ul>
-<li><a href=#sql-standard-based-authorization-disallows-transform>SQL Standard Based Authorization Disallows TRANSFORM</a></li>
-<li><a href=#transform-examples>TRANSFORM Examples</a></li>
+<li></li>
</ul>
</li>
<li><a href=#schema-less-map-reduce-scripts>Schema-less Map-reduce Scripts</a></li>
<li><a href=#typing-the-output-of-transform>Typing the output of TRANSFORM</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=transformmap-reduce-syntax>Transform/Map-Reduce Syntax</h2>
<p>Users can also plug in their own custom mappers and reducers in the data stream by using features natively supported in the Hive language. e.g. in order to run a custom mapper script - map_script - and a custom reducer script - reduce_script - the user can issue the following command which uses the TRANSFORM clause to embed the mapper and the reducer scripts.</p>
<p>By default, columns will be transformed to <em>STRING</em> and delimited by TAB before feeding to the user script; similarly, all NULL values will be converted to the literal string <strong>\N</strong> in order to differentiate NULL values from empty strings. The standard output of the user script will be treated as TAB-separated <em>STRING</em> columns, any cell containing only <strong>\N</strong> will be re-interpreted as a NULL, and then the resulting STRING column will be cast to [...]
diff --git a/docs/latest/languagemanual-types_27838462/index.html b/docs/latest/languagemanual-types_27838462/index.html
index 224e0b5..400a554 100644
--- a/docs/latest/languagemanual-types_27838462/index.html
+++ b/docs/latest/languagemanual-types_27838462/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--languagemanual-types>Apache Hive : LanguageManual Types</h1>
-<h1 id=hive-data-types>Hive Data Types</h1>
+<h1 id=apache-hive--languagemanual-data-types>Apache Hive : LanguageManual Data Types</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-data-types>Hive Data Types</a>
+<li><a href=#apache-hive--languagemanual-data-types>Apache Hive : LanguageManual Data Types</a>
<ul>
<li><a href=#overview>Overview</a>
<ul>
@@ -136,44 +137,20 @@ ASF
</li>
<li><a href=#column-types>Column Types</a>
<ul>
-<li><a href=#integral-types--tinyint,-smallint,-int/integer,-bigint->Integral Types (TINYINT, SMALLINT, INT/INTEGER, BIGINT)</a></li>
-<li></li>
+<li><a href=#integral-types-tinyintsmallintintintegerbigint>Integral Types (<code>TINYINT</code>, <code>SMALLINT</code>, <code>INT/INTEGER</code>, <code>BIGINT</code>)</a></li>
+<li><a href=#heading></a></li>
<li><a href=#strings>Strings</a></li>
<li><a href=#varchar>Varchar</a></li>
<li><a href=#char>Char</a></li>
-<li><a href=#timestamps>Timestamps</a>
-<ul>
-<li><a href=#casting-dates>Casting Dates</a></li>
-</ul>
-</li>
+<li><a href=#timestamps>Timestamps</a></li>
<li><a href=#intervals>Intervals</a></li>
-<li><a href=#decimals>Decimals</a>
-<ul>
-<li><a href=#decimal-literals>Decimal Literals</a></li>
-<li><a href=#decimal-type-incompatibilities-between-hive-0120-and-0130>Decimal Type Incompatibilities between Hive 0.12.0 and 0.13.0</a>
-<ul>
-<li><a href=#upgrading-pre-hive-0130-decimal-columns>Upgrading Pre-Hive 0.13.0 Decimal Columns</a></li>
-</ul>
-</li>
-</ul>
-</li>
+<li><a href=#decimals>Decimals</a></li>
<li><a href=#union-types>Union Types</a></li>
</ul>
</li>
<li><a href=#literals>Literals</a>
<ul>
-<li><a href=#floating-point-types>Floating Point Types</a>
-<ul>
-<li><a href=#decimal-types>Decimal Types</a>
-<ul>
-<li><a href=#using-decimal-types>Using Decimal Types</a></li>
-<li><a href=#mathematical-udfs>Mathematical UDFs</a></li>
-<li><a href=#casting-decimal-values>Casting Decimal Values</a></li>
-<li><a href=#testing-decimal-types>Testing Decimal Types</a></li>
-</ul>
-</li>
-</ul>
-</li>
+<li><a href=#floating-point-types>Floating Point Types</a></li>
</ul>
</li>
<li><a href=#handling-of-null-values>Handling of NULL Values</a></li>
@@ -182,6 +159,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p>This lists all supported data types in Hive. See <a href=#type-system>Type System</a> in the <a href=https://hive.apache.org/docs/latest/tutorial_27362061/>Tutorial</a> for additional information.</p>
<p>For data types supported by HCatalog, see:</p>
diff --git a/docs/latest/languagemanual-udf_27362046/index.html b/docs/latest/languagemanual-udf_27362046/index.html
index c214a28..b9ee9e8 100644
--- a/docs/latest/languagemanual-udf_27362046/index.html
+++ b/docs/latest/languagemanual-udf_27362046/index.html
@@ -120,11 +120,13 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--languagemanual-udf>Apache Hive : LanguageManual UDF</h1>
-<h1 id=hive-operators-and-user-defined-functions-udfs>Hive Operators and User-Defined Functions (UDFs)</h1>
+<h1 id=apache-hive--languagemanual-operators-and-user-defined-functions>Apache Hive : LanguageManual Operators and User-Defined Functions</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-operators-and-user-defined-functions-udfs>Hive Operators and User-Defined Functions (UDFs)</a>
+<li><a href=#apache-hive--languagemanual-operators-and-user-defined-functions>Apache Hive : LanguageManual Operators and User-Defined Functions</a>
<ul>
+<li><a href=#overview>Overview</a></li>
<li><a href=#built-in-operators>Built-in Operators</a>
<ul>
<li><a href=#operators-precedences>Operators Precedences</a></li>
@@ -138,37 +140,20 @@ ASF
</li>
<li><a href=#built-in-functions>Built-in Functions</a>
<ul>
-<li><a href=#mathematical-functions>Mathematical Functions</a>
-<ul>
-<li><a href=#mathematical-functions-and-operators-for-decimal-datatypes>Mathematical Functions and Operators for Decimal Datatypes</a></li>
-</ul>
-</li>
+<li><a href=#mathematical-functions>Mathematical Functions</a></li>
<li><a href=#collection-functions>Collection Functions</a></li>
<li><a href=#type-conversion-functions>Type Conversion Functions</a></li>
<li><a href=#date-functions>Date Functions</a></li>
<li><a href=#conditional-functions>Conditional Functions</a></li>
<li><a href=#string-functions>String Functions</a></li>
<li><a href=#data-masking-functions>Data Masking Functions</a></li>
-<li><a href=#misc-functions>Misc. Functions</a>
-<ul>
-<li><a href=#xpath>xpath</a></li>
-<li><a href=#get_json_object>get_json_object</a></li>
-</ul>
-</li>
+<li><a href=#misc-functions>Misc. Functions</a></li>
</ul>
</li>
<li><a href=#built-in-aggregate-functions-udaf>Built-in Aggregate Functions (UDAF)</a></li>
<li><a href=#built-in-table-generating-functions-udtf>Built-in Table-Generating Functions (UDTF)</a>
<ul>
-<li><a href=#usage-examples>Usage Examples</a>
-<ul>
-<li><a href=#explode--array->explode (array)</a></li>
-<li><a href=#explode--map->explode (map)</a></li>
-<li><a href=#posexplode--array->posexplode (array)</a></li>
-<li><a href=#inline--array-of-structs->inline (array of structs)</a></li>
-<li><a href=#stack--values->stack (values)</a></li>
-</ul>
-</li>
+<li><a href=#usage-examples>Usage Examples</a></li>
<li><a href=#explode>explode</a></li>
<li><a href=#posexplode>posexplode</a></li>
<li><a href=#json_tuple>json_tuple</a></li>
@@ -179,10 +164,13 @@ ASF
<li><a href=#utility-functions>Utility Functions</a></li>
<li><a href=#udf-internals>UDF internals</a></li>
<li><a href=#creating-custom-udfs>Creating Custom UDFs</a></li>
+<li><a href=#attachments>Attachments:</a></li>
</ul>
</li>
</ul>
-<p>Case-insensitive</p>
+</nav>
+</aside>
+<h2 id=overview>Overview</h2>
<p>All Hive keywords are case-insensitive, including the names of Hive operators and functions.</p>
<p>In <a href=#beeline>Beeline</a> or the <a href=https://hive.apache.org/docs/latest/languagemanual-cli_27362033/>CLI</a>, use the commands below to show the latest documentation:</p>
<pre tabindex=0><code>SHOW FUNCTIONS;
@@ -1002,11 +990,8 @@ DESCRIBE FUNCTION EXTENDED <function_name>;
<ul>
<li>dayofyear(date) is date_format(date, ‘D’)</li>
</ul>
-<p>As of Hive 4.0.0 (</p>
-<h2 id=hive-27673httpsissuesapacheorgjirabrowsehive-27673srcconfmacro><a href="https://issues.apache.org/jira/browse/HIVE-27673?src=confmacro">HIVE-27673</a></h2>
-<p>Configurable datetime formatter for date_format
-Closed</p>
-<p>), the “hive.datetime.formatter” property can be used to control the underlying formatter implementation, and as a consequence the accepted patterns and their behavior. Prior versions always used <a href=https://docs.oracle.com/javase/8/docs/api/java/text/SimpleDateFormat.html>https://docs.oracle.com/javase/8/docs/api/java/text/SimpleDateFormat.html</a> as the underlying formatter. |</p>
+<p>As of Hive 4.0.0 (<a href=https://issues.apache.org/jira/browse/HIVE-27673>HIVE-27673</a>
+), the “hive.datetime.formatter” property can be used to control the underlying formatter implementation, and as a consequence the accepted patterns and their behavior. Prior versions always used <a href=https://docs.oracle.com/javase/8/docs/api/java/text/SimpleDateFormat.html>https://docs.oracle.com/javase/8/docs/api/java/text/SimpleDateFormat.html</a> as the underlying formatter. |</p>
<h3 id=conditional-functions>Conditional Functions</h3>
<table>
<thead>
diff --git a/docs/latest/languagemanual-union_27362049/index.html b/docs/latest/languagemanual-union_27362049/index.html
index da2a906..145d0b3 100644
--- a/docs/latest/languagemanual-union_27362049/index.html
+++ b/docs/latest/languagemanual-union_27362049/index.html
@@ -121,18 +121,21 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-union>Apache Hive : LanguageManual Union</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-union>Apache Hive : LanguageManual Union</a>
<ul>
<li><a href=#union-syntax>Union Syntax</a>
<ul>
-<li><a href=#union-within-a-from-clause>UNION within a FROM Clause</a></li>
-<li><a href=#unions-in-ddl-and-insert-statements>Unions in DDL and Insert Statements</a></li>
-<li><a href=#applying-subclauses>Applying Subclauses</a></li>
-<li><a href=#column-aliases-for-schema-matching>Column Aliases for Schema Matching</a></li>
-<li><a href=#column-type-conversion>Column Type Conversion</a></li>
-<li><a href=#version-information>Version Information</a></li>
+<li></li>
+</ul>
+</li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=union-syntax>Union Syntax</h2>
<pre tabindex=0><code>select_statement UNION [ALL | DISTINCT] select_statement UNION [ALL | DISTINCT] select_statement ...
diff --git a/docs/latest/languagemanual-variablesubstitution_30754722/index.html b/docs/latest/languagemanual-variablesubstitution_30754722/index.html
index 553d57d..17cce83 100644
--- a/docs/latest/languagemanual-variablesubstitution_30754722/index.html
+++ b/docs/latest/languagemanual-variablesubstitution_30754722/index.html
@@ -121,14 +121,17 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-variablesubstitution>Apache Hive : LanguageManual VariableSubstitution</h1>
-<h1 id=heading></h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li></li>
+<li><a href=#apache-hive--languagemanual-variablesubstitution>Apache Hive : LanguageManual VariableSubstitution</a></li>
<li><a href=#introduction>Introduction</a></li>
<li><a href=#using-variables>Using Variables</a></li>
<li><a href=#substitution-during-query-construction>Substitution During Query Construction</a></li>
<li><a href=#disabling-variable-substitution>Disabling Variable Substitution</a></li>
</ul>
+</nav>
+</aside>
<h1 id=introduction>Introduction</h1>
<p>Hive is used for batch and interactive queries. Variable Substitution allows for tasks such as separating environment-specific configuration variables from code.</p>
<p>The Hive variable substitution mechanism was designed to avoid some of the code that was getting baked into the scripting language on top of Hive.</p>
diff --git a/docs/latest/languagemanual-virtualcolumns_27362048/index.html b/docs/latest/languagemanual-virtualcolumns_27362048/index.html
index bb38ad6..b4c5ccb 100644
--- a/docs/latest/languagemanual-virtualcolumns_27362048/index.html
+++ b/docs/latest/languagemanual-virtualcolumns_27362048/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-virtualcolumns>Apache Hive : LanguageManual VirtualColumns</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--languagemanual-virtualcolumns>Apache Hive : LanguageManual VirtualColumns</a>
<ul>
<li><a href=#virtual-columns>Virtual Columns</a>
<ul>
@@ -128,6 +132,10 @@ ASF
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=virtual-columns>Virtual Columns</h2>
<p>Hive 0.8.0 provides support for two virtual columns:</p>
<p>One is <code>INPUT__FILE__NAME</code>, which is the input file’s name for a mapper task.</p>
diff --git a/docs/latest/languagemanual-windowingandanalytics_31819589/index.html b/docs/latest/languagemanual-windowingandanalytics_31819589/index.html
index db87144..f96d88f 100644
--- a/docs/latest/languagemanual-windowingandanalytics_31819589/index.html
+++ b/docs/latest/languagemanual-windowingandanalytics_31819589/index.html
@@ -121,29 +121,23 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--languagemanual-windowingandanalytics>Apache Hive : LanguageManual WindowingAndAnalytics</h1>
-<h1 id=windowing-and-analytics-functions>Windowing and Analytics Functions</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#windowing-and-analytics-functions>Windowing and Analytics Functions</a>
+<li><a href=#apache-hive--languagemanual-windowingandanalytics>Apache Hive : LanguageManual WindowingAndAnalytics</a>
<ul>
<li><a href=#enhancements-to-hive-ql>Enhancements to Hive QL</a></li>
<li><a href=#examples>Examples</a>
<ul>
-<li><a href=#partition-by-with-one-partitioning-column-no-order-by-or-window-specification>PARTITION BY with one partitioning column, no ORDER BY or window specification</a></li>
-<li><a href=#partition-by-with-two-partitioning-columns-no-order-by-or-window-specification>PARTITION BY with two partitioning columns, no ORDER BY or window specification</a></li>
-<li><a href=#partition-by-with-one-partitioning-column-one-order-by-column-and-no-window-specification>PARTITION BY with one partitioning column, one ORDER BY column, and no window specification</a></li>
-<li><a href=#partition-by-with-two-partitioning-columns-two-order-by-columns-and-no-window-specification>PARTITION BY with two partitioning columns, two ORDER BY columns, and no window specification</a></li>
-<li><a href=#partition-by-with-partitioning-order-by-and-window-specification>PARTITION BY with partitioning, ORDER BY, and window specification</a></li>
-<li><a href=#window-clause>WINDOW clause</a></li>
-<li><a href=#lead-using-default-1-row-lead-and-not-specifying-default-value>LEAD using default 1 row lead and not specifying default value</a></li>
-<li><a href=#lag-specifying-a-lag-of-3-rows-and-default-value-of-0>LAG specifying a lag of 3 rows and default value of 0</a></li>
-<li><a href=#distinct-counting-for-each-partition>Distinct counting for each partition</a></li>
+<li></li>
</ul>
</li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=enhancements-to-hive-ql>Enhancements to Hive QL</h2>
-<p>Version</p>
<p>Introduced in Hive version 0.11.</p>
<p>This section introduces the Hive QL enhancements for windowing and analytics functions. See “<a href=https://issues.apache.org/jira/secure/attachment/12575830/WindowingSpecification.pdf>Windowing Specifications in HQL</a>” (attached to <a href=https://issues.apache.org/jira/browse/HIVE-4197>HIVE-4197</a>) for details. <a href=https://issues.apache.org/jira/browse/HIVE-896>HIVE-896</a> has more information, including links to earlier documentation in the initial comments.</p>
<p>All of the windowing and analytics functions operate as per the SQL standard.</p>
diff --git a/docs/latest/listbucketing_27846854/index.html b/docs/latest/listbucketing_27846854/index.html
index 67ee92b..39b7b41 100644
--- a/docs/latest/listbucketing_27846854/index.html
+++ b/docs/latest/listbucketing_27846854/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--listbucketing>Apache Hive : ListBucketing</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--listbucketing>Apache Hive : ListBucketing</a></li>
<li><a href=#goal>Goal</a>
<ul>
<li><a href=#basic-partitioning>Basic Partitioning</a></li>
@@ -137,21 +140,20 @@ ASF
<li><a href=#hive-enhancements>Hive Enhancements</a>
<ul>
<li><a href=#create-table>Create Table</a></li>
-<li><a href=#alter-table>Alter Table</a>
-<ul>
-<li><a href=#alter-table-skewed>Alter Table Skewed</a></li>
-<li><a href=#alter-table-not-skewed>Alter Table Not Skewed</a></li>
-<li><a href=#alter-table-not-stored-as-directories>Alter Table Not Stored as Directories</a></li>
-<li><a href=#alter-table-set-skewed-location>Alter Table Set Skewed Location</a></li>
+<li><a href=#alter-table>Alter Table</a></li>
+<li><a href=#design>Design</a></li>
</ul>
</li>
-<li><a href=#design>Design</a></li>
</ul>
</li>
+<li><a href=#implementation>Implementation</a>
+<ul>
+<li><a href=#comments>Comments:</a></li>
</ul>
</li>
-<li><a href=#implementation>Implementation</a></li>
</ul>
+</nav>
+</aside>
<h1 id=goal>Goal</h1>
<p>The top level problem is as follows:</p>
<p>There are many tables of the following format:</p>
diff --git a/docs/latest/llap_62689557/index.html b/docs/latest/llap_62689557/index.html
index 21f1f0b..596707f 100644
--- a/docs/latest/llap_62689557/index.html
+++ b/docs/latest/llap_62689557/index.html
@@ -121,6 +121,12 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--llap>Apache Hive : LLAP</h1>
+<p>Live Long And Process (LLAP) functionality was added in Hive 2.0 (<a href=https://issues.apache.org/jira/browse/HIVE-7926>HIVE-7926</a> and associated tasks). <a href=https://issues.apache.org/jira/browse/HIVE-9850>HIVE-9850</a> links documentation, features, and issues for this enhancement.
+For configuration of LLAP, see the LLAP Section of <a href=#configuration-properties>Configuration Properties</a>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--llap>Apache Hive : LLAP</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#persistent-daemon>Persistent Daemon</a></li>
@@ -136,9 +142,12 @@ ASF
<li><a href=#slider-on-yarn-deployment>SLIDER on YARN Deployment</a></li>
<li><a href=#llap-status>LLAP Status</a></li>
<li><a href=#resources>Resources</a></li>
+<li><a href=#attachments>Attachments:</a></li>
+</ul>
+</li>
</ul>
-<p>Live Long And Process (LLAP) functionality was added in Hive 2.0 (<a href=https://issues.apache.org/jira/browse/HIVE-7926>HIVE-7926</a> and associated tasks). <a href=https://issues.apache.org/jira/browse/HIVE-9850>HIVE-9850</a> links documentation, features, and issues for this enhancement.</p>
-<p>For configuration of LLAP, see the LLAP Section of <a href=#configuration-properties>Configuration Properties</a>.</p>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p>Hive has become significantly faster thanks to various features and improvements that were built by the community in recent years, including <a href=https://hive.apache.org/docs/latest/hive-on-tez_33296197/>Tez</a> and <a href=https://hive.apache.org/docs/latest/cost-based-optimization-in-hive_42566775/>Cost-based-optimization</a>. The following were needed to take Hive to the next level:</p>
<ul>
diff --git a/docs/latest/locking_27362050/index.html b/docs/latest/locking_27362050/index.html
index 6a88137..6fbd493 100644
--- a/docs/latest/locking_27362050/index.html
+++ b/docs/latest/locking_27362050/index.html
@@ -121,8 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--locking>Apache Hive : Locking</h1>
-<h1 id=hive-concurrency-model>Hive Concurrency Model</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--locking>Apache Hive : Locking</a></li>
<li><a href=#hive-concurrency-model>Hive Concurrency Model</a>
<ul>
<li><a href=#use-cases>Use Cases</a></li>
@@ -133,6 +135,9 @@ ASF
</li>
<li><a href=#locking-in-hive-transactions>Locking in Hive Transactions</a></li>
</ul>
+</nav>
+</aside>
+<h1 id=hive-concurrency-model>Hive Concurrency Model</h1>
<h2 id=use-cases>Use Cases</h2>
<p>Concurrency support (<a href=http://issues.apache.org/jira/browse/HIVE-1293>http://issues.apache.org/jira/browse/HIVE-1293</a>) is a must in databases and their use cases are well understood. At a minimum, we want to support concurrent readers and writers whenever possible. It would be useful to add a mechanism to discover the current locks which have been acquired. There is no immediate requirement to add an API to explicitly acquire any locks, so all locks would be acquired implicitly.</p>
<p>The following lock modes will be defined in hive (Note that Intent lock is not needed).</p>
diff --git a/docs/latest/manual-installation_283118363/index.html b/docs/latest/manual-installation_283118363/index.html
index 2215245..03c7f22 100644
--- a/docs/latest/manual-installation_283118363/index.html
+++ b/docs/latest/manual-installation_283118363/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--manual-installation>Apache Hive : Manual Installation</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--manual-installation>Apache Hive : Manual Installation</a></li>
<li><a href=#installing-configuring-and-running-hive>Installing, configuring and running Hive</a>
<ul>
<li><a href=#prerequisites>Prerequisites</a></li>
@@ -150,6 +153,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h1 id=installing-configuring-and-running-hive>Installing, configuring and running Hive</h1>
<p>You can install a stable release of Hive by downloading and unpacking a tarball, or you can download the source code and build Hive using Maven (release 3.6.3 and later).</p>
<h2 id=prerequisites>Prerequisites</h2>
diff --git a/docs/latest/mapjoin-and-partition-pruning_34015666/index.html b/docs/latest/mapjoin-and-partition-pruning_34015666/index.html
index a625484..e462546 100644
--- a/docs/latest/mapjoin-and-partition-pruning_34015666/index.html
+++ b/docs/latest/mapjoin-and-partition-pruning_34015666/index.html
@@ -121,22 +121,35 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--mapjoin-and-partition-pruning>Apache Hive : MapJoin and Partition Pruning</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--mapjoin-and-partition-pruning>Apache Hive : MapJoin and Partition Pruning</a></li>
<li><a href=#overview>Overview</a>
<ul>
+<li>
+<ul>
<li><a href=#problem>Problem</a></li>
<li><a href=#proposed-solution>Proposed Solution</a></li>
<li><a href=#possible-extensions>Possible Extensions</a></li>
</ul>
</li>
+</ul>
+</li>
<li><a href=#optimization-details>Optimization Details</a>
<ul>
+<li>
+<ul>
<li><a href=#compile-time>Compile Time</a></li>
<li><a href=#runtime>Runtime</a></li>
<li><a href=#pseudo-code>Pseudo Code</a></li>
</ul>
</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h1 id=overview>Overview</h1>
<p>In Hive, Map-Join is a technique that materializes data for all tables involved in the join except for the largest table and then large table is streamed over the materialized data from small tables. Map-Join is often a good join approach for star-schema joins where the fact table will be streamed over materialized dimension tables.</p>
<h3 id=problem>Problem</h3>
diff --git a/docs/latest/mapjoinoptimization_27362029/index.html b/docs/latest/mapjoinoptimization_27362029/index.html
index d5492f9..160f4e8 100644
--- a/docs/latest/mapjoinoptimization_27362029/index.html
+++ b/docs/latest/mapjoinoptimization_27362029/index.html
@@ -121,8 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--mapjoinoptimization>Apache Hive : MapJoinOptimization</h1>
-<p><strong>Index</strong></p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--mapjoinoptimization>Apache Hive : MapJoinOptimization</a></li>
<li><a href=#1-map-join-optimization>1. Map Join Optimization</a>
<ul>
<li><a href=#11-using-distributed-cache-to-propagate-hashtable-file>1.1 Using Distributed Cache to Propagate Hashtable File</a></li>
@@ -139,6 +141,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h1 id=1-map-join-optimization>1. Map Join Optimization</h1>
<h2 id=11-using-distributed-cache-to-propagate-hashtable-file>1.1 Using Distributed Cache to Propagate Hashtable File</h2>
<p>Previously, when 2 large data tables need to do a join, there will be 2 different Mappers to sort these tables based on the join key and emit an intermediate file, and the Reducer will take the intermediate file as input file and do the real join work. This join mechanism (referred to as Common Join) is perfect with two large data size. But if one the join tables is small enough to fit into the Mapper‚ A’s memory, then there is no need to launch the Reducer. Actually, the Reduce [...]
diff --git a/docs/latest/materialized-views_80447331/index.html b/docs/latest/materialized-views_80447331/index.html
index 5ddb22e..6c86f90 100644
--- a/docs/latest/materialized-views_80447331/index.html
+++ b/docs/latest/materialized-views_80447331/index.html
@@ -121,8 +121,13 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--materialized-views>Apache Hive : Materialized views</h1>
+<p>This page documents the work done for the supporting materialized views in Apache Hive.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--materialized-views>Apache Hive : Materialized views</a>
<ul>
-<li><a href=#introduction>Introduction</a>
+<li><a href=#version-information>Version information</a>
<ul>
<li><a href=#objectives>Objectives</a></li>
</ul>
@@ -144,10 +149,12 @@ ASF
<li><a href=#materialized-view-lifecycle>Materialized view lifecycle</a></li>
<li><a href=#open-issues-jira>Open issues (JIRA)</a></li>
</ul>
-<p>Version information</p>
+</li>
+</ul>
+</nav>
+</aside>
+<h2 id=version-information>Version information</h2>
<p>Materialized views support is introduced in Hive 3.0.0.</p>
-<h2 id=introduction>Introduction</h2>
-<p>This page documents the work done for the supporting materialized views in Apache Hive.</p>
<h3 id=objectives>Objectives</h3>
<p>Traditionally, one of the most powerful techniques used to accelerate query processing in data warehouses is the pre-computation of relevant summaries or materialized views.</p>
<p>The initial implementation introduced in Apache Hive 3.0.0 focuses on introducing materialized views and automatic query rewriting based on those materializations in the project. In particular, materialized views can be stored natively in Hive or in other systems such as Druid using custom storage handlers, and they can seamlessly exploit new exciting Hive features such as LLAP acceleration. Then the optimizer relies in Apache Calcite to automatically produce full and partial rewritin [...]
diff --git a/docs/latest/parquet_38570914/index.html b/docs/latest/parquet_38570914/index.html
index 8d41d1e..9c07765 100644
--- a/docs/latest/parquet_38570914/index.html
+++ b/docs/latest/parquet_38570914/index.html
@@ -121,33 +121,39 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--parquet>Apache Hive : Parquet</h1>
-<p>Version</p>
<p>Parquet is supported by a plugin in Hive 0.10, 0.11, and 0.12 and natively in Hive 0.13 and later.</p>
-<p> </p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#introduction>Introduction</a></li>
-<li><a href=#native-parquet-support>Native Parquet Support</a>
+<li><a href=#apache-hive--parquet>Apache Hive : Parquet</a>
+<ul>
+<li><a href=#introduction><strong>Introduction</strong></a></li>
+<li><a href=#native-parquet-support><strong>Native Parquet Support</strong></a>
<ul>
<li><a href=#hive-010-011-and-012>Hive 0.10, 0.11, and 0.12</a></li>
<li><a href=#hive-013>Hive 0.13</a></li>
</ul>
</li>
-<li><a href=#hiveql-syntax>HiveQL Syntax</a>
+<li><a href=#hiveql-syntax><strong>HiveQL Syntax</strong></a>
<ul>
<li><a href=#hive-010---012>Hive 0.10 - 0.12</a></li>
<li><a href=#hive-013-and-later>Hive 0.13 and later</a></li>
</ul>
</li>
-<li><a href=#versions-and-limitations>Versions and Limitations</a>
+<li><a href=#versions-and-limitations><strong>Versions and Limitations</strong></a>
<ul>
<li><a href=#hive-0130>Hive 0.13.0</a></li>
<li><a href=#hive-0140>Hive 0.14.0</a></li>
<li><a href=#hive-110>Hive 1.1.0</a></li>
<li><a href=#hive-120>Hive 1.2.0</a></li>
-<li><a href=#resources>Resources</a></li>
+<li><a href=#resources><strong>Resources</strong></a></li>
+</ul>
+</li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=introduction><strong>Introduction</strong></h2>
<p>Parquet (<a href=http://parquet.io/>http://parquet.io/</a>) is an ecosystem wide columnar format for Hadoop. Read <a href=https://blog.twitter.com/2013/dremel-made-simple-with-parquet>Dremel made simple with Parquet</a> for a good introduction to the format while the Parquet project has an <a href=https://github.com/Parquet/parquet-format>in-depth description of the format</a> including motivations and diagrams. At the time of this writing Parquet supports the follow engines and data [...]
<p><strong>Engines</strong></p>
diff --git a/docs/latest/partitionedviews_27362053/index.html b/docs/latest/partitionedviews_27362053/index.html
index 2b04502..399e2c4 100644
--- a/docs/latest/partitionedviews_27362053/index.html
+++ b/docs/latest/partitionedviews_27362053/index.html
@@ -121,7 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--partitionedviews>Apache Hive : PartitionedViews</h1>
+<p>This is a followup to <a href=https://hive.apache.org/docs/latest/viewdev_27362067/>ViewDev</a> for adding partition-awareness to views.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--partitionedviews>Apache Hive : PartitionedViews</a></li>
<li><a href=#use-cases>Use Cases</a>
<ul>
<li><a href=#approaches>Approaches</a></li>
@@ -133,7 +137,8 @@ ASF
</li>
<li><a href=#hook-information>Hook Information</a></li>
</ul>
-<p>This is a followup to <a href=https://hive.apache.org/docs/latest/viewdev_27362067/>ViewDev</a> for adding partition-awareness to views.</p>
+</nav>
+</aside>
<h1 id=use-cases>Use Cases</h1>
<ol>
<li>An administrator wants to create a set of views as a table/column renaming layer on top of an existing set of base tables, without breaking any existing dependencies on those tables. To read-only users, the views should behave exactly the same as the underlying tables in every way. Among other things, this means users should be able to browse available partitions.</li>
diff --git a/docs/latest/presentations_27362054/index.html b/docs/latest/presentations_27362054/index.html
index 1d04ffd..1a29113 100644
--- a/docs/latest/presentations_27362054/index.html
+++ b/docs/latest/presentations_27362054/index.html
@@ -121,8 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--presentations>Apache Hive : Presentations</h1>
-<p> </p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--presentations>Apache Hive : Presentations</a></li>
<li><a href=#hive-meetups>Hive Meetups</a>
<ul>
<li><a href=#january-2016-hive-user-group-meetup>January 2016 Hive User Group Meetup</a></li>
@@ -137,8 +139,14 @@ ASF
</ul>
</li>
<li><a href=#older-hive-presentations>Older Hive Presentations</a></li>
-<li><a href=#related-work>Related Work</a></li>
+<li><a href=#related-work>Related Work</a>
+<ul>
+<li><a href=#attachments>Attachments:</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h1 id=hive-meetups>Hive Meetups</h1>
<h2 id=january-2016-hive-user-group-meetup>January 2016 Hive User Group Meetup</h2>
<ul>
diff --git a/docs/latest/query-reexecution_87298873/index.html b/docs/latest/query-reexecution_87298873/index.html
index 0774049..7828615 100644
--- a/docs/latest/query-reexecution_87298873/index.html
+++ b/docs/latest/query-reexecution_87298873/index.html
@@ -121,8 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--query-reexecution>Apache Hive : Query ReExecution</h1>
-<p>Query reexecution provides a facility to re-run the query multiple times in case of an unfortunate event happens.</p>
+<p>Query reexecution provides a facility to re-run the query multiple times in case of an unfortunate event happens. Introduced in Hive 3.0 (<a href=https://issues.apache.org/jira/browse/HIVE-17626>HIVE-17626</a>)</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--query-reexecution>Apache Hive : Query ReExecution</a></li>
<li><a href=#reexecition-strategies>ReExecition strategies</a>
<ul>
<li><a href=#overlay>Overlay</a></li>
@@ -132,7 +135,8 @@ ASF
</li>
<li><a href=#configuration>Configuration</a></li>
</ul>
-<p>Introduced in Hive 3.0 (<a href=https://issues.apache.org/jira/browse/HIVE-17626>HIVE-17626</a>)</p>
+</nav>
+</aside>
<h1 id=reexecition-strategies>ReExecition strategies</h1>
<h2 id=overlay>Overlay</h2>
<p>Enables to change the hive settings for all reexecutions which will be happening. It works by adding a configuration subtree as an overlay to the actual hive settings(reexec.overlay.*)</p>
diff --git a/docs/latest/rcfilecat_30748712/index.html b/docs/latest/rcfilecat_30748712/index.html
index c74475d..c18e651 100644
--- a/docs/latest/rcfilecat_30748712/index.html
+++ b/docs/latest/rcfilecat_30748712/index.html
@@ -121,16 +121,19 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--rcfilecat>Apache Hive : RCFileCat</h1>
-<h1 id=rcfilecat>RCFileCat</h1>
+<p>$HIVE_HOME/bin/hive –rcfilecat is a shell utility which can be used to print data or metadata from <a href=https://hive.apache.org/docs/latest/rcfile_58851803/>RC files</a>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#rcfilecat>RCFileCat</a>
+<li><a href=#apache-hive--rcfilecat>Apache Hive : RCFileCat</a>
<ul>
<li><a href=#data>Data</a></li>
<li><a href=#metadata>Metadata</a></li>
</ul>
</li>
</ul>
-<p>$HIVE_HOME/bin/hive –rcfilecat is a shell utility which can be used to print data or metadata from <a href=https://hive.apache.org/docs/latest/rcfile_58851803/>RC files</a>.</p>
+</nav>
+</aside>
<h2 id=data>Data</h2>
<p>Prints out the rows stored in an RCFile, columns are tab separated and rows are newline separated.</p>
<p>Usage:</p>
diff --git a/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/index.html b/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/index.html
index bedca34..91d9316 100644
--- a/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/index.html
+++ b/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/index.html
@@ -121,9 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--replacing-the-implementation-of-hive-cli-using-beeline>Apache Hive : Replacing the Implementation of Hive CLI Using Beeline</h1>
-<h2 id=heading></h2>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--replacing-the-implementation-of-hive-cli-using-beeline>Apache Hive : Replacing the Implementation of Hive CLI Using Beeline</a>
<ul>
-<li></li>
<li><a href=#why-replace-the-existing-hive-cli>Why Replace the Existing Hive CLI?</a></li>
<li><a href=#hive-cli-functionality-support>Hive CLI Functionality Support</a>
<ul>
@@ -135,6 +137,10 @@ ASF
</li>
<li><a href=#performance-impacts>Performance Impacts</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=why-replace-the-existing-hive-cli>Why Replace the Existing Hive CLI?</h2>
<p><a href=#hive-cli>Hive CLI</a> is a legacy tool which had two main use cases. The first is that it served as a thick client for SQL on Hadoop and the second is that it served as a command line tool for Hive Server (the original Hive server, now often referred to as “HiveServer1”). Hive Server has been deprecated and removed from the Hive code base as of Hive 1.0.0 (<a href=https://issues.apache.org/jira/browse/HIVE-6977>HIVE-6977</a>) and replaced with HiveServer2 (<a href [...]
<p>Ideally, Hive CLI should be deprecated as the Hive community has long recommended using the Beeline plus HiveServer2 configuration; however, because of the wide use of Hive CLI, we instead are replacing Hive CLI’s implementation with a new Hive CLI on top of Beeline plus embedded HiveServer2 (<a href=https://issues.apache.org/jira/browse/HIVE-10511>HIVE-10511</a>) so that the Hive community only needs to maintain a single code path. In this way, the new Hive CLI is just an alias [...]
diff --git a/docs/latest/replication_61336919/index.html b/docs/latest/replication_61336919/index.html
index 72ce978..5ec6460 100644
--- a/docs/latest/replication_61336919/index.html
+++ b/docs/latest/replication_61336919/index.html
@@ -121,6 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--replication>Apache Hive : Replication</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--replication>Apache Hive : Replication</a>
<ul>
<li><a href=#overview>Overview</a></li>
<li><a href=#potential-uses>Potential Uses</a></li>
@@ -130,6 +134,10 @@ ASF
<li><a href=#typical-mode-of-operation>Typical Mode of Operation</a></li>
<li><a href=#replication-to-awsemrs3>Replication to AWS/EMR/S3</a></li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h2 id=overview>Overview</h2>
<p>Hive Replication builds on the <a href=https://hive.apache.org/docs/latest/hcatalog-notification_34014558/>metastore event</a> and <a href=https://hive.apache.org/docs/latest/languagemanual-importexport_27837968/>ExIm</a> features to provide a framework for replicating Hive metadata and data changes between clusters. There is no requirement for the source cluster and replica to run the same Hadoop distribution, Hive version, or metastore RDBMS. The replication system has a fairly &lsq [...]
<p>See <a href=https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/>HiveReplicationDevelopment</a> for information on the design of replication in Hive.</p>
diff --git a/docs/latest/scheduled-queries_145724128/index.html b/docs/latest/scheduled-queries_145724128/index.html
index 2c8a9ef..d0b7d4d 100644
--- a/docs/latest/scheduled-queries_145724128/index.html
+++ b/docs/latest/scheduled-queries_145724128/index.html
@@ -121,7 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--scheduled-queries>Apache Hive : Scheduled Queries</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--scheduled-queries>Apache Hive : Scheduled Queries</a></li>
+<li><a href=#introduction>Introduction</a></li>
<li><a href=#maintaining-scheduled-queries>Maintaining scheduled queries</a>
<ul>
<li><a href=#create-scheduled-query-syntax>Create Scheduled query syntax</a></li>
@@ -129,7 +133,7 @@ ASF
<li><a href=#drop-syntax>Drop syntax</a></li>
<li><a href=#schedulespecification-syntax>scheduleSpecification syntax</a>
<ul>
-<li><a href=#cron-based-schedule-syntax>CRON based schedule syntax</a></li>
+<li><a href=#cron-based-schedulesyntax>CRON based schedule syntax</a></li>
<li><a href=#every-based-schedule-syntax>EVERY based schedule syntax</a></li>
</ul>
</li>
@@ -157,14 +161,16 @@ ASF
</li>
<li><a href=#examples>Examples</a>
<ul>
-<li><a href=#example-1-–-basic-example-of-using-schedules>Example 1 – basic example of using schedules</a></li>
-<li><a href=#example-2-–-analyze-external-table-periodically>Example 2 – analyze external table periodically</a></li>
-<li><a href=#example-3-–-materialized-view-rebuild>Example 3 – materialized view rebuild</a></li>
-<li><a href=#example-4-–-ingestion>Example 4 – Ingestion</a></li>
+<li><a href=#example-1-basic-example-of-using-schedules>Example 1 – basic example of using schedules</a></li>
+<li><a href=#example-2-analyze-external-table-periodically>Example 2 – analyze external table periodically</a></li>
+<li><a href=#example-3-materialized-view-rebuild>Example 3 – materialized view rebuild</a></li>
+<li><a href=#example-4-ingestion>Example 4 – Ingestion</a></li>
</ul>
</li>
</ul>
-<p><strong>Intro</strong></p>
+</nav>
+</aside>
+<h1 id=introduction>Introduction</h1>
<p>Executing statements periodically can be usefull in</p>
<ul>
<li>Pulling informations from external systems</li>
diff --git a/docs/latest/serde_27362059/index.html b/docs/latest/serde_27362059/index.html
index 126dbc6..7184ec7 100644
--- a/docs/latest/serde_27362059/index.html
+++ b/docs/latest/serde_27362059/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--serde>Apache Hive : SerDe</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--serde>Apache Hive : SerDe</a></li>
<li><a href=#serde-overview>SerDe Overview</a>
<ul>
<li><a href=#built-in-and-custom-serdes>Built-in and Custom SerDes</a>
@@ -135,8 +138,14 @@ ASF
</li>
<li><a href=#input-processing>Input Processing</a></li>
<li><a href=#output-processing>Output Processing</a></li>
-<li><a href=#additional-notes>Additional Notes</a></li>
+<li><a href=#additional-notes>Additional Notes</a>
+<ul>
+<li><a href=#comments>Comments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
<h1 id=serde-overview>SerDe Overview</h1>
<p>SerDe is short for Serializer/Deserializer. Hive uses the SerDe interface for IO. The interface handles both serialization and deserialization and also interpreting the results of serialization as individual fields for processing.</p>
<p>A SerDe allows Hive to read in data from a table, and write it back out to HDFS in any custom format. Anyone can write their own SerDe for their own data formats.</p>
diff --git a/docs/latest/setting-up-hiveserver2_30758712/index.html b/docs/latest/setting-up-hiveserver2_30758712/index.html
index b2e5efc..5dc44b8 100644
--- a/docs/latest/setting-up-hiveserver2_30758712/index.html
+++ b/docs/latest/setting-up-hiveserver2_30758712/index.html
@@ -121,40 +121,31 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--setting-up-hiveserver2>Apache Hive : Setting Up HiveServer2</h1>
-<h1 id=hiveserver2>HiveServer2</h1>
+<p><a href=https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Overview>HiveServer2</a> (HS2) is a server interface that enables remote clients to execute queries against Hive and retrieve the results (a more detailed intro <a href=https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Overview>here</a>). The current implementation, based on Thrift RPC, is an improved version of <a href=https://hive.apache.org/docs/latest/hiveserver_27362111/>HiveServer</a> and supports mu [...]
+<ul>
+<li>The Thrift interface definition language (IDL) for HiveServer2 is available at <a href=https://github.com/apache/hive/blob/trunk/service/if/TCLIService.thrift>https://github.com/apache/hive/blob/trunk/service/if/TCLIService.thrift</a>.</li>
+<li>Thrift documentation is available at <a href=http://thrift.apache.org/docs/>http://thrift.apache.org/docs/</a>.</li>
+</ul>
+<p>This document describes how to set up the server. How to use a client with this server is described in the <a href=https://hive.apache.org/docs/latest/hiveserver2-clients_30758725/>HiveServer2 Clients document</a>.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hiveserver2>HiveServer2</a>
+<li><a href=#apache-hive--setting-up-hiveserver2>Apache Hive : Setting Up HiveServer2</a>
<ul>
+<li><a href=#version-information>Version information</a></li>
<li><a href=#how-to-configure>How to Configure</a>
<ul>
-<li><a href=#configuration-properties-in-the-hive-site-xml-file>Configuration Properties in the hive-site.xml File</a></li>
-<li><a href=#running-in-http-mode>Running in HTTP Mode</a>
-<ul>
-<li><a href=#cookie-based-authentication>Cookie Based Authentication</a></li>
-</ul>
-</li>
-<li><a href=#optional-global-init-file>Optional Global Init File</a></li>
-<li><a href=#logging-configuration>Logging Configuration</a></li>
+<li></li>
</ul>
</li>
<li><a href=#how-to-start>How to Start</a>
<ul>
-<li><a href=#usage-message>Usage Message</a></li>
+<li></li>
</ul>
</li>
<li><a href=#authenticationsecurity-configuration>Authentication/Security Configuration</a>
<ul>
-<li><a href=#configuration>Configuration</a></li>
-<li><a href=#impersonation>Impersonation</a></li>
-<li><a href=#integrity/confidentiality-protection>Integrity/Confidentiality Protection</a></li>
-<li><a href=#ssl-encryption>SSL Encryption</a>
-<ul>
-<li><a href=#setting-up-ssl-with-self-signed-certificates>Setting up SSL with self-signed certificates</a></li>
-<li><a href=#selectively-disabling-ssl-protocol-versions>Selectively disabling SSL protocol versions</a></li>
-</ul>
-</li>
-<li><a href=#pluggable-authentication-modules--pam->Pluggable Authentication Modules (PAM)</a></li>
-<li><a href=#setting-up-hiveserver2-job-credential-provider>Setting up HiveServer2 job credential provider</a></li>
+<li></li>
</ul>
</li>
<li><a href=#scratch-directory-management>Scratch Directory Management</a>
@@ -166,16 +157,13 @@ ASF
<li><a href=#web-ui-for-hiveserver2>Web UI for HiveServer2</a></li>
<li><a href=#python-client-driver>Python Client Driver</a></li>
<li><a href=#ruby-client-driver>Ruby Client Driver</a></li>
+<li><a href=#attachments>Attachments:</a></li>
</ul>
</li>
</ul>
-<p><a href=https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Overview>HiveServer2</a> (HS2) is a server interface that enables remote clients to execute queries against Hive and retrieve the results (a more detailed intro <a href=https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Overview>here</a>). The current implementation, based on Thrift RPC, is an improved version of <a href=https://hive.apache.org/docs/latest/hiveserver_27362111/>HiveServer</a> and supports mu [...]
-<ul>
-<li>The Thrift interface definition language (IDL) for HiveServer2 is available at <a href=https://github.com/apache/hive/blob/trunk/service/if/TCLIService.thrift>https://github.com/apache/hive/blob/trunk/service/if/TCLIService.thrift</a>.</li>
-<li>Thrift documentation is available at <a href=http://thrift.apache.org/docs/>http://thrift.apache.org/docs/</a>.</li>
-</ul>
-<p>This document describes how to set up the server. How to use a client with this server is described in the <a href=https://hive.apache.org/docs/latest/hiveserver2-clients_30758725/>HiveServer2 Clients document</a>.</p>
-<p>Version</p>
+</nav>
+</aside>
+<h2 id=version-information>Version information</h2>
<p>Introduced in Hive version 0.11. See <a href=https://issues.apache.org/jira/browse/HIVE-2935>HIVE-2935</a>.</p>
<h2 id=how-to-configure>How to Configure</h2>
<h4 id=configuration-properties-in-the-hive-sitexml-file><strong>Configuration Properties in the <code>hive-site.xml</code> File</strong></h4>
diff --git a/docs/latest/sql-standard-based-hive-authorization_40509928/index.html b/docs/latest/sql-standard-based-hive-authorization_40509928/index.html
index 7a8e246..f84996b 100644
--- a/docs/latest/sql-standard-based-hive-authorization_40509928/index.html
+++ b/docs/latest/sql-standard-based-hive-authorization_40509928/index.html
@@ -121,18 +121,21 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--sql-standard-based-hive-authorization>Apache Hive : SQL Standard Based Hive Authorization</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--sql-standard-based-hive-authorization>Apache Hive : SQL Standard Based Hive Authorization</a></li>
<li><a href=#status-of-hive-authorization-before-hive-013>Status of Hive Authorization before Hive 0.13</a></li>
-<li><a href=#sql-standards-based-hive-authorization--new-in-hive-0-13->SQL Standards Based Hive Authorization (New in Hive 0.13)</a>
+<li><a href=#sql-standards-based-hiveauthorization-new-in-hive-013>SQL Standards Based Hive Authorization (New in Hive 0.13)</a>
<ul>
-<li><a href=#restrictions-on-hive-commands-and-statements>Restrictions on Hive Commands and Statements</a></li>
+<li><a href=#restrictions-on-hivecommands-and-statements>Restrictions on Hive Commands and Statements</a></li>
<li><a href=#privileges>Privileges</a></li>
<li><a href=#objects>Objects</a></li>
<li><a href=#object-ownership>Object Ownership</a></li>
<li><a href=#users-and-roles>Users and Roles</a>
<ul>
<li><a href=#names-of-users-and-roles>Names of Users and Roles</a></li>
-<li><a href=#role-management-commands>Role Management Commands</a></li>
+<li><a href=#role-management-commands><strong>Role Management Commands</strong></a></li>
</ul>
</li>
<li><a href=#managing-object-privileges>Managing Object Privileges</a>
@@ -141,7 +144,7 @@ ASF
<li><a href=#examples-of-managing-object-privileges>Examples of Managing Object Privileges</a></li>
</ul>
</li>
-<li><a href=#privileges-required-for-hive-operations>Privileges Required for Hive Operations</a></li>
+<li><a href=#privileges-required-for-hiveoperations>Privileges Required for Hive Operations</a></li>
<li><a href=#configuration>Configuration</a>
<ul>
<li><a href=#for-hive-013x>For Hive 0.13.x</a></li>
@@ -156,9 +159,12 @@ ASF
</li>
<li><a href=#references>References</a></li>
<li><a href=#troubleshooting>Troubleshooting</a></li>
+<li><a href=#attachments>Attachments:</a></li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h1 id=status-of-hive-authorization-before-hive-013>Status of Hive Authorization before Hive 0.13</h1>
<p>The <a href=#default-authorization-in-hive>default authorization in Hive</a> is not designed with the intent to protect against malicious users accessing data they should not be accessing. It only helps in preventing users from accidentally doing operations they are not supposed to do. It is also incomplete because it does not have authorization checks for many operations including the grant statement. The authorization checks happen during Hive query compilation. But as the user is a [...]
<p>Hive also has support for storage based authorization, which is commonly used to add authorization to metastore server API calls (see <a href=#storage-based-authorization-in-the-metastore-server>Storage Based Authorization in the Metastore Server</a>). As of Hive 0.12.0 it can be used on the client side as well. While it can protect the metastore against changes by malicious users, it does not support fine grained access control (column or row level).</p>
diff --git a/docs/latest/statisticsanddatamining_27362058/index.html b/docs/latest/statisticsanddatamining_27362058/index.html
index fbe973d..88f7ade 100644
--- a/docs/latest/statisticsanddatamining_27362058/index.html
+++ b/docs/latest/statisticsanddatamining_27362058/index.html
@@ -120,11 +120,12 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--statisticsanddatamining>Apache Hive : StatisticsAndDataMining</h1>
-<h1 id=statistics-and-data-mining-in-hive>Statistics and Data Mining in Hive</h1>
+<h1 id=apache-hive--statistics-and-data-mining>Apache Hive : Statistics and Data Mining</h1>
<p>This page is the secondary documentation for the slightly more advanced statistical and data mining functions that are being integrated into Hive, and especially the functions that warrant more than one-line descriptions.</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#statistics-and-data-mining-in-hive>Statistics and Data Mining in Hive</a>
+<li><a href=#apache-hive--statistics-and-data-mining>Apache Hive : Statistics and Data Mining</a>
<ul>
<li><a href=#ngrams-and-context_ngrams-n-gram-frequency-estimation>ngrams() and context_ngrams(): N-gram frequency estimation</a>
<ul>
@@ -135,14 +136,16 @@ ASF
</li>
<li><a href=#histogram_numeric-estimating-frequency-distributions>histogram_numeric(): Estimating frequency distributions</a>
<ul>
-<li><a href=#use-cases>Use Cases</a></li>
-<li><a href=#usage>Usage</a></li>
-<li><a href=#example>Example</a></li>
+<li><a href=#use-cases-1>Use Cases</a></li>
+<li><a href=#usage-1>Usage</a></li>
+<li><a href=#example-1>Example</a></li>
</ul>
</li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=ngrams-and-context_ngrams-n-gram-frequency-estimation>ngrams() and context_ngrams(): N-gram frequency estimation</h2>
<p><a href=http://en.wikipedia.org/wiki/N-gram>N-grams</a> are subsequences of length <strong>N</strong> drawn from a longer sequence. The purpose of the <code>ngrams()</code> UDAF is to find the <code>k</code> most frequent n-grams from one or more sequences. It can be used in conjunction with the <code>sentences()</code> UDF to analyze unstructured natural language text, or the <code>collect()</code> function to analyze more general string data.</p>
<p>Contextual n-grams are similar to n-grams, but allow you to specify a ‘context’ string around which n-grams are to be estimated. For example, you can specify that you’re only interested in finding the most common two-word phrases in text that follow the context “I love”. You could achieve the same result by manually stripping sentences of non-contextual content and then passing them to <code>ngrams()</code>, but <code>context_ngrams()</code> makes it much [...]
diff --git a/docs/latest/statsdev_27362062/index.html b/docs/latest/statsdev_27362062/index.html
index c374464..ca30bee 100644
--- a/docs/latest/statsdev_27362062/index.html
+++ b/docs/latest/statsdev_27362062/index.html
@@ -120,10 +120,12 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--statsdev>Apache Hive : StatsDev</h1>
-<h1 id=statistics-in-hive>Statistics in Hive</h1>
+<h1 id=apache-hive--statistics>Apache Hive : Statistics</h1>
+<p>This document describes the support of statistics for Hive tables (see <a href=http://issues.apache.org/jira/browse/HIVE-33>HIVE-33</a>).</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#statistics-in-hive>Statistics in Hive</a>
+<li><a href=#apache-hive--statistics>Apache Hive : Statistics</a>
<ul>
<li><a href=#motivation>Motivation</a></li>
<li><a href=#scope>Scope</a>
@@ -139,19 +141,20 @@ ASF
<ul>
<li><a href=#configuration-variables>Configuration Variables</a></li>
<li><a href=#newly-created-tables>Newly Created Tables</a></li>
-<li><a href=#existing-tables-–-analyze>Existing Tables – ANALYZE</a></li>
+<li><a href=#existing-tables-analyze>Existing Tables – ANALYZE</a></li>
</ul>
</li>
<li><a href=#examples>Examples</a>
<ul>
-<li><a href=#analyze-table-table1-cache-metadata>ANALYZE TABLE CACHE METADATA</a></li>
+<li><a href=#analyze-table-table1-cache-metadata>ANALYZE TABLE <table1> CACHE METADATA</a></li>
</ul>
</li>
<li><a href=#current-status-jira>Current Status (JIRA)</a></li>
</ul>
</li>
</ul>
-<p>This document describes the support of statistics for Hive tables (see <a href=http://issues.apache.org/jira/browse/HIVE-33>HIVE-33</a>).</p>
+</nav>
+</aside>
<h2 id=motivation>Motivation</h2>
<p>Statistics such as the number of rows of a table or partition and the histograms of a particular interesting column are important in many ways. One of the key use cases of statistics is query optimization. Statistics serve as the input to the cost functions of the optimizer so that it can compare different plans and choose among them. Statistics may sometimes meet the purpose of the users' queries. Users can quickly get the answers for some of their queries by only querying stored sta [...]
<h2 id=scope>Scope</h2>
diff --git a/docs/latest/storage-based-authorization-in-the-metastore-server_45876440/index.html b/docs/latest/storage-based-authorization-in-the-metastore-server_45876440/index.html
index 1278e35..e564a0f 100644
--- a/docs/latest/storage-based-authorization-in-the-metastore-server_45876440/index.html
+++ b/docs/latest/storage-based-authorization-in-the-metastore-server_45876440/index.html
@@ -121,27 +121,29 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--storage-based-authorization-in-the-metastore-server>Apache Hive : Storage Based Authorization in the Metastore Server</h1>
+<p>The metastore server security feature with storage based authorization was added to Hive in release 0.10. This feature was introduced previously in <a href=https://hive.apache.org/docs/latest/hcatalog-authorization_34014782/>HCatalog</a>.</p>
+<p><a href=https://issues.apache.org/jira/browse/HIVE-3705>HIVE-3705</a> added metastore server security to Hive in release 0.10.0.</p>
<ul>
-<li><a href=#storage-based-authorization-in-the-metastore-server>Storage Based Authorization in the Metastore Server</a>
+<li>For additional information about storage based authorization in the metastore server, see the HCatalog document <a href=https://hive.apache.org/docs/latest/hcatalog-authorization_34014782/>Storage Based Authorization</a>.</li>
+<li>For an overview of Hive authorization models and other security options, see the <a href=https://hive.apache.org/docs/latest/languagemanual-authorization_27362032/>Authorization</a> document.</li>
+</ul>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--storage-based-authorization-in-the-metastore-server>Apache Hive : Storage Based Authorization in the Metastore Server</a>
<ul>
<li><a href=#the-need-for-metastore-server-security>The Need for Metastore Server Security</a></li>
<li><a href=#storage-based-authorization>Storage Based Authorization</a></li>
<li><a href=#configuration-parameters-for-metastore-security>Configuration Parameters for Metastore Security</a>
<ul>
-<li><a href=#sample-hive-site-xml:-default-settings>Sample hive-site.xml: Default Settings</a></li>
+<li><a href=#sample-hive-sitexml-default-settings>Sample hive-site.xml: Default Settings</a></li>
</ul>
</li>
</ul>
</li>
</ul>
-<h1 id=storage-based-authorization-in-the-metastore-server>Storage Based Authorization in the Metastore Server</h1>
-<p>The metastore server security feature with storage based authorization was added to Hive in release 0.10. This feature was introduced previously in <a href=https://hive.apache.org/docs/latest/hcatalog-authorization_34014782/>HCatalog</a>.</p>
-<p>Version 0.10.0</p>
-<p><a href=https://issues.apache.org/jira/browse/HIVE-3705>HIVE-3705</a> added metastore server security to Hive in release 0.10.0.</p>
-<ul>
-<li>For additional information about storage based authorization in the metastore server, see the HCatalog document <a href=https://hive.apache.org/docs/latest/hcatalog-authorization_34014782/>Storage Based Authorization</a>.</li>
-<li>For an overview of Hive authorization models and other security options, see the <a href=https://hive.apache.org/docs/latest/languagemanual-authorization_27362032/>Authorization</a> document.</li>
-</ul>
+</nav>
+</aside>
<h2 id=the-need-for-metastore-server-security>The Need for Metastore Server Security</h2>
<p>When multiple clients access the same metastore in a backing database, such as MySQL, the database connection credentials may be visible in the <code>hive-site.xml</code> configuration file. A malicious or incompetent user could cause serious damage to metadata even though the underlying data is protected by HDFS access controls.</p>
<p>Also, when a Hive metastore server uses Thrift to communicate with clients and has a backing database for metadata storage and persistence, the authentication and authorization done on the client side cannot guarantee security on the metastore side. To provide security for metadata, Hive release 0.10 added authorization capability to the metastore. (See <a href=https://issues.apache.org/jira/browse/HIVE-3705>HIVE-3705</a>.) </p>
diff --git a/docs/latest/streaming-data-ingest-v2_85477610/index.html b/docs/latest/streaming-data-ingest-v2_85477610/index.html
index bae6b1b..0472041 100644
--- a/docs/latest/streaming-data-ingest-v2_85477610/index.html
+++ b/docs/latest/streaming-data-ingest-v2_85477610/index.html
@@ -122,23 +122,26 @@ ASF
<div class=docs>
<h1 id=apache-hive--streaming-data-ingest-v2>Apache Hive : Streaming Data Ingest V2</h1>
<p>Starting in release Hive 3.0.0, <a href=https://hive.apache.org/docs/latest/streaming-data-ingest_40509746/>Streaming Data Ingest</a> is deprecated and is replaced by newer V2 API (<a href=https://issues.apache.org/jira/browse/HIVE-19205>HIVE-19205</a>). </p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--streaming-data-ingest-v2>Apache Hive : Streaming Data Ingest V2</a></li>
<li><a href=#hive-streaming-api>Hive Streaming API</a>
<ul>
+<li>
+<ul>
<li><a href=#streaming-mutation-api-deprecation-and-removal>Streaming Mutation API Deprecation and Removal</a></li>
</ul>
</li>
+</ul>
+</li>
<li><a href=#streaming-requirements>Streaming Requirements</a></li>
<li><a href=#limitations>Limitations</a></li>
<li><a href=#api-usage>API Usage</a>
<ul>
<li><a href=#transaction-and-connection-management>Transaction and Connection Management</a>
<ul>
-<li><a href=#hivestreamingconnection>HiveStreamingConnection</a>
-<ul>
-<li><a href=#usage-guidelines>Usage Guidelines</a></li>
-</ul>
-</li>
+<li><a href=#hivestreamingconnection>HiveStreamingConnection</a></li>
<li><a href=#notes-about-the-hiveconf-object>Notes about the HiveConf Object</a></li>
</ul>
</li>
@@ -156,6 +159,8 @@ ASF
</li>
<li><a href=#example>Example</a></li>
</ul>
+</nav>
+</aside>
<h1 id=hive-streaming-api>Hive Streaming API</h1>
<p>Traditionally adding new data into Hive requires gathering a large amount of data onto HDFS and then periodically adding a new partition. This is essentially a “batch insertion”. </p>
<p>Hive Streaming API allows data to be pumped continuously into Hive. The incoming data can be continuously committed in small batches of records into an existing Hive partition or table. Once data is committed it becomes immediately visible to all Hive queries initiated subsequently.</p>
diff --git a/docs/latest/streaming-data-ingest_40509746/index.html b/docs/latest/streaming-data-ingest_40509746/index.html
index 785c3c1..ff70d9e 100644
--- a/docs/latest/streaming-data-ingest_40509746/index.html
+++ b/docs/latest/streaming-data-ingest_40509746/index.html
@@ -121,13 +121,20 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--streaming-data-ingest>Apache Hive : Streaming Data Ingest</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--streaming-data-ingest>Apache Hive : Streaming Data Ingest</a></li>
<li><a href=#hive-3-streaming-api>Hive 3 Streaming API</a></li>
<li><a href=#hive-hcatalog-streaming-api>Hive HCatalog Streaming API</a>
<ul>
+<li>
+<ul>
<li><a href=#streaming-mutation-api>Streaming Mutation API</a></li>
</ul>
</li>
+</ul>
+</li>
<li><a href=#streaming-requirements>Streaming Requirements</a></li>
<li><a href=#limitations>Limitations</a></li>
<li><a href=#api-usage>API Usage</a>
@@ -136,11 +143,7 @@ ASF
<ul>
<li><a href=#hiveendpoint>HiveEndPoint</a></li>
<li><a href=#streamingconnection>StreamingConnection</a></li>
-<li><a href=#transactionbatch>TransactionBatch</a>
-<ul>
-<li><a href=#usage-guidelines>Usage Guidelines</a></li>
-</ul>
-</li>
+<li><a href=#transactionbatch>TransactionBatch</a></li>
<li><a href=#notes-about-the-hiveconf-object>Notes about the HiveConf Object</a></li>
</ul>
</li>
@@ -156,10 +159,12 @@ ASF
<li><a href=#error-handling>Error Handling</a></li>
</ul>
</li>
-<li><a href=#example-–-non-secure-mode>Example – Non-secure Mode</a></li>
-<li><a href=#example-–-secure-streaming>Example – Secure Streaming</a></li>
+<li><a href=#example-non-secure-mode>Example – Non-secure Mode</a></li>
+<li><a href=#example-securestreaming>Example – Secure Streaming</a></li>
<li><a href=#knowledge-base>Knowledge Base</a></li>
</ul>
+</nav>
+</aside>
<h1 id=hive-3-streaming-api>Hive 3 Streaming API</h1>
<p><a href=https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest+V2>Hive 3 Streaming API Documentation</a> - new API available in Hive 3</p>
<h1 id=hive-hcatalog-streaming-api>Hive HCatalog Streaming API</h1>
diff --git a/docs/latest/teradatabinaryserde_89068127/index.html b/docs/latest/teradatabinaryserde_89068127/index.html
index 5e88a9c..e28977e 100644
--- a/docs/latest/teradatabinaryserde_89068127/index.html
+++ b/docs/latest/teradatabinaryserde_89068127/index.html
@@ -121,30 +121,25 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--teradatabinaryserde>Apache Hive : TeradataBinarySerde</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#availability>Availability</a></li>
-<li><a href=#overview>Overview</a></li>
-<li><a href=#how-to-export>How to export</a>
+<li><a href=#apache-hive--teradatabinaryserde>Apache Hive : TeradataBinarySerde</a>
<ul>
-<li><a href=#using-tpt-fastexport>Using TPT FastExport</a></li>
-<li><a href=#using-bteq>Using BTEQ</a></li>
-</ul>
-</li>
-<li><a href=#how-to-import>How to import</a>
+<li>
<ul>
-<li><a href=#using-bteq>Using BTEQ</a></li>
-<li><a href=#using-tpt-fastload>Using TPT FastLoad</a></li>
+<li><a href=#availability>Availability</a></li>
+<li><a href=#overview>Overview</a></li>
+<li><a href=#how-to-export>How to export</a></li>
+<li><a href=#how-to-import>How to import</a></li>
+<li><a href=#usage>Usage</a></li>
</ul>
</li>
-<li><a href=#usage>Usage</a>
-<ul>
-<li><a href=#table-creating>Table Creating</a></li>
-<li><a href=#table-properties>Table Properties</a></li>
-<li><a href=#teradata-to-hive-type-conversion>Teradata to Hive Type Conversion</a></li>
-<li><a href=#serde-restriction>Serde Restriction</a></li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h3 id=availability>Availability</h3>
<p>Earliest version CSVSerde is available</p>
<p>The TeradataBinarySerDe is available in <a href=https://issues.apache.org/jira/browse/HIVE-20225>Hive 2.4</a> or greater.</p>
diff --git a/docs/latest/theta-join_33293991/index.html b/docs/latest/theta-join_33293991/index.html
index b34232d..cf7946c 100644
--- a/docs/latest/theta-join_33293991/index.html
+++ b/docs/latest/theta-join_33293991/index.html
@@ -121,45 +121,38 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--theta-join>Apache Hive : Theta Join</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
+<ul>
+<li><a href=#apache-hive--theta-join>Apache Hive : Theta Join</a>
<ul>
<li><a href=#preliminaries>Preliminaries</a>
<ul>
<li><a href=#overview>Overview</a></li>
-<li><a href=#specific-use-cases>Specific Use Cases</a>
-<ul>
-<li><a href=#geo-location>Geo-Location</a></li>
-<li><a href=#side-table-similarity>Side-Table Similarity</a></li>
-</ul>
-</li>
-<li><a href=#requirements>Requirements</a>
-<ul>
-<li><a href=#goals>Goals</a></li>
-<li><a href=#specific-non-goals>Specific Non-Goals</a></li>
-</ul>
-</li>
+<li><a href=#specific-use-cases>Specific Use Cases</a></li>
+<li><a href=#requirements>Requirements</a></li>
</ul>
</li>
<li><a href=#literature-review>Literature Review</a>
<ul>
-<li><a href=#map-reduce-merge:-simplified-relational-data-processing-on-large-clusters-[1]>Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters [1]</a></li>
-<li><a href=#efficient-parallel-set-similarity-joins-using-mapreduce-[2]>Efficient Parallel Set-Similarity Joins Using MapReduce [2]</a></li>
-<li><a href=#processing-theta-joins-using-mapreduce-[3]>Processing Theta-Joins using MapReduce [3]</a></li>
-<li><a href=#efficient-multi-way-theta-join-processing-using-mapreduce-[4]>Efficient Multi-way Theta-Join Processing Using MapReduce [4]</a></li>
+<li><a href=#map-reduce-merge-simplified-relational-data-processing-on-large-clusters-1>Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters [1]</a></li>
+<li><a href=#efficient-parallel-set-similarity-joins-using-mapreduce-2>Efficient Parallel Set-Similarity Joins Using MapReduce [2]</a></li>
+<li><a href=#processing-theta-joins-using-mapreduce-3>Processing Theta-Joins using MapReduce [3]</a></li>
+<li><a href=#efficient-multi-way-theta-join-processing-using-mapreduce-4>Efficient Multi-way Theta-Join Processing Using MapReduce [4]</a></li>
</ul>
</li>
<li><a href=#design>Design</a>
<ul>
<li><a href=#map-side>Map-side</a></li>
-<li><a href=#reduce-side>Reduce-side</a>
-<ul>
-<li><a href=#mapper>Mapper</a></li>
-<li><a href=#reducer>Reducer</a></li>
+<li><a href=#reduce-side>Reduce-side</a></li>
</ul>
</li>
+<li><a href=#references>References</a></li>
</ul>
</li>
-<li><a href=#references>References</a></li>
</ul>
+</nav>
+</aside>
<h2 id=preliminaries>Preliminaries</h2>
<h3 id=overview>Overview</h3>
<p><a href=https://issues.apache.org/jira/browse/HIVE-556>HIVE-556</a> requests that Hive support non-equality joins commonly called theta joins. Theta joins cover all kinds of non-equality joins such as <, <=, >, >=, <>, LIKE, RLIKE, and Generic UDF.</p>
diff --git a/docs/latest/top-k-stats_30150275/index.html b/docs/latest/top-k-stats_30150275/index.html
index df20b91..84f95d5 100644
--- a/docs/latest/top-k-stats_30150275/index.html
+++ b/docs/latest/top-k-stats_30150275/index.html
@@ -120,10 +120,12 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--top-k-stats>Apache Hive : Top K Stats</h1>
-<h1 id=column-level-top-k-statistics>Column Level Top K Statistics</h1>
+<h1 id=apache-hive--column-level-top-k-statistics>Apache Hive : Column Level Top K Statistics</h1>
+<p>This document is an addition to <a href=https://cwiki.apache.org/confluence/display/Hive/StatsDev>Statistics in Hive</a>. It describes the support of collecting column level top K values for Hive tables (see <a href=https://issues.apache.org/jira/browse/HIVE-3421>HIVE-3421</a>).</p>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#column-level-top-k-statistics>Column Level Top K Statistics</a>
+<li><a href=#apache-hive--column-level-top-k-statistics>Apache Hive : Column Level Top K Statistics</a>
<ul>
<li><a href=#scope>Scope</a></li>
<li><a href=#implementation>Implementation</a></li>
@@ -138,7 +140,8 @@ ASF
</ul>
</li>
</ul>
-<p>This document is an addition to <a href=https://cwiki.apache.org/confluence/display/Hive/StatsDev>Statistics in Hive</a>. It describes the support of collecting column level top K values for Hive tables (see <a href=https://issues.apache.org/jira/browse/HIVE-3421>HIVE-3421</a>).</p>
+</nav>
+</aside>
<h2 id=scope>Scope</h2>
<p>In addition to the partition statistics, column level top K values can also be estimated for Hive tables.<br>
The name and top K values of the most skewed column is stored in the partition or non-partitioned table’s skewed information, if user did not specify <a href=https://cwiki.apache.org/confluence/display/Hive/ListBucketing>skew</a>. This works for both newly created and existing tables.<br>
diff --git a/docs/latest/tutorial_27362061/index.html b/docs/latest/tutorial_27362061/index.html
index 3ee0e4f..68b12e9 100644
--- a/docs/latest/tutorial_27362061/index.html
+++ b/docs/latest/tutorial_27362061/index.html
@@ -121,23 +121,67 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--tutorial>Apache Hive : Tutorial</h1>
-<h1 id=hive-tutorial><strong>Hive Tutorial</strong></h1>
-<hr>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-tutorial>Hive Tutorial</a></li>
+<li><a href=#apache-hive--tutorial>Apache Hive : Tutorial</a></li>
<li><a href=#concepts>Concepts</a>
<ul>
<li><a href=#what-is-hive>What Is Hive</a></li>
<li><a href=#what-hive-is-not>What Hive Is NOT</a></li>
<li><a href=#getting-started>Getting Started</a></li>
<li><a href=#data-units>Data Units</a></li>
-<li><a href=#type-system>Type System</a></li>
-<li><a href=#built-in-operators-and-functions>Built In Operators and Functions</a></li>
+<li><a href=#type-system>Type System</a>
+<ul>
+<li><a href=#primitive-types>Primitive Types</a></li>
+<li><a href=#complex-types>Complex Types</a></li>
+<li><a href=#timestamp>Timestamp</a></li>
+</ul>
+</li>
+<li><a href=#built-in-operators-and-functions>Built In Operators and Functions</a>
+<ul>
+<li><a href=#built-in-operators>Built In Operators</a></li>
+<li><a href=#built-in-functions>Built In Functions</a></li>
+</ul>
+</li>
<li><a href=#language-capabilities>Language Capabilities</a></li>
</ul>
</li>
-<li><a href=#usage-and-examples>Usage and Examples</a></li>
+<li><a href=#usage-and-examples>Usage and Examples</a>
+<ul>
+<li><a href=#creating-showing-altering-and-dropping-tables>Creating, Showing, Altering, and Dropping Tables</a>
+<ul>
+<li><a href=#creating-tables>Creating Tables</a></li>
+<li><a href=#browsing-tables-and-partitions>Browsing Tables and Partitions</a></li>
+<li><a href=#altering-tables>Altering Tables</a></li>
+<li><a href=#dropping-tables-and-partitions>Dropping Tables and Partitions</a></li>
+</ul>
+</li>
+<li><a href=#loading-data>Loading Data</a></li>
+<li><a href=#httpsissuesapacheorgjirasecureviewavatarsizexsmallavatarid21140avatartypeissuetypehive-5999httpsissuesapacheorgjirabrowsehive-5999srcconfmacro><a href="https://issues.apache.org/jira/browse/HIVE-5999?src=confmacro"><img src="https://issues.apache.org/jira/secure/viewavatar?size=xsmall&avatarId=21140&avatarType=issuetype" alt>HIVE-5999</a></a></li>
+<li><a href=#httpsissuesapacheorgjirasecureviewavatarsizexsmallavatarid21133avatartypeissuetypehive-11996httpsissuesapacheorgjirabrowsehive-11996srcconfmacro><a href="https://issues.apache.org/jira/browse/HIVE-11996?src=confmacro"><img src="https://issues.apache.org/jira/secure/viewavatar?size=xsmall&avatarId=21133&avatarType=issuetype" alt>HIVE-11996</a></a></li>
+<li><a href=#querying-and-inserting-data>Querying and Inserting Data</a>
+<ul>
+<li><a href=#simple-query>Simple Query</a></li>
+<li><a href=#partition-based-query>Partition Based Query</a></li>
+<li><a href=#joins>Joins</a></li>
+<li><a href=#aggregations>Aggregations</a></li>
+<li><a href=#multi-tablefile-inserts>Multi Table/File Inserts</a></li>
+<li><a href=#dynamic-partition-insert>Dynamic-Partition Insert</a></li>
+<li><a href=#inserting-into-local-files>Inserting into Local Files</a></li>
+<li><a href=#sampling>Sampling</a></li>
+<li><a href=#union-all>Union All</a></li>
+<li><a href=#array-operations>Array Operations</a></li>
+<li><a href=#map-associative-arrays-operations>Map (Associative Arrays) Operations</a></li>
+<li><a href=#custom-mapreduce-scripts>Custom Map/Reduce Scripts</a></li>
+<li><a href=#co-groups>Co-Groups</a></li>
+</ul>
+</li>
</ul>
+</li>
+</ul>
+</nav>
+</aside>
<h1 id=concepts>Concepts</h1>
<h2 id=what-is-hive>What Is Hive</h2>
<p>Hive is a data warehousing infrastructure based on <a href=http://hadoop.apache.org/>Apache Hadoop</a>. Hadoop provides massive scale out and fault tolerance capabilities for data storage and processing on commodity hardware.</p>
diff --git a/docs/latest/unit-testing-hive-sql_61328063/index.html b/docs/latest/unit-testing-hive-sql_61328063/index.html
index c14c533..a06d153 100644
--- a/docs/latest/unit-testing-hive-sql_61328063/index.html
+++ b/docs/latest/unit-testing-hive-sql_61328063/index.html
@@ -121,20 +121,33 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--unit-testing-hive-sql>Apache Hive : Unit Testing Hive SQL</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--unit-testing-hive-sql>Apache Hive : Unit Testing Hive SQL</a></li>
<li><a href=#motivations>Motivations</a></li>
<li><a href=#challenges>Challenges</a></li>
<li><a href=#modularisation>Modularisation</a>
<ul>
+<li>
+<ul>
<li><a href=#encapsulation-of-column-level-logic>Encapsulation of column level logic</a></li>
<li><a href=#encapsulation-of-set-level-logic>Encapsulation of set level logic</a></li>
</ul>
</li>
+</ul>
+</li>
<li><a href=#tools-and-frameworks>Tools and frameworks</a></li>
<li><a href=#useful-practices>Useful practices</a></li>
<li><a href=#relevant-issues>Relevant issues</a></li>
-<li><a href=#other-hive-unit-testing-concerns>Other Hive unit testing concerns</a></li>
+<li><a href=#other-hive-unit-testing-concerns>Other Hive unit testing concerns</a>
+<ul>
+<li><a href=#comments>Comments:</a></li>
+</ul>
+</li>
</ul>
+</nav>
+</aside>
<h1 id=motivations>Motivations</h1>
<p>Hive is widely applied as a solution to numerous distinct problem types in the domain of big data. Quite clearly it is often used for the ad hoc querying of large datasets. However it is also used to implement ETL type processes. Unlike ad hoc queries, the Hive SQL written for ETLs has some distinct attributes:</p>
<ul>
diff --git a/docs/latest/user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2_58852417/index.html b/docs/latest/user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2_58852417/index.html
index 9a5fe32..66a7812 100644
--- a/docs/latest/user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2_58852417/index.html
+++ b/docs/latest/user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2_58852417/index.html
@@ -121,33 +121,24 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2>Apache Hive : User and Group Filter Support with LDAP Atn Provider in HiveServer2</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#user-and-group-filter-support-with-ldap>User and Group Filter Support with LDAP</a>
-<ul>
-<li><a href=#group-membership>Group Membership</a>
-<ul>
-<li><a href=#hiveserver2authenticationldapgroupdnpattern>hive.server2.authentication.ldap.groupDNPattern</a></li>
-<li><a href=#hiveserver2authenticationldapgroupfilter>hive.server2.authentication.ldap.groupFilter</a></li>
-<li><a href=#hiveserver2authenticationldapgroupmembershipkey>hive.server2.authentication.ldap.groupMembershipKey</a></li>
-<li><a href=#hiveserver2authenticationldapgroupclasskey>hive.server2.authentication.ldap.groupClassKey</a></li>
-</ul>
-</li>
-<li><a href=#user-search-list>User Search List</a>
+<li><a href=#apache-hive--user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2>Apache Hive : User and Group Filter Support with LDAP Atn Provider in HiveServer2</a>
<ul>
-<li><a href=#hiveserver2authenticationldapuserdnpattern>hive.server2.authentication.ldap.userDNPattern</a></li>
-<li><a href=#hiveserver2authenticationldapuserfilter>hive.server2.authentication.ldap.userFilter</a></li>
-</ul>
-</li>
-<li><a href=#custom-query-string>Custom Query String</a>
+<li><a href=#user-and-group-filter-support-with-ldap>User and Group Filter Support with LDAP</a>
<ul>
-<li><a href=#hiveserver2authenticationldapcustomldapquery>hive.server2.authentication.ldap.customLDAPQuery</a></li>
-<li><a href=#support-for-groups-in-custom-ldap-query>Support for Groups in Custom LDAP Query</a></li>
+<li><a href=#group-membership>Group Membership</a></li>
+<li><a href=#user-search-list>User Search List</a></li>
+<li><a href=#custom-query-string>Custom Query String</a></li>
+<li><a href=#order-of-precedence>Order of Precedence</a></li>
</ul>
</li>
-<li><a href=#order-of-precedence>Order of Precedence</a></li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=user-and-group-filter-support-with-ldap>User and Group Filter Support with LDAP</h2>
<p>Starting in Hive 1.3.0, <a href=https://issues.apache.org/jira/browse/HIVE-7193>HIVE-7193</a> adds support in HiveServer2 for</p>
<ul>
diff --git a/docs/latest/user-faq_27362095/index.html b/docs/latest/user-faq_27362095/index.html
index 7764519..d65df0a 100644
--- a/docs/latest/user-faq_27362095/index.html
+++ b/docs/latest/user-faq_27362095/index.html
@@ -121,13 +121,14 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--user-faq>Apache Hive : User FAQ</h1>
-<h1 id=hive-user-faq>Hive User FAQ</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-user-faq>Hive User FAQ</a>
+<li><a href=#apache-hive--user-faq>Apache Hive : User FAQ</a>
<ul>
<li><a href=#general>General</a>
<ul>
-<li><a href="#i-see-errors-like:-server-access-error:-connection-timed-out-url=http://archive-apache-org/dist/hadoop/core/hadoop-0-20-1/hadoop-0-20-1-tar-gz">I see errors like: Server access Error: Connection timed out url=http://archive.apache.org/dist/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz</a></li>
+<li><a href=#i-see-errors-like-server-access-error-connection-timed-out-urlhttparchiveapacheorgdisthadoopcorehadoop-0201hadoop-0201targz>I see errors like: Server access Error: Connection timed out url=<a href=http://archive.apache.org/dist/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz>http://archive.apache.org/dist/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz</a></a></li>
<li><a href=#how-to-change-the-warehousedir-location-for-older-tables>How to change the warehouse.dir location for older tables?</a></li>
<li><a href=#when-running-a-join-query-i-see-out-of-memory-errors>When running a JOIN query, I see out-of-memory errors.</a></li>
<li><a href=#mysql-excpeption>I am using MySQL as metastore and I see errors: “com.mysql.jdbc.exceptions.jdbc4.!CommunicationsException: Communications link failure”</a></li>
@@ -174,6 +175,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=general>General</h2>
<h3 id=i-see-errors-like-server-access-error-connection-timed-out-urlhttparchiveapacheorgdisthadoopcorehadoop-0201hadoop-0201targz>I see errors like: Server access Error: Connection timed out url=<a href=http://archive.apache.org/dist/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz>http://archive.apache.org/dist/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz</a></h3>
<p>Run the following commands:<br>
diff --git a/docs/latest/using-tidb-as-the-hive-metastore-database_158872426/index.html b/docs/latest/using-tidb-as-the-hive-metastore-database_158872426/index.html
index 3cde9d3..1375f32 100644
--- a/docs/latest/using-tidb-as-the-hive-metastore-database_158872426/index.html
+++ b/docs/latest/using-tidb-as-the-hive-metastore-database_158872426/index.html
@@ -121,9 +121,11 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--using-tidb-as-the-hive-metastore-database>Apache Hive : Using TiDB as the Hive Metastore database</h1>
-<h1 id=heading></h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#why-use-tidb-in-hive-as-the-metastore-database?>Why use TiDB in Hive as the Metastore database?</a></li>
+<li><a href=#apache-hive--using-tidb-as-the-hive-metastore-database>Apache Hive : Using TiDB as the Hive Metastore database</a></li>
+<li><a href=#why-use-tidb-in-hive-as-the-metastore-database>Why use TiDB in Hive as the Metastore database?</a></li>
<li><a href=#how-to-create-a-hive-cluster-with-tidb>How to create a Hive cluster with TiDB</a>
<ul>
<li><a href=#components-required>Components required</a></li>
@@ -140,7 +142,9 @@ ASF
<li><a href=#conclusion>Conclusion</a></li>
<li><a href=#faq>FAQ</a></li>
</ul>
-<p>Why use TiDB in Hive as the Metastore database?</p>
+</nav>
+</aside>
+<h1 id=why-use-tidb-in-hive-as-the-metastore-database>Why use TiDB in Hive as the Metastore database?</h1>
<p><a href=https://github.com/pingcap/tidb>TiDB</a> is a distributed SQL database built by <a href=https://pingcap.com/>PingCAP</a> and its open-source community. <strong>It is MySQL compatible and features horizontal scalability, strong consistency, and high availability.</strong> It’s a one-stop solution for both Online Transactional Processing (OLTP) and Online Analytical Processing (OLAP) workloads.</p>
<p>In scenarios with enormous amounts of data, due to TiDB’s distributed architecture, query performance is not limited to the capability of a single machine. When the data volume reaches the bottleneck, you can add nodes to improve TiDB’s storage capacity.</p>
<p>Because TiDB is compatible with the MySQL protocol, it’s easy to switch Hive’s Metastore database to TiDB. You can use TiDB as if you were using MySQL, with almost no changes:</p>
diff --git a/docs/latest/vectorized-query-execution_34838326/index.html b/docs/latest/vectorized-query-execution_34838326/index.html
index deca805..eb3e8ac 100644
--- a/docs/latest/vectorized-query-execution_34838326/index.html
+++ b/docs/latest/vectorized-query-execution_34838326/index.html
@@ -121,7 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--vectorized-query-execution>Apache Hive : Vectorized Query Execution</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
+<li><a href=#apache-hive--vectorized-query-execution>Apache Hive : Vectorized Query Execution</a></li>
<li><a href=#introduction>Introduction</a></li>
<li><a href=#using-vectorized-query-execution>Using Vectorized Query Execution</a>
<ul>
@@ -133,6 +136,8 @@ ASF
<li><a href=#limitations>Limitations</a></li>
<li><a href=#version-information>Version Information</a></li>
</ul>
+</nav>
+</aside>
<h1 id=introduction>Introduction</h1>
<p>Vectorized query execution is a Hive feature that greatly reduces the CPU usage for typical query operations like scans, filters, aggregates, and joins. A standard query execution system processes one row at a time. This involves long code paths and significant metadata interpretation in the inner loop of execution. Vectorized query execution streamlines operations by processing a block of 1024 rows at a time. Within the block, each column is stored as a vector (an array of a primitiv [...]
<h1 id=using-vectorized-query-execution>Using Vectorized Query Execution</h1>
diff --git a/docs/latest/viewdev_27362067/index.html b/docs/latest/viewdev_27362067/index.html
index a283022..ddeee6d 100644
--- a/docs/latest/viewdev_27362067/index.html
+++ b/docs/latest/viewdev_27362067/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--viewdev>Apache Hive : ViewDev</h1>
-<h1 id=hive-views>Hive Views</h1>
+<h1 id=apache-hive--views>Apache Hive : Views</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-views>Hive Views</a>
+<li><a href=#apache-hive--views>Apache Hive : Views</a>
<ul>
<li><a href=#use-cases>Use Cases</a></li>
<li><a href=#scope>Scope</a></li>
@@ -151,6 +152,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=use-cases>Use Cases</h2>
<p>Views (<a href=http://issues.apache.org/jira/browse/HIVE-972>http://issues.apache.org/jira/browse/HIVE-972</a>) are a standard DBMS feature and their uses are well understood. A typical use case might be to create an interface layer with a consistent entity/attribute naming scheme on top of an existing set of inconsistently named tables, without having to cause disruption due to direct modification of the tables. More advanced use cases would involve predefined filters, joins, aggrega [...]
<h2 id=scope>Scope</h2>
diff --git a/docs/latest/webhcat-configure_34015738/index.html b/docs/latest/webhcat-configure_34015738/index.html
index 76e3054..ba6b8a6 100644
--- a/docs/latest/webhcat-configure_34015738/index.html
+++ b/docs/latest/webhcat-configure_34015738/index.html
@@ -121,19 +121,22 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-configure>Apache Hive : WebHCat Configure</h1>
-<h1 id=webhcat-configuration>WebHCat Configuration</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#webhcat-configuration>WebHCat Configuration</a>
+<li><a href=#apache-hive--webhcat-configure>Apache Hive : WebHCat Configure</a>
<ul>
<li><a href=#configuration-files>Configuration Files</a></li>
<li><a href=#configuration-variables>Configuration Variables</a>
<ul>
-<li><a href=#default-values>Default Values</a></li>
+<li></li>
</ul>
</li>
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=configuration-files>Configuration Files</h2>
<p>The configuration for WebHCat (Templeton) merges the normal Hadoop configuration with the WebHCat-specific variables. Because WebHCat is designed to connect services that are not normally connected, the configuration is more complex than might be desirable.</p>
<p>The WebHCat-specific configuration is split into two layers:</p>
diff --git a/docs/latest/webhcat-installwebhcat_34015585/index.html b/docs/latest/webhcat-installwebhcat_34015585/index.html
index 5f96863..9a73caa 100644
--- a/docs/latest/webhcat-installwebhcat_34015585/index.html
+++ b/docs/latest/webhcat-installwebhcat_34015585/index.html
@@ -120,10 +120,11 @@ ASF
</header>
<div class=content>
<div class=docs>
-<h1 id=apache-hive--webhcat-installwebhcat>Apache Hive : WebHCat InstallWebHCat</h1>
-<h1 id=webhcat-installation>WebHCat Installation</h1>
+<h1 id=apache-hive--webhcat-installation>Apache Hive : WebHCat Installation</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#webhcat-installation>WebHCat Installation</a>
+<li><a href=#apache-hive--webhcat-installation>Apache Hive : WebHCat Installation</a>
<ul>
<li><a href=#webhcat-installed-with-hive>WebHCat Installed with Hive</a></li>
<li><a href=#webhcat-installation-procedure>WebHCat Installation Procedure</a></li>
@@ -136,8 +137,9 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=webhcat-installed-with-hive>WebHCat Installed with Hive</h2>
-<p>Version</p>
<p>WebHCat and HCatalog are installed with Hive, starting with Hive release 0.11.0.</p>
<p>If you install Hive from the binary tarball, the WebHCat server command <code>webhcat_server.sh</code> is in the <code>hcatalog/sbin</code> directory.</p>
<p>Hive installation is documented <a href=https://hive.apache.org/docs/latest/adminmanual-installation_27362077/>here</a>.</p>
diff --git a/docs/latest/webhcat-reference-ddl_34015990/index.html b/docs/latest/webhcat-reference-ddl_34015990/index.html
index e58ad60..41c59e6 100644
--- a/docs/latest/webhcat-reference-ddl_34015990/index.html
+++ b/docs/latest/webhcat-reference-ddl_34015990/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-ddl>Apache Hive : WebHCat Reference DDL</h1>
-<h1 id=ddl-command--post-ddl>DDL Command — POST ddl</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#ddl-command--post-ddl>DDL Command — POST ddl</a>
+<li><a href=#apache-hive--webhcat-reference-ddl>Apache Hive : WebHCat Reference DDL</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Performs an <a href=#hcatalog-ddl>HCatalog DDL</a> command. The command is executed immediately upon request. Responses are limited to 1 MB. For requests which may return longer results consider using the <a href=https://hive.apache.org/docs/latest/webhcat-reference-hive_34017180/>Hive resource</a> as an alternative.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-deletedb_34016281/index.html b/docs/latest/webhcat-reference-deletedb_34016281/index.html
index 8503f73..85eea6d 100644
--- a/docs/latest/webhcat-reference-deletedb_34016281/index.html
+++ b/docs/latest/webhcat-reference-deletedb_34016281/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-deletedb>Apache Hive : WebHCat Reference DeleteDB</h1>
-<h1 id=delete-database--delete-ddldatabasedb>Delete Database — DELETE ddl/database/:db</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#delete-database--delete-ddldatabasedb>Delete Database — DELETE ddl/database/:db</a>
+<li><a href=#apache-hive--webhcat-reference-deletedb>Apache Hive : WebHCat Reference DeleteDB</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Delete a database.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-deletejob_34017204/index.html b/docs/latest/webhcat-reference-deletejob_34017204/index.html
index 7fa7114..8477315 100644
--- a/docs/latest/webhcat-reference-deletejob_34017204/index.html
+++ b/docs/latest/webhcat-reference-deletejob_34017204/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-deletejob>Apache Hive : WebHCat Reference DeleteJob</h1>
-<h1 id=delete-job--delete-queuejobid>Delete Job — DELETE queue/:jobid</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#delete-job--delete-queuejobid>Delete Job — DELETE queue/:jobid</a>
+<li><a href=#apache-hive--webhcat-reference-deletejob>Apache Hive : WebHCat Reference DeleteJob</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Kill a job given its job ID. Substitute “:jobid” with the job ID received when the job was created.</p>
<p>Version: Deprecated in 0.12.0</p>
diff --git a/docs/latest/webhcat-reference-deletejobid_34835045/index.html b/docs/latest/webhcat-reference-deletejobid_34835045/index.html
index b5993d8..3b2a056 100644
--- a/docs/latest/webhcat-reference-deletejobid_34835045/index.html
+++ b/docs/latest/webhcat-reference-deletejobid_34835045/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-deletejobid>Apache Hive : WebHCat Reference DeleteJobID</h1>
-<h1 id=delete-job--delete-jobsjobid>Delete Job — DELETE jobs/:jobid</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#delete-job--delete-jobsjobid>Delete Job — DELETE jobs/:jobid</a>
+<li><a href=#apache-hive--webhcat-reference-deletejobid>Apache Hive : WebHCat Reference DeleteJobID</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Kill a job given its job ID. Substitute “:jobid” with the job ID received when the job was created.</p>
<p>Version: Hive 0.12.0 and later</p>
diff --git a/docs/latest/webhcat-reference-deletepartition_34016611/index.html b/docs/latest/webhcat-reference-deletepartition_34016611/index.html
index 082dcf5..1c7ac40 100644
--- a/docs/latest/webhcat-reference-deletepartition_34016611/index.html
+++ b/docs/latest/webhcat-reference-deletepartition_34016611/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-deletepartition>Apache Hive : WebHCat Reference DeletePartition</h1>
-<h1 id=delete-partition--delete-ddldatabasedbtabletablepartitionpartition>Delete Partition — DELETE ddl/database/:db/table/:table/partition/:partition</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#delete-partition--delete-ddldatabasedbtabletablepartitionpartition>Delete Partition — DELETE ddl/database/:db/table/:table/partition/:partition</a>
+<li><a href=#apache-hive--webhcat-reference-deletepartition>Apache Hive : WebHCat Reference DeletePartition</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Delete (drop) a partition in an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-deletetable_34016561/index.html b/docs/latest/webhcat-reference-deletetable_34016561/index.html
index 6237bd5..fd3b216 100644
--- a/docs/latest/webhcat-reference-deletetable_34016561/index.html
+++ b/docs/latest/webhcat-reference-deletetable_34016561/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-deletetable>Apache Hive : WebHCat Reference DeleteTable</h1>
-<h1 id=delete-table--delete-ddldatabasedbtabletable>Delete Table — DELETE ddl/database/:db/table/:table</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#delete-table--delete-ddldatabasedbtabletable>Delete Table — DELETE ddl/database/:db/table/:table</a>
+<li><a href=#apache-hive--webhcat-reference-deletetable>Apache Hive : WebHCat Reference DeleteTable</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Delete (drop) an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-getcolumn_34016979/index.html b/docs/latest/webhcat-reference-getcolumn_34016979/index.html
index 1dee163..6bd5a4b 100644
--- a/docs/latest/webhcat-reference-getcolumn_34016979/index.html
+++ b/docs/latest/webhcat-reference-getcolumn_34016979/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-getcolumn>Apache Hive : WebHCat Reference GetColumn</h1>
-<h1 id=describe-column--get-ddldatabasedbtabletablecolumncolumn>Describe Column — GET ddl/database/:db/table/:table/column/:column</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#describe-column--get-ddldatabasedbtabletablecolumncolumn>Describe Column — GET ddl/database/:db/table/:table/column/:column</a>
+<li><a href=#apache-hive--webhcat-reference-getcolumn>Apache Hive : WebHCat Reference GetColumn</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Describe a single column in an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-getcolumns_34016970/index.html b/docs/latest/webhcat-reference-getcolumns_34016970/index.html
index 29f7dc8..980a375 100644
--- a/docs/latest/webhcat-reference-getcolumns_34016970/index.html
+++ b/docs/latest/webhcat-reference-getcolumns_34016970/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-getcolumns>Apache Hive : WebHCat Reference GetColumns</h1>
-<h1 id=list-columns--get-ddldatabasedbtabletablecolumn>List Columns — GET ddl/database/:db/table/:table/column</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#list-columns--get-ddldatabasedbtabletablecolumn>List Columns — GET ddl/database/:db/table/:table/column</a>
+<li><a href=#apache-hive--webhcat-reference-getcolumns>Apache Hive : WebHCat Reference GetColumns</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>List the columns in an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-getdb_34016250/index.html b/docs/latest/webhcat-reference-getdb_34016250/index.html
index a0d561d..ba7a411 100644
--- a/docs/latest/webhcat-reference-getdb_34016250/index.html
+++ b/docs/latest/webhcat-reference-getdb_34016250/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-getdb>Apache Hive : WebHCat Reference GetDB</h1>
-<h1 id=describe-database--get-ddldatabasedb>Describe Database — GET ddl/database/:db</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#describe-database--get-ddldatabasedb>Describe Database — GET ddl/database/:db</a>
+<li><a href=#apache-hive--webhcat-reference-getdb>Apache Hive : WebHCat Reference GetDB</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Describe a database. (Note: This resource has a “format=extended” parameter however the output structure does not change if it is used.)</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-getdbs_34016238/index.html b/docs/latest/webhcat-reference-getdbs_34016238/index.html
index 6622c20..5dfc57e 100644
--- a/docs/latest/webhcat-reference-getdbs_34016238/index.html
+++ b/docs/latest/webhcat-reference-getdbs_34016238/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-getdbs>Apache Hive : WebHCat Reference GetDBs</h1>
-<h1 id=list-databases--get-ddldatabase>List Databases — GET ddl/database</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#list-databases--get-ddldatabase>List Databases — GET ddl/database</a>
+<li><a href=#apache-hive--webhcat-reference-getdbs>Apache Hive : WebHCat Reference GetDBs</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>List the databases in HCatalog.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-getpartition_34016592/index.html b/docs/latest/webhcat-reference-getpartition_34016592/index.html
index e0e439c..3dd140c 100644
--- a/docs/latest/webhcat-reference-getpartition_34016592/index.html
+++ b/docs/latest/webhcat-reference-getpartition_34016592/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-getpartition>Apache Hive : WebHCat Reference GetPartition</h1>
-<h1 id=describe-partition--get-ddldatabasedbtabletablepartitionpartition>Describe Partition — GET ddl/database/:db/table/:table/partition/:partition</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#describe-partition--get-ddldatabasedbtabletablepartitionpartition>Describe Partition — GET ddl/database/:db/table/:table/partition/:partition</a>
+<li><a href=#apache-hive--webhcat-reference-getpartition>Apache Hive : WebHCat Reference GetPartition</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Describe a single partition in an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-getpartitions_34016583/index.html b/docs/latest/webhcat-reference-getpartitions_34016583/index.html
index fdc117a..413987e 100644
--- a/docs/latest/webhcat-reference-getpartitions_34016583/index.html
+++ b/docs/latest/webhcat-reference-getpartitions_34016583/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-getpartitions>Apache Hive : WebHCat Reference GetPartitions</h1>
-<h1 id=list-partitions--get-ddldatabasedbtabletablepartition>List Partitions — GET ddl/database/:db/table/:table/partition</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#list-partitions--get-ddldatabasedbtabletablepartition>List Partitions — GET ddl/database/:db/table/:table/partition</a>
+<li><a href=#apache-hive--webhcat-reference-getpartitions>Apache Hive : WebHCat Reference GetPartitions</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>List all the partitions in an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-getproperties_34016995/index.html b/docs/latest/webhcat-reference-getproperties_34016995/index.html
index 105ea28..d4a6659 100644
--- a/docs/latest/webhcat-reference-getproperties_34016995/index.html
+++ b/docs/latest/webhcat-reference-getproperties_34016995/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-getproperties>Apache Hive : WebHCat Reference GetProperties</h1>
-<h1 id=list-properties--get-ddldatabasedbtabletableproperty>List Properties — GET ddl/database/:db/table/:table/property</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#list-properties--get-ddldatabasedbtabletableproperty>List Properties — GET ddl/database/:db/table/:table/property</a>
+<li><a href=#apache-hive--webhcat-reference-getproperties>Apache Hive : WebHCat Reference GetProperties</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>List all the properties of an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-getproperty_34017004/index.html b/docs/latest/webhcat-reference-getproperty_34017004/index.html
index f2caa54..a566310 100644
--- a/docs/latest/webhcat-reference-getproperty_34017004/index.html
+++ b/docs/latest/webhcat-reference-getproperty_34017004/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-getproperty>Apache Hive : WebHCat Reference GetProperty</h1>
-<h1 id=property-value--get-ddldatabasedbtabletablepropertyproperty>Property Value — GET ddl/database/:db/table/:table/property/:property</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#property-value--get-ddldatabasedbtabletablepropertyproperty>Property Value — GET ddl/database/:db/table/:table/property/:property</a>
+<li><a href=#apache-hive--webhcat-reference-getproperty>Apache Hive : WebHCat Reference GetProperty</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Return the value of a single table property.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-gettable_34016519/index.html b/docs/latest/webhcat-reference-gettable_34016519/index.html
index c9b98cf..0deaaa2 100644
--- a/docs/latest/webhcat-reference-gettable_34016519/index.html
+++ b/docs/latest/webhcat-reference-gettable_34016519/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-gettable>Apache Hive : WebHCat Reference GetTable</h1>
-<h1 id=describe-table--get-ddldatabasedbtabletable>Describe Table — GET ddl/database/:db/table/:table</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#describe-table--get-ddldatabasedbtabletable>Describe Table — GET ddl/database/:db/table/:table</a>
+<li><a href=#apache-hive--webhcat-reference-gettable>Apache Hive : WebHCat Reference GetTable</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -141,6 +142,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Describe an HCatalog table. Normally returns a simple list of columns (using “desc table”), but the extended format will show more information (using “show table extended like”).</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-gettables_34016290/index.html b/docs/latest/webhcat-reference-gettables_34016290/index.html
index 0d95973..ff98379 100644
--- a/docs/latest/webhcat-reference-gettables_34016290/index.html
+++ b/docs/latest/webhcat-reference-gettables_34016290/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-gettables>Apache Hive : WebHCat Reference GetTables</h1>
-<h1 id=list-tables--get-ddldatabasedbtable>List Tables — GET ddl/database/:db/table</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#list-tables--get-ddldatabasedbtable>List Tables — GET ddl/database/:db/table</a>
+<li><a href=#apache-hive--webhcat-reference-gettables>Apache Hive : WebHCat Reference GetTables</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>List the tables in an HCatalog database.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-hive_34017180/index.html b/docs/latest/webhcat-reference-hive_34017180/index.html
index d2065c5..547c29d 100644
--- a/docs/latest/webhcat-reference-hive_34017180/index.html
+++ b/docs/latest/webhcat-reference-hive_34017180/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-hive>Apache Hive : WebHCat Reference Hive</h1>
-<h1 id=hive-job--post-hive>Hive Job — POST hive</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-job--post-hive>Hive Job — POST hive</a>
+<li><a href=#apache-hive--webhcat-reference-hive>Apache Hive : WebHCat Reference Hive</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Runs a <a href=http://hive.apache.org/>Hive</a> query or set of commands.</p>
<p>Version: Hive 0.13.0 and later</p>
diff --git a/docs/latest/webhcat-reference-job_34835065/index.html b/docs/latest/webhcat-reference-job_34835065/index.html
index 355407c..dd8e790 100644
--- a/docs/latest/webhcat-reference-job_34835065/index.html
+++ b/docs/latest/webhcat-reference-job_34835065/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-job>Apache Hive : WebHCat Reference Job</h1>
-<h1 id=job-information--get-jobsjobid>Job Information — GET jobs/:jobid</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#job-information--get-jobsjobid>Job Information — GET jobs/:jobid</a>
+<li><a href=#apache-hive--webhcat-reference-job>Apache Hive : WebHCat Reference Job</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Check the status of a job and get related job information given its job ID. Substitute “:jobid” with the job ID received when the job was created.</p>
<p>Version: Hive 0.12.0 and later</p>
diff --git a/docs/latest/webhcat-reference-jobids_34017187/index.html b/docs/latest/webhcat-reference-jobids_34017187/index.html
index 823e75a..8501f35 100644
--- a/docs/latest/webhcat-reference-jobids_34017187/index.html
+++ b/docs/latest/webhcat-reference-jobids_34017187/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-jobids>Apache Hive : WebHCat Reference JobIDs</h1>
-<h1 id=list-jobids--get-queue>List JobIDs — GET queue</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#list-jobids--get-queue>List JobIDs — GET queue</a>
+<li><a href=#apache-hive--webhcat-reference-jobids>Apache Hive : WebHCat Reference JobIDs</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Return a list of all job IDs.</p>
<p>Version: Deprecated in 0.12.0</p>
diff --git a/docs/latest/webhcat-reference-jobinfo_34017194/index.html b/docs/latest/webhcat-reference-jobinfo_34017194/index.html
index 0d896d2..ebd0df2 100644
--- a/docs/latest/webhcat-reference-jobinfo_34017194/index.html
+++ b/docs/latest/webhcat-reference-jobinfo_34017194/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-jobinfo>Apache Hive : WebHCat Reference JobInfo</h1>
-<h1 id=job-information--get-queuejobid>Job Information — GET queue/:jobid</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#job-information--get-queuejobid>Job Information — GET queue/:jobid</a>
+<li><a href=#apache-hive--webhcat-reference-jobinfo>Apache Hive : WebHCat Reference JobInfo</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Check the status of a job and get related job information given its job ID. Substitute “:jobid” with the job ID received when the job was created.</p>
<p>Version: Deprecated in 0.12.0</p>
diff --git a/docs/latest/webhcat-reference-jobs_34835057/index.html b/docs/latest/webhcat-reference-jobs_34835057/index.html
index 7c01c24..c388b76 100644
--- a/docs/latest/webhcat-reference-jobs_34835057/index.html
+++ b/docs/latest/webhcat-reference-jobs_34835057/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-jobs>Apache Hive : WebHCat Reference Jobs</h1>
-<h1 id=list-jobids--get-jobs>List JobIDs — GET jobs</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#list-jobids--get-jobs>List JobIDs — GET jobs</a>
+<li><a href=#apache-hive--webhcat-reference-jobs>Apache Hive : WebHCat Reference Jobs</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -142,6 +143,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Return a list of all job IDs.</p>
<p>Version: Hive 0.12.0 and later</p>
diff --git a/docs/latest/webhcat-reference-mapreducejar_34017030/index.html b/docs/latest/webhcat-reference-mapreducejar_34017030/index.html
index 8763e45..b9c40e5 100644
--- a/docs/latest/webhcat-reference-mapreducejar_34017030/index.html
+++ b/docs/latest/webhcat-reference-mapreducejar_34017030/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-mapreducejar>Apache Hive : WebHCat Reference MapReduceJar</h1>
-<h1 id=mapreduce-job--post-mapreducejar>MapReduce Job — POST mapreduce/jar</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#mapreduce-job--post-mapreducejar>MapReduce Job — POST mapreduce/jar</a>
+<li><a href=#apache-hive--webhcat-reference-mapreducejar>Apache Hive : WebHCat Reference MapReduceJar</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Creates and queues a standard <a href=http://hadoop.apache.org/docs/stable/commands_manual.html>Hadoop MapReduce</a> job.</p>
<p>Version: Hive 0.13.0 and later</p>
diff --git a/docs/latest/webhcat-reference-mapreducestream_34017023/index.html b/docs/latest/webhcat-reference-mapreducestream_34017023/index.html
index f941d16..b9f3ca6 100644
--- a/docs/latest/webhcat-reference-mapreducestream_34017023/index.html
+++ b/docs/latest/webhcat-reference-mapreducestream_34017023/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-mapreducestream>Apache Hive : WebHCat Reference MapReduceStream</h1>
-<h1 id=mapreduce-streaming-job--post-mapreducestreaming>MapReduce Streaming Job — POST mapreduce/streaming</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#mapreduce-streaming-job--post-mapreducestreaming>MapReduce Streaming Job — POST mapreduce/streaming</a>
+<li><a href=#apache-hive--webhcat-reference-mapreducestream>Apache Hive : WebHCat Reference MapReduceStream</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -140,6 +141,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Create and queue a <a href=http://hadoop.apache.org/docs/stable/streaming.html>Hadoop streaming MapReduce</a> job.</p>
<p>Version: Hive 0.13.0 and later</p>
diff --git a/docs/latest/webhcat-reference-pig_34017169/index.html b/docs/latest/webhcat-reference-pig_34017169/index.html
index c5e06fd..506eb80 100644
--- a/docs/latest/webhcat-reference-pig_34017169/index.html
+++ b/docs/latest/webhcat-reference-pig_34017169/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-pig>Apache Hive : WebHCat Reference Pig</h1>
-<h1 id=pig-job--post-pig>Pig Job — POST pig</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#pig-job--post-pig>Pig Job — POST pig</a>
+<li><a href=#apache-hive--webhcat-reference-pig>Apache Hive : WebHCat Reference Pig</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Create and queue a <a href=http://pig.apache.org/>Pig</a> job.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-posttable_34016548/index.html b/docs/latest/webhcat-reference-posttable_34016548/index.html
index 21fd9fa..2ced394 100644
--- a/docs/latest/webhcat-reference-posttable_34016548/index.html
+++ b/docs/latest/webhcat-reference-posttable_34016548/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-posttable>Apache Hive : WebHCat Reference PostTable</h1>
-<h1 id=rename-table--post-ddldatabasedbtabletable>Rename Table — POST ddl/database/:db/table/:table</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#rename-table--post-ddldatabasedbtabletable>Rename Table — POST ddl/database/:db/table/:table</a>
+<li><a href=#apache-hive--webhcat-reference-posttable>Apache Hive : WebHCat Reference PostTable</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Rename an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-putcolumn_34016987/index.html b/docs/latest/webhcat-reference-putcolumn_34016987/index.html
index 1fe491f..bb24c64 100644
--- a/docs/latest/webhcat-reference-putcolumn_34016987/index.html
+++ b/docs/latest/webhcat-reference-putcolumn_34016987/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-putcolumn>Apache Hive : WebHCat Reference PutColumn</h1>
-<h1 id=create-column--put-ddldatabasedbtabletablecolumncolumn>Create Column — PUT ddl/database/:db/table/:table/column/:column</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#create-column--put-ddldatabasedbtabletablecolumncolumn>Create Column — PUT ddl/database/:db/table/:table/column/:column</a>
+<li><a href=#apache-hive--webhcat-reference-putcolumn>Apache Hive : WebHCat Reference PutColumn</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Create a column in an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-putdb_34016273/index.html b/docs/latest/webhcat-reference-putdb_34016273/index.html
index 5f7d68e..9e69267 100644
--- a/docs/latest/webhcat-reference-putdb_34016273/index.html
+++ b/docs/latest/webhcat-reference-putdb_34016273/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-putdb>Apache Hive : WebHCat Reference PutDB</h1>
-<h1 id=create-database--put-ddldatabasedb>Create Database — PUT ddl/database/:db</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#create-database--put-ddldatabasedb>Create Database — PUT ddl/database/:db</a>
+<li><a href=#apache-hive--webhcat-reference-putdb>Apache Hive : WebHCat Reference PutDB</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Create a database.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-putpartition_34016600/index.html b/docs/latest/webhcat-reference-putpartition_34016600/index.html
index acd6fe0..00c1c0b 100644
--- a/docs/latest/webhcat-reference-putpartition_34016600/index.html
+++ b/docs/latest/webhcat-reference-putpartition_34016600/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-putpartition>Apache Hive : WebHCat Reference PutPartition</h1>
-<h1 id=create-partition--put-ddldatabasedbtabletablepartitionpartition>Create Partition — PUT ddl/database/:db/table/:table/partition/:partition</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#create-partition--put-ddldatabasedbtabletablepartitionpartition>Create Partition — PUT ddl/database/:db/table/:table/partition/:partition</a>
+<li><a href=#apache-hive--webhcat-reference-putpartition>Apache Hive : WebHCat Reference PutPartition</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Create a partition in an HCatalog table.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-putproperty_34017012/index.html b/docs/latest/webhcat-reference-putproperty_34017012/index.html
index d81e5ad..049ef89 100644
--- a/docs/latest/webhcat-reference-putproperty_34017012/index.html
+++ b/docs/latest/webhcat-reference-putproperty_34017012/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-putproperty>Apache Hive : WebHCat Reference PutProperty</h1>
-<h1 id=set-property--put-ddldatabasedbtabletablepropertyproperty>Set Property — PUT ddl/database/:db/table/:table/property/:property</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#set-property--put-ddldatabasedbtabletablepropertyproperty>Set Property — PUT ddl/database/:db/table/:table/property/:property</a>
+<li><a href=#apache-hive--webhcat-reference-putproperty>Apache Hive : WebHCat Reference PutProperty</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Add a single property on an HCatalog table. This will also reset an existing property.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-puttable_34016540/index.html b/docs/latest/webhcat-reference-puttable_34016540/index.html
index ddc017d..1d43ff1 100644
--- a/docs/latest/webhcat-reference-puttable_34016540/index.html
+++ b/docs/latest/webhcat-reference-puttable_34016540/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-puttable>Apache Hive : WebHCat Reference PutTable</h1>
-<h1 id=create-table--put-ddldatabasedbtabletable>Create Table — PUT ddl/database/:db/table/:table</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#create-table--put-ddldatabasedbtabletable>Create Table — PUT ddl/database/:db/table/:table</a>
+<li><a href=#apache-hive--webhcat-reference-puttable>Apache Hive : WebHCat Reference PutTable</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -140,6 +141,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Create a new HCatalog table. For more information, please refer to the Hive documentation for <a href=#create-table>CREATE TABLE</a>.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-puttablelike_34016572/index.html b/docs/latest/webhcat-reference-puttablelike_34016572/index.html
index 179b9b4..b4c7cdf 100644
--- a/docs/latest/webhcat-reference-puttablelike_34016572/index.html
+++ b/docs/latest/webhcat-reference-puttablelike_34016572/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-puttablelike>Apache Hive : WebHCat Reference PutTableLike</h1>
-<h1 id=create-table-like--put-ddldatabasedbtableexistingtablelikenewtable>Create Table Like — PUT ddl/database/:db/table/:existingtable/like/:newtable</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#create-table-like--put-ddldatabasedbtableexistingtablelikenewtable>Create Table Like — PUT ddl/database/:db/table/:existingtable/like/:newtable</a>
+<li><a href=#apache-hive--webhcat-reference-puttablelike>Apache Hive : WebHCat Reference PutTableLike</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Create a new HCatalog table like an existing one.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-responsetypes_34015937/index.html b/docs/latest/webhcat-reference-responsetypes_34015937/index.html
index d190106..f19401f 100644
--- a/docs/latest/webhcat-reference-responsetypes_34015937/index.html
+++ b/docs/latest/webhcat-reference-responsetypes_34015937/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-responsetypes>Apache Hive : WebHCat Reference ResponseTypes</h1>
-<h1 id=response-types--get-version>Response Types — GET :version</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#response-types--get-version>Response Types — GET :version</a>
+<li><a href=#apache-hive--webhcat-reference-responsetypes>Apache Hive : WebHCat Reference ResponseTypes</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -139,6 +140,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Returns a list of the response types supported by WebHCat (Templeton).</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-status_34015941/index.html b/docs/latest/webhcat-reference-status_34015941/index.html
index 9cbf454..ef972f7 100644
--- a/docs/latest/webhcat-reference-status_34015941/index.html
+++ b/docs/latest/webhcat-reference-status_34015941/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-status>Apache Hive : WebHCat Reference Status</h1>
-<h1 id=current-status--get-status>Current Status — GET status</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#current-status--get-status>Current Status — GET status</a>
+<li><a href=#apache-hive--webhcat-reference-status>Apache Hive : WebHCat Reference Status</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Returns the current status of the WebHCat (Templeton) server. Useful for heartbeat monitoring.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-version_34015986/index.html b/docs/latest/webhcat-reference-version_34015986/index.html
index 2f4109e..4345867 100644
--- a/docs/latest/webhcat-reference-version_34015986/index.html
+++ b/docs/latest/webhcat-reference-version_34015986/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-version>Apache Hive : WebHCat Reference Version</h1>
-<h1 id=list-versions--get-version>List Versions — GET version</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#list-versions--get-version>List Versions — GET version</a>
+<li><a href=#apache-hive--webhcat-reference-version>Apache Hive : WebHCat Reference Version</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Returns a list of supported versions and the current version.</p>
<h2 id=url>URL</h2>
diff --git a/docs/latest/webhcat-reference-versionhadoop_44303410/index.html b/docs/latest/webhcat-reference-versionhadoop_44303410/index.html
index 1f8f5b5..52f012c 100644
--- a/docs/latest/webhcat-reference-versionhadoop_44303410/index.html
+++ b/docs/latest/webhcat-reference-versionhadoop_44303410/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-versionhadoop>Apache Hive : WebHCat Reference VersionHadoop</h1>
-<h1 id=hadoop-version--get-versionhadoop>Hadoop Version — GET version/hadoop</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hadoop-version--get-versionhadoop>Hadoop Version — GET version/hadoop</a>
+<li><a href=#apache-hive--webhcat-reference-versionhadoop>Apache Hive : WebHCat Reference VersionHadoop</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Return the version of Hadoop being run when WebHCat creates a MapReduce job (<a href=https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/>POST mapreduce/jar</a> or <a href=https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/>mapreduce/streaming</a>).</p>
<p>Version: Hive 0.13.0 and later</p>
diff --git a/docs/latest/webhcat-reference-versionhive_44303406/index.html b/docs/latest/webhcat-reference-versionhive_44303406/index.html
index 20b7967..64b6411 100644
--- a/docs/latest/webhcat-reference-versionhive_44303406/index.html
+++ b/docs/latest/webhcat-reference-versionhive_44303406/index.html
@@ -121,9 +121,10 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-reference-versionhive>Apache Hive : WebHCat Reference VersionHive</h1>
-<h1 id=hive-version--get-versionhive>Hive Version — GET version/hive</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#hive-version--get-versionhive>Hive Version — GET version/hive</a>
+<li><a href=#apache-hive--webhcat-reference-versionhive>Apache Hive : WebHCat Reference VersionHive</a>
<ul>
<li><a href=#description>Description</a></li>
<li><a href=#url>URL</a></li>
@@ -138,6 +139,8 @@ ASF
</ul>
</li>
</ul>
+</nav>
+</aside>
<h2 id=description>Description</h2>
<p>Return the version of Hive being run when WebHCat issues Hive queries or commands (<a href=https://hive.apache.org/docs/latest/webhcat-reference-hive_34017180/>POST hive</a>).</p>
<p>Version: Hive 0.13.0 and later</p>
diff --git a/docs/latest/webhcat-usingwebhcat_34015492/index.html b/docs/latest/webhcat-usingwebhcat_34015492/index.html
index 8b3cb03..5c5a39b 100644
--- a/docs/latest/webhcat-usingwebhcat_34015492/index.html
+++ b/docs/latest/webhcat-usingwebhcat_34015492/index.html
@@ -121,19 +121,17 @@ ASF
<div class=content>
<div class=docs>
<h1 id=apache-hive--webhcat-usingwebhcat>Apache Hive : WebHCat UsingWebHCat</h1>
-<h1 id=using-the-hcatalog-rest-api-webhcat>Using the HCatalog REST API (WebHCat)</h1>
+<aside class=table-of-contents>
+<nav id=TableOfContents>
<ul>
-<li><a href=#using-the-hcatalog-rest-api-webhcat>Using the HCatalog REST API (WebHCat)</a>
+<li><a href=#apache-hive--webhcat-usingwebhcat>Apache Hive : WebHCat UsingWebHCat</a>
<ul>
+<li><a href=#version-information>Version information</a></li>
<li><a href=#introduction-to-webhcat>Introduction to WebHCat</a></li>
<li><a href=#url-format>URL Format</a></li>
<li><a href=#security>Security</a>
<ul>
-<li><a href=#standard-parameters>Standard Parameters</a>
-<ul>
-<li><a href=#specifying-username>Specifying user.name</a></li>
-</ul>
-</li>
+<li><a href=#standard-parameters>Standard Parameters</a></li>
<li><a href=#security-error-response>Security Error Response</a></li>
</ul>
</li>
@@ -141,10 +139,13 @@ ASF
<li><a href=#error-codes-and-responses>Error Codes and Responses</a></li>
<li><a href=#log-files>Log Files</a></li>
<li><a href=#project-name>Project Name</a></li>
+<li><a href=#attachments>Attachments:</a></li>
</ul>
</li>
</ul>
-<p>Version information</p>
+</nav>
+</aside>
+<h2 id=version-information>Version information</h2>
<p>The HCatalog project graduated from the Apache incubator and merged with the Hive project on March 26, 2013.<br>
Hive version 0.11.0 is the first release that includes HCatalog and its REST API, WebHCat.</p>
<h2 id=introduction-to-webhcat>Introduction to WebHCat</h2>
diff --git a/index.json b/index.json
index 80c4561..b80ac52 100644
--- a/index.json
+++ b/index.json
@@ -1 +1 @@
-[{"categories":null,"contents":"Query File Test(qtest) Query File Test is a JUnit-based integration test suite for Apache Hive. Developers write any SQL; the testing framework runs it and verifies the result and output.\n Tutorial: How to run a specific test case Preparation Run a test case Tutorial: How to add a new test case Add a QFile Generate a result file Verify the new result file Commandline options Test options Test Iceberg, Accumulo, or Kudu QTestOptionHandler: pre/pos [...]
\ No newline at end of file
+[{"categories":null,"contents":"Query File Test(qtest) Query File Test is a JUnit-based integration test suite for Apache Hive. Developers write any SQL; the testing framework runs it and verifies the result and output.\n Query File Test(qtest) Tutorial: How to run a specific test case Preparation Run a test case Tutorial: How to add a new test case Add a QFile Generate a result file Verify the new result file Commandline options Test options Test Iceberg, Accumulo, or Kudu QTe [...]
\ No newline at end of file
diff --git a/index.xml b/index.xml
index 9d163a8..8a4a2e0 100644
--- a/index.xml
+++ b/index.xml
@@ -1,23 +1,18 @@
<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Hive on Hive Site</title><link>https://hive.apache.org/</link><description>Recent content in Apache Hive on Hive Site</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><lastBuildDate>Fri, 27 Jan 2023 19:16:15 +0530</lastBuildDate><atom:link href="https://hive.apache.org/index.xml" rel="self" type="application/rss+xml"/><ite [...]
-Tutorial: How to run a specific test case Preparation Run a test case Tutorial: How to add a new test case Add a QFile Generate a result file Verify the new result file Commandline options Test options Test Iceberg, Accumulo, or Kudu QTestOptionHandler: pre/post-processor Using test data Mask non-deterministic outputs Advanced Locations of log files Negative tests How to specify drivers How to use PostgreSQL/MySQL/Oracle as a backend database for Hive Metastore Remote debug Tips for Addi [...]
-Make Apache Hive’s data model and metadata services accessible to users of the Apache Pig dataflow programming language as well as other Hadoop language runtimes. Make it possible for Hive users and users of other Hadoop language runtimes to share data stored in Hive’s HDFS data warehouse.</description></item><item><title>Apache Hive : AccumuloIntegration</title><link>https://hive.apache.org/docs/latest/accumulointegration_46633569/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate [...]
-Version Note Introduction Changes From Hive 2 to Hive 3 General Configuration RDBMS Option 1: Embedding Derby Option 2: External RDBMS Supported RDBMSs Installing and Upgrading the Metastore Schema Running the Metastore Embedded Mode Metastore Server High Availability Securing the Service Running the Metastore Without Hive Performance Optimizations CachedStore Less Commonly Changed Configuration Parameters Version Note This document applies only to the Metastore in Hive 3.</description>< [...]
+Query File Test(qtest) Tutorial: How to run a specific test case Preparation Run a test case Tutorial: How to add a new test case Add a QFile Generate a result file Verify the new result file Commandline options Test options Test Iceberg, Accumulo, or Kudu QTestOptionHandler: pre/post-processor Using test data Mask non-deterministic outputs Advanced Locations of log files Negative tests How to specify drivers How to use PostgreSQL/MySQL/Oracle as a backend database for Hive Metastore Rem [...]
+Make Apache Hive’s data model and metadata services accessible to users of the Apache Pig dataflow programming language as well as other Hadoop language runtimes. Make it possible for Hive users and users of other Hadoop language runtimes to share data stored in Hive’s HDFS data warehouse.</description></item><item><title>Apache Hive : AccumuloIntegration</title><link>https://hive.apache.org/docs/latest/accumulointegration_46633569/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate [...]
+Apache Hive : AdminManual Metastore Administration Introduction Local/Embedded Metastore Database (Derby) Remote Metastore Database Local/Embedded Metastore Server Remote Metastore Server Supported Backend Databases for Metastore Metastore Schema Consistency and Upgrades Introduction All the metadata for Hive tables and partitions are accessed through the Hive Metastore.</description></item><item><title>Apache Hive : AdminManual SettingUpHiveServer</title><link>https://hive.apache.org/do [...]
This information is versioned by Hive release version, allowing a user to quickly identify features available to them.
-The formal name of the current SQL standard is ISO/IEC 9075 &ldquo;Database Language SQL&rdquo;.</description></item><item><title>Apache Hive : AuthDev</title><link>https://hive.apache.org/docs/latest/authdev_27362078/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/authdev_27362078/</guid><description>Apache Hive : AuthDev Index
-1. Privilege 1.1 Access Privilege 2. Hive Operations 3. Metadata 3.1 user, group, and roles 3.1.1 Role management 3.1.2 role metadata 3.1.3 hive role user membership table 3.2 Privileges to be supported by Hive 3.2.1 metadata 4. grant/revoke access privilege 4.1 Privilege names/types: 4.2 show grant 4.3 grant/revoke statement 5.</description></item><item><title>Apache Hive : AvroSerDe</title><link>https://hive.apache.org/docs/latest/avroserde_27850707/</link><pubDate>Thu, 12 Dec 2024 00: [...]
-Overview – Working with Avro from Hive
-Requirements
-Avro to Hive type conversion
-Creating Avro-backed Hive tables
-All Hive versions Hive 0.14 and later versions Writing tables to Avro files
-- [Example](#example)+ [All Hive versions](#all-hive-versions) Hive 0.14 and later Avro file extension Specifying the Avro schema for a table</description></item><item><title>Apache Hive : BecomingACommitter</title><link>https://hive.apache.org/community/becomingcommitter/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/community/becomingcommitter/</guid><description>Apache Hive : BecomingACommitter Becoming A Hive Committer The Apache Software Found [...]
-Committer Zen Contributors often ask Hive PMC members the question, &ldquo;What do I need to do in order to become a committer?</description></item><item><title>Apache Hive : Binary DataType Proposal</title><link>https://hive.apache.org/docs/latest/binary-datatype-proposal_27826614/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/binary-datatype-proposal_27826614/</guid><description>Apache Hive : Binary DataType Proposal Binary Type i [...]
-Patterns are case-insensitive, except AM/PM and T/Z. See these sections for more details. For string to datetime conversion, no duplicate format tokens are allowed, including tokens</description></item><item><title>Apache Hive : ChangeLog</title><link>https://hive.apache.org/docs/latest/changelog_283118275/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/changelog_283118275/</guid><description>Apache Hive : ChangeLog Release 4.0.0 - 2024- [...]
-HiveQL changes Metastore Schema Metastore Thrift API** Introduction This document describes changes to a) HiveQL, b) metastore schema, and c) metastore Thrift API to support column level statistics in Hive. Please note that the document doesn’t describe the changes needed to persist histograms in the metastore yet.
-Version information
-Column statistics are introduced in Hive 0.10.0 by HIVE-1362. This is the design document.</description></item><item><title>Apache Hive : Common Table Expression</title><link>https://hive.apache.org/docs/latest/common-table-expression_38572242/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/common-table-expression_38572242/</guid><description>Apache Hive : Common Table Expression A Common Table Expression (CTE) is a temporary result set [...]
+The formal name of the current SQL standard is ISO/IEC 9075 &ldquo;Database Language SQL&rdquo;.</description></item><item><title>Apache Hive : AuthDev</title><link>https://hive.apache.org/docs/latest/authdev_27362078/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/authdev_27362078/</guid><description>Apache Hive : AuthDev This is the design document for the original Hive authorization mode. See Authorization for an overview of a [...]
+Apache Hive : AuthDev 1. Privilege 1.1 Access Privilege 2. Hive Operations 3. Metadata 3.1 user, group, and roles 3.1.1 Role management 3.1.2 role metadata 3.1.3 hive role user membership table 3.</description></item><item><title>Apache Hive : AvroSerDe</title><link>https://hive.apache.org/docs/latest/avroserde_27850707/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/avroserde_27850707/</guid><description>Apache Hive : AvroSerDe Apache H [...]
+The AvroSerde is available in Hive 0.9.1 and greater.</description></item><item><title>Apache Hive : BecomingACommitter</title><link>https://hive.apache.org/community/becomingcommitter/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/community/becomingcommitter/</guid><description>Apache Hive : BecomingACommitter Becoming A Hive Committer The Apache Software Foundation defines generic guidelines for what it means to be a committer. However, it leaves [...]
+Committer Zen Contributors often ask Hive PMC members the question, &ldquo;What do I need to do in order to become a committer?</description></item><item><title>Apache Hive : Binary DataType Proposal</title><link>https://hive.apache.org/docs/latest/binary-datatype-proposal_27826614/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/binary-datatype-proposal_27826614/</guid><description>Apache Hive : Binary DataType Proposal Binary Type i [...]
+Hive is a project of the Apache Software Foundation. The foundation holds the copyright on Apache code including the code in the Hive codebase. The foundation FAQ explains the operation and background of the foundation.</description></item><item><title>Apache Hive : CAST...FORMAT with SQL:2016 datetime formats</title><link>https://hive.apache.org/docs/latest/122917025/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/122917025/</guid><desc [...]
+Patterns are case-insensitive, except AM/PM and T/Z. See these sections for more details. For string to datetime conversion, no duplicate format tokens are allowed, including tokens</description></item><item><title>Apache Hive : ChangeLog</title><link>https://hive.apache.org/docs/latest/changelog_283118275/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/changelog_283118275/</guid><description>Apache Hive : ChangeLog Release 4.0.0 - 2024- [...]
Version</description></item><item><title>Apache Hive : Compaction pooling</title><link>https://hive.apache.org/docs/latest/compaction-pooling_240884493/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/compaction-pooling_240884493/</guid><description>Apache Hive : Compaction pooling Concept: Compaction requests and workers can be assigned to pools. A worker assigned to a specific pool will only process compaction requests in that pool. Wor [...]
-You can import text files compressed with Gzip or Bzip2 directly into a table stored as TextFile. The compression will be detected automatically and the file will be decompressed on-the-fly during query execution. For example:</description></item><item><title>Apache Hive : Configuration Properties</title><link>https://hive.apache.org/docs/latest/configuration-properties_27842758/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/configurati [...]
+You can import text files compressed with Gzip or Bzip2 directly into a table stored as TextFile. The compression will be detected automatically and the file will be decompressed on-the-fly during query execution. For example:</description></item><item><title>Apache Hive : Configuration Properties</title><link>https://hive.apache.org/docs/latest/configuration-properties_27842758/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/configurati [...]
+The canonical list of configuration properties is managed in the HiveConf Java class, so refer to the HiveConf.java file for a complete list of configuration properties available in your Hive release.
+For information about how to use these configuration properties, see Configuring Hive. That document also describes administrative configuration properties for setting up Hive in the Configuration Variables section.</description></item><item><title>Apache Hive : ContributorDay2011</title><link>https://hive.apache.org/docs/latest/contributorday2011_27820725/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/contributorday2011_27820725/</guid [...]
Resources for mini-hackathon:
PluginDeveloperKit has info on the new pdk; download this snapshot build of Hive which includes it you&rsquo;ll need a Mac or Linux development environment with Hive+Hadoop already installed on it per these instructions; for Hive, use the snapshot you&rsquo;ll also need Apache ant installed. HIVE-1545 has the UDF libraries we&rsquo;d like to get cleaned up for inclusion in Hive or extension libraries (download core.</description></item><item><title>Apache Hive : ContributorMi [...]
Attendees: http://www.meetup.com/Hive-Contributors-Group/events/30620561/
@@ -32,24 +27,24 @@ Carl asked for more details about the impact of HIVE-2795 on the upgrade process
Location: Cloudera (Palo Alto)
Attendees: http://www.meetup.com/Hive-Contributors-Group/events/26345541/
Carl proposed end of August as target for 0.8 release, with branch cut in a couple of weeks. Work is still underway for publishing release artifacts in Maven for 0.7.1 and 0.8 (development snapshots are already being published).
-Ashutosh gave an update on HCatalog development status; no blocking issues from Hive for the 0.2 release; some ideas are being discussed for the 0.</description></item><item><title>Apache Hive : Copy of Hive Schema Tool - [TODO: move it under a 4.0 admin manual page, find a proper name]</title><link>https://hive.apache.org/docs/latest/284790216/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/284790216/</guid><description>Apache Hive : Co [...]
-Metastore Schema Verification Hive records the schema version in the metastore database and verifies that the metastore schema version is compatible with Hive binaries that are going to access the metastore.</description></item><item><title>Apache Hive : Correlation Optimizer</title><link>https://hive.apache.org/docs/latest/correlation-optimizer_34019487/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/correlation-optimizer_34019487/</gui [...]
-set hive.optimize.correlation=true; 1. Overview In Hadoop environments, an SQL query submitted to Hive will be evaluated in distributed systems. Thus, after generating a query operator tree representing the submitted SQL query, Hive needs to determine what operations can be executed in a task which will be evalauted in a single node.</description></item><item><title>Apache Hive : Cost-based optimization in Hive</title><link>https://hive.apache.org/docs/latest/cost-based-optimization-in-h [...]
+Ashutosh gave an update on HCatalog development status; no blocking issues from Hive for the 0.2 release; some ideas are being discussed for the 0.</description></item><item><title>Apache Hive : Copy of Hive Schema Tool - [TODO: move it under a 4.0 admin manual page, find a proper name]</title><link>https://hive.apache.org/docs/latest/284790216/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/284790216/</guid><description>Apache Hive : Co [...]
+set hive.optimize.correlation=true; 1. Overview In Hadoop environments, an SQL query submitted to Hive will be evaluated in distributed systems. Thus, after generating a query operator tree representing the submitted SQL query, Hive needs to determine what operations can be executed in a task which will be evalauted in a single node.</description></item><item><title>Apache Hive : Cost-based optimization in Hive</title><link>https://hive.apache.org/docs/latest/cost-based-optimization-in-h [...]
The CSVSerde is available in Hive 0.14 and greater.
Background The CSV SerDe is based on https://github.com/ogrodnek/csv-serde, and was added to the Hive distribution in HIVE-7777.
Limitation
-This SerDe treats all columns to be of type String. Even if you create a table with non-string column types using this SerDe, the DESCRIBE TABLE output would show string column type.</description></item><item><title>Apache Hive : Data Connector for Hive and Hive-like engines</title><link>https://hive.apache.org/docs/latest/data-connector-for-hive-and-hive-like-engines_288885794/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/data-connect [...]
-This enables various kind of sketch operations thru regular sql statement.</description></item><item><title>Apache Hive : Default Constraint (HIVE-18726)</title><link>https://hive.apache.org/docs/latest/75969407/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/75969407/</guid><description>Apache Hive : Default Constraint (HIVE-18726) Introduction This document proposes the addition of DEFAULT clause to Hive. DEFAULT clause is a domain con [...]
+This SerDe treats all columns to be of type String. Even if you create a table with non-string column types using this SerDe, the DESCRIBE TABLE output would show string column type.</description></item><item><title>Apache Hive : Data Connector for Hive and Hive-like engines</title><link>https://hive.apache.org/docs/latest/data-connector-for-hive-and-hive-like-engines_288885794/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/data-connect [...]
+This enables various kind of sketch operations thru regular sql statement.
+Apache Hive : Datasketches Integration Sketch functions Naming convention sketchType functionName List declared sketch functions Integration with materialized views BI mode Rewrite COUNT(DISTINCT(X)) Rewrite percentile_disc(p) withing group(order by x) Rewrite cume_dist() over (order by id) Rewrite NTILE Rewrite RANK Examples Simple distinct counting examples using HLL Use HLL to compute distinct values using an intermediate table Use HLL to compute distinct values without intermediate t [...]
Background With the addition of DEFAULT constraint (HIVE-18726) user can define columns to have default value which will be used in case user doesn’t explicitly specify it while INSERTING data. For DEFAULT constraint to kick in user has to explicitly specify column schema leaving out the column name for which user would like the sytem to use DEFAULT value.</description></item><item><title>Apache Hive : Dependent Tables</title><link>https://hive.apache.org/docs/latest/dependent-tables_301 [...]
create table T (key string, value string) partitioned by (ds string, hr string);
insert overwrite table T partition (ds=&lsquo;1&rsquo;, hr=&lsquo;1&rsquo;) &hellip;;
..
insert overwrite table T partition (ds=&lsquo;1&rsquo;, hr=&lsquo;24&rsquo;) &hellip;;
T is a partitioned table by date and hour, and Tsignal is an external table which conceptually denotes the creation of the signal table.</description></item><item><title>Apache Hive : Design</title><link>https://hive.apache.org/docs/latest/design_27362072/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/design_27362072/</guid><description>Apache Hive : Design This page contains details about the Hive design and architecture. A brief techn [...]
-Hive Architecture Hive Data Model Metastore Motivation Metadata Objects Metastore Architecture Metastore Interface Hive Query Language Compiler Optimizer Hive APIs Figure 1
-Hive Architecture Figure 1 shows the major components of Hive and its interactions with Hadoop. As shown in that figure, the main components of Hive are:</description></item><item><title>Apache Hive : DesignDocs</title><link>https://hive.apache.org/docs/latest/designdocs_27362075/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/designdocs_27362075/</guid><description>Apache Hive : DesignDocs Hive Design Documents Proposals that appear in [...]
+Apache Hive : Design Hive Architecture Hive Data Model Metastore Motivation Metadata Objects Metastore Architecture Metastore Interface Hive Query Language Compiler Optimizer Hive APIs Attachments: Hive Architecture Figure 1
+Figure 1 shows the major components of Hive and its interactions with Hadoop.</description></item><item><title>Apache Hive : DesignDocs</title><link>https://hive.apache.org/docs/latest/designdocs_27362075/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/designdocs_27362075/</guid><description>Apache Hive : DesignDocs Hive Design Documents Proposals that appear in the &ldquo;Completed&rdquo; and &ldquo;In Progress&rdquo; se [...]
Completed Views (HIVE-1143) Partitioned Views (HIVE-1941) Storage Handlers (HIVE-705) HBase Integration HBase Bulk Load Locking (HIVE-1293) Indexes (HIVE-417) Bitmap Indexes (HIVE-1803) Filter Pushdown (HIVE-279) Table-level Statistics (HIVE-1361) Dynamic Partitions Binary Data Type (HIVE-2380) Decimal Precision and Scale Support HCatalog (formerly Howl) HiveServer2 (HIVE-2935) Column Statistics in Hive (HIVE-1362) List Bucketing (HIVE-3026) Group By With Rollup (HIVE-2397) Enhanced Aggr [...]
-Hive Developer Guide Code organization and architecture Compiling and running Hive Unit tests Debugging Hive code Pluggable interfaces Hive Developer FAQ Moving files Building Hive Testing Hive Plugin Developer Kit Writing UDTFs Hive on Spark: Getting Started</description></item><item><title>Apache Hive : DeveloperGuide</title><link>https://hive.apache.org/docs/latest/developerguide_27362074/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/lates [...]
+Hive Developer Guide Code organization and architecture Compiling and running Hive Unit tests Debugging Hive code Pluggable interfaces Hive Developer FAQ Moving files Building Hive Testing Hive Plugin Developer Kit Writing UDTFs Hive on Spark: Getting Started</description></item><item><title>Apache Hive : DeveloperGuide</title><link>https://hive.apache.org/docs/latest/developerguide_27362074/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/lates [...]
Meeting Minutes April 18, 2012 December 5, 2011 September 7, 2011 July 26, 2011 June 30, 2011 April 25, 2011 January 11, 2011 (forgot to take notes) October 25, 2010 September 13, 2010 August 8, 2010 July 6, 2010 June 1, 2010</description></item><item><title>Apache Hive : Development ContributorsMeetings HiveContributorsMinutes100601</title><link>https://hive.apache.org/docs/latest/development-contributorsmeetings-hivecontributorsminutes100601_27362084/</link><pubDate>Thu, 12 Dec 2024 00 [...]
The following people were present:
Facebook (Paul Yang; Ning Zhang; Yongqiang He; Ahmed Aly; John Sichi; Ashish Thusoo; Namit Jain) Netflix (Eva Tse; Jerome Boulon) Cloudera (Arvind Prabhakar; Vinithra Varadharajan; Carl Steinbach) Yahoo (Alan Gates) The following were the main meeting minutes:
@@ -66,27 +61,20 @@ website (now at hive.apache.org) svn (new trunk location is http://svn.apache.or
Location: Facebook Palo Alto
Attendees: http://www.meetup.com/Hive-Contributors-Group/events/17272914/
The 0.7 release is out, and Carl proposed an 0.7.1 release for items such as PostgreSQL metastore upgrade scripts and Maven artifact publication. Rules for a point release were discussed: no metastore changes, and no changes to API&rsquo;s such as Thrift and extension interfaces. Everyone was fine with this; Carl will manage the release.</description></item><item><title>Apache Hive : Different TIMESTAMP types</title><link>https://hive.apache.org/docs/latest/different-timestamp-types_ [...]
-TIMESTAMP and TIMESTAMP WITHOUT TIME ZONE The TIMESTAMP and TIMESTAMP WITHOUT TIME ZONE types shall behave like the LocalDateTime class of Java, i.e., each value is a recording of what can be seen on a calendar and a clock hanging on the wall, for example &ldquo;1969-07-20 16:17:39&rdquo;.</description></item><item><title>Apache Hive : Druid Integration</title><link>https://hive.apache.org/docs/latest/druid-integration_65866491/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pub [...]
+TIMESTAMP and TIMESTAMP WITHOUT TIME ZONE The TIMESTAMP and TIMESTAMP WITHOUT TIME ZONE types shall behave like the LocalDateTime class of Java, i.e., each value is a recording of what can be seen on a calendar and a clock hanging on the wall, for example &ldquo;1969-07-20 16:17:39&rdquo;.</description></item><item><title>Apache Hive : Druid Integration</title><link>https://hive.apache.org/docs/latest/druid-integration_65866491/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pub [...]
+Apache Hive : Druid Integration Objectives Preliminaries Druid Storage Handlers Usage Discovery and management of Druid datasources from Hive Create tables linked to existing Druid datasources Create Druid datasources from Hive Druid kafka ingestion from Hive INSERT, INSERT OVERWRITE and DROP statements Queries completely executed in Druid Queries across Druid and Hive Open Issues (JIRA) Objectives Our main goal is to be able to index data from Hive into Druid, and to be able to query Dr [...]
Tutorial: Dynamic-Partition Insert Hive DML: Dynamic Partition Inserts HCatalog Dynamic Partitioning Usage with Pig Usage from MapReduce References:
-Original design doc HIVE-936 Terminology Static Partition (SP) columns: in DML/DDL involving multiple partitioning columns, the columns whose values are known at COMPILE TIME (given by user).</description></item><item><title>Apache Hive : Enabling gRPC in Hive/Hive Metastore (Proposal)</title><link>https://hive.apache.org/docs/latest/158869886/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/158869886/</guid><description>Apache Hive : Ena [...]
-Last upated: 7/31/2020
-Objective Background Design Overview Implementation Pluggable gRPC Support Hive Metastore Server Class Change Config Changes Hive Metastore Client Class Change Configuration Changes Summary Future Work Objective To modernize Hive Metastore’s interface with a state-of-the-art serving layer based on gRPC while also keeping it backwards compatible with Thrift for minimal upgrade toil; To achieve this the proposed design is to add support for a proxy-layer between the Thrift interface and a [...]
-GROUPING SETS clause Grouping__ID function Grouping function Cubes and Rollups hive.new.job.grouping.set.cardinality Grouping__ID function (before Hive 2.3.0) Version
-Grouping sets, CUBE and ROLLUP operators, and the GROUPING__ID function were added in Hive 0.10.0.
-See HIVE-2397, HIVE-3433, HIVE-3471, and HIVE-3613.
-Also see HIVE-3552 for an improvement added in Hive 0.</description></item><item><title>Apache Hive : Exchange Partition</title><link>https://hive.apache.org/docs/latest/exchange-partition_30755801/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/exchange-partition_30755801/</guid><description>Apache Hive : Exchange Partition The EXCHANGE PARTITION command will move a partition from a source table to target table and alter each table& [...]
+Original design doc HIVE-936 Terminology Static Partition (SP) columns: in DML/DDL involving multiple partitioning columns, the columns whose values are known at COMPILE TIME (given by user).</description></item><item><title>Apache Hive : Enabling gRPC in Hive/Hive Metastore (Proposal)</title><link>https://hive.apache.org/docs/latest/158869886/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/158869886/</guid><description>Apache Hive : Ena [...]
+Apache Hive : Enhanced Aggregation, Cube, Grouping and Rollup GROUPING SETS clause Grouping__ID function Grouping function Cubes and Rollups hive.new.job.grouping.set.cardinality Grouping__ID function (before Hive 2.3.0) Comments: Version
+Grouping sets, CUBE and ROLLUP operators, and the GROUPING__ID function were added in Hive 0.</description></item><item><title>Apache Hive : Exchange Partition</title><link>https://hive.apache.org/docs/latest/exchange-partition_30755801/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/exchange-partition_30755801/</guid><description>Apache Hive : Exchange Partition The EXCHANGE PARTITION command will move a partition from a source table to [...]
When the command is executed, the source table&rsquo;s partition folder in HDFS will be renamed to move it to the destination table&rsquo;s partition folder.</description></item><item><title>Apache Hive : FileFormats</title><link>https://hive.apache.org/docs/latest/fileformats_47384180/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/fileformats_47384180/</guid><description>Apache Hive : FileFormats File Formats and Compression Fi [...]
Text File SequenceFile RCFile Avro Files ORC Files Parquet Custom INPUTFORMAT and OUTPUTFORMAT The hive.default.fileformat configuration parameter determines the format to use if it is not specified in a CREATE TABLE or ALTER TABLE statement. Text file is the parameter&rsquo;s default value.
-For more information, see the sections Storage Formats and Row Formats &amp; SerDe on the DDL page.</description></item><item><title>Apache Hive : FilterPushdownDev</title><link>https://hive.apache.org/docs/latest/filterpushdowndev_27362092/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/filterpushdowndev_27362092/</guid><description>Apache Hive : FilterPushdownDev Filter Pushdown Filter Pushdown Introduction Use Cases Components Inv [...]
-Installation and Configuration
-- [Running HiveServer2 and Beeline](#running-hiveserver2-and-beeline)+ [Requirements](#requirements) Installing Hive from a Stable Release Building Hive from Source Compile Hive on master Compile Hive on branch-1 Compile Hive Prior to 0.13 on Hadoop 0.20 Compile Hive Prior to 0.13 on Hadoop 0.23 Running Hive Running Hive CLI Running HiveServer2 and Beeline Running HCatalog Running WebHCat (Templeton) Configuration Management Overview Runtime Configuration Hive, Map-Reduce and Local-Mode [...]
+For more information, see the sections Storage Formats and Row Formats &amp; SerDe on the DDL page.</description></item><item><title>Apache Hive : FilterPushdownDev</title><link>https://hive.apache.org/docs/latest/filterpushdowndev_27362092/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/filterpushdowndev_27362092/</guid><description>Apache Hive : Filter Pushdown This document explains how we are planning to add support in Hive&r [...]
+Apache Hive : Filter Pushdown Use Cases Components Involved Primary Filter Representation Other Filter Representations Filter Passing Filter Collection Filter Decomposition Use Cases Below are the main use cases we are targeting.</description></item><item><title>Apache Hive : GenericUDAFCaseStudy</title><link>https://hive.apache.org/docs/latest/genericudafcasestudy_27362093/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/genericudafcases [...]
The following page only applies to branch-0.12 and earlier. For trunk see HiveDeveloperFAQ
After checking out the source code run the following command from the top-level directory:
$ ant clean package eclipse-files Now open up Eclipse and do the following:
-File-&gt;Import-&gt;General-&gt;Existing Projects Into Workspace-&gt;Select root directory (point to ) Make sure that Eclipse Java Compiler is in 1.</description></item><item><title>Apache Hive : GroupByWithRollup</title><link>https://hive.apache.org/docs/latest/groupbywithrollup_27826238/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/groupbywithrollup_27826238/</guid><description>Apache Hive : GroupByWithRollup Group By [...]
-Original design doc
-HIVE-2397
-Group By With Rollup Terminology Design Map Aggr &amp; No Skew: Map Aggr &amp; Skew No Map Aggr &amp; No Skew &amp; No Rollup No Map Aggr &amp; No Skew &amp; With Rollup No Map Aggr &amp; Skew &amp; (No Distinct or No Rollup) No Map Aggr &amp; Skew &amp; Distinct &amp; Rollup Terminology (No) Map Aggr: Shorthand for whether the configuration variable hive.</description></item><item><title>Apache Hive : Hadoop-compatible Input-Output Format for [...]
+File-&gt;Import-&gt;General-&gt;Existing Projects Into Workspace-&gt;Select root directory (point to ) Make sure that Eclipse Java Compiler is in 1.</description></item><item><title>Apache Hive : GroupByWithRollup</title><link>https://hive.apache.org/docs/latest/groupbywithrollup_27826238/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/groupbywithrollup_27826238/</guid><description>Apache Hive : Group By With Rollup Apach [...]
InputFormat: http://hadoop.apache.org/docs/mapreduce/r0.21.0/api/org/apache/hadoop/mapreduce/InputFormat.html OutputFormat: http://hadoop.apache.org/docs/mapreduce/r0.21.0/api/org/apache/hadoop/mapreduce/OutputFormat.html The classes will be named HiveApiInputFormat and HiveApiOutputFormat.
See HIVE-3752 for discussion of this proposal.
InputFormat (reading from Hive) Usage:
@@ -94,39 +82,35 @@ Create a HiveInputDescription object. Fill it with information about the table t
This is part of metastore on hbase work - HIVE-9452 Use HBase to store Hive metadata Open
Functionality needed
RawStore functions that support partition filtering are the following -
-getPartitionsByExpr getPartitionsByFilter (takes filter string as argument, used from hcatalog) We need to generate a query execution plan in terms of Hbase scan api calls for a given filter condition.</description></item><item><title>Apache Hive : HBaseBulkLoad</title><link>https://hive.apache.org/docs/latest/hbasebulkload_27362088/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hbasebulkload_27362088/</guid><description>Apache Hive : H [...]
-- [Avro Data Stored in HBase Columns](#avro-data-stored-in-hbase-columns)+ [Introduction](#introduction) Storage Handlers Usage Column Mapping Multiple Columns and Families Hive MAP to HBase Column Family Hive MAP to HBase Column Prefix Hiding Column Prefixes Illegal: Hive Primitive to HBase Column Family Example with Binary Columns Simple Composite Row Keys Complex Composite Row Keys and HBaseKeyFactory Avro Data Stored in HBase Columns Put Timestamps Key Uniqueness Overwrite Potential [...]
+getPartitionsByExpr getPartitionsByFilter (takes filter string as argument, used from hcatalog) We need to generate a query execution plan in terms of Hbase scan api calls for a given filter condition.</description></item><item><title>Apache Hive : HBaseBulkLoad</title><link>https://hive.apache.org/docs/latest/hbasebulkload_27362088/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hbasebulkload_27362088/</guid><description>Apache Hive : H [...]
+Apache Hive : HBase Bulk Load Overview Decide on Target HBase Schema Estimate Resources Needed Add necessary JARs Prepare Range Partitioning Prepare Staging Location Sort Data Run HBase Script Map New Table Back Into Hive Followups Needed Overview Ideally, bulk load from Hive into HBase would be part of HBaseIntegration, making it as simple as this:</description></item><item><title>Apache Hive : HBaseIntegration</title><link>https://hive.apache.org/docs/latest/hbaseintegration_27362089/< [...]
+A presentation is available from the HBase HUG10 Meetup
+This feature is a work in progress, and suggestions for its improvement are very welcome.</description></item><item><title>Apache Hive : HBaseMetastoreDevelopmentGuide</title><link>https://hive.apache.org/docs/latest/hbasemetastoredevelopmentguide_55151960/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hbasemetastoredevelopmentguide_55151960/</guid><description>Apache Hive : HBaseMetastoreDevelopmentGuide Guide for contributors to the [...]
This work is discontinued and the code is removed in release 3.0.0 (HIVE-17234).
- Building Setup for running hive against hbase metastore - Importing metadata from rdbms to hbase Design Docs Building You will need to download the source for Tephra and build it from the develop branch. You need Tephra 0.</description></item><item><title>Apache Hive : HCatalog</title><link>https://hive.apache.org/docs/latest/hcatalog_33299065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog_33299065/</guid><description>Apache [...]
-This is the HCatalog manual. Using HCatalog Installation from Tarball HCatalog Configuration Properties Load and Store Interfaces Input and Output Interfaces Reader and Writer Interfaces Command Line Interface Storage Formats Dynamic Partitioning Notification Storage Based Authorization The old HCatalog wiki page has many other documents including additional user documentation, further information on HBase integration, and resources for contributors.</description></item><item><title>Apac [...]
-The following Pig script illustrates this:
-A = load 'raw' using HCatLoader(); .</description></item><item><title>Apache Hive : HCatalog InputOutput</title><link>https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/</guid><description>Apache Hive : HCatalog InputOutput Input and Output Interfaces Input and Output Interfaces Set Up HCatInputFormat API HCatOutputFormat API HCatRecord Running M [...]
-Note: HCatalog is not thread safe.
-HCatInputFormat The HCatInputFormat is used with MapReduce jobs to read data from HCatalog-managed tables.</description></item><item><title>Apache Hive : HCatalog InstallHCat</title><link>https://hive.apache.org/docs/latest/hcatalog-installhcat_34013403/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-installhcat_34013403/</guid><description>Apache Hive : HCatalog InstallHCat Installation from Tarball Installation from Tarball HC [...]
+Apache Hive : HBaseMetastoreDevelopmentGuide Building Setup for running hive against hbase metastore - Importing metadata from rdbms to hbase Design Docs Building You will need to download the source for Tephra and build it from the develop branch.</description></item><item><title>Apache Hive : HCatalog</title><link>https://hive.apache.org/docs/latest/hcatalog_33299065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog_33299065/</g [...]
+This is the HCatalog manual. Using HCatalog Installation from Tarball HCatalog Configuration Properties Load and Store Interfaces Input and Output Interfaces Reader and Writer Interfaces Command Line Interface Storage Formats Dynamic Partitioning Notification Storage Based Authorization The old HCatalog wiki page has many other documents including additional user documentation, further information on HBase integration, and resources for contributors.</description></item><item><title>Apac [...]
+The following Pig script illustrates this:</description></item><item><title>Apache Hive : HCatalog InputOutput</title><link>https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-inputoutput_34013776/</guid><description>Apache Hive : HCatalog Input and Output Interfaces Apache Hive : HCatalog Input and Output Interfaces Set Up HCatInputFormat API HCatOutputFormat API HCa [...]
+Note: HCatalog is not thread safe.</description></item><item><title>Apache Hive : HCatalog InstallHCat</title><link>https://hive.apache.org/docs/latest/hcatalog-installhcat_34013403/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-installhcat_34013403/</guid><description>Apache Hive : HCatalog Installation from Tarball Apache Hive : HCatalog Installation from Tarball HCatalog Installed with Hive HCatalog Command Line HCatalog Cli [...]
HCatalog is installed with Hive, starting with Hive release 0.11.0.
Hive installation is documented here.
-HCatalog Command Line If you install Hive from the binary tarball, the hcat command is available in the hcatalog/bin directory.
-The hcat command line is similar to the hive command line; the main difference is that it restricts the queries that can be run to metadata-only operations such as DDL and DML queries used to read metadata (for example, &ldquo;show tables&rdquo;).</description></item><item><title>Apache Hive : HCatalog LoadStore</title><link>https://hive.apache.org/docs/latest/hcatalog-loadstore_34013511/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/l [...]
-The data transfer API has three essential classes:</description></item><item><title>Apache Hive : HCatalog StorageFormats</title><link>https://hive.apache.org/docs/latest/hcatalog-storageformats_34013997/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-storageformats_34013997/</guid><description>Apache Hive : HCatalog StorageFormats Storage Formats Storage Formats SerDes and Storage Formats Usage from Hive CTAS Issue with JSON Se [...]
-Background Structure Data Requirements Streaming Requirements Record Layout Connection and Transaction Management Writing Data Dynamic Partition Creation Reading Data Example Background In certain data processing use cases it is necessary to modify existing data when new facts arrive.</description></item><item><title>Apache Hive : HCatalog Streaming Mutation API (Copy)</title><link>https://hive.apache.org/docs/latest/283118454/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><gui [...]
-Background Structure Data Requirements Streaming Requirements Record Layout Connection and Transaction Management Writing Data Dynamic Partition Creation Reading Data Example Background In certain data processing use cases it is necessary to modify existing data when new facts arrive.</description></item><item><title>Apache Hive : HCatalog UsingHCat</title><link>https://hive.apache.org/docs/latest/hcatalog-usinghcat_34013260/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid> [...]
-HCatalog graduated from the Apache incubator and merged with the Hive project on March 26, 2013.
-Hive version 0.11.0 is the first release that includes HCatalog.</description></item><item><title>Apache Hive : Hive across Multiple Data Centers (Physical Clusters)</title><link>https://hive.apache.org/docs/latest/27837073/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/27837073/</guid><description>Apache Hive : Hive across Multiple Data Centers (Physical Clusters) This project has been abandoned. We&rsquo;re leaving the design doc [...]
-Use Cases Requirements Use Cases Inside facebook, we are running out of power inside a data center (physical cluster), and we have a need to have a bigger cluster.
-We can divide the cluster into multiple clusters - multiple hive instances, multiple mr and multiple dfs.</description></item><item><title>Apache Hive : Hive APIs Overview</title><link>https://hive.apache.org/docs/latest/hive-apis-overview_61326349/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-apis-overview_61326349/</guid><description>Apache Hive : Hive APIs Overview This page aims to catalogue and describe the various public fac [...]
-API categories Operation based APIs Query based APIs Available APIs HCatClient (Java) HCatalog Storage Handlers (Java) HCatalog CLI (Command Line) Metastore (Java) WebHCat (REST) Streaming Data Ingest (Java) Streaming Mutation (Java) hive-jdbc (JDBC) API categories The APIs can be segmented into two conceptual categories: operation based APIs and query based APIs.</description></item><item><title>Apache Hive : Hive Aws EMR</title><link>https://hive.apache.org/docs/latest/hive-aws-emr_278 [...]
+HCatalog Command Line If you install Hive from the binary tarball, the hcat command is available in the hcatalog/bin directory.</description></item><item><title>Apache Hive : HCatalog LoadStore</title><link>https://hive.apache.org/docs/latest/hcatalog-loadstore_34013511/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hcatalog-loadstore_34013511/</guid><description>Apache Hive : HCatalog Load and Store Interfaces Apache Hive : HCatalog Lo [...]
+Apache Hive : HCatalog Streaming Mutation API Background Structure Data Requirements Streaming Requirements Record Layout Connection and Transaction Management Writing Data Dynamic Partition Creation Reading Data Example Attachments: Background In certain data processing use cases it is necessary to modify existing data when new facts arrive.</description></item><item><title>Apache Hive : HCatalog Streaming Mutation API (Copy)</title><link>https://hive.apache.org/docs/latest/283118454/</ [...]
+Apache Hive : HCatalog Streaming Mutation API (Copy) Background Structure Data Requirements Streaming Requirements Record Layout Connection and Transaction Management Writing Data Dynamic Partition Creation Reading Data Example Attachments: Background In certain data processing use cases it is necessary to modify existing data when new facts arrive.</description></item><item><title>Apache Hive : HCatalog UsingHCat</title><link>https://hive.apache.org/docs/latest/hcatalog-usinghcat_340132 [...]
+Apache Hive : Hive across Multiple Data Centers (Physical Clusters) Use Cases Requirements Use Cases Inside facebook, we are running out of power inside a data center (physical cluster), and we have a need to have a bigger cluster.</description></item><item><title>Apache Hive : Hive APIs Overview</title><link>https://hive.apache.org/docs/latest/hive-apis-overview_61326349/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-apis-overview [...]
+Apache Hive : Hive APIs Overview API categories Operation based APIs Query based APIs Available APIs HCatClient (Java) HCatalog Storage Handlers (Java) HCatalog CLI (Command Line) Metastore (Java) WebHCat (REST) Streaming Data Ingest (Java) Streaming Mutation (Java) hive-jdbc (JDBC) Comments: API categories The APIs can be segmented into two conceptual categories: operation based APIs and query based APIs.</description></item><item><title>Apache Hive : Hive Aws EMR</title><link>https://h [...]
Here you can find the most important configurations and default values.
-Config Name Default Value Description Config file hive.metastore.client.cache.v2.enabled true This property enabled a Caffaine Cache for Metastore client MetastoreConf More configs are in MetastoreConf.</description></item><item><title>Apache Hive : Hive deprecated authorization mode / Legacy Mode</title><link>https://hive.apache.org/docs/latest/45876173/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/45876173/</guid><description>Apache [...]
+Config Name Default Value Description Config file hive.metastore.client.cache.v2.enabled true This property enabled a Caffaine Cache for Metastore client MetastoreConf More configs are in MetastoreConf.</description></item><item><title>Apache Hive : Hive deprecated authorization mode / Legacy Mode</title><link>https://hive.apache.org/docs/latest/45876173/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/45876173/</guid><description>Apache [...]
+Apache Hive : Hive deprecated authorization mode / Legacy Mode Disclaimer Prerequisites Users, Groups, and Roles Creating/Dropping/Using Roles Privileges Hive Operations and Required Privileges Disclaimer Hive authorization is not completely secure.</description></item><item><title>Apache Hive : Hive HPL/SQL</title><link>https://hive.apache.org/docs/latest/59690156/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/59690156/</guid><descript [...]
HPL/SQL is an open source tool (Apache License 2.0) that implements procedural SQL language for Apache Hive, SparkSQL, Impala as well as any other SQL-on-Hadoop implementation, any NoSQL and any RDBMS.
-HPL/SQL is a hybrid and heterogeneous language that understands syntaxes and semantics of almost any existing procedural SQL dialect, and you can use with any database, for example, running existing Oracle PL/SQL code on Apache Hive and Microsoft SQL Server, or running Transact-SQL on Oracle, Cloudera Impala or Amazon Redshift.</description></item><item><title>Apache Hive : Hive Metadata Caching Proposal</title><link>https://hive.apache.org/docs/latest/hive-metadata-caching-proposal_6940 [...]
-Introduced in Hive 0.10.0. See HIVE-3056 and HIVE-3443.
+HPL/SQL is a hybrid and heterogeneous language that understands syntaxes and semantics of almost any existing procedural SQL dialect, and you can use with any database, for example, running existing Oracle PL/SQL code on Apache Hive and Microsoft SQL Server, or running Transact-SQL on Oracle, Cloudera Impala or Amazon Redshift.</description></item><item><title>Apache Hive : Hive Metadata Caching Proposal</title><link>https://hive.apache.org/docs/latest/hive-metadata-caching-proposal_6940 [...]
The Hive MetaTool enables administrators to do bulk updates on the location fields in database, table, and partition records in the metastore. It provides the following functionality:
-Ability to search and replace the HDFS NN (NameNode) location in metastore records that reference the NN.</description></item><item><title>Apache Hive : Hive Metrics</title><link>https://hive.apache.org/docs/latest/hive-metrics_65872987/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-metrics_65872987/</guid><description>Apache Hive : Hive Metrics The metrics that Hive collects can be viewed in the HiveServer2 Web UI by using the &am [...]
-The metrics dump will display any metric available over JMX encoded in JSON: Alternatively the metrics can be written directly into HDFS, a JSON file on the local file system where the HS2 instance is running or to the console by enabling the corresponding metric reporters. By default only the JMX and the JSON file reporter are enabled.</description></item><item><title>Apache Hive : Hive on Spark</title><link>https://hive.apache.org/docs/latest/hive-on-spark_42567714/</link><pubDate>Thu, [...]
-set hive.execution.engine=spark; Hive on Spark was added in HIVE-7292.</description></item><item><title>Apache Hive : Hive on Spark: Join Design Master</title><link>https://hive.apache.org/docs/latest/50858744/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/50858744/</guid><description>Apache Hive : Hive on Spark: Join Design Master Purpose and Prerequisites MapReduce Summary Figure 1. Join Processors for Hive on MapReduce Tez Comparison [...]
-We believe that this type of functionality will be of increasing importance as Hadoop and Hive workloads migrate to the cloud.</description></item><item><title>Apache Hive : Hive Schema Tool</title><link>https://hive.apache.org/docs/latest/hive-schema-tool_34835119/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-schema-tool_34835119/</guid><description>Apache Hive : Hive Schema Tool Metastore Schema Verification The Hive Schema Tool [...]
+Ability to search and replace the HDFS NN (NameNode) location in metastore records that reference the NN. One use is to transition a Hive deployment to HDFS HA NN (HDFS High Availability NameNode).</description></item><item><title>Apache Hive : Hive Metrics</title><link>https://hive.apache.org/docs/latest/hive-metrics_65872987/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-metrics_65872987/</guid><description>Apache Hive : Hive Met [...]
+The metrics dump will display any metric available over JMX encoded in JSON: Alternatively the metrics can be written directly into HDFS, a JSON file on the local file system where the HS2 instance is running or to the console by enabling the corresponding metric reporters. By default only the JMX and the JSON file reporter are enabled.</description></item><item><title>Apache Hive : Hive on Spark</title><link>https://hive.apache.org/docs/latest/hive-on-spark_42567714/</link><pubDate>Thu, [...]
+set hive.execution.engine=spark; Hive on Spark was added in HIVE-7292.
+Apache Hive : Hive on Spark: Getting Started Version Compatibility Spark Installation Configuring YARN Configuring Hive Configuration property details Configuring Spark Tuning Details Common Issues (Green are resolved, will be removed from this list) Recommended Configuration Design documents Attachments: Comments: Version Compatibility Hive on Spark is only tested with a specific version of Spark, so a given version of Hive is only guaranteed to work with a specific version of Spark.</d [...]
+We believe that this type of functionality will be of increasing importance as Hadoop and Hive workloads migrate to the cloud.</description></item><item><title>Apache Hive : Hive Schema Tool</title><link>https://hive.apache.org/docs/latest/hive-schema-tool_34835119/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-schema-tool_34835119/</guid><description>Apache Hive : Hive Schema Tool Apache Hive : Hive Schema Tool Metastore Schema Ve [...]
Introduced in Hive 0.12.0. See HIVE-3764.
-Hive now records the schema version in the metastore database and verifies that the metastore schema version is compatible with Hive binaries that are going to accesss the metastore. Note that the Hive properties to implicitly create or alter the existing schema are disabled by default.</description></item><item><title>Apache Hive : Hive Transactions</title><link>https://hive.apache.org/docs/latest/hive-transactions_40509723/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid> [...]
+Hive now records the schema version in the metastore database and verifies that the metastore schema version is compatible with Hive binaries that are going to accesss the metastore.</description></item><item><title>Apache Hive : Hive Transactions</title><link>https://hive.apache.org/docs/latest/hive-transactions_40509723/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-transactions_40509723/</guid><description>Apache Hive : ACID Tra [...]
Creating an Iceberg Table
An iceberg table can be created using STORED BY ICEBERG keywords while creating a table.
Creating an Iceberg table using normal create command CREATE TABLE TBL_ICE (ID INT) STORED BY ICEBERG; The above creates an iceberg table named &lsquo;TBL_ICE&rsquo;</description></item><item><title>Apache Hive : Hive-Tez Compatibility</title><link>https://hive.apache.org/docs/latest/hive-tez-compatibility_59689974/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hive-tez-compatibility_59689974/</guid><description>Apache Hive : Hi [...]
@@ -135,71 +119,66 @@ Background This document explores the different ways of leveraging Hive on Amazo
Hadoop already has a long tradition of being run on EC2 and S3. These are well documented in the links below which are a must read:
Hadoop and S3 Amazon and EC2 The second document also has pointers on how to get started using EC2 and S3.</description></item><item><title>Apache Hive : HiveAws HivingS3nRemotely</title><link>https://hive.apache.org/docs/latest/hiveaws-hivings3nremotely_27362102/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hiveaws-hivings3nremotely_27362102/</guid><description>Apache Hive : HiveAws HivingS3nRemotely = Querying S3 files from your PC ( [...]
Usage Scenario The scenario being covered here goes as follows:
-A user has data stored in S3 - for example Apache log files archived in the cloud, or databases backed up into S3. The user would like to declare tables over the data sets here and issue SQL queries against them These SQL queries should be executed using computed resources provisioned from EC2.</description></item><item><title>Apache Hive : HiveClient</title><link>https://hive.apache.org/docs/latest/hiveclient_27362101/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https: [...]
+A user has data stored in S3 - for example Apache log files archived in the cloud, or databases backed up into S3. The user would like to declare tables over the data sets here and issue SQL queries against them These SQL queries should be executed using computed resources provisioned from EC2.</description></item><item><title>Apache Hive : HiveClient</title><link>https://hive.apache.org/docs/latest/hiveclient_27362101/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https: [...]
+For details about the standalone server see Hive Server or HiveServer2.
+Apache Hive : HiveClient Command Line JDBC JDBC Client Sample Code Running the JDBC Sample Code JDBC Client Setup for a Secure Cluster Python PHP ODBC Thrift Thrift Java Client Thrift C++ Client Thrift Node Clients Thrift Ruby Client Command Line Operates in embedded mode only, that is, it needs to have access to the Hive libraries.</description></item><item><title>Apache Hive : HiveContributorsMinutes100601</title><link>https://hive.apache.org/docs/latest/hivecontributorsminutes100601_2 [...]
The following people were present:
Facebook (Paul Yang; Ning Zhang; Yongqiang He; Ahmed Aly; John Sichi; Ashish Thusoo; Namit Jain) Netflix (Eva Tse; Jerome Boulon) Cloudera (Arvind Prabhakar; Vinithra Varadharajan; Carl Steinbach) Yahoo (Alan Gates) The following were the main meeting minutes:
We should have these meetings more often, say every month. Cloudera will host the next meeting.</description></item><item><title>Apache Hive : HiveContributorsMinutes100706</title><link>https://hive.apache.org/docs/latest/hivecontributorsminutes100706_27362065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hivecontributorsminutes100706_27362065/</guid><description>Apache Hive : HiveContributorsMinutes100706 Attendees: Amr Awadallah, Joh [...]
bc Wong gave a live demo of Cloudera&rsquo;s Hue framework and the Beeswax Hive web interface. Slides from this talk are available here: http://www.slideshare.net/cwsteinbach/cloudera-huebeeswax Hue was recently released as open source. The code is available on Github here: http://github.com/cloudera/hue Olga Natkovich gave a whiteboard talk on HOwl.</description></item><item><title>Apache Hive : HiveCounters</title><link>https://hive.apache.org/docs/latest/hivecounters_67636835/</li [...]
For Tez execution, %context is set to the mapper/reducer name. For other execution engines it is not included in the counter name.
-Counter Name Description RECORDS_IN[_%context] Input records read RECORDS_OUT[_%context] Output records written RECORDS_OUT_INTERMEDIATE[_%context] Records written as intermediate records to ReduceSink (which become input records to other tasks) CREATED_FILES Number of files created DESERIALIZE_ERRORS Deserialization errors encountered while reading data</description></item><item><title>Apache Hive : HiveDerbyServerMode</title><link>https://hive.apache.org/docs/latest/hivederbyservermode [...]
+Counter Name Description RECORDS_IN[_%context] Input records read RECORDS_OUT[_%context] Output records written RECORDS_OUT_INTERMEDIATE[_%context] Records written as intermediate records to ReduceSink (which become input records to other tasks) CREATED_FILES Number of files created DESERIALIZE_ERRORS Deserialization errors encountered while reading data</description></item><item><title>Apache Hive : HiveDerbyServerMode</title><link>https://hive.apache.org/docs/latest/hivederbyservermode [...]
+See Metadata Store and Embedded Metastore for more information.
+Apache Hive : Using Derby in Server Mode Download Derby Set Environment Starting Derby Configure Hive to Use Network Derby Copy Derby Jar Files Start Up Hive The Result Download Derby It is suggested you download the version of Derby that ships with Hive.</description></item><item><title>Apache Hive : HiveDeveloperFAQ</title><link>https://hive.apache.org/docs/latest/hivedeveloperfaq_27823747/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/lates [...]
To see how the JDBC interface can be used, see sample code.
-Integration with Pentaho Download pentaho report designer from the pentaho website. Overwrite report-designer.</description></item><item><title>Apache Hive : HiveODBC</title><link>https://hive.apache.org/docs/latest/hiveodbc_27362099/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hiveodbc_27362099/</guid><description>Apache Hive : HiveODBC Hive ODBC Driver Hive ODBC Driver Introduction Suggested Reading Software Requirements Driver Arch [...]
-package com.example.hive.udf; import org.apache.hadoop.hive.ql.exec.UDF; import org.apache.hadoop.io.Text; public final class Lower extends UDF { public Text evaluate(final Text s) { if (s == null) { return null; } return new Text(s.toString().toLowerCase()); } } (Note that there&rsquo;s already a built-in function for this, it&rsquo;s just an easy example).</description></item><item><title>Apache Hive : HiveQL</title><link>https://hive.apache.org/docs/latest/hiveql_27362097/</li [...]
-Please see the HiveQL Language Manual</description></item><item><title>Apache Hive : HiveReplicationDevelopment</title><link>https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/</guid><description>Apache Hive : HiveReplicationDevelopment Introduction Purposes of Replication Disaster Recovery Load Balancing Replication Taxonomy Transact [...]
-Motivations Concurrency Many users have reported that the current HiveServer implementation has concurrency bugs (for example, see HIVE-80). In fact, it&rsquo;s impossible for HiveServer to support concurrent connections using the current Thrift API, a result of the fact that Thrift doesn&rsquo;t provide server-side access to connection handles. Since the current API does not provide explicit support for sessions or connections, HiveServer has no way of mapping incoming requests [...]
-Built on top of Apache Hadoop™, Hive provides the following features:
-Tools to enable easy access to data via SQL, thus enabling data warehousing tasks such as extract/transform/load (ETL), reporting, and data analysis.</description></item><item><title>Apache Hive : Howl</title><link>https://hive.apache.org/docs/latest/howl_27362109/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howl_27362109/</guid><description>Apache Hive : Howl This page collects some pointers to resources about Howl (an effort to crea [...]
-Howl wiki Yahoo group for Howl developers (including mailing list archive) Howl source code at github Howl CLI functional spec Original plans for Owl (predecessor to Howl)</description></item><item><title>Apache Hive : HowToCommit</title><link>https://hive.apache.org/docs/latest/howtocommit_27362108/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howtocommit_27362108/</guid><description>Apache Hive : HowToCommit Guide for Hive Committers [...]
-New committers New committers are encouraged to first read Apache&rsquo;s generic committer documentation:</description></item><item><title>Apache Hive : HowToContribute</title><link>https://hive.apache.org/docs/latest/howtocontribute_27362107/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howtocontribute_27362107/</guid><description>Apache Hive : HowToContribute How to Contribute to Apache Hive This page describes the mechanics of [...]
-Getting the Source Code Becoming a Contributor Making Changes Coding Conventions Understanding Maven Understanding Hive Branches Hadoop Dependencies Unit Tests Add a Unit Test Submitting a PR Fetching a PR from Github Contributing Your Work JIRA Guidelines Generating Thrift Code See Also Getting the Source Code First of all, you need the Hive source code.</description></item><item><title>Apache Hive : HowToRelease</title><link>https://hive.apache.org/docs/latest/howtorelease_27362106/</l [...]
-Storage API Release Storage API Prepare Master Branch Storage API Branching Making Storage API Release Artifacts Publishing the Storage API Artifacts Preparing Branch for further development Cleaning Up Storage API Artifacts Hive Release Preparation Branching Updating Release Branch Building Voting Verifying the Release Candidate Publishing Archive old releases Preparing Branch for Future Maintenance Release See Also Hadoop Version Warning</description></item><item><title>Apache Hive : H [...]
-Materialized views with automatic rewriting can result in very similar results. Hive 2.3.0 adds support for materialzed views. Using columnar file formats (Parquet, ORC) – they can do selective scanning; they may even skip entire files/blocks.</description></item><item><title>Apache Hive : IndexDev Bitmap</title><link>https://hive.apache.org/docs/latest/indexdev-bitmap_27362028/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/indexdev-bit [...]
-Introduction Approach Proposal First implementation Second iteration Example Introduction This document explains the proposed design for adding a bitmap index handler (https://issues.apache.org/jira/browse/HIVE-1803).
+Apache Hive : JDBC Driver Integration with Pentaho Integration with SQuirrel SQL Client Integration with Pentaho Download pentaho report designer from the pentaho website.</description></item><item><title>Apache Hive : HiveODBC</title><link>https://hive.apache.org/docs/latest/hiveodbc_27362099/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hiveodbc_27362099/</guid><description>Apache Hive : ODBC Driver These instructions are for the Hiv [...]
+There is no ODBC driver available for HiveServer2 as part of Apache Hive. There are third party ODBC drivers available from different vendors, and most of them seem to be free.
+Apache Hive : ODBC Driver Introduction Suggested Reading Software Requirements Driver Architecture Building and Setting Up ODBC Components Hive Client Build/Setup unixODBC API Wrapper Build/Setup Connecting the Driver to a Driver Manager Testing with ISQL Build libodbchive.</description></item><item><title>Apache Hive : HivePlugins</title><link>https://hive.apache.org/docs/latest/hiveplugins_27362098/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/d [...]
+package com.example.hive.udf; import org.apache.hadoop.hive.ql.exec.UDF; import org.apache.hadoop.io.Text; public final class Lower extends UDF { public Text evaluate(final Text s) { if (s == null) { return null; } return new Text(s.</description></item><item><title>Apache Hive : HiveQL</title><link>https://hive.apache.org/docs/latest/hiveql_27362097/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hiveql_27362097/</guid><description>Apac [...]
+Please see the HiveQL Language Manual</description></item><item><title>Apache Hive : HiveReplicationDevelopment</title><link>https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/hivereplicationdevelopment_55155632/</guid><description>Apache Hive : HiveReplicationDevelopment Apache Hive : HiveReplicationDevelopment Introduction Purposes of Replication Disaster Recovery Loa [...]
+This work is under development and interfaces are subject to change. This has been designed for use in conjunction with external orchestration tools, which would be responsible for co-ordinating the right sequence of commands between source and target clusters, fault tolerance/failure handling, and also providing correct configuration options that are necessary to be able to do cross cluster replication.</description></item><item><title>Apache Hive : HiveServer</title><link>https://hive. [...]
+Apache Hive : HiveServer2 Clients Version information Beeline – Command Line Shell Beeline Example Beeline Commands Beeline Properties Beeline Hive Commands Beeline Command Options Output Formats HiveServer2 Logging Cancelling the Query Background Query in Terminal Script JDBC Connection URLs Connection URL Format Connection URL for Remote or Embedded Mode Connection URL When HiveServer2 Is Running in HTTP Mode Connection URL When SSL Is Enabled in HiveServer2 Connection URL When ZooKeep [...]
+Motivations Concurrency Many users have reported that the current HiveServer implementation has concurrency bugs (for example, see HIVE-80). In fact, it&rsquo;s impossible for HiveServer to support concurrent connections using the current Thrift API, a result of the fact that Thrift doesn&rsquo;t provide server-side access to connection handles. Since the current API does not provide explicit support for sessions or connections, HiveServer has no way of mapping incoming requests [...]
+Built on top of Apache Hadoop™, Hive provides the following features:</description></item><item><title>Apache Hive : Howl</title><link>https://hive.apache.org/docs/latest/howl_27362109/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howl_27362109/</guid><description>Apache Hive : Howl This page collects some pointers to resources about Howl (an effort to create a metastore for all of Hadoop) and how its first incarnation is being built b [...]
+Howl wiki Yahoo group for Howl developers (including mailing list archive) Howl source code at github Howl CLI functional spec Original plans for Owl (predecessor to Howl)</description></item><item><title>Apache Hive : HowToCommit</title><link>https://hive.apache.org/docs/latest/howtocommit_27362108/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/howtocommit_27362108/</guid><description>Apache Hive : Guide for Committers This page contai [...]
+Apache Hive : Guide for Committers New committers Review Reject PreCommit runs, and committing patches Commit Backporting commits to previous branches Dialog New committers New committers are encouraged to first read Apache&rsquo;s generic committer documentation:</description></item><item><title>Apache Hive : HowToContribute</title><link>https://hive.apache.org/docs/latest/howtocontribute_27362107/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org [...]
+Apache Hive : How to Contribute Getting the Source Code Becoming a Contributor Making Changes Coding Conventions Understanding Maven Understanding Hive Branches Hadoop Dependencies Unit Tests Add a Unit Test Submitting a PR Fetching a PR from Github Contributing Your Work JIRA Guidelines Generating Thrift Code See Also Getting the Source Code First of all, you need the Hive source code.</description></item><item><title>Apache Hive : HowToRelease</title><link>https://hive.apache.org/docs/ [...]
+Materialized views with automatic rewriting can result in very similar results. Hive 2.3.0 adds support for materialzed views.</description></item><item><title>Apache Hive : IndexDev Bitmap</title><link>https://hive.apache.org/docs/latest/indexdev-bitmap_27362028/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/indexdev-bitmap_27362028/</guid><description>Apache Hive : Bitmap Indexing Apache Hive : Bitmap Indexing Introduction Approach Pr [...]
Bitmap indexing (http://en.wikipedia.org/wiki/Bitmap_index) is a standard technique for indexing columns with few distinct
values, such as gender.
Approach We want to develop a bitmap index that can reuse as much of the existing Compact Index code as possible.</description></item><item><title>Apache Hive : Introduction to Apache Hive</title><link>https://hive.apache.org/docs/latest/introduction-to-apache-hive_283118337/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/introduction-to-apache-hive_283118337/</guid><description>Apache Hive : Introduction to Apache Hive The Apache Hive™ [...]
Built on top of Apache Hadoop™, Hive provides the following features:
-Tools to enable easy access to data via SQL, thus enabling data warehousing tasks such as extract/transform/load (ETL), reporting, and data analysis. A mechanism to impose structure on a variety of data formats Access to files stored either directly in Apache HDFS™ or in other data storage systems such as Apache HBase™ Query execution via Apache Tez™ or MapReduce Procedural language with HPL-SQL Sub-second query retrieval via Hive LLAP, Apache YARN and Apache Slider.</description></item> [...]
+Tools to enable easy access to data via SQL, thus enabling data warehousing tasks such as extract/transform/load (ETL), reporting, and data analysis. A mechanism to impose structure on a variety of data formats Access to files stored either directly in Apache HDFS™ or in other data storage systems such as Apache HBase™ Query execution via Apache Tez™ or MapReduce Procedural language with HPL-SQL Sub-second query retrieval via Hive LLAP, Apache YARN and Apache Slider.</description></item> [...]
Commands and CLIs
Commands Hive CLI (old) Beeline CLI (new) Variable Substitution HCatalog CLI File Formats
Avro Files ORC Files Parquet Compressed Data Storage LZO Compression Data Types
Data Definition Statements
-DDL Statements Bucketed Tables Statistics (Analyze and Describe) Indexes Archiving Data Manipulation Statements</description></item><item><title>Apache Hive : LanguageManual Archiving</title><link>https://hive.apache.org/docs/latest/languagemanual-archiving_27362031/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-archiving_27362031/</guid><description>Apache Hive : LanguageManual Archiving Archiving for File Count Reductio [...]
-Archiving for File Count Reduction Overview Settings Usage Archive Unarchive Cautions and Limitations Under the Hood Overview Due to the design of HDFS, the number of files in the filesystem directly affects the memory consumption in the namenode. While normally not a problem for small clusters, memory usage may hit the limits of accessible memory on a single machine when there are &gt;50-100 million files.</description></item><item><title>Apache Hive : LanguageManual Authorization</ [...]
-Introduction Hive Authorization Options Use Cases Overview of Authorization Modes 1 Storage Based Authorization in the Metastore Server Fall Back Authorizer 2 SQL Standards Based Authorization in HiveServer2 3 Authorization using Apache Ranger &amp; Sentry 4 Old default Hive Authorization (Legacy Mode) Addressing Authorization Needs of Multiple Use Cases Explain Authorization More Information Introduction Note that this documentation is referring to Authorization which is verifying i [...]
-Command Description quit exit Use quit or exit to leave the interactive shell. reset Resets the configuration to the default values (as of Hive 0.10: see HIVE-3202). Any configuration parameters that were set using the set command or -hiveconf parameter in hive commandline will get reset to default value.</description></item><item><title>Apache Hive : LanguageManual DDL</title><link>https://hive.apache.org/docs/latest/languagemanual-ddl_27362034/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
-Overview Keywords, Non-reserved Keywords and Reserved Keywords Create/Drop/Alter/Use Database Create/Drop/Alter Connector Create/Drop/Truncate Table Alter Table/Partition/Column Create/Drop/Alter View Create/Drop/Alter Materialized View Create/Drop/Alter Index Create/Drop Macro Create/Drop/Reload Function Create/Drop/Grant/Revoke Roles and Privileges Show Describe Abort Scheduled queries
-Datasketches integration
-HCatalog and WebHCat DDL
-Overview HiveQL DDL statements are documented here, including:
-CREATE DATABASE/SCHEMA, TABLE, VIEW, FUNCTION, INDEX DROP DATABASE/SCHEMA, TABLE, VIEW, INDEX TRUNCATE TABLE ALTER DATABASE/SCHEMA, TABLE, VIEW MSCK REPAIR TABLE (or ALTER TABLE RECOVER PARTITIONS) SHOW DATABASES/SCHEMAS, TABLES, TBLPROPERTIES, VIEWS, PARTITIONS, FUNCTIONS, INDEX[ES], COLUMNS, CREATE TABLE DESCRIBE DATABASE/SCHEMA, table_name, view_name, materialized_view_name PARTITION statements are usually options of TABLE statements, except for SHOW PARTITIONS.</description></item><i [...]
-Bucketed tables are fantastic in that they allow much more efficient sampling than do non-bucketed tables, and they may later allow for time saving operations such as mapside joins. However, the bucketing specified at table creation is not enforced when the table is written to, and so it is possible for the table&rsquo;s metadata to advertise properties which are not upheld by the table&rsquo;s actual layout.</description></item><item><title>Apache Hive : LanguageManual DML</titl [...]
-EXPLAIN [EXTENDED|CBO|AST|DEPENDENCY|AUTHORIZATION|LOCKS|VECTORIZATION|ANALYZE] query AUTHORIZATION is supported from HIVE 0.14.0 via HIVE-5961.</description></item><item><title>Apache Hive : LanguageManual GroupBy</title><link>https://hive.apache.org/docs/latest/languagemanual-groupby_27362038/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-groupby_27362038/</guid><description>Apache Hive : LanguageManual GroupBy Group By [...]
-The EXPORT and IMPORT commands were added in Hive 0.8.0 (see HIVE-1918).
+DDL Statements Bucketed Tables Statistics (Analyze and Describe) Indexes Archiving Data Manipulation Statements</description></item><item><title>Apache Hive : LanguageManual Archiving</title><link>https://hive.apache.org/docs/latest/languagemanual-archiving_27362031/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-archiving_27362031/</guid><description>Apache Hive : LanguageManual Archiving Archiving for File Count Reduction.
+Apache Hive : LanguageManual Archiving Overview Settings Usage Archive Unarchive Cautions and Limitations Under the Hood Overview Due to the design of HDFS, the number of files in the filesystem directly affects the memory consumption in the namenode. While normally not a problem for small clusters, memory usage may hit the limits of accessible memory on a single machine when there are &gt;50-100 million files.</description></item><item><title>Apache Hive : LanguageManual Authorizati [...]
+Apache Hive : LanguageManual Hive CLI Deprecation in favor of Beeline CLI Hive Command Line Options Examples The hiverc File Logging Tool to Clear Dangling Scratch Directories Hive Batch Mode Commands Hive Interactive Shell Commands Hive Resources HCatalog CLI Deprecation in favor of Beeline CLI HiveServer2 (introduced in Hive 0.</description></item><item><title>Apache Hive : LanguageManual Commands</title><link>https://hive.apache.org/docs/latest/languagemanual-commands_34838882/</link> [...]
+Command Description quit exit Use quit or exit to leave the interactive shell. reset Resets the configuration to the default values (as of Hive 0.10: see HIVE-3202). Any configuration parameters that were set using the set command or -hiveconf parameter in hive commandline will get reset to default value.</description></item><item><title>Apache Hive : LanguageManual DDL</title><link>https://hive.apache.org/docs/latest/languagemanual-ddl_27362034/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
+Bucketed tables are fantastic in that they allow much more efficient sampling than do non-bucketed tables, and they may later allow for time saving operations such as mapside joins. However, the bucketing specified at table creation is not enforced when the table is written to, and so it is possible for the table&rsquo;s metadata to advertise properties which are not upheld by the table&rsquo;s actual layout.</description></item><item><title>Apache Hive : LanguageManual DML</titl [...]
Replication extensions to the EXPORT and IMPORT commands were added in Hive 1.2.0 (see HIVE-7973 and Hive Replication Development).
-Overview The EXPORT command exports the data of a table or partition, along with the metadata, into a specified output location.</description></item><item><title>Apache Hive : LanguageManual Indexing</title><link>https://hive.apache.org/docs/latest/languagemanual-indexing_31822176/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-indexing_31822176/</guid><description>Apache Hive : LanguageManual Indexing Indexing Is Removed [...]
-Materialized views with automatic rewriting can result in very similar results. Hive 2.3.0 adds support for materialzed views. Using columnar file formats (Parquet, ORC) – they can do selective scanning; they may even skip entire files/blocks.</description></item><item><title>Apache Hive : LanguageManual JoinOptimization</title><link>https://hive.apache.org/docs/latest/languagemanual-joinoptimization_33293167/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apa [...]
-Current and Future Optimizations Optimize Auto Join Conversion
-- [Current Optimization](#current-optimization)+ [Auto Conversion to SMB Map Join](#auto-conversion-to-smb-map-join) - [SMB Join across Tables with Different Keys](#smb-join-across-tables-with-different-keys) Generate Hash Tables on the Task Side</description></item><item><title>Apache Hive : LanguageManual Joins</title><link>https://hive.apache.org/docs/latest/languagemanual-joins_27362039/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest [...]
-join_table: table_reference [INNER] JOIN table_factor [join_condition] | table_reference {LEFT|RIGHT|FULL} [OUTER] JOIN table_reference join_condition | table_reference LEFT SEMI JOIN table_reference join_condition | table_reference CROSS JOIN table_reference [join_condition] (as of Hive 0.</description></item><item><title>Apache Hive : LanguageManual LateralView</title><link>https://hive.apache.org/docs/latest/languagemanual-lateralview_27362040/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
+Overview The EXPORT command exports the data of a table or partition, along with the metadata, into a specified output location.</description></item><item><title>Apache Hive : LanguageManual Indexing</title><link>https://hive.apache.org/docs/latest/languagemanual-indexing_31822176/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-indexing_31822176/</guid><description>Apache Hive : LanguageManual Indexing Apache Hive : Langua [...]
+Materialized views with automatic rewriting can result in very similar results. Hive 2.3.0 adds support for materialzed views.</description></item><item><title>Apache Hive : LanguageManual JoinOptimization</title><link>https://hive.apache.org/docs/latest/languagemanual-joinoptimization_33293167/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-joinoptimization_33293167/</guid><description>Apache Hive : LanguageManual Join Op [...]
+The join optimizations described here were added in Hive version 0.11.0. See HIVE-3784 and related JIRAs.
+This document describes optimizations of Hive&rsquo;s query execution planning to improve the efficiency of joins and reduce the need for user hints.</description></item><item><title>Apache Hive : LanguageManual Joins</title><link>https://hive.apache.org/docs/latest/languagemanual-joins_27362039/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-joins_27362039/</guid><description>Apache Hive : LanguageManual Joins Apache [...]
+join_table: table_reference [INNER] JOIN table_factor [join_condition] | table_reference {LEFT|RIGHT|FULL} [OUTER] JOIN table_reference join_condition | table_reference LEFT SEMI JOIN table_reference join_condition | table_reference CROSS JOIN table_reference [join_condition] (as of Hive 0.</description></item><item><title>Apache Hive : LanguageManual LateralView</title><link>https://hive.apache.org/docs/latest/languagemanual-lateralview_27362040/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
Introduced in Hive version 0.11.0.
-The Optimized Row Columnar (ORC) file format provides a highly efficient way to store Hive data.</description></item><item><title>Apache Hive : LanguageManual Sampling</title><link>https://hive.apache.org/docs/latest/languagemanual-sampling_27362042/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-sampling_27362042/</guid><description>Apache Hive : LanguageManual Sampling Sampling Syntax Sampling Bucketized Table Block Samp [...]
-Select Syntax [WITH CommonTableExpression (, CommonTableExpression)*] (Note: Only available starting with Hive 0.</description></item><item><title>Apache Hive : LanguageManual SortBy</title><link>https://hive.apache.org/docs/latest/languagemanual-sortby_27362045/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-sortby_27362045/</guid><description>Apache Hive : LanguageManual SortBy Order, Sort, Cluster, and Distribute By Syn [...]
-Hive versions prior to 1.</description></item><item><title>Apache Hive : LanguageManual VariableSubstitution</title><link>https://hive.apache.org/docs/latest/languagemanual-variablesubstitution_30754722/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-variablesubstitution_30754722/</guid><description>Apache Hive : LanguageManual VariableSubstitution Introduction Using Variables Substitution During Query Construction Disabli [...]
-The Hive variable substitution mechanism was designed to avoid some of the code that was getting baked into the scripting language on top of Hive.
-Examples such as the following shell commands may (inefficiently) be used to set variables within a script:</description></item><item><title>Apache Hive : LanguageManual VirtualColumns</title><link>https://hive.apache.org/docs/latest/languagemanual-virtualcolumns_27362048/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-virtualcolumns_27362048/</guid><description>Apache Hive : LanguageManual VirtualColumns Virtual Columns S [...]
+The Optimized Row Columnar (ORC) file format provides a highly efficient way to store Hive data.</description></item><item><title>Apache Hive : LanguageManual Sampling</title><link>https://hive.apache.org/docs/latest/languagemanual-sampling_27362042/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-sampling_27362042/</guid><description>Apache Hive : LanguageManual Sampling Apache Hive : LanguageManual Sampling Sampling Synta [...]
+Hive versions prior to 1.2.0 only support UNION ALL (bag union), in which duplicate rows are not eliminated.</description></item><item><title>Apache Hive : LanguageManual VariableSubstitution</title><link>https://hive.apache.org/docs/latest/languagemanual-variablesubstitution_30754722/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-variablesubstitution_30754722/</guid><description>Apache Hive : LanguageManual VariableSubst [...]
+The Hive variable substitution mechanism was designed to avoid some of the code that was getting baked into the scripting language on top of Hive.</description></item><item><title>Apache Hive : LanguageManual VirtualColumns</title><link>https://hive.apache.org/docs/latest/languagemanual-virtualcolumns_27362048/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-virtualcolumns_27362048/</guid><description>Apache Hive : Language [...]
One is INPUT__FILE__NAME, which is the input file&rsquo;s name for a mapper task.
the other is BLOCK__OFFSET__INSIDE__FILE, which is the current global file position.
-For block compressed file, it is the current block&rsquo;s file offset, which is the current block&rsquo;s first byte&rsquo;s file offset.
-Since Hive 0.</description></item><item><title>Apache Hive : LanguageManual WindowingAndAnalytics</title><link>https://hive.apache.org/docs/latest/languagemanual-windowingandanalytics_31819589/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-windowingandanalytics_31819589/</guid><description>Apache Hive : LanguageManual WindowingAndAnalytics Windowing and Analytics Functions Windowing and Analytics Functions Enhancements to [...]
-UDFs xpath, xpath_short, xpath_int, xpath_long, xpath_float, xpath_double, xpath_number, xpath_string Functions for parsing XML data using XPath expressions. Since version: 0.6.0 Overview The xpath family of UDFs are wrappers around the Java XPath library javax.xml.xpath provided by the JDK. The library is based on the XPath 1.0 specification. Please refer to http://java.sun.com/javase/6/docs/api/javax/xml/xpath/package-summary.html for detailed information on the Java XPath library.</de [...]
-Type Postfix Example TINYINT Y 100Y SMALLINT S 100S BIGINT L 100L String types String literals can be expressed with either single quotes (') or double quotes (&quot;).</description></item><item><title>Apache Hive : LLAP</title><link>https://hive.apache.org/docs/latest/llap_62689557/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/llap_62689557/</guid><description>Apache Hive : LLAP Overview Persistent Daemon Execution Engine Query Fr [...]
-For configuration of LLAP, see the LLAP Section of Configuration Properties.
-Overview Hive has become significantly faster thanks to various features and improvements that were built by the community in recent years, including Tez and Cost-based-optimization.</description></item><item><title>Apache Hive : Locking</title><link>https://hive.apache.org/docs/latest/locking_27362050/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/locking_27362050/</guid><description>Apache Hive : Locking Hive Concurrency Model Hive Co [...]
-Managed (Internal) External Introduction This document lists some of the differences between the two but the fundamental difference is that Hive assumes that it owns the data for managed tables. That means that the data, its properties and data layout will and can only be changed via Hive command. The data still lives in a normal file system and nothing is stopping you from changing it without telling Hive about it.</description></item><item><title>Apache Hive : Manual Installation</titl [...]
-1. Map Join Optimization 1.1 Using Distributed Cache to Propagate Hashtable File 1.2 Removing JDBM 1.3 Performance Evaluation 2. Converting Join into Map Join Automatically 2.1 New Join Execution Flow 2.2 Resolving the Join Operation at Run Time 2.3 Backup Task 2.4 Performance Evaluation 1. Map Join Optimization 1.1 Using Distributed Cache to Propagate Hashtable File Previously, when 2 large data tables need to do a join, there will be 2 different Mappers to sort these tables based on th [...]
-Materialized views support is introduced in Hive 3.0.0.
-Introduction This page documents the work done for the supporting materialized views in Apache Hive.</description></item><item><title>Apache Hive : Materialized views in Hive</title><link>https://hive.apache.org/docs/latest/materialized-views-in-hive_283118346/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/materialized-views-in-hive_283118346/</guid><description>Apache Hive : Materialized views in Hive Objectives Traditionally, one of t [...]
+For block compressed file, it is the current block&rsquo;s file offset, which is the current block&rsquo;s first byte&rsquo;s file offset.</description></item><item><title>Apache Hive : LanguageManual WindowingAndAnalytics</title><link>https://hive.apache.org/docs/latest/languagemanual-windowingandanalytics_31819589/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/languagemanual-windowingandanalytics_31819589/</guid><descripti [...]
+This section introduces the Hive QL enhancements for windowing and analytics functions. See &ldquo;Windowing Specifications in HQL&rdquo; (attached to HIVE-4197) for details. HIVE-896 has more information, including links to earlier documentation in the initial comments.</description></item><item><title>Apache Hive : LanguageManual XPathUDF</title><link>https://hive.apache.org/docs/latest/languagemanual-xpathudf_27362051/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><g [...]
+UDFs xpath, xpath_short, xpath_int, xpath_long, xpath_float, xpath_double, xpath_number, xpath_string Functions for parsing XML data using XPath expressions. Since version: 0.6.0 Overview The xpath family of UDFs are wrappers around the Java XPath library javax.xml.xpath provided by the JDK. The library is based on the XPath 1.0 specification. Please refer to http://java.sun.com/javase/6/docs/api/javax/xml/xpath/package-summary.html for detailed information on the Java XPath library.</de [...]
+There are many tables of the following format:
+create table T(a, b, c, .</description></item><item><title>Apache Hive : Literals</title><link>https://hive.apache.org/docs/latest/literals_27829682/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/literals_27829682/</guid><description>Apache Hive : Literals Literals Integral types Integral literals are assumed to be INT by default, unless the number exceeds the range of INT in which case it is interpreted as a BIGINT, or if one of the fo [...]
+Type Postfix Example TINYINT Y 100Y SMALLINT S 100S BIGINT L 100L String types String literals can be expressed with either single quotes (') or double quotes (&quot;).</description></item><item><title>Apache Hive : LLAP</title><link>https://hive.apache.org/docs/latest/llap_62689557/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/llap_62689557/</guid><description>Apache Hive : LLAP Live Long And Process (LLAP) functionality was added [...]
+Apache Hive : LLAP Overview Persistent Daemon Execution Engine Query Fragment Execution I/O Caching Workload Management ACID Support Security Monitoring Web Services SLIDER on YARN Deployment LLAP Status Resources Attachments: Overview Hive has become significantly faster thanks to various features and improvements that were built by the community in recent years, including Tez and Cost-based-optimization.</description></item><item><title>Apache Hive : Locking</title><link>https://hive.a [...]
+Managed (Internal) External Introduction This document lists some of the differences between the two but the fundamental difference is that Hive assumes that it owns the data for managed tables. That means that the data, its properties and data layout will and can only be changed via Hive command. The data still lives in a normal file system and nothing is stopping you from changing it without telling Hive about it.</description></item><item><title>Apache Hive : Manual Installation</titl [...]
+Apache Hive : Materialized views Version information Objectives Management of materialized views in Hive Materialized views creation Other operations for materialized view management Materialized view-based query rewriting Example 1 Example 2 Example 3 Materialized view maintenance Materialized view lifecycle Open issues (JIRA) Version information Materialized views support is introduced in Hive 3.</description></item><item><title>Apache Hive : Materialized views in Hive</title><link>htt [...]
The initial implementation focuses on introducing materialized views and automatic query rewriting based on those materializations in the project. In particular, materialized views can be stored natively in Hive or in other systems such as Druid using custom storage handlers, and they can seamlessly exploit new exciting Hive features such as LLAP acceleration.</description></item><item><title>Apache Hive : MetaStore API Tests</title><link>https://hive.apache.org/docs/latest/metastore-api [...]
To ensure that the IMetaStoreClient implementations provide the same API we created a set of tests to validate their workings.
Currently the following implementations are tested:
@@ -209,14 +188,13 @@ Version Hive 0.14.0 and later.
Hive QL Syntax You can use MultiDelimitSerDe in a create table statement like this:
CREATE TABLE test ( id string, hivearray array&lt;binary&gt;, hivemap map&lt;string,int&gt;) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe' WITH SERDEPROPERTIES (&quot;field.delim&quot;=&quot;[,]&quot;,&quot;collection.delim&quot;=&quot;:&quot;,&quot;mapkey.delim&quot;=&quot;@&quot;); where field.delim is the field delimiter, collection.delim and mapkey.delim is the delimiter for collection items and key [...]
Guide to Hive Operators and Functions
-Reflect UDF Generic UDAF Case Study Functions for Statistics and Data Mining</description></item><item><title>Apache Hive : OuterJoinBehavior</title><link>https://hive.apache.org/docs/latest/outerjoinbehavior_35749927/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/outerjoinbehavior_35749927/</guid><description>Apache Hive : OuterJoinBehavior Hive Outer Join Behavior Hive Outer Join Behavior Definitions Predicate Pushdown Rules Hive Impl [...]
-Parquet is supported by a plugin in Hive 0.10, 0.11, and 0.12 and natively in Hive 0.13 and later.
- Introduction Native Parquet Support Hive 0.10, 0.11, and 0.12 Hive 0.13 HiveQL Syntax Hive 0.10 - 0.12 Hive 0.13 and later Versions and Limitations Hive 0.13.0 Hive 0.14.0 Hive 1.1.0 Hive 1.2.0 Resources Introduction Parquet (http://parquet.</description></item><item><title>Apache Hive : Partition Filter Syntax</title><link>https://hive.apache.org/docs/latest/partition-filter-syntax_103092177/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/la [...]
+Reflect UDF Generic UDAF Case Study Functions for Statistics and Data Mining</description></item><item><title>Apache Hive : OuterJoinBehavior</title><link>https://hive.apache.org/docs/latest/outerjoinbehavior_35749927/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/outerjoinbehavior_35749927/</guid><description>Apache Hive : OuterJoinBehavior Hive Outer Join Behavior Hive Outer Join Behavior Definitions Predicate Pushdown Rules Hive Impl [...]
+Apache Hive : Parquet Introduction Native Parquet Support Hive 0.10, 0.11, and 0.12 Hive 0.13 HiveQL Syntax Hive 0.10 - 0.12 Hive 0.13 and later Versions and Limitations Hive 0.13.0 Hive 0.14.0 Hive 1.1.0 Hive 1.2.0 Resources Introduction Parquet (http://parquet.</description></item><item><title>Apache Hive : Partition Filter Syntax</title><link>https://hive.apache.org/docs/latest/partition-filter-syntax_103092177/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hiv [...]
country = &quot;USA&quot; AND (state = &quot;CA&quot; OR state = &quot;AZ&quot;)
In particular notice that it is possible to nest sub-expressions within parentheses.
The following operators are supported when constructing filters for partition columns (derived from HIVE-1862):
-= &lt; &lt;= &gt; &gt;= &lt;&gt; AND OR LIKE (on keys of type string only, supports literal string template with &lsquo;.</description></item><item><title>Apache Hive : PartitionedViews</title><link>https://hive.apache.org/docs/latest/partitionedviews_27362053/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/partitionedviews_27362053/</guid><description>Apache Hive : PartitionedViews Use Cases Approaches Syntax [...]
-Use Cases An administrator wants to create a set of views as a table/column renaming layer on top of an existing set of base tables, without breaking any existing dependencies on those tables. To read-only users, the views should behave exactly the same as the underlying tables in every way.</description></item><item><title>Apache Hive : Performance</title><link>https://hive.apache.org/docs/latest/performance_27362052/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https:/ [...]
+= &lt; &lt;= &gt; &gt;= &lt;&gt; AND OR LIKE (on keys of type string only, supports literal string template with &lsquo;.</description></item><item><title>Apache Hive : PartitionedViews</title><link>https://hive.apache.org/docs/latest/partitionedviews_27362053/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/partitionedviews_27362053/</guid><description>Apache Hive : PartitionedViews This is a followup to ViewD [...]
+Apache Hive : PartitionedViews Use Cases Approaches Syntax Metastore Strict Mode View Definition Changes Hook Information Use Cases An administrator wants to create a set of views as a table/column renaming layer on top of an existing set of base tables, without breaking any existing dependencies on those tables.</description></item><item><title>Apache Hive : Performance</title><link>https://hive.apache.org/docs/latest/performance_27362052/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000< [...]
Benchmarks Here are some JIRA issues about benchmarks for Hive:</description></item><item><title>Apache Hive : Permission Inheritance in Hive</title><link>https://hive.apache.org/docs/latest/permission-inheritance-in-hive_48203008/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/permission-inheritance-in-hive_48203008/</guid><description>Apache Hive : Permission Inheritance in Hive This document describes how attributes (permission, grou [...]
HDFS Background When a file or directory is created, its owner is the user identity of the client process, and its group is inherited from parent (the BSD rule). Permissions are taken from default umask. Extended Acl&rsquo;s are taken from parent unless they are set explicitly. Goals To reduce need to set fine-grain file security props after every operation, users may want the following Hive warehouse file/dir to auto-inherit security properties from their directory parents:</descrip [...]
The PDK is planned for inclusion in the Hive 0.8.0 release; until that is available, please download a recent snapshot build from Jenkins; make sure it includes HIVE-2244.</description></item><item><title>Apache Hive : PoweredBy</title><link>https://hive.apache.org/docs/latest/poweredby_27362055/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/poweredby_27362055/</guid><description>Apache Hive : PoweredBy Applications and organizations us [...]
@@ -224,140 +202,141 @@ Bizo We use Hive for reporting and ad hoc queries.
Chitika We use Hive for data mining and analysis on our 435M monthly global users.
CNET We use Hive for data mining, internal log analysis and ad hoc queries.
Digg We use Hive for data mining, internal log analysis, R&amp;D, and reporting/analytics.
-eHarmony We use Hadoop to store copies of internal log and dimension data sources and use it as a source for reporting/analytics and machine learning.</description></item><item><title>Apache Hive : Presentations</title><link>https://hive.apache.org/docs/latest/presentations_27362054/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/presentations_27362054/</guid><description>Apache Hive : Presentations Hive Meetups January 2016 Hive User [...]
-ReExecition strategies Overlay Reoptimize Operator Matching Configuration Introduced in Hive 3.0 (HIVE-17626)
-ReExecition strategies Overlay Enables to change the hive settings for all reexecutions which will be happening. It works by adding a configuration subtree as an overlay to the actual hive settings(reexec.</description></item><item><title>Apache Hive : Query Results Caching (HIVE-18513)</title><link>https://hive.apache.org/docs/latest/75963441/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/75963441/</guid><description>Apache Hive : Quer [...]
+eHarmony We use Hadoop to store copies of internal log and dimension data sources and use it as a source for reporting/analytics and machine learning.</description></item><item><title>Apache Hive : Presentations</title><link>https://hive.apache.org/docs/latest/presentations_27362054/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/presentations_27362054/</guid><description>Apache Hive : Presentations Apache Hive : Presentations Hive Meetu [...]
+Apache Hive : Query ReExecution ReExecition strategies Overlay Reoptimize Operator Matching Configuration ReExecition strategies Overlay Enables to change the hive settings for all reexecutions which will be happening. It works by adding a configuration subtree as an overlay to the actual hive settings(reexec.</description></item><item><title>Apache Hive : Query Results Caching (HIVE-18513)</title><link>https://hive.apache.org/docs/latest/75963441/</link><pubDate>Thu, 12 Dec 2024 00:00:0 [...]
Background Existing behavior for Hive query processing (very simplified):
Hive query compilation takes the query string and produces a QueryPlan.</description></item><item><title>Apache Hive : RCFile</title><link>https://hive.apache.org/docs/latest/rcfile_58851803/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/rcfile_58851803/</guid><description>Apache Hive : RCFile RCFile (Record Columnar File) is a data placement structure designed for MapReduce-based data warehouse systems. Hive added the RCFile format in [...]
-RCFile stores table data in a flat file consisting of binary key/value pairs. It first partitions rows horizontally into row splits, and then it vertically partitions each row split in a columnar way. RCFile stores the metadata of a row split as the key part of a record, and all the data of a row split as the value part.</description></item><item><title>Apache Hive : RCFileCat</title><link>https://hive.apache.org/docs/latest/rcfilecat_30748712/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0 [...]
-Data Prints out the rows stored in an RCFile, columns are tab separated and rows are newline separated.
+RCFile stores table data in a flat file consisting of binary key/value pairs. It first partitions rows horizontally into row splits, and then it vertically partitions each row split in a columnar way. RCFile stores the metadata of a row split as the key part of a record, and all the data of a row split as the value part.</description></item><item><title>Apache Hive : RCFileCat</title><link>https://hive.apache.org/docs/latest/rcfilecat_30748712/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0 [...]
+Apache Hive : RCFileCat Data Metadata Data Prints out the rows stored in an RCFile, columns are tab separated and rows are newline separated.
Usage:
hive --rcfilecat [--start=start_offset] [--length=len] [--verbose] fileName --start=start_offset Start offset to begin reading in the file --length=len Length of data to read from the file --verbose Prints periodic stats about the data read, how many records, how many bytes, scan rate Metadata New in 0.</description></item><item><title>Apache Hive : Rebalance compaction</title><link>https://hive.apache.org/docs/latest/rebalance-compaction_240884502/</link><pubDate>Thu, 12 Dec 2024 00:00: [...]
Apache Hivemall (incubating) Apache Hivemall is a scalable machine learning library for Apache Hive, Apache Spark, and Apache Pig.
-Apache Sentry (incubating) Sentry is a role-based authorization system for Apache Hive.</description></item><item><title>Apache Hive : Replacing the Implementation of Hive CLI Using Beeline</title><link>https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/</guid><description>Apache [...]
+Apache Sentry (incubating) Sentry is a role-based authorization system for Apache Hive.</description></item><item><title>Apache Hive : Replacing the Implementation of Hive CLI Using Beeline</title><link>https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/replacing-the-implementation-of-hive-cli-using-beeline_61311909/</guid><description>Apache [...]
Features to be added Major Recent Changes Table Statistics Archiving Indexing First Cut Concurrency Conversion to Map-Join at Runtime Support for Multiple Distincts Remove Partition Filtering Conditions INSERT INTO statement Block-level merge HAVING clause support Cross-database queries Bitmap Index Use Filter Pushdown for Automatically Accessing Indexes Remove Duplicate Filters Authentication Authorization Current Projects Bloom Filters TIMESTAMP data type Up For Grabs Priorities are de [...]
There are several rules already defined by the community, but most of them are not enforced.
-Yetus helps us by checking these rules for newly introduced errors. Note that Yetus checks only the changed part of the code. If any unchanged code contains errors, then Yetus will not report them, but all of the new code should conform to the rules.</description></item><item><title>Apache Hive : Scheduled Queries</title><link>https://hive.apache.org/docs/latest/scheduled-queries_145724128/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/ [...]
+Yetus helps us by checking these rules for newly introduced errors. Note that Yetus checks only the changed part of the code. If any unchanged code contains errors, then Yetus will not report them, but all of the new code should conform to the rules.</description></item><item><title>Apache Hive : Scheduled Queries</title><link>https://hive.apache.org/docs/latest/scheduled-queries_145724128/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/ [...]
Authorization modes
The links below refer to the original Hive authorization mode. See Authorization for an overview of authorization modes, which include storage based authorization and SQL standards based authorization.
-Thoughts on security from Venkatesh Howl&rsquo;s approach for persisting and validating DDL authorization via HDFS permissions HIVE-1264: Hadoop security integration THRIFT-889: allow Kerberos authentication over Thrift HTTP THRIFT-876: SASL integration Howl Authorization Proposal Hive Authorization Proposal Note that Howl was the precursor to HCatalog.</description></item><item><title>Apache Hive : SerDe</title><link>https://hive.apache.org/docs/latest/serde_27362059/</link><pubDate [...]
-A SerDe allows Hive to read in data from a table, and write it back out to HDFS in any custom format.</description></item><item><title>Apache Hive : Setting Up Hive with Docker</title><link>https://hive.apache.org/docs/latest/setting-up-hive-with-docker_282102281/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/setting-up-hive-with-docker_282102281/</guid><description>Apache Hive : Setting Up Hive with Docker Introduction Run Apache Hive [...]
+Thoughts on security from Venkatesh Howl&rsquo;s approach for persisting and validating DDL authorization via HDFS permissions HIVE-1264: Hadoop security integration THRIFT-889: allow Kerberos authentication over Thrift HTTP THRIFT-876: SASL integration Howl Authorization Proposal Hive Authorization Proposal Note that Howl was the precursor to HCatalog.</description></item><item><title>Apache Hive : SerDe</title><link>https://hive.apache.org/docs/latest/serde_27362059/</link><pubDate [...]
STEP 1: Pull the image Pull the 4.0.0 image from Hive DockerHub docker pull apache/hive:4.0.0 STEP 2: Export the Hive version export HIVE_VERSION=4.0.0 STEP 3: Launch the HiveServer2 with an embedded Metastore. This is lightweight and for a quick setup, it uses Derby as metastore db.
-docker run -d -p 10000:10000 -p 10002:10002 --env SERVICE_NAME=hiveserver2 --name hive4 apache/hive:${HIVE_VERSION} STEP 4: Connect to beeline docker exec -it hiveserver2 beeline -u 'jdbc:hive2://hiveserver2:10000/' Note: Launch Standalone Metastore To use standalone Metastore with Derby,</description></item><item><title>Apache Hive : Setting Up HiveServer2</title><link>https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pu [...]
+docker run -d -p 10000:10000 -p 10002:10002 --env SERVICE_NAME=hiveserver2 --name hive4 apache/hive:${HIVE_VERSION} STEP 4: Connect to beeline docker exec -it hiveserver2 beeline -u 'jdbc:hive2://hiveserver2:10000/' Note: Launch Standalone Metastore To use standalone Metastore with Derby,</description></item><item><title>Apache Hive : Setting Up HiveServer2</title><link>https://hive.apache.org/docs/latest/setting-up-hiveserver2_30758712/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pu [...]
+The Thrift interface definition language (IDL) for HiveServer2 is available at https://github.</description></item><item><title>Apache Hive : Skewed Join Optimization</title><link>https://hive.apache.org/docs/latest/skewed-join-optimization_27847852/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/skewed-join-optimization_27847852/</guid><description>Apache Hive : Skewed Join Optimization Optimizing Skewed Joins The Problem A join of 2 la [...]
e.g., Suppose we have table A with a key column, &ldquo;id&rdquo; which has values 1, 2, 3 and 4, and table B with a similar column, which has values 1, 2 and 3.</description></item><item><title>Apache Hive : Spatial queries</title><link>https://hive.apache.org/docs/latest/spatial-queries_34022710/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/spatial-queries_34022710/</guid><description>Apache Hive : Spatial queries Overview Ha [...]
-Hive****SP: we integrate Hadoop-GIS with Hive, to support both structured queries and spatial queries with a unified query language (HQL) and interface (Hive Shell).</description></item><item><title>Apache Hive : SQL Standard Based Hive Authorization</title><link>https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928 [...]
-Statistics and Data Mining in Hive ngrams() and context_ngrams(): N-gram frequency estimation Use Cases Usage Example histogram_numeric(): Estimating frequency distributions Use Cases Usage Example ngrams() and context_ngrams(): N-gram frequency estimation N-grams are subsequences of length N drawn from a longer sequence.</description></item><item><title>Apache Hive : StatsDev</title><link>https://hive.apache.org/docs/latest/statsdev_27362062/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +00 [...]
-Motivation Statistics such as the number of rows of a table or partition and the histograms of a particular interesting column are important in many ways.</description></item><item><title>Apache Hive : Storage API Release Proposal</title><link>https://hive.apache.org/docs/latest/storage-api-release-proposal_67635447/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/storage-api-release-proposal_67635447/</guid><description>Apache Hive : Sto [...]
-Besides HBase, a storage handler implementation is also available for Hypertable, and others are being developed for Cassandra, Azure Table, JDBC (MySQL and others), MongoDB, ElasticSearch, Phoenix HBase, VoltDB and Google Spreadsheets.</description></item><item><title>Apache Hive : Streaming Data Ingest</title><link>https://hive.apache.org/docs/latest/streaming-data-ingest_40509746/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/streami [...]
+Hive****SP: we integrate Hadoop-GIS with Hive, to support both structured queries and spatial queries with a unified query language (HQL) and interface (Hive Shell).</description></item><item><title>Apache Hive : SQL Standard Based Hive Authorization</title><link>https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/sql-standard-based-hive-authorization_40509928 [...]
+Apache Hive : Statistics and Data Mining ngrams() and context_ngrams(): N-gram frequency estimation Use Cases Usage Example histogram_numeric(): Estimating frequency distributions Use Cases Usage Example ngrams() and context_ngrams(): N-gram frequency estimation N-grams are subsequences of length N drawn from a longer sequence.</description></item><item><title>Apache Hive : StatsDev</title><link>https://hive.apache.org/docs/latest/statsdev_27362062/</link><pubDate>Thu, 12 Dec 2024 00:00: [...]
+Apache Hive : Statistics Motivation Scope Table and Partition Statistics Column Statistics Top K Statistics Quick overview Implementation Usage Configuration Variables Newly Created Tables Existing Tables – ANALYZE Examples ANALYZE TABLE &lt;table1&gt; CACHE METADATA Current Status (JIRA) Motivation Statistics such as the number of rows of a table or partition and the histograms of a particular interesting column are important in many ways.</description></item><item><title>Apache [...]
+HIVE-3705 added metastore server security to Hive in release 0.10.0.
+For additional information about storage based authorization in the metastore server, see the HCatalog document Storage Based Authorization. For an overview of Hive authorization models and other security options, see the Authorization document.</description></item><item><title>Apache Hive : StorageHandlers</title><link>https://hive.apache.org/docs/latest/storagehandlers_27362063/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/storagehan [...]
+Besides HBase, a storage handler implementation is also available for Hypertable, and others are being developed for Cassandra, Azure Table, JDBC (MySQL and others), MongoDB, ElasticSearch, Phoenix HBase, VoltDB and Google Spreadsheets.</description></item><item><title>Apache Hive : Streaming Data Ingest</title><link>https://hive.apache.org/docs/latest/streaming-data-ingest_40509746/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/streami [...]
SELECT customer.customer_num, (SELECT SUM(ship_charge) FROM orders WHERE customer.customer_num = orders.customer_num ) AS total_ship_chg FROM customer Recently a lot of work has been done to extend support for subqueries (HIVE-15456). But this work primarily targeted extending subquery support in WHERE and HAVING clauses. We plan to continue the work done in HIVE-15456 to support subqueries in a select list (see HIVE-16091).</description></item><item><title>Apache Hive : Suggestion for D [...]
Feature ID Feature Name Implemented Mandatory Comments E011 Numeric data types Yes Mandatory E011-01 INTEGER and SMALLINT data types (including all spellings) Yes Mandatory E011-02 REAL, DOUBLE PRECISON, and FLOAT data types Yes Mandatory E011-03 DECIMAL and NUMERIC data types Yes Mandatory E011-04 Arithmetic operators Yes Mandatory E011-05 Numeric comparison Yes Mandatory E011-06 Implicit casting among the numeric data types Yes Mandatory E021 Character string types Yes Mandatory E021-0 [...]
-The problem we try to solve here is the cache consistency issue.</description></item><item><title>Apache Hive : TeradataBinarySerde</title><link>https://hive.apache.org/docs/latest/teradatabinaryserde_89068127/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/teradatabinaryserde_89068127/</guid><description>Apache Hive : TeradataBinarySerde Availability Overview How to export Using TPT FastExport Using BTEQ How to import Using BTEQ Using T [...]
+The problem we try to solve here is the cache consistency issue.</description></item><item><title>Apache Hive : TeradataBinarySerde</title><link>https://hive.apache.org/docs/latest/teradatabinaryserde_89068127/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/teradatabinaryserde_89068127/</guid><description>Apache Hive : TeradataBinarySerde Apache Hive : TeradataBinarySerde Availability Overview How to export How to import Usage Availabili [...]
The TeradataBinarySerDe is available in Hive 2.4 or greater.
-Overview Teradata can use TPT(Teradata Parallel Transporter) or BTEQ(Basic Teradata Query) to export and import data files compressed by gzip in very high speed.</description></item><item><title>Apache Hive : TestingDocs</title><link>https://hive.apache.org/docs/latest/testingdocs_42567126/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/testingdocs_42567126/</guid><description>Apache Hive : TestingDocs Hive Testing Documents The followin [...]
-Hive Developer FAQ: Testing Developer Guide: Unit Tests Unit Testing Hive SQL Running Yetus MetaStore API Tests Query File Test(qtest)</description></item><item><title>Apache Hive : Theta Join</title><link>https://hive.apache.org/docs/latest/theta-join_33293991/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/theta-join_33293991/</guid><description>Apache Hive : Theta Join Preliminaries Overview Specific Use Cases Geo-Location Side-Table [...]
-Scope In addition to the partition statistics, column level top K values can also be estimated for Hive tables.</description></item><item><title>Apache Hive : Transitivity on predicate pushdown</title><link>https://hive.apache.org/docs/latest/transitivity-on-predicate-pushdown_27823388/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/transitivity-on-predicate-pushdown_27823388/</guid><description>Apache Hive : Transitivity on predicate pu [...]
+Overview Teradata can use TPT(Teradata Parallel Transporter) or BTEQ(Basic Teradata Query) to export and import data files compressed by gzip in very high speed. However such binary files are encoded in Teradata’s proprietary format and can’t be directly consumed by Hive without a customized SerDe.</description></item><item><title>Apache Hive : TestingDocs</title><link>https://hive.apache.org/docs/latest/testingdocs_42567126/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid> [...]
+Hive Developer FAQ: Testing Developer Guide: Unit Tests Unit Testing Hive SQL Running Yetus MetaStore API Tests Query File Test(qtest)</description></item><item><title>Apache Hive : Theta Join</title><link>https://hive.apache.org/docs/latest/theta-join_33293991/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/theta-join_33293991/</guid><description>Apache Hive : Theta Join Apache Hive : Theta Join Preliminaries Overview Specific Use Cases [...]
+Apache Hive : Column Level Top K Statistics Scope Implementation Usage Example Newly Created Tables Existing Tables Current Status (JIRA) Scope In addition to the partition statistics, column level top K values can also be estimated for Hive tables.</description></item><item><title>Apache Hive : Transitivity on predicate pushdown</title><link>https://hive.apache.org/docs/latest/transitivity-on-predicate-pushdown_27823388/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>http [...]
set hive.mapred.mode=strict; create table invites (foo int, bar string) partitioned by (ds string); create table invites2 (foo int, bar string) partitioned by (ds string); select count(*) from invites join invites2 on invites.ds=invites2.ds where invites.ds='2011-01-01'; would give the error
-Error in semantic analysis: No Partition Predicate Found for Alias &quot;invites2&quot; Table &quot;invites2&quot; Here, the filter is applied to the table invites as invites.</description></item><item><title>Apache Hive : Tutorial</title><link>https://hive.apache.org/docs/latest/tutorial_27362061/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/tutorial_27362061/</guid><description>Apache Hive : Tutorial Hive Tutorial Hiv [...]
-Hive is designed to enable easy data summarization, ad-hoc querying and analysis of large volumes of data.</description></item><item><title>Apache Hive : Type Qualifiers in Hive</title><link>https://hive.apache.org/docs/latest/type-qualifiers-in-hive_33298524/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/type-qualifiers-in-hive_33298524/</guid><description>Apache Hive : Type Qualifiers in Hive Intro Hive will need to support some kind [...]
+Error in semantic analysis: No Partition Predicate Found for Alias &quot;invites2&quot; Table &quot;invites2&quot; Here, the filter is applied to the table invites as invites.</description></item><item><title>Apache Hive : Tutorial</title><link>https://hive.apache.org/docs/latest/tutorial_27362061/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/tutorial_27362061/</guid><description>Apache Hive : Tutorial Apache Hive : Tut [...]
My impression is that the actual enforcement of the type qualifiers should be done by the ObjectInspectors/Converters/casts operations. It should be ok to do col * col when col is a decimal(2) value of 99, it would fail if you try to cast the result to decimal(2) or try to insert it to a decimal(2) column.</description></item><item><title>Apache Hive : Union Optimization</title><link>https://hive.apache.org/docs/latest/union-optimization_29688910/</link><pubDate>Thu, 12 Dec 2024 00:00:00 [...]
select * from
(subq1
UNION ALL
sub2) u;
-If the parents to union were map reduce jobs, they will write the output to temporary files. The Union will then read the rows from these temporary files and write to a final directory. In effect, the results are read and written twice unnecessarily. We can avoid this by directly writing to the final directory.</description></item><item><title>Apache Hive : Unit Testing Hive SQL</title><link>https://hive.apache.org/docs/latest/unit-testing-hive-sql_61328063/</link><pubDate>Thu, 12 Dec 20 [...]
+If the parents to union were map reduce jobs, they will write the output to temporary files. The Union will then read the rows from these temporary files and write to a final directory. In effect, the results are read and written twice unnecessarily. We can avoid this by directly writing to the final directory.</description></item><item><title>Apache Hive : Unit Testing Hive SQL</title><link>https://hive.apache.org/docs/latest/unit-testing-hive-sql_61328063/</link><pubDate>Thu, 12 Dec 20 [...]
The view refers to exactly one base table or updatable view in the FROM clause without a WHERE clause. Each column in the view is a column in the underlying table/updatable view with no underlying columns duplicated. Views must have the same partition columns as the underlying table/updatable view. When inserting into a view:
-If a view does not specify all underlying columns, NULL will be inserted for each column not specified.</description></item><item><title>Apache Hive : User and Group Filter Support with LDAP Atn Provider in HiveServer2</title><link>https://hive.apache.org/docs/latest/user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2_58852417/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/user-and-group-filter-support-with-ldap-atn-prov [...]
+If a view does not specify all underlying columns, NULL will be inserted for each column not specified.</description></item><item><title>Apache Hive : User and Group Filter Support with LDAP Atn Provider in HiveServer2</title><link>https://hive.apache.org/docs/latest/user-and-group-filter-support-with-ldap-atn-provider-in-hiveserver2_58852417/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/user-and-group-filter-support-with-ldap-atn-prov [...]
User Guide The query language specification is available at LanguageManual. Also see, GettingStarted for setup instructions.
-Supported Features Usage Examples Creating tables MovieLens User Ratings CREATE TABLE u_data ( userid INT, movieid INT, rating INT, unixtime STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS TEXTFILE; Apache Access Log Tables add jar ../build/contrib/hive_contrib.jar; CREATE TABLE apachelog ( host STRING, identity STRING, user STRING, time STRING, request STRING, status STRING, size STRING, referer STRING, agent STRING) ROW FORMAT SERDE 'org.</description></item><item><tit [...]
+Supported Features Usage Examples Creating tables MovieLens User Ratings CREATE TABLE u_data ( userid INT, movieid INT, rating INT, unixtime STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS TEXTFILE; Apache Access Log Tables add jar ../build/contrib/hive_contrib.jar; CREATE TABLE apachelog ( host STRING, identity STRING, user STRING, time STRING, request STRING, status STRING, size STRING, referer STRING, agent STRING) ROW FORMAT SERDE 'org.</description></item><item><tit [...]
Navigation Links Next: Using WebHCat
-General: HCatalog Manual – Hive Wiki Home – Hive Project Site</description></item><item><title>Apache Hive : WebHCat Configure</title><link>https://hive.apache.org/docs/latest/webhcat-configure_34015738/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-configure_34015738/</guid><description>Apache Hive : WebHCat Configure WebHCat Configuration WebHCat Configuration Configuration Files Configuration Variables Default Values Configur [...]
-The WebHCat-specific configuration is split into two layers:
-webhcat-default.xml – All the configuration variables that WebHCat needs.</description></item><item><title>Apache Hive : WebHCat InstallWebHCat</title><link>https://hive.apache.org/docs/latest/webhcat-installwebhcat_34015585/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-installwebhcat_34015585/</guid><description>Apache Hive : WebHCat InstallWebHCat WebHCat Installation WebHCat Installation WebHCat Installed with Hive WebHCat I [...]
-WebHCat and HCatalog are installed with Hive, starting with Hive release 0.11.0.
-If you install Hive from the binary tarball, the WebHCat server command webhcat_server.sh is in the hcatalog/sbin directory.
-Hive installation is documented here.</description></item><item><title>Apache Hive : WebHCat Reference</title><link>https://hive.apache.org/docs/latest/webhcat-reference_34015762/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference_34015762/</guid><description>Apache Hive : WebHCat Reference Reference: WebHCat Resources This overview page lists all of the WebHCat resources. (DDL resources are listed here and on another overv [...]
+General: HCatalog Manual – Hive Wiki Home – Hive Project Site</description></item><item><title>Apache Hive : WebHCat Configure</title><link>https://hive.apache.org/docs/latest/webhcat-configure_34015738/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-configure_34015738/</guid><description>Apache Hive : WebHCat Configure Apache Hive : WebHCat Configure Configuration Files Configuration Variables Configuration Files The configurati [...]
+The WebHCat-specific configuration is split into two layers:</description></item><item><title>Apache Hive : WebHCat InstallWebHCat</title><link>https://hive.apache.org/docs/latest/webhcat-installwebhcat_34015585/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-installwebhcat_34015585/</guid><description>Apache Hive : WebHCat Installation Apache Hive : WebHCat Installation WebHCat Installed with Hive WebHCat Installation Procedure [...]
+If you install Hive from the binary tarball, the WebHCat server command webhcat_server.sh is in the hcatalog/sbin directory.</description></item><item><title>Apache Hive : WebHCat Reference</title><link>https://hive.apache.org/docs/latest/webhcat-reference_34015762/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference_34015762/</guid><description>Apache Hive : WebHCat Reference Reference: WebHCat Resources This overview page [...]
Category Resource (Type) Description General :version (GET) Return a list of supported response types. status (GET) Return the WebHCat server status.</description></item><item><title>Apache Hive : WebHCat Reference AllDDL</title><link>https://hive.apache.org/docs/latest/webhcat-reference-allddl_34016001/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-allddl_34016001/</guid><description>Apache Hive : WebHCat Referenc [...]
-For information about HCatalog DDL commands, see HCatalog DDL. For information about Hive DDL commands, see Hive Data Definition Language. Object Resource (Type) Description DDL Command ddl (POST) Perform an HCatalog DDL command.</description></item><item><title>Apache Hive : WebHCat Reference DDL</title><link>https://hive.apache.org/docs/latest/webhcat-reference-ddl_34015990/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-refere [...]
+For information about HCatalog DDL commands, see HCatalog DDL. For information about Hive DDL commands, see Hive Data Definition Language. Object Resource (Type) Description DDL Command ddl (POST) Perform an HCatalog DDL command.</description></item><item><title>Apache Hive : WebHCat Reference DDL</title><link>https://hive.apache.org/docs/latest/webhcat-reference-ddl_34015990/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-refere [...]
+URL http://www.myserver.com/templeton/ddl</description></item><item><title>Apache Hive : WebHCat Reference DeleteDB</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletedb_34016281/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletedb_34016281/</guid><description>Apache Hive : WebHCat Reference DeleteDB Apache Hive : WebHCat Reference DeleteDB Description URL Parameters Results Example Curl Comman [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db
-Parameters Name Description Required? Default :db The database name Required None ifExists Hive returns an error if the database specified does not exist, unless ifExists is set to true.</description></item><item><title>Apache Hive : WebHCat Reference DeleteJob</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/</guid>< [...]
+Parameters Name Description Required? Default :db The database name Required None ifExists Hive returns an error if the database specified does not exist, unless ifExists is set to true.</description></item><item><title>Apache Hive : WebHCat Reference DeleteJob</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/</guid>< [...]
Version: Deprecated in 0.12.0
-DELETE queue/:jobid is deprecated starting in Hive release 0.12.0. Users are encouraged to use DELETE jobs/:jobid instead.</description></item><item><title>Apache Hive : WebHCat Reference DeleteJobID</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletejobid_34835045/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletejobid_34835045/</guid><description>Apache Hive : WebHCat Reference DeleteJobID De [...]
+DELETE queue/:jobid is deprecated starting in Hive release 0.12.0. Users are encouraged to use DELETE jobs/:jobid instead.</description></item><item><title>Apache Hive : WebHCat Reference DeleteJobID</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletejobid_34835045/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletejobid_34835045/</guid><description>Apache Hive : WebHCat Reference DeleteJobID Ap [...]
Version: Hive 0.12.0 and later
-DELETE jobs/:jobid is introduced in Hive release 0.12.0. It is equivalent to [DELETE queue/:jobid](https://hive.</description></item><item><title>Apache Hive : WebHCat Reference DeletePartition</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletepartition_34016611/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletepartition_34016611/</guid><description>Apache Hive : WebHCat Reference DeletePartit [...]
+DELETE jobs/:jobid is introduced in Hive release 0.12.0. It is equivalent to [DELETE queue/:jobid](https://hive.apache.org/docs/latest/webhcat-reference-deletejob_34017204/) in prior releases.</description></item><item><title>Apache Hive : WebHCat Reference DeletePartition</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletepartition_34016611/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletepar [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/partition/:partition
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference DeleteTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletetable_34016561/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletetable_340165 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference DeleteTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-deletetable_34016561/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-deletetable_340165 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None ifExists Hive 0.</description></item><item><title>Apache Hive : WebHCat Reference GetColumn</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getcolumn_34016979/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getcolumn_34016979/</guid><description>Apache Hive : WebHCat Reference GetColum [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None ifExists Hive 0.70 and later returns an error if the table specified does not exist, unless ifExists is set to true.</description></item><item><title>Apache Hive : WebHCat Reference GetColumn</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getcolumn_34016979/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/late [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/column/:column
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :column The column name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetColumns</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getcolumns_34016970/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getcolumns_3 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :column The column name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetColumns</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getcolumns_34016970/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getcolumns_3 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/column
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetDB</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getdb_34016250/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getdb_34016250/</guid><description>Apache Hive : WebHCat Ref [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetDB</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getdb_34016250/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getdb_34016250/</guid><description>Apache Hive : WebHCat Ref [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db
-Parameters Name Description Required? Default :db The database name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetDBs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getdbs_34016238/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getdbs_34016238/</guid><description>Apache Hive : WebHCat Reference GetDBs List Databases — GE [...]
+Parameters Name Description Required? Default :db The database name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetDBs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getdbs_34016238/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getdbs_34016238/</guid><description>Apache Hive : WebHCat Reference GetDBs Apache Hive : WebHC [...]
URL http://www.myserver.com/templeton/v1/ddl/database
-Parameters Name Description Required? Default like List only databases whose names match the specified pattern. Optional &ldquo;*&rdquo; (List all) The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetPartition</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getpartition_34016592/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getparti [...]
+Parameters Name Description Required? Default like List only databases whose names match the specified pattern. Optional &ldquo;*&rdquo; (List all) The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetPartition</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getpartition_34016592/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getparti [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/partition/:partition
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference GetPartitions</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getpartitions_34016583/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getpartitions_ [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference GetPartitions</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getpartitions_34016583/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getpartitions_ [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/partition
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetProperties</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getproperties_34016995/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getproperties_34016995/</guid><description>A [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetProperties</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getproperties_34016995/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getproperties_34016995/</guid><description>A [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/property
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetProperty</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getproperty_34017004/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getproperty_34017004/</guid><description>Apache [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetProperty</title><link>https://hive.apache.org/docs/latest/webhcat-reference-getproperty_34017004/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-getproperty_34017004/</guid><description>Apache [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/property/:property
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :property The property name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-gettable_34016519/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-gettable_340 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :property The property name Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference GetTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-gettable_34016519/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-gettable_340 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table
-Parameters Name Description Required? Default :db The database name Required None like List only tables whose names match the specified pattern Optional &ldquo;*&rdquo; (List all tables) The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference Hive</title><link>https://hive.apache.org/docs/latest/webhcat-reference-hive_34017180/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/web [...]
+Parameters Name Description Required? Default :db The database name Required None like List only tables whose names match the specified pattern Optional &ldquo;*&rdquo; (List all tables) The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference Hive</title><link>https://hive.apache.org/docs/latest/webhcat-reference-hive_34017180/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/web [...]
Version: Hive 0.13.0 and later
As of Hive 0.13.0, GET version/hive displays the Hive version used for the query or commands.
URL http://www.myserver.com/templeton/v1/hive
-Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference Job</title><link>https://hive.apache.org/docs/latest/webhcat-reference-job_34835065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-job_34835065/</guid><description>Apache Hive : WebHCat Reference Job Job Information — GET jobs/:jobid Job Information — GET jobs/:jobid Description URL Parameters Results Example Curl Com [...]
+Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference Job</title><link>https://hive.apache.org/docs/latest/webhcat-reference-job_34835065/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-job_34835065/</guid><description>Apache Hive : WebHCat Reference Job Apache Hive : WebHCat Reference Job Description URL Parameters Results Example Curl Command JSON Output Description Che [...]
Version: Hive 0.12.0 and later
-GET jobs/:jobid is introduced in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference JobIDs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/</guid><description>Apache Hive : WebHCat Reference JobIDs List JobIDs — GET queue List JobIDs — GET queue Description URL Parameters Results Example Curl [...]
+GET jobs/:jobid is introduced in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference JobIDs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/</guid><description>Apache Hive : WebHCat Reference JobIDs Apache Hive : WebHCat Reference JobIDs Description URL Parameters Results Example Curl Command J [...]
Version: Deprecated in 0.12.0
GET queue is deprecated starting in Hive release 0.12.0. (See HIVE-4443.) Users are encouraged to use [GET jobs](https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/) instead.
Version: Obsolete in 0.14.0
-GET queue will be removed in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference JobInfo</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobinfo_34017194/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobinfo_34017194/</guid><description>Apache Hive : WebHCat Reference JobInfo Job Information — GET queue/:jobid Job Information — GET queue/:jobid Description URL Parameters [...]
-Version: Deprecated in 0.</description></item><item><title>Apache Hive : WebHCat Reference Jobs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/</guid><description>Apache Hive : WebHCat Reference Jobs List JobIDs — GET jobs List JobIDs — GET jobs Description URL Parameters Results Examples Curl Command JSON Output Curl Command [...]
+GET queue will be removed in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference JobInfo</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobinfo_34017194/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobinfo_34017194/</guid><description>Apache Hive : WebHCat Reference JobInfo Apache Hive : WebHCat Reference JobInfo Description URL Parameters Results Example Curl Command [...]
+Version: Deprecated in 0.12.0
+GET queue/:jobid is deprecated starting in Hive release 0.</description></item><item><title>Apache Hive : WebHCat Reference Jobs</title><link>https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-jobs_34835057/</guid><description>Apache Hive : WebHCat Reference Jobs Apache Hive : WebHCat Reference Jobs Description URL Parameters Results Examples Curl Command [...]
Version: Hive 0.12.0 and later
-GET jobs is introduced in Hive release 0.12.0. It is equivalent to [GET queue](https://hive.</description></item><item><title>Apache Hive : WebHCat Reference MapReduceJar</title><link>https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/</guid><description>Apache Hive : WebHCat Reference MapReduceJar MapReduce Job — POST mapredu [...]
+GET jobs is introduced in Hive release 0.12.0. It is equivalent to [GET queue](https://hive.apache.org/docs/latest/webhcat-reference-jobids_34017187/) in prior releases.</description></item><item><title>Apache Hive : WebHCat Reference MapReduceJar</title><link>https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-mapreducejar_34017030/</guid><descript [...]
Version: Hive 0.13.0 and later
As of Hive 0.13.0, GET version/hadoop displays the Hadoop version used for the MapReduce job.
URL http://www.myserver.com/templeton/v1/mapreduce/jar
-Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference MapReduceStream</title><link>https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/</guid><description>Apache Hive : WebHCat Reference MapReduceStream MapReduce Streaming Job — POST mapreduce/streaming MapReduce Streaming [...]
+Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference MapReduceStream</title><link>https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-mapreducestream_34017023/</guid><description>Apache Hive : WebHCat Reference MapReduceStream Apache Hive : WebHCat Reference MapReduceStream Description URL Paramet [...]
Version: Hive 0.13.0 and later
-As of Hive 0.13.0, GET version/hadoop displays the Hadoop version used for the MapReduce job.</description></item><item><title>Apache Hive : WebHCat Reference Pig</title><link>https://hive.apache.org/docs/latest/webhcat-reference-pig_34017169/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-pig_34017169/</guid><description>Apache Hive : WebHCat Reference Pig Pig Job — POST pig Pig Job — POST pig Description URL Parameter [...]
+As of Hive 0.13.0, GET version/hadoop displays the Hadoop version used for the MapReduce job.
+URL http://www.myserver.com/templeton/v1/mapreduce/streaming
+Parameters Name Description Required?</description></item><item><title>Apache Hive : WebHCat Reference Pig</title><link>https://hive.apache.org/docs/latest/webhcat-reference-pig_34017169/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-pig_34017169/</guid><description>Apache Hive : WebHCat Reference Pig Apache Hive : WebHCat Reference Pig Description URL Parameters Results Example Code and Data Setup Curl Command JSON Ou [...]
URL http://www.myserver.com/templeton/v1/pig
-Parameters Name Description Required? Default execute String containing an entire, short Pig program to run. One of either &ldquo;execute&rdquo; or &ldquo;file&rdquo; is required.</description></item><item><title>Apache Hive : WebHCat Reference PostTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-posttable_34016548/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-posttable_34016548 [...]
+Parameters Name Description Required? Default execute String containing an entire, short Pig program to run. One of either &ldquo;execute&rdquo; or &ldquo;file&rdquo; is required.</description></item><item><title>Apache Hive : WebHCat Reference PostTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-posttable_34016548/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-posttable_34016548 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table
-Parameters Name Description Required? Default :db The database name Required None :table The existing (old) table name Required None rename The new table name Required None group The user group to use Optional None permissions The permissions string to use.</description></item><item><title>Apache Hive : WebHCat Reference PutColumn</title><link>https://hive.apache.org/docs/latest/webhcat-reference-putcolumn_34016987/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hi [...]
+Parameters Name Description Required? Default :db The database name Required None :table The existing (old) table name Required None rename The new table name Required None group The user group to use Optional None permissions The permissions string to use.</description></item><item><title>Apache Hive : WebHCat Reference PutColumn</title><link>https://hive.apache.org/docs/latest/webhcat-reference-putcolumn_34016987/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hi [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/column/:column
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :column The column name Required None group The user group to use Optional None permissions The permissions string to use Optional None type The type of column to add, like &ldquo;string&rdquo; or &ldquo;int&rdquo; Required None comment The column comment, like a description Optional None The standard parameters are also supported.</description></item><ite [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :column The column name Required None group The user group to use Optional None permissions The permissions string to use Optional None type The type of column to add, like &ldquo;string&rdquo; or &ldquo;int&rdquo; Required None comment The column comment, like a description Optional None The standard parameters are also supported.</description></item><ite [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db
-Parameters Name Description Required? Default :db The database name Required None group The user group to use Optional None permissions The permissions string to use Optional None location The database location Optional None comment A comment for the database, like a description Optional None properties The database properties Optional None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference PutPartition</title><link>https://hive.a [...]
+Parameters Name Description Required? Default :db The database name Required None group The user group to use Optional None permissions The permissions string to use Optional None location The database location Optional None comment A comment for the database, like a description Optional None properties The database properties Optional None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference PutPartition</title><link>https://hive.a [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/partition/:partition
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference PutProperty</title><link>https://hive.apache.org/docs/latest/webhcat-reference-putproperty_34017012/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-putproperty_340170 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :partition The partition name, col_name=&lsquo;value&rsquo; list.</description></item><item><title>Apache Hive : WebHCat Reference PutProperty</title><link>https://hive.apache.org/docs/latest/webhcat-reference-putproperty_34017012/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-putproperty_340170 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table/property/:property
-Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :property The property name Required None group The user group to use Optional None permissions The permissions string to use Optional None value The property value Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference PutTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-puttable_3 [...]
+Parameters Name Description Required? Default :db The database name Required None :table The table name Required None :property The property name Required None group The user group to use Optional None permissions The permissions string to use Optional None value The property value Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference PutTable</title><link>https://hive.apache.org/docs/latest/webhcat-reference-puttable_3 [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:table
-Parameters Name Description Required? Default :db The database name.</description></item><item><title>Apache Hive : WebHCat Reference PutTableLike</title><link>https://hive.apache.org/docs/latest/webhcat-reference-puttablelike_34016572/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-puttablelike_34016572/</guid><description>Apache Hive : WebHCat Reference PutTableLike Create Table Like — PUT ddl/database/:db/table/:exis [...]
+Parameters Name Description Required? Default :db The database name.</description></item><item><title>Apache Hive : WebHCat Reference PutTableLike</title><link>https://hive.apache.org/docs/latest/webhcat-reference-puttablelike_34016572/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-puttablelike_34016572/</guid><description>Apache Hive : WebHCat Reference PutTableLike Apache Hive : WebHCat Reference PutTableLike Descrip [...]
URL http://www.myserver.com/templeton/v1/ddl/database/:db/table/:existingtable/like/:newtable
-Parameters Name Description Required? Default :db The database name Required None :existingtable The existing table name Required None :newtable The new table name Required None group The user group to use when creating a table Optional None permissions The permissions string to use when creating a table Optional None external Allows you to specify a location so that Hive does not use the default location for this table.</description></item><item><title>Apache Hive : WebHCat Reference Re [...]
+Parameters Name Description Required? Default :db The database name Required None :existingtable The existing table name Required None :newtable The new table name Required None group The user group to use when creating a table Optional None permissions The permissions string to use when creating a table Optional None external Allows you to specify a location so that Hive does not use the default location for this table.</description></item><item><title>Apache Hive : WebHCat Reference Re [...]
URL http://www.myserver.com/templeton/:version
-Parameters Name Description Required? Default :version The WebHCat version number. (Currently this must be &ldquo;v1&rdquo;.</description></item><item><title>Apache Hive : WebHCat Reference Status</title><link>https://hive.apache.org/docs/latest/webhcat-reference-status_34015941/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-status_34015941/</guid><description>Apache Hive : WebHCat Reference Status Current Stat [...]
+Parameters Name Description Required? Default :version The WebHCat version number. (Currently this must be &ldquo;v1&rdquo;.) Required None The standard parameters are also supported.</description></item><item><title>Apache Hive : WebHCat Reference Status</title><link>https://hive.apache.org/docs/latest/webhcat-reference-status_34015941/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-status_34015941/</guid><desc [...]
URL http://www.myserver.com/templeton/v1/status
Parameters Only the standard parameters are accepted.
-Results Name Description status &ldquo;ok&rdquo; if the WebHCat server was contacted.</description></item><item><title>Apache Hive : WebHCat Reference Version</title><link>https://hive.apache.org/docs/latest/webhcat-reference-version_34015986/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-version_34015986/</guid><description>Apache Hive : WebHCat Reference Version List Versions — GET version List Versions — GET [...]
+Results Name Description status &ldquo;ok&rdquo; if the WebHCat server was contacted.</description></item><item><title>Apache Hive : WebHCat Reference Version</title><link>https://hive.apache.org/docs/latest/webhcat-reference-version_34015986/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-version_34015986/</guid><description>Apache Hive : WebHCat Reference Version Apache Hive : WebHCat Reference Version Descrip [...]
URL http://www.myserver.com/templeton/v1/version
Parameters Only the standard parameters are accepted.
-Results Name Description supportedVersions A list of all supported versions. version The current version.</description></item><item><title>Apache Hive : WebHCat Reference VersionHadoop</title><link>https://hive.apache.org/docs/latest/webhcat-reference-versionhadoop_44303410/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-versionhadoop_44303410/</guid><description>Apache Hive : WebHCat Reference VersionHadoop Hadoop Vers [...]
+Results Name Description supportedVersions A list of all supported versions. version The current version.</description></item><item><title>Apache Hive : WebHCat Reference VersionHadoop</title><link>https://hive.apache.org/docs/latest/webhcat-reference-versionhadoop_44303410/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-versionhadoop_44303410/</guid><description>Apache Hive : WebHCat Reference VersionHadoop Apache Hive [...]
Version: Hive 0.13.0 and later
GET version/hadoop is introduced in Hive release 0.13.0 (HIVE-6226).
URL http://www.myserver.com/templeton/v1/version/hadoop
-Parameters Only the standard parameters are accepted.</description></item><item><title>Apache Hive : WebHCat Reference VersionHive</title><link>https://hive.apache.org/docs/latest/webhcat-reference-versionhive_44303406/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-versionhive_44303406/</guid><description>Apache Hive : WebHCat Reference VersionHive Hive Version — GET version/hive Hive Version — GET version/hive Descrip [...]
+Parameters Only the standard parameters are accepted.</description></item><item><title>Apache Hive : WebHCat Reference VersionHive</title><link>https://hive.apache.org/docs/latest/webhcat-reference-versionhive_44303406/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-reference-versionhive_44303406/</guid><description>Apache Hive : WebHCat Reference VersionHive Apache Hive : WebHCat Reference VersionHive Description URL Parameters [...]
Version: Hive 0.13.0 and later
GET version/hive is introduced in Hive release 0.13.0 (HIVE-6226).
URL http://www.myserver.com/templeton/v1/version/hive
-Parameters Only the standard parameters are accepted.</description></item><item><title>Apache Hive : WebHCat UsingWebHCat</title><link>https://hive.apache.org/docs/latest/webhcat-usingwebhcat_34015492/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-usingwebhcat_34015492/</guid><description>Apache Hive : WebHCat UsingWebHCat Using the HCatalog REST API (WebHCat) Using the HCatalog REST API (WebHCat) Introduction to WebHCat URL For [...]
-The HCatalog project graduated from the Apache incubator and merged with the Hive project on March 26, 2013.</description></item><item><title>QuickStarted</title><link>https://hive.apache.org/development/quickstart/</link><pubDate>Fri, 12 May 2023 17:51:06 +0530</pubDate><guid>https://hive.apache.org/development/quickstart/</guid><description>Introduction Run Apache Hive inside docker container in pseudo-distributed mode, inorder to provide the following Quick-start/Debugging/Prepare a t [...]
+Parameters Only the standard parameters are accepted.</description></item><item><title>Apache Hive : WebHCat UsingWebHCat</title><link>https://hive.apache.org/docs/latest/webhcat-usingwebhcat_34015492/</link><pubDate>Thu, 12 Dec 2024 00:00:00 +0000</pubDate><guid>https://hive.apache.org/docs/latest/webhcat-usingwebhcat_34015492/</guid><description>Apache Hive : WebHCat UsingWebHCat Apache Hive : WebHCat UsingWebHCat Version information Introduction to WebHCat URL Format Security Standard [...]
+Hive version 0.11.0 is the first release that includes HCatalog and its REST API, WebHCat.</description></item><item><title>QuickStarted</title><link>https://hive.apache.org/development/quickstart/</link><pubDate>Fri, 12 May 2023 17:51:06 +0530</pubDate><guid>https://hive.apache.org/development/quickstart/</guid><description>Introduction Run Apache Hive inside docker container in pseudo-distributed mode, inorder to provide the following Quick-start/Debugging/Prepare a test env for Hive
Quickstart STEP 1: Pull the image Pull the image from DockerHub: https://hub.docker.com/r/apache/hive/tags. Here are the latest images: 4.0.0 3.1.3 docker pull apache/hive:4.0.0
STEP 2: Export the Hive version export HIVE_VERSION=4.0.0
STEP 3: Launch the HiveServer2 with an embedded Metastore.</description></item><item><title>Getting Started</title><link>https://hive.apache.org/development/gettingstarted/</link><pubDate>Tue, 10 Jan 2023 12:35:11 +0530</pubDate><guid>https://hive.apache.org/development/gettingstarted/</guid><description>The Apache Hive ™ data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Structure can be projected onto data alread [...]