You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hawq.apache.org by yo...@apache.org on 2017/02/22 22:11:01 UTC
[07/18] incubator-hawq-docs git commit: HAWQ-1305 Add apache license
header to doc source
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-troubleshooting-gpfdist.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-troubleshooting-gpfdist.html.md.erb b/markdown/datamgmt/load/g-troubleshooting-gpfdist.html.md.erb
index 2e6a450..1b88477 100644
--- a/markdown/datamgmt/load/g-troubleshooting-gpfdist.html.md.erb
+++ b/markdown/datamgmt/load/g-troubleshooting-gpfdist.html.md.erb
@@ -2,6 +2,25 @@
title: Troubleshooting gpfdist
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
The segments access `gpfdist` at runtime. Ensure that the HAWQ segment hosts have network access to `gpfdist`. `gpfdist` is a web server: test connectivity by running the following command from each host in the HAWQ array (segments and master):
``` shell
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-unloading-data-from-hawq-database.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-unloading-data-from-hawq-database.html.md.erb b/markdown/datamgmt/load/g-unloading-data-from-hawq-database.html.md.erb
index e0690ad..5576750 100644
--- a/markdown/datamgmt/load/g-unloading-data-from-hawq-database.html.md.erb
+++ b/markdown/datamgmt/load/g-unloading-data-from-hawq-database.html.md.erb
@@ -2,6 +2,25 @@
title: Unloading Data from HAWQ
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
A writable external table allows you to select rows from other database tables and output the rows to files, named pipes, to applications, or as output targets for parallel MapReduce calculations. You can define file-based and web-based writable external tables.
This topic describes how to unload data from HAWQ using parallel unload (writable external tables) and non-parallel unload (`COPY`).
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-unloading-data-using-a-writable-external-table.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-unloading-data-using-a-writable-external-table.html.md.erb b/markdown/datamgmt/load/g-unloading-data-using-a-writable-external-table.html.md.erb
index 377f2d6..a20c9ff 100644
--- a/markdown/datamgmt/load/g-unloading-data-using-a-writable-external-table.html.md.erb
+++ b/markdown/datamgmt/load/g-unloading-data-using-a-writable-external-table.html.md.erb
@@ -2,6 +2,25 @@
title: Unloading Data Using a Writable External Table
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Writable external tables allow only `INSERT` operations. You must grant `INSERT` permission on a table to enable access to users who are not the table owner or a superuser. For example:
``` sql
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-unloading-data-using-copy.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-unloading-data-using-copy.html.md.erb b/markdown/datamgmt/load/g-unloading-data-using-copy.html.md.erb
index 816a2b5..7f30941 100644
--- a/markdown/datamgmt/load/g-unloading-data-using-copy.html.md.erb
+++ b/markdown/datamgmt/load/g-unloading-data-using-copy.html.md.erb
@@ -2,6 +2,25 @@
title: Unloading Data Using COPY
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
`COPY TO` copies data from a table to a file (or standard input) on the HAWQ master host using a single process on the HAWQ master instance. Use `COPY` to output a table's entire contents, or filter the output using a `SELECT` statement. For example:
``` sql
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-url-based-web-external-tables.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-url-based-web-external-tables.html.md.erb b/markdown/datamgmt/load/g-url-based-web-external-tables.html.md.erb
index a115972..7df7fc7 100644
--- a/markdown/datamgmt/load/g-url-based-web-external-tables.html.md.erb
+++ b/markdown/datamgmt/load/g-url-based-web-external-tables.html.md.erb
@@ -2,6 +2,25 @@
title: URL-based Web External Tables
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
A URL-based web table accesses data from a web server using the HTTP protocol. Web table data is dynamic; the data is not rescannable.
Specify the `LOCATION` of files on a web server using `http://`. The web data file(s) must reside on a web server that HAWQ segment hosts can access. The number of URLs specified corresponds to the minimum number of virtual segments that work in parallel to access the web table.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-using-a-custom-format.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-using-a-custom-format.html.md.erb b/markdown/datamgmt/load/g-using-a-custom-format.html.md.erb
index e83744a..8abe90d 100644
--- a/markdown/datamgmt/load/g-using-a-custom-format.html.md.erb
+++ b/markdown/datamgmt/load/g-using-a-custom-format.html.md.erb
@@ -2,6 +2,25 @@
title: Using a Custom Format
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
You specify a custom data format in the `FORMAT` clause of `CREATE EXTERNAL TABLE`.
```
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-using-the-hawq-file-server--gpfdist-.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-using-the-hawq-file-server--gpfdist-.html.md.erb b/markdown/datamgmt/load/g-using-the-hawq-file-server--gpfdist-.html.md.erb
index 0c68b2c..a0619ff 100644
--- a/markdown/datamgmt/load/g-using-the-hawq-file-server--gpfdist-.html.md.erb
+++ b/markdown/datamgmt/load/g-using-the-hawq-file-server--gpfdist-.html.md.erb
@@ -2,6 +2,25 @@
title: Using the HAWQ File Server (gpfdist)
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
The `gpfdist` protocol provides the best performance and is the easiest to set up. `gpfdist` ensures optimum use of all segments in your HAWQ system for external table reads.
This topic describes the setup and management tasks for using `gpfdist` with external tables.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-working-with-file-based-ext-tables.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-working-with-file-based-ext-tables.html.md.erb b/markdown/datamgmt/load/g-working-with-file-based-ext-tables.html.md.erb
index e024a7d..ae23711 100644
--- a/markdown/datamgmt/load/g-working-with-file-based-ext-tables.html.md.erb
+++ b/markdown/datamgmt/load/g-working-with-file-based-ext-tables.html.md.erb
@@ -2,6 +2,25 @@
title: Working with File-Based External Tables
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
External tables provide access to data stored in data sources outside of HAWQ as if the data were stored in regular database tables. Data can be read from or written to external tables.
An external table is a HAWQ database table backed with data that resides outside of the database. An external table is either readable or writable. It can be used like a regular database table in SQL commands such as `SELECT` and `INSERT` and joined with other tables. External tables are most often used to load and unload database data.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-write-a-transform.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-write-a-transform.html.md.erb b/markdown/datamgmt/load/g-write-a-transform.html.md.erb
index 6b35ab2..5bb11dc 100644
--- a/markdown/datamgmt/load/g-write-a-transform.html.md.erb
+++ b/markdown/datamgmt/load/g-write-a-transform.html.md.erb
@@ -2,6 +2,25 @@
title: Write a Transform
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
The transform specifies what to extract from the data.You can use any authoring environment and language appropriate for your project. For XML transformations, choose a technology such as XSLT, Joost (STX), Java, Python, or Perl, based on the goals and scope of the project.
In the price example, the next step is to transform the XML data into a simple two-column delimited format.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-write-the-gpfdist-configuration.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-write-the-gpfdist-configuration.html.md.erb b/markdown/datamgmt/load/g-write-the-gpfdist-configuration.html.md.erb
index 89733cd..a6a7e78 100644
--- a/markdown/datamgmt/load/g-write-the-gpfdist-configuration.html.md.erb
+++ b/markdown/datamgmt/load/g-write-the-gpfdist-configuration.html.md.erb
@@ -2,6 +2,25 @@
title: Write the gpfdist Configuration
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
The `gpfdist` configuration is specified as a YAML 1.1 document. It specifies rules that `gpfdist` uses to select a Transform to apply when loading or extracting data.
This example `gpfdist` configuration contains the following items:
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/datamgmt/load/g-xml-transformation-examples.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/datamgmt/load/g-xml-transformation-examples.html.md.erb b/markdown/datamgmt/load/g-xml-transformation-examples.html.md.erb
index 12ad1d6..5d83224 100644
--- a/markdown/datamgmt/load/g-xml-transformation-examples.html.md.erb
+++ b/markdown/datamgmt/load/g-xml-transformation-examples.html.md.erb
@@ -2,6 +2,25 @@
title: XML Transformation Examples
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
The following examples demonstrate the complete process for different types of XML data and STX transformations. Files and detailed instructions associated with these examples can be downloaded from the Apache site `gpfdist_transform` tools demo page. Read the README file before you run the examples.
- **[Command-based Web External Tables](../../datamgmt/load/g-example-1-dblp-database-publications-in-demo-directory.html)**
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/ddl/ddl-database.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/ddl/ddl-database.html.md.erb b/markdown/ddl/ddl-database.html.md.erb
index d643fae..ba68098 100644
--- a/markdown/ddl/ddl-database.html.md.erb
+++ b/markdown/ddl/ddl-database.html.md.erb
@@ -2,6 +2,25 @@
title: Creating and Managing Databases
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Your HAWQ deployment may have multiple databases. This is different from some database management systems \(such as Oracle\) where the database instance *is* the database. Although you can create many databases in a HAWQ system, client programs can connect to and access only one database at a time \u2014 you cannot cross-query between databases.
## <a id="topic3"></a>About Template Databases
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/ddl/ddl-partition.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/ddl/ddl-partition.html.md.erb b/markdown/ddl/ddl-partition.html.md.erb
index f790161..b0dc3f4 100644
--- a/markdown/ddl/ddl-partition.html.md.erb
+++ b/markdown/ddl/ddl-partition.html.md.erb
@@ -2,6 +2,25 @@
title: Partitioning Large Tables
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Table partitioning enables supporting very large tables, such as fact tables, by logically dividing them into smaller, more manageable pieces. Partitioned tables can improve query performance by allowing the HAWQ query optimizer to scan only the data needed to satisfy a given query instead of scanning all the contents of a large table.
Partitioning does not change the physical distribution of table data across the segments. Table distribution is physical: HAWQ physically divides partitioned tables and non-partitioned tables across segments to enable parallel query processing. Table *partitioning* is logical: HAWQ logically divides big tables to improve query performance and facilitate data warehouse maintenance tasks, such as rolling old data out of the data warehouse.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/ddl/ddl-schema.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/ddl/ddl-schema.html.md.erb b/markdown/ddl/ddl-schema.html.md.erb
index 7c361ba..6fb9b83 100644
--- a/markdown/ddl/ddl-schema.html.md.erb
+++ b/markdown/ddl/ddl-schema.html.md.erb
@@ -2,6 +2,25 @@
title: Creating and Managing Schemas
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Schemas logically organize objects and data in a database. Schemas allow you to have more than one object \(such as tables\) with the same name in the database without conflict if the objects are in different schemas.
## <a id="topic18"></a>The Default "Public" Schema
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/ddl/ddl-storage.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/ddl/ddl-storage.html.md.erb b/markdown/ddl/ddl-storage.html.md.erb
index 264e552..9d73711 100644
--- a/markdown/ddl/ddl-storage.html.md.erb
+++ b/markdown/ddl/ddl-storage.html.md.erb
@@ -2,6 +2,25 @@
title: Table Storage Model and Distribution Policy
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ supports several storage models and a mix of storage models. When you create a table, you choose how to store its data. This topic explains the options for table storage and how to choose the best storage model for your workload.
**Note:** To simplify the creation of database tables, you can specify the default values for some table storage options with the HAWQ server configuration parameter `gp_default_storage_options`.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/ddl/ddl-table.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/ddl/ddl-table.html.md.erb b/markdown/ddl/ddl-table.html.md.erb
index bc4f0c4..4eb56af 100644
--- a/markdown/ddl/ddl-table.html.md.erb
+++ b/markdown/ddl/ddl-table.html.md.erb
@@ -2,6 +2,25 @@
title: Creating and Managing Tables
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ Tables are similar to tables in any relational database, except that table rows are distributed across the different segments in the system. When you create a table, you specify the table's distribution policy.
## <a id="topic26"></a>Creating a Table
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/ddl/ddl-tablespace.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/ddl/ddl-tablespace.html.md.erb b/markdown/ddl/ddl-tablespace.html.md.erb
index 8720665..9b4bdf0 100644
--- a/markdown/ddl/ddl-tablespace.html.md.erb
+++ b/markdown/ddl/ddl-tablespace.html.md.erb
@@ -2,6 +2,25 @@
title: Creating and Managing Tablespaces
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Tablespaces allow database administrators to have multiple file systems per machine and decide how to best use physical storage to store database objects. They are named locations within a filespace in which you can create objects. Tablespaces allow you to assign different storage for frequently and infrequently used database objects or to control the I/O performance on certain database objects. For example, place frequently-used tables on file systems that use high performance solid-state drives \(SSD\), and place other tables on standard hard drives.
A tablespace requires a file system location to store its database files. In HAWQ, the master and each segment require a distinct storage location. The collection of file system locations for all components in a HAWQ system is a *filespace*. Filespaces can be used by one or more tablespaces.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/ddl/ddl-view.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/ddl/ddl-view.html.md.erb b/markdown/ddl/ddl-view.html.md.erb
index 35da41e..999b81b 100644
--- a/markdown/ddl/ddl-view.html.md.erb
+++ b/markdown/ddl/ddl-view.html.md.erb
@@ -2,6 +2,25 @@
title: Creating and Managing Views
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Views enable you to save frequently used or complex queries, then access them in a `SELECT` statement as if they were a table. A view is not physically materialized on disk: the query runs as a subquery when you access the view.
If a subquery is associated with a single query, consider using the `WITH` clause of the `SELECT` command instead of creating a seldom-used view.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/ddl/ddl.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/ddl/ddl.html.md.erb b/markdown/ddl/ddl.html.md.erb
index 7873fe7..8d4a044 100644
--- a/markdown/ddl/ddl.html.md.erb
+++ b/markdown/ddl/ddl.html.md.erb
@@ -2,6 +2,25 @@
title: Defining Database Objects
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This section covers data definition language \(DDL\) in HAWQ and how to create and manage database objects.
Creating objects in a HAWQ includes making up-front choices about data distribution, storage options, data loading, and other HAWQ features that will affect the ongoing performance of your database system. Understanding the options that are available and how the database will be used will help you make the right decisions.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/install/aws-config.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/install/aws-config.html.md.erb b/markdown/install/aws-config.html.md.erb
index 1bb519e..8f3cf5e 100644
--- a/markdown/install/aws-config.html.md.erb
+++ b/markdown/install/aws-config.html.md.erb
@@ -2,6 +2,25 @@
title: Amazon EC2 Configuration
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Amazon Elastic Compute Cloud (EC2) is a service provided by Amazon Web Services (AWS). You can install and configure HAWQ on virtual servers provided by Amazon EC2. The following information describes some considerations when deploying a HAWQ cluster in an Amazon EC2 environment.
## <a id="topic_wqv_yfx_y5"></a>About Amazon EC2
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/install/select-hosts.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/install/select-hosts.html.md.erb b/markdown/install/select-hosts.html.md.erb
index ecbe0b5..c59a9e7 100644
--- a/markdown/install/select-hosts.html.md.erb
+++ b/markdown/install/select-hosts.html.md.erb
@@ -2,6 +2,25 @@
title: Select HAWQ Host Machines
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Before you begin to install HAWQ, follow these steps to select and prepare the host machines.
Complete this procedure for all HAWQ deployments:
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/ElasticSegments.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/ElasticSegments.html.md.erb b/markdown/overview/ElasticSegments.html.md.erb
index 383eab5..b925ae8 100755
--- a/markdown/overview/ElasticSegments.html.md.erb
+++ b/markdown/overview/ElasticSegments.html.md.erb
@@ -2,6 +2,25 @@
title: Elastic Query Execution Runtime
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ uses dynamically allocated virtual segments to provide resources for query execution.
In HAWQ 1.x, the number of segments \(compute resource carrier\) used to run a query is fixed, no matter whether the underlying query is big query requiring many resources or a small query requiring little resources. This architecture is simple, however it uses resources inefficiently.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/HAWQArchitecture.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/HAWQArchitecture.html.md.erb b/markdown/overview/HAWQArchitecture.html.md.erb
index d42d241..7febdda 100755
--- a/markdown/overview/HAWQArchitecture.html.md.erb
+++ b/markdown/overview/HAWQArchitecture.html.md.erb
@@ -2,6 +2,25 @@
title: HAWQ Architecture
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This topic presents HAWQ architecture and its main components.
In a typical HAWQ deployment, each slave node has one physical HAWQ segment, an HDFS DataNode and a NodeManager installed. Masters for HAWQ, HDFS and YARN are hosted on separate nodes.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/HAWQOverview.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/HAWQOverview.html.md.erb b/markdown/overview/HAWQOverview.html.md.erb
index c41f3d9..2ee1ba8 100755
--- a/markdown/overview/HAWQOverview.html.md.erb
+++ b/markdown/overview/HAWQOverview.html.md.erb
@@ -2,6 +2,25 @@
title: What is HAWQ?
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ is a Hadoop native SQL query engine that combines the key technological advantages of MPP database with the scalability and convenience of Hadoop. HAWQ reads data from and writes data to HDFS natively.
HAWQ delivers industry-leading performance and linear scalability. It provides users the tools to confidently and successfully interact with petabyte range data sets. HAWQ provides users with a complete, standards compliant SQL interface. More specifically, HAWQ has the following features:
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/HDFSCatalogCache.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/HDFSCatalogCache.html.md.erb b/markdown/overview/HDFSCatalogCache.html.md.erb
index 8803dc4..a081143 100755
--- a/markdown/overview/HDFSCatalogCache.html.md.erb
+++ b/markdown/overview/HDFSCatalogCache.html.md.erb
@@ -2,6 +2,25 @@
title: HDFS Catalog Cache
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HDFS catalog cache is a caching service used by HAWQ master to determine the distribution information of table data on HDFS.
HDFS is slow at RPC handling, especially when the number of concurrent requests is high. In order to decide which segments handle which part of data, HAWQ needs data location information from HDFS NameNodes. HDFS catalog cache is used to cache the data location information and accelerate HDFS RPCs.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/ManagementTools.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/ManagementTools.html.md.erb b/markdown/overview/ManagementTools.html.md.erb
index 0c7439d..9a5074b 100755
--- a/markdown/overview/ManagementTools.html.md.erb
+++ b/markdown/overview/ManagementTools.html.md.erb
@@ -2,6 +2,25 @@
title: HAWQ Management Tools
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ management tools are consolidated into one `hawq` command.
The `hawq` command can init, start and stop each segment separately, and supports dynamic expansion of the cluster.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/RedundancyFailover.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/RedundancyFailover.html.md.erb b/markdown/overview/RedundancyFailover.html.md.erb
index 90eec63..5a48bd0 100755
--- a/markdown/overview/RedundancyFailover.html.md.erb
+++ b/markdown/overview/RedundancyFailover.html.md.erb
@@ -2,6 +2,25 @@
title: High Availability, Redundancy and Fault Tolerance
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ ensures high availability for its clusters through system redundancy. HAWQ deployments utilize platform hardware redundancy, such as RAID for the master catalog, JBOD for segments and network redundancy for its interconnect layer. On the software level, HAWQ provides redundancy via master mirroring and dual cluster maintenance. In addition, HAWQ supports high availability NameNode configuration within HDFS.
To maintain cluster health, HAWQ uses a fault tolerance service based on heartbeats and on-demand probe protocols. It can identify newly added nodes dynamically and remove nodes from the cluster when it becomes unusable.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/ResourceManagement.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/ResourceManagement.html.md.erb b/markdown/overview/ResourceManagement.html.md.erb
index 8f7e2fd..7f99069 100755
--- a/markdown/overview/ResourceManagement.html.md.erb
+++ b/markdown/overview/ResourceManagement.html.md.erb
@@ -2,6 +2,25 @@
title: Resource Management
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ provides several approaches to resource management and includes several user-configurable options, including integration with YARN's resource management.
HAWQ has the ability to manage resources by using the following mechanisms:
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/TableDistributionStorage.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/TableDistributionStorage.html.md.erb b/markdown/overview/TableDistributionStorage.html.md.erb
index ec1d8b5..678885b 100755
--- a/markdown/overview/TableDistributionStorage.html.md.erb
+++ b/markdown/overview/TableDistributionStorage.html.md.erb
@@ -2,6 +2,25 @@
title: Table Distribution and Storage
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ stores all table data, except the system table, in HDFS. When a user creates a table, the metadata is stored on the master's local file system and the table content is stored in HDFS.
In order to simplify table data management, all the data of one relation are saved under one HDFS folder.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/overview/system-overview.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/overview/system-overview.html.md.erb b/markdown/overview/system-overview.html.md.erb
index 9fc1c53..455ea0a 100644
--- a/markdown/overview/system-overview.html.md.erb
+++ b/markdown/overview/system-overview.html.md.erb
@@ -1,6 +1,25 @@
---
title: Apache HAWQ (Incubating) System Overview
---
+
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
* <a href="./HAWQOverview.html" class="subnav">What is HAWQ?</a>
* <a href="./HAWQArchitecture.html" class="subnav">HAWQ Architecture</a>
* <a href="./TableDistributionStorage.html" class="subnav">Table Distribution and Storage</a>
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/plext/UsingProceduralLanguages.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/plext/UsingProceduralLanguages.html.md.erb b/markdown/plext/UsingProceduralLanguages.html.md.erb
index bef1b93..2b83b91 100644
--- a/markdown/plext/UsingProceduralLanguages.html.md.erb
+++ b/markdown/plext/UsingProceduralLanguages.html.md.erb
@@ -2,6 +2,25 @@
title: Using Languages and Extensions in HAWQ
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ supports user-defined functions that are created with the SQL and C built-in languages, and also supports user-defined aliases for internal functions.
HAWQ also supports user-defined functions written in languages other than SQL and C. These other languages are generically called *procedural languages* (PLs) and are extensions to the core HAWQ functionality. HAWQ specifically supports the PL/Java, PL/Perl, PL/pgSQL, PL/Python, and PL/R procedural languages.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/plext/builtin_langs.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/plext/builtin_langs.html.md.erb b/markdown/plext/builtin_langs.html.md.erb
index 01891e8..882044a 100644
--- a/markdown/plext/builtin_langs.html.md.erb
+++ b/markdown/plext/builtin_langs.html.md.erb
@@ -2,6 +2,25 @@
title: Using HAWQ Built-In Languages
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This section provides an introduction to using the HAWQ built-in languages.
HAWQ supports user-defined functions created with the SQL and C built-in languages. HAWQ also supports user-defined aliases for internal functions.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/plext/using_pgcrypto.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/plext/using_pgcrypto.html.md.erb b/markdown/plext/using_pgcrypto.html.md.erb
index e3e9225..1e06f0b 100644
--- a/markdown/plext/using_pgcrypto.html.md.erb
+++ b/markdown/plext/using_pgcrypto.html.md.erb
@@ -2,6 +2,25 @@
title: Enabling Cryptographic Functions for PostgreSQL (pgcrypto)
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
`pgcrypto` is a package extension included in your HAWQ distribution. You must explicitly enable the cryptographic functions to use this extension.
## <a id="pgcryptoprereq"></a>Prerequisites
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/plext/using_pljava.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/plext/using_pljava.html.md.erb b/markdown/plext/using_pljava.html.md.erb
index e463093..cb97f29 100644
--- a/markdown/plext/using_pljava.html.md.erb
+++ b/markdown/plext/using_pljava.html.md.erb
@@ -2,6 +2,25 @@
title: Using PL/Java
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This section provides an overview of the HAWQ PL/Java procedural language extension.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/plext/using_plperl.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/plext/using_plperl.html.md.erb b/markdown/plext/using_plperl.html.md.erb
index d6ffa04..f642fea 100644
--- a/markdown/plext/using_plperl.html.md.erb
+++ b/markdown/plext/using_plperl.html.md.erb
@@ -2,6 +2,25 @@
title: Using PL/Perl
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This section contains an overview of the HAWQ PL/Perl language extension.
## <a id="enableplperl"></a>Enabling PL/Perl
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/plext/using_plpgsql.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/plext/using_plpgsql.html.md.erb b/markdown/plext/using_plpgsql.html.md.erb
index 3661e9b..c778c70 100644
--- a/markdown/plext/using_plpgsql.html.md.erb
+++ b/markdown/plext/using_plpgsql.html.md.erb
@@ -2,6 +2,25 @@
title: Using PL/pgSQL in HAWQ
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
SQL is the language of most other relational databases use as query language. It is portable and easy to learn. But every SQL statement must be executed individually by the database server.
PL/pgSQL is a loadable procedural language. PL/SQL can do the following:
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/plext/using_plpython.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/plext/using_plpython.html.md.erb b/markdown/plext/using_plpython.html.md.erb
index 063509a..32a6e6d 100644
--- a/markdown/plext/using_plpython.html.md.erb
+++ b/markdown/plext/using_plpython.html.md.erb
@@ -2,6 +2,25 @@
title: Using PL/Python in HAWQ
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This section provides an overview of the HAWQ PL/Python procedural language extension.
## <a id="abouthawqplpython"></a>About HAWQ PL/Python
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/plext/using_plr.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/plext/using_plr.html.md.erb b/markdown/plext/using_plr.html.md.erb
index 367a1d0..ca4def7 100644
--- a/markdown/plext/using_plr.html.md.erb
+++ b/markdown/plext/using_plr.html.md.erb
@@ -2,6 +2,25 @@
title: Using PL/R in HAWQ
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
PL/R is a procedural language. With the HAWQ PL/R extension, you can write database functions in the R programming language and use R packages that contain R functions and data sets.
**Note**: To use PL/R in HAWQ, R must be installed on each node in your HAWQ cluster. Additionally, you must install the PL/R package on an existing HAWQ deployment or have specified PL/R as a build option when compiling HAWQ.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/ConfigurePXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/ConfigurePXF.html.md.erb b/markdown/pxf/ConfigurePXF.html.md.erb
index fec6b27..c21866e 100644
--- a/markdown/pxf/ConfigurePXF.html.md.erb
+++ b/markdown/pxf/ConfigurePXF.html.md.erb
@@ -2,6 +2,25 @@
title: Configuring PXF
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This topic describes how to configure the PXF service.
**Note:** After you make any changes to a PXF configuration file (such as `pxf-profiles.xml` for adding custom profiles), propagate the changes to all nodes with PXF installed, and then restart the PXF service on all nodes.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/HBasePXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/HBasePXF.html.md.erb b/markdown/pxf/HBasePXF.html.md.erb
index 8b89730..3be06d2 100644
--- a/markdown/pxf/HBasePXF.html.md.erb
+++ b/markdown/pxf/HBasePXF.html.md.erb
@@ -2,6 +2,25 @@
title: Accessing HBase Data
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
## <a id="installingthepxfhbaseplugin"></a>Prerequisites
Before trying to access HBase data with PXF, verify the following:
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/HDFSFileDataPXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/HDFSFileDataPXF.html.md.erb b/markdown/pxf/HDFSFileDataPXF.html.md.erb
index 2021565..6780650 100644
--- a/markdown/pxf/HDFSFileDataPXF.html.md.erb
+++ b/markdown/pxf/HDFSFileDataPXF.html.md.erb
@@ -2,6 +2,25 @@
title: Accessing HDFS File Data
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HDFS is the primary distributed storage mechanism used by Apache Hadoop applications. The PXF HDFS plug-in reads file data stored in HDFS. The plug-in supports plain delimited and comma-separated-value format text files. The HDFS plug-in also supports the Avro binary format.
This section describes how to use PXF to access HDFS data, including how to create and query an external table from files in the HDFS data store.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/HDFSWritablePXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/HDFSWritablePXF.html.md.erb b/markdown/pxf/HDFSWritablePXF.html.md.erb
index b99b03e..021b6b9 100644
--- a/markdown/pxf/HDFSWritablePXF.html.md.erb
+++ b/markdown/pxf/HDFSWritablePXF.html.md.erb
@@ -2,6 +2,25 @@
title: Writing Data to HDFS
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
The PXF HDFS plug-in supports writable external tables using the `HdfsTextSimple` and `SequenceWritable` profiles. You might create a writable table to export data from a HAWQ internal table to binary or text HDFS files.
Use the `HdfsTextSimple` profile when writing text data. Use the `SequenceWritable` profile when dealing with binary data.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb b/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb
index 72ca3b6..1a49576 100644
--- a/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb
+++ b/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb
@@ -2,6 +2,25 @@
title: Using PXF with Unmanaged Data
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ Extension Framework (PXF) is an extensible framework that allows HAWQ to query external system data.�
PXF includes built-in connectors for accessing data inside HDFS files, Hive tables, and HBase tables. PXF also integrates with HCatalog to query Hive tables directly.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/HivePXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/HivePXF.html.md.erb b/markdown/pxf/HivePXF.html.md.erb
index 199c7a1..e0f6c79 100644
--- a/markdown/pxf/HivePXF.html.md.erb
+++ b/markdown/pxf/HivePXF.html.md.erb
@@ -2,6 +2,25 @@
title: Accessing Hive Data
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
Apache Hive is a distributed data warehousing infrastructure. Hive facilitates managing large data sets supporting multiple data formats, including comma-separated value (.csv), RC, ORC, and parquet. The PXF Hive plug-in reads data stored in Hive, as well as HDFS or HBase.
This section describes how to use PXF to access Hive data. Options for querying data stored in Hive include:
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/InstallPXFPlugins.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/InstallPXFPlugins.html.md.erb b/markdown/pxf/InstallPXFPlugins.html.md.erb
index 4ae4101..4fbda74 100644
--- a/markdown/pxf/InstallPXFPlugins.html.md.erb
+++ b/markdown/pxf/InstallPXFPlugins.html.md.erb
@@ -2,6 +2,25 @@
title: Installing PXF Plug-ins
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This topic describes how to install the built-in PXF service plug-ins that are required to connect PXF to HDFS, Hive, HBase, and JSON.
**Note:** PXF requires that you run Tomcat on the host machine. Tomcat reserves ports 8005, 8080, and 8009. If you have configured Oozie JXM reporting on a host that will run PXF, make sure that the reporting service uses a port other than 8005. This helps to prevent port conflict errors from occurring when you start the PXF service.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/JsonPXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/JsonPXF.html.md.erb b/markdown/pxf/JsonPXF.html.md.erb
index 97195ad..5f156c4 100644
--- a/markdown/pxf/JsonPXF.html.md.erb
+++ b/markdown/pxf/JsonPXF.html.md.erb
@@ -2,6 +2,25 @@
title: Accessing JSON File Data
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
The PXF JSON plug-in reads native JSON stored in HDFS. The plug-in supports common data types, as well as basic (N-level) projection and arrays.
To access JSON file data with HAWQ, the data must be stored in HDFS and an external table created from the HDFS data store.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb b/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb
index 292616b..c947775 100644
--- a/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb
+++ b/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb
@@ -2,6 +2,25 @@
title: PXF External Tables and API
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
You can use the PXF API to create�your own connectors to access any other type of parallel data store or processing engine.
The PXF Java API lets you extend PXF functionality and add new services and formats without changing HAWQ. The API includes three classes that are extended to allow HAWQ to access an external data source: Fragmenter, Accessor, and Resolver.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/ReadWritePXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/ReadWritePXF.html.md.erb b/markdown/pxf/ReadWritePXF.html.md.erb
index 18f655d..f424afd 100644
--- a/markdown/pxf/ReadWritePXF.html.md.erb
+++ b/markdown/pxf/ReadWritePXF.html.md.erb
@@ -2,6 +2,25 @@
title: Using Profiles to Read and Write Data
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
PXF profiles are collections of common metadata attributes that can be used to simplify the reading and writing of data. You can use any of the built-in profiles that come with PXF or you can create your own.
For example, if you are writing single line records to text files on HDFS, you could use the built-in HdfsTextSimple profile. You specify this profile when you create the PXF external table used to write the data to HDFS.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/pxf/TroubleshootingPXF.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/pxf/TroubleshootingPXF.html.md.erb b/markdown/pxf/TroubleshootingPXF.html.md.erb
index 9febe09..c1bd43a 100644
--- a/markdown/pxf/TroubleshootingPXF.html.md.erb
+++ b/markdown/pxf/TroubleshootingPXF.html.md.erb
@@ -2,6 +2,25 @@
title: Troubleshooting PXF
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
## <a id="pxerrortbl"></a>PXF Errors
The following table lists some common errors encountered while using PXF:
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/query/HAWQQueryProcessing.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/query/HAWQQueryProcessing.html.md.erb b/markdown/query/HAWQQueryProcessing.html.md.erb
index 1d221f4..0538592 100644
--- a/markdown/query/HAWQQueryProcessing.html.md.erb
+++ b/markdown/query/HAWQQueryProcessing.html.md.erb
@@ -2,6 +2,25 @@
title: About HAWQ Query Processing
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
This topic provides an overview of how HAWQ processes queries. Understanding this process can be useful when writing and tuning queries.
Users issue queries to HAWQ as they would to any database management system. They connect to the database instance on the HAWQ master host using a client application such as `psql` and submit SQL statements.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/query/defining-queries.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/query/defining-queries.html.md.erb b/markdown/query/defining-queries.html.md.erb
index b796511..360ebe2 100644
--- a/markdown/query/defining-queries.html.md.erb
+++ b/markdown/query/defining-queries.html.md.erb
@@ -2,6 +2,25 @@
title: Defining Queries
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ is based on the PostgreSQL implementation of the SQL standard. SQL commands are typically entered using the standard PostgreSQL interactive terminal `psql`, but other programs that have similar functionality can be used as well.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/query/functions-operators.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/query/functions-operators.html.md.erb b/markdown/query/functions-operators.html.md.erb
index 8f14ee6..4b4b03a 100644
--- a/markdown/query/functions-operators.html.md.erb
+++ b/markdown/query/functions-operators.html.md.erb
@@ -2,6 +2,25 @@
title: Using Functions and Operators
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
HAWQ evaluates functions and operators used in SQL expressions.
## <a id="topic27"></a>Using Functions in HAWQ
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/query/gporca/query-gporca-changed.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/query/gporca/query-gporca-changed.html.md.erb b/markdown/query/gporca/query-gporca-changed.html.md.erb
index 041aa4b..4e7d586 100644
--- a/markdown/query/gporca/query-gporca-changed.html.md.erb
+++ b/markdown/query/gporca/query-gporca-changed.html.md.erb
@@ -2,6 +2,25 @@
title: Changed Behavior with GPORCA
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
<span class="shortdesc">When GPORCA is enabled, HAWQ's behavior changes. This topic describes these changes.</span>
- The command `CREATE TABLE AS` distributes table data randomly if the `DISTRIBUTED BY` clause is not specified and no primary or unique keys are specified.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/query/gporca/query-gporca-enable.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/query/gporca/query-gporca-enable.html.md.erb b/markdown/query/gporca/query-gporca-enable.html.md.erb
index e8cc93f..510b4e4 100644
--- a/markdown/query/gporca/query-gporca-enable.html.md.erb
+++ b/markdown/query/gporca/query-gporca-enable.html.md.erb
@@ -2,6 +2,25 @@
title: Enabling GPORCA
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
<span class="shortdesc">Precompiled versions of HAWQ that include the GPORCA query optimizer enable it by default, no additional configuration is required. To use the GPORCA query optimizer in a HAWQ built from source, your build must include GPORCA. You must also enable specific HAWQ server configuration parameters at or after install time: </span>
- [Set the <code class="ph codeph">optimizer\_analyze\_root\_partition</code> parameter to <code class="ph codeph">on</code>](#topic_r5d_hv1_kr) to enable statistics collection for the root partition of a partitioned table.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a42c05a9/markdown/query/gporca/query-gporca-fallback.html.md.erb
----------------------------------------------------------------------
diff --git a/markdown/query/gporca/query-gporca-fallback.html.md.erb b/markdown/query/gporca/query-gporca-fallback.html.md.erb
index 999e9a7..2c540a1 100644
--- a/markdown/query/gporca/query-gporca-fallback.html.md.erb
+++ b/markdown/query/gporca/query-gporca-fallback.html.md.erb
@@ -2,6 +2,25 @@
title: Determining The Query Optimizer In Use
---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
<span class="shortdesc"> When GPORCA is enabled, you can determine if HAWQ is using GPORCA or is falling back to the legacy query optimizer. </span>
These are two ways to determine which query optimizer HAWQ used to execute the query: