You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hawq.apache.org by yo...@apache.org on 2016/09/20 16:08:16 UTC
[1/3] incubator-hawq-docs git commit: misc doc clarifications
Repository: incubator-hawq-docs
Updated Branches:
refs/heads/develop 1661c625d -> c617b1c10
misc doc clarifications
Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/cd4a3db2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/cd4a3db2
Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/cd4a3db2
Branch: refs/heads/develop
Commit: cd4a3db248a2b882683dc496c9f07872b0cb2783
Parents: 1661c62
Author: Lisa Owen <lo...@pivotal.io>
Authored: Mon Sep 19 10:44:24 2016 -0700
Committer: Lisa Owen <lo...@pivotal.io>
Committed: Mon Sep 19 10:44:24 2016 -0700
----------------------------------------------------------------------
install/aws-config.html.md.erb | 18 ++----------------
pxf/HawqExtensionFrameworkPXF.html.md.erb | 4 ++++
reference/HAWQDataTypes.html.md.erb | 4 +++-
requirements/system-requirements.html.md.erb | 3 +++
4 files changed, 12 insertions(+), 17 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/cd4a3db2/install/aws-config.html.md.erb
----------------------------------------------------------------------
diff --git a/install/aws-config.html.md.erb b/install/aws-config.html.md.erb
index 395970b..fb2a623 100644
--- a/install/aws-config.html.md.erb
+++ b/install/aws-config.html.md.erb
@@ -29,9 +29,7 @@ Instance store-backed storage is generally better performing than EBS and recomm
**Note** EC2 *instance store* provides temporary block-level storage. This storage is located on disks that are physically attached to the host computer. While instance store provides high performance, powering off the instance causes data loss. Soft reboots preserve instance store data.
Virtual devices for instance store volumes for HAWQ EC2 instance store instances are named `ephemeralN` (where *N* varies based on instance type). CentOS instance store block device are named `/dev/xvdletter` (where *letter* is a lower case letter of the alphabet).
-
-?? DO WE RECOMMEND EBS-backed VOLUMES FOR ANYTHING? I.E. BACKUPS, ...??)
-
+
### <a id="topic_cfgplacegrp"></a>Configure Placement Group
@@ -75,24 +73,14 @@ Ensure your Ambari and HAWQ master instances are each assigned a public IP addre
A security group is a set of rules that control network traffic to and from your HAWQ instance. One or more rules may be associated with a security group, and one or more security groups may be associated with an instance.
-To configure HAWQ communication between nodes in the HAWQ cluster, include and open the following ports in the appropriate security group for the HAWQ master and segment nodes:
-
-?? PROVIDE SPECIFIC type/protocol/portrange/source settings from EC2 console ??
+To configure HAWQ communication between nodes in the HAWQ cluster, include and open the following ports in the appropriate security group for the HAWQ master and segment nodes.
| Port | Application |
|-------|-------------------------------------|
| 22 | ssh - secure connect to other hosts |
-| XX | XX |
-
-UDP access within the VPC should be enabled by default.
-
-
-?? DIFFENT SECURITY GROUP FOR AMBARI NODE ??
To allow access to/from a source external to the Ambari management node, include and open the following ports in an appropriate security group for your Ambari node:
-?? PROVIDE SPECIFIC type/protocol/portrange/source settings from EC2 console ??
-
| Port | Application |
|-------|-------------------------------------|
| 22 | ssh - secure connect to other hosts |
@@ -116,8 +104,6 @@ After launching your HAWQ instance, you will connect to and configure the instan
Before installing HAWQ, set up the EC2 instances as you would local host server machines. Configure the host operating system, configure host network information (for example, update the `/etc/hosts` file), set operating system parameters, and install operating system packages. For information about how to prepare your operating system environment for HAWQ, see [Select HAWQ Host Machines](../install/select-hosts.html).
-?? PACKAGES, KERNEL VERSION, KERNEL SETTINGS, BEST PRACTICES HERE OR WILL THEY BE THE SAME AS FOR PHYSICAL DEVICE??
-
##References<a id="topic_hgz_zwy_bv"></a>
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/cd4a3db2/pxf/HawqExtensionFrameworkPXF.html.md.erb
----------------------------------------------------------------------
diff --git a/pxf/HawqExtensionFrameworkPXF.html.md.erb b/pxf/HawqExtensionFrameworkPXF.html.md.erb
index b705984..c0d7c0f 100644
--- a/pxf/HawqExtensionFrameworkPXF.html.md.erb
+++ b/pxf/HawqExtensionFrameworkPXF.html.md.erb
@@ -28,6 +28,10 @@ PXF allows users to create custom connectors to access other parallel data store
This topic describes how to access HBase data using PXF.
+- **[Accessing JSON Data](../pxf/JsonPXF.html)**
+
+ This topic describes how to access JSON data using PXF.
+
- **[Using Profiles to Read and Write Data](../pxf/ReadWritePXF.html)**
PXF profiles are collections of common metadata attributes that can be used to simplify the reading and writing of data. You can use any of the built-in profiles that come with PXF or you can create your own.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/cd4a3db2/reference/HAWQDataTypes.html.md.erb
----------------------------------------------------------------------
diff --git a/reference/HAWQDataTypes.html.md.erb b/reference/HAWQDataTypes.html.md.erb
index d894b38..fe5cff7 100644
--- a/reference/HAWQDataTypes.html.md.erb
+++ b/reference/HAWQDataTypes.html.md.erb
@@ -27,7 +27,7 @@ The following data types are specified by SQL:
- timestamp�(with or without time zone)
- varchar
-**Note**: HAWQ supports the array data type for append-only tables; parquet table storage does *not* support the array type.
+**Note**(\*): HAWQ supports the array data type for append-only tables; parquet table storage does *not* support the array type.
Each data type has an external representation determined by its input and output functions. Many of the built-in types have obvious external formats. However, several types are unique to HAWQ, such as geometric paths, or have several possibilities for formats, such as the date and time types. Some of the input and output functions are not invertible. That is, the result of an output function may lose accuracy when compared to the original input.
@@ -75,6 +75,8 @@ Each data type has an external representation determined by its input and output
For variable length data types (such as char, varchar, text, xml, etc.) if the data is greater than or equal to 127 bytes, the storage overhead is 4 bytes instead of 1.
+**Note**: Use these documented built-in types when creating user tables. Any other data types that might be visible in the source code are for internal use only.
+
## <a id="timezones"></a>Time Zones
Time zones, and time-zone conventions, are influenced by political decisions, not just earth geometry. Time zones around the world became somewhat standardized during the 1900's, but continue to be prone to arbitrary changes, particularly with respect to daylight-savings rules.�HAWQ�uses the widely-used�zoneinfo�time zone database for information about historical time zone rules. For times in the future, the assumption is that the latest known rules for a given time zone will continue to be observed indefinitely far into the future.
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/cd4a3db2/requirements/system-requirements.html.md.erb
----------------------------------------------------------------------
diff --git a/requirements/system-requirements.html.md.erb b/requirements/system-requirements.html.md.erb
index bc08ef0..35a2ed9 100644
--- a/requirements/system-requirements.html.md.erb
+++ b/requirements/system-requirements.html.md.erb
@@ -187,6 +187,9 @@ If this system uses the default HAWQ resource manager, you would set `hawq_rm_me
- Dedicated, non-blocking switch.
- Systems with multiple NICs require NIC bonding to utilize all available network bandwidth.
+## <a id="topic_rdb_jhv_2v"></a>Networking Requirements
+
+Communications between the HAWQ master and segments require reverse DNS lookup be configured in your cluster network.
## <a id="port-req"></a>Port Requirements
Individual PXF plug-ins, which you install after adding the HAWQ and PXF services, require that you Tomcat on the host machine. Tomcat reserves ports 8005, 8080, and 8009.
[3/3] incubator-hawq-docs git commit: use colon before table
Posted by yo...@apache.org.
use colon before table
Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/c617b1c1
Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/c617b1c1
Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/c617b1c1
Branch: refs/heads/develop
Commit: c617b1c107f725852e3dd880a382bd2d6eb1d2a8
Parents: f6382c2
Author: Lisa Owen <lo...@pivotal.io>
Authored: Mon Sep 19 10:57:08 2016 -0700
Committer: Lisa Owen <lo...@pivotal.io>
Committed: Mon Sep 19 10:57:08 2016 -0700
----------------------------------------------------------------------
install/aws-config.html.md.erb | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/c617b1c1/install/aws-config.html.md.erb
----------------------------------------------------------------------
diff --git a/install/aws-config.html.md.erb b/install/aws-config.html.md.erb
index fb2a623..32675fe 100644
--- a/install/aws-config.html.md.erb
+++ b/install/aws-config.html.md.erb
@@ -73,7 +73,7 @@ Ensure your Ambari and HAWQ master instances are each assigned a public IP addre
A security group is a set of rules that control network traffic to and from your HAWQ instance. One or more rules may be associated with a security group, and one or more security groups may be associated with an instance.
-To configure HAWQ communication between nodes in the HAWQ cluster, include and open the following ports in the appropriate security group for the HAWQ master and segment nodes.
+To configure HAWQ communication between nodes in the HAWQ cluster, include and open the following ports in the appropriate security group for the HAWQ master and segment nodes:
| Port | Application |
|-------|-------------------------------------|
[2/3] incubator-hawq-docs git commit: add reverse dns to Networking
Requirements section
Posted by yo...@apache.org.
add reverse dns to Networking Requirements section
Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/f6382c2c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/f6382c2c
Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/f6382c2c
Branch: refs/heads/develop
Commit: f6382c2c1aa204ef6e9756ae16e9169b0722a143
Parents: cd4a3db
Author: Lisa Owen <lo...@pivotal.io>
Authored: Mon Sep 19 10:54:55 2016 -0700
Committer: Lisa Owen <lo...@pivotal.io>
Committed: Mon Sep 19 10:54:55 2016 -0700
----------------------------------------------------------------------
requirements/system-requirements.html.md.erb | 5 +----
1 file changed, 1 insertion(+), 4 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/f6382c2c/requirements/system-requirements.html.md.erb
----------------------------------------------------------------------
diff --git a/requirements/system-requirements.html.md.erb b/requirements/system-requirements.html.md.erb
index 35a2ed9..cf9214d 100644
--- a/requirements/system-requirements.html.md.erb
+++ b/requirements/system-requirements.html.md.erb
@@ -186,10 +186,7 @@ If this system uses the default HAWQ resource manager, you would set `hawq_rm_me
- Gigabit Ethernet within the array. For a production cluster, 10 Gigabit Ethernet recommended.
- Dedicated, non-blocking switch.
- Systems with multiple NICs require NIC bonding to utilize all available network bandwidth.
-
-## <a id="topic_rdb_jhv_2v"></a>Networking Requirements
-
-Communications between the HAWQ master and segments require reverse DNS lookup be configured in your cluster network.
+- Communication between the HAWQ master and segments requires reverse DNS lookup be configured in your cluster network.
## <a id="port-req"></a>Port Requirements
Individual PXF plug-ins, which you install after adding the HAWQ and PXF services, require that you Tomcat on the host machine. Tomcat reserves ports 8005, 8080, and 8009.