You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hawq.apache.org by George Lu <lu...@gmail.com> on 2016/12/09 07:34:25 UTC
Fwd: HAWQ register error if create table DDL without specifying
distributed by (column)
Dear all,
I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on HDP
2.5
I created a one-level partitioned table:
create table sales2( amount numeric(10,2), year integer)
with(appendonly=true) distributed randomly partition by range(year)
(start(2014) end (2016) every(1));
then insert two records into that.
After that, I use "hawq extract -d testdb -o sales2.yml sale2" to extract
the table metadata.
Then I use "hawq register -d testdb --config sales2.yml sales6" to register
the HDFS into a new (not existing) table sales6.
I met below errors:
20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
to connect database localhost:5432 testdb
20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
check...
20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
check done.
20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
check for table sales2_1_prt_1...
20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
check done for table sales2_1_prt_1.
20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
check for table sales2_1_prt_2...
20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
check done for table sales2_1_prt_2.
20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
file(s) to be registered: ['hdfs://kevinhwx12061712.
bdl02.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
number of public.sales6_1_prt_1 is not consistent with previous bucket
number.
20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
found, Hawqregister starts to rollback...
20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
Register Rollback Finished.
*However*, if I created the table like:
create table sales3(id int, amount numeric(10,2), year integer)
with(appendonly=true) *distributed by* (id) partition by range(year)
(start(2014) end (2016) every(1));
And the extract and register works properly.
I have pasted the sales3.yml in below.
Please kindly help to check what is the problem and do I need to specify
the distributed by (column) in the Create Table DDL if I want to use hawq
register for one-level partitioned table?
Thanks!
Regards,
Lu Wenbin
===========================================================================
1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
--inserts is preferred over -d. -d is deprecated.
--
-- Greenplum Database database dump
--
SET statement_timeout = 0;
SET client_encoding = 'UTF8';
SET standard_conforming_strings = off;
SET check_function_bodies = false;
SET client_min_messages = warning;
SET escape_string_warning = off;
SET gp_enable_column_oriented_table = true;
SET default_with_oids = false;
--
-- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
--
SET gp_called_by_pgdump = true;
SET search_path = public, pg_catalog;
SET default_tablespace = '';
--
-- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
--
CREATE TABLE sales2 (
amount numeric(10,2),
year integer
)
WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
(
START (2014) END (2015) EVERY (1) WITH
(tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
START (2015) END (2016) EVERY (1) WITH
(tablename='sales2_1_prt_2', orientation=row , appendonly=true )
);
ALTER TABLE public.sales2 OWNER TO gpadmin;
--
-- Greenplum Database database dump complete
--
2) Sales2.yml
AO_FileLocations:
Blocksize: 32768
Checksum: false
CompressionLevel: 0
CompressionType: null
Files:
- eofuncompressed: 0
path: /hawq_default/16385/16508/16910/1
size: 0
tupcount: 0
varblockcount: 0
PartitionBy: PARTITION BY range (year)
Partitions:
- Blocksize: 32768
Checksum: false
CompressionLevel: 0
CompressionType: null
Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
Files:
- eofuncompressed: 32
path: /hawq_default/16385/16508/16915/1
size: 32
tupcount: 1
varblockcount: 1
Name: sales2_1_prt_1
- Blocksize: 32768
Checksum: false
CompressionLevel: 0
CompressionType: null
Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
Files:
- eofuncompressed: 32
path: /hawq_default/16385/16508/16921/1
size: 32
tupcount: 1
varblockcount: 1
Name: sales2_1_prt_2
AO_Schema:
- name: amount
type: numeric
- name: year
type: int4
DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
2.1.0.0 build
2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
20140120 (Red
Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
Distribution_Policy: DISTRIBUTED RANDOMLY
Encoding: UTF8
FileFormat: AO
TableName: public.sales2
Version: 1.0.0
3) sales3 schema
--inserts is preferred over -d. -d is deprecated.
--
-- Greenplum Database database dump
--
SET statement_timeout = 0;
SET client_encoding = 'UTF8';
SET standard_conforming_strings = off;
SET check_function_bodies = false;
SET client_min_messages = warning;
SET escape_string_warning = off;
SET gp_enable_column_oriented_table = true;
SET default_with_oids = false;
--
-- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
--
SET gp_called_by_pgdump = true;
SET search_path = public, pg_catalog;
SET default_tablespace = '';
--
-- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
--
CREATE TABLE sales3 (
id integer,
amount numeric(10,2),
year integer
)
WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
(
START (2014) END (2015) EVERY (1) WITH
(tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
START (2015) END (2016) EVERY (1) WITH
(tablename='sales3_1_prt_2', orientation=row , appendonly=true )
);
ALTER TABLE public.sales3 OWNER TO gpadmin;
--
-- Greenplum Database database dump complete
--
4) sales3.yml
AO_FileLocations:
Blocksize: 32768
Checksum: false
CompressionLevel: 0
CompressionType: null
Files:
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/1
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/2
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/3
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/4
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/5
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/6
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/7
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/8
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/9
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/10
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/11
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/12
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/13
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/14
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/15
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/16
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/17
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/18
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/19
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/20
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/21
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/22
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/23
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/24
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/25
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/26
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/27
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/28
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/29
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/30
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/31
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/32
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/33
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/34
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/35
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/36
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/37
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/38
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/39
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/40
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/41
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16970/42
size: 0
tupcount: 0
varblockcount: 0
PartitionBy: PARTITION BY range (year)
Partitions:
- Blocksize: 32768
Checksum: false
CompressionLevel: 0
CompressionType: null
Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
Files:
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/1
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/2
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/3
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/4
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/5
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/6
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/7
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/8
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/9
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/10
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/11
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/12
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/13
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/14
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/15
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/16
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/17
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/18
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/19
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/20
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/21
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/22
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/23
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/24
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/25
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/26
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/27
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/28
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/29
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/30
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 32
path: /hawq_default/16385/16508/16975/31
size: 32
tupcount: 1
varblockcount: 1
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/32
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/33
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/34
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/35
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/36
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/37
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/38
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/39
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/40
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/41
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16975/42
size: 0
tupcount: 0
varblockcount: 0
Name: sales3_1_prt_1
- Blocksize: 32768
Checksum: false
CompressionLevel: 0
CompressionType: null
Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
Files:
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/1
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/2
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/3
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/4
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/5
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/6
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/7
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/8
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/9
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/10
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/11
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/12
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/13
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/14
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/15
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 32
path: /hawq_default/16385/16508/16981/16
size: 32
tupcount: 1
varblockcount: 1
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/17
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/18
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/19
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/20
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/21
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/22
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/23
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/24
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/25
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/26
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/27
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/28
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/29
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/30
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/31
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/32
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/33
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/34
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/35
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/36
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/37
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/38
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/39
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/40
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/41
size: 0
tupcount: 0
varblockcount: 0
- eofuncompressed: 0
path: /hawq_default/16385/16508/16981/42
size: 0
tupcount: 0
varblockcount: 0
Name: sales3_1_prt_2
AO_Schema:
- name: id
type: int4
- name: amount
type: numeric
- name: year
type: int4
Bucketnum: 42
DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
2.1.0.0 build
2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
20140120 (Red
Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
Distribution_Policy: DISTRIBUTED BY (id)
Encoding: UTF8
FileFormat: AO
TableName: public.sales3
Version: 1.0.0
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Hong Wu <xu...@gmail.com>.
Hi Supriya Biswas,
To remove your address from the list, send a message to:
<de...@hawq.incubator.apache.org>
I think you will receive a confirm email if it works. If it doesn't work,
send mail to the following for info and FAQ for this list:
<de...@hawq.incubator.apache.org>
<de...@hawq.incubator.apache.org>
Hong
2016-12-13 22:10 GMT+08:00 Supriya Biswas <su...@nielsen.com>:
> I DO NOT WANT TO RECEIVE ANY MAIL.
>
> I UN-SUBSCRIBED IT BUT, STILL RECEIVING MAIL.
>
> ** PLEASE HELP BY REMOVING ME FROM THE MAILING LIST **
>
>
> *Supriyo Biswas *Architect
> The Nielsen Company
> Office (516) 682-6021/NETS 249-6021
>
> Cell (516) 353-6795
> www.nielsen.com
>
> On Tue, Dec 13, 2016 at 12:42 AM, Wenbin Lu <lu...@gmail.com> wrote:
>
>> Hi Lili,
>>
>> Greatly appreciates your help!!
>>
>> Thanks!
>>
>> Regards,
>> Lu Wenbin
>>
>> On Mon, Dec 12, 2016 at 11:46 PM, Lili Ma <lm...@pivotal.io> wrote:
>>
>>> Hi George,
>>>
>>> We have fixed the bug in current HAWQ master branch. And you can use a
>>> temp workaround as this: If you want to register to a randomly distributed
>>> table, you can set default_hash_table_bucket_number to 6 before
>>> creating the DDL.
>>>
>>> Any further questions, please do not hesitate to let us know!
>>>
>>> Thanks
>>> Lili
>>>
>>> On Sat, Dec 10, 2016 at 12:31 PM, George Lu <lu...@gmail.com>
>>> wrote:
>>>
>>>> Hi Lili and Hong,
>>>>
>>>> Thanks a lot for your help!
>>>> I tried the SQL to get bucket num. The result is 42.
>>>>
>>>> Thanks for the code explanation also.
>>>>
>>>> Regards,
>>>> Lu Wenbin
>>>>
>>>> On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Wenbin,
>>>>>
>>>>> So glad that you are using the very fresh feature inside HDB 2.1.0!
>>>>> "hawqregister" supports registering a one-level partition table in this
>>>>> release. You can register a hash distributed table to a hash distributed
>>>>> table, a randomly distributed table to a randomly distributed table, a hash
>>>>> distributed table to a hash distributed table. But you can not
>>>>> register a randomly distributed table to a hash distributed table.
>>>>>
>>>>> For your case, the usage is exactly correct. According to your log
>>>>> file, it says
>>>>> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
>>>>> consistent with previous bucket number." This is a pre-check in
>>>>> hawqregister, making sure that the bucketnum value from yaml file is
>>>>> consistent with destination table. For a randomly distributed table, this
>>>>> value is meaningless and in fact this check is unnecessary. But current
>>>>> implement also does the check in this case, using default values'
>>>>> consistency.
>>>>>
>>>>> I noticed that in your extracted yaml file "sales3.yml", the
>>>>> bucketnum is 42 so I guess in your environment, the default bucketnum is
>>>>> 42. Please check it with following SQLs:
>>>>>
>>>>> postgres=# select oid from pg_class where relnamespace='2200' and
>>>>> relname = 'sales2';
>>>>>
>>>>> postgres=# select bucketnum from gp_distribution_policy where
>>>>> localoid = 'oid';
>>>>>
>>>>> I think the output should be 42(the default bucket number guc value).
>>>>> To conclude, I think it is a bug of hawqregister code here
>>>>> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
>>>>> For randomly distributed table, the source bucket_num check value is set
>>>>> with fixed 6. We should modify it with the value in different HAWQ
>>>>> environment, or we can remove this check for registering randomly
>>>>> distributed table. I will do that fix asap.
>>>>> Thanks,
>>>>> Hong
>>>>>
>>>>> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>>>>>
>>>>>> Dear all,
>>>>>>
>>>>>>
>>>>>>
>>>>>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS
>>>>>> on HDP 2.5
>>>>>>
>>>>>>
>>>>>>
>>>>>> I created a one-level partitioned table:
>>>>>>
>>>>>> create table sales2( amount numeric(10,2), year integer)
>>>>>> with(appendonly=true) distributed randomly partition by range(year)
>>>>>> (start(2014) end (2016) every(1));
>>>>>>
>>>>>> then insert two records into that.
>>>>>>
>>>>>>
>>>>>>
>>>>>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to
>>>>>> extract the table metadata.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>>>>>> register the HDFS into a new (not existing) table sales6.
>>>>>>
>>>>>> I met below errors:
>>>>>>
>>>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>>>>>> to connect database localhost:5432 testdb
>>>>>>
>>>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check...
>>>>>>
>>>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check done.
>>>>>>
>>>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check for table sales2_1_prt_1...
>>>>>>
>>>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check done for table sales2_1_prt_1.
>>>>>>
>>>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check for table sales2_1_prt_2...
>>>>>>
>>>>>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check done for table sales2_1_prt_2.
>>>>>>
>>>>>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>>>>>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>>>>>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>>>>>
>>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>>>>>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>>>>>> number.
>>>>>>
>>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>>>>>> found, Hawqregister starts to rollback...
>>>>>>
>>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>>>>>> Register Rollback Finished.
>>>>>>
>>>>>>
>>>>>>
>>>>>> *However*, if I created the table like:
>>>>>>
>>>>>> create table sales3(id int, amount numeric(10,2), year integer)
>>>>>> with(appendonly=true) *distributed by* (id) partition by range(year)
>>>>>> (start(2014) end (2016) every(1));
>>>>>>
>>>>>> And the extract and register works properly.
>>>>>>
>>>>>> I have pasted the sales3.yml in below.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Please kindly help to check what is the problem and do I need to
>>>>>> specify the distributed by (column) in the Create Table DDL if I want to
>>>>>> use hawq register for one-level partitioned table?
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks!
>>>>>>
>>>>>>
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> Lu Wenbin
>>>>>>
>>>>>>
>>>>>>
>>>>>> ============================================================
>>>>>> ===============
>>>>>>
>>>>>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>>>>>
>>>>>> --inserts is preferred over -d. -d is deprecated.
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Greenplum Database database dump
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET statement_timeout = 0;
>>>>>>
>>>>>> SET client_encoding = 'UTF8';
>>>>>>
>>>>>> SET standard_conforming_strings = off;
>>>>>>
>>>>>> SET check_function_bodies = false;
>>>>>>
>>>>>> SET client_min_messages = warning;
>>>>>>
>>>>>> SET escape_string_warning = off;
>>>>>>
>>>>>> SET gp_enable_column_oriented_table = true;
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET default_with_oids = false;
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET gp_called_by_pgdump = true;
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET search_path = public, pg_catalog;
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET default_tablespace = '';
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin;
>>>>>> Tablespace:
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> CREATE TABLE sales2 (
>>>>>>
>>>>>> amount numeric(10,2),
>>>>>>
>>>>>> year integer
>>>>>>
>>>>>> )
>>>>>>
>>>>>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>>>>>
>>>>>> (
>>>>>>
>>>>>> START (2014) END (2015) EVERY (1) WITH
>>>>>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>>>>>
>>>>>> START (2015) END (2016) EVERY (1) WITH
>>>>>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>>>>>
>>>>>> );
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Greenplum Database database dump complete
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2) Sales2.yml
>>>>>>
>>>>>> AO_FileLocations:
>>>>>>
>>>>>> Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16910/1
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> PartitionBy: PARTITION BY range (year)
>>>>>>
>>>>>> Partitions:
>>>>>>
>>>>>> - Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Constraint: START (2014) END (2015) EVERY (1) WITH
>>>>>> (appendonly=true)
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 32
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16915/1
>>>>>>
>>>>>> size: 32
>>>>>>
>>>>>> tupcount: 1
>>>>>>
>>>>>> varblockcount: 1
>>>>>>
>>>>>> Name: sales2_1_prt_1
>>>>>>
>>>>>> - Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Constraint: START (2015) END (2016) EVERY (1) WITH
>>>>>> (appendonly=true)
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 32
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16921/1
>>>>>>
>>>>>> size: 32
>>>>>>
>>>>>> tupcount: 1
>>>>>>
>>>>>> varblockcount: 1
>>>>>>
>>>>>> Name: sales2_1_prt_2
>>>>>>
>>>>>> AO_Schema:
>>>>>>
>>>>>> - name: amount
>>>>>>
>>>>>> type: numeric
>>>>>>
>>>>>> - name: year
>>>>>>
>>>>>> type: int4
>>>>>>
>>>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>>>> 2.1.0.0 build
>>>>>>
>>>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>>>> 20140120 (Red
>>>>>>
>>>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>>>
>>>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>>>
>>>>>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>>>>>
>>>>>> Encoding: UTF8
>>>>>>
>>>>>> FileFormat: AO
>>>>>>
>>>>>> TableName: public.sales2
>>>>>>
>>>>>> Version: 1.0.0
>>>>>>
>>>>>>
>>>>>>
>>>>>> 3) sales3 schema
>>>>>>
>>>>>> --inserts is preferred over -d. -d is deprecated.
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Greenplum Database database dump
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET statement_timeout = 0;
>>>>>>
>>>>>> SET client_encoding = 'UTF8';
>>>>>>
>>>>>> SET standard_conforming_strings = off;
>>>>>>
>>>>>> SET check_function_bodies = false;
>>>>>>
>>>>>> SET client_min_messages = warning;
>>>>>>
>>>>>> SET escape_string_warning = off;
>>>>>>
>>>>>> SET gp_enable_column_oriented_table = true;
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET default_with_oids = false;
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET gp_called_by_pgdump = true;
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET search_path = public, pg_catalog;
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET default_tablespace = '';
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin;
>>>>>> Tablespace:
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> CREATE TABLE sales3 (
>>>>>>
>>>>>> id integer,
>>>>>>
>>>>>> amount numeric(10,2),
>>>>>>
>>>>>> year integer
>>>>>>
>>>>>> )
>>>>>>
>>>>>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>>>>>
>>>>>> (
>>>>>>
>>>>>> START (2014) END (2015) EVERY (1) WITH
>>>>>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>>>>>
>>>>>> START (2015) END (2016) EVERY (1) WITH
>>>>>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>>>>>
>>>>>> );
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Greenplum Database database dump complete
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> 4) sales3.yml
>>>>>>
>>>>>> AO_FileLocations:
>>>>>>
>>>>>> Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/1
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/2
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/3
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/4
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/5
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/6
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/7
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/8
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/9
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/10
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/11
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/12
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/13
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/14
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/15
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/16
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/17
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/18
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/19
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/20
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/21
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/22
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/23
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/24
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/25
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/26
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/27
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/28
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/29
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/30
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/31
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/32
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/33
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/34
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/35
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/36
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/37
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/38
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/39
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/40
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/41
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/42
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> PartitionBy: PARTITION BY range (year)
>>>>>>
>>>>>> Partitions:
>>>>>>
>>>>>> - Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Constraint: START (2014) END (2015) EVERY (1) WITH
>>>>>> (appendonly=true)
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/1
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/2
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/3
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/4
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/5
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/6
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/7
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/8
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/9
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/10
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/11
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/12
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/13
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/14
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/15
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/16
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/17
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/18
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/19
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/20
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/21
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/22
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/23
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/24
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/25
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/26
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/27
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/28
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/29
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/30
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 32
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/31
>>>>>>
>>>>>> size: 32
>>>>>>
>>>>>> tupcount: 1
>>>>>>
>>>>>> varblockcount: 1
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/32
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/33
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/34
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/35
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/36
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/37
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/38
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/39
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/40
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/41
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/42
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> Name: sales3_1_prt_1
>>>>>>
>>>>>> - Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Constraint: START (2015) END (2016) EVERY (1) WITH
>>>>>> (appendonly=true)
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/1
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/2
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/3
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/4
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/5
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/6
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/7
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/8
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/9
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/10
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/11
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/12
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/13
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/14
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/15
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 32
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/16
>>>>>>
>>>>>> size: 32
>>>>>>
>>>>>> tupcount: 1
>>>>>>
>>>>>> varblockcount: 1
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/17
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/18
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/19
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/20
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/21
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/22
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/23
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/24
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/25
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/26
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/27
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/28
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/29
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/30
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/31
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/32
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/33
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/34
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/35
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/36
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/37
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/38
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/39
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/40
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/41
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/42
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> Name: sales3_1_prt_2
>>>>>>
>>>>>> AO_Schema:
>>>>>>
>>>>>> - name: id
>>>>>>
>>>>>> type: int4
>>>>>>
>>>>>> - name: amount
>>>>>>
>>>>>> type: numeric
>>>>>>
>>>>>> - name: year
>>>>>>
>>>>>> type: int4
>>>>>>
>>>>>> Bucketnum: 42
>>>>>>
>>>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>>>> 2.1.0.0 build
>>>>>>
>>>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>>>> 20140120 (Red
>>>>>>
>>>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>>>
>>>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>>>
>>>>>> Distribution_Policy: DISTRIBUTED BY (id)
>>>>>>
>>>>>> Encoding: UTF8
>>>>>>
>>>>>> FileFormat: AO
>>>>>>
>>>>>> TableName: public.sales3
>>>>>>
>>>>>> Version: 1.0.0
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Hong Wu <xu...@gmail.com>.
Hi Supriya Biswas,
To remove your address from the list, send a message to:
<de...@hawq.incubator.apache.org>
I think you will receive a confirm email if it works. If it doesn't work,
send mail to the following for info and FAQ for this list:
<de...@hawq.incubator.apache.org>
<de...@hawq.incubator.apache.org>
Hong
2016-12-13 22:10 GMT+08:00 Supriya Biswas <su...@nielsen.com>:
> I DO NOT WANT TO RECEIVE ANY MAIL.
>
> I UN-SUBSCRIBED IT BUT, STILL RECEIVING MAIL.
>
> ** PLEASE HELP BY REMOVING ME FROM THE MAILING LIST **
>
>
> *Supriyo Biswas *Architect
> The Nielsen Company
> Office (516) 682-6021/NETS 249-6021
>
> Cell (516) 353-6795
> www.nielsen.com
>
> On Tue, Dec 13, 2016 at 12:42 AM, Wenbin Lu <lu...@gmail.com> wrote:
>
>> Hi Lili,
>>
>> Greatly appreciates your help!!
>>
>> Thanks!
>>
>> Regards,
>> Lu Wenbin
>>
>> On Mon, Dec 12, 2016 at 11:46 PM, Lili Ma <lm...@pivotal.io> wrote:
>>
>>> Hi George,
>>>
>>> We have fixed the bug in current HAWQ master branch. And you can use a
>>> temp workaround as this: If you want to register to a randomly distributed
>>> table, you can set default_hash_table_bucket_number to 6 before
>>> creating the DDL.
>>>
>>> Any further questions, please do not hesitate to let us know!
>>>
>>> Thanks
>>> Lili
>>>
>>> On Sat, Dec 10, 2016 at 12:31 PM, George Lu <lu...@gmail.com>
>>> wrote:
>>>
>>>> Hi Lili and Hong,
>>>>
>>>> Thanks a lot for your help!
>>>> I tried the SQL to get bucket num. The result is 42.
>>>>
>>>> Thanks for the code explanation also.
>>>>
>>>> Regards,
>>>> Lu Wenbin
>>>>
>>>> On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Wenbin,
>>>>>
>>>>> So glad that you are using the very fresh feature inside HDB 2.1.0!
>>>>> "hawqregister" supports registering a one-level partition table in this
>>>>> release. You can register a hash distributed table to a hash distributed
>>>>> table, a randomly distributed table to a randomly distributed table, a hash
>>>>> distributed table to a hash distributed table. But you can not
>>>>> register a randomly distributed table to a hash distributed table.
>>>>>
>>>>> For your case, the usage is exactly correct. According to your log
>>>>> file, it says
>>>>> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
>>>>> consistent with previous bucket number." This is a pre-check in
>>>>> hawqregister, making sure that the bucketnum value from yaml file is
>>>>> consistent with destination table. For a randomly distributed table, this
>>>>> value is meaningless and in fact this check is unnecessary. But current
>>>>> implement also does the check in this case, using default values'
>>>>> consistency.
>>>>>
>>>>> I noticed that in your extracted yaml file "sales3.yml", the
>>>>> bucketnum is 42 so I guess in your environment, the default bucketnum is
>>>>> 42. Please check it with following SQLs:
>>>>>
>>>>> postgres=# select oid from pg_class where relnamespace='2200' and
>>>>> relname = 'sales2';
>>>>>
>>>>> postgres=# select bucketnum from gp_distribution_policy where
>>>>> localoid = 'oid';
>>>>>
>>>>> I think the output should be 42(the default bucket number guc value).
>>>>> To conclude, I think it is a bug of hawqregister code here
>>>>> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
>>>>> For randomly distributed table, the source bucket_num check value is set
>>>>> with fixed 6. We should modify it with the value in different HAWQ
>>>>> environment, or we can remove this check for registering randomly
>>>>> distributed table. I will do that fix asap.
>>>>> Thanks,
>>>>> Hong
>>>>>
>>>>> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>>>>>
>>>>>> Dear all,
>>>>>>
>>>>>>
>>>>>>
>>>>>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS
>>>>>> on HDP 2.5
>>>>>>
>>>>>>
>>>>>>
>>>>>> I created a one-level partitioned table:
>>>>>>
>>>>>> create table sales2( amount numeric(10,2), year integer)
>>>>>> with(appendonly=true) distributed randomly partition by range(year)
>>>>>> (start(2014) end (2016) every(1));
>>>>>>
>>>>>> then insert two records into that.
>>>>>>
>>>>>>
>>>>>>
>>>>>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to
>>>>>> extract the table metadata.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>>>>>> register the HDFS into a new (not existing) table sales6.
>>>>>>
>>>>>> I met below errors:
>>>>>>
>>>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>>>>>> to connect database localhost:5432 testdb
>>>>>>
>>>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check...
>>>>>>
>>>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check done.
>>>>>>
>>>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check for table sales2_1_prt_1...
>>>>>>
>>>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check done for table sales2_1_prt_1.
>>>>>>
>>>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check for table sales2_1_prt_2...
>>>>>>
>>>>>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>>> check done for table sales2_1_prt_2.
>>>>>>
>>>>>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>>>>>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>>>>>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>>>>>
>>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>>>>>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>>>>>> number.
>>>>>>
>>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>>>>>> found, Hawqregister starts to rollback...
>>>>>>
>>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>>>>>> Register Rollback Finished.
>>>>>>
>>>>>>
>>>>>>
>>>>>> *However*, if I created the table like:
>>>>>>
>>>>>> create table sales3(id int, amount numeric(10,2), year integer)
>>>>>> with(appendonly=true) *distributed by* (id) partition by range(year)
>>>>>> (start(2014) end (2016) every(1));
>>>>>>
>>>>>> And the extract and register works properly.
>>>>>>
>>>>>> I have pasted the sales3.yml in below.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Please kindly help to check what is the problem and do I need to
>>>>>> specify the distributed by (column) in the Create Table DDL if I want to
>>>>>> use hawq register for one-level partitioned table?
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks!
>>>>>>
>>>>>>
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> Lu Wenbin
>>>>>>
>>>>>>
>>>>>>
>>>>>> ============================================================
>>>>>> ===============
>>>>>>
>>>>>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>>>>>
>>>>>> --inserts is preferred over -d. -d is deprecated.
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Greenplum Database database dump
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET statement_timeout = 0;
>>>>>>
>>>>>> SET client_encoding = 'UTF8';
>>>>>>
>>>>>> SET standard_conforming_strings = off;
>>>>>>
>>>>>> SET check_function_bodies = false;
>>>>>>
>>>>>> SET client_min_messages = warning;
>>>>>>
>>>>>> SET escape_string_warning = off;
>>>>>>
>>>>>> SET gp_enable_column_oriented_table = true;
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET default_with_oids = false;
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET gp_called_by_pgdump = true;
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET search_path = public, pg_catalog;
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET default_tablespace = '';
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin;
>>>>>> Tablespace:
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> CREATE TABLE sales2 (
>>>>>>
>>>>>> amount numeric(10,2),
>>>>>>
>>>>>> year integer
>>>>>>
>>>>>> )
>>>>>>
>>>>>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>>>>>
>>>>>> (
>>>>>>
>>>>>> START (2014) END (2015) EVERY (1) WITH
>>>>>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>>>>>
>>>>>> START (2015) END (2016) EVERY (1) WITH
>>>>>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>>>>>
>>>>>> );
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Greenplum Database database dump complete
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2) Sales2.yml
>>>>>>
>>>>>> AO_FileLocations:
>>>>>>
>>>>>> Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16910/1
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> PartitionBy: PARTITION BY range (year)
>>>>>>
>>>>>> Partitions:
>>>>>>
>>>>>> - Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Constraint: START (2014) END (2015) EVERY (1) WITH
>>>>>> (appendonly=true)
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 32
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16915/1
>>>>>>
>>>>>> size: 32
>>>>>>
>>>>>> tupcount: 1
>>>>>>
>>>>>> varblockcount: 1
>>>>>>
>>>>>> Name: sales2_1_prt_1
>>>>>>
>>>>>> - Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Constraint: START (2015) END (2016) EVERY (1) WITH
>>>>>> (appendonly=true)
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 32
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16921/1
>>>>>>
>>>>>> size: 32
>>>>>>
>>>>>> tupcount: 1
>>>>>>
>>>>>> varblockcount: 1
>>>>>>
>>>>>> Name: sales2_1_prt_2
>>>>>>
>>>>>> AO_Schema:
>>>>>>
>>>>>> - name: amount
>>>>>>
>>>>>> type: numeric
>>>>>>
>>>>>> - name: year
>>>>>>
>>>>>> type: int4
>>>>>>
>>>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>>>> 2.1.0.0 build
>>>>>>
>>>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>>>> 20140120 (Red
>>>>>>
>>>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>>>
>>>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>>>
>>>>>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>>>>>
>>>>>> Encoding: UTF8
>>>>>>
>>>>>> FileFormat: AO
>>>>>>
>>>>>> TableName: public.sales2
>>>>>>
>>>>>> Version: 1.0.0
>>>>>>
>>>>>>
>>>>>>
>>>>>> 3) sales3 schema
>>>>>>
>>>>>> --inserts is preferred over -d. -d is deprecated.
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Greenplum Database database dump
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET statement_timeout = 0;
>>>>>>
>>>>>> SET client_encoding = 'UTF8';
>>>>>>
>>>>>> SET standard_conforming_strings = off;
>>>>>>
>>>>>> SET check_function_bodies = false;
>>>>>>
>>>>>> SET client_min_messages = warning;
>>>>>>
>>>>>> SET escape_string_warning = off;
>>>>>>
>>>>>> SET gp_enable_column_oriented_table = true;
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET default_with_oids = false;
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET gp_called_by_pgdump = true;
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET search_path = public, pg_catalog;
>>>>>>
>>>>>>
>>>>>>
>>>>>> SET default_tablespace = '';
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin;
>>>>>> Tablespace:
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> CREATE TABLE sales3 (
>>>>>>
>>>>>> id integer,
>>>>>>
>>>>>> amount numeric(10,2),
>>>>>>
>>>>>> year integer
>>>>>>
>>>>>> )
>>>>>>
>>>>>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>>>>>
>>>>>> (
>>>>>>
>>>>>> START (2014) END (2015) EVERY (1) WITH
>>>>>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>>>>>
>>>>>> START (2015) END (2016) EVERY (1) WITH
>>>>>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>>>>>
>>>>>> );
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> -- Greenplum Database database dump complete
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> 4) sales3.yml
>>>>>>
>>>>>> AO_FileLocations:
>>>>>>
>>>>>> Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/1
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/2
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/3
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/4
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/5
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/6
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/7
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/8
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/9
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/10
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/11
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/12
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/13
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/14
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/15
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/16
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/17
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/18
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/19
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/20
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/21
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/22
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/23
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/24
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/25
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/26
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/27
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/28
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/29
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/30
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/31
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/32
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/33
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/34
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/35
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/36
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/37
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/38
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/39
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/40
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/41
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16970/42
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> PartitionBy: PARTITION BY range (year)
>>>>>>
>>>>>> Partitions:
>>>>>>
>>>>>> - Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Constraint: START (2014) END (2015) EVERY (1) WITH
>>>>>> (appendonly=true)
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/1
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/2
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/3
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/4
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/5
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/6
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/7
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/8
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/9
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/10
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/11
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/12
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/13
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/14
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/15
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/16
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/17
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/18
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/19
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/20
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/21
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/22
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/23
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/24
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/25
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/26
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/27
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/28
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/29
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/30
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 32
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/31
>>>>>>
>>>>>> size: 32
>>>>>>
>>>>>> tupcount: 1
>>>>>>
>>>>>> varblockcount: 1
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/32
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/33
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/34
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/35
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/36
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/37
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/38
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/39
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/40
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/41
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16975/42
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> Name: sales3_1_prt_1
>>>>>>
>>>>>> - Blocksize: 32768
>>>>>>
>>>>>> Checksum: false
>>>>>>
>>>>>> CompressionLevel: 0
>>>>>>
>>>>>> CompressionType: null
>>>>>>
>>>>>> Constraint: START (2015) END (2016) EVERY (1) WITH
>>>>>> (appendonly=true)
>>>>>>
>>>>>> Files:
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/1
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/2
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/3
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/4
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/5
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/6
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/7
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/8
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/9
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/10
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/11
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/12
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/13
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/14
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/15
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 32
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/16
>>>>>>
>>>>>> size: 32
>>>>>>
>>>>>> tupcount: 1
>>>>>>
>>>>>> varblockcount: 1
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/17
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/18
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/19
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/20
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/21
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/22
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/23
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/24
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/25
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/26
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/27
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/28
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/29
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/30
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/31
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/32
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/33
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/34
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/35
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/36
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/37
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/38
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/39
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/40
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/41
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> - eofuncompressed: 0
>>>>>>
>>>>>> path: /hawq_default/16385/16508/16981/42
>>>>>>
>>>>>> size: 0
>>>>>>
>>>>>> tupcount: 0
>>>>>>
>>>>>> varblockcount: 0
>>>>>>
>>>>>> Name: sales3_1_prt_2
>>>>>>
>>>>>> AO_Schema:
>>>>>>
>>>>>> - name: id
>>>>>>
>>>>>> type: int4
>>>>>>
>>>>>> - name: amount
>>>>>>
>>>>>> type: numeric
>>>>>>
>>>>>> - name: year
>>>>>>
>>>>>> type: int4
>>>>>>
>>>>>> Bucketnum: 42
>>>>>>
>>>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>>>> 2.1.0.0 build
>>>>>>
>>>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>>>> 20140120 (Red
>>>>>>
>>>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>>>
>>>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>>>
>>>>>> Distribution_Policy: DISTRIBUTED BY (id)
>>>>>>
>>>>>> Encoding: UTF8
>>>>>>
>>>>>> FileFormat: AO
>>>>>>
>>>>>> TableName: public.sales3
>>>>>>
>>>>>> Version: 1.0.0
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Supriya Biswas <su...@nielsen.com>.
I DO NOT WANT TO RECEIVE ANY MAIL.
I UN-SUBSCRIBED IT BUT, STILL RECEIVING MAIL.
** PLEASE HELP BY REMOVING ME FROM THE MAILING LIST **
*Supriyo Biswas *Architect
The Nielsen Company
Office (516) 682-6021/NETS 249-6021
Cell (516) 353-6795
www.nielsen.com
On Tue, Dec 13, 2016 at 12:42 AM, Wenbin Lu <lu...@gmail.com> wrote:
> Hi Lili,
>
> Greatly appreciates your help!!
>
> Thanks!
>
> Regards,
> Lu Wenbin
>
> On Mon, Dec 12, 2016 at 11:46 PM, Lili Ma <lm...@pivotal.io> wrote:
>
>> Hi George,
>>
>> We have fixed the bug in current HAWQ master branch. And you can use a
>> temp workaround as this: If you want to register to a randomly distributed
>> table, you can set default_hash_table_bucket_number to 6 before creating
>> the DDL.
>>
>> Any further questions, please do not hesitate to let us know!
>>
>> Thanks
>> Lili
>>
>> On Sat, Dec 10, 2016 at 12:31 PM, George Lu <lu...@gmail.com>
>> wrote:
>>
>>> Hi Lili and Hong,
>>>
>>> Thanks a lot for your help!
>>> I tried the SQL to get bucket num. The result is 42.
>>>
>>> Thanks for the code explanation also.
>>>
>>> Regards,
>>> Lu Wenbin
>>>
>>> On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com> wrote:
>>>
>>>> Hi Wenbin,
>>>>
>>>> So glad that you are using the very fresh feature inside HDB 2.1.0!
>>>> "hawqregister" supports registering a one-level partition table in this
>>>> release. You can register a hash distributed table to a hash distributed
>>>> table, a randomly distributed table to a randomly distributed table, a hash
>>>> distributed table to a hash distributed table. But you can not
>>>> register a randomly distributed table to a hash distributed table.
>>>>
>>>> For your case, the usage is exactly correct. According to your log
>>>> file, it says
>>>> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
>>>> consistent with previous bucket number." This is a pre-check in
>>>> hawqregister, making sure that the bucketnum value from yaml file is
>>>> consistent with destination table. For a randomly distributed table, this
>>>> value is meaningless and in fact this check is unnecessary. But current
>>>> implement also does the check in this case, using default values'
>>>> consistency.
>>>>
>>>> I noticed that in your extracted yaml file "sales3.yml", the
>>>> bucketnum is 42 so I guess in your environment, the default bucketnum is
>>>> 42. Please check it with following SQLs:
>>>>
>>>> postgres=# select oid from pg_class where relnamespace='2200' and
>>>> relname = 'sales2';
>>>>
>>>> postgres=# select bucketnum from gp_distribution_policy where localoid
>>>> = 'oid';
>>>>
>>>> I think the output should be 42(the default bucket number guc value).
>>>> To conclude, I think it is a bug of hawqregister code here
>>>> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
>>>> For randomly distributed table, the source bucket_num check value is set
>>>> with fixed 6. We should modify it with the value in different HAWQ
>>>> environment, or we can remove this check for registering randomly
>>>> distributed table. I will do that fix asap.
>>>> Thanks,
>>>> Hong
>>>>
>>>> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>>>>
>>>>> Dear all,
>>>>>
>>>>>
>>>>>
>>>>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on
>>>>> HDP 2.5
>>>>>
>>>>>
>>>>>
>>>>> I created a one-level partitioned table:
>>>>>
>>>>> create table sales2( amount numeric(10,2), year integer)
>>>>> with(appendonly=true) distributed randomly partition by range(year)
>>>>> (start(2014) end (2016) every(1));
>>>>>
>>>>> then insert two records into that.
>>>>>
>>>>>
>>>>>
>>>>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to
>>>>> extract the table metadata.
>>>>>
>>>>>
>>>>>
>>>>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>>>>> register the HDFS into a new (not existing) table sales6.
>>>>>
>>>>> I met below errors:
>>>>>
>>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>>>>> to connect database localhost:5432 testdb
>>>>>
>>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>> check...
>>>>>
>>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>> check done.
>>>>>
>>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>> check for table sales2_1_prt_1...
>>>>>
>>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>> check done for table sales2_1_prt_1.
>>>>>
>>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>> check for table sales2_1_prt_2...
>>>>>
>>>>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>>> check done for table sales2_1_prt_2.
>>>>>
>>>>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>>>>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>>>>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>>>>
>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>>>>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>>>>> number.
>>>>>
>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>>>>> found, Hawqregister starts to rollback...
>>>>>
>>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>>>>> Register Rollback Finished.
>>>>>
>>>>>
>>>>>
>>>>> *However*, if I created the table like:
>>>>>
>>>>> create table sales3(id int, amount numeric(10,2), year integer)
>>>>> with(appendonly=true) *distributed by* (id) partition by range(year)
>>>>> (start(2014) end (2016) every(1));
>>>>>
>>>>> And the extract and register works properly.
>>>>>
>>>>> I have pasted the sales3.yml in below.
>>>>>
>>>>>
>>>>>
>>>>> Please kindly help to check what is the problem and do I need to
>>>>> specify the distributed by (column) in the Create Table DDL if I want to
>>>>> use hawq register for one-level partitioned table?
>>>>>
>>>>>
>>>>>
>>>>> Thanks!
>>>>>
>>>>>
>>>>>
>>>>> Regards,
>>>>>
>>>>> Lu Wenbin
>>>>>
>>>>>
>>>>>
>>>>> ============================================================
>>>>> ===============
>>>>>
>>>>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>>>>
>>>>> --inserts is preferred over -d. -d is deprecated.
>>>>>
>>>>> --
>>>>>
>>>>> -- Greenplum Database database dump
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> SET statement_timeout = 0;
>>>>>
>>>>> SET client_encoding = 'UTF8';
>>>>>
>>>>> SET standard_conforming_strings = off;
>>>>>
>>>>> SET check_function_bodies = false;
>>>>>
>>>>> SET client_min_messages = warning;
>>>>>
>>>>> SET escape_string_warning = off;
>>>>>
>>>>> SET gp_enable_column_oriented_table = true;
>>>>>
>>>>>
>>>>>
>>>>> SET default_with_oids = false;
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> SET gp_called_by_pgdump = true;
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> SET search_path = public, pg_catalog;
>>>>>
>>>>>
>>>>>
>>>>> SET default_tablespace = '';
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin;
>>>>> Tablespace:
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> CREATE TABLE sales2 (
>>>>>
>>>>> amount numeric(10,2),
>>>>>
>>>>> year integer
>>>>>
>>>>> )
>>>>>
>>>>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>>>>
>>>>> (
>>>>>
>>>>> START (2014) END (2015) EVERY (1) WITH
>>>>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>>>>
>>>>> START (2015) END (2016) EVERY (1) WITH
>>>>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>>>>
>>>>> );
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> -- Greenplum Database database dump complete
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> 2) Sales2.yml
>>>>>
>>>>> AO_FileLocations:
>>>>>
>>>>> Blocksize: 32768
>>>>>
>>>>> Checksum: false
>>>>>
>>>>> CompressionLevel: 0
>>>>>
>>>>> CompressionType: null
>>>>>
>>>>> Files:
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16910/1
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> PartitionBy: PARTITION BY range (year)
>>>>>
>>>>> Partitions:
>>>>>
>>>>> - Blocksize: 32768
>>>>>
>>>>> Checksum: false
>>>>>
>>>>> CompressionLevel: 0
>>>>>
>>>>> CompressionType: null
>>>>>
>>>>> Constraint: START (2014) END (2015) EVERY (1) WITH
>>>>> (appendonly=true)
>>>>>
>>>>> Files:
>>>>>
>>>>> - eofuncompressed: 32
>>>>>
>>>>> path: /hawq_default/16385/16508/16915/1
>>>>>
>>>>> size: 32
>>>>>
>>>>> tupcount: 1
>>>>>
>>>>> varblockcount: 1
>>>>>
>>>>> Name: sales2_1_prt_1
>>>>>
>>>>> - Blocksize: 32768
>>>>>
>>>>> Checksum: false
>>>>>
>>>>> CompressionLevel: 0
>>>>>
>>>>> CompressionType: null
>>>>>
>>>>> Constraint: START (2015) END (2016) EVERY (1) WITH
>>>>> (appendonly=true)
>>>>>
>>>>> Files:
>>>>>
>>>>> - eofuncompressed: 32
>>>>>
>>>>> path: /hawq_default/16385/16508/16921/1
>>>>>
>>>>> size: 32
>>>>>
>>>>> tupcount: 1
>>>>>
>>>>> varblockcount: 1
>>>>>
>>>>> Name: sales2_1_prt_2
>>>>>
>>>>> AO_Schema:
>>>>>
>>>>> - name: amount
>>>>>
>>>>> type: numeric
>>>>>
>>>>> - name: year
>>>>>
>>>>> type: int4
>>>>>
>>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>>> 2.1.0.0 build
>>>>>
>>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>>> 20140120 (Red
>>>>>
>>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>>
>>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>>
>>>>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>>>>
>>>>> Encoding: UTF8
>>>>>
>>>>> FileFormat: AO
>>>>>
>>>>> TableName: public.sales2
>>>>>
>>>>> Version: 1.0.0
>>>>>
>>>>>
>>>>>
>>>>> 3) sales3 schema
>>>>>
>>>>> --inserts is preferred over -d. -d is deprecated.
>>>>>
>>>>> --
>>>>>
>>>>> -- Greenplum Database database dump
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> SET statement_timeout = 0;
>>>>>
>>>>> SET client_encoding = 'UTF8';
>>>>>
>>>>> SET standard_conforming_strings = off;
>>>>>
>>>>> SET check_function_bodies = false;
>>>>>
>>>>> SET client_min_messages = warning;
>>>>>
>>>>> SET escape_string_warning = off;
>>>>>
>>>>> SET gp_enable_column_oriented_table = true;
>>>>>
>>>>>
>>>>>
>>>>> SET default_with_oids = false;
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> SET gp_called_by_pgdump = true;
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> SET search_path = public, pg_catalog;
>>>>>
>>>>>
>>>>>
>>>>> SET default_tablespace = '';
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin;
>>>>> Tablespace:
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> CREATE TABLE sales3 (
>>>>>
>>>>> id integer,
>>>>>
>>>>> amount numeric(10,2),
>>>>>
>>>>> year integer
>>>>>
>>>>> )
>>>>>
>>>>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>>>>
>>>>> (
>>>>>
>>>>> START (2014) END (2015) EVERY (1) WITH
>>>>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>>>>
>>>>> START (2015) END (2016) EVERY (1) WITH
>>>>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>>>>
>>>>> );
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> -- Greenplum Database database dump complete
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> 4) sales3.yml
>>>>>
>>>>> AO_FileLocations:
>>>>>
>>>>> Blocksize: 32768
>>>>>
>>>>> Checksum: false
>>>>>
>>>>> CompressionLevel: 0
>>>>>
>>>>> CompressionType: null
>>>>>
>>>>> Files:
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/1
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/2
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/3
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/4
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/5
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/6
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/7
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/8
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/9
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/10
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/11
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/12
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/13
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/14
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/15
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/16
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/17
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/18
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/19
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/20
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/21
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/22
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/23
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/24
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/25
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/26
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/27
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/28
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/29
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/30
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/31
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/32
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/33
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/34
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/35
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/36
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/37
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/38
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/39
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/40
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/41
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16970/42
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> PartitionBy: PARTITION BY range (year)
>>>>>
>>>>> Partitions:
>>>>>
>>>>> - Blocksize: 32768
>>>>>
>>>>> Checksum: false
>>>>>
>>>>> CompressionLevel: 0
>>>>>
>>>>> CompressionType: null
>>>>>
>>>>> Constraint: START (2014) END (2015) EVERY (1) WITH
>>>>> (appendonly=true)
>>>>>
>>>>> Files:
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/1
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/2
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/3
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/4
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/5
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/6
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/7
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/8
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/9
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/10
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/11
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/12
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/13
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/14
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/15
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/16
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/17
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/18
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/19
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/20
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/21
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/22
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/23
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/24
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/25
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/26
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/27
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/28
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/29
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/30
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 32
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/31
>>>>>
>>>>> size: 32
>>>>>
>>>>> tupcount: 1
>>>>>
>>>>> varblockcount: 1
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/32
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/33
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/34
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/35
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/36
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/37
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/38
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/39
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/40
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/41
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16975/42
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> Name: sales3_1_prt_1
>>>>>
>>>>> - Blocksize: 32768
>>>>>
>>>>> Checksum: false
>>>>>
>>>>> CompressionLevel: 0
>>>>>
>>>>> CompressionType: null
>>>>>
>>>>> Constraint: START (2015) END (2016) EVERY (1) WITH
>>>>> (appendonly=true)
>>>>>
>>>>> Files:
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/1
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/2
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/3
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/4
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/5
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/6
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/7
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/8
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/9
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/10
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/11
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/12
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/13
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/14
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/15
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 32
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/16
>>>>>
>>>>> size: 32
>>>>>
>>>>> tupcount: 1
>>>>>
>>>>> varblockcount: 1
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/17
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/18
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/19
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/20
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/21
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/22
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/23
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/24
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/25
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/26
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/27
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/28
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/29
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/30
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/31
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/32
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/33
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/34
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/35
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/36
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/37
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/38
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/39
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/40
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/41
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> - eofuncompressed: 0
>>>>>
>>>>> path: /hawq_default/16385/16508/16981/42
>>>>>
>>>>> size: 0
>>>>>
>>>>> tupcount: 0
>>>>>
>>>>> varblockcount: 0
>>>>>
>>>>> Name: sales3_1_prt_2
>>>>>
>>>>> AO_Schema:
>>>>>
>>>>> - name: id
>>>>>
>>>>> type: int4
>>>>>
>>>>> - name: amount
>>>>>
>>>>> type: numeric
>>>>>
>>>>> - name: year
>>>>>
>>>>> type: int4
>>>>>
>>>>> Bucketnum: 42
>>>>>
>>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>>> 2.1.0.0 build
>>>>>
>>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>>> 20140120 (Red
>>>>>
>>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>>
>>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>>
>>>>> Distribution_Policy: DISTRIBUTED BY (id)
>>>>>
>>>>> Encoding: UTF8
>>>>>
>>>>> FileFormat: AO
>>>>>
>>>>> TableName: public.sales3
>>>>>
>>>>> Version: 1.0.0
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Wenbin Lu <lu...@gmail.com>.
Hi Lili,
Greatly appreciates your help!!
Thanks!
Regards,
Lu Wenbin
On Mon, Dec 12, 2016 at 11:46 PM, Lili Ma <lm...@pivotal.io> wrote:
> Hi George,
>
> We have fixed the bug in current HAWQ master branch. And you can use a
> temp workaround as this: If you want to register to a randomly distributed
> table, you can set default_hash_table_bucket_number to 6 before creating
> the DDL.
>
> Any further questions, please do not hesitate to let us know!
>
> Thanks
> Lili
>
> On Sat, Dec 10, 2016 at 12:31 PM, George Lu <lu...@gmail.com> wrote:
>
>> Hi Lili and Hong,
>>
>> Thanks a lot for your help!
>> I tried the SQL to get bucket num. The result is 42.
>>
>> Thanks for the code explanation also.
>>
>> Regards,
>> Lu Wenbin
>>
>> On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com> wrote:
>>
>>> Hi Wenbin,
>>>
>>> So glad that you are using the very fresh feature inside HDB 2.1.0!
>>> "hawqregister" supports registering a one-level partition table in this
>>> release. You can register a hash distributed table to a hash distributed
>>> table, a randomly distributed table to a randomly distributed table, a hash
>>> distributed table to a hash distributed table. But you can not register
>>> a randomly distributed table to a hash distributed table.
>>>
>>> For your case, the usage is exactly correct. According to your log file,
>>> it says
>>> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
>>> consistent with previous bucket number." This is a pre-check in
>>> hawqregister, making sure that the bucketnum value from yaml file is
>>> consistent with destination table. For a randomly distributed table, this
>>> value is meaningless and in fact this check is unnecessary. But current
>>> implement also does the check in this case, using default values'
>>> consistency.
>>>
>>> I noticed that in your extracted yaml file "sales3.yml", the
>>> bucketnum is 42 so I guess in your environment, the default bucketnum is
>>> 42. Please check it with following SQLs:
>>>
>>> postgres=# select oid from pg_class where relnamespace='2200' and
>>> relname = 'sales2';
>>>
>>> postgres=# select bucketnum from gp_distribution_policy where localoid
>>> = 'oid';
>>>
>>> I think the output should be 42(the default bucket number guc value). To
>>> conclude, I think it is a bug of hawqregister code here
>>> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
>>> For randomly distributed table, the source bucket_num check value is set
>>> with fixed 6. We should modify it with the value in different HAWQ
>>> environment, or we can remove this check for registering randomly
>>> distributed table. I will do that fix asap.
>>> Thanks,
>>> Hong
>>>
>>> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>>>
>>>> Dear all,
>>>>
>>>>
>>>>
>>>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on
>>>> HDP 2.5
>>>>
>>>>
>>>>
>>>> I created a one-level partitioned table:
>>>>
>>>> create table sales2( amount numeric(10,2), year integer)
>>>> with(appendonly=true) distributed randomly partition by range(year)
>>>> (start(2014) end (2016) every(1));
>>>>
>>>> then insert two records into that.
>>>>
>>>>
>>>>
>>>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to
>>>> extract the table metadata.
>>>>
>>>>
>>>>
>>>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>>>> register the HDFS into a new (not existing) table sales6.
>>>>
>>>> I met below errors:
>>>>
>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>>>> to connect database localhost:5432 testdb
>>>>
>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check...
>>>>
>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check done.
>>>>
>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check for table sales2_1_prt_1...
>>>>
>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check done for table sales2_1_prt_1.
>>>>
>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check for table sales2_1_prt_2...
>>>>
>>>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check done for table sales2_1_prt_2.
>>>>
>>>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>>>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>>>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>>>
>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>>>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>>>> number.
>>>>
>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>>>> found, Hawqregister starts to rollback...
>>>>
>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>>>> Register Rollback Finished.
>>>>
>>>>
>>>>
>>>> *However*, if I created the table like:
>>>>
>>>> create table sales3(id int, amount numeric(10,2), year integer)
>>>> with(appendonly=true) *distributed by* (id) partition by range(year)
>>>> (start(2014) end (2016) every(1));
>>>>
>>>> And the extract and register works properly.
>>>>
>>>> I have pasted the sales3.yml in below.
>>>>
>>>>
>>>>
>>>> Please kindly help to check what is the problem and do I need to
>>>> specify the distributed by (column) in the Create Table DDL if I want to
>>>> use hawq register for one-level partitioned table?
>>>>
>>>>
>>>>
>>>> Thanks!
>>>>
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Lu Wenbin
>>>>
>>>>
>>>>
>>>> ============================================================
>>>> ===============
>>>>
>>>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>>>
>>>> --inserts is preferred over -d. -d is deprecated.
>>>>
>>>> --
>>>>
>>>> -- Greenplum Database database dump
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> SET statement_timeout = 0;
>>>>
>>>> SET client_encoding = 'UTF8';
>>>>
>>>> SET standard_conforming_strings = off;
>>>>
>>>> SET check_function_bodies = false;
>>>>
>>>> SET client_min_messages = warning;
>>>>
>>>> SET escape_string_warning = off;
>>>>
>>>> SET gp_enable_column_oriented_table = true;
>>>>
>>>>
>>>>
>>>> SET default_with_oids = false;
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> SET gp_called_by_pgdump = true;
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> SET search_path = public, pg_catalog;
>>>>
>>>>
>>>>
>>>> SET default_tablespace = '';
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin;
>>>> Tablespace:
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> CREATE TABLE sales2 (
>>>>
>>>> amount numeric(10,2),
>>>>
>>>> year integer
>>>>
>>>> )
>>>>
>>>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>>>
>>>> (
>>>>
>>>> START (2014) END (2015) EVERY (1) WITH
>>>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>>>
>>>> START (2015) END (2016) EVERY (1) WITH
>>>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>>>
>>>> );
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Greenplum Database database dump complete
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> 2) Sales2.yml
>>>>
>>>> AO_FileLocations:
>>>>
>>>> Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16910/1
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> PartitionBy: PARTITION BY range (year)
>>>>
>>>> Partitions:
>>>>
>>>> - Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 32
>>>>
>>>> path: /hawq_default/16385/16508/16915/1
>>>>
>>>> size: 32
>>>>
>>>> tupcount: 1
>>>>
>>>> varblockcount: 1
>>>>
>>>> Name: sales2_1_prt_1
>>>>
>>>> - Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 32
>>>>
>>>> path: /hawq_default/16385/16508/16921/1
>>>>
>>>> size: 32
>>>>
>>>> tupcount: 1
>>>>
>>>> varblockcount: 1
>>>>
>>>> Name: sales2_1_prt_2
>>>>
>>>> AO_Schema:
>>>>
>>>> - name: amount
>>>>
>>>> type: numeric
>>>>
>>>> - name: year
>>>>
>>>> type: int4
>>>>
>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>> 2.1.0.0 build
>>>>
>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>> 20140120 (Red
>>>>
>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>
>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>
>>>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>>>
>>>> Encoding: UTF8
>>>>
>>>> FileFormat: AO
>>>>
>>>> TableName: public.sales2
>>>>
>>>> Version: 1.0.0
>>>>
>>>>
>>>>
>>>> 3) sales3 schema
>>>>
>>>> --inserts is preferred over -d. -d is deprecated.
>>>>
>>>> --
>>>>
>>>> -- Greenplum Database database dump
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> SET statement_timeout = 0;
>>>>
>>>> SET client_encoding = 'UTF8';
>>>>
>>>> SET standard_conforming_strings = off;
>>>>
>>>> SET check_function_bodies = false;
>>>>
>>>> SET client_min_messages = warning;
>>>>
>>>> SET escape_string_warning = off;
>>>>
>>>> SET gp_enable_column_oriented_table = true;
>>>>
>>>>
>>>>
>>>> SET default_with_oids = false;
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> SET gp_called_by_pgdump = true;
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> SET search_path = public, pg_catalog;
>>>>
>>>>
>>>>
>>>> SET default_tablespace = '';
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin;
>>>> Tablespace:
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> CREATE TABLE sales3 (
>>>>
>>>> id integer,
>>>>
>>>> amount numeric(10,2),
>>>>
>>>> year integer
>>>>
>>>> )
>>>>
>>>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>>>
>>>> (
>>>>
>>>> START (2014) END (2015) EVERY (1) WITH
>>>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>>>
>>>> START (2015) END (2016) EVERY (1) WITH
>>>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>>>
>>>> );
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Greenplum Database database dump complete
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> 4) sales3.yml
>>>>
>>>> AO_FileLocations:
>>>>
>>>> Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/1
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/2
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/3
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/4
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/5
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/6
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/7
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/8
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/9
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/10
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/11
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/12
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/13
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/14
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/15
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/16
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/17
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/18
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/19
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/20
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/21
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/22
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/23
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/24
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/25
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/26
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/27
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/28
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/29
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/30
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/31
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/32
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/33
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/34
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/35
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/36
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/37
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/38
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/39
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/40
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/41
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/42
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> PartitionBy: PARTITION BY range (year)
>>>>
>>>> Partitions:
>>>>
>>>> - Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/1
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/2
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/3
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/4
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/5
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/6
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/7
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/8
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/9
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/10
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/11
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/12
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/13
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/14
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/15
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/16
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/17
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/18
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/19
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/20
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/21
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/22
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/23
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/24
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/25
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/26
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/27
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/28
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/29
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/30
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 32
>>>>
>>>> path: /hawq_default/16385/16508/16975/31
>>>>
>>>> size: 32
>>>>
>>>> tupcount: 1
>>>>
>>>> varblockcount: 1
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/32
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/33
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/34
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/35
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/36
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/37
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/38
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/39
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/40
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/41
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/42
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> Name: sales3_1_prt_1
>>>>
>>>> - Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/1
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/2
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/3
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/4
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/5
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/6
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/7
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/8
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/9
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/10
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/11
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/12
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/13
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/14
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/15
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 32
>>>>
>>>> path: /hawq_default/16385/16508/16981/16
>>>>
>>>> size: 32
>>>>
>>>> tupcount: 1
>>>>
>>>> varblockcount: 1
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/17
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/18
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/19
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/20
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/21
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/22
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/23
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/24
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/25
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/26
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/27
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/28
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/29
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/30
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/31
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/32
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/33
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/34
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/35
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/36
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/37
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/38
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/39
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/40
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/41
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/42
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> Name: sales3_1_prt_2
>>>>
>>>> AO_Schema:
>>>>
>>>> - name: id
>>>>
>>>> type: int4
>>>>
>>>> - name: amount
>>>>
>>>> type: numeric
>>>>
>>>> - name: year
>>>>
>>>> type: int4
>>>>
>>>> Bucketnum: 42
>>>>
>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>> 2.1.0.0 build
>>>>
>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>> 20140120 (Red
>>>>
>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>
>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>
>>>> Distribution_Policy: DISTRIBUTED BY (id)
>>>>
>>>> Encoding: UTF8
>>>>
>>>> FileFormat: AO
>>>>
>>>> TableName: public.sales3
>>>>
>>>> Version: 1.0.0
>>>>
>>>>
>>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Wenbin Lu <lu...@gmail.com>.
Hi Lili,
Greatly appreciates your help!!
Thanks!
Regards,
Lu Wenbin
On Mon, Dec 12, 2016 at 11:46 PM, Lili Ma <lm...@pivotal.io> wrote:
> Hi George,
>
> We have fixed the bug in current HAWQ master branch. And you can use a
> temp workaround as this: If you want to register to a randomly distributed
> table, you can set default_hash_table_bucket_number to 6 before creating
> the DDL.
>
> Any further questions, please do not hesitate to let us know!
>
> Thanks
> Lili
>
> On Sat, Dec 10, 2016 at 12:31 PM, George Lu <lu...@gmail.com> wrote:
>
>> Hi Lili and Hong,
>>
>> Thanks a lot for your help!
>> I tried the SQL to get bucket num. The result is 42.
>>
>> Thanks for the code explanation also.
>>
>> Regards,
>> Lu Wenbin
>>
>> On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com> wrote:
>>
>>> Hi Wenbin,
>>>
>>> So glad that you are using the very fresh feature inside HDB 2.1.0!
>>> "hawqregister" supports registering a one-level partition table in this
>>> release. You can register a hash distributed table to a hash distributed
>>> table, a randomly distributed table to a randomly distributed table, a hash
>>> distributed table to a hash distributed table. But you can not register
>>> a randomly distributed table to a hash distributed table.
>>>
>>> For your case, the usage is exactly correct. According to your log file,
>>> it says
>>> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
>>> consistent with previous bucket number." This is a pre-check in
>>> hawqregister, making sure that the bucketnum value from yaml file is
>>> consistent with destination table. For a randomly distributed table, this
>>> value is meaningless and in fact this check is unnecessary. But current
>>> implement also does the check in this case, using default values'
>>> consistency.
>>>
>>> I noticed that in your extracted yaml file "sales3.yml", the
>>> bucketnum is 42 so I guess in your environment, the default bucketnum is
>>> 42. Please check it with following SQLs:
>>>
>>> postgres=# select oid from pg_class where relnamespace='2200' and
>>> relname = 'sales2';
>>>
>>> postgres=# select bucketnum from gp_distribution_policy where localoid
>>> = 'oid';
>>>
>>> I think the output should be 42(the default bucket number guc value). To
>>> conclude, I think it is a bug of hawqregister code here
>>> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
>>> For randomly distributed table, the source bucket_num check value is set
>>> with fixed 6. We should modify it with the value in different HAWQ
>>> environment, or we can remove this check for registering randomly
>>> distributed table. I will do that fix asap.
>>> Thanks,
>>> Hong
>>>
>>> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>>>
>>>> Dear all,
>>>>
>>>>
>>>>
>>>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on
>>>> HDP 2.5
>>>>
>>>>
>>>>
>>>> I created a one-level partitioned table:
>>>>
>>>> create table sales2( amount numeric(10,2), year integer)
>>>> with(appendonly=true) distributed randomly partition by range(year)
>>>> (start(2014) end (2016) every(1));
>>>>
>>>> then insert two records into that.
>>>>
>>>>
>>>>
>>>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to
>>>> extract the table metadata.
>>>>
>>>>
>>>>
>>>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>>>> register the HDFS into a new (not existing) table sales6.
>>>>
>>>> I met below errors:
>>>>
>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>>>> to connect database localhost:5432 testdb
>>>>
>>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check...
>>>>
>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check done.
>>>>
>>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check for table sales2_1_prt_1...
>>>>
>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check done for table sales2_1_prt_1.
>>>>
>>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check for table sales2_1_prt_2...
>>>>
>>>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>>> check done for table sales2_1_prt_2.
>>>>
>>>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>>>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>>>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>>>
>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>>>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>>>> number.
>>>>
>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>>>> found, Hawqregister starts to rollback...
>>>>
>>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>>>> Register Rollback Finished.
>>>>
>>>>
>>>>
>>>> *However*, if I created the table like:
>>>>
>>>> create table sales3(id int, amount numeric(10,2), year integer)
>>>> with(appendonly=true) *distributed by* (id) partition by range(year)
>>>> (start(2014) end (2016) every(1));
>>>>
>>>> And the extract and register works properly.
>>>>
>>>> I have pasted the sales3.yml in below.
>>>>
>>>>
>>>>
>>>> Please kindly help to check what is the problem and do I need to
>>>> specify the distributed by (column) in the Create Table DDL if I want to
>>>> use hawq register for one-level partitioned table?
>>>>
>>>>
>>>>
>>>> Thanks!
>>>>
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Lu Wenbin
>>>>
>>>>
>>>>
>>>> ============================================================
>>>> ===============
>>>>
>>>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>>>
>>>> --inserts is preferred over -d. -d is deprecated.
>>>>
>>>> --
>>>>
>>>> -- Greenplum Database database dump
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> SET statement_timeout = 0;
>>>>
>>>> SET client_encoding = 'UTF8';
>>>>
>>>> SET standard_conforming_strings = off;
>>>>
>>>> SET check_function_bodies = false;
>>>>
>>>> SET client_min_messages = warning;
>>>>
>>>> SET escape_string_warning = off;
>>>>
>>>> SET gp_enable_column_oriented_table = true;
>>>>
>>>>
>>>>
>>>> SET default_with_oids = false;
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> SET gp_called_by_pgdump = true;
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> SET search_path = public, pg_catalog;
>>>>
>>>>
>>>>
>>>> SET default_tablespace = '';
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin;
>>>> Tablespace:
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> CREATE TABLE sales2 (
>>>>
>>>> amount numeric(10,2),
>>>>
>>>> year integer
>>>>
>>>> )
>>>>
>>>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>>>
>>>> (
>>>>
>>>> START (2014) END (2015) EVERY (1) WITH
>>>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>>>
>>>> START (2015) END (2016) EVERY (1) WITH
>>>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>>>
>>>> );
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Greenplum Database database dump complete
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> 2) Sales2.yml
>>>>
>>>> AO_FileLocations:
>>>>
>>>> Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16910/1
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> PartitionBy: PARTITION BY range (year)
>>>>
>>>> Partitions:
>>>>
>>>> - Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 32
>>>>
>>>> path: /hawq_default/16385/16508/16915/1
>>>>
>>>> size: 32
>>>>
>>>> tupcount: 1
>>>>
>>>> varblockcount: 1
>>>>
>>>> Name: sales2_1_prt_1
>>>>
>>>> - Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 32
>>>>
>>>> path: /hawq_default/16385/16508/16921/1
>>>>
>>>> size: 32
>>>>
>>>> tupcount: 1
>>>>
>>>> varblockcount: 1
>>>>
>>>> Name: sales2_1_prt_2
>>>>
>>>> AO_Schema:
>>>>
>>>> - name: amount
>>>>
>>>> type: numeric
>>>>
>>>> - name: year
>>>>
>>>> type: int4
>>>>
>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>> 2.1.0.0 build
>>>>
>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>> 20140120 (Red
>>>>
>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>
>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>
>>>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>>>
>>>> Encoding: UTF8
>>>>
>>>> FileFormat: AO
>>>>
>>>> TableName: public.sales2
>>>>
>>>> Version: 1.0.0
>>>>
>>>>
>>>>
>>>> 3) sales3 schema
>>>>
>>>> --inserts is preferred over -d. -d is deprecated.
>>>>
>>>> --
>>>>
>>>> -- Greenplum Database database dump
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> SET statement_timeout = 0;
>>>>
>>>> SET client_encoding = 'UTF8';
>>>>
>>>> SET standard_conforming_strings = off;
>>>>
>>>> SET check_function_bodies = false;
>>>>
>>>> SET client_min_messages = warning;
>>>>
>>>> SET escape_string_warning = off;
>>>>
>>>> SET gp_enable_column_oriented_table = true;
>>>>
>>>>
>>>>
>>>> SET default_with_oids = false;
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> SET gp_called_by_pgdump = true;
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> SET search_path = public, pg_catalog;
>>>>
>>>>
>>>>
>>>> SET default_tablespace = '';
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin;
>>>> Tablespace:
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> CREATE TABLE sales3 (
>>>>
>>>> id integer,
>>>>
>>>> amount numeric(10,2),
>>>>
>>>> year integer
>>>>
>>>> )
>>>>
>>>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>>>
>>>> (
>>>>
>>>> START (2014) END (2015) EVERY (1) WITH
>>>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>>>
>>>> START (2015) END (2016) EVERY (1) WITH
>>>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>>>
>>>> );
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> -- Greenplum Database database dump complete
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> 4) sales3.yml
>>>>
>>>> AO_FileLocations:
>>>>
>>>> Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/1
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/2
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/3
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/4
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/5
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/6
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/7
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/8
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/9
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/10
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/11
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/12
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/13
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/14
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/15
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/16
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/17
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/18
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/19
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/20
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/21
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/22
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/23
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/24
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/25
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/26
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/27
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/28
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/29
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/30
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/31
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/32
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/33
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/34
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/35
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/36
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/37
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/38
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/39
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/40
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/41
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16970/42
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> PartitionBy: PARTITION BY range (year)
>>>>
>>>> Partitions:
>>>>
>>>> - Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/1
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/2
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/3
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/4
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/5
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/6
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/7
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/8
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/9
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/10
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/11
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/12
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/13
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/14
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/15
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/16
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/17
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/18
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/19
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/20
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/21
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/22
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/23
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/24
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/25
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/26
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/27
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/28
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/29
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/30
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 32
>>>>
>>>> path: /hawq_default/16385/16508/16975/31
>>>>
>>>> size: 32
>>>>
>>>> tupcount: 1
>>>>
>>>> varblockcount: 1
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/32
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/33
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/34
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/35
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/36
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/37
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/38
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/39
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/40
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/41
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16975/42
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> Name: sales3_1_prt_1
>>>>
>>>> - Blocksize: 32768
>>>>
>>>> Checksum: false
>>>>
>>>> CompressionLevel: 0
>>>>
>>>> CompressionType: null
>>>>
>>>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>>>
>>>> Files:
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/1
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/2
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/3
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/4
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/5
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/6
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/7
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/8
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/9
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/10
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/11
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/12
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/13
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/14
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/15
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 32
>>>>
>>>> path: /hawq_default/16385/16508/16981/16
>>>>
>>>> size: 32
>>>>
>>>> tupcount: 1
>>>>
>>>> varblockcount: 1
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/17
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/18
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/19
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/20
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/21
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/22
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/23
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/24
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/25
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/26
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/27
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/28
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/29
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/30
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/31
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/32
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/33
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/34
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/35
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/36
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/37
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/38
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/39
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/40
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/41
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> - eofuncompressed: 0
>>>>
>>>> path: /hawq_default/16385/16508/16981/42
>>>>
>>>> size: 0
>>>>
>>>> tupcount: 0
>>>>
>>>> varblockcount: 0
>>>>
>>>> Name: sales3_1_prt_2
>>>>
>>>> AO_Schema:
>>>>
>>>> - name: id
>>>>
>>>> type: int4
>>>>
>>>> - name: amount
>>>>
>>>> type: numeric
>>>>
>>>> - name: year
>>>>
>>>> type: int4
>>>>
>>>> Bucketnum: 42
>>>>
>>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>>> 2.1.0.0 build
>>>>
>>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>>> 20140120 (Red
>>>>
>>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>>
>>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>>
>>>> Distribution_Policy: DISTRIBUTED BY (id)
>>>>
>>>> Encoding: UTF8
>>>>
>>>> FileFormat: AO
>>>>
>>>> TableName: public.sales3
>>>>
>>>> Version: 1.0.0
>>>>
>>>>
>>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Lili Ma <lm...@pivotal.io>.
Hi George,
We have fixed the bug in current HAWQ master branch. And you can use a
temp workaround as this: If you want to register to a randomly distributed
table, you can set default_hash_table_bucket_number to 6 before creating
the DDL.
Any further questions, please do not hesitate to let us know!
Thanks
Lili
On Sat, Dec 10, 2016 at 12:31 PM, George Lu <lu...@gmail.com> wrote:
> Hi Lili and Hong,
>
> Thanks a lot for your help!
> I tried the SQL to get bucket num. The result is 42.
>
> Thanks for the code explanation also.
>
> Regards,
> Lu Wenbin
>
> On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com> wrote:
>
>> Hi Wenbin,
>>
>> So glad that you are using the very fresh feature inside HDB 2.1.0!
>> "hawqregister" supports registering a one-level partition table in this
>> release. You can register a hash distributed table to a hash distributed
>> table, a randomly distributed table to a randomly distributed table, a hash
>> distributed table to a hash distributed table. But you can not register
>> a randomly distributed table to a hash distributed table.
>>
>> For your case, the usage is exactly correct. According to your log file,
>> it says
>> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
>> consistent with previous bucket number." This is a pre-check in
>> hawqregister, making sure that the bucketnum value from yaml file is
>> consistent with destination table. For a randomly distributed table, this
>> value is meaningless and in fact this check is unnecessary. But current
>> implement also does the check in this case, using default values'
>> consistency.
>>
>> I noticed that in your extracted yaml file "sales3.yml", the bucketnum is
>> 42 so I guess in your environment, the default bucketnum is 42. Please
>> check it with following SQLs:
>>
>> postgres=# select oid from pg_class where relnamespace='2200' and relname
>> = 'sales2';
>>
>> postgres=# select bucketnum from gp_distribution_policy where localoid =
>> 'oid';
>>
>> I think the output should be 42(the default bucket number guc value). To
>> conclude, I think it is a bug of hawqregister code here
>> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
>> For randomly distributed table, the source bucket_num check value is set
>> with fixed 6. We should modify it with the value in different HAWQ
>> environment, or we can remove this check for registering randomly
>> distributed table. I will do that fix asap.
>> Thanks,
>> Hong
>>
>> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>>
>>> Dear all,
>>>
>>>
>>>
>>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on
>>> HDP 2.5
>>>
>>>
>>>
>>> I created a one-level partitioned table:
>>>
>>> create table sales2( amount numeric(10,2), year integer)
>>> with(appendonly=true) distributed randomly partition by range(year)
>>> (start(2014) end (2016) every(1));
>>>
>>> then insert two records into that.
>>>
>>>
>>>
>>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to
>>> extract the table metadata.
>>>
>>>
>>>
>>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>>> register the HDFS into a new (not existing) table sales6.
>>>
>>> I met below errors:
>>>
>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>>> to connect database localhost:5432 testdb
>>>
>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check...
>>>
>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check done.
>>>
>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check for table sales2_1_prt_1...
>>>
>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check done for table sales2_1_prt_1.
>>>
>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check for table sales2_1_prt_2...
>>>
>>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check done for table sales2_1_prt_2.
>>>
>>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>>
>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>>> number.
>>>
>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>>> found, Hawqregister starts to rollback...
>>>
>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>>> Register Rollback Finished.
>>>
>>>
>>>
>>> *However*, if I created the table like:
>>>
>>> create table sales3(id int, amount numeric(10,2), year integer)
>>> with(appendonly=true) *distributed by* (id) partition by range(year)
>>> (start(2014) end (2016) every(1));
>>>
>>> And the extract and register works properly.
>>>
>>> I have pasted the sales3.yml in below.
>>>
>>>
>>>
>>> Please kindly help to check what is the problem and do I need to specify
>>> the distributed by (column) in the Create Table DDL if I want to use hawq
>>> register for one-level partitioned table?
>>>
>>>
>>>
>>> Thanks!
>>>
>>>
>>>
>>> Regards,
>>>
>>> Lu Wenbin
>>>
>>>
>>>
>>> ============================================================
>>> ===============
>>>
>>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>>
>>> --inserts is preferred over -d. -d is deprecated.
>>>
>>> --
>>>
>>> -- Greenplum Database database dump
>>>
>>> --
>>>
>>>
>>>
>>> SET statement_timeout = 0;
>>>
>>> SET client_encoding = 'UTF8';
>>>
>>> SET standard_conforming_strings = off;
>>>
>>> SET check_function_bodies = false;
>>>
>>> SET client_min_messages = warning;
>>>
>>> SET escape_string_warning = off;
>>>
>>> SET gp_enable_column_oriented_table = true;
>>>
>>>
>>>
>>> SET default_with_oids = false;
>>>
>>>
>>>
>>> --
>>>
>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>
>>> --
>>>
>>>
>>>
>>> SET gp_called_by_pgdump = true;
>>>
>>>
>>>
>>>
>>>
>>> SET search_path = public, pg_catalog;
>>>
>>>
>>>
>>> SET default_tablespace = '';
>>>
>>>
>>>
>>> --
>>>
>>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>>>
>>> --
>>>
>>>
>>>
>>> CREATE TABLE sales2 (
>>>
>>> amount numeric(10,2),
>>>
>>> year integer
>>>
>>> )
>>>
>>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>>
>>> (
>>>
>>> START (2014) END (2015) EVERY (1) WITH
>>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>>
>>> START (2015) END (2016) EVERY (1) WITH
>>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>>
>>> );
>>>
>>>
>>>
>>>
>>>
>>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>>
>>>
>>>
>>> --
>>>
>>> -- Greenplum Database database dump complete
>>>
>>> --
>>>
>>>
>>>
>>> 2) Sales2.yml
>>>
>>> AO_FileLocations:
>>>
>>> Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Files:
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16910/1
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> PartitionBy: PARTITION BY range (year)
>>>
>>> Partitions:
>>>
>>> - Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>>
>>> Files:
>>>
>>> - eofuncompressed: 32
>>>
>>> path: /hawq_default/16385/16508/16915/1
>>>
>>> size: 32
>>>
>>> tupcount: 1
>>>
>>> varblockcount: 1
>>>
>>> Name: sales2_1_prt_1
>>>
>>> - Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>>
>>> Files:
>>>
>>> - eofuncompressed: 32
>>>
>>> path: /hawq_default/16385/16508/16921/1
>>>
>>> size: 32
>>>
>>> tupcount: 1
>>>
>>> varblockcount: 1
>>>
>>> Name: sales2_1_prt_2
>>>
>>> AO_Schema:
>>>
>>> - name: amount
>>>
>>> type: numeric
>>>
>>> - name: year
>>>
>>> type: int4
>>>
>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>> 2.1.0.0 build
>>>
>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>> 20140120 (Red
>>>
>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>
>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>
>>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>>
>>> Encoding: UTF8
>>>
>>> FileFormat: AO
>>>
>>> TableName: public.sales2
>>>
>>> Version: 1.0.0
>>>
>>>
>>>
>>> 3) sales3 schema
>>>
>>> --inserts is preferred over -d. -d is deprecated.
>>>
>>> --
>>>
>>> -- Greenplum Database database dump
>>>
>>> --
>>>
>>>
>>>
>>> SET statement_timeout = 0;
>>>
>>> SET client_encoding = 'UTF8';
>>>
>>> SET standard_conforming_strings = off;
>>>
>>> SET check_function_bodies = false;
>>>
>>> SET client_min_messages = warning;
>>>
>>> SET escape_string_warning = off;
>>>
>>> SET gp_enable_column_oriented_table = true;
>>>
>>>
>>>
>>> SET default_with_oids = false;
>>>
>>>
>>>
>>> --
>>>
>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>
>>> --
>>>
>>>
>>>
>>> SET gp_called_by_pgdump = true;
>>>
>>>
>>>
>>>
>>>
>>> SET search_path = public, pg_catalog;
>>>
>>>
>>>
>>> SET default_tablespace = '';
>>>
>>>
>>>
>>> --
>>>
>>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>>>
>>> --
>>>
>>>
>>>
>>> CREATE TABLE sales3 (
>>>
>>> id integer,
>>>
>>> amount numeric(10,2),
>>>
>>> year integer
>>>
>>> )
>>>
>>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>>
>>> (
>>>
>>> START (2014) END (2015) EVERY (1) WITH
>>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>>
>>> START (2015) END (2016) EVERY (1) WITH
>>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>>
>>> );
>>>
>>>
>>>
>>>
>>>
>>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>>
>>>
>>>
>>> --
>>>
>>> -- Greenplum Database database dump complete
>>>
>>> --
>>>
>>>
>>>
>>> 4) sales3.yml
>>>
>>> AO_FileLocations:
>>>
>>> Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Files:
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/1
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/2
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/3
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/4
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/5
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/6
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/7
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/8
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/9
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/10
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/11
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/12
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/13
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/14
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/15
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/16
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/17
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/18
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/19
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/20
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/21
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/22
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/23
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/24
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/25
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/26
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/27
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/28
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/29
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/30
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/31
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/32
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/33
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/34
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/35
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/36
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/37
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/38
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/39
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/40
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/41
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/42
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> PartitionBy: PARTITION BY range (year)
>>>
>>> Partitions:
>>>
>>> - Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>>
>>> Files:
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/1
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/2
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/3
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/4
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/5
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/6
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/7
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/8
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/9
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/10
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/11
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/12
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/13
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/14
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/15
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/16
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/17
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/18
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/19
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/20
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/21
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/22
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/23
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/24
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/25
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/26
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/27
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/28
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/29
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/30
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 32
>>>
>>> path: /hawq_default/16385/16508/16975/31
>>>
>>> size: 32
>>>
>>> tupcount: 1
>>>
>>> varblockcount: 1
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/32
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/33
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/34
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/35
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/36
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/37
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/38
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/39
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/40
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/41
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/42
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> Name: sales3_1_prt_1
>>>
>>> - Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>>
>>> Files:
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/1
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/2
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/3
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/4
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/5
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/6
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/7
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/8
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/9
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/10
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/11
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/12
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/13
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/14
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/15
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 32
>>>
>>> path: /hawq_default/16385/16508/16981/16
>>>
>>> size: 32
>>>
>>> tupcount: 1
>>>
>>> varblockcount: 1
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/17
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/18
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/19
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/20
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/21
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/22
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/23
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/24
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/25
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/26
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/27
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/28
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/29
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/30
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/31
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/32
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/33
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/34
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/35
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/36
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/37
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/38
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/39
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/40
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/41
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/42
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> Name: sales3_1_prt_2
>>>
>>> AO_Schema:
>>>
>>> - name: id
>>>
>>> type: int4
>>>
>>> - name: amount
>>>
>>> type: numeric
>>>
>>> - name: year
>>>
>>> type: int4
>>>
>>> Bucketnum: 42
>>>
>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>> 2.1.0.0 build
>>>
>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>> 20140120 (Red
>>>
>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>
>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>
>>> Distribution_Policy: DISTRIBUTED BY (id)
>>>
>>> Encoding: UTF8
>>>
>>> FileFormat: AO
>>>
>>> TableName: public.sales3
>>>
>>> Version: 1.0.0
>>>
>>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Lili Ma <lm...@pivotal.io>.
Hi George,
We have fixed the bug in current HAWQ master branch. And you can use a
temp workaround as this: If you want to register to a randomly distributed
table, you can set default_hash_table_bucket_number to 6 before creating
the DDL.
Any further questions, please do not hesitate to let us know!
Thanks
Lili
On Sat, Dec 10, 2016 at 12:31 PM, George Lu <lu...@gmail.com> wrote:
> Hi Lili and Hong,
>
> Thanks a lot for your help!
> I tried the SQL to get bucket num. The result is 42.
>
> Thanks for the code explanation also.
>
> Regards,
> Lu Wenbin
>
> On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com> wrote:
>
>> Hi Wenbin,
>>
>> So glad that you are using the very fresh feature inside HDB 2.1.0!
>> "hawqregister" supports registering a one-level partition table in this
>> release. You can register a hash distributed table to a hash distributed
>> table, a randomly distributed table to a randomly distributed table, a hash
>> distributed table to a hash distributed table. But you can not register
>> a randomly distributed table to a hash distributed table.
>>
>> For your case, the usage is exactly correct. According to your log file,
>> it says
>> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
>> consistent with previous bucket number." This is a pre-check in
>> hawqregister, making sure that the bucketnum value from yaml file is
>> consistent with destination table. For a randomly distributed table, this
>> value is meaningless and in fact this check is unnecessary. But current
>> implement also does the check in this case, using default values'
>> consistency.
>>
>> I noticed that in your extracted yaml file "sales3.yml", the bucketnum is
>> 42 so I guess in your environment, the default bucketnum is 42. Please
>> check it with following SQLs:
>>
>> postgres=# select oid from pg_class where relnamespace='2200' and relname
>> = 'sales2';
>>
>> postgres=# select bucketnum from gp_distribution_policy where localoid =
>> 'oid';
>>
>> I think the output should be 42(the default bucket number guc value). To
>> conclude, I think it is a bug of hawqregister code here
>> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
>> For randomly distributed table, the source bucket_num check value is set
>> with fixed 6. We should modify it with the value in different HAWQ
>> environment, or we can remove this check for registering randomly
>> distributed table. I will do that fix asap.
>> Thanks,
>> Hong
>>
>> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>>
>>> Dear all,
>>>
>>>
>>>
>>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on
>>> HDP 2.5
>>>
>>>
>>>
>>> I created a one-level partitioned table:
>>>
>>> create table sales2( amount numeric(10,2), year integer)
>>> with(appendonly=true) distributed randomly partition by range(year)
>>> (start(2014) end (2016) every(1));
>>>
>>> then insert two records into that.
>>>
>>>
>>>
>>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to
>>> extract the table metadata.
>>>
>>>
>>>
>>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>>> register the HDFS into a new (not existing) table sales6.
>>>
>>> I met below errors:
>>>
>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>>> to connect database localhost:5432 testdb
>>>
>>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check...
>>>
>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check done.
>>>
>>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check for table sales2_1_prt_1...
>>>
>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check done for table sales2_1_prt_1.
>>>
>>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check for table sales2_1_prt_2...
>>>
>>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>>> check done for table sales2_1_prt_2.
>>>
>>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>>
>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>>> number.
>>>
>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>>> found, Hawqregister starts to rollback...
>>>
>>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>>> Register Rollback Finished.
>>>
>>>
>>>
>>> *However*, if I created the table like:
>>>
>>> create table sales3(id int, amount numeric(10,2), year integer)
>>> with(appendonly=true) *distributed by* (id) partition by range(year)
>>> (start(2014) end (2016) every(1));
>>>
>>> And the extract and register works properly.
>>>
>>> I have pasted the sales3.yml in below.
>>>
>>>
>>>
>>> Please kindly help to check what is the problem and do I need to specify
>>> the distributed by (column) in the Create Table DDL if I want to use hawq
>>> register for one-level partitioned table?
>>>
>>>
>>>
>>> Thanks!
>>>
>>>
>>>
>>> Regards,
>>>
>>> Lu Wenbin
>>>
>>>
>>>
>>> ============================================================
>>> ===============
>>>
>>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>>
>>> --inserts is preferred over -d. -d is deprecated.
>>>
>>> --
>>>
>>> -- Greenplum Database database dump
>>>
>>> --
>>>
>>>
>>>
>>> SET statement_timeout = 0;
>>>
>>> SET client_encoding = 'UTF8';
>>>
>>> SET standard_conforming_strings = off;
>>>
>>> SET check_function_bodies = false;
>>>
>>> SET client_min_messages = warning;
>>>
>>> SET escape_string_warning = off;
>>>
>>> SET gp_enable_column_oriented_table = true;
>>>
>>>
>>>
>>> SET default_with_oids = false;
>>>
>>>
>>>
>>> --
>>>
>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>
>>> --
>>>
>>>
>>>
>>> SET gp_called_by_pgdump = true;
>>>
>>>
>>>
>>>
>>>
>>> SET search_path = public, pg_catalog;
>>>
>>>
>>>
>>> SET default_tablespace = '';
>>>
>>>
>>>
>>> --
>>>
>>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>>>
>>> --
>>>
>>>
>>>
>>> CREATE TABLE sales2 (
>>>
>>> amount numeric(10,2),
>>>
>>> year integer
>>>
>>> )
>>>
>>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>>
>>> (
>>>
>>> START (2014) END (2015) EVERY (1) WITH
>>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>>
>>> START (2015) END (2016) EVERY (1) WITH
>>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>>
>>> );
>>>
>>>
>>>
>>>
>>>
>>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>>
>>>
>>>
>>> --
>>>
>>> -- Greenplum Database database dump complete
>>>
>>> --
>>>
>>>
>>>
>>> 2) Sales2.yml
>>>
>>> AO_FileLocations:
>>>
>>> Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Files:
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16910/1
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> PartitionBy: PARTITION BY range (year)
>>>
>>> Partitions:
>>>
>>> - Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>>
>>> Files:
>>>
>>> - eofuncompressed: 32
>>>
>>> path: /hawq_default/16385/16508/16915/1
>>>
>>> size: 32
>>>
>>> tupcount: 1
>>>
>>> varblockcount: 1
>>>
>>> Name: sales2_1_prt_1
>>>
>>> - Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>>
>>> Files:
>>>
>>> - eofuncompressed: 32
>>>
>>> path: /hawq_default/16385/16508/16921/1
>>>
>>> size: 32
>>>
>>> tupcount: 1
>>>
>>> varblockcount: 1
>>>
>>> Name: sales2_1_prt_2
>>>
>>> AO_Schema:
>>>
>>> - name: amount
>>>
>>> type: numeric
>>>
>>> - name: year
>>>
>>> type: int4
>>>
>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>> 2.1.0.0 build
>>>
>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>> 20140120 (Red
>>>
>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>
>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>
>>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>>
>>> Encoding: UTF8
>>>
>>> FileFormat: AO
>>>
>>> TableName: public.sales2
>>>
>>> Version: 1.0.0
>>>
>>>
>>>
>>> 3) sales3 schema
>>>
>>> --inserts is preferred over -d. -d is deprecated.
>>>
>>> --
>>>
>>> -- Greenplum Database database dump
>>>
>>> --
>>>
>>>
>>>
>>> SET statement_timeout = 0;
>>>
>>> SET client_encoding = 'UTF8';
>>>
>>> SET standard_conforming_strings = off;
>>>
>>> SET check_function_bodies = false;
>>>
>>> SET client_min_messages = warning;
>>>
>>> SET escape_string_warning = off;
>>>
>>> SET gp_enable_column_oriented_table = true;
>>>
>>>
>>>
>>> SET default_with_oids = false;
>>>
>>>
>>>
>>> --
>>>
>>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>>
>>> --
>>>
>>>
>>>
>>> SET gp_called_by_pgdump = true;
>>>
>>>
>>>
>>>
>>>
>>> SET search_path = public, pg_catalog;
>>>
>>>
>>>
>>> SET default_tablespace = '';
>>>
>>>
>>>
>>> --
>>>
>>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>>>
>>> --
>>>
>>>
>>>
>>> CREATE TABLE sales3 (
>>>
>>> id integer,
>>>
>>> amount numeric(10,2),
>>>
>>> year integer
>>>
>>> )
>>>
>>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>>
>>> (
>>>
>>> START (2014) END (2015) EVERY (1) WITH
>>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>>
>>> START (2015) END (2016) EVERY (1) WITH
>>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>>
>>> );
>>>
>>>
>>>
>>>
>>>
>>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>>
>>>
>>>
>>> --
>>>
>>> -- Greenplum Database database dump complete
>>>
>>> --
>>>
>>>
>>>
>>> 4) sales3.yml
>>>
>>> AO_FileLocations:
>>>
>>> Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Files:
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/1
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/2
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/3
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/4
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/5
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/6
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/7
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/8
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/9
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/10
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/11
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/12
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/13
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/14
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/15
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/16
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/17
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/18
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/19
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/20
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/21
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/22
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/23
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/24
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/25
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/26
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/27
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/28
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/29
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/30
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/31
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/32
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/33
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/34
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/35
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/36
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/37
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/38
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/39
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/40
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/41
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16970/42
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> PartitionBy: PARTITION BY range (year)
>>>
>>> Partitions:
>>>
>>> - Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>>
>>> Files:
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/1
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/2
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/3
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/4
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/5
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/6
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/7
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/8
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/9
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/10
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/11
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/12
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/13
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/14
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/15
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/16
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/17
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/18
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/19
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/20
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/21
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/22
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/23
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/24
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/25
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/26
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/27
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/28
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/29
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/30
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 32
>>>
>>> path: /hawq_default/16385/16508/16975/31
>>>
>>> size: 32
>>>
>>> tupcount: 1
>>>
>>> varblockcount: 1
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/32
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/33
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/34
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/35
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/36
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/37
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/38
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/39
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/40
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/41
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16975/42
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> Name: sales3_1_prt_1
>>>
>>> - Blocksize: 32768
>>>
>>> Checksum: false
>>>
>>> CompressionLevel: 0
>>>
>>> CompressionType: null
>>>
>>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>>
>>> Files:
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/1
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/2
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/3
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/4
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/5
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/6
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/7
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/8
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/9
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/10
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/11
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/12
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/13
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/14
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/15
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 32
>>>
>>> path: /hawq_default/16385/16508/16981/16
>>>
>>> size: 32
>>>
>>> tupcount: 1
>>>
>>> varblockcount: 1
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/17
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/18
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/19
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/20
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/21
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/22
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/23
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/24
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/25
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/26
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/27
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/28
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/29
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/30
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/31
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/32
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/33
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/34
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/35
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/36
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/37
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/38
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/39
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/40
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/41
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> - eofuncompressed: 0
>>>
>>> path: /hawq_default/16385/16508/16981/42
>>>
>>> size: 0
>>>
>>> tupcount: 0
>>>
>>> varblockcount: 0
>>>
>>> Name: sales3_1_prt_2
>>>
>>> AO_Schema:
>>>
>>> - name: id
>>>
>>> type: int4
>>>
>>> - name: amount
>>>
>>> type: numeric
>>>
>>> - name: year
>>>
>>> type: int4
>>>
>>> Bucketnum: 42
>>>
>>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>>> 2.1.0.0 build
>>>
>>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>>> 20140120 (Red
>>>
>>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>>
>>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>>
>>> Distribution_Policy: DISTRIBUTED BY (id)
>>>
>>> Encoding: UTF8
>>>
>>> FileFormat: AO
>>>
>>> TableName: public.sales3
>>>
>>> Version: 1.0.0
>>>
>>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by George Lu <lu...@gmail.com>.
Hi Lili and Hong,
Thanks a lot for your help!
I tried the SQL to get bucket num. The result is 42.
Thanks for the code explanation also.
Regards,
Lu Wenbin
On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com> wrote:
> Hi Wenbin,
>
> So glad that you are using the very fresh feature inside HDB 2.1.0!
> "hawqregister" supports registering a one-level partition table in this
> release. You can register a hash distributed table to a hash distributed
> table, a randomly distributed table to a randomly distributed table, a hash
> distributed table to a hash distributed table. But you can not register a
> randomly distributed table to a hash distributed table.
>
> For your case, the usage is exactly correct. According to your log file,
> it says
> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
> consistent with previous bucket number." This is a pre-check in
> hawqregister, making sure that the bucketnum value from yaml file is
> consistent with destination table. For a randomly distributed table, this
> value is meaningless and in fact this check is unnecessary. But current
> implement also does the check in this case, using default values'
> consistency.
>
> I noticed that in your extracted yaml file "sales3.yml", the bucketnum is
> 42 so I guess in your environment, the default bucketnum is 42. Please
> check it with following SQLs:
>
> postgres=# select oid from pg_class where relnamespace='2200' and relname
> = 'sales2';
>
> postgres=# select bucketnum from gp_distribution_policy where localoid =
> 'oid';
>
> I think the output should be 42(the default bucket number guc value). To
> conclude, I think it is a bug of hawqregister code here
> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
> For randomly distributed table, the source bucket_num check value is set
> with fixed 6. We should modify it with the value in different HAWQ
> environment, or we can remove this check for registering randomly
> distributed table. I will do that fix asap.
> Thanks,
> Hong
>
> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>
>> Dear all,
>>
>>
>>
>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on
>> HDP 2.5
>>
>>
>>
>> I created a one-level partitioned table:
>>
>> create table sales2( amount numeric(10,2), year integer)
>> with(appendonly=true) distributed randomly partition by range(year)
>> (start(2014) end (2016) every(1));
>>
>> then insert two records into that.
>>
>>
>>
>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to extract
>> the table metadata.
>>
>>
>>
>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>> register the HDFS into a new (not existing) table sales6.
>>
>> I met below errors:
>>
>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>> to connect database localhost:5432 testdb
>>
>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check...
>>
>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check done.
>>
>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check for table sales2_1_prt_1...
>>
>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check done for table sales2_1_prt_1.
>>
>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check for table sales2_1_prt_2...
>>
>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check done for table sales2_1_prt_2.
>>
>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>
>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>> number.
>>
>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>> found, Hawqregister starts to rollback...
>>
>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>> Register Rollback Finished.
>>
>>
>>
>> *However*, if I created the table like:
>>
>> create table sales3(id int, amount numeric(10,2), year integer)
>> with(appendonly=true) *distributed by* (id) partition by range(year)
>> (start(2014) end (2016) every(1));
>>
>> And the extract and register works properly.
>>
>> I have pasted the sales3.yml in below.
>>
>>
>>
>> Please kindly help to check what is the problem and do I need to specify
>> the distributed by (column) in the Create Table DDL if I want to use hawq
>> register for one-level partitioned table?
>>
>>
>>
>> Thanks!
>>
>>
>>
>> Regards,
>>
>> Lu Wenbin
>>
>>
>>
>> ============================================================
>> ===============
>>
>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>
>> --inserts is preferred over -d. -d is deprecated.
>>
>> --
>>
>> -- Greenplum Database database dump
>>
>> --
>>
>>
>>
>> SET statement_timeout = 0;
>>
>> SET client_encoding = 'UTF8';
>>
>> SET standard_conforming_strings = off;
>>
>> SET check_function_bodies = false;
>>
>> SET client_min_messages = warning;
>>
>> SET escape_string_warning = off;
>>
>> SET gp_enable_column_oriented_table = true;
>>
>>
>>
>> SET default_with_oids = false;
>>
>>
>>
>> --
>>
>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>
>> --
>>
>>
>>
>> SET gp_called_by_pgdump = true;
>>
>>
>>
>>
>>
>> SET search_path = public, pg_catalog;
>>
>>
>>
>> SET default_tablespace = '';
>>
>>
>>
>> --
>>
>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>>
>> --
>>
>>
>>
>> CREATE TABLE sales2 (
>>
>> amount numeric(10,2),
>>
>> year integer
>>
>> )
>>
>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>
>> (
>>
>> START (2014) END (2015) EVERY (1) WITH
>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>
>> START (2015) END (2016) EVERY (1) WITH
>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>
>> );
>>
>>
>>
>>
>>
>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>
>>
>>
>> --
>>
>> -- Greenplum Database database dump complete
>>
>> --
>>
>>
>>
>> 2) Sales2.yml
>>
>> AO_FileLocations:
>>
>> Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Files:
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16910/1
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> PartitionBy: PARTITION BY range (year)
>>
>> Partitions:
>>
>> - Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>
>> Files:
>>
>> - eofuncompressed: 32
>>
>> path: /hawq_default/16385/16508/16915/1
>>
>> size: 32
>>
>> tupcount: 1
>>
>> varblockcount: 1
>>
>> Name: sales2_1_prt_1
>>
>> - Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>
>> Files:
>>
>> - eofuncompressed: 32
>>
>> path: /hawq_default/16385/16508/16921/1
>>
>> size: 32
>>
>> tupcount: 1
>>
>> varblockcount: 1
>>
>> Name: sales2_1_prt_2
>>
>> AO_Schema:
>>
>> - name: amount
>>
>> type: numeric
>>
>> - name: year
>>
>> type: int4
>>
>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>> 2.1.0.0 build
>>
>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>> 20140120 (Red
>>
>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>
>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>
>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>
>> Encoding: UTF8
>>
>> FileFormat: AO
>>
>> TableName: public.sales2
>>
>> Version: 1.0.0
>>
>>
>>
>> 3) sales3 schema
>>
>> --inserts is preferred over -d. -d is deprecated.
>>
>> --
>>
>> -- Greenplum Database database dump
>>
>> --
>>
>>
>>
>> SET statement_timeout = 0;
>>
>> SET client_encoding = 'UTF8';
>>
>> SET standard_conforming_strings = off;
>>
>> SET check_function_bodies = false;
>>
>> SET client_min_messages = warning;
>>
>> SET escape_string_warning = off;
>>
>> SET gp_enable_column_oriented_table = true;
>>
>>
>>
>> SET default_with_oids = false;
>>
>>
>>
>> --
>>
>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>
>> --
>>
>>
>>
>> SET gp_called_by_pgdump = true;
>>
>>
>>
>>
>>
>> SET search_path = public, pg_catalog;
>>
>>
>>
>> SET default_tablespace = '';
>>
>>
>>
>> --
>>
>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>>
>> --
>>
>>
>>
>> CREATE TABLE sales3 (
>>
>> id integer,
>>
>> amount numeric(10,2),
>>
>> year integer
>>
>> )
>>
>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>
>> (
>>
>> START (2014) END (2015) EVERY (1) WITH
>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>
>> START (2015) END (2016) EVERY (1) WITH
>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>
>> );
>>
>>
>>
>>
>>
>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>
>>
>>
>> --
>>
>> -- Greenplum Database database dump complete
>>
>> --
>>
>>
>>
>> 4) sales3.yml
>>
>> AO_FileLocations:
>>
>> Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Files:
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/1
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/2
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/3
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/4
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/5
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/6
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/7
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/8
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/9
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/10
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/11
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/12
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/13
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/14
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/15
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/16
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/17
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/18
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/19
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/20
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/21
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/22
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/23
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/24
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/25
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/26
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/27
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/28
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/29
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/30
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/31
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/32
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/33
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/34
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/35
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/36
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/37
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/38
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/39
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/40
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/41
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/42
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> PartitionBy: PARTITION BY range (year)
>>
>> Partitions:
>>
>> - Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>
>> Files:
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/1
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/2
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/3
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/4
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/5
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/6
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/7
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/8
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/9
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/10
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/11
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/12
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/13
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/14
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/15
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/16
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/17
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/18
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/19
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/20
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/21
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/22
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/23
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/24
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/25
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/26
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/27
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/28
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/29
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/30
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 32
>>
>> path: /hawq_default/16385/16508/16975/31
>>
>> size: 32
>>
>> tupcount: 1
>>
>> varblockcount: 1
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/32
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/33
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/34
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/35
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/36
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/37
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/38
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/39
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/40
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/41
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/42
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> Name: sales3_1_prt_1
>>
>> - Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>
>> Files:
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/1
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/2
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/3
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/4
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/5
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/6
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/7
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/8
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/9
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/10
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/11
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/12
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/13
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/14
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/15
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 32
>>
>> path: /hawq_default/16385/16508/16981/16
>>
>> size: 32
>>
>> tupcount: 1
>>
>> varblockcount: 1
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/17
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/18
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/19
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/20
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/21
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/22
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/23
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/24
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/25
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/26
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/27
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/28
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/29
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/30
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/31
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/32
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/33
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/34
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/35
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/36
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/37
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/38
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/39
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/40
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/41
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/42
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> Name: sales3_1_prt_2
>>
>> AO_Schema:
>>
>> - name: id
>>
>> type: int4
>>
>> - name: amount
>>
>> type: numeric
>>
>> - name: year
>>
>> type: int4
>>
>> Bucketnum: 42
>>
>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>> 2.1.0.0 build
>>
>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>> 20140120 (Red
>>
>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>
>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>
>> Distribution_Policy: DISTRIBUTED BY (id)
>>
>> Encoding: UTF8
>>
>> FileFormat: AO
>>
>> TableName: public.sales3
>>
>> Version: 1.0.0
>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by George Lu <lu...@gmail.com>.
Hi Lili and Hong,
Thanks a lot for your help!
I tried the SQL to get bucket num. The result is 42.
Thanks for the code explanation also.
Regards,
Lu Wenbin
On Sat, Dec 10, 2016 at 11:38 AM, Hong Wu <xu...@gmail.com> wrote:
> Hi Wenbin,
>
> So glad that you are using the very fresh feature inside HDB 2.1.0!
> "hawqregister" supports registering a one-level partition table in this
> release. You can register a hash distributed table to a hash distributed
> table, a randomly distributed table to a randomly distributed table, a hash
> distributed table to a hash distributed table. But you can not register a
> randomly distributed table to a hash distributed table.
>
> For your case, the usage is exactly correct. According to your log file,
> it says
> "gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not
> consistent with previous bucket number." This is a pre-check in
> hawqregister, making sure that the bucketnum value from yaml file is
> consistent with destination table. For a randomly distributed table, this
> value is meaningless and in fact this check is unnecessary. But current
> implement also does the check in this case, using default values'
> consistency.
>
> I noticed that in your extracted yaml file "sales3.yml", the bucketnum is
> 42 so I guess in your environment, the default bucketnum is 42. Please
> check it with following SQLs:
>
> postgres=# select oid from pg_class where relnamespace='2200' and relname
> = 'sales2';
>
> postgres=# select bucketnum from gp_distribution_policy where localoid =
> 'oid';
>
> I think the output should be 42(the default bucket number guc value). To
> conclude, I think it is a bug of hawqregister code here
> <https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
> For randomly distributed table, the source bucket_num check value is set
> with fixed 6. We should modify it with the value in different HAWQ
> environment, or we can remove this check for registering randomly
> distributed table. I will do that fix asap.
> Thanks,
> Hong
>
> 2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
>
>> Dear all,
>>
>>
>>
>> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on
>> HDP 2.5
>>
>>
>>
>> I created a one-level partitioned table:
>>
>> create table sales2( amount numeric(10,2), year integer)
>> with(appendonly=true) distributed randomly partition by range(year)
>> (start(2014) end (2016) every(1));
>>
>> then insert two records into that.
>>
>>
>>
>> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to extract
>> the table metadata.
>>
>>
>>
>> Then I use "hawq register -d testdb --config sales2.yml sales6" to
>> register the HDFS into a new (not existing) table sales6.
>>
>> I met below errors:
>>
>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
>> to connect database localhost:5432 testdb
>>
>> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check...
>>
>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check done.
>>
>> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check for table sales2_1_prt_1...
>>
>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check done for table sales2_1_prt_1.
>>
>> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check for table sales2_1_prt_2...
>>
>> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
>> check done for table sales2_1_prt_2.
>>
>> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
>> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
>> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>>
>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
>> number of public.sales6_1_prt_1 is not consistent with previous bucket
>> number.
>>
>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
>> found, Hawqregister starts to rollback...
>>
>> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
>> Register Rollback Finished.
>>
>>
>>
>> *However*, if I created the table like:
>>
>> create table sales3(id int, amount numeric(10,2), year integer)
>> with(appendonly=true) *distributed by* (id) partition by range(year)
>> (start(2014) end (2016) every(1));
>>
>> And the extract and register works properly.
>>
>> I have pasted the sales3.yml in below.
>>
>>
>>
>> Please kindly help to check what is the problem and do I need to specify
>> the distributed by (column) in the Create Table DDL if I want to use hawq
>> register for one-level partitioned table?
>>
>>
>>
>> Thanks!
>>
>>
>>
>> Regards,
>>
>> Lu Wenbin
>>
>>
>>
>> ============================================================
>> ===============
>>
>> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>>
>> --inserts is preferred over -d. -d is deprecated.
>>
>> --
>>
>> -- Greenplum Database database dump
>>
>> --
>>
>>
>>
>> SET statement_timeout = 0;
>>
>> SET client_encoding = 'UTF8';
>>
>> SET standard_conforming_strings = off;
>>
>> SET check_function_bodies = false;
>>
>> SET client_min_messages = warning;
>>
>> SET escape_string_warning = off;
>>
>> SET gp_enable_column_oriented_table = true;
>>
>>
>>
>> SET default_with_oids = false;
>>
>>
>>
>> --
>>
>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>
>> --
>>
>>
>>
>> SET gp_called_by_pgdump = true;
>>
>>
>>
>>
>>
>> SET search_path = public, pg_catalog;
>>
>>
>>
>> SET default_tablespace = '';
>>
>>
>>
>> --
>>
>> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>>
>> --
>>
>>
>>
>> CREATE TABLE sales2 (
>>
>> amount numeric(10,2),
>>
>> year integer
>>
>> )
>>
>> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>>
>> (
>>
>> START (2014) END (2015) EVERY (1) WITH
>> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>>
>> START (2015) END (2016) EVERY (1) WITH
>> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>>
>> );
>>
>>
>>
>>
>>
>> ALTER TABLE public.sales2 OWNER TO gpadmin;
>>
>>
>>
>> --
>>
>> -- Greenplum Database database dump complete
>>
>> --
>>
>>
>>
>> 2) Sales2.yml
>>
>> AO_FileLocations:
>>
>> Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Files:
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16910/1
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> PartitionBy: PARTITION BY range (year)
>>
>> Partitions:
>>
>> - Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>
>> Files:
>>
>> - eofuncompressed: 32
>>
>> path: /hawq_default/16385/16508/16915/1
>>
>> size: 32
>>
>> tupcount: 1
>>
>> varblockcount: 1
>>
>> Name: sales2_1_prt_1
>>
>> - Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>
>> Files:
>>
>> - eofuncompressed: 32
>>
>> path: /hawq_default/16385/16508/16921/1
>>
>> size: 32
>>
>> tupcount: 1
>>
>> varblockcount: 1
>>
>> Name: sales2_1_prt_2
>>
>> AO_Schema:
>>
>> - name: amount
>>
>> type: numeric
>>
>> - name: year
>>
>> type: int4
>>
>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>> 2.1.0.0 build
>>
>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>> 20140120 (Red
>>
>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>
>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>
>> Distribution_Policy: DISTRIBUTED RANDOMLY
>>
>> Encoding: UTF8
>>
>> FileFormat: AO
>>
>> TableName: public.sales2
>>
>> Version: 1.0.0
>>
>>
>>
>> 3) sales3 schema
>>
>> --inserts is preferred over -d. -d is deprecated.
>>
>> --
>>
>> -- Greenplum Database database dump
>>
>> --
>>
>>
>>
>> SET statement_timeout = 0;
>>
>> SET client_encoding = 'UTF8';
>>
>> SET standard_conforming_strings = off;
>>
>> SET check_function_bodies = false;
>>
>> SET client_min_messages = warning;
>>
>> SET escape_string_warning = off;
>>
>> SET gp_enable_column_oriented_table = true;
>>
>>
>>
>> SET default_with_oids = false;
>>
>>
>>
>> --
>>
>> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>>
>> --
>>
>>
>>
>> SET gp_called_by_pgdump = true;
>>
>>
>>
>>
>>
>> SET search_path = public, pg_catalog;
>>
>>
>>
>> SET default_tablespace = '';
>>
>>
>>
>> --
>>
>> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>>
>> --
>>
>>
>>
>> CREATE TABLE sales3 (
>>
>> id integer,
>>
>> amount numeric(10,2),
>>
>> year integer
>>
>> )
>>
>> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>>
>> (
>>
>> START (2014) END (2015) EVERY (1) WITH
>> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>>
>> START (2015) END (2016) EVERY (1) WITH
>> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>>
>> );
>>
>>
>>
>>
>>
>> ALTER TABLE public.sales3 OWNER TO gpadmin;
>>
>>
>>
>> --
>>
>> -- Greenplum Database database dump complete
>>
>> --
>>
>>
>>
>> 4) sales3.yml
>>
>> AO_FileLocations:
>>
>> Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Files:
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/1
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/2
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/3
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/4
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/5
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/6
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/7
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/8
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/9
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/10
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/11
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/12
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/13
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/14
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/15
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/16
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/17
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/18
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/19
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/20
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/21
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/22
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/23
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/24
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/25
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/26
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/27
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/28
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/29
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/30
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/31
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/32
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/33
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/34
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/35
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/36
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/37
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/38
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/39
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/40
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/41
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16970/42
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> PartitionBy: PARTITION BY range (year)
>>
>> Partitions:
>>
>> - Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>>
>> Files:
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/1
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/2
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/3
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/4
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/5
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/6
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/7
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/8
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/9
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/10
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/11
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/12
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/13
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/14
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/15
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/16
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/17
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/18
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/19
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/20
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/21
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/22
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/23
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/24
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/25
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/26
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/27
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/28
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/29
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/30
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 32
>>
>> path: /hawq_default/16385/16508/16975/31
>>
>> size: 32
>>
>> tupcount: 1
>>
>> varblockcount: 1
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/32
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/33
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/34
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/35
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/36
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/37
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/38
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/39
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/40
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/41
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16975/42
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> Name: sales3_1_prt_1
>>
>> - Blocksize: 32768
>>
>> Checksum: false
>>
>> CompressionLevel: 0
>>
>> CompressionType: null
>>
>> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>>
>> Files:
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/1
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/2
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/3
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/4
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/5
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/6
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/7
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/8
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/9
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/10
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/11
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/12
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/13
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/14
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/15
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 32
>>
>> path: /hawq_default/16385/16508/16981/16
>>
>> size: 32
>>
>> tupcount: 1
>>
>> varblockcount: 1
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/17
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/18
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/19
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/20
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/21
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/22
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/23
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/24
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/25
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/26
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/27
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/28
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/29
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/30
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/31
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/32
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/33
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/34
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/35
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/36
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/37
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/38
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/39
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/40
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/41
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> - eofuncompressed: 0
>>
>> path: /hawq_default/16385/16508/16981/42
>>
>> size: 0
>>
>> tupcount: 0
>>
>> varblockcount: 0
>>
>> Name: sales3_1_prt_2
>>
>> AO_Schema:
>>
>> - name: id
>>
>> type: int4
>>
>> - name: amount
>>
>> type: numeric
>>
>> - name: year
>>
>> type: int4
>>
>> Bucketnum: 42
>>
>> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
>> 2.1.0.0 build
>>
>> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
>> 20140120 (Red
>>
>> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>>
>> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>>
>> Distribution_Policy: DISTRIBUTED BY (id)
>>
>> Encoding: UTF8
>>
>> FileFormat: AO
>>
>> TableName: public.sales3
>>
>> Version: 1.0.0
>>
>>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Hong Wu <xu...@gmail.com>.
Hi Wenbin,
So glad that you are using the very fresh feature inside HDB 2.1.0!
"hawqregister" supports registering a one-level partition table in this
release. You can register a hash distributed table to a hash distributed
table, a randomly distributed table to a randomly distributed table, a hash
distributed table to a hash distributed table. But you can not register a
randomly distributed table to a hash distributed table.
For your case, the usage is exactly correct. According to your log file, it
says
"gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not consistent
with previous bucket number." This is a pre-check in hawqregister, making
sure that the bucketnum value from yaml file is consistent with destination
table. For a randomly distributed table, this value is meaningless and in
fact this check is unnecessary. But current implement also does the check
in this case, using default values' consistency.
I noticed that in your extracted yaml file "sales3.yml", the bucketnum is
42 so I guess in your environment, the default bucketnum is 42. Please
check it with following SQLs:
postgres=# select oid from pg_class where relnamespace='2200' and relname =
'sales2';
postgres=# select bucketnum from gp_distribution_policy where localoid =
'oid';
I think the output should be 42(the default bucket number guc value). To
conclude, I think it is a bug of hawqregister code here
<https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
For randomly distributed table, the source bucket_num check value is set
with fixed 6. We should modify it with the value in different HAWQ
environment, or we can remove this check for registering randomly
distributed table. I will do that fix asap.
Thanks,
Hong
2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
> Dear all,
>
>
>
> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on HDP
> 2.5
>
>
>
> I created a one-level partitioned table:
>
> create table sales2( amount numeric(10,2), year integer)
> with(appendonly=true) distributed randomly partition by range(year)
> (start(2014) end (2016) every(1));
>
> then insert two records into that.
>
>
>
> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to extract
> the table metadata.
>
>
>
> Then I use "hawq register -d testdb --config sales2.yml sales6" to
> register the HDFS into a new (not existing) table sales6.
>
> I met below errors:
>
> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
> to connect database localhost:5432 testdb
>
> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check...
>
> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done.
>
> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check for table sales2_1_prt_1...
>
> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done for table sales2_1_prt_1.
>
> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check for table sales2_1_prt_2...
>
> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done for table sales2_1_prt_2.
>
> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
> number of public.sales6_1_prt_1 is not consistent with previous bucket
> number.
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
> found, Hawqregister starts to rollback...
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
> Register Rollback Finished.
>
>
>
> *However*, if I created the table like:
>
> create table sales3(id int, amount numeric(10,2), year integer)
> with(appendonly=true) *distributed by* (id) partition by range(year)
> (start(2014) end (2016) every(1));
>
> And the extract and register works properly.
>
> I have pasted the sales3.yml in below.
>
>
>
> Please kindly help to check what is the problem and do I need to specify
> the distributed by (column) in the Create Table DDL if I want to use hawq
> register for one-level partitioned table?
>
>
>
> Thanks!
>
>
>
> Regards,
>
> Lu Wenbin
>
>
>
> ============================================================
> ===============
>
> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>
> --inserts is preferred over -d. -d is deprecated.
>
> --
>
> -- Greenplum Database database dump
>
> --
>
>
>
> SET statement_timeout = 0;
>
> SET client_encoding = 'UTF8';
>
> SET standard_conforming_strings = off;
>
> SET check_function_bodies = false;
>
> SET client_min_messages = warning;
>
> SET escape_string_warning = off;
>
> SET gp_enable_column_oriented_table = true;
>
>
>
> SET default_with_oids = false;
>
>
>
> --
>
> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>
> --
>
>
>
> SET gp_called_by_pgdump = true;
>
>
>
>
>
> SET search_path = public, pg_catalog;
>
>
>
> SET default_tablespace = '';
>
>
>
> --
>
> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>
> --
>
>
>
> CREATE TABLE sales2 (
>
> amount numeric(10,2),
>
> year integer
>
> )
>
> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>
> (
>
> START (2014) END (2015) EVERY (1) WITH
> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>
> START (2015) END (2016) EVERY (1) WITH
> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>
> );
>
>
>
>
>
> ALTER TABLE public.sales2 OWNER TO gpadmin;
>
>
>
> --
>
> -- Greenplum Database database dump complete
>
> --
>
>
>
> 2) Sales2.yml
>
> AO_FileLocations:
>
> Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16910/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> PartitionBy: PARTITION BY range (year)
>
> Partitions:
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16915/1
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> Name: sales2_1_prt_1
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16921/1
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> Name: sales2_1_prt_2
>
> AO_Schema:
>
> - name: amount
>
> type: numeric
>
> - name: year
>
> type: int4
>
> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
> 2.1.0.0 build
>
> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
> 20140120 (Red
>
> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>
> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>
> Distribution_Policy: DISTRIBUTED RANDOMLY
>
> Encoding: UTF8
>
> FileFormat: AO
>
> TableName: public.sales2
>
> Version: 1.0.0
>
>
>
> 3) sales3 schema
>
> --inserts is preferred over -d. -d is deprecated.
>
> --
>
> -- Greenplum Database database dump
>
> --
>
>
>
> SET statement_timeout = 0;
>
> SET client_encoding = 'UTF8';
>
> SET standard_conforming_strings = off;
>
> SET check_function_bodies = false;
>
> SET client_min_messages = warning;
>
> SET escape_string_warning = off;
>
> SET gp_enable_column_oriented_table = true;
>
>
>
> SET default_with_oids = false;
>
>
>
> --
>
> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>
> --
>
>
>
> SET gp_called_by_pgdump = true;
>
>
>
>
>
> SET search_path = public, pg_catalog;
>
>
>
> SET default_tablespace = '';
>
>
>
> --
>
> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>
> --
>
>
>
> CREATE TABLE sales3 (
>
> id integer,
>
> amount numeric(10,2),
>
> year integer
>
> )
>
> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>
> (
>
> START (2014) END (2015) EVERY (1) WITH
> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>
> START (2015) END (2016) EVERY (1) WITH
> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>
> );
>
>
>
>
>
> ALTER TABLE public.sales3 OWNER TO gpadmin;
>
>
>
> --
>
> -- Greenplum Database database dump complete
>
> --
>
>
>
> 4) sales3.yml
>
> AO_FileLocations:
>
> Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/16
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/31
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> PartitionBy: PARTITION BY range (year)
>
> Partitions:
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/16
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16975/31
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> Name: sales3_1_prt_1
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16981/16
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/31
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> Name: sales3_1_prt_2
>
> AO_Schema:
>
> - name: id
>
> type: int4
>
> - name: amount
>
> type: numeric
>
> - name: year
>
> type: int4
>
> Bucketnum: 42
>
> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
> 2.1.0.0 build
>
> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
> 20140120 (Red
>
> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>
> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>
> Distribution_Policy: DISTRIBUTED BY (id)
>
> Encoding: UTF8
>
> FileFormat: AO
>
> TableName: public.sales3
>
> Version: 1.0.0
>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Hong Wu <xu...@gmail.com>.
Hi Wenbin,
So glad that you are using the very fresh feature inside HDB 2.1.0!
"hawqregister" supports registering a one-level partition table in this
release. You can register a hash distributed table to a hash distributed
table, a randomly distributed table to a randomly distributed table, a hash
distributed table to a hash distributed table. But you can not register a
randomly distributed table to a hash distributed table.
For your case, the usage is exactly correct. According to your log file, it
says
"gpadmin-[ERROR]:-Bucket number of public.sales6_1_prt_1 is not consistent
with previous bucket number." This is a pre-check in hawqregister, making
sure that the bucketnum value from yaml file is consistent with destination
table. For a randomly distributed table, this value is meaningless and in
fact this check is unnecessary. But current implement also does the check
in this case, using default values' consistency.
I noticed that in your extracted yaml file "sales3.yml", the bucketnum is
42 so I guess in your environment, the default bucketnum is 42. Please
check it with following SQLs:
postgres=# select oid from pg_class where relnamespace='2200' and relname =
'sales2';
postgres=# select bucketnum from gp_distribution_policy where localoid =
'oid';
I think the output should be 42(the default bucket number guc value). To
conclude, I think it is a bug of hawqregister code here
<https://github.com/apache/incubator-hawq/blob/master/tools/bin/hawqregister#L530>.
For randomly distributed table, the source bucket_num check value is set
with fixed 6. We should modify it with the value in different HAWQ
environment, or we can remove this check for registering randomly
distributed table. I will do that fix asap.
Thanks,
Hong
2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
> Dear all,
>
>
>
> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on HDP
> 2.5
>
>
>
> I created a one-level partitioned table:
>
> create table sales2( amount numeric(10,2), year integer)
> with(appendonly=true) distributed randomly partition by range(year)
> (start(2014) end (2016) every(1));
>
> then insert two records into that.
>
>
>
> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to extract
> the table metadata.
>
>
>
> Then I use "hawq register -d testdb --config sales2.yml sales6" to
> register the HDFS into a new (not existing) table sales6.
>
> I met below errors:
>
> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
> to connect database localhost:5432 testdb
>
> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check...
>
> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done.
>
> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check for table sales2_1_prt_1...
>
> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done for table sales2_1_prt_1.
>
> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check for table sales2_1_prt_2...
>
> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done for table sales2_1_prt_2.
>
> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
> number of public.sales6_1_prt_1 is not consistent with previous bucket
> number.
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
> found, Hawqregister starts to rollback...
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
> Register Rollback Finished.
>
>
>
> *However*, if I created the table like:
>
> create table sales3(id int, amount numeric(10,2), year integer)
> with(appendonly=true) *distributed by* (id) partition by range(year)
> (start(2014) end (2016) every(1));
>
> And the extract and register works properly.
>
> I have pasted the sales3.yml in below.
>
>
>
> Please kindly help to check what is the problem and do I need to specify
> the distributed by (column) in the Create Table DDL if I want to use hawq
> register for one-level partitioned table?
>
>
>
> Thanks!
>
>
>
> Regards,
>
> Lu Wenbin
>
>
>
> ============================================================
> ===============
>
> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>
> --inserts is preferred over -d. -d is deprecated.
>
> --
>
> -- Greenplum Database database dump
>
> --
>
>
>
> SET statement_timeout = 0;
>
> SET client_encoding = 'UTF8';
>
> SET standard_conforming_strings = off;
>
> SET check_function_bodies = false;
>
> SET client_min_messages = warning;
>
> SET escape_string_warning = off;
>
> SET gp_enable_column_oriented_table = true;
>
>
>
> SET default_with_oids = false;
>
>
>
> --
>
> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>
> --
>
>
>
> SET gp_called_by_pgdump = true;
>
>
>
>
>
> SET search_path = public, pg_catalog;
>
>
>
> SET default_tablespace = '';
>
>
>
> --
>
> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>
> --
>
>
>
> CREATE TABLE sales2 (
>
> amount numeric(10,2),
>
> year integer
>
> )
>
> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>
> (
>
> START (2014) END (2015) EVERY (1) WITH
> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>
> START (2015) END (2016) EVERY (1) WITH
> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>
> );
>
>
>
>
>
> ALTER TABLE public.sales2 OWNER TO gpadmin;
>
>
>
> --
>
> -- Greenplum Database database dump complete
>
> --
>
>
>
> 2) Sales2.yml
>
> AO_FileLocations:
>
> Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16910/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> PartitionBy: PARTITION BY range (year)
>
> Partitions:
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16915/1
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> Name: sales2_1_prt_1
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16921/1
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> Name: sales2_1_prt_2
>
> AO_Schema:
>
> - name: amount
>
> type: numeric
>
> - name: year
>
> type: int4
>
> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
> 2.1.0.0 build
>
> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
> 20140120 (Red
>
> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>
> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>
> Distribution_Policy: DISTRIBUTED RANDOMLY
>
> Encoding: UTF8
>
> FileFormat: AO
>
> TableName: public.sales2
>
> Version: 1.0.0
>
>
>
> 3) sales3 schema
>
> --inserts is preferred over -d. -d is deprecated.
>
> --
>
> -- Greenplum Database database dump
>
> --
>
>
>
> SET statement_timeout = 0;
>
> SET client_encoding = 'UTF8';
>
> SET standard_conforming_strings = off;
>
> SET check_function_bodies = false;
>
> SET client_min_messages = warning;
>
> SET escape_string_warning = off;
>
> SET gp_enable_column_oriented_table = true;
>
>
>
> SET default_with_oids = false;
>
>
>
> --
>
> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>
> --
>
>
>
> SET gp_called_by_pgdump = true;
>
>
>
>
>
> SET search_path = public, pg_catalog;
>
>
>
> SET default_tablespace = '';
>
>
>
> --
>
> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>
> --
>
>
>
> CREATE TABLE sales3 (
>
> id integer,
>
> amount numeric(10,2),
>
> year integer
>
> )
>
> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>
> (
>
> START (2014) END (2015) EVERY (1) WITH
> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>
> START (2015) END (2016) EVERY (1) WITH
> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>
> );
>
>
>
>
>
> ALTER TABLE public.sales3 OWNER TO gpadmin;
>
>
>
> --
>
> -- Greenplum Database database dump complete
>
> --
>
>
>
> 4) sales3.yml
>
> AO_FileLocations:
>
> Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/16
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/31
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> PartitionBy: PARTITION BY range (year)
>
> Partitions:
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/16
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16975/31
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> Name: sales3_1_prt_1
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16981/16
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/31
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> Name: sales3_1_prt_2
>
> AO_Schema:
>
> - name: id
>
> type: int4
>
> - name: amount
>
> type: numeric
>
> - name: year
>
> type: int4
>
> Bucketnum: 42
>
> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
> 2.1.0.0 build
>
> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
> 20140120 (Red
>
> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>
> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>
> Distribution_Policy: DISTRIBUTED BY (id)
>
> Encoding: UTF8
>
> FileFormat: AO
>
> TableName: public.sales3
>
> Version: 1.0.0
>
>
Re: HAWQ register error if create table DDL without specifying
distributed by (column)
Posted by Lili Ma <li...@apache.org>.
Hi Wenbin,
I tried to reproduce your problem on HDB 2.1.0 in my Macbook, and found no
error.
See the steps:
1. Create table
postgres=# create table sales2( amount numeric(10,2), year integer)
with(appendonly=true) distributed randomly partition by range(year)
(start(2014) end (2016) every(1));
NOTICE: CREATE TABLE will create partition "sales2_1_prt_1" for table
"sales2"
NOTICE: CREATE TABLE will create partition "sales2_1_prt_2" for table
"sales2"
2. Insert Data
postgres=# insert into sales2 values(5.8, 2015);
INSERT 0 1
postgres=# insert into sales2 values(5.8, 2014);
INSERT 0 1
3. hawq extract
hawq extract -d postgres -o sales2.yml sales2
4. hawq register
hawq register -d postgres --config sales2.yml sales6
The output:
20161209:17:55:26:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-try to connect database
localhost:5432 postgres
20161209:17:55:26:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-Files check...
20161209:17:55:27:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-Files check done.
20161209:17:55:27:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-Files check for table
sales2_1_prt_1...
20161209:17:55:29:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-Files check done for table
sales2_1_prt_1.
20161209:17:55:29:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-Files check for table
sales2_1_prt_2...
20161209:17:55:30:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-Files check done for table
sales2_1_prt_2.
20161209:17:55:33:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-New file(s) to be
registered: ['hdfs://localhost:8020/hawq_default/16385/16387/16548/1']
20161209:17:55:38:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-New file(s) to be
registered: ['hdfs://localhost:8020/hawq_default/16385/16387/16553/1']
20161209:17:55:42:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-New file(s) to be
registered: ['hdfs://localhost:8020/hawq_default/16385/16387/16559/1']
hdfscmd: "hadoop fs -mv
hdfs://localhost:8020/hawq_default/16385/16387/16548/1
hdfs://localhost:8020/hawq_default/16385/16387/16568/1"
hdfscmd: "hadoop fs -mv
hdfs://localhost:8020/hawq_default/16385/16387/16553/1
hdfs://localhost:8020/hawq_default/16385/16387/16573/1"
hdfscmd: "hadoop fs -mv
hdfs://localhost:8020/hawq_default/16385/16387/16559/1
hdfs://localhost:8020/hawq_default/16385/16387/16579/1"
20161209:17:55:49:003248
hawqregister:malilis-MacBook-Pro:malili-[INFO]:-Hawq Register Succeed.
Could you check whether the command is the same as your input, and also
check your HDB release number?
Thanks
Lili
2016-12-09 15:34 GMT+08:00 George Lu <lu...@gmail.com>:
> Dear all,
>
>
>
> I had a problem in hawq register in HDB 2.1.0 backed by Isilon HDFS on HDP
> 2.5
>
>
>
> I created a one-level partitioned table:
>
> create table sales2( amount numeric(10,2), year integer)
> with(appendonly=true) distributed randomly partition by range(year)
> (start(2014) end (2016) every(1));
>
> then insert two records into that.
>
>
>
> After that, I use "hawq extract -d testdb -o sales2.yml sale2" to extract
> the table metadata.
>
>
>
> Then I use "hawq register -d testdb --config sales2.yml sales6" to
> register the HDFS into a new (not existing) table sales6.
>
> I met below errors:
>
> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-try
> to connect database localhost:5432 testdb
>
> 20161209:07:07:10:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check...
>
> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done.
>
> 20161209:07:07:13:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check for table sales2_1_prt_1...
>
> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done for table sales2_1_prt_1.
>
> 20161209:07:07:15:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check for table sales2_1_prt_2...
>
> 20161209:07:07:17:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Files
> check done for table sales2_1_prt_2.
>
> 20161209:07:07:22:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-New
> file(s) to be registered: ['hdfs://kevinhwx12061712.bdl0
> 2.shanghai.dev:8020/hawq_default/16385/16508/16910/1']
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[ERROR]:-Bucket
> number of public.sales6_1_prt_1 is not consistent with previous bucket
> number.
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Error
> found, Hawqregister starts to rollback...
>
> 20161209:07:07:25:081923 hawqregister:kevi41hwxworker0:gpadmin-[INFO]:-Hawq
> Register Rollback Finished.
>
>
>
> *However*, if I created the table like:
>
> create table sales3(id int, amount numeric(10,2), year integer)
> with(appendonly=true) *distributed by* (id) partition by range(year)
> (start(2014) end (2016) every(1));
>
> And the extract and register works properly.
>
> I have pasted the sales3.yml in below.
>
>
>
> Please kindly help to check what is the problem and do I need to specify
> the distributed by (column) in the Create Table DDL if I want to use hawq
> register for one-level partitioned table?
>
>
>
> Thanks!
>
>
>
> Regards,
>
> Lu Wenbin
>
>
>
> ============================================================
> ===============
>
> 1) Sales schema by pg_dump -d testdb -t sales2 --schema-only
>
> --inserts is preferred over -d. -d is deprecated.
>
> --
>
> -- Greenplum Database database dump
>
> --
>
>
>
> SET statement_timeout = 0;
>
> SET client_encoding = 'UTF8';
>
> SET standard_conforming_strings = off;
>
> SET check_function_bodies = false;
>
> SET client_min_messages = warning;
>
> SET escape_string_warning = off;
>
> SET gp_enable_column_oriented_table = true;
>
>
>
> SET default_with_oids = false;
>
>
>
> --
>
> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>
> --
>
>
>
> SET gp_called_by_pgdump = true;
>
>
>
>
>
> SET search_path = public, pg_catalog;
>
>
>
> SET default_tablespace = '';
>
>
>
> --
>
> -- Name: sales2; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>
> --
>
>
>
> CREATE TABLE sales2 (
>
> amount numeric(10,2),
>
> year integer
>
> )
>
> WITH (appendonly=true) DISTRIBUTED RANDOMLY PARTITION BY RANGE(year)
>
> (
>
> START (2014) END (2015) EVERY (1) WITH
> (tablename='sales2_1_prt_1', orientation=row , appendonly=true ),
>
> START (2015) END (2016) EVERY (1) WITH
> (tablename='sales2_1_prt_2', orientation=row , appendonly=true )
>
> );
>
>
>
>
>
> ALTER TABLE public.sales2 OWNER TO gpadmin;
>
>
>
> --
>
> -- Greenplum Database database dump complete
>
> --
>
>
>
> 2) Sales2.yml
>
> AO_FileLocations:
>
> Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16910/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> PartitionBy: PARTITION BY range (year)
>
> Partitions:
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16915/1
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> Name: sales2_1_prt_1
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16921/1
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> Name: sales2_1_prt_2
>
> AO_Schema:
>
> - name: amount
>
> type: numeric
>
> - name: year
>
> type: int4
>
> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
> 2.1.0.0 build
>
> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
> 20140120 (Red
>
> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>
> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>
> Distribution_Policy: DISTRIBUTED RANDOMLY
>
> Encoding: UTF8
>
> FileFormat: AO
>
> TableName: public.sales2
>
> Version: 1.0.0
>
>
>
> 3) sales3 schema
>
> --inserts is preferred over -d. -d is deprecated.
>
> --
>
> -- Greenplum Database database dump
>
> --
>
>
>
> SET statement_timeout = 0;
>
> SET client_encoding = 'UTF8';
>
> SET standard_conforming_strings = off;
>
> SET check_function_bodies = false;
>
> SET client_min_messages = warning;
>
> SET escape_string_warning = off;
>
> SET gp_enable_column_oriented_table = true;
>
>
>
> SET default_with_oids = false;
>
>
>
> --
>
> -- Name: GPDUMPGUC; Type: INTERNAL GUC; Schema: -; Owner:
>
> --
>
>
>
> SET gp_called_by_pgdump = true;
>
>
>
>
>
> SET search_path = public, pg_catalog;
>
>
>
> SET default_tablespace = '';
>
>
>
> --
>
> -- Name: sales3; Type: TABLE; Schema: public; Owner: gpadmin; Tablespace:
>
> --
>
>
>
> CREATE TABLE sales3 (
>
> id integer,
>
> amount numeric(10,2),
>
> year integer
>
> )
>
> WITH (appendonly=true) DISTRIBUTED BY (id) PARTITION BY RANGE(year)
>
> (
>
> START (2014) END (2015) EVERY (1) WITH
> (tablename='sales3_1_prt_1', orientation=row , appendonly=true ),
>
> START (2015) END (2016) EVERY (1) WITH
> (tablename='sales3_1_prt_2', orientation=row , appendonly=true )
>
> );
>
>
>
>
>
> ALTER TABLE public.sales3 OWNER TO gpadmin;
>
>
>
> --
>
> -- Greenplum Database database dump complete
>
> --
>
>
>
> 4) sales3.yml
>
> AO_FileLocations:
>
> Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/16
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/31
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16970/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> PartitionBy: PARTITION BY range (year)
>
> Partitions:
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2014) END (2015) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/16
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16975/31
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16975/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> Name: sales3_1_prt_1
>
> - Blocksize: 32768
>
> Checksum: false
>
> CompressionLevel: 0
>
> CompressionType: null
>
> Constraint: START (2015) END (2016) EVERY (1) WITH (appendonly=true)
>
> Files:
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/1
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/2
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/3
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/4
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/5
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/6
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/7
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/8
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/9
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/10
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/11
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/12
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/13
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/14
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/15
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 32
>
> path: /hawq_default/16385/16508/16981/16
>
> size: 32
>
> tupcount: 1
>
> varblockcount: 1
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/17
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/18
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/19
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/20
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/21
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/22
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/23
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/24
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/25
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/26
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/27
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/28
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/29
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/30
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/31
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/32
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/33
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/34
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/35
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/36
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/37
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/38
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/39
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/40
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/41
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> - eofuncompressed: 0
>
> path: /hawq_default/16385/16508/16981/42
>
> size: 0
>
> tupcount: 0
>
> varblockcount: 0
>
> Name: sales3_1_prt_2
>
> AO_Schema:
>
> - name: id
>
> type: int4
>
> - name: amount
>
> type: numeric
>
> - name: year
>
> type: int4
>
> Bucketnum: 42
>
> DBVersion: PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ
> 2.1.0.0 build
>
> 2490) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.8.2
> 20140120 (Red
>
> Hat 4.8.2-15) compiled on Nov 30 2016 03:44:46
>
> DFS_URL: hdfs://kevinhwx12061712.bdl02.shanghai.dev:8020
>
> Distribution_Policy: DISTRIBUTED BY (id)
>
> Encoding: UTF8
>
> FileFormat: AO
>
> TableName: public.sales3
>
> Version: 1.0.0
>
>