You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudberry.apache.org by "Yohimbe227 (via GitHub)" <gi...@apache.org> on 2025/09/23 13:58:04 UTC
[D] Migrate to Apache Cloudberry [cloudberry]
GitHub user Yohimbe227 created a discussion: Migrate to Apache Cloudberry
Please advise whether it will be possible to migrate relatively painlessly from areanadata DB 6.8.1 to Apache Cloudberry.
GitHub link: https://github.com/apache/cloudberry/discussions/1371
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
@Yohimbe227 I am a bit confused ... "_in the end it worked"_ or "_I'm out of options_" ... Do you need assistance?
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14607053
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
GitHub user tuhaihe added a comment to the discussion: Migrate to Apache Cloudberry
I believe ADB 6.x is based on Greenplum Database 6.x, so for migration, you can try the tool https://github.com/cloudberry-contrib/cbcopy, which supports `GP4.x~7.x` ~> `Cloudberry`.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14492213
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
Ahhh ... Can you share the exact topology of your arenadata cluster (number of nodes, number of primaries and mirrors per node)?
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14607707
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
@Yohimbe227 Using cbcopy, I was able to perform multiple copy variants from an arenadata cluster (2 segments, 2 primaries/mirrors per segment) to a Cloudberry (main branch) of the same topology. From my perspective, there is nothing fancy I did to get my AWS VM clusters running. I am willing to get in a zoom session with you to share my config.
These are the basic commands I ran:
```
Option A: Migrate entire database
cbcopy \
--source-host=adw --source-port=5432 --source-user=cbadmin \
--dest-host=cdw --dest-port=5432 --dest-user=cbadmin \
--dbname=test_source \
--dest-dbname=test_target \
--truncate --verbose
Option B: Migrate specific schema
cbcopy \
--source-host=adw --source-port=5432 --source-user=cbadmin \
--dest-host=cdw --dest-port=5432 --dest-user=cbadmin \
--schema=test_source.test_schema \
--dest-schema=test_target.test_schema \
--truncate --verbose
Option C: Migrate specific table
cbcopy \
--source-host=adw --source-port=5432 --source-user=cbadmin \
--dest-host=cdw --dest-port=5432 --dest-user=cbadmin \
--include-table=test_source.test_schema.employees \
--dest-table=test_target.test_schema.employees \
--truncate --verbose
```
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14623175
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 edited a comment on the discussion: Migrate to Apache Cloudberry
"It worked" it's to make cluster, and "no options" to cbcopy.
Yes, i need help.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14607600
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
@Yohimbe227 Thanks for sharing those details. RED OS 8 should behave similarly to RHEL 8, so in principle Cloudberry and cbcopy should work — but you’re right that vendor changes can sometimes introduce surprises.
Since your setup is 1 master and 2 segment nodes, you should be able to start with a straightforward deployment and test the migration workflow end to end. If you run into issues building or deploying on RED OS 8, I’d be glad to help troubleshoot.
There are also other things to consider in this type of migration. Does your Arenadata cluster use any extensions or additional GP tooling (for example, PXF)? You may need to set these up in the Cloudberry environment to have a reasonable chance of providing an application/analytics environment that closely matches your original setup.
Please feel free to reach out if you’d like assistance at any stage.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14507790
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
@Yohimbe227 – I set up a very basic single-node configuration with Arenadata 5, Apache Cloudberry (main branch), and cbcopy (https://github.com/cloudberry-contrib/cbcopy). The migration worked smoothly, and there isn’t much complexity involved. You should be able to set up your own environment and validate the process fairly easily. The [cbcopy](https://github.com/cloudberry-contrib/cbcopy) README and running `cbcopy --help` provide **clear** guidance on general usage.
For reference, I used Rocky Linux 8.10, which turned out to be the simplest option for building both Arenadata and Cloudberry from source.
If you’d like a small sandbox to test this, I’d be happy to provide an environment where you can run through the steps. Please feel free to reach out if you’d like further assistance.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14507252
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
Looks straightforward enough to spin up.
Do you have a test schema or some mock data I could use to try out the cbcopy workflow?
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14612072
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 added a comment to the discussion: Migrate to Apache Cloudberry
Thank you very much for the information. It is very important to me. The situation is complicated by the fact that I have a specific RED OS 8 operating system. Yes, it is based on RHEEL, but who knows what changes have been made.
The initial configuration is 1 master node and 2 segment nodes.
I will try to deploy Cloudberry.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14507683
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
Here is a sample of the execution of the three options I tried:
```
cbadmin in 🌐 adw in arenadata/master/gpseg-1
❯ # Option A: Migrate entire database
cbadmin in 🌐 adw in arenadata/master/gpseg-1
❯ cbcopy \
∙ --source-host=adw --source-port=5432 --source-user=cbadmin \
∙ --dest-host=cdw --dest-port=5432 --dest-user=cbadmin \
∙ --dbname=test_source \
∙ --dest-dbname=test_target \
∙ --truncate --verbose
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Starting copy (timestamp=20251008011644)...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Establishing 1 source db management connection(s)...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Establishing 4 dest db management connection(s)...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Establishing 1 source db (test_source) metadata connection(s)...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Establishing 2 dest db (test_target) metadata connection(s)...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Establishing 4 dest db (test_target) data connection(s)...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Establishing 4 source db (test_source) data connection(s)...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Retrieving user tables on source database "test_source"...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Finished retrieving user tables
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Retrieving partition table on source database "test_source"...
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Finished retrieving partition tables
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Copying metadata from database "test_source" to "test_target"
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Metadata will be written to /home/cbadmin/gpAdminLogs/cbcopy_meta_20251008011644
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Gathering additional table metadata
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting column definitions
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting distribution policies
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Getting partition definitions
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Getting storage information
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving external table information
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting table type
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting access method
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting table replica identity
20251008:01:16:44 cbcopy:cbadmin:adw:067184-[INFO]:-Getting child partitions with altered schema
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Constructing table definition map
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing Session Configuration Parameters to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Writing global database metadata
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE RESOURCE QUEUE statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE RESOURCE GROUP statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE ROLE statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_authid
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing GRANT ROLE statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE TABLESPACE statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_tablespace
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing Database Configuration Parameters to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing ROLE Configuration Parameter to meadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Global database metadata backup complete
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Writing pre-data metadata
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving function information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_proc
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_class
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving protocols
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_extprotocol
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE SCHEMA statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_namespace
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE EXTENSION statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE COLLATION statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_collation
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving type information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting shell types
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting base types
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting composite types
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting composite type attributes
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting domain types
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving range types
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_type
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE TYPE statements for shell types to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE TYPE statements for enum types to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE PROCEDURAL LANGUAGE statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_language
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE FOREIGN DATA WRAPPER statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_foreign_data_wrapper
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE SERVER statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_foreign_server
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE USER MAPPING statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving Text Search Parsers
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving Text Search Parsers
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving TEXT SEARCH CONFIGURATION information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_ts_config
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving TEXT SEARCH TEMPLATE information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving TEXT SEARCH DICTIONARY information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_ts_dict
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE OPERATOR FAMILY statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_opfamily
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving OPERATOR information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_operator
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving OPERATOR CLASS information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_opclass
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving AGGREGATE information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_proc
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving CAST information
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving views
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting distribution policies
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE SEQUENCE statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Retrieving constraints
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE statements for dependent objects to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing ALTER SEQUENCE statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE CONVERSION statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_conversion
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Pre-data metadata backup complete
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Writing post-data metadata
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE INDEX statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE RULE statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE TRIGGER statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing ALTER DEFAULT PRIVILEGES statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Writing CREATE EVENT TRIGGER statements to metadata file
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Getting object type metadata from pg_event_trigger
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Post-data metadata backup complete
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Metadata file written done
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Metadata will be restored from /home/cbadmin/gpAdminLogs/cbcopy_meta_20251008011644, WithGlobal: false
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Restoring pre-data metadata
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring schemas
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 5% (1/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 15% (2/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 25% (3/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 35% (4/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 45% (5/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 50% (6/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring extensions
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring collations
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring types
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring operator families
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring sequences
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 60% (7/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 70% (8/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring dependent objects in parallel mode
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 80% (9/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring procedural languages
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring exchange partitions
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring sequence owner
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 90% (10/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring conversions
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Restoring constraints
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[DEBUG]:-Pre-data objects restored: 100% (11/11)
20251008:01:16:45 cbcopy:cbadmin:adw:067184-[INFO]:-Pre-data metadata restore complete
Pre-data objects restored: (11/11) [==========================================================] 100 %
Pre-data objects restored: (11/11) [==========================================================] 100 %
Table copied: (1/1) [==========================================================] 100 %
20251008:01:16:46 cbcopy:cbadmin:adw:067184-[INFO]:-Database test_source: successfully copied 1 tables, skipped 0 tables, failed 0 tables
20251008:01:16:46 cbcopy:cbadmin:adw:067184-[INFO]:-Restoring post-data metadata
20251008:01:16:46 cbcopy:cbadmin:adw:067184-[INFO]:-Post-data metadata restore complete
20251008:01:16:46 cbcopy:cbadmin:adw:067184-[INFO]:-file rename, MetaFile /home/cbadmin/gpAdminLogs/cbcopy_meta_20251008011644 --> /home/cbadmin/gpAdminLogs/cbcopy_meta
_20251008011644.test_source.test_target.bk, TocFile /home/cbadmin/gpAdminLogs/cbcopy_toc_20251008011644 --> /home/cbadmin/gpAdminLogs/cbcopy_toc_20251008011644.test_sou
rce.test_target.bk
20251008:01:16:46 cbcopy:cbadmin:adw:067184-[INFO]:-Total elapsed time: 1.936346732s
20251008:01:16:46 cbcopy:cbadmin:adw:067184-[DEBUG]:-Beginning cleanup
20251008:01:16:46 cbcopy:cbadmin:adw:067184-[DEBUG]:-Cleanup complete
20251008:01:16:46 cbcopy:cbadmin:adw:067184-[INFO]:-Copy completed successfully
cbadmin in 🌐 adw in arenadata/master/gpseg-1 took 2s
❯ # Option B: Migrate specific schema
cbadmin in 🌐 adw in arenadata/master/gpseg-1
❯ cbcopy \
∙ --source-host=adw --source-port=5432 --source-user=cbadmin \
∙ --dest-host=cdw --dest-port=5432 --dest-user=cbadmin \
∙ --schema=test_source.test_schema \
∙ --dest-schema=test_target.test_schema \
∙ --truncate --verbose
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Starting copy (timestamp=20251008011704)...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Establishing 1 source db management connection(s)...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Establishing 4 dest db management connection(s)...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Establishing 1 source db (test_source) metadata connection(s)...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Establishing 2 dest db (test_target) metadata connection(s)...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Establishing 4 dest db (test_target) data connection(s)...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Establishing 4 source db (test_source) data connection(s)...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Retrieving user tables on source database "test_source"...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Finished retrieving user tables
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Retrieving partition table on source database "test_source"...
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Finished retrieving partition tables
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Copying metadata from schema "test_source.test_schema" => "test_target.test_schema"
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Metadata will be written to /home/cbadmin/gpAdminLogs/cbcopy_meta_20251008011704
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Gathering additional table metadata
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting column definitions
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting distribution policies
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Getting partition definitions
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Getting storage information
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving external table information
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting table type
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting access method
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting table replica identity
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Getting child partitions with altered schema
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Constructing table definition map
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing Session Configuration Parameters to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Writing global database metadata
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE RESOURCE QUEUE statements to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE RESOURCE GROUP statements to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE ROLE statements to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_authid
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing GRANT ROLE statements to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE TABLESPACE statements to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_tablespace
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing Database Configuration Parameters to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing ROLE Configuration Parameter to meadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Global database metadata backup complete
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[INFO]:-Writing pre-data metadata
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving function information
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_proc
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_class
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving protocols
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_extprotocol
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE SCHEMA statements to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_namespace
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE EXTENSION statements to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE COLLATION statements to metadata file
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_collation
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving type information
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting shell types
20251008:01:17:04 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting base types
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting composite types
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting composite type attributes
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting domain types
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving range types
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_type
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE TYPE statements for shell types to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE TYPE statements for enum types to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving Text Search Parsers
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving Text Search Parsers
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving TEXT SEARCH CONFIGURATION information
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_ts_config
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving TEXT SEARCH TEMPLATE information
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving TEXT SEARCH DICTIONARY information
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_ts_dict
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE OPERATOR FAMILY statements to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_opfamily
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving OPERATOR information
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_operator
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving OPERATOR CLASS information
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_opclass
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving AGGREGATE information
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_proc
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving CAST information
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving views
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting distribution policies
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE SEQUENCE statements to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Retrieving constraints
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE statements for dependent objects to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing ALTER SEQUENCE statements to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE CONVERSION statements to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Getting object type metadata from pg_conversion
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[INFO]:-Pre-data metadata backup complete
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[INFO]:-Writing post-data metadata
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE INDEX statements to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE RULE statements to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing CREATE TRIGGER statements to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Writing ALTER DEFAULT PRIVILEGES statements to metadata file
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[INFO]:-Post-data metadata backup complete
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[INFO]:-Metadata file written done
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[INFO]:-Metadata will be restored from /home/cbadmin/gpAdminLogs/cbcopy_meta_20251008011704, WithGlobal: false
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[INFO]:-Restoring pre-data metadata
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring schemas
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Pre-data objects restored: 10% (1/7)
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Pre-data objects restored: 25% (2/7)
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring extensions
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring collations
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring types
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring operator families
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring sequences
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Pre-data objects restored: 40% (3/7)
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Pre-data objects restored: 55% (4/7)
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring dependent objects in parallel mode
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Pre-data objects restored: 70% (5/7)
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring procedural languages
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring exchange partitions
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring sequence owner
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Pre-data objects restored: 85% (6/7)
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring conversions
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Restoring constraints
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[DEBUG]:-Pre-data objects restored: 100% (7/7)
20251008:01:17:05 cbcopy:cbadmin:adw:067276-[INFO]:-Pre-data metadata restore complete
Pre-data objects restored: (7/7) [==========================================================] 100 %
Pre-data objects restored: (7/7) [==========================================================] 100 %
Pre-data objects restored: (7/7) [==========================================================] 100 %
Table copied: (1/1) [==========================================================] 100 %
20251008:01:17:06 cbcopy:cbadmin:adw:067276-[INFO]:-Restoring post-data metadata
20251008:01:17:06 cbcopy:cbadmin:adw:067276-[INFO]:-Post-data metadata restore complete
20251008:01:17:06 cbcopy:cbadmin:adw:067276-[INFO]:-file rename, MetaFile /home/cbadmin/gpAdminLogs/cbcopy_meta_20251008011704 --> /home/cbadmin/gpAdminLogs/cbcopy_meta
_20251008011704.test_source.test_target.bk, TocFile /home/cbadmin/gpAdminLogs/cbcopy_toc_20251008011704 --> /home/cbadmin/gpAdminLogs/cbcopy_toc_20251008011704.test_sou
rce.test_target.bk
20251008:01:17:06 cbcopy:cbadmin:adw:067276-[INFO]:-Total elapsed time: 1.85293371s
20251008:01:17:06 cbcopy:cbadmin:adw:067276-[DEBUG]:-Beginning cleanup
20251008:01:17:06 cbcopy:cbadmin:adw:067276-[DEBUG]:-Cleanup complete
20251008:01:17:06 cbcopy:cbadmin:adw:067276-[INFO]:-Copy completed successfully
cbadmin in 🌐 adw in arenadata/master/gpseg-1 took 2s
❯ # Option C: Migrate specific table
cbadmin in 🌐 adw in arenadata/master/gpseg-1
❯ cbcopy \
∙ --source-host=adw --source-port=5432 --source-user=cbadmin \
∙ --dest-host=cdw --dest-port=5432 --dest-user=cbadmin \
∙ --include-table=test_source.test_schema.employees \
∙ --dest-table=test_target.test_schema.employees \
∙ --truncate --verbose
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Starting copy (timestamp=20251008011729)...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Establishing 1 source db management connection(s)...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Establishing 4 dest db management connection(s)...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Establishing 1 source db (test_source) metadata connection(s)...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Establishing 2 dest db (test_target) metadata connection(s)...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Establishing 4 dest db (test_target) data connection(s)...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 3.0.0-devel+dev.2134.g6e0c40bc6e6 bu
ild dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 23:51:57 (with assert checking), Database Type:
Apache Cloudberry Database, Semantic Version: 3.0.0
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Establishing 4 source db (test_source) data connection(s)...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknow
n-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Oct 7 2025 03:10:59 (with assert checking), Database Type: Greenplum Database,
Semantic Version: 6.8.1
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Retrieving user tables on source database "test_source"...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Finished retrieving user tables
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Retrieving partition table on source database "test_source"...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Finished retrieving partition tables
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Retrieving user tables on destination database "test_target"...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Finished retrieving user tables
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Retrieving partition table on destination database "test_target"...
20251008:01:17:29 cbcopy:cbadmin:adw:067366-[INFO]:-Finished retrieving partition table
Table copied: (0/1) [----------------------------------------------------------] 0 %
Table copied: (1/1) [==========================================================] 100 %
20251008:01:17:30 cbcopy:cbadmin:adw:067366-[INFO]:-Database test_source: successfully copied 1 tables, skipped 0 tables, failed 0 tables
20251008:01:17:30 cbcopy:cbadmin:adw:067366-[INFO]:-Total elapsed time: 1.073848921s
20251008:01:17:30 cbcopy:cbadmin:adw:067366-[DEBUG]:-Beginning cleanup
20251008:01:17:30 cbcopy:cbadmin:adw:067366-[DEBUG]:-Cleanup complete
20251008:01:17:30 cbcopy:cbadmin:adw:067366-[INFO]:-Copy completed successfully
cbadmin in 🌐 adw in arenadata/master/gpseg-1
❯
```
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14623280
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 added a comment to the discussion: Migrate to Apache Cloudberry
Yes!
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14607600
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 edited a comment on the discussion: Migrate to Apache Cloudberry
Hi!
I launched the cluster, there were a bunch of problems, but in the end it worked.
But I can't beat cbcopy!
It got to the point where I wrote IP addresses instead of names everywhere, but I still get an error like this:
```
[gpadmin@mdw ~]$ cbcopy --with-global-metadata --source-host=10.81.1.3 --source-port=5432 --source-user=gpadmin --dest-host=10.81.200.3 --dest-port=5432 --dest-user=gpadmin --schema=adb.test --dest-schema=adb.test --truncate
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Starting copy (timestamp=20251006095931)...
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Establishing 1 source db management connection(s)...
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build 6.8.1_arenadata5-173.el7) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39), 64-bit compiled on Jun 22 2020 14:36:57, Database Type: Greenplum Database, Semantic Version: 6.8.1
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Establishing 4 dest db management connection(s)...
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 2.0.0-incubating build 1) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 13.3.1 20250418 (RED SOFT 13.3.1-3), 64-bit compiled on Sep 26 2025 10:52:13 (with assert checking), Database Type: Apache Cloudberry Database, Semantic Version: 2.0.0
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[CRITICAL]:-Dest segment "10.80.209.4" should return only one IP address: Query was:
SELECT id As content, content AS hostname
FROM cbcopy_hosts_temp_20251006095931_0
```
I suspect that the problem is that I have 2 primary and 2 mirror on each node.
I'm out of options :(
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14601752
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 added a comment to the discussion: Migrate to Apache Cloudberry
Thanks for your answers. Yesterday, I dealt with this problem again and tried the pull method instead of push, and things started moving forward. After tinkering around a bit more, I went back to push, and the multi-IP error disappeared. Perhaps I fixed something else, I can't remember exactly, but now everything is working and cbcopy is working great. However, judging by
https://github.com/cloudberry-contrib/cbcopy/commit/1e9518a7735104dcc4b18a38beca901da6708c70 , I was clearly not the only one with this problem.
I ran a few schemes and everything is OK!
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14626581
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
@Yohimbe227 If you’re able to share a copy or version details of Areanadata DB 6.8.1, I’d be happy to spin up a test environment and try out a migration using cbcopy together. That way we can validate the process step by step and confirm whether it works smoothly in your setup.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14496668
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 added a comment to the discussion: Migrate to Apache Cloudberry
https://github.com/arenadata/gpdb/releases/tag/6.8.1_arenadata5
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14496902
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
@Yohimbe227 Part 1 - Building from the source you provided:
OS: Rocky Linux 8.10 (Green Obsidian)
```
cbadmin=# select version();
version
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build dev) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-28), 64-bit compiled on Sep 24 2025 03:43:26
(1 row)
```
Clearly, this feels like the open source version of GP 6.8.1.
Part 2 - Using cbcopy, migrating from this starting point should be very straightforward. Let me setup a quick test and I'll share the process flow asap.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14497462
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
```
cbadmin in 🌐 adw in arenadata/master/gpseg-1
❯ psql -P pager=off template1 -c 'SELECT * from gp_segment_configuration'
dbid | content | role | preferred_role | mode | status | port | hostname | address | datadir
------+---------+------+----------------+------+--------+-------+----------+---------+-----------------------------------------
1 | -1 | p | p | n | u | 5432 | adw | adw | /data1/arenadata/master/gpseg-1
3 | 1 | p | p | s | u | 16001 | asdw1 | asdw1 | /data2/arenadata/primary/gpseg1
7 | 1 | m | m | s | u | 17001 | asdw2 | asdw2 | /data2/arenadata/mirror/gpseg1
2 | 0 | p | p | s | u | 16000 | asdw1 | asdw1 | /data1/arenadata/primary/gpseg0
6 | 0 | m | m | s | u | 17000 | asdw2 | asdw2 | /data1/arenadata/mirror/gpseg0
4 | 2 | p | p | s | u | 16000 | asdw2 | asdw2 | /data1/arenadata/primary/gpseg2
8 | 2 | m | m | s | u | 17000 | asdw1 | asdw1 | /data1/arenadata/mirror/gpseg2
5 | 3 | p | p | s | u | 16001 | asdw2 | asdw2 | /data2/arenadata/primary/gpseg3
9 | 3 | m | m | s | u | 17001 | asdw1 | asdw1 | /data2/arenadata/mirror/gpseg3
10 | -1 | m | m | s | u | 15432 | adw | adw | /data1/arenadata/standby_master/gpseg-1
(10 rows)
```
```
cbadmin in 🌐 cdw in cloudberry/coordinator/gpseg-1
❯ psql -P pager=off template1 -c 'SELECT * from gp_segment_configuration'
dbid | content | role | preferred_role | mode | status | port | hostname | address | datadir | warehouseid
------+---------+------+----------------+------+--------+------+----------+---------+---------------------------------------+-------------
1 | -1 | p | p | n | u | 5432 | cdw | cdw | /data1/cloudberry/coordinator/gpseg-1 | 0
2 | 0 | p | p | s | u | 6000 | csdw1 | csdw1 | /data1/cloudberry/primary/gpseg0 | 0
6 | 0 | m | m | s | u | 7000 | csdw2 | csdw2 | /data1/cloudberry/mirror/gpseg0 | 0
3 | 1 | p | p | s | u | 6001 | csdw1 | csdw1 | /data2/cloudberry/primary/gpseg1 | 0
7 | 1 | m | m | s | u | 7001 | csdw2 | csdw2 | /data2/cloudberry/mirror/gpseg1 | 0
4 | 2 | p | p | s | u | 6000 | csdw2 | csdw2 | /data1/cloudberry/primary/gpseg2 | 0
8 | 2 | m | m | s | u | 7000 | csdw1 | csdw1 | /data1/cloudberry/mirror/gpseg2 | 0
5 | 3 | p | p | s | u | 6001 | csdw2 | csdw2 | /data2/cloudberry/primary/gpseg3 | 0
9 | 3 | m | m | s | u | 7001 | csdw1 | csdw1 | /data2/cloudberry/mirror/gpseg3 | 0
(9 rows)
```
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14623294
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 added a comment to the discussion: Migrate to Apache Cloudberry
Hi!
I launched the cluster, there were a bunch of problems, but in the end it worked.
But I can't beat cbcopy!
It got to the point where I wrote IP addresses instead of names everywhere, but I still get an error like this:
```
[gpadmin@mdw ~]$ cbcopy --with-global-metadata --source-host=10.81.1.3 --source-port=5432 --source-user=gpadmin --dest-host=10.81.200.3 --dest-port=5432 --dest-user=gpadmin --schema=adb.test --dest-schema=adb.test --truncate
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Starting copy (timestamp=20251006095931)...
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Establishing 1 source db management connection(s)...
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Initialized database version - Full Version: PostgreSQL 9.4.24 (Greenplum Database 6.8.1 build 6.8.1_arenadata5-173.el7) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39), 64-bit compiled on Jun 22 2020 14:36:57, Database Type: Greenplum Database, Semantic Version: 6.8.1
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Establishing 4 dest db management connection(s)...
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[INFO]:-Initialized database version - Full Version: PostgreSQL 14.4 (Apache Cloudberry 2.0.0-incubating build 1) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 13.3.1 20250418 (RED SOFT 13.3.1-3), 64-bit compiled on Sep 26 2025 10:52:13 (with assert checking), Database Type: Apache Cloudberry Database, Semantic Version: 2.0.0
20251006:09:59:31 cbcopy:gpadmin:mdw:045523-[CRITICAL]:-Dest segment "10.80.209.4" should return only one IP address: Query was:
SELECT id As content, content AS hostname
FROM cbcopy_hosts_temp_20251006095931_0
```
I'm out of options :(
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14601752
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 added a comment to the discussion: Migrate to Apache Cloudberry
Sorry for asking a question that is not entirely relevant to the topic. But my bosses really want to know if there is a deadline for when this project will leave the incubator.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14627902
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
GitHub user edespino added a comment to the discussion: Migrate to Apache Cloudberry
@Yohimbe227 There isn’t a set date or deadline for when projects graduate from Apache Incubation — it depends on community growth, governance maturity, transparency, and alignment with ASF principles. What matters most is steady progress, open collaboration, and active participation.
We’ve completed our first release (v2.0.0) and plan to continue with several more as we build momentum toward graduation. Your questions and participation help shape the project in a positive and transparent way. Please keep asking questions, sharing feedback, and helping others — every contribution truly makes a difference!
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14629274
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [D] Migrate to Apache Cloudberry [cloudberry]
Posted by "Yohimbe227 (via GitHub)" <gi...@apache.org>.
GitHub user Yohimbe227 added a comment to the discussion: Migrate to Apache Cloudberry
1 master node, 2 segment nodes. 2 primary segments and 2 mirror segments on each segment nodes.
GitHub link: https://github.com/apache/cloudberry/discussions/1371#discussioncomment-14611726
----
This is an automatically sent email for dev@cloudberry.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@cloudberry.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org