You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudberry.apache.org by "MisterRaindrop (via GitHub)" <gi...@apache.org> on 2025/12/18 11:05:54 UTC
[PR] Add a pxf ci test [cloudberry-pxf]
MisterRaindrop opened a new pull request, #19:
URL: https://github.com/apache/cloudberry-pxf/pull/19
<!--Thank you for contributing! -->
<!--In case of an existing issue or discussions, please reference it-->
<!--Remove this section if no corresponding issue.-->
---
## Change logs
Cloudberry PXF Integration Testing Framework
This is a Docker-based integration testing framework for Cloudberry Database and PXF (Platform Extension Framework)
connector.
Key Features:
- **Unified Architecture**: Ubuntu 22.04 base images for consistent environment
- **Multi-container Setup**:
- singlecluster: Hadoop ecosystem (HDFS, YARN)
- Cloudberry Database + PXF connector
- **Automated CI/CD**: GitHub Actions pipeline with build, test, and artifact collection
Major Improvements:
- **Enhanced Workflows**: Improved GitHub Actions with better error handling and reporting
- **Test Automation**: Comprehensive test suite with detailed result reporting
- **Configuration Management**: Resolved PXF profile conflicts and configuration issues
Local Development Workflow:
First stage:
git clone cloudberry-pxf and cloudberry in the same directory. They need to be mounted to Docker.
then `cd cloudberry-pxf` and run command.
```
docker compose -f concourse/docker/pxf-cbdb-dev/ubuntu/docker-compose.yml down -v
docker compose -f concourse/docker/pxf-cbdb-dev/ubuntu/docker-compose.yml build
docker compose -f concourse/docker/pxf-cbdb-dev/ubuntu/docker-compose.yml up -d
docker exec pxf-cbdb-dev bash -lc \
"cd /home/gpadmin/workspace/cloudberry-pxf/concourse/docker/pxf-cbdb-dev/ubuntu && ./script/entrypoint.sh"
docker exec pxf-cbdb-dev bash -lc \
"cd /home/gpadmin/workspace/cloudberry-pxf/concourse/docker/pxf-cbdb-dev/ubuntu && ./script/run_tests.sh"
```
## Contributor's checklist
Here are some reminders before you submit your pull request:
* Make sure that your Pull Request has a clear title and commit message. You can take the [Git commit template](https://github.com/cloudberrydb/cloudberrydb/blob/main/.gitmessage) as a reference.
* Sign the Contributor License Agreement as prompted for your first-time contribution (*One-time setup*).
* Learn the [code contribution](https://cloudberrydb.org/contribute/code) and [doc contribution](https://cloudberrydb.org/contribute/doc) guides for better collaboration.
* List your communications in the [GitHub Issues](https://github.com/cloudberrydb/cloudberrydb-site/issues) or [Discussions](https://github.com/orgs/cloudberrydb/discussions) (if has or needed).
* Feel free to ask for the cloudberrydb team to help review and approve.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add a pxf ci test [cloudberry-pxf]
Posted by "my-ship-it (via GitHub)" <gi...@apache.org>.
my-ship-it merged PR #19:
URL: https://github.com/apache/cloudberry-pxf/pull/19
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add a pxf ci test [cloudberry-pxf]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #19:
URL: https://github.com/apache/cloudberry-pxf/pull/19#discussion_r2633361778
##########
.github/workflows/pxf-ci.yml:
##########
@@ -0,0 +1,401 @@
+name: PXF CI Pipeline
+
+on:
+ push:
+ branches: [ main ]
+ pull_request:
Review Comment:
```suggestion
pull_request:
branches: [ merge-with-upstream ]
```
##########
.github/workflows/pxf-ci.yml:
##########
@@ -0,0 +1,401 @@
+name: PXF CI Pipeline
+
+on:
+ push:
+ branches: [ main ]
Review Comment:
```suggestion
branches: [ merge-with-upstream ]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add a pxf ci test [cloudberry-pxf]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #19:
URL: https://github.com/apache/cloudberry-pxf/pull/19#issuecomment-3680583625
> Hi @MisterRaindrop! I have played with this PR. Looks really good! My minor improvements here: [ostinru#8](https://github.com/ostinru/cloudberry-pxf/pull/8) (It seems that it is not possible to create PR on top of other PR, so I don't know how to transfer my commits to this PR)
Hey @ostinru could you list the commit you want to cherry-pick to this PR? I can help do this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add a pxf ci test [cloudberry-pxf]
Posted by "MisterRaindrop (via GitHub)" <gi...@apache.org>.
MisterRaindrop commented on PR #19:
URL: https://github.com/apache/cloudberry-pxf/pull/19#issuecomment-3669749676
@Mulily0513 Hi, I've merged your code. Please review it when you have time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add a pxf ci test [cloudberry-pxf]
Posted by "ostinru (via GitHub)" <gi...@apache.org>.
ostinru commented on PR #19:
URL: https://github.com/apache/cloudberry-pxf/pull/19#issuecomment-3680376595
Hi @MisterRaindrop! I have played with this PR. Looks really good!
My minor improvements here: https://github.com/ostinru/cloudberry-pxf/pull/8 (It seems that it is not possible to create PR on top of other PR, so I don't know how to transfer my commits to this PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add a pxf ci test [cloudberry-pxf]
Posted by "ostinru (via GitHub)" <gi...@apache.org>.
ostinru commented on PR #19:
URL: https://github.com/apache/cloudberry-pxf/pull/19#issuecomment-3681225032
> > Hi @MisterRaindrop! I have played with this PR. Looks really good! My minor improvements here: [ostinru#8](https://github.com/ostinru/cloudberry-pxf/pull/8) (It seems that it is not possible to create PR on top of other PR, so I don't know how to transfer my commits to this PR)
>
> Hey @ostinru could you list the commit you want to cherry-pick to this PR? I can help do this.
>
> You mean from [0933af0](https://github.com/ostinru/cloudberry-pxf/pull/8/commits/0933af0ac6b55f518d792ee0f47a8b31fa7d2b89) to [68e5a53](https://github.com/ostinru/cloudberry-pxf/pull/8/commits/68e5a53b7818624705dbc3c78ad3d759c68d0a98)?
Thanks!
I have created new PR. Skipped on commit - firstly I should check it better before submiting to upstream (this repo).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add a pxf ci test [cloudberry-pxf]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #19:
URL: https://github.com/apache/cloudberry-pxf/pull/19#issuecomment-3680734115
Hi @ostinru you can rebase your fix based on the latest work branch. It's good to create a PR now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org