You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "MacChen01 (via GitHub)" <gi...@apache.org> on 2023/07/28 09:02:16 UTC
[GitHub] [bigtop] MacChen01 opened a new pull request, #1150: BIGTOP-3968: add support for tez
MacChen01 opened a new pull request, #1150:
URL: https://github.com/apache/bigtop/pull/1150
### Description of PR
Add support for tez component, include compile command and problem.
1. install tez-ui by bower need the root permissions in openEuler
### How was this patch tested?
build command
docker run --rm -v pwd:/home/bigtop --workdir /home/bigtop bigtop/slaves:trunk-openeuler-22.03-aarch64 bash -c '. /etc/profile.d/bigtop.sh; ./gradlew tez-pkg'
smoke test command
./docker-hadoop.sh -C config_openeuler-22.03.yaml -c 3 -s
### For code changes:
- [ ] Does the title or this PR starts with the corresponding JIRA issue id (BIGTOP-3968)
- [ ] Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] MacChen01 commented on pull request #1150: BIGTOP-3968: add support for tez
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 commented on PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#issuecomment-1667134996
The tez component is ok on openEuler using _**jenkins way**_ like the link:
This link help us: https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+CI+Setup+Guide
Close the PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] Hann0321 commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "Hann0321 (via GitHub)" <gi...@apache.org>.
Hann0321 commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1284165795
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
> The TEZ building has been verified on the other Distros (Ubuntu, Fedora, Rocky).
@guyuqi
I tried to grant 1000 uid to the specified working directory, but still get this error. The root permission is required for the openEuler system to run the bower installation command. However, the Jenkins user does not have the root permission in the openEuler system.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] MacChen01 commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1285345207
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
It smoke test successful without this modify code using **_jenkins_** way you gave us.
This link help us: https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+CI+Setup+Guide
I will close the PR.
@guyuqi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] Hann0321 commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "Hann0321 (via GitHub)" <gi...@apache.org>.
Hann0321 commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1282849453
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
@guyuqi
Hi, we need to grant the root permission to the jenkins user to run the bower installation commands in the openEuler system.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] MacChen01 commented on pull request #1150: BIGTOP-3968: add support for tez
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 commented on PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#issuecomment-1661357403
**The smoke test successful log on openEuler:**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] guyuqi commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "guyuqi (via GitHub)" <gi...@apache.org>.
guyuqi commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1283905669
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
The TEZ building has been verified on the other Distros (Ubuntu, Fedora, Rocky).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] guyuqi commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "guyuqi (via GitHub)" <gi...@apache.org>.
guyuqi commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1282863101
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
It seems you actually were building `Tez` by `root` user from the screenshot above: `/root/bigtop-fedora/build`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] MacChen01 commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1285347216
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
Thanks your help @guyuqi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] guyuqi commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "guyuqi (via GitHub)" <gi...@apache.org>.
guyuqi commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1283935611
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
jenkins uid is 1000, not 1001:
```
jenkins@e52ab97e4481:/ws$ id
uid=1000(jenkins) gid=1000(jenkins) groups=1000(jenkins)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] MacChen01 closed pull request #1150: BIGTOP-3968: add support for tez
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 closed pull request #1150: BIGTOP-3968: add support for tez
URL: https://github.com/apache/bigtop/pull/1150
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] guyuqi commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "guyuqi (via GitHub)" <gi...@apache.org>.
guyuqi commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1283904805
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
The log tells: "Since bower is a user command, there is no need to execute it with superuser permissions".
Please try to add -u jenkins in build command:
`docker run --rm -u jenkins ....`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] Hann0321 commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "Hann0321 (via GitHub)" <gi...@apache.org>.
Hann0321 commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1283898363
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
> It seems you actually were building `Tez` by root users from the screenshot above: `/root/bigtop-fedora/build`
@guyuqi
If the Jenkins user is not granted the root permission to run the Bower installation command in the openEuler system, the error will occur. the screenshot above: /root/bigtop-fedora/build is the specified working directory.
My build command is :
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] Hann0321 commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "Hann0321 (via GitHub)" <gi...@apache.org>.
Hann0321 commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1283898363
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
> It seems you actually were building `Tez` by root users from the screenshot above: `/root/bigtop-fedora/build`
@guyuqi
If the Jenkins user is not granted the root permission to run the Bower installation command in the openEuler system, the error will occur. the screenshot above: /root/bigtop-fedora/build is the specified working directory.
My build command is :
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] guyuqi commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "guyuqi (via GitHub)" <gi...@apache.org>.
guyuqi commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1282863101
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
It seems you actually were building `Tez` by root users from the screenshot above: `/root/bigtop-fedora/build`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] guyuqi commented on a diff in pull request #1150: BIGTOP-3968: add support for tez
Posted by "guyuqi (via GitHub)" <gi...@apache.org>.
guyuqi commented on code in PR #1150:
URL: https://github.com/apache/bigtop/pull/1150#discussion_r1282831359
##########
bigtop-packages/src/common/tez/do-component-build:
##########
@@ -33,4 +33,11 @@ BUILD_TEZ_OPTS="clean package \
-Phadoop28 \
-DskipTests"
+# install tez-ui by bower need the root permissions in openEuler
Review Comment:
You may have a misconception about Bower installation here.
It's not allowed to install `bower` by user: `root`.
The `--allow-root `flag allows the installation of Bower by the `root` user.
But we should build and test Bigotp components by `jenkins` user.
`--allow-root` should be false not be true here.
Could you please try to build tez by jenkins user?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org