You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "MacChen01 (via GitHub)" <gi...@apache.org> on 2024/03/05 08:34:48 UTC
[PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
MacChen01 opened a new pull request, #1243:
URL: https://github.com/apache/bigtop/pull/1243
https://issues.apache.org/jira/browse/BIGTOP-4068
The bug is alluxio smoketest failed in rockylinux 9, the test cmd
./docker-hadoop.sh -d -c 3 -C config_rockylinux-9.yaml
**redhat-lsb** should be installed by dnf when alluxio somketest in rockylinux 9
- [ ] Does the title or this PR starts with the corresponding JIRA issue id (BIGTOP-4068)
- [ ] Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "uscxiexing (via GitHub)" <gi...@apache.org>.
uscxiexing commented on code in PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#discussion_r1514309363
##########
bigtop_toolchain/bin/puppetize.sh:
##########
@@ -69,7 +69,8 @@ case ${ID}-${VERSION_ID} in
puppet module install puppetlabs-stdlib --version 4.12.0
# Enabling the PowerTools and EPEL repositories via Puppet doesn't seem to work in some cases.
# As a workaround for that, enable the former here in advance of running the Puppet manifests.
- dnf config-manager --set-enabled crb
+ dnf config-manager --set-enabled crb devel
+ dnf install -y redhat-lsb initscripts
Review Comment:
Thanks for the advice. @iwasakims
And I will delete “_dnf install -y redhat-lsb initscripts_”。Only increase ”_dnf config-manager --set-enabled crb devel”。
it succeed too,hadoop can also start。


--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on code in PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#discussion_r1513763927
##########
bigtop_toolchain/bin/puppetize.sh:
##########
@@ -69,7 +69,8 @@ case ${ID}-${VERSION_ID} in
puppet module install puppetlabs-stdlib --version 4.12.0
# Enabling the PowerTools and EPEL repositories via Puppet doesn't seem to work in some cases.
# As a workaround for that, enable the former here in advance of running the Puppet manifests.
- dnf config-manager --set-enabled crb
+ dnf config-manager --set-enabled crb devel
+ dnf install -y redhat-lsb initscripts
Review Comment:
Package [dependency on initscripts](https://github.com/apache/bigtop/blob/36a3b44905e062e0b1c657dba6bc82dc84accbb4/bigtop-packages/src/rpm/alluxio/SPECS/alluxio.spec#L75) seems to be already exist. How about adding dependency on redhat-lsb too? We can not expect that the puppetize.sh is applied in all deployment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 commented on PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#issuecomment-1978218609
The successful log is:

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 commented on PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#issuecomment-1978248590
@guyuqi @iwasakims @sekikn
Please help review this code, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on code in PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#discussion_r1513762357
##########
bigtop_toolchain/bin/puppetize.sh:
##########
@@ -69,7 +69,8 @@ case ${ID}-${VERSION_ID} in
puppet module install puppetlabs-stdlib --version 4.12.0
# Enabling the PowerTools and EPEL repositories via Puppet doesn't seem to work in some cases.
# As a workaround for that, enable the former here in advance of running the Puppet manifests.
- dnf config-manager --set-enabled crb
+ dnf config-manager --set-enabled crb devel
Review Comment:
This should be done in the [Puppet manifest](https://github.com/apache/bigtop/blob/master/bigtop-deploy/puppet/modules/alluxio/manifests/init.pp)? We can not expect that the puppetize.sh is applied in all deployment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims merged PR #1243:
URL: https://github.com/apache/bigtop/pull/1243
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 commented on code in PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#discussion_r1515431400
##########
bigtop_toolchain/bin/puppetize.sh:
##########
@@ -69,7 +69,8 @@ case ${ID}-${VERSION_ID} in
puppet module install puppetlabs-stdlib --version 4.12.0
# Enabling the PowerTools and EPEL repositories via Puppet doesn't seem to work in some cases.
# As a workaround for that, enable the former here in advance of running the Puppet manifests.
- dnf config-manager --set-enabled crb
+ dnf config-manager --set-enabled crb devel
+ dnf install -y redhat-lsb initscripts
Review Comment:
Thanks @iwasakims @uscxiexing
The “dnf install -y redhat-lsb initscripts” code has deleted, it's work fine in my env.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#issuecomment-2005756076
Filed [BIGTOP-4080](https://issues.apache.org/jira/browse/BIGTOP-4080) as a follow-up.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on code in PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#discussion_r1514258713
##########
bigtop_toolchain/bin/puppetize.sh:
##########
@@ -69,7 +69,8 @@ case ${ID}-${VERSION_ID} in
puppet module install puppetlabs-stdlib --version 4.12.0
# Enabling the PowerTools and EPEL repositories via Puppet doesn't seem to work in some cases.
# As a workaround for that, enable the former here in advance of running the Puppet manifests.
- dnf config-manager --set-enabled crb
+ dnf config-manager --set-enabled crb devel
+ dnf install -y redhat-lsb initscripts
Review Comment:
> hadoop installed need /lib/lsb/init-functions in bigto/puppet:trunk-rockylinux-9 ,But it didn't.
If we need Hadoop too for running smoke-tests of Alluxio, the dependency between classes of alluxio and hadoop in the puppet manifest.
> I think this is the base environment and should be installed in puppet.
The docker image is mainly for the ease of development. RPM packages should work without assuming the environment. It appropriate package dependency is defined in alluxio package, init-functions is automatically installed by yum/dnf.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "uscxiexing (via GitHub)" <gi...@apache.org>.
uscxiexing commented on code in PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#discussion_r1513914942
##########
bigtop_toolchain/bin/puppetize.sh:
##########
@@ -69,7 +69,8 @@ case ${ID}-${VERSION_ID} in
puppet module install puppetlabs-stdlib --version 4.12.0
# Enabling the PowerTools and EPEL repositories via Puppet doesn't seem to work in some cases.
# As a workaround for that, enable the former here in advance of running the Puppet manifests.
- dnf config-manager --set-enabled crb
+ dnf config-manager --set-enabled crb devel
+ dnf install -y redhat-lsb initscripts
Review Comment:
Thanks. @iwasakims
I run alluxio smoke test test, hadoop installation error,the log is :

1. hadoop installed need /lib/lsb/init-functions in bigto/puppet:trunk-rockylinux-9 ,But it didn't.
2. /lib/lsb/init-functions should pass dnf install redhat-lsb and initscripts.
3. I think this is the base environment and should be installed in puppet. If you don't want to installed it in puppet,can I move provisioner/utils/smoke-test.sh ,and add rockylinux9 branch ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4068: fix the alluxio in rockylinux9 bug [bigtop]
Posted by "MacChen01 (via GitHub)" <gi...@apache.org>.
MacChen01 commented on PR #1243:
URL: https://github.com/apache/bigtop/pull/1243#issuecomment-1989775610
@iwasakims
Please help check the code from your advice, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org