You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by GitBox <gi...@apache.org> on 2022/09/17 12:42:24 UTC
[GitHub] [ambari] kevinw66 opened a new pull request, #3366: [WIP]AMBARI-25732: Introduce BIGTOP stack
kevinw66 opened a new pull request, #3366:
URL: https://github.com/apache/ambari/pull/3366
## What changes were proposed in this pull request?
Introduce BIGTOP 3.2.0(snapshot) stack
## How was this patch tested?
(Please explain how this patch was tested. Ex: unit tests, manual tests)
(If this patch involves UI changes, please attach a screen-shot; otherwise, remove this)
Please review [Ambari Contributing Guide](https://cwiki.apache.org/confluence/display/AMBARI/How+to+Contribute) before opening a pull request.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] virajjasani commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
virajjasani commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1250380402
@kevinw66 Thanks a lot for this PR. Curious, where are the select packages located?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] virajjasani commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
virajjasani commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1253164286
With this PR, now it also means that from trunk (3.0.0+) onwards, we no longer need to depend on HDP (or replacement) stack and maybe that's for good, but HDP (or replacement) stack is still required for immediate 2.7.7 release. We will have to maintain common changes accordingly b/ trunk and branch-2.x until 2.x releases are EOL'ed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] brahmareddybattula commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
brahmareddybattula commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1257241658
> With this PR, now it also means that from trunk (3.0.0+) onwards, we no longer need to depend on HDP (or replacement) stack and maybe that's for good, but HDP (or replacement) stack is still required for immediate 2.7.7 release. We will have to maintain common changes accordingly b/ trunk and branch-2.x until 2.x releases are EOL'ed.
branch-2.7 should have stack to updated the clusters from the HDP. Will create tasks for same.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] kevinw66 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
kevinw66 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1253112969
> @kevinw66 looks you committed without review..? it's by mistake..?
Oh I thought Viraj is done review
But also, it's all mpack code from bigtop side, already been reviewed, the bug fixes will have separated PRs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] virajjasani commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
virajjasani commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1253159815
No worries, I was going to test and provide the approval anyways. @kevinw66 also asked to forward-port an HDFS related change that I committed ~3 yr back to branch-2.7 but it was not merged to trunk yet. I will create forward-port PR soon.
Otherwise this PR seems good. We can wait next time onwards. Thanks everyone
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] brahmareddybattula commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
brahmareddybattula commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1250184878
thanks for detailed testing. this needs to have good amount of review. do you want to split the PR..?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] kevinw66 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
kevinw66 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1254643024
> wonder to know that bigtop stack support kerberos or not ?
Yes
> Can't get bigtop stack from Public Repository ?
Please check "Skip Repository Base URL validation(Advanced)"
@lordk911 We do not recommend that you use it now, still plenty of bugs need to be fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] kevinw66 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
kevinw66 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1250113425
## Successfully Installed Services
## Successfully Enabled Kerberos
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] brahmareddybattula commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
brahmareddybattula commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1252634901
@kevinw66 looks you committed without review..? it's by mistake..?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] guyuqi commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
guyuqi commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1253127418
> Please go through following committer guideliness, there are some more.
>
> https://cwiki.apache.org/confluence/display/AMBARI/How+to+Commit
>
> A committer must sign off on a patch. It is very helpful if the community also reviews the patch, but in the end a committer must take responsibility for the correctness of the patch. If the patch is simple enough and the committer feels confident in the review, a single +1 from a committer is sufficient to commit the patch. (Remember committers cannot review their own patch. If a committer submits a patch, they should make sure that another committer reviews it.)
@brahmareddybattula
Thanks for your suggestion and it makes sense.
But this PR was completely ported from Bigtop Mpack and I've reviewed this PR and tested it based on Centos-7 (x86_64 and Arm64).
I'd like to make up for it now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] wangzheyuan commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
wangzheyuan commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1251151690
There is no Ranger in this stack.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] kevinw66 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
kevinw66 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1251207222
> There is no Ranger in this stack.
The work on Ranger is not finished yet on bigtop side.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] brahmareddybattula commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
brahmareddybattula commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1253118207
Please go through following committer guideliness, there are some more.
https://cwiki.apache.org/confluence/display/AMBARI/How+to+Commit
A committer must sign off on a patch. It is very helpful if the community also reviews the patch, but in the end a committer must take responsibility for the correctness of the patch. If the patch is simple enough and the committer feels confident in the review, a single +1 from a committer is sufficient to commit the patch. (Remember committers cannot review their own patch. If a committer submits a patch, they should make sure that another committer reviews it.)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] kevinw66 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
kevinw66 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1251118269
There are still plenty of bugs exists in trunk branch, I'd like to fix it in separate PRs, this PR is only for porting code from `bigtop ambari mpack`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] lordk911 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
lordk911 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1254584818
wonder to know that bigtop stack support kerberos or not ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] kevinw66 merged pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
kevinw66 merged PR #3366:
URL: https://github.com/apache/ambari/pull/3366
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] kevinw66 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
kevinw66 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1250466019
> @kevinw66 Thanks a lot for this PR. Curious, where are the select packages located?
@virajjasani
Sadly, we don't have one right now, the services still installed in `/usr/lib`, considering there are bugs exists in both Ambari and MPack code, so I create this PR first, we can work parallel on stack support and select support, [BIGTOP-3785](https://issues.apache.org/jira/browse/BIGTOP-3785) still needs to be done before we can support select packages.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] kevinw66 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
kevinw66 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1250348483
> thanks for detailed testing. this needs to have good amount of review. do you want to split the PR..?
No need actually, the code is ported from bigtop-ambari-mpack with few changes to compatible with trunk branch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] lordk911 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
lordk911 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1254682086
Thank you for reply，also thanks the great job of ambari and bigtop team.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] lordk911 commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
lordk911 commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1254600996
Can't get bigtop stack from Public Repository ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] guyuqi commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
guyuqi commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1253127693
Tested it based on Centos-7 (x86_64 and Arm64).
+1, LGTM
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org
[GitHub] [ambari] brahmareddybattula commented on pull request #3366: AMBARI-25732: Introduce BIGTOP stack
Posted by GitBox <gi...@apache.org>.
brahmareddybattula commented on PR #3366:
URL: https://github.com/apache/ambari/pull/3366#issuecomment-1253151704
> > Please go through following committer guideliness, there are some more.
> > https://cwiki.apache.org/confluence/display/AMBARI/How+to+Commit
> > A committer must sign off on a patch. It is very helpful if the community also reviews the patch, but in the end a committer must take responsibility for the correctness of the patch. If the patch is simple enough and the committer feels confident in the review, a single +1 from a committer is sufficient to commit the patch. (Remember committers cannot review their own patch. If a committer submits a patch, they should make sure that another committer reviews it.)
>
> @brahmareddybattula Thanks for your suggestion and it makes sense. But this PR was completely ported from Bigtop Mpack and I've reviewed this PR and tested it based on Centos-7 (x86_64 and Arm64). I'd like to make up for it now.
that doesn't mean, we should merge to ambari directly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@ambari.apache.org
For additional commands, e-mail: dev-help@ambari.apache.org