You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2022/09/06 02:00:23 UTC

[GitHub] [bigtop] kevinw66 opened a new pull request, #1002: BIGTOP-3805: Support parent directory configuration for Spark rpm build script

kevinw66 opened a new pull request, #1002:
URL: https://github.com/apache/bigtop/pull/1002

   <!--
     Thanks for sending a pull request!
       1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/BIGTOP/How+to+Contribute
       2. Make sure your PR title starts with JIRA issue id, e.g., 'BIGTOP-3638: Your PR title ...'.
   -->
   
   ### Description of PR
   
   
   ### How was this patch tested?
   diff result:
   ```
   467490 blocks
   467490 blocks
   8386 blocks
   8386 blocks
   69792 blocks
   69792 blocks
   10 blocks
   10 blocks
   10 blocks
   10 blocks
   25856 blocks
   25856 blocks
   13786 blocks
   13790 blocks
   10 blocks
   10 blocks
   10 blocks
   10 blocks
   26599 blocks
   26599 blocks
   ```
   
   
   ### For code changes:
   
   - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'BIGTOP-3638. Your PR title ...')?
   - [ ] Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [bigtop] sekikn commented on pull request #1002: BIGTOP-3805: Support parent directory configuration for Spark rpm build script

Posted by GitBox <gi...@apache.org>.
sekikn commented on PR #1002:
URL: https://github.com/apache/bigtop/pull/1002#issuecomment-1263409903

   +1, tested as follows:
   
   ```
   $ ./gradlew spark-clean spark-pkg repo -Dbuildwithdeps=true
   $ mv output/spark /tmp
   $ curl -sL https://github.com/apache/bigtop/pull/1002.diff | git apply 
   $ ./gradlew spark-clean spark-pkg repo -Dbuildwithdeps=true
   $ for i in $(ls output/spark/noarch); do diff <(rpm -qlp output/spark/noarch/$i) <(rpm -qlp /tmp/spark/noarch/$i); done
   $ ./gradlew spark-clean spark-pkg repo -Dbuildwithdeps=true -PparentDir=/usr/bigtop
   $ for i in $(ls output/spark/noarch); do rpm -qlp output/spark/noarch/$i; done                                                                                                                                        
   /etc/spark                                                                                                                                                                                                                                    
   /usr/bigtop/etc/spark/conf.dist                                                                                                                                                                                                               
   
   ...
   
   /usr/bigtop/etc/spark/conf.dist/workers.template                                                                                                                                                                                              
   /usr/bigtop/usr/bin/find-spark-home                                                                                                                                                                                                           
   /usr/bigtop/usr/bin/spark-class                                                                                                                                                                                                               
   /usr/bigtop/usr/bin/spark-example                                                                                                                                                                                                             
   /usr/bigtop/usr/bin/spark-shell
   /usr/bigtop/usr/bin/spark-sql
   /usr/bigtop/usr/bin/spark-submit
   /usr/bigtop/usr/lib/spark/LICENSE
   
   ...
   
   /usr/bigtop/usr/lib/spark/external/lib/spark-token-provider-kafka-0-10_2.12-3.2.1.jar                                                                                                                                                         
   /etc/rc.d/init.d/spark-history-server                                                                                                                                                                                                         
   /etc/rc.d/init.d/spark-master                                                                                                                                                                                                                 
   /usr/bigtop/usr/bin/pyspark                                                                                                                                                                                                                   
   /usr/bigtop/usr/lib/spark/bin/pyspark                                                                                                                                                                                                         
   
   ...
   
   /usr/bigtop/usr/lib/spark/python/test_support/userlibrary.py                                                                                                                                                                                  
   /usr/bigtop/usr/bin/sparkR                                                                                                                                                                                                                    
   /usr/bigtop/usr/lib/spark/R                                                                                                                                                                                                                   
   
   ...
   
   /usr/bigtop/usr/lib/spark/bin/sparkR                                                                                                                                                                                                          
   /etc/rc.d/init.d/spark-thriftserver                                                                                                                                                                                                           
   /etc/rc.d/init.d/spark-worker                                                                                                                                                                                                                 
   /usr/bigtop/usr/lib/spark/yarn/lib/spark-yarn-shuffle.jar                                                                                                                                                                                     
   /usr/bigtop/usr/lib/spark/yarn/spark-3.2.1-yarn-shuffle.jar                                                                                                                                                                                   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [bigtop] sekikn merged pull request #1002: BIGTOP-3805: Support parent directory configuration for Spark rpm build script

Posted by GitBox <gi...@apache.org>.
sekikn merged PR #1002:
URL: https://github.com/apache/bigtop/pull/1002


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [bigtop] sekikn commented on pull request #1002: BIGTOP-3805: Support parent directory configuration for Spark rpm build script

Posted by GitBox <gi...@apache.org>.
sekikn commented on PR #1002:
URL: https://github.com/apache/bigtop/pull/1002#issuecomment-1263410965

   Merged into master. Thanks @kevinw66!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org