You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zeppelin.apache.org by bzz <gi...@git.apache.org> on 2016/11/30 14:14:52 UTC

[GitHub] zeppelin pull request #1709: [HOTFIX] Make Spark download stable on CI

GitHub user bzz opened a pull request:

    https://github.com/apache/zeppelin/pull/1709

    [HOTFIX] Make Spark download stable on CI

    ### What is this PR for?
    There has been issues with downloading\caching Spark, esp in #1689 #1696 
    This is hotfix for Spark download on CI.
    
    ### What type of PR is it?
    Hot Fix
    
    ### Todos
    *[x] do not use distrs.apache.org
    *[x] levirage `download-maven-plugin` cache for Spark download
    *[x] set timeout 1min and 5 re-tries on download
    *[x] un-pack them under `/target/` so `mvn clean` works as expected
    *[x] mute logs for `./testing/install_external_dependencies.sh`
    
    ### How should this be tested?
    In CI logs, Spark should be downloaded by `spark-dependencies` and cached under `${HOME}/.m2/repository/.cache/maven-download-plugin`
    
    ### Questions:
    * Does the licenses files need update? No
    * Is there breaking changes for older versions? No
    * Does this needs documentation? No


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bzz/incubator-zeppelin make-ci-stabel

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/zeppelin/pull/1709.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1709
    
----
commit 9ee9c045c21648752791c5692e410df6a6a72349
Author: Alexander Bezzubov <bz...@apache.org>
Date:   2016-11-30T01:55:07Z

    Direct Spark download url for CI as INFRA-12996

commit 605dea9bcb11f90954065f66dd06ee03656fd65a
Author: Alexander Bezzubov <bz...@apache.org>
Date:   2016-11-30T06:38:58Z

    Spark 2.0.1 on CI, same as in pom.xml

commit 7a64690ba60634352a25acff91158e3e4f4c7d81
Author: Alexander Bezzubov <bz...@apache.org>
Date:   2016-11-30T08:55:03Z

    Bump download-maven-plugin version to lastes 1.3.0

commit 78109af26db877fd20b10589351c6975fdc61a73
Author: Alexander Bezzubov <bz...@apache.org>
Date:   2016-11-30T10:04:56Z

    Set readTimeOut for download-maven-plugin

commit 1d85b5c162e2ea25f5dedd099e0df9fa079a0f46
Author: Alexander Bezzubov <bz...@apache.org>
Date:   2016-11-30T10:31:57Z

    Mute dependency install logs

commit 7040b092fd3ea4876a8bfd627ca70070ff4f9ccc
Author: Alexander Bezzubov <bz...@apache.org>
Date:   2016-11-30T13:09:23Z

    Switch Spark download dir

commit 702dcdd112e4501cd4c94b9e4240437ef5f4f745
Author: Alexander Bezzubov <bz...@apache.org>
Date:   2016-11-30T14:03:34Z

    Spark download\cached, using download-maven-plugin

commit 06c031c757a89eda6614949c35b12c7b25855b77
Author: Alexander Bezzubov <bz...@apache.org>
Date:   2016-11-30T14:04:50Z

    Move logging config to MAVEN_OPTS

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1709: [HOTFIX] Make Spark download stable on CI

Posted by 1ambda <gi...@git.apache.org>.

Github user 1ambda commented on the issue:

    https://github.com/apache/zeppelin/pull/1709
  
    This is awesome and thanks for great, great effort of @bzz 
    
    Let me add 1 small detail for who not to see the full history. 
    
    archive.apache has download limitation thus it is safe to use cloudfront server in case of cache miss.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1709: [HOTFIX] Make Spark download stable on CI

Posted by bzz <gi...@git.apache.org>.

Github user bzz commented on the issue:

    https://github.com/apache/zeppelin/pull/1709
  
    CI is green, merging to master as a HOTFIX


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1709: [HOTFIX] Make Spark download stable on CI

Posted by Leemoonsoo <gi...@git.apache.org>.

Github user Leemoonsoo commented on the issue:

    https://github.com/apache/zeppelin/pull/1709
  
    +1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1709: [HOTFIX] Make Spark download stable on CI

Posted by asfgit <gi...@git.apache.org>.

Github user asfgit closed the pull request at:

    https://github.com/apache/zeppelin/pull/1709


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---