You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/07/21 08:03:39 UTC
[GitHub] [spark] ScrapCodes opened a new pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
ScrapCodes opened a new pull request #29177:
URL: https://github.com/apache/spark/pull/29177
…
### What changes were proposed in this pull request?
Change repo for CRAN as per the ubuntu version used in docker image of the release script.
### Why are the changes needed?
Without this change, r-base and r-dev dependency won't install.
```
[root@kyok-test-1 ~]# tail docker-build.log
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
r-base : Depends: r-base-core (>= 4.0.2-1.1804.0) but it is not going to be installed
Depends: r-recommended (= 4.0.2-1.1804.0) but it is not going to be installed
r-base-dev : Depends: r-base-core (>= 4.0.2-1.1804.0) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.
The command '/bin/sh -c apt-get clean && apt-get update && $APT_INSTALL gnupg ca-certificates apt-transport-https && echo 'deb https://cloud.r-project.org/bin/linux/ubuntu bionic-cran40/' >> /etc/apt/sources.list && gpg --keyserver keyserver.ubuntu.com --recv-key E298A3A825C0D65DFD57CBB651716619E084DAB9 && gpg -a --export E084DAB9 | apt-key add - && apt-get clean && rm -rf /var/lib/apt/lists/* && apt-get clean && apt-get update && $APT_INSTALL software-properties-common && apt-add-repository -y ppa:brightbox/ruby-ng && apt-get update && $APT_INSTALL openjdk-8-jdk && update-alternatives --set java /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java && $APT_INSTALL curl wget git maven ivy subversion make gcc lsof libffi-dev pandoc pandoc-citeproc libssl-dev libcurl4-openssl-dev libxml2-dev && ln -s -T /usr/share/java/ivy.jar /usr/share/ant/lib/ivy.jar && curl -sL https://deb.nodesource.com/setup_4.x | bash && $APT_INSTALL nodejs && $APT_INSTALL libpy
thon2.7-dev libpython3-dev python-pip python3-pip && pip install --upgrade pip && hash -r pip && pip install setuptools && pip install $BASE_PIP_PKGS && pip install $PIP_PKGS && cd && virtualenv -p python3 /opt/p35 && . /opt/p35/bin/activate && pip install setuptools && pip install $BASE_PIP_PKGS && pip install $PIP_PKGS && $APT_INSTALL r-base r-base-dev && $APT_INSTALL texlive-latex-base texlive texlive-fonts-extra texinfo qpdf && Rscript -e "install.packages(c('curl', 'xml2', 'httr', 'devtools', 'testthat', 'knitr', 'rmarkdown', 'roxygen2', 'e1071', 'survival'), repos='https://cloud.r-project.org/')" && Rscript -e "devtools::install_github('jimhester/lintr')" && $APT_INSTALL ruby2.3 ruby2.3-dev mkdocs && gem install jekyll --no-rdoc --no-ri -v 3.8.6 && gem install jekyll-redirect-from -v 0.15.0 && gem install pygments.rb' returned a non-zero code: 100
```
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Manually, by applying this patch, create release script pass without errors.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661704544
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661765627
Thanks @ScrapCodes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661782993
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] ScrapCodes edited a comment on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
ScrapCodes edited a comment on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661720966
ahh looks like an oversight, while back porting from https://github.com/apache/spark/pull/28922
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661704275
**[Test build #126239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126239/testReport)** for PR 29177 at commit [`7445efe`](https://github.com/apache/spark/commit/7445efeeedd38f0f1a4926cb17f40c09033cdaae).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661782470
**[Test build #126239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126239/testReport)** for PR 29177 at commit [`7445efe`](https://github.com/apache/spark/commit/7445efeeedd38f0f1a4926cb17f40c09033cdaae).
* This patch **fails Spark unit tests**.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] ScrapCodes commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
ScrapCodes commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661723777
I was working on the release 2.4.7, this would unblock me.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] ScrapCodes commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
ScrapCodes commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661783260
Thank you @HyukjinKwon !
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon closed pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
HyukjinKwon closed pull request #29177:
URL: https://github.com/apache/spark/pull/29177
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] ScrapCodes commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
ScrapCodes commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661714382
@HyukjinKwon Would you like to take a look? I was not sure why you have changed it to bionic?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661765719
I am going to merge this to unblock the release.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661783000
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126239/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661704544
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661704275
**[Test build #126239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126239/testReport)** for PR 29177 at commit [`7445efe`](https://github.com/apache/spark/commit/7445efeeedd38f0f1a4926cb17f40c09033cdaae).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] ScrapCodes edited a comment on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
ScrapCodes edited a comment on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661714382
@HyukjinKwon Would you like to take a look? I was not sure why it was changed to bionic?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661784548
Merged to branch-2.4
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] ScrapCodes commented on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
ScrapCodes commented on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661720966
ahh looks like an oversight from https://github.com/apache/spark/pull/28922
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29177: [SPARK-32379][BUILD] docker based spark release script should use correct CRAN repo.
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #29177:
URL: https://github.com/apache/spark/pull/29177#issuecomment-661782993
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org