You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Mark Grover <ma...@apache.org> on 2016/01/11 21:56:47 UTC
Write access to wiki
Hi all,
May I please get write access to the useful tools
<https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-IntelliJ>
wiki page?
I did some investigation
<https://issues.apache.org/jira/browse/SPARK-12426?focusedCommentId=15083482&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15083482>
related to docker integration tests and want to list out the pre-requisites
required on the machine for those tests to pass, on that page.
On a related note, I was trying to search for any puppet recipes we
maintain for setting up build slaves. If our Jenkins infra were wiped out,
how do we rebuild the slave?
Thanks in advance!
Mark
Re: Write access to wiki
Posted by Nick Pentreath <ni...@gmail.com>.
I'd also like to get Wiki write access - at the least it allows a few of us
to amend the "Powered By" and similar pages when those requests come
through (Sean has been doing a lot of that recently :)
On Mon, Jan 11, 2016 at 11:01 PM, Sean Owen <so...@cloudera.com> wrote:
> ... I forget who can give access -- is it INFRA at Apache or one of us?
> I can apply any edit you need in the meantime.
>
> Shane may be able to fill you in on how the Jenkins build is set up.
>
> On Mon, Jan 11, 2016 at 8:56 PM, Mark Grover <ma...@apache.org> wrote:
> > Hi all,
> > May I please get write access to the useful tools wiki page?
> >
> > I did some investigation related to docker integration tests and want to
> > list out the pre-requisites required on the machine for those tests to
> pass,
> > on that page.
> >
> > On a related note, I was trying to search for any puppet recipes we
> maintain
> > for setting up build slaves. If our Jenkins infra were wiped out, how do
> we
> > rebuild the slave?
> >
> > Thanks in advance!
> >
> > Mark
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
Re: Write access to wiki
Posted by Holden Karau <ho...@pigscanfly.ca>.
Any chance I could also get write access to the wiki? I'd like to update
some of the PySpark documentation in the wiki.
On Tue, Jan 12, 2016 at 10:14 AM, shane knapp <sk...@berkeley.edu> wrote:
> > Ok, sounds good. I think it would be great, if you could add installing
> the
> > 'docker-engine' package and starting the 'docker' service in there too. I
> > was planning to update the playbook if there were one in the apache/spark
> > repo but I didn't see one, hence my question.
> >
> we currently have docker 1.5 running on the worker, and after the
> Great Upgrade To CentOS7, we'll be running a much more modern version
> of docker.
>
> shane
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
--
Cell : 425-233-8271
Twitter: https://twitter.com/holdenkarau
Re: Write access to wiki
Posted by shane knapp <sk...@berkeley.edu>.
> Ok, sounds good. I think it would be great, if you could add installing the
> 'docker-engine' package and starting the 'docker' service in there too. I
> was planning to update the playbook if there were one in the apache/spark
> repo but I didn't see one, hence my question.
>
we currently have docker 1.5 running on the worker, and after the
Great Upgrade To CentOS7, we'll be running a much more modern version
of docker.
shane
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Write access to wiki
Posted by Mark Grover <ma...@apache.org>.
Thanks Sean, I will send you the edit on the JIRA to keep email traffic
low:-)
Thanks Shane, comments in line.
On Mon, Jan 11, 2016 at 2:50 PM, shane knapp <sk...@berkeley.edu> wrote:
> > Shane may be able to fill you in on how the Jenkins build is set up.
> >
> mark: yes. yes i can. :)
>
> currently, we have a set of bash scripts and binary packages on our
> jenkins master that can turn a bare centos install in to a jenkins
> worker.
>
Got it, thanks.
>
> i've also been porting over these bash tools in to ansible playbooks,
> but a lot of development stopped on this after we lost our staging
> instance due to a datacenter fire (yes, really) back in september.
> we're getting a new staging instance (master + slaves) set up in the
> next week or so, and THEN i can finish the ansible port.
>
Ok, sounds good. I think it would be great, if you could add installing the
'docker-engine' package and starting the 'docker' service in there too. I
was planning to update the playbook if there were one in the apache/spark
repo but I didn't see one, hence my question.
> these scripts are checked in to a private AMPLab github repo.
>
> does this help?
>
Yes, it does. Thanks!
>
> shane
>
Re: Write access to wiki
Posted by shane knapp <sk...@berkeley.edu>.
> Shane may be able to fill you in on how the Jenkins build is set up.
>
mark: yes. yes i can. :)
currently, we have a set of bash scripts and binary packages on our
jenkins master that can turn a bare centos install in to a jenkins
worker.
i've also been porting over these bash tools in to ansible playbooks,
but a lot of development stopped on this after we lost our staging
instance due to a datacenter fire (yes, really) back in september.
we're getting a new staging instance (master + slaves) set up in the
next week or so, and THEN i can finish the ansible port.
these scripts are checked in to a private AMPLab github repo.
does this help?
shane
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Write access to wiki
Posted by Sean Owen <so...@cloudera.com>.
... I forget who can give access -- is it INFRA at Apache or one of us?
I can apply any edit you need in the meantime.
Shane may be able to fill you in on how the Jenkins build is set up.
On Mon, Jan 11, 2016 at 8:56 PM, Mark Grover <ma...@apache.org> wrote:
> Hi all,
> May I please get write access to the useful tools wiki page?
>
> I did some investigation related to docker integration tests and want to
> list out the pre-requisites required on the machine for those tests to pass,
> on that page.
>
> On a related note, I was trying to search for any puppet recipes we maintain
> for setting up build slaves. If our Jenkins infra were wiped out, how do we
> rebuild the slave?
>
> Thanks in advance!
>
> Mark
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org