You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Iulian Dragoș <iu...@typesafe.com> on 2015/06/25 15:18:52 UTC
Various forks
Could someone point the source of the Spark-fork used to build
genjavadoc-plugin? Even more important it would be to know the reasoning
behind this fork.
Ironically, this hinders my attempts at removing another fork, the Spark
REPL fork (and the upgrade to Scala 2.11.7). See here
<https://github.com/apache/spark/pull/6903>. Since genjavadoc is a compiler
plugin, it is cross-compiled with the full Scala version, meaning someone
needs to publish a new version for 2.11.7.
Ideally, we'd have a list of all forks maintained by the Spark project. I
know about:
- org.spark-project/akka
- org.spark-project/hive
- org.spark-project/genjavadoc-plugin
Are there more? Where are they hosted, and what's the release process
around them?
thanks,
iulian
--
--
Iulian Dragos
------
Reactive Apps on the JVM
www.typesafe.com
Re: Various forks
Posted by Xiangrui Meng <me...@databricks.com>.
We made that fork to hide package private classes/members in the generated
Java API doc. Otherwise, the Java API doc is very messy. The patch is to
map all private[*] to the default scope in the generated Java code.
However, this might not be the expected behavior for other packages. So it
didn't get merged into the official genjavadoc repo. The proposal is to
have a flag in genjavadoc settings to enable this mapping, but it was
delayed. This is the JIRA for this issue:
https://issues.apache.org/jira/browse/SPARK-7992. -Xiangrui
On Tue, Mar 15, 2016 at 10:50 AM Reynold Xin <rx...@databricks.com> wrote:
> +Xiangrui
>
> On Tue, Mar 15, 2016 at 10:24 AM, Sean Owen <so...@cloudera.com> wrote:
>
>> Picking up this old thread, since we have the same problem updating to
>> Scala 2.11.8
>>
>> https://github.com/apache/spark/pull/11681#issuecomment-196932777
>>
>> We can see the org.spark-project packages here:
>>
>> http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.spark-project%22
>>
>> I've forgotten who maintains the custom fork builds, and I don't know
>> the reasons we needed a fork of genjavadoc. Is it still relevant?
>>
>> Heh, there's no plugin for 2.11.8 from the upstream project either anyway:
>>
>> http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22com.typesafe.genjavadoc%22
>>
>> This may be blocked for now
>>
>> On Thu, Jun 25, 2015 at 2:18 PM, Iulian Dragoș
>> <iu...@typesafe.com> wrote:
>> > Could someone point the source of the Spark-fork used to build
>> > genjavadoc-plugin? Even more important it would be to know the reasoning
>> > behind this fork.
>> >
>> > Ironically, this hinders my attempts at removing another fork, the Spark
>> > REPL fork (and the upgrade to Scala 2.11.7). See here. Since genjavadoc
>> is a
>> > compiler plugin, it is cross-compiled with the full Scala version,
>> meaning
>> > someone needs to publish a new version for 2.11.7.
>> >
>> > Ideally, we'd have a list of all forks maintained by the Spark project.
>> I
>> > know about:
>> >
>> > - org.spark-project/akka
>> > - org.spark-project/hive
>> > - org.spark-project/genjavadoc-plugin
>> >
>> > Are there more? Where are they hosted, and what's the release process
>> around
>> > them?
>> >
>> > thanks,
>> > iulian
>> >
>> > --
>> >
>> > --
>> > Iulian Dragos
>> >
>> > ------
>> > Reactive Apps on the JVM
>> > www.typesafe.com
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>>
>
Re: Various forks
Posted by Reynold Xin <rx...@databricks.com>.
+Xiangrui
On Tue, Mar 15, 2016 at 10:24 AM, Sean Owen <so...@cloudera.com> wrote:
> Picking up this old thread, since we have the same problem updating to
> Scala 2.11.8
>
> https://github.com/apache/spark/pull/11681#issuecomment-196932777
>
> We can see the org.spark-project packages here:
>
> http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.spark-project%22
>
> I've forgotten who maintains the custom fork builds, and I don't know
> the reasons we needed a fork of genjavadoc. Is it still relevant?
>
> Heh, there's no plugin for 2.11.8 from the upstream project either anyway:
>
> http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22com.typesafe.genjavadoc%22
>
> This may be blocked for now
>
> On Thu, Jun 25, 2015 at 2:18 PM, Iulian Dragoș
> <iu...@typesafe.com> wrote:
> > Could someone point the source of the Spark-fork used to build
> > genjavadoc-plugin? Even more important it would be to know the reasoning
> > behind this fork.
> >
> > Ironically, this hinders my attempts at removing another fork, the Spark
> > REPL fork (and the upgrade to Scala 2.11.7). See here. Since genjavadoc
> is a
> > compiler plugin, it is cross-compiled with the full Scala version,
> meaning
> > someone needs to publish a new version for 2.11.7.
> >
> > Ideally, we'd have a list of all forks maintained by the Spark project. I
> > know about:
> >
> > - org.spark-project/akka
> > - org.spark-project/hive
> > - org.spark-project/genjavadoc-plugin
> >
> > Are there more? Where are they hosted, and what's the release process
> around
> > them?
> >
> > thanks,
> > iulian
> >
> > --
> >
> > --
> > Iulian Dragos
> >
> > ------
> > Reactive Apps on the JVM
> > www.typesafe.com
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
Re: Various forks
Posted by Sean Owen <so...@cloudera.com>.
Picking up this old thread, since we have the same problem updating to
Scala 2.11.8
https://github.com/apache/spark/pull/11681#issuecomment-196932777
We can see the org.spark-project packages here:
http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.spark-project%22
I've forgotten who maintains the custom fork builds, and I don't know
the reasons we needed a fork of genjavadoc. Is it still relevant?
Heh, there's no plugin for 2.11.8 from the upstream project either anyway:
http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22com.typesafe.genjavadoc%22
This may be blocked for now
On Thu, Jun 25, 2015 at 2:18 PM, Iulian Dragoș
<iu...@typesafe.com> wrote:
> Could someone point the source of the Spark-fork used to build
> genjavadoc-plugin? Even more important it would be to know the reasoning
> behind this fork.
>
> Ironically, this hinders my attempts at removing another fork, the Spark
> REPL fork (and the upgrade to Scala 2.11.7). See here. Since genjavadoc is a
> compiler plugin, it is cross-compiled with the full Scala version, meaning
> someone needs to publish a new version for 2.11.7.
>
> Ideally, we'd have a list of all forks maintained by the Spark project. I
> know about:
>
> - org.spark-project/akka
> - org.spark-project/hive
> - org.spark-project/genjavadoc-plugin
>
> Are there more? Where are they hosted, and what's the release process around
> them?
>
> thanks,
> iulian
>
> --
>
> --
> Iulian Dragos
>
> ------
> Reactive Apps on the JVM
> www.typesafe.com
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org