You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by ARose <As...@telarix.com> on 2015/04/06 16:23:02 UTC
What happened to the Row class in 1.3.0?
I am trying to call Row.create(object[]) similarly to what's shown in this
programming guide
<https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema>
, but the create() method is no longer recognized. I tried to look up the
documentation for the Row api, but it does not seem to exist:
http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row
Is there a new equivalent for doing this programmatic specification of
schema in 1.3.0?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: What happened to the Row class in 1.3.0?
Posted by Nan Zhu <zh...@gmail.com>.
Row class was not documented mistakenly in 1.3.0
you can check the 1.3.1 API doc http://people.apache.org/~pwendell/spark-1.3.1-rc1-docs/api/scala/index.html#org.apache.spark.sql.Row
Best,
--
Nan Zhu
http://codingcat.me
On Monday, April 6, 2015 at 10:23 AM, ARose wrote:
> I am trying to call Row.create(object[]) similarly to what's shown in this
> programming guide
> <https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema>
> , but the create() method is no longer recognized. I tried to look up the
> documentation for the Row api, but it does not seem to exist:
> http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row
>
> Is there a new equivalent for doing this programmatic specification of
> schema in 1.3.0?
>
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com (http://Nabble.com).
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org (mailto:user-unsubscribe@spark.apache.org)
> For additional commands, e-mail: user-help@spark.apache.org (mailto:user-help@spark.apache.org)
>
>
Re: What happened to the Row class in 1.3.0?
Posted by Ted Yu <yu...@gmail.com>.
Thanks Nan.
I was searching for RowFactory.scala
Cheers
On Mon, Apr 6, 2015 at 7:52 AM, Nan Zhu <zh...@gmail.com> wrote:
> Hi, Ted
>
> It’s here:
> https://github.com/apache/spark/blob/61b427d4b1c4934bd70ed4da844b64f0e9a377aa/sql/catalyst/src/main/java/org/apache/spark/sql/RowFactory.java
>
> Best,
>
> --
> Nan Zhu
> http://codingcat.me
>
> On Monday, April 6, 2015 at 10:44 AM, Ted Yu wrote:
>
> I searched code base but didn't find RowFactory class.
>
> Pardon me.
>
> On Mon, Apr 6, 2015 at 7:39 AM, Ted Yu <yu...@gmail.com> wrote:
>
> From scaladoc
> of sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala :
>
> * To create a new Row, use [[RowFactory.create()]] in Java or
> [[Row.apply()]] in Scala.
> *
>
> Cheers
>
> On Mon, Apr 6, 2015 at 7:23 AM, ARose <As...@telarix.com> wrote:
>
> I am trying to call Row.create(object[]) similarly to what's shown in this
> programming guide
> <
> https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema
> >
> , but the create() method is no longer recognized. I tried to look up the
> documentation for the Row api, but it does not seem to exist:
>
> http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row
>
> Is there a new equivalent for doing this programmatic specification of
> schema in 1.3.0?
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
>
>
>
Re: What happened to the Row class in 1.3.0?
Posted by Nan Zhu <zh...@gmail.com>.
Hi, Ted
It’s here: https://github.com/apache/spark/blob/61b427d4b1c4934bd70ed4da844b64f0e9a377aa/sql/catalyst/src/main/java/org/apache/spark/sql/RowFactory.java
Best,
--
Nan Zhu
http://codingcat.me
On Monday, April 6, 2015 at 10:44 AM, Ted Yu wrote:
> I searched code base but didn't find RowFactory class.
>
> Pardon me.
>
> On Mon, Apr 6, 2015 at 7:39 AM, Ted Yu <yuzhihong@gmail.com (mailto:yuzhihong@gmail.com)> wrote:
> > From scaladoc of sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala :
> >
> > * To create a new Row, use [[RowFactory.create()]] in Java or [[Row.apply()]] in Scala.
> > *
> >
> >
> > Cheers
> >
> > On Mon, Apr 6, 2015 at 7:23 AM, ARose <Ashley.Rose@telarix.com (mailto:Ashley.Rose@telarix.com)> wrote:
> > > I am trying to call Row.create(object[]) similarly to what's shown in this
> > > programming guide
> > > <https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema>
> > > , but the create() method is no longer recognized. I tried to look up the
> > > documentation for the Row api, but it does not seem to exist:
> > > http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row
> > >
> > > Is there a new equivalent for doing this programmatic specification of
> > > schema in 1.3.0?
> > >
> > >
> > >
> > >
> > > --
> > > View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html
> > > Sent from the Apache Spark User List mailing list archive at Nabble.com (http://Nabble.com).
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: user-unsubscribe@spark.apache.org (mailto:user-unsubscribe@spark.apache.org)
> > > For additional commands, e-mail: user-help@spark.apache.org (mailto:user-help@spark.apache.org)
> > >
> >
>
Re: What happened to the Row class in 1.3.0?
Posted by Ted Yu <yu...@gmail.com>.
I searched code base but didn't find RowFactory class.
Pardon me.
On Mon, Apr 6, 2015 at 7:39 AM, Ted Yu <yu...@gmail.com> wrote:
> From scaladoc
> of sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala :
>
> * To create a new Row, use [[RowFactory.create()]] in Java or
> [[Row.apply()]] in Scala.
> *
>
> Cheers
>
> On Mon, Apr 6, 2015 at 7:23 AM, ARose <As...@telarix.com> wrote:
>
>> I am trying to call Row.create(object[]) similarly to what's shown in
>> this
>> programming guide
>> <
>> https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema
>> >
>> , but the create() method is no longer recognized. I tried to look up the
>> documentation for the Row api, but it does not seem to exist:
>>
>> http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row
>>
>> Is there a new equivalent for doing this programmatic specification of
>> schema in 1.3.0?
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>
Re: What happened to the Row class in 1.3.0?
Posted by Ted Yu <yu...@gmail.com>.
>From scaladoc of sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala
:
* To create a new Row, use [[RowFactory.create()]] in Java or
[[Row.apply()]] in Scala.
*
Cheers
On Mon, Apr 6, 2015 at 7:23 AM, ARose <As...@telarix.com> wrote:
> I am trying to call Row.create(object[]) similarly to what's shown in this
> programming guide
> <
> https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema
> >
> , but the create() method is no longer recognized. I tried to look up the
> documentation for the Row api, but it does not seem to exist:
>
> http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row
>
> Is there a new equivalent for doing this programmatic specification of
> schema in 1.3.0?
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>