You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Cristian Teodor (JIRA)" <ji...@apache.org> on 2017/05/29 14:25:04 UTC
[jira] [Updated] (SPARK-20914) Javadoc contains code that is
invalid
[ https://issues.apache.org/jira/browse/SPARK-20914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cristian Teodor updated SPARK-20914:
------------------------------------
Description:
i was looking over the [dataset|https://spark.apache.org/docs/2.1.1/api/java/org/apache/spark/sql/Dataset.html] and noticed the code on top that does not make sense in java.
{code}
// To create Dataset<Row> using SparkSession
Dataset<Row> people = spark.read().parquet("...");
Dataset<Row> department = spark.read().parquet("...");
people.filter("age".gt(30))
.join(department, people.col("deptId").equalTo(department("id")))
.groupBy(department.col("name"), "gender")
.agg(avg(people.col("salary")), max(people.col("age")));
{code}
invalid parts:
*"age".gt(30)
*department("id")
was:
i was looking over the {link]dataset|https://spark.apache.org/docs/2.1.1/api/java/org/apache/spark/sql/Dataset.html{link} and noticed the code on top that does not make sense in java.
{code}
// To create Dataset<Row> using SparkSession
Dataset<Row> people = spark.read().parquet("...");
Dataset<Row> department = spark.read().parquet("...");
people.filter("age".gt(30))
.join(department, people.col("deptId").equalTo(department("id")))
.groupBy(department.col("name"), "gender")
.agg(avg(people.col("salary")), max(people.col("age")));
{code}
invalid parts:
*"age".gt(30)
*department("id")
> Javadoc contains code that is invalid
> -------------------------------------
>
> Key: SPARK-20914
> URL: https://issues.apache.org/jira/browse/SPARK-20914
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
> Affects Versions: 2.1.1
> Reporter: Cristian Teodor
> Priority: Minor
>
> i was looking over the [dataset|https://spark.apache.org/docs/2.1.1/api/java/org/apache/spark/sql/Dataset.html] and noticed the code on top that does not make sense in java.
> {code}
> // To create Dataset<Row> using SparkSession
> Dataset<Row> people = spark.read().parquet("...");
> Dataset<Row> department = spark.read().parquet("...");
> people.filter("age".gt(30))
> .join(department, people.col("deptId").equalTo(department("id")))
> .groupBy(department.col("name"), "gender")
> .agg(avg(people.col("salary")), max(people.col("age")));
> {code}
> invalid parts:
> *"age".gt(30)
> *department("id")
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org