You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2018/01/29 09:58:44 UTC

Nondeterministic Catalyst expressions -- trait and property?!

Hi,

Why does Spark SQL need Nondeterministic trait [1] and property? That must
be confusing for others not only me, right?

[1]
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala#L299

[2]
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala?utf8=%E2%9C%93#L83

Given the exact same names I suspect Nondeterministic trait does more than
the name says (and property could express alone). Any plans to "fix" this
(e.g. renaming the trait)?

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Mastering Spark SQL https://bit.ly/mastering-spark-sql
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
Follow me at https://twitter.com/jaceklaskowski