You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2018/07/26 12:51:14 UTC

Qs on Dataset API -- groups of createXXXTempViews and XXXcheckpoint methods

Hi,

I'd appreciate your help on the following two questions about Dataset API:

1. Why do Dataset methods:
createTempView, createOrReplaceTempView, createGlobalTempView
and createOrReplaceGlobalTempView not return a DataFrame? They seem to be
neither actions nor transformations (and probably the reason for a separate
group basic). I wonder why they don't return a DataFrame? Where's the catch?

2. Why are localCheckpoint and checkpoint in the basic group? They'd be
fine to be with untyped transformations since they do transform a Dataset
into a DataFrame. Again, a bit of help would be very helpful.

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Mastering Spark SQL https://bit.ly/mastering-spark-sql
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
Follow me at https://twitter.com/jaceklaskowski