Parquet SaveMode.Append Trouble.

[satyajit vegesna <sa...@gmail.com>]

Hi,

I am new to using Spark and Parquet files,

Below is what i am trying to do, on Spark-shell,

val df =
sqlContext.parquetFile("/data/LM/Parquet/Segment/pages/part-m-00000.gz.parquet")
Have also tried below command,

val
df=sqlContext.read.format("parquet").load("/data/LM/Parquet/Segment/pages/part-m-00000.gz.parquet")

Now i have an other existing parquet file to which i want to append this
Parquet file data of df.

so i use,

df.save("/data/LM/Parquet/Segment/pages2/part-m-00000.gz.parquet","parquet",
SaveMode.Append )

also tried below command,

df.save("/data/LM/Parquet/Segment/pages2/part-m-00000.gz.parquet",
SaveMode.Append )


and it throws me below error,

<console>:26: error: not found: value SaveMode

df.save("/data/LM/Parquet/Segment/pages2/part-m-00000.gz.parquet","parquet",
SaveMode.Append )

Please help me, in case i am doing something wrong here.

Regards,
Satyajit.

Re: Parquet SaveMode.Append Trouble.

[Cheng Lian <li...@gmail.com>]

You need to import org.apache.spark.sql.SaveMode

Cheng

On 7/31/15 6:26 AM, satyajit vegesna wrote:
> Hi,
>
> I am new to using Spark and Parquet files,
>
> Below is what i am trying to do, on Spark-shell,
>
> val df = 
> sqlContext.parquetFile("/data/LM/Parquet/Segment/pages/part-m-00000.gz.parquet") 
>
> Have also tried below command,
>
> val 
> df=sqlContext.read.format("parquet").load("/data/LM/Parquet/Segment/pages/part-m-00000.gz.parquet")
>
> Now i have an other existing parquet file to which i want to append 
> this Parquet file data of df.
>
> so i use,
>
> df.save("/data/LM/Parquet/Segment/pages2/part-m-00000.gz.parquet","parquet", 
> SaveMode.Append )
>
> also tried below command,
>
> df.save("/data/LM/Parquet/Segment/pages2/part-m-00000.gz.parquet", 
> SaveMode.Append )
>
>
> and it throws me below error,
>
> <console>:26: error: not found: value SaveMode
> df.save("/data/LM/Parquet/Segment/pages2/part-m-00000.gz.parquet","parquet", 
> SaveMode.Append )
>
> Please help me, in case i am doing something wrong here.
>
> Regards,
> Satyajit.
>
>
>


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Parquet SaveMode.Append Trouble.

[StanZhai <ma...@zhaishidan.cn>]

You should import org.apache.spark.sql.SaveMode



--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Parquet-SaveMode-Append-Trouble-tp13529p13531.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org