You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Shahab Yunus <sh...@gmail.com> on 2018/03/19 15:41:26 UTC

Warnings on data insert into Hive Table using PySpark

Hi there. When I try to insert data into hive tables using the following
query, I get these warnings below. The data is inserted fine (the query
works without warning directly on hive cli as well.) What is the reason for
these warnings and how can we get rid of them?

I am using pyspark interpreter.

*spark_session.sql("insert into schema_name.table_name
(partition_col='JobA') values ('value1', 'value2', '2018-03-10')")*

*-chgrp: '' does not match expected pattern for group*
*Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...*
*-chgrp: '' does not match expected pattern for group
      *
*Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...*
*-chgrp: '' does not match expected pattern for group*
*Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...*
*-chgrp: '' does not match expected pattern for group*
*Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...*

Software:
Scala version 2.11.8
(OpenJDK 64-Bit Server VM, Java 1.8.0_121)
Spark 2.0.2
Hadoop 2.7.3-amzn-0


Thanks & Regards,
Shahab