You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@drill.apache.org by "James Turton (Jira)" <ji...@apache.org> on 2022/01/06 13:15:00 UTC

[jira] [Closed] (DRILL-7232) Error while writing parquet by Drill Docker container Drill version 1.15

     [ https://issues.apache.org/jira/browse/DRILL-7232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

James Turton closed DRILL-7232.
-------------------------------
      Assignee: James Turton
    Resolution: Invalid

Hi thanks for this report.  The stack trace you included comes from Spark SQL not Drill.  I think you're looking in the wrong place for your Parquet write problem.

> Error while writing parquet by Drill Docker container Drill version 1.15
> ------------------------------------------------------------------------
>
>                 Key: DRILL-7232
>                 URL: https://issues.apache.org/jira/browse/DRILL-7232
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Manoj Singh
>            Assignee: James Turton
>            Priority: Critical
>
> We are getting the below error in our application logs. We are running drill1.15 as a docker container.
> The Parquet location /opt/data/parquet-location has all the rights and permissions.
>  
> Please advise what i am doing wrong here.
> 2019-05-02 07:29:02 [WARN ] [] @ Log : warn : 182 - could not write summary file for file:/opt/data/parquet-location/72AB79EC-D841-4D7D-8FEE-2FCEC6D089A7-Online_Search__Snapshot_Data.parquet
> java.lang.NullPointerException
>  at org.apache.parquet.hadoop.ParquetFileWriter.mergeFooters(ParquetFileWriter.java:456)
>  at org.apache.parquet.hadoop.ParquetFileWriter.writeMetadataFile(ParquetFileWriter.java:420)
>  at org.apache.parquet.hadoop.ParquetOutputCommitter.writeMetaDataFile(ParquetOutputCommitter.java:58)
>  at org.apache.parquet.hadoop.ParquetOutputCommitter.commitJob(ParquetOutputCommitter.java:48)
>  at org.apache.spark.sql.execution.datasources.BaseWriterContainer.commitJob(WriterContainer.scala:208)
>  at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply$mcV$sp(InsertIntoHadoopFsRelation.scala:151)
>  at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply(InsertIntoHadoopFsRelation.scala:108)
>  at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply(Inse



--
This message was sent by Atlassian Jira
(v8.20.1#820001)