You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2020/01/06 06:05:00 UTC
[jira] [Updated] (SPARK-30400) Test failure in SQL module on
ppc64le
[ https://issues.apache.org/jira/browse/SPARK-30400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-30400:
---------------------------------
Description:
I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however, the test cases are failing in SQL module with following error :
{code}
- CREATE TABLE USING AS SELECT based on the file without write permission *** FAILED ***
Expected exception org.apache.spark.SparkException to be thrown, but no exception was thrown (CreateTableAsSelectSuite.scala:92)
- create a table, drop it and create another one with the same name *** FAILED ***
org.apache.spark.sql.AnalysisException: Table default.jsonTable already exists. You need to drop it first.;
at org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:159)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:104)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:102)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.executeCollect(commands.scala:115)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
at org.apache.spark.sql.Dataset$$anonfun$53.apply(Dataset.scala:3365)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:78)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:125)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:73)
{code}
Would like some help on understanding the cause for the same . I am running it on a High end VM with good connectivity.
was:
I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however, the test cases are failing in SQL module with following error :
- CREATE TABLE USING AS SELECT based on the file without write permission *** FAILED ***
Expected exception org.apache.spark.SparkException to be thrown, but no exception was thrown (CreateTableAsSelectSuite.scala:92)
- create a table, drop it and create another one with the same name *** FAILED ***
org.apache.spark.sql.AnalysisException: Table default.jsonTable already exists. You need to drop it first.;
at org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:159)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:104)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:102)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.executeCollect(commands.scala:115)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
at org.apache.spark.sql.Dataset$$anonfun$53.apply(Dataset.scala:3365)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:78)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:125)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:73)
Would like some help on understanding the cause for the same . I am running it on a High end VM with good connectivity.
> Test failure in SQL module on ppc64le
> -------------------------------------
>
> Key: SPARK-30400
> URL: https://issues.apache.org/jira/browse/SPARK-30400
> Project: Spark
> Issue Type: Test
> Components: Build
> Affects Versions: 2.4.0
> Environment: os: rhel 7.6
> arch: ppc64le
> Reporter: AK97
> Priority: Major
>
> I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however, the test cases are failing in SQL module with following error :
> {code}
> - CREATE TABLE USING AS SELECT based on the file without write permission *** FAILED ***
> Expected exception org.apache.spark.SparkException to be thrown, but no exception was thrown (CreateTableAsSelectSuite.scala:92)
> - create a table, drop it and create another one with the same name *** FAILED ***
> org.apache.spark.sql.AnalysisException: Table default.jsonTable already exists. You need to drop it first.;
> at org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:159)
> at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:104)
> at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:102)
> at org.apache.spark.sql.execution.command.DataWritingCommandExec.executeCollect(commands.scala:115)
> at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
> at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
> at org.apache.spark.sql.Dataset$$anonfun$53.apply(Dataset.scala:3365)
> at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:78)
> at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:125)
> at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:73)
> {code}
> Would like some help on understanding the cause for the same . I am running it on a High end VM with good connectivity.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org