You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by yhuai <gi...@git.apache.org> on 2015/02/17 20:27:12 UTC
[GitHub] spark pull request: [SPARK-5852][SQL]Fail to convert a newly creat...
GitHub user yhuai opened a pull request:
https://github.com/apache/spark/pull/4655
[SPARK-5852][SQL]Fail to convert a newly created empty metastore parquet table to a data source parquet table.
The problem is that after we create an empty hive metastore parquet table (e.g. `CREATE TABLE test (a int) STORED AS PARQUET`), Hive will create an empty dir for us, which cause our data source `ParquetRelation2` fail to get the schema of the table. See JIRA for the case to reproduce the bug and the exception.
JIRA: https://issues.apache.org/jira/browse/SPARK-5852
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yhuai/spark CTASParquet
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4655.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4655
----
commit 442ffe01ca4abb3ba94ad4fe30604501befcb32b
Author: Cheng Hao <ha...@intel.com>
Date: 2015-02-12T09:19:27Z
passdown the schema for Parquet File in HiveContext
commit a04930badb291e55ba4e6ba79ce781a89f827932
Author: Cheng Hao <ha...@intel.com>
Date: 2015-02-13T03:06:47Z
fix bug of scan an empty parquet based table
commit 36978d1835ab6e0266ad3787b33056b573fd59e8
Author: Cheng Hao <ha...@intel.com>
Date: 2015-02-17T07:17:54Z
Update the code as feedback
commit d7e230851a34bdd80ae622a99c6cc0c2b365eae7
Author: Yin Huai <yh...@databricks.com>
Date: 2015-02-17T17:43:08Z
Revert changes in HiveMetastoreCatalog.scala.
commit 3db3d207dc5e58ce0666b52a71f98bfd646a35b2
Author: Yin Huai <yh...@databricks.com>
Date: 2015-02-17T18:56:49Z
Minor update.
commit 2ac94f73783840b58c1e05110397fe52fdb92db4
Author: Yin Huai <yh...@databricks.com>
Date: 2015-02-17T19:09:06Z
Update tests.
commit b8b34501fb57ac33e36f55dc58a0094c8b40b68a
Author: Yin Huai <yh...@databricks.com>
Date: 2015-02-17T19:23:10Z
Update tests.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-5852][SQL]Fail to convert a newly creat...
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4655#issuecomment-74749230
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/27640/
Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-5852][SQL]Fail to convert a newly creat...
Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4655#issuecomment-74749219
[Test build #27640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27640/consoleFull) for PR 4655 at commit [`b8b3450`](https://github.com/apache/spark/commit/b8b34501fb57ac33e36f55dc58a0094c8b40b68a).
* This patch **passes all tests**.
* This patch merges cleanly.
* This patch adds no public classes.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-5852][SQL]Fail to convert a newly creat...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/4655
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: [SPARK-5852][SQL]Fail to convert a newly creat...
Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4655#issuecomment-74735710
[Test build #27640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27640/consoleFull) for PR 4655 at commit [`b8b3450`](https://github.com/apache/spark/commit/b8b34501fb57ac33e36f55dc58a0094c8b40b68a).
* This patch merges cleanly.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org