You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/08/22 02:15:20 UTC

[jira] [Commented] (CARBONDATA-132) Parse some Spark Exception which can be shown to driver side and show them directly.

    [ https://issues.apache.org/jira/browse/CARBONDATA-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429966#comment-15429966 ] 

ASF GitHub Bot commented on CARBONDATA-132:
-------------------------------------------

GitHub user Zhangshunyu opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/81

    [CARBONDATA-132] Parse some Spark exception from executor side and show them directly on driver. 

    ## Why raise this pr:
    For example, when data load is failed because of wrong csv file header in load DDL, the exception message only shows in executor side like "CSV header provided in DDL is not proper. Column names in schema and CSV header are not the same" but the user using beeline can not get it from driver side because dirver only shows "Dataload Faluire" , it is very inconvenient for user to get the reason unless he check the executor log info.
    
    ## How to solve:
    Get the SparkException on driver side and parse the cause, when it is DataLoadingException, we can show the DataLoadingException message to driver. Show DataLoadingException is because that it is mainly about CSV file and wrapped in understandable message which can be shown to the user.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/Zhangshunyu/incubator-carbondata exc

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/81.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #81
    
----
commit d6c32cb6ea80ccfe9f7aee1e14236d90933fce1a
Author: Zhangshunyu <zh...@huawei.com>
Date:   2016-08-22T02:08:26Z

    Parse some Spark exception from executor side and show them directly on driver

----


> Parse some Spark Exception which can be shown to driver side and show them directly.
> ------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-132
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-132
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: zhangshunyu
>            Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)