You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zhang, Liyun" <li...@intel.com> on 2016/12/29 06:37:30 UTC

Can anyone help to assign the privilege to me to update the wiki of hive on spark

Hi:

  I want to update wiki<https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started> of hive on spark because HIVE-8373, my account is kellyzly, can anyone help to assign the privilege to me to update wiki?







Best Regards

Kelly Zhang/Zhang,Liyun







-----Original Message-----
From: Rui Li (JIRA) [mailto:jira@apache.org]
Sent: Wednesday, December 28, 2016 5:36 PM
To: Zhang, Liyun <li...@intel.com>
Subject: [jira] [Commented] (HIVE-8373) OOM for a simple query with spark.master=local [Spark Branch]





    [ https://issues.apache.org/jira/browse/HIVE-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15782500#comment-15782500 ]



Rui Li commented on HIVE-8373:

------------------------------



Thanks [~asears] for the explanations. [~kellyzly], yes please go ahead update the wiki. I think we can put it in the [known issue|https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started#HiveonSpark:GettingStarted-CommonIssues(Greenareresolved,willberemovedfromthislist)] part.



> OOM for a simple query with spark.master=local [Spark Branch]

> -------------------------------------------------------------

>

>                 Key: HIVE-8373

>                 URL: https://issues.apache.org/jira/browse/HIVE-8373

>             Project: Hive

>          Issue Type: Bug

>          Components: Spark

>            Reporter: Xuefu Zhang

>            Assignee: liyunzhang_intel

>

> I have a straigh forward query to run in Spark local mode, but get an OOM even though the data volumn is tiny:

> {code}

> Exception in thread "Spark Context Cleaner"

> Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Spark Context Cleaner"

> Exception in thread "Executor task launch worker-1"

> Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Executor task launch worker-1"

> Exception in thread "Keep-Alive-Timer"

> Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Keep-Alive-Timer"

> Exception in thread "Driver Heartbeater"

> Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Driver Heartbeater"

> {code}

> The query is:

> {code}

> select product_name, avg(item_price) as avg_price from product join

> item on item.product_pk=product.product_pk group by product_name order

> by avg_price; {code}







--

This message was sent by Atlassian JIRA

(v6.3.4#6332)


Best Regards
Kelly Zhang/Zhang,Liyun


Re: Can anyone help to assign the privilege to me to update the wiki of hive on spark

Posted by Lefty Leverenz <le...@gmail.com>.
Kelly, first you need to get a Confluence account as described in About
This Wiki
<https://cwiki.apache.org/confluence/display/Hive/AboutThisWiki#AboutThisWiki-Howtogetpermissiontoedit>
.

-- Lefty


On Wed, Dec 28, 2016 at 10:37 PM, Zhang, Liyun <li...@intel.com>
wrote:

> Hi:
>
>   I want to update wiki<https://cwiki.apache.org/
> confluence/display/Hive/Hive+on+Spark%3A+Getting+Started> of hive on
> spark because HIVE-8373, my account is kellyzly, can anyone help to assign
> the privilege to me to update wiki?
>
>
>
>
>
>
>
> Best Regards
>
> Kelly Zhang/Zhang,Liyun
>
>
>
>
>
>
>
> -----Original Message-----
> From: Rui Li (JIRA) [mailto:jira@apache.org]
> Sent: Wednesday, December 28, 2016 5:36 PM
> To: Zhang, Liyun <li...@intel.com>
> Subject: [jira] [Commented] (HIVE-8373) OOM for a simple query with
> spark.master=local [Spark Branch]
>
>
>
>
>
>     [ https://issues.apache.org/jira/browse/HIVE-8373?page=
> com.atlassian.jira.plugin.system.issuetabpanels:comment-
> tabpanel&focusedCommentId=15782500#comment-15782500 ]
>
>
>
> Rui Li commented on HIVE-8373:
>
> ------------------------------
>
>
>
> Thanks [~asears] for the explanations. [~kellyzly], yes please go ahead
> update the wiki. I think we can put it in the [known issue|
> https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+
> Started#HiveonSpark:GettingStarted-CommonIssues(Greenareresolved,
> willberemovedfromthislist)] part.
>
>
>
> > OOM for a simple query with spark.master=local [Spark Branch]
>
> > -------------------------------------------------------------
>
> >
>
> >                 Key: HIVE-8373
>
> >                 URL: https://issues.apache.org/jira/browse/HIVE-8373
>
> >             Project: Hive
>
> >          Issue Type: Bug
>
> >          Components: Spark
>
> >            Reporter: Xuefu Zhang
>
> >            Assignee: liyunzhang_intel
>
> >
>
> > I have a straigh forward query to run in Spark local mode, but get an
> OOM even though the data volumn is tiny:
>
> > {code}
>
> > Exception in thread "Spark Context Cleaner"
>
> > Exception: java.lang.OutOfMemoryError thrown from the
> UncaughtExceptionHandler in thread "Spark Context Cleaner"
>
> > Exception in thread "Executor task launch worker-1"
>
> > Exception: java.lang.OutOfMemoryError thrown from the
> UncaughtExceptionHandler in thread "Executor task launch worker-1"
>
> > Exception in thread "Keep-Alive-Timer"
>
> > Exception: java.lang.OutOfMemoryError thrown from the
> UncaughtExceptionHandler in thread "Keep-Alive-Timer"
>
> > Exception in thread "Driver Heartbeater"
>
> > Exception: java.lang.OutOfMemoryError thrown from the
> UncaughtExceptionHandler in thread "Driver Heartbeater"
>
> > {code}
>
> > The query is:
>
> > {code}
>
> > select product_name, avg(item_price) as avg_price from product join
>
> > item on item.product_pk=product.product_pk group by product_name order
>
> > by avg_price; {code}
>
>
>
>
>
>
>
> --
>
> This message was sent by Atlassian JIRA
>
> (v6.3.4#6332)
>
>
> Best Regards
> Kelly Zhang/Zhang,Liyun
>
>