Re: MODERATE for dev@carbondata.apache.org

[Liang Chen <ch...@apache.org>]

Hi


First please send one mail to dev-subscribe@carbondata.apache.org
<de...@carbondata.incubator.apache.org> for joining mailing list
group.

After you join mailing list group, please send your question again to
dev@carbondata.apache.org <de...@carbondata.incubator.apache.org>
Please provide the error log message, and your create table script.

Regards
Liang


2017-09-15 11:42 GMT+08:00 <
dev-reject-1505446964.37092.jdlciocnigpdiccpckcd@carbondata.apache.org>:

>
> To approve:
>    dev-accept-1505446964.37092.jdlciocnigpdiccpckcd@carbondata.apache.org
> To reject:
>    dev-reject-1505446964.37092.jdlciocnigpdiccpckcd@carbondata.apache.org
> To give a reason to reject:
> %%% Start comment
> %%% End comment
>
>
>
> ---------- 已转发邮件 ----------
> From: "刘feng" <f....@neusoft.com>
> To: <de...@carbondata.apache.org>
> Cc:
> Bcc:
> Date: Fri, 15 Sep 2017 11:42:26 +0800
> Subject: carbondata 加载数据问题咨询
>
> 您好，
>
>    最近研究carbondata，在加载数据时遇到几个问题：
>
> 1，load 数据量超过10G，在collect at GlobalDictionaryUtil.scala:746
> <http://namenode1:8088/proxy/application_1505443499883_0001/stages/stage?id=4&attempt=0>
> 报错，导致无法进行
>
> 2，5G以内数据，往新建的表中insert时，一两分钟就可以成功，但是按照增量的方式insert时会很慢，大约三十分钟。
>
> 以上，请问有什么优化的办法吗？谢谢！！！
>
> 配置：集群三个 数据节点，配置 128G内存 8核CPU，10块硬盘。
>
>
>
> ------------------------------------------------------------
> -------------------------------------------
>
> 刘峰
>
> Mobile：13889865456 <138%208986%205456>
>
>
>
> ------------------------------------------------------------
> ---------------------------------------
> Confidentiality Notice: The information contained in this e-mail and any
> accompanying attachment(s)
> is intended only for the use of the intended recipient and may be
> confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader
> of this communication is
> not the intended recipient, unauthorized use, forwarding, printing,
> storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this
> communication in error,please
> immediately notify the sender by return e-mail, and delete the original
> message and all copies from
> your system. Thank you.
> ------------------------------------------------------------
> ---------------------------------------
>
>