You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by 马云 <si...@163.com> on 2017/03/08 04:25:26 UTC
question about dimColumnExecuterInfo.getFilterKeys()
Hi Dev,
when do filter query, I can see a filtered byte array.
Does filterValues always has order by the dictionary value?
If not, which case it has no order. thanks
byte[][] filterValues = dimColumnExecuterInfo.getFilterKeys();
Re:Re: question about dimColumnExecuterInfo.getFilterKeys()
Posted by 马云 <si...@163.com>.
thanks
At 2017-03-09 11:09:59, "Ravindra Pesala" <ra...@gmail.com> wrote:
>Hi,
>
>The filter values which we get from query will be converted to respective
>surrogates and sorted on surrogate values before start applying the filter.
>
>
>Regards,
>Ravindra
>
>On 8 March 2017 at 09:55, 马云 <si...@163.com> wrote:
>
>> Hi Dev,
>>
>>
>> when do filter query, I can see a filtered byte array.
>> Does filterValues always has order by the dictionary value?
>> If not, which case it has no order. thanks
>>
>>
>>
>> byte[][] filterValues = dimColumnExecuterInfo.getFilterKeys();
>>
>>
>>
>>
>>
>
>
>--
>Thanks & Regards,
>Ravi
Re: question about dimColumnExecuterInfo.getFilterKeys()
Posted by Ravindra Pesala <ra...@gmail.com>.
Hi,
The filter values which we get from query will be converted to respective
surrogates and sorted on surrogate values before start applying the filter.
Regards,
Ravindra
On 8 March 2017 at 09:55, 马云 <si...@163.com> wrote:
> Hi Dev,
>
>
> when do filter query, I can see a filtered byte array.
> Does filterValues always has order by the dictionary value?
> If not, which case it has no order. thanks
>
>
>
> byte[][] filterValues = dimColumnExecuterInfo.getFilterKeys();
>
>
>
>
>
--
Thanks & Regards,
Ravi
Re:please help for outofmemory issue in eclipse
Posted by 马云 <si...@163.com>.
please ignore my issue.
I change JDK from 1.8 to 1.7 and add the below, it runs successfully now.
-Xmx3550m -Xms3550m -XX:MaxPermSize=512m
At 2017-03-08 17:20:58, "马云" <si...@163.com> wrote:
Hi dev,
today I start setup carbon data 1.0 in my local eclipse
I use "-X -DskipTests -Pspark-1.6 -Dspark.version=1.6.2 clean package" to do maven build in eclipse successfully.
but when I run the CarbonExample in eclipse, it shows the below issue(refer to the below log).
Even I configure -Xmx10g -Xms10g, it also show the issue.
Can anyone help me? thanks
INFO 08-03 16:50:59,037 - Running Spark version 1.6.2
WARN 08-03 16:51:01,624 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO 08-03 16:51:01,752 - Changing view acls to: mayun
INFO 08-03 16:51:01,753 - Changing modify acls to: mayun
INFO 08-03 16:51:01,754 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(mayun); users with modify permissions: Set(mayun)
INFO 08-03 16:51:02,274 - Successfully started service 'sparkDriver' on port 51080.
INFO 08-03 16:51:02,609 - Slf4jLogger started
INFO 08-03 16:51:02,649 - Starting remoting
INFO 08-03 16:51:02,808 - Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@10.100.56.61:51081]
INFO 08-03 16:51:02,814 - Successfully started service 'sparkDriverActorSystem' on port 51081.
INFO 08-03 16:51:02,824 - Registering MapOutputTracker
INFO 08-03 16:51:02,844 - Registering BlockManagerMaster
INFO 08-03 16:51:02,857 - Created local directory at /private/var/folders/qg/b6zvdz3n1cggqx66yzc6m_s40000gn/T/blockmgr-85a89cab-9e48-4708-be89-cde6951285fe
INFO 08-03 16:51:02,870 - MemoryStore started with capacity 12.7 GB
INFO 08-03 16:51:02,926 - Registering OutputCommitCoordinator
INFO 08-03 16:51:03,072 - jetty-8.y.z-SNAPSHOT
INFO 08-03 16:51:03,118 - Started SelectChannelConnector@0.0.0.0:4040
INFO 08-03 16:51:03,118 - Successfully started service 'SparkUI' on port 4040.
INFO 08-03 16:51:03,121 - Started SparkUI at http://10.100.56.61:4040
INFO 08-03 16:51:03,212 - Starting executor ID driver on host localhost
INFO 08-03 16:51:03,228 - Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 51082.
INFO 08-03 16:51:03,229 - Server created on 51082
INFO 08-03 16:51:03,230 - Trying to register BlockManager
INFO 08-03 16:51:03,233 - Registering block manager localhost:51082 with 12.7 GB RAM, BlockManagerId(driver, localhost, 51082)
INFO 08-03 16:51:03,234 - Registered BlockManager
Starting CarbonExample using spark version 1.6.2
Exception in thread "main"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "main"
please help for outofmemory issue in eclipse
Posted by 马云 <si...@163.com>.
Hi dev,
today I start setup carbon data 1.0 in my local eclipse
I use "-X -DskipTests -Pspark-1.6 -Dspark.version=1.6.2 clean package" to do maven build in eclipse successfully.
but when I run the CarbonExample in eclipse, it shows the below issue(refer to the below log).
Even I configure -Xmx10g -Xms10g, it also show the issue.
Can anyone help me? thanks
INFO 08-03 16:50:59,037 - Running Spark version 1.6.2
WARN 08-03 16:51:01,624 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO 08-03 16:51:01,752 - Changing view acls to: mayun
INFO 08-03 16:51:01,753 - Changing modify acls to: mayun
INFO 08-03 16:51:01,754 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(mayun); users with modify permissions: Set(mayun)
INFO 08-03 16:51:02,274 - Successfully started service 'sparkDriver' on port 51080.
INFO 08-03 16:51:02,609 - Slf4jLogger started
INFO 08-03 16:51:02,649 - Starting remoting
INFO 08-03 16:51:02,808 - Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@10.100.56.61:51081]
INFO 08-03 16:51:02,814 - Successfully started service 'sparkDriverActorSystem' on port 51081.
INFO 08-03 16:51:02,824 - Registering MapOutputTracker
INFO 08-03 16:51:02,844 - Registering BlockManagerMaster
INFO 08-03 16:51:02,857 - Created local directory at /private/var/folders/qg/b6zvdz3n1cggqx66yzc6m_s40000gn/T/blockmgr-85a89cab-9e48-4708-be89-cde6951285fe
INFO 08-03 16:51:02,870 - MemoryStore started with capacity 12.7 GB
INFO 08-03 16:51:02,926 - Registering OutputCommitCoordinator
INFO 08-03 16:51:03,072 - jetty-8.y.z-SNAPSHOT
INFO 08-03 16:51:03,118 - Started SelectChannelConnector@0.0.0.0:4040
INFO 08-03 16:51:03,118 - Successfully started service 'SparkUI' on port 4040.
INFO 08-03 16:51:03,121 - Started SparkUI at http://10.100.56.61:4040
INFO 08-03 16:51:03,212 - Starting executor ID driver on host localhost
INFO 08-03 16:51:03,228 - Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 51082.
INFO 08-03 16:51:03,229 - Server created on 51082
INFO 08-03 16:51:03,230 - Trying to register BlockManager
INFO 08-03 16:51:03,233 - Registering block manager localhost:51082 with 12.7 GB RAM, BlockManagerId(driver, localhost, 51082)
INFO 08-03 16:51:03,234 - Registered BlockManager
Starting CarbonExample using spark version 1.6.2
Exception in thread "main"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "main"