Re: Carbondata performance over Parquet

[Prasanna R <pr...@huawei.com>]

Can you try the below schema with mentioned tableproperties and check the
query performance with Parquet once.

carbon.sql("create table carbon_test_new_7(flowSeqNum integer ,protocolId
integer ,srcTos integer ,dstTos integer ,tcpBits integer ,srcPort integer
,dstPort integer ,workerId integer ,epoch long ,rowNum long ,exportMs long
,pktSeqNum long ,inIfId long ,inIfEntityId long ,outIfId long ,outIfEntityId
long ,inOctets long ,outOctets long ,inPackets long ,outPackets long
,bgpSrcAsNum long ,bgpDstAsNum long ,endMs long ,startMs long
,policyQosQueueId long ,exporterIp string ,srcIp string ,dstIp string
,srcMask string ,dstMask string ,direction string ,nextHopIp string
,bgpNextHopIp string ,appName string ,srcIpGroup string ,dstIpGroup string
,appId string ,policyQosClassificationHierarchy string ,inIfEnabled boolean
,outIfEnabled boolean) stored as carbondata
TBLPROPERTIES('no_inverted_index'='flowSeqNum,protocolId,srcTos,dstTos,tcpBits,srcPort,dstPort,workerId,epoch,rowNum,exportMs,pktSeqNum,inIfId,inIfEntityId,outIfId,outIfEntityId,inOctets,outOctets,inPackets,outPackets,bgpSrcAsNum,bgpDstAsNum,endMs,startMs,policyQosQueueId,exporterIp,srcIp,dstIp,srcMask,dstMask,direction,nextHopIp,bgpNextHopIp,appName,srcIpGroup,dstIpGroup,appId,policyQosClassificationHierarchy,inIfEnabled,outIfEnabled','SORT_COLUMNS'='',
'local_dictionary_enable'='true','table_blocklet_size'='90','table_blocksize'='120')")

").show() 


Please let us know once after testing. 



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/