You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@carbondata.apache.org by carbondata-newuser <yu...@foxmail.com> on 2018/10/26 09:57:17 UTC

Is carbondata replace global dictionary in driver site?

For example.
Assume column A has a global dictionary  encoding, and the dictionary is 
{
      "AAAAA": 1,
      "BBBBB": 2,
      "CCCCC": 3
}
executor 1 return the result [1,2,3]
Finally the driver will replace the 1 to 'AAAAA', 2 to "BBBBB"?
The replace occurs in driver not executor?
If so, I want to ask why?




--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: Is carbondata replace global dictionary in driver site?

Posted by sujith chacko <su...@gmail.com>.

Conversion from dictionary to actual values happens in executor side.
Please refer CarbonDictionaryDecoder.scala class know more details about
conversion logic.

You can also refer the plan by executing explain query.

Thanks,
Sujith

On Fri, 26 Oct 2018 at 3:27 PM, carbondata-newuser <
yunfanfighting@foxmail.com> wrote:

> For example.
> Assume column A has a global dictionary  encoding, and the dictionary is
> {
>       "AAAAA": 1,
>       "BBBBB": 2,
>       "CCCCC": 3
> }
> executor 1 return the result [1,2,3]
> Finally the driver will replace the 1 to 'AAAAA', 2 to "BBBBB"?
> The replace occurs in driver not executor?
> If so, I want to ask why?
>
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>