You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by Yunchuan Zheng <yc...@gmail.com> on 2019/03/09 16:47:58 UTC

[Discussion] Can Parquet separate columns to different blocks?

Hi dev@ community,

I am working on a project where I want to separate columns in a parquet
file, i.e. write different columns to different blocks and place them on
different machines, so they're not organized as row groups. Does Parquet
support such a scenario?

Thanks,
Yunchuan Zheng

Re: [Discussion] Can Parquet separate columns to different blocks?

Posted by Deepak Majeti <ma...@gmail.com>.

You can create two parquet files with different columns in each and write
them to different machines.

On Sat, Mar 9, 2019 at 11:48 AM Yunchuan Zheng <yc...@gmail.com>
wrote:

> Hi dev@ community,
>
> I am working on a project where I want to separate columns in a parquet
> file, i.e. write different columns to different blocks and place them on
> different machines, so they're not organized as row groups. Does Parquet
> support such a scenario?
>
> Thanks,
> Yunchuan Zheng
>

-- 
regards,
Deepak Majeti