You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@drill.apache.org by Avner Levy <av...@gmail.com> on 2020/03/25 21:45:47 UTC

Controlling number of fragments with Apache Drill CREATE TABLE AS (CTAS) and parquet

I'm running Drill 1.17.0 in embedded mode and reading/writing files to S3.
When I create new CTAS tables it creates 6 small fragments parquet files
(1.5MB each).
Is there a way to control the number of fragments?
To limit it to 1 fragment only?
Already tried the following but it didn't help:

ALTER SYSTEM SET store.parquet.block-size = 1073741824;
ALTER SYSTEM SET store.parquet.writer.use_single_fs_block = true;