You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@gobblin.apache.org by ap...@gmail.com on 2019/12/18 17:29:49 UTC

Apache Gobblin Gitter messages at 2019/12/18 09:29:48

####  ![](https://avatars2.githubusercontent.com/u/906477?v=4&s=60) Shirshanka
Das (shirshanka)

**[2019-12-18T17:12:24.892Z]** @treff7es : do you use Parquet in your setup?

* * *

####  ![](https://avatars2.githubusercontent.com/u/906477?v=4&s=60) Shirshanka
Das (shirshanka)

**[2019-12-18T17:25:57.222Z]** @pritamsarkar86 : seems like Parquet has
support for writing protobuf natively? if you use the ProtoParquetWriter
(<https://github.com/apache/parquet-mr/blob/master/parquet-
protobuf/src/main/java/org/apache/parquet/proto/ProtoParquetWriter.java>)

* * *

####  ![](https://avatars2.githubusercontent.com/u/906477?v=4&s=60) Shirshanka
Das (shirshanka)

**[2019-12-18T17:27:53.488Z]** so one option might be to create a separate
ProtoParquetWriter (modeling the ParquetDataWriter) or better ? figuring out
how to refactor the existing ParquetDataWriter (and Builder) to support this
option

* * *