You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Vimal Jain <vk...@gmail.com> on 2020/09/21 09:20:29 UTC

Conversion from JSON to Parquet fails using Drill

Hi,
I am trying to convert my JSON data into Parquet format using Apache Drill
CTAS query like below :-

*create table ds2.root.`parquetOutput` as select * from
TABLE(ds1.root.`jsonInput/` (type =>'json'));*

But it fails with error :-








*Error: SYSTEM ERROR: InvalidSchemaException: Cannot write a schema with an
empty group: optional group abc {}Fragment 0:0Please, refer to logs for
more information.[Error Id: fa3c0390-0093-4c4a-9b32-098d5cc68c7e on
ip-172-30-3-153.ec2.internal:31010] (state=,code=0)*

So can someone explain what is the issue here, can't my jsons have a key
"abc" with value as empty object "{}" ?
It's empty in some json files in ds1 but in some there is a value.
Any help to resolve this would be appreciated.

*Thanks and Regards,*
*Vimal Jain*