You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@livy.apache.org by "Harsch, Tim" <Ti...@Teradata.com> on 2018/05/15 22:30:35 UTC
%json magick fails to render dataframe schema
Hi,
I am attempting to use %json magick to get back schema info of a dataframe. It fails to populate the dataType field. e.g.
{
"dataType": {},
"metadata": {
"map": {}
},
"name": "venueid",
"nullable": true
}
This gist shows the dataframe schema does provide datatype:
https://gist.githubusercontent.com/harschware/c8c1a2a0e7f4fc5753d006ad8000e7bc/raw/114f806b21b11ad7dc1d7ceaf17c56ae96d2903a/livyResultForSchema.json
This gist shows the %json of the dataframe schema, and all datatype fields are empty objects '{}'
https://gist.githubusercontent.com/harschware/6c0912feaf1851d4a4329066cd253188/raw/913592d8582c6586bac4d24961c5b94d6a0a0007/livyResultForSchemaAsJson.json
I'm pretty sure this is a bug in %json, can anyone confirm? happy to file a Jira for it if needed
Thanks,
Tim