You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by HareeshShasrtyMJ <ha...@gmail.com> on 2018/12/17 07:00:18 UTC
How to Write and Read a Nested JSON Into and From Apache Ignite
Table
Hello All,
For one of our big data platform, we are evaluating to have Apache Ignite to
be the data store that is capable of providing,
1. in-memory processing capabilities for performance,
2. ANSI SQL-99 interface
3. Standing up a Dimensional Data Model (Star Schema OR Snowflake) on the
Apache Database,
4. Provide Interface to DB Visualization Tools viz., Tableau and Power BI,
and
5. Ability to Write and Read a Nested JSON Into and From Apache Ignite Table
We have successfully evaluated all the four aforementioned features required
for our platform. However, are currently stuck with the 5 requirement as we
are unable to insert Nested JSON into Apache Ignite table using Scala
DataFrame...we are able to load simple JSON though.
We also followed the Ignite Documentation and articles on blogs that
suggested use of Binary Objects.
However, on evaluation, we found that even Binary Objects do not support
nested levels.
https://issues.apache.org/jira/browse/IGNITE-6265
https://issues.apache.org/jira/browse/IGNITE-6266
https://stackoverflow.com/questions/45674684/is-apache-ignite-suited-for-nosql-schema
Hence, any support or direction or workarounds with corresponding examples
on how to handle Nested JSON with Apache Ignite would be of great help and
Appreciated.
Thank you all in advance.
-----
---------------------
Thanks & Regards,
Hareesh
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: How to Write and Read a Nested JSON Into and From Apache Ignite
Table
Posted by "ilya.kasnacheev" <il...@gmail.com>.
Hello!
You can nest BinaryObjects as deep as you need. I know that there are users
who routinely serialize JSON to BinaryObject.
However, you will not be actually refer to nested data in SQL queries, only
to top-level values.
Regards,
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: How to Write and Read a Nested JSON Into and From Apache Ignite
Table
Posted by HareeshShasrtyMJ <ha...@gmail.com>.
Hello Dennis,
Thank you for the response.
Yes, the Objects need to have same schema.
With regards to Converting to BinaryObjects, please let me know whether
Nested BinaryObject fields more than one level is supported. My
understanding is NO.
My requirement is,
1. Write Simple and Nested JSON into Apache Ignite Table and then be able to
query on the JSON attributes (...irrespective of how it is saved internally
by Apache Ignite).
2. Read from from the Apache Ignite Table as Nested JSON.
Regards,
Hareesh.
-----
---------------------
Thanks & Regards,
Hareesh
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: How to Write and Read a Nested JSON Into and From Apache Ignite Table
Posted by Denis Mekhanikov <dm...@gmail.com>.
Hareesh,
Are the object supposed to have the same schema?
If yes, then JSONs may be converted to BinaryObjects.
If no, then you'll have to store them as blobs or text.
If you want to access such data from SQL, your tables
should have a flat structure. You may have nested binary
objects, but in SQL they will look flat anyway.
Take a look at the following documentation page:
https://apacheignite-sql.readme.io/docs/schema-and-indexes#section-indexing-nested-objects
Denis
пн, 17 дек. 2018 г. в 10:00, HareeshShasrtyMJ <ha...@gmail.com>:
> Hello All,
>
> For one of our big data platform, we are evaluating to have Apache Ignite
> to
> be the data store that is capable of providing,
> 1. in-memory processing capabilities for performance,
> 2. ANSI SQL-99 interface
> 3. Standing up a Dimensional Data Model (Star Schema OR Snowflake) on the
> Apache Database,
> 4. Provide Interface to DB Visualization Tools viz., Tableau and Power BI,
> and
> 5. Ability to Write and Read a Nested JSON Into and From Apache Ignite
> Table
>
> We have successfully evaluated all the four aforementioned features
> required
> for our platform. However, are currently stuck with the 5 requirement as we
> are unable to insert Nested JSON into Apache Ignite table using Scala
> DataFrame...we are able to load simple JSON though.
>
> We also followed the Ignite Documentation and articles on blogs that
> suggested use of Binary Objects.
> However, on evaluation, we found that even Binary Objects do not support
> nested levels.
>
> https://issues.apache.org/jira/browse/IGNITE-6265
> https://issues.apache.org/jira/browse/IGNITE-6266
>
> https://stackoverflow.com/questions/45674684/is-apache-ignite-suited-for-nosql-schema
>
> Hence, any support or direction or workarounds with corresponding examples
> on how to handle Nested JSON with Apache Ignite would be of great help and
> Appreciated.
>
> Thank you all in advance.
>
>
>
> -----
>
> ---------------------
> Thanks & Regards,
> Hareesh
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>