[jira] [Commented] (DRILL-3478) Bson Record Reader for Mongo storage plugin

["B Anil Kumar (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000275#comment-15000275 ] 

B Anil Kumar commented on DRILL-3478:
-------------------------------------

With this current bson reader support, most of bson and extended json type related issues will be resolved. And also this will optimize the drill-mongo query performance(by skipping BSON to JSON serialization and directly parsing BSON).

As of now we can enable bson reader by enabling *alter session set store.mongo.bson.record.reader = true;* and default is JSON Reader. Once we do thourough performance testing then we can make bson as default.

We have tested this feature in both embedded and sharded modes and also executed successfully below test cases. Attaching sqlline test results.

To run test cases with Json:
1) For sharded replicated (default)
mvn test -Ddrill.mongo.tests.shardMode=true

2) For embedded
mvn test -Ddrill.mongo.tests.shardMode=false


To run with bson:
1) For sharded replicated (default)
mvn test -Ddrill.mongo.tests.shardMode=true  -Ddrill.mongo.tests.bson.reader=true

2) For embedded
mvn test -Ddrill.mongo.tests.shardMode=false -Ddrill.mongo.tests.bson.reader=true

> Bson Record Reader for Mongo storage plugin
> -------------------------------------------
>
>                 Key: DRILL-3478
>                 URL: https://issues.apache.org/jira/browse/DRILL-3478
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Storage - MongoDB
>            Reporter: B Anil Kumar
>            Assignee: B Anil Kumar
>             Fix For: Future
>
>         Attachments: drill_bson_sqlline_test_11112015
>
>
> Improve the mongo query performance.
> We are considering the suggestions provided by [~dragoncurve] and [~hgunes] in drill mailing chain.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)