[jira] [Created] (DRILL-5139) select array list column - mongodb

["yousuf uddin (JIRA)" <ji...@apache.org>]

yousuf uddin created DRILL-5139:
-----------------------------------

             Summary: select array list column - mongodb
                 Key: DRILL-5139
                 URL: https://issues.apache.org/jira/browse/DRILL-5139
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.8.0
            Reporter: yousuf uddin


Drill versiom : 1.8.0
Mongo:3.2.11

alter session set store.mongo.bson.record.reader = true;
alter session set store.mongo.all_text_mode = true;

Sample Doc

{
    "_id" : ObjectId("58524d507e08dae4c0377b9e"),
    "rule_list" : [
        "A",
        "B",
        "C",
        "D13"
    ],
    "actor_friends_count" : 40,
    "klout_score" : 28,
    "actor_favorites_count" : 1697,
    "actor_preferred_username" : "_20_xxxx",
    "sentiment" : "neu",
    "tweet_id" : "tag:search.twitter.com,2005:000xxxxx",
    "object_actor_followers_count" : 573,
    "actor_posted_time" : "2016-06-24T00:37:54.000Z",
    "actor_id" : "id:twitter.com:xxxxxxxxxx",
    "actor_display_name" : "xxxxxx",
    "retweet_count" : 57,
    "hashtag_list" : [
        "c",
        "d",
        "E",
        "f",
        "VCVC",
        "XXCXCXC",
        "RRRR"
    ],
    "body" : "some tweet blah blah",
    "actor_followers_count" : 21,
    "actor_status_count" : 1756,
    "verb" : "share",
    "posted_time" : "2016-08-01T23:47:43.000Z",
    "object_actor_status_count" : 2796,
    "lang" : "ar",
    "object_actor_preferred_username" : "xxxxxxx",
    "original_tweet_id" : "tag:search.twitter.com,2005:xxxxxxxxxxxx",
    "gender" : "male",
    "object_actor_id" : "id:twitter.com:xxxxxxxxxxxxx",
    "favorites_count" : 0,
    "object_posted_time" : "2016-08-01T22:54:22.000Z",
    "object_actor_friends_count" : 69,
    "generator_display_name" : "Twitter Web Client",
    "object_actor_display_name" : "xxxxxxxxxxxx",
    "actor_listed_count" : 0
}

Queries
1) select rule_list from tweets limit 10;  
2) select flatten(rule_list) from tweets limit 10;  

Result :
Error: SYSTEM ERROR: IllegalArgumentException: You tried to write a VarChar type when you are using a ValueWriter of type UnionListWriter.

Fragment 1:15

[Error Id: 80858afd-9b3c-43cf-b987-7ae8b82021ab on test04.css.org:31010]

  (java.lang.IllegalArgumentException) You tried to write a VarChar type when you are using a ValueWriter of type UnionListWriter.
    org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.fail():762
    org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.write():325
    org.apache.drill.exec.vector.complex.impl.UnionListWriter.write():91
    org.apache.drill.exec.store.bson.BsonRecordReader.writeString():275
    org.apache.drill.exec.store.bson.BsonRecordReader.writeToListOrMap():167
    org.apache.drill.exec.store.bson.BsonRecordReader.writeToListOrMap():112
    org.apache.drill.exec.store.bson.BsonRecordReader.write():75
    org.apache.drill.exec.store.mongo.MongoRecordReader.next():186
    org.apache.drill.exec.physical.impl.ScanBatch.next():178
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():109
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():135
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():109
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    org.apache.drill.exec.physical.impl.flatten.FlattenRecordBatch.innerNext():120
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():109
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    org.apache.drill.exec.physical.impl.limit.LimitRecordBatch.innerNext():115
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():109
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext():94
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    org.apache.drill.exec.physical.impl.BaseRootExec.next():104
    org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext():92
    org.apache.drill.exec.physical.impl.BaseRootExec.next():94
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():232
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():226
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1657
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():226
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1142
    java.util.concurrent.ThreadPoolExecutor$Worker.run():617
    java.lang.Thread.run():745 (state=,code=0)


Kindly Note: if set alter session set store.mongo.bson.record.reader = false; then the above queries works. 





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)